cls_luigi.tests.test_inhabitation_task_repometa

Module Contents

Classes

StartNode	Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.
SomeAbstractClass	Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.
ConcreteClass4	Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.
SomeAbstractAbstractClass	Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.
ConcreteClass1	Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.
ConcreteClass2	Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.
ConcreteClass3	Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.
SomeOtherAbstractAbstractClass	Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.
ConcreteClassInAbstractChain	Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.
AbstractFromConcreteClassInChain	Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.
ConcreteClass5	Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.
ConcreteClass6	Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.
ConcreteClass7	Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.
UnrelatedAbstractClass	Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.
UnrelatedConcreteClass1	Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.
UnrelatedConcreteClass2	Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.
EndNode	Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.
EndEndNode	This is the base class of all Luigi Tasks, the base unit of work in Luigi.
WrapperTask	Abstract class representing a CLS-Luigi wrapper task. It combines the functionality of luigi.WrapperTask, LuigiCombinator, and ClsBaseTask.
TestRepositoryFilterMethods	A class whose instances are single test cases.

Functions

show_repository_and_subtypes_dict()

class cls_luigi.tests.test_inhabitation_task_repometa.StartNode(*args, **kwargs)

Bases: cls_luigi.cls_tasks.ClsTask

Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.

abstract = False

output()

The output that this Task produces.

The output of the Task determines if the Task needs to be run–the task is considered finished iff the outputs all exist. Subclasses should override this method to return a single Target or a list of Target instances.

Implementation note

If running multiple workers, the output must be a resource that is accessible by all workers, such as a DFS or database. Otherwise, workers might compute the same output since they don’t see the work done by other workers.

See Task.output

run()

The task run method, to be overridden in a subclass.

See Task.run

class cls_luigi.tests.test_inhabitation_task_repometa.SomeAbstractClass(*args, **kwargs)

Bases: cls_luigi.cls_tasks.ClsTask

Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.

abstract = True

requires()

The Tasks that this Task depends on.

A Task will only run if all of the Tasks that it requires are completed. If your Task does not require any other Tasks, then you don’t need to override this method. Otherwise, a subclass can override this method to return a single Task, a list of Task instances, or a dict whose values are Task instances.

See Task.requires

output()

The output that this Task produces.

The output of the Task determines if the Task needs to be run–the task is considered finished iff the outputs all exist. Subclasses should override this method to return a single Target or a list of Target instances.

Implementation note

If running multiple workers, the output must be a resource that is accessible by all workers, such as a DFS or database. Otherwise, workers might compute the same output since they don’t see the work done by other workers.

See Task.output

run()

The task run method, to be overridden in a subclass.

See Task.run

class cls_luigi.tests.test_inhabitation_task_repometa.ConcreteClass4(*args, **kwargs)

Bases: SomeAbstractClass

Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.

abstract = False

class cls_luigi.tests.test_inhabitation_task_repometa.SomeAbstractAbstractClass(*args, **kwargs)

Bases: SomeAbstractClass

Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.

abstract = True

class cls_luigi.tests.test_inhabitation_task_repometa.ConcreteClass1(*args, **kwargs)

Bases: SomeAbstractAbstractClass

Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.

abstract = False

class cls_luigi.tests.test_inhabitation_task_repometa.ConcreteClass2(*args, **kwargs)

Bases: SomeAbstractAbstractClass

Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.

abstract = False

class cls_luigi.tests.test_inhabitation_task_repometa.ConcreteClass3(*args, **kwargs)

Bases: SomeAbstractAbstractClass

Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.

abstract = False

class cls_luigi.tests.test_inhabitation_task_repometa.SomeOtherAbstractAbstractClass(*args, **kwargs)

Bases: SomeAbstractClass

Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.

abstract = True

class cls_luigi.tests.test_inhabitation_task_repometa.ConcreteClassInAbstractChain(*args, **kwargs)

Bases: SomeOtherAbstractAbstractClass

Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.

abstract = False

class cls_luigi.tests.test_inhabitation_task_repometa.AbstractFromConcreteClassInChain(*args, **kwargs)

Bases: ConcreteClassInAbstractChain

Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.

abstract = True

class cls_luigi.tests.test_inhabitation_task_repometa.ConcreteClass5(*args, **kwargs)

Bases: AbstractFromConcreteClassInChain

Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.

abstract = False

class cls_luigi.tests.test_inhabitation_task_repometa.ConcreteClass6(*args, **kwargs)

Bases: AbstractFromConcreteClassInChain

Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.

abstract = False

class cls_luigi.tests.test_inhabitation_task_repometa.ConcreteClass7(*args, **kwargs)

Bases: AbstractFromConcreteClassInChain

Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.

abstract = False

class cls_luigi.tests.test_inhabitation_task_repometa.UnrelatedAbstractClass(*args, **kwargs)

Bases: cls_luigi.cls_tasks.ClsTask

Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.

abstract = True

some_class

requires()

The Tasks that this Task depends on.

A Task will only run if all of the Tasks that it requires are completed. If your Task does not require any other Tasks, then you don’t need to override this method. Otherwise, a subclass can override this method to return a single Task, a list of Task instances, or a dict whose values are Task instances.

See Task.requires

output()

The output that this Task produces.

The output of the Task determines if the Task needs to be run–the task is considered finished iff the outputs all exist. Subclasses should override this method to return a single Target or a list of Target instances.

Implementation note

If running multiple workers, the output must be a resource that is accessible by all workers, such as a DFS or database. Otherwise, workers might compute the same output since they don’t see the work done by other workers.

See Task.output

run()

The task run method, to be overridden in a subclass.

See Task.run

class cls_luigi.tests.test_inhabitation_task_repometa.UnrelatedConcreteClass1(*args, **kwargs)

Bases: UnrelatedAbstractClass

Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.

abstract = False

class cls_luigi.tests.test_inhabitation_task_repometa.UnrelatedConcreteClass2(*args, **kwargs)

Bases: UnrelatedAbstractClass

Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.

abstract = False

class cls_luigi.tests.test_inhabitation_task_repometa.EndNode(*args, **kwargs)

Bases: cls_luigi.cls_tasks.ClsTask

Abstract class representing a CLS-Luigi task. It combines the functionality of luigi.Task, LuigiCombinator, and ClsBaseTask.

abstract = False

unreleated_class

requires()

The Tasks that this Task depends on.

A Task will only run if all of the Tasks that it requires are completed. If your Task does not require any other Tasks, then you don’t need to override this method. Otherwise, a subclass can override this method to return a single Task, a list of Task instances, or a dict whose values are Task instances.

See Task.requires

output()

The output that this Task produces.

The output of the Task determines if the Task needs to be run–the task is considered finished iff the outputs all exist. Subclasses should override this method to return a single Target or a list of Target instances.

Implementation note

If running multiple workers, the output must be a resource that is accessible by all workers, such as a DFS or database. Otherwise, workers might compute the same output since they don’t see the work done by other workers.

See Task.output

run()

The task run method, to be overridden in a subclass.

See Task.run

class cls_luigi.tests.test_inhabitation_task_repometa.EndEndNode(*args, **kwargs)

Bases: luigi.Task, cls_luigi.inhabitation_task.LuigiCombinator

This is the base class of all Luigi Tasks, the base unit of work in Luigi.

A Luigi Task describes a unit or work.

The key methods of a Task, which must be implemented in a subclass are:

• run() - the computation done by this task.

• requires() - the list of Tasks that this Task depends on.

• output() - the output Target that this Task creates.

Each Parameter of the Task should be declared as members:

class MyTask(luigi.Task):
    count = luigi.IntParameter()
    second_param = luigi.Parameter()

In addition to any declared properties and methods, there are a few non-declared properties, which are created by the Register metaclass:

class cls_luigi.tests.test_inhabitation_task_repometa.WrapperTask(*args, **kwargs)

Bases: cls_luigi.cls_tasks.ClsWrapperTask

Abstract class representing a CLS-Luigi wrapper task. It combines the functionality of luigi.WrapperTask, LuigiCombinator, and ClsBaseTask.

abstract = False

config

config_domain

requires()

The Tasks that this Task depends on.

A Task will only run if all of the Tasks that it requires are completed. If your Task does not require any other Tasks, then you don’t need to override this method. Otherwise, a subclass can override this method to return a single Task, a list of Task instances, or a dict whose values are Task instances.

See Task.requires

class cls_luigi.tests.test_inhabitation_task_repometa.TestRepositoryFilterMethods(methodName='runTest')

Bases: unittest.TestCase

A class whose instances are single test cases.

By default, the test code itself should be placed in a method named ‘runTest’.

If the fixture may be used for many test cases, create as many test methods as are needed. When instantiating such a TestCase subclass, specify in the constructor arguments the name of the test method that the instance is to execute.

Test authors should subclass TestCase for their own tests. Construction and deconstruction of the test’s environment (‘fixture’) can be implemented by overriding the ‘setUp’ and ‘tearDown’ methods respectively.

If it is necessary to override the __init__ method, the base class __init__ method must always be called. It is important that subclasses should not change the signature of their __init__ method, since instances of the classes are instantiated automatically by parts of the framework in order to be run.

When subclassing TestCase, you can set these attributes: * failureException: determines which exception will be raised when

the instance’s assertion methods fail; test methods raising this exception will be deemed to have ‘failed’ rather than ‘errored’.

• longMessage: determines whether long messages (including repr of

  objects used in assert methods) will be printed on failure in addition to any explicit message passed.

• maxDiff: sets the maximum length of a diff in failure messages

  by assert methods using difflib. It is looked up as an instance attribute so can be configured by individual tests if required.

classmethod tearDownClass()

Hook method for deconstructing the class fixture after running all tests in the class.

test_get_list_of_all_upstream_classes_ConcreteClass3()

test_get_list_of_all_upstream_classes_ConcreteClass4()

test_get_list_of_all_upstream_classes_ConcreteClass5()

test_get_list_of_all_upstream_abstract_classes_ConcreteClass3()

test_get_list_of_all_upstream_abstract_classes_ConcreteClass5()

test_get_list_of_all_upstream_abstract_classes_AbstractFromConcreteClassInChain()

test_get_list_of_all_upstream_abstract_classes_ConcreteClassInAbstractChain()

test_get_all_upstream_classes_ConcreteClass1()

test_get_set_of_all_downstream_classes_ConcreteClassInAbstractChain()

test_get_set_of_all_downstream_classes_SomeAbstractClass()

test_get_all_downstream_abstract_classes_SomeAbstractClass()

test_get_all_downstream_abstract_classes_UnrelatedAbstractClass()

test_get_class_chain_SomeAbstractClass()

test_get_class_chain_ConcreteClass5()

test_get_abstract_class_chain_SomeAbstractClass()

test_get_maximal_shared_upper_classes_ConcreteClass5_ConcreteClass6()

test_get_maximal_shared_upper_classes_ConcreteClass2_ConcreteClass7()

test_get_all_downstream_concrete_classes_ConcreteClassInAbstractChain()

test_get_all_downstream_concrete_classes_SomeAbstractClass()

test_delete_related_combinators_1()

test_delete_related_combinators_2()

test_filtered_repository_SomeAbstractAbstractClass()

test_filtered_repository_ConcreteClass1_ConcreteClass2()

test_filtered_repository_SomeOtherAbstractAbstractClass_UnrelatedConcreteClass1()

test_filtered_repository_with_deep_filter()

cls_luigi.tests.test_inhabitation_task_repometa.show_repository_and_subtypes_dict()