parsl.dataflow.dependency_resolvers.DEEP_DEPENDENCY_RESOLVER
- parsl.dataflow.dependency_resolvers.DEEP_DEPENDENCY_RESOLVER = DependencyResolver(traverse_to_gather=<function deep_traverse_to_gather>, traverse_to_unwrap=<function deep_traverse_to_unwrap>)[source]
A DependencyResolver describes how app dependencies can be resolved. It is specified as two functions:
traverse_to_gather
which turns an app parameter into a sequence of futures which must be waited for before the task can be executed (for example, in the case ofDEEP_DEPENDENCY_RESOLVER
this traverses structures such as lists to find every containedFuture
), andtraverse_to_unwrap
which turns an app parameter into its value to be passed to the app on execution (for example in the case ofDEEP_DEPENDENCY_RESOLVER
this replaces a list containing futures with a new list containing the values of those resolved futures).By default, Parsl will use
SHALLOW_DEPENDENCY_RESOLVER
which only resolves Futures passed directly as arguments.