parsl.data_provider.data_manager.DataManager

class parsl.data_provider.data_manager.DataManager(dfk: DataFlowKernel)[source]

The DataManager is responsible for transferring input and output data.

__init__(dfk: DataFlowKernel) → None[source]

Initialize the DataManager.

Parameters:dfk (-) – The DataFlowKernel that this DataManager is managing data for.

Methods

__init__(dfk) Initialize the DataManager.
DataManager.add_file
DataManager.get_data_manager
DataManager.scale_in
DataManager.scale_out
DataManager.shutdown
stage_in(file, input, executor) Transport the input from the input source to the executor, if it is file-like, returning a DataFuture that wraps the stage-in operation.
stage_out(file, executor, app_fu) Transport the file from the local filesystem to the remote Globus endpoint.
DataManager.start
DataManager.submit

Attributes

DataManager.run_dir
DataManager.scaling_enabled