parsl.data_provider.data_manager.DataManager

class parsl.data_provider.data_manager.DataManager(dfk: DataFlowKernel)[source]

The DataManager is responsible for transferring input and output data.

__init__(dfk: DataFlowKernel) → None[source]

Initialize the DataManager.

Parameters

dfk (-) – The DataFlowKernel that this DataManager is managing data for.

Methods

__init__(dfk)

Initialize the DataManager.

optionally_stage_in(input, func, executor)

replace_task(file, func, executor)

This will give staging providers the chance to wrap (or replace entirely!) the task function.

replace_task_stage_out(file, func, executor)

This will give staging providers the chance to wrap (or replace entirely!) the task function.

stage_in(file, input, executor)

Transport the input from the input source to the executor, if it is file-like, returning a DataFuture that wraps the stage-in operation.

stage_out(file, executor, app_fu)

Transport the file from the local filesystem to the remote Globus endpoint.