parsl.data_provider.http.HTTPSeparateTaskStaging

class parsl.data_provider.http.HTTPSeparateTaskStaging[source]

A staging provider that Performs HTTP and HTTPS staging as a separate parsl-level task. This requires a shared file system on the executor.

__init__()[source]

Initialize self. See help(type(self)) for accurate signature.

Methods

__init__

Initialize self.

can_stage_in(file)

Given a File object, decide if this staging provider can stage the file.

can_stage_out(file)

Like can_stage_in, but for staging out.

replace_task(dm, executor, file, func)

For a file to be staged in, optionally return a replacement app function, which usually should be the original app function wrapped in staging code.

replace_task_stage_out(dm, executor, file, func)

For a file to be staged out, optionally return a replacement app function, which usually should be the original app function wrapped in staging code.

stage_in(dm, executor, file, parent_fut)

This call gives the staging provider an opportunity to prepare for stage-in and to launch arbitrary tasks which must complete as part of stage-in.

stage_out(dm, executor, file, app_fu)

This call gives the staging provider an opportunity to prepare for stage-out and to launch arbitrary tasks which must complete as part of stage-out.