parsl.data_provider.rsync.RSyncStaging

class parsl.data_provider.rsync.RSyncStaging(hostname)

This staging provider will execute rsync on worker nodes to stage in files from a remote location.

Worker nodes must be able to authenticate to the rsync server without interactive authentication - for example, worker initialization could include an appropriate SSH key configuration.

The submit side will need to run an rsync-compatible server (for example, an ssh server with the rsync binary installed)

__init__(hostname)

Initialize self. See help(type(self)) for accurate signature.

Methods

__init__(hostname)	Initialize self.
can_stage_in(file)	Given a File object, decide if this staging provider can stage the file.
can_stage_out(file)	Like can_stage_in, but for staging out.
replace_task(dm, executor, file, f)	For a file to be staged in, optionally return a replacement app function, which usually should be the original app function wrapped in staging code.
replace_task_stage_out(dm, executor, file, f)	For a file to be staged out, optionally return a replacement app function, which usually should be the original app function wrapped in staging code.
stage_in(dm, executor, file, parent_fut)	This call gives the staging provider an opportunity to prepare for stage-in and to launch arbitrary tasks which must complete as part of stage-in.
stage_out(dm, executor, file, parent_fut)	This call gives the staging provider an opportunity to prepare for stage-out and to launch arbitrary tasks which must complete as part of stage-out.