parsl.channels.base.Channel
- class parsl.channels.base.Channel[source]
Channels are abstractions that enable ExecutionProviders to talk to resource managers of remote compute facilities.
For certain resources such as campus clusters or supercomputers at research laboratories, resource requirements may require authentication. For instance some resources may allow access to their job schedulers from only their login-nodes which require you to authenticate through SSH, or require two factor authentication.
The simplest Channel, LocalChannel, executes commands locally in a shell, while the SSHChannel authenticates you to remote systems.
Channels provide the ability to execute commands remotely, using the execute_wait method, and manipulate the remote file system using methods such as push_file, pull_file and makedirs.
Channels should ensure that each launched command runs in a new process group, so that providers (such as AdHocProvider and LocalProvider) which terminate long running commands using process groups can do so.
Methods
__init__
()abspath
(path)Return the absolute path.
close
()Closes the channel.
execute_wait
(cmd[, walltime, envs])Executes the cmd, with a defined walltime.
isdir
(path)Return true if the path refers to an existing directory.
makedirs
(path[, mode, exist_ok])Create a directory.
pull_file
(remote_source, local_dir)Transport file on the remote side to a local directory
push_file
(source, dest_dir)Channel will take care of moving the file from source to the destination directory
Attributes
This is a property.
- abstract abspath(path: str) str [source]
Return the absolute path.
- Parameters:
path (str) – Path for which the absolute path will be returned.
- abstract close() bool [source]
Closes the channel. Clean out any auth credentials.
- Parameters:
None –
- Returns:
Bool
- abstract execute_wait(cmd: str, walltime: int = 0, envs: Dict[str, str] = {}) Tuple[int, str, str] [source]
Executes the cmd, with a defined walltime.
- Parameters:
cmd (-) – Command string to execute over the channel
walltime (-) – Timeout in seconds
- KWargs:
envs (Dict[str, str]) : Environment variables to push to the remote side
- Returns:
(exit_code, stdout, stderr) (int, string, string)
- abstract isdir(path: str) bool [source]
Return true if the path refers to an existing directory.
- Parameters:
path (str) – Path of directory to check.
- abstract makedirs(path: str, mode: int = 329, exist_ok: bool = False) None [source]
Create a directory.
If intermediate directories do not exist, they will be created.
- abstract pull_file(remote_source: str, local_dir: str) str [source]
Transport file on the remote side to a local directory
- Parameters:
remote_source (string) – remote_source
local_dir (string) – Local directory to copy to
- Returns:
destination_path (string)
- abstract push_file(source: str, dest_dir: str) str [source]
Channel will take care of moving the file from source to the destination directory
- Parameters:
source (string) – Full filepath of the file to be moved
dest_dir (string) – Absolute path of the directory to move to
- Returns:
destination_path (string)
- abstract property script_dir: str[source]
This is a property. Returns the directory assigned for storing all internal scripts such as scheduler submit scripts. This is usually where error logs from the scheduler would reside on the channel destination side.
- Parameters:
None (-) –
- Returns:
Channel script dir