class parsl.executors.base.ParslExecutor[source]

Executors are abstractions that represent available compute resources to which you could submit arbitrary App tasks.

This is an abstract base class that only enforces concrete implementations of functionality by the child classes.

Can be used as a context manager. On exit, calls self.shutdown() with no arguments and re-raises any thrown exception.

In addition to the listed methods, a ParslExecutor instance must always have a member field:

label: str - a human readable label for the executor, unique

with respect to other executors.

Per-executor monitoring behaviour can be influenced by exposing:

radio_mode: str - a string describing which radio mode should be used to

send task resource data back to the submit side.

An executor may optionally expose:

storage_access: List[parsl.data_provider.staging.Staging] - a list of staging

providers that will be used for file staging. In the absence of this attribute, or if this attribute is None, then a default value of parsl.data_provider.staging.default_staging will be used by the staging code.

Typechecker note: Ideally storage_access would be declared on executor __init__ methods as List[Staging] - however, lists are by default invariant, not co-variant, and it looks like @typeguard cannot be persuaded otherwise. So if you’re implementing an executor and want to @typeguard the constructor, you’ll have to use List[Any] here.





Create a monitoring message for each block based on the poll status.


Should resource monitoring happen for tasks on running on this executor?


Shutdown the executor.


Start the executor.

submit(func, resource_specification, *args, ...)




Address to the Hub for monitoring.


Port to the Hub for monitoring.




Path to the run directory.

create_monitoring_info(status: Dict[str, JobStatus]) List[object][source]

Create a monitoring message for each block based on the poll status.


a list of dictionaries mapping to the info of each block

property hub_address: str | None[source]

Address to the Hub for monitoring.

property hub_port: int | None[source]

Port to the Hub for monitoring.

label: str = 'undefined'[source]
monitor_resources() bool[source]

Should resource monitoring happen for tasks on running on this executor?

Parsl resource monitoring conflicts with execution styles which use threads, and can deadlock while running.

This function allows resource monitoring to be disabled per executor implementation.

radio_mode: str = 'udp'[source]
property run_dir: str[source]

Path to the run directory.

abstract shutdown() None[source]

Shutdown the executor.

This includes all attached resources such as workers and controllers.

abstract start() List[str] | None[source]

Start the executor.

Any spin-up operations (for example: starting thread pools) should be performed here.

abstract submit(func: Callable, resource_specification: Dict[str, Any], *args: Any, **kwargs: Any) Future[source]


The executor can optionally set a parsl_executor_task_id attribute on the Future that it returns, and in that case, parsl will log a relationship between the executor’s task ID and parsl level try/task IDs.