parsl.config.Config

class parsl.config.Config(executors=None, app_cache=True, checkpoint_files=None, checkpoint_mode=None, checkpoint_period=None, data_management_max_threads=10, lazy_errors=True, retries=0, run_dir='runinfo', strategy='simple', monitoring_config=None, usage_tracking=True)[source]

Specification of Parsl configuration options.

Parameters:
  • executors (list of ParslExecutor, optional) – List of executor instances to use. Possible executors include ThreadPoolExecutor, IPyParallelExecutor, or TurbineExecutor. Default is [ThreadPoolExecutor()].
  • app_cache (bool, optional) – Enable app caching. Default is True.
  • checkpoint_files (list of str, optional) – List of paths to checkpoint files. Default is None.
  • checkpoint_mode (str, optional) – Checkpoint mode to use, can be ‘dfk_exit’, ‘task_exit’, or ‘periodic’. If set to None, checkpointing will be disabled. Default is None.
  • checkpoint_period (str, optional) – Time interval (in “HH:MM:SS”) at which to checkpoint completed tasks. Only has an effect if checkpoint_mode='periodic'.
  • data_management_max_threads (int, optional) – Maximum number of threads to allocate for the data manager to use for managing input and output transfers. Default is 10.
  • monitoring_config (MonitoringConfig, optional) – The config to use for database monitoring. Default is None which does not log to a database.
  • lazy_errors (bool, optional) – If True, errors from task failures will not be raised until future.result() is called. Otherwise, they will be raised as soon as the task returns. Default is True.
  • retries (int, optional) – Set the number of retries in case of failure. Default is 0.
  • run_dir (str, optional) – Path to run directory. Default is ‘runinfo’.
  • strategy (str, optional) – Strategy to use for scaling resources according to workflow needs. Can be ‘simple’ or None. If None, dynamic scaling will be disabled. Default is ‘simple’.
  • usage_tracking (bool, optional) – Enable usage tracking. Default is True.
__init__(executors=None, app_cache=True, checkpoint_files=None, checkpoint_mode=None, checkpoint_period=None, data_management_max_threads=10, lazy_errors=True, retries=0, run_dir='runinfo', strategy='simple', monitoring_config=None, usage_tracking=True)[source]

Initialize self. See help(type(self)) for accurate signature.

Methods

__init__([executors, app_cache, …]) Initialize self.

Attributes

executors