parsl.monitoring.MonitoringHub¶
-
class
parsl.monitoring.
MonitoringHub
(hub_address, hub_port=None, hub_port_range=(55050, 56000), client_address='127.0.0.1', client_port_range=(55000, 56000), workflow_name=None, workflow_version=None, logging_endpoint='sqlite:///monitoring.db', logdir=None, monitoring_debug=False, resource_monitoring_enabled=True, resource_monitoring_interval=30)[source]¶ -
__init__
(hub_address, hub_port=None, hub_port_range=(55050, 56000), client_address='127.0.0.1', client_port_range=(55000, 56000), workflow_name=None, workflow_version=None, logging_endpoint='sqlite:///monitoring.db', logdir=None, monitoring_debug=False, resource_monitoring_enabled=True, resource_monitoring_interval=30)[source]¶ Parameters: - hub_address (str) – The ip address at which the workers will be able to reach the Hub. Default: “127.0.0.1”
- hub_port (int) – The specific port at which workers will be able to reach the Hub via UDP. Default: None
- hub_port_range (tuple(int, int)) – The MonitoringHub picks ports at random from the range which will be used by Hub. This is overridden when the hub_port option is set. Defauls: (55050, 56000)
- client_address (str) – The ip address at which the dfk will be able to reach Hub. Default: “127.0.0.1”
- client_port_range (tuple(int, int)) – The MonitoringHub picks ports at random from the range which will be used by Hub. Defauls: (55050, 56000)
- workflow_name (str) – The name for the workflow. Default to the name of the parsl script
- workflow_version (str) – The version of the workflow. Default to the beginning datetime of the parsl script
- logging_endpoint (str) – The database connection url for monitoring to log the information. These URLs follow RFC-1738, and can include username, password, hostname, database name. Default: ‘sqlite:///monitoring.db’
- logdir (str) – Parsl log directory paths. Logs and temp files go here. Default: ‘.’
- monitoring_debug (Bool) – Enable monitoring debug logging. Default: False
- resource_monitoring_enabled (boolean) – Set this field to True to enable logging the info of resource usage of each task. Default: True
- resource_monitoring_interval (int) – The time interval at which the monitoring records the resource usage of each task. Default: 30 seconds
Methods
__init__
(hub_address[, hub_port, …])param hub_address: The ip address at which the workers will be able to reach the Hub. Default: “127.0.0.1” close
()monitor_wrapper
(f, task_id, …)Internal Wrap the Parsl app with a function that will call the monitor function and point it at the correct pid when the task begins. send
(mtype, message)start
(run_id)-