parsl.executors.high_throughput.manager_selector.BlockIdManagerSelector

class parsl.executors.high_throughput.manager_selector.BlockIdManagerSelector

Returns an interesting_managers list sorted by block ID

Observations: 1. BlockID manager selector helps with workloads that see a varying amount of tasks over time. New blocks are prioritized with the blockID manager selector, when used with ‘htex_auto_scaling’, results in compute cost savings.

2. Doesn’t really work with bag-of-tasks workloads. When all the tasks are put into the queue upfront, all blocks operate at near full utilization for the majority of the workload, which task goes where doesn’t really matter.

__init__()

Methods

__init__()
sort_managers(ready_managers, manager_list)	Sort a given list of managers.

sort_managers(ready_managers: Dict[bytes, ManagerRecord], manager_list: Set[bytes]) → List[bytes]

Sort a given list of managers.

Any operations pertaining to the sorting and rearrangement of the interesting_managers Set should be performed here.