User guide

• Overview
  • Parsl and Concurrency
  • Parsl and Execution
  • Parsl and Communication
    • Parameter Passing
    • File Passing
    • Futures
  • The Parsl Environment
    • Memory environment
    • File system environment
    • Service Environment
    • Environment Summary
• Apps
  • Python Apps
    • Special Keyword Arguments
    • Serializing Functions from Libraries
    • Returns
    • Limitations
  • Bash Apps
    • Special Keywords
    • Returns
    • Limitations
  • MPI Apps
• Futures
  • AppFutures
  • DataFutures
• Passing Python objects
• Staging data files
  • Parsl files
  • Staging providers
    • NoOpFileStaging for Local/Shared File Systems
    • FTP, HTTP, HTTPS: separate task staging
    • FTP, HTTP, HTTPS: in-task staging
    • Globus
      • Globus Configuration
      • Globus Authorization
    • rsync
      • rsync Configuration
      • rsync Authorization
• Execution
  • Execution providers
  • Executors
  • Launchers
  • Blocks
  • Elasticity
    • Parallelism
    • Configuration
  • Multi-executor
• MPI Apps
  • HTEx and MPI Tasks
    • Configuring the Provider
    • Configuring the Executor
      • Example Configuration
    • Writing MPI-Compatible Apps
    • Limitations
• Error handling
  • Exceptions
  • Retries
  • Lazy fail
  • Retry handlers
• Memoization and checkpointing
  • App caching
    • App equivalence
    • Invocation equivalence
    • Ignoring arguments
    • Caveats
  • Checkpointing
    • Creating a checkpoint
    • Resuming from a checkpoint
• Configuration
  • How to Configure
  • Heterogeneous Resources
  • Accelerators
  • Multi-Threaded Applications
  • Ad-Hoc Clusters
  • Amazon Web Services
  • ASPIRE 1 (NSCC)
  • Blue Waters (NCSA)
  • Illinois Campus Cluster (UIUC)
  • Bridges (PSC)
  • CC-IN2P3
  • CCL (Notre Dame, with Work Queue)
  • Comet (SDSC)
  • Cooley (ALCF)
  • Perlmutter (NERSC)
  • Frontera (TACC)
  • Kubernetes Clusters
  • Midway (RCC, UChicago)
  • Open Science Grid
  • Polaris (ALCF)
  • Stampede2 (TACC)
  • Summit (ORNL)
  • Theta (ALCF)
  • TOSS3 (LLNL)
  • Further help
• Monitoring
  • Monitoring configuration
  • Visualization
    • Workflows Page
    • Workflow Summary
• Example parallel patterns
  • Bag of Tasks
  • Sequential workflows
  • Parallel workflows
  • Parallel workflows with loops
  • MapReduce
  • Caching expensive initialisation between tasks
• Structuring Parsl programs
• Join Apps
  • Parsl sub-workflows
  • Using Futures from other components
  • Usage
  • Example of a Parsl sub-workflow
  • Example of invoking a Futures-driven task from another system
  • Terminology
• Usage statistics collection
  • Why are we doing this?
  • Opt-In
  • What is sent?
  • How is the data sent?
  • When is the data sent?
  • What will the data be used for?
  • Feedback
• Plugins
  • Executors
  • Providers, Launchers and Channels
  • File staging
  • Memoization/checkpointing
  • Invoking other asynchronous components
• Historical: Performance and Scalability
  • Scalability
    • Strong scaling
    • Weak scaling
  • Throughput
  • Summary