Tutorial: Spack 101

This is an introduction to Spack with lectures and live demos. It was last presented at the Supercomputing 2023 Conference, November 12, 2023. The event was a full-day tutorial.

You can use these materials to teach a course on Spack at your own site, or you can just skip ahead and read the live demo scripts to see how Spack is used in practice.

Slides

Download Slides.

Full citation: Todd Gamblin, Gregory Becker, Richarda Butler, Massimiliano Culpo, Tamara Dahlgren, Adam Stewart, Luke Peyralans, and Alec Scott. Managing HPC Software Complexity with Spack. Supercomputing 2023 (SC23), Denver, CO. November 12 2023.

Video

For the last video of this tutorial, see the AWS/RADIUSS 2023 version

Live Demos

We provide scripts that take you step-by-step through basic Spack tasks. They correspond to sections in the slides above.

To run through the scripts, we provide the spack/tutorial container image. You can invoke

$ docker pull ghcr.io/spack/tutorial:sc23
$ docker run -it ghcr.io/spack/tutorial:sc23

to start using the container. You should now be ready to run through our demo scripts:

1. Basic Installation Tutorial

2. Environments Tutorial

3. Configuration Tutorial

4. Package Creation Tutorial

5. Stacks Tutorial

6. Developer Workflows Tutorial

7. Mirrors and Binary Caches Tutorial

8. Scripting with Spack

Other sections from past tutorials are also available, although they may not be kept up-to-date as frequently:

1. Module Files Tutorial

2. Spack Package Build Systems

3. Advanced Topics in Packaging

Full contents:

Links

• Main Spack Documentation

Tutorial

• Basic Installation Tutorial
  • Installing Spack
  • What is in Spack?
  • Installing Packages
  • Uninstalling Packages
  • Advanced spack find Usage
  • Customizing Compilers
• Environments Tutorial
  • Environment Basics
    • Creating and activating environments
    • Installing packages
    • Creating an environment incrementally
    • Using packages
    • Uninstalling packages
  • The spack.yaml file
    • Editing environment configuration
    • Re-concretizing the environment
  • Building in environments
  • Reproducing builds
    • Environment files
    • Managed versus independent environments
    • Reviewing a managed environment
    • Creating an independent environment
    • Updating an installed environment
    • Reviewing spack.lock
    • Reproducing an environment
  • More information
    • Setting up and building environments
    • Using environments
    • Finding examples of environments
• Configuration Tutorial
  • Configuration from the command line
  • Configuration Scopes
    • Platform-specific scopes
  • YAML Format
  • Compiler Configuration
    • Compiler flags
    • Advanced compiler configuration
  • Configuring Package Preferences
    • Variant preferences
    • External packages
    • Installation permissions
  • High-level Config
  • Conclusion
• Package Creation Tutorial
  • What is a Spack Package?
  • Getting Started
  • Creating the Package File
  • Adding Package Documentation
  • Adding Dependencies
  • Debugging Package Builds
    • Reviewing the Build Log
    • Building Manually
  • Specifying Configure Arguments
  • Adding Variants
  • Adding Tests
  • Querying the Spec Object
    • Querying Spec Versions
    • Querying Spec Names
    • Querying Variants
  • Multiple Build Systems
  • Cleaning Up
  • More information
    • Testing an installation
    • Customizing package-related environments
    • Using other build systems
    • Making a package externally detectable
• Mirrors and Binary Caches Tutorial
  • Setting up a source cache mirror
  • Setting up a binary cache mirror
  • Bootstrapping Mirrors
  • Cache Summary
• Stacks Tutorial
  • Spec matrices
    • Setup the compiler
    • Install software against different MPIs and LAPACKs
    • Named lists in spack environments
    • Conditional definitions
  • View descriptors
  • Module files
• Developer Workflows Tutorial
  • Installing from local source
  • Development iteration cycles
  • Workflow Summary
• Scripting with Spack
  • Setting up the tutorial
  • Scripting with spack find
    • spack find --format
    • spack find --json
  • Introducing the spack python command
    • Accessing the Spec object
    • Querying the Spack database
    • Using scripts
  • Using the spack-python executable
• Module Files Tutorial
  • Setup for the Tutorial
    • Build a module tool
    • Add a new compiler
    • Build the software that will be used in the tutorial
  • What are Module Files?
    • Module Systems
    • How does Spack generate module files?
    • Modules vs spack load
  • Non-hierarchical Module Files
    • Filter unwanted modifications to the environment
    • Prevent some module files from being generated
    • Change module file naming
    • Add custom environment modifications
    • Autoload dependencies
  • Hierarchical Module Files
    • Core/Compiler/MPI
    • Add LAPACK to the hierarchy
  • Working with Templates
    • Module file templates
    • Extend the default templates
    • Restore settings for future sections
• Spack Package Build Systems
  • Package Class Hierarchy
  • Package
  • Autotools
  • Makefile
  • CMake
  • PythonPackage
  • Other Build Systems
• Advanced Topics in Packaging
  • Setup for the Tutorial
  • Modifying a Package’s Build Environment
    • Set environment variables in dependent packages at build-time
    • Set environment variables in your own package
  • Retrieving Library Information
    • Accessing dependency libraries
    • Providing libraries to dependents
  • Other Packaging Topics
    • Attach attributes to other packages
    • Extra query parameters