Advanced Tutorials

The following advanced tutorials assume familiarity with distributed computing concepts. If terms like “workers,” “schedulers,” “containers,” or “declarative programming” are unfamiliar, please start with the Beginner Tutorials first.

Getting Started

• Tutorial 1: Getting Started with Scalable
• Tutorial 2: Mastering the Manifest System

These introductory tutorials assume no prior Scalable experience. Start here if you are new to the framework.

Core Capabilities

• Tutorial 3: Scaling Strategies with Providers
• Tutorial 4: Performance Optimization and Caching
• Tutorial 5: Cloud Integration with AWS and GCP
• Tutorial 6: Monitoring and Observability with Telemetry
• Tutorial 7: Error Handling and Resilience Patterns

These tutorials cover Scalable’s primary feature set. They assume you have completed the Getting Started tutorials and have a working local environment.

Advanced Topics

• Tutorial 8: Deployment Workflows with Kubernetes
• Tutorial 9: ML-Driven Resource Advising and Scaling
• Tutorial 10: AI-Assisted Workflow Composition

These tutorials explore Scalable’s advanced and differentiating capabilities. They assume familiarity with the core features and, in some cases, access to external infrastructure (Kubernetes clusters, cloud accounts).

Running the Demeter Example End-to-End

• Tutorial Setup: Run the Demeter Example End-to-End

The tutorials above use a real Demeter LULCC pipeline as their running example. The setup guide above explains the one-time installation and data download you need to actually execute the code blocks.