dagster-expert
Expert guidance for working with Dagster and the dg CLI. ALWAYS use before doing any task that requires knowledge specific to Dagster, or that references assets, materialization, components, data tools or data pipelines. Common tasks may include creating a new project, adding new definitions, understanding the current project structure, answering general questions about the codebase (finding asset, schedule, sensor, component or job definitions), debugging issues, or providing deep information a
Security Assessment
Detected risks:
About dagster-expert
The dagster-expert skill provides specialized guidance for working with Dagster, a modern data orchestration platform, and its dg CLI tool. This skill solves the problem of navigating Dagster's ecosystem by offering expert assistance with project setup, definition management, component architecture, and integration workflows. It ensures users follow best practices when building data pipelines, managing assets, and configuring automation.
This skill's main capabilities include creating and managing Dagster projects, defining assets and components, configuring schedules and sensors, implementing declarative automation, and integrating with external tools and services. It provides comprehensive reference documentation covering asset selection syntax, environment variable configuration, automation patterns, and CLI commands. The skill emphasizes using the dg CLI for programmatic interactions and supports uv for dependency management, ensuring efficient project structure exploration only when strictly necessary.
Target users include data engineers, analytics engineers, and platform teams building data pipelines and orchestration workflows. Common use cases involve creating new Dagster projects, adding asset definitions, debugging pipeline issues, setting up automation with schedules or sensors, understanding project structure, and integrating with external data tools. The skill is particularly valuable for teams adopting Dagster or scaling their data infrastructure, as it provides guidance on component reusability, asset-centric automation, and integration library selection.
FAQ
When should I use the dagster-expert skill?
Use this skill before performing any task requiring Dagster-specific knowledge, including creating projects, adding definitions, understanding project structure, working with assets or components, configuring automation (schedules, sensors, declarative automation), debugging issues, or integrating with external data tools.
Does this skill support the dg CLI and uv package manager?
Yes, the skill recommends using the dg CLI for programmatic interactions with Dagster and supports uv for dependency management. Most dg commands have a --json flag for machine-readable output, and you can run commands like 'uv run dg list defs' or 'uv run dg launch --assets my_asset'.
How do I integrate Dagster with external tools?
Always read the Integration libraries index reference file first, which contains information about existing integration libraries and guidance on creating custom integrations for tools without published libraries.
What are the core concepts I need to understand?
The two primary concepts are Assets (persistent objects like tables, files, or models produced by your pipeline) and Components (reusable building blocks that generate definitions such as assets, schedules, sensors, and jobs for a particular domain).
Does the skill provide reference documentation?
Yes, comprehensive reference documentation is available covering asset selection syntax, environment variables, asset patterns, automation approaches (schedules, sensors, declarative automation), and CLI commands. The skill always reads relevant reference files before answering to ensure accuracy.
All Files
173 filesInstall dagster-expert
Quick Setup:
- Copy the skill folder to
.claude/skills/ - Claude will automatically detect and use the skill
Repository
dagster-io/skills