23 skills found
Use this skill when the user wants to build tool/scripts or achieve a task where using data from the Hugging Face API would help. This is especially useful when chaining or combining API calls or the task will be repeated/automated. This Skill creates a reusable script to fetch, enrich or process data.
Expert guidance for working with Dagster and the dg CLI. ALWAYS use before doing any task that requires knowledge specific to Dagster, or that references assets, materialization, components, data tools or data pipelines. Common tasks may include creating a new project, adding new definitions, understanding the current project structure, answering general questions about the codebase (finding asset, schedule, sensor, component or job definitions), debugging issues, or providing deep information a
Expert assistant for choosing and implementing scientific workflow tools - from simple joblib caching to complex orchestration with Prefect, Parsl, FireWorks, and quacc. Recommends the simplest solution that meets requirements.
Incremental Load Setup - Auto-activating skill for Data Pipelines.Triggers on: incremental load setup, incremental load setupPart of the Data Pipelines skill category.
Spark Job Creator - Auto-activating skill for Data Pipelines.Triggers on: spark job creator, spark job creatorPart of the Data Pipelines skill category.
File Format Converter - Auto-activating skill for Data Pipelines.Triggers on: file format converter, file format converterPart of the Data Pipelines skill category.
Schema Validator - Auto-activating skill for Data Pipelines.Triggers on: schema validator, schema validatorPart of the Data Pipelines skill category.
Kafka Stream Processor - Auto-activating skill for Data Pipelines.Triggers on: kafka stream processor, kafka stream processorPart of the Data Pipelines skill category.
Prefect Flow Builder - Auto-activating skill for Data Pipelines.Triggers on: prefect flow builder, prefect flow builderPart of the Data Pipelines skill category.
Pipeline Monitoring Setup - Auto-activating skill for Data Pipelines.Triggers on: pipeline monitoring setup, pipeline monitoring setupPart of the Data Pipelines skill category.
Dbt Test Creator - Auto-activating skill for Data Pipelines.Triggers on: dbt test creator, dbt test creatorPart of the Data Pipelines skill category.
Luigi Task Generator - Auto-activating skill for Data Pipelines.Triggers on: luigi task generator, luigi task generatorPart of the Data Pipelines skill category.
