17 skills found
Inspect the availability of model serving on a completed Itô compute booking and, when the canonical backend becomes available, hand off an explicitly confirmed serving manifest. Use after ito-compute has booked GPU nodes and the user asks for an OpenAI-compatible endpoint, ito-serve, hosted Kimi, or self-hosted open-weights inference. ECC implements no serving stack of its own.
Start, query, and stop a network-specific TAO inference microservice ({network_arch}-inference-microservice) by delegating container execution to the appropriate platform skill. Handles container image resolution, job-payload JSON construction, and the service registry. Use when the user wants to run inference on a TAO model checkpoint using a microservice container, deploy a TAO inference endpoint, or stop a running inference container.
Build deterministic forecast scripts with Earth2Studio (model, data source, IO, inference). Do NOT use for ensemble, diagnostics, data-only fetch, or install.
Select, validate, patch, and deploy existing NVIDIA Dynamo Kubernetes recipes. Use for model/backend/GPU/deployment-mode recipe bring-up; use router-starter for router-only mode work and troubleshoot for broken deployments.
Start or patch Dynamo router modes and run router endpoint smoke checks. Use for round-robin, KV-aware, least-loaded, or device-aware routing setup; use recipe-runner for recipe deployment and troubleshoot for failure diagnosis.
Half-Quadratic Quantization for LLMs without calibration data. Use when quantizing models to 4/3/2-bit precision without needing calibration datasets, for fast quantization workflows, or when deploying with vLLM or HuggingFace Transformers.
Reserved and on-demand GPU cloud instances for ML training and inference. Use when you need dedicated GPU instances with simple SSH access, persistent filesystems, or high-performance multi-node clusters for large-scale training.
Triton Inference Config - Auto-activating skill for ML Deployment.Triggers on: triton inference config, triton inference configPart of the ML Deployment skill category.
Batch Inference Pipeline - Auto-activating skill for ML Deployment.Triggers on: batch inference pipeline, batch inference pipelinePart of the ML Deployment skill category.
Tensorflow Serving Setup - Auto-activating skill for ML Deployment.Triggers on: tensorflow serving setup, tensorflow serving setupPart of the ML Deployment skill category.
Model Pruning Helper - Auto-activating skill for ML Deployment.Triggers on: model pruning helper, model pruning helperPart of the ML Deployment skill category.
Azure Ml Deployer - Auto-activating skill for ML Deployment.Triggers on: azure ml deployer, azure ml deployerPart of the ML Deployment skill category.
