physical-ai-defect-image-generation
Use when the user wants to orchestrate defect image generation with NVIDIA Cosmos AnomalyGen (Cosmos-Predict2-derived) on OSMO for PCBA, metal surface, and glass inspection. The Day 0 path handles cold-start with USD-to-ROI, image-edit augmentation, and AnomalyGen to create initial PCBA datasets. The Day 1 path performs inference and labeling on real images. This skill helps with first-time asset setup, creation of finetuning checkpoints, and configuring deployment. Trigger keywords: defect imag
Security Assessment
About physical-ai-defect-image-generation
Physical AI Defect Image Generation orchestrates end-to-end defect image generation, augmentation, and labeling pipelines for Automated Optical Inspection (AOI) datasets using NVIDIA Cosmos AnomalyGen (a Cosmos-Predict2-2B model fine-tuned per use case) running on OSMO. It addresses the cold-start data problem in visual inspection: teams that lack real defect imagery for PCBA, metal surface, or glass inspection can synthesize labeled defect datasets from CAD/USD scenes and image-edit augmentation, then transition to inference and labeling on real photos.
The skill governs flow selection, data handoffs, and submit commands across several canonical OSMO workflow YAMLs. Day 0 flows cover texture defects (usd2roi ROI cropping, Qwen Image-Edit augmentation, fine-tune-or-passthrough, and inline AnomalyGen labeling including missing-component detection), good/clean-image generation, and structural pose defects (shift, tombstone, sideflip). Day 1 flows perform inference and labeling on real images via real-photo alignment (the default) or manual ROI masks for metal and glass. It ships use-case cookbooks, setup configs (PCB, metal, glass, pretrained), fine-tuning and GPU-sizing references, preflight scripts for URLs, credentials, and pod templates, and OSMO monitoring and troubleshooting guidance.
Target users are manufacturing and physical-AI engineers building AOI defect-detection datasets and models who need first-time asset setup, fine-tuning checkpoints, and deployment configuration without hand-assembling each pipeline stage. It is oriented toward orchestration; individual component internals live in each component's own documentation, and the skill focuses on chaining steps non-interactively and correctly routing vague requests to the right flow.
FAQ
Which inspection domains does this skill support?
PCBA (printed circuit board assembly), metal surface, and glass inspection. AnomalyGen ships as per-use-case fine-tunes: Cosmos-AnomalyGen-PCB-2B, -Metal-2B, and -Glass-2B.
What is the difference between the Day 0 and Day 1 paths?
Day 0 handles cold-start: it synthesizes initial datasets from CAD scene USD files using USD-to-ROI rendering, image-edit augmentation, and AnomalyGen. Day 1 runs inference and labeling on real captured images, either by aligning a real PCBA photo to a CAD-derived USD (the default) or by supplying pre-captured clean images with manual ROI masks for metal and glass.
What infrastructure and credentials are required?
Flows run on NVIDIA OSMO and use GPU resources, with preflight scripts provided to validate URLs, credentials, and pod templates before submission. Setup uses NGC artifacts and image-edit endpoints; consult the setup and GPU-sizing references for the exact requirements per flow.
How are the pipelines actually run?
Every flow has a canonical OSMO workflow YAML in the assets directory that chains all steps non-interactively, combined with use-case cookbooks that hold the usd2roi, image-edit, and AnomalyGen training configs. The skill selects the flow, wires data handoffs, and issues the submit command.
Does the skill cover model internals or only orchestration?
It focuses on orchestration: flow selection, data handoffs, submit commands, first-time asset setup, fine-tuning checkpoint creation, and deployment configuration. Component internals are documented separately in each component's own SKILL.md.
All Files
54 filesInstall physical-ai-defect-image-generation
Quick Setup:
- Copy the skill folder to
.claude/skills/ - Claude will automatically detect and use the skill
Repository
nvidia/skills