arize-ai-provider-integration

This skill creates, reads, updates, and deletes Arize AI integrations that store LLM provider credentials used by evaluators and other Arize features that need to invoke an LLM. It solves the problem of registering and managing provider credentials in Arize in a consistent way, supporting many providers including OpenAI, Anthropic, Azure OpenAI, AWS Bedrock, Vertex AI, Gemini, NVIDIA NIM, and OpenAI-compatible custom endpoints. An AI integration is stored provider credentials referenced by a base64 integration ID, which downstream operations such as evaluator creation require.

All operations run through the ax CLI. You can list integrations with ax ai-integrations list --space SPACE, including name filtering, pagination via --limit and --cursor, and JSON output; get details with ax ai-integrations get NAME_OR_ID; and create with ax ai-integrations create, where required flags depend on the provider. API-key providers like openAI, anthropic, and gemini use --api-key; azureOpenAI and nvidiaNim also need --base-url; awsBedrock uses --provider-metadata with a role_arn; and vertexAI uses --provider-metadata with project_id and location. Optional flags include --model-name (repeatable), --enable-default-models, and --function-calling-enabled. The skill notes that create is account-scoped and does not accept --space, while list, get, update, and delete do. The SPACE value can be a space name or a base64 space ID, discoverable via ax spaces list, and auth types include default, proxy_with_headers, and bearer_token.

The skill targets Arize users connecting LLM providers for evaluators and other features, and it requires the ax CLI and a configured Arize profile. It emphasizes strong security practices: never read .env files or search the filesystem for credentials, never ask users to paste secrets into chat, and reference env var names like $OPENAI_API_KEY rather than raw values, asking the user to export keys and run create in their own terminal. Troubleshooting guidance maps common errors, such as command not found, 401 Unauthorized, or unknown space, to reference docs like references/ax-setup.md and references/ax-profiles.md, and directs users to https://app.arize.com/admin for API keys.