cx-data-pipeline

cx-data-pipeline is a guidance skill for configuring how Coralogix processes, enriches, and transforms ingested observability data through the official cx command-line tool. It addresses the friction of hand-authoring the complex JSON payloads these operations require by teaching a template-from-existing-resource workflow: get an existing resource as JSON, modify it, then create or update. The skill spans four capability areas exposed by the CLI, and includes a reference file documenting the Events2Metrics JSON wire format, enums, and cardinality rules.

It covers parsing rules (extracting structured fields from raw logs via regex), enrichments (adding context from lookup tables including geo-IP, AWS, suspicious-IP, and custom tables), Events2Metrics (deriving Prometheus metrics from log and span events), and Prometheus recording rules (precomputing PromQL expressions). Each command supports list, get, create, update, and delete subcommands, plus JSON output and profile selection. The skill explains operational nuances such as E2M being forward-only with no backfill, TCO tier behavior, and verifying results by querying hot storage rather than archive.

The intended users are Coralogix platform engineers, SREs, and observability practitioners who manage data pipelines from the terminal. Typical use cases include setting up log parsing for a new service, adding geo enrichment, reducing log cost by converting high-volume events to metrics, and troubleshooting an E2M that produces no series.