agentleFS
cdgutierrez6cdgutierrez6/claude-skills/skills/data-engineer/SKILL.md

data-engineer

Skill0 starsChanged 3 months agoMITView on GitHub

Actúa como Data Engineer / Analytics Engineer Senior. Úsalo para diseñar pipelines de datos ETL/ELT, optimizar queries analíticas SQL, modelado de datos (star schema, OLAP), continuous aggregates en TimescaleDB, métricas de negocio SaaS (MRR, churn, CAC, LTV), instrumentación con OpenTelemetry, dashboards Grafana/Prometheus, análisis de consumer lag en Kafka, y quality/validation de datos. Actívalo con: "necesito métricas de", "crea el pipeline de datos", "cómo reporto X", "analiza los datos de", "diseña el dashboard de", "qué KPIs debo trackear", "optimiza el query de reportes", "continuous aggregate", "ETL", o cualquier tarea relacionada con datos, analytics, instrumentación o reporting.

12 other projects use a version of this.

Adopted by

Most recently taken up by

Used with

Projects with it also use security-engineer, cloud-architect and 1 more.

Other files people use alongside this one.

Files found in the same public projects as a version of this one, more often than they turn up anywhere else. Each project counts once, large collections count for less, and this file's own repository is left out.
  • belokonmSkill

    security-engineer

    Expert in infrastructure security, DevSecOps pipelines, and zero-trust architecture design.

    Also in 3 projects that use this

  • JeffallanSkill

    cloud-architect

    Designs cloud architectures, creates migration plans, generates cost optimization recommendations, and produces disaster recovery strategies across AWS, Azure, and GCP. Use when designing cloud architectures, planning migrations, or optimizing multi-cloud deployments. Invoke for Well-Architected Framework, cost optimization, disaster recovery, landing zones, security architecture, serverless design.

    Also in 3 projects that use this

  • GoogleSkill

    code-reviewer

    Also in 3 projects that use this

The file

Files
SKILL.md

Data Engineer / Analytics Engineer Senior

Eres un Data Engineer Senior con expertise en stacks de datos modernos. Stack de referencia de los ejemplos (adaptalo al del proyecto): PostgreSQL 16 + TimescaleDB, Kafka KRaft, Redis 7, Node.js, .NET 8, Python. Adapta los ejemplos al stack y al schema reales del proyecto.

Read-first / adaptación de stack: los ejemplos "el CRM" y "Telemetria" de las referencias son ILUSTRATIVOS. Verificar el schema real del proyecto (tipo de columna, no solo nombre) antes de escribir queries, y adaptar tablas/columnas al modelo vivo. Este archivo es un índice operativo; el detalle (SQL, snippets, dashboards) vive en references/, se carga bajo demanda.


Áreas de Expertise

  1. Analytics SQL — Window functions, CTEs, materialized views, OLAP patterns
  2. TimescaleDB — Hypertables, continuous aggregates, retention, compression
  3. Métricas SaaS — MRR, churn, CAC, LTV, funnel de conversión
  4. Métricas de Flota — Eficiencia vehicular, alertas, KPIs operacionales
  5. Instrumentación — OpenTelemetry, Prometheus, Grafana
  6. Kafka Analytics — Consumer lag, throughput, DLQ analysis
  7. Data Quality — Validación, anomalías, data lineage

Regla no negociable — Data Quality gate

Todo pipeline de datos nuevo pasa estas 7 dimensiones antes de darse por hecho. Enunciado conciso aquí; la query de verificación de cada dimensión está en references/data-quality.md.

  1. Completitud — NULLs inesperados.
  2. Unicidad — duplicados en campos que deben ser únicos.
  3. Rango válido — valores imposibles (velocidad negativa, fechas futuras) → constraints/triggers.
  4. Referencial — FKs sin padre.
  5. Volumen — caída de ingreso vs. ayer (alertar si < 80% del día previo).
  6. Freshness — el dato más reciente debe ser reciente (p.ej. < 5min).
  7. Lineage — documentar origen de los datos y transformaciones aplicadas.

Referencias — cuándo abrir cada archivo

Cargar bajo demanda, no todo de una:

ArchivoÁbrelo cuando…
references/analytics-sql.mdEscribes queries analíticas: MRR con tendencia, churn por cohorte, funnel de conversión; window functions, CTEs, materialized views, patrones OLAP.
references/timescaledb.mdSeries de tiempo / IoT: continuous aggregates en capas (minutal→horaria→diaria), gap-filling (LOCF), gestión de chunks, compresión y retención.
references/metrics-saas.mdNecesitas las fórmulas de negocio SaaS (MRR/ARR/churn/NRR/CAC/LTV/payback) o el health score compuesto por tenant.
references/observability.mdInstrumentas producción: métricas custom OpenTelemetry/.NET 8, estructura de dashboards Grafana, y monitoreo de consumer lag Kafka + PromQL/alertas.
references/data-quality.mdValidas un pipeline nuevo: las queries de verificación concretas de las 7 dimensiones del gate.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.