agentleFS
hollandkevinthollandkevint/data-product-operator/skills/databricks-data-product-review/SKILL.md

databricks-data-product-review

Skill5 starsChanged 2 months agoMITView on GitHub

Review a Databricks data product or proposed release using approved metadata and query evidence. Use for Unity Catalog scope, Delta change handling, reconciliation, or a release handoff. Does not provision infrastructure or authorize production writes.

The file

We split this skill into the rules it gives an agent

5 rules. About 0 are common, 3 are distinctive, and 2 are very specific to this project.

  • ≈0

    Common · estimate

    Many files like this have a rule of this kind.

  • ≈3

    Distinctive · estimate

    This author's own choices. Worth a look.

  • 2

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    Use approved metadata or synthetic evidence when live access is unavailable.

    line 11
  2. Distinctive:

    Keep credentials out of prompts and artifacts.

    line 19
  3. Very specific:

    Before a proposed MERGE, check duplicate source matches and document a business-supported ordering rule.

    line 32
  4. Very specific:

    Verify the runtime's duplicate-match semantics.

    line 33
  5. Distinctive:

    Check whether the feed is a complete snapshot or an incremental delivery.

    line 42

≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Databricks Data-Product Review

Produce a release evidence record tied to one intended use, source version and consumer. Use approved metadata or synthetic evidence when live access is unavailable. Do not invent execution results.

Establish the boundary

  • Confirm the workspace, cloud, principal, SQL warehouse or compute, runtime and permitted task.
  • Resolve the actual catalog.schema.table names and relevant table versions. Do not guess a release from a familiar name or mix releases silently.
  • Record the population, grain, business time window, freshness expectation and accepting owner.
  • Inspect the existing query runner and its restrictions before using another execution path.
  • Keep credentials out of prompts and artifacts. Do not broaden grants, create shares, enable features or export records as a side effect of review.
  • Draft queries by default. Execute only authorized reads through the approved connection; bound scan cost and returned data. A row limit does not bound bytes scanned.

Review the contract

  1. Confirm which governed tables or views the principal can access. Include row filters, masks and downstream sharing where relevant. A catalog's existence does not prove the configuration is safe for the use.
  2. Identify keys and expected join cardinality. Check uniqueness at the declared grain before joining. Keep patient identifiers scoped to their source or tenant.
  3. Reconcile rows, distinct entities, missing keys, date coverage and relevant subgroup counts before and after each meaningful transformation.
  4. Distinguish source-event time, arrival time and table commit time. Record the snapshot used by each query; separate statements against changing tables can disagree legitimately.
  5. Review corrections, deletes and late arrivals. Decide which outputs should change and which must remain frozen as a historical release.

Review Delta changes

  • Before a proposed MERGE, check duplicate source matches and document a business-supported ordering rule. Do not keep an arbitrary row to silence an error.
  • Verify the runtime's duplicate-match semantics. Review WHEN NOT MATCHED BY SOURCE carefully: An incremental subset is not evidence that absent target records should be deleted.
  • Identify the applicable change data feed implementation, table format, runtime support and available history. Do not assume all change feeds have the same enablement behavior.
  • Handle insert, update and delete semantics explicitly. Do not count both update images as new clinical events.
  • Record the last processed version, retention limits and recovery plan. Change feed availability is not a permanent audit archive.
  • Propose a bounded replay test in an approved nonproduction target. Production writes, checkpoint resets, retention changes and VACUUM require separate authority.

Synthetic review case

A feed has two corrections for the same claim key. An engineer proposes a merge followed by deletion of all unmatched target rows. Check whether the feed is a complete snapshot or an incremental delivery; resolve correction ordering from source semantics. The expected review flags both duplicate matching and unintended deletion risk. It does not execute the merge. A passing staged replay supports only the tested versions and cases, not the original failure's cause or every downstream consumer.

Return the decision record

Include intended use; principal and object scope; source/table versions; query identifiers; aggregate observations; unresolved explanations; proposed checks with owners; and whether evidence supports the named handoff. Label each check proposed, executed or independently confirmed. Leave unavailable evidence unresolved. Separate data fitness from model evaluation, permissions to act and operational supervision. For healthcare, preserve clinical definitions and ask qualified owners to accept residual risk. Do not turn a technical pass into a clinical or compliance approval.

Sources and applicability

Official AWS documentation reviewed September 10, 2026; verify the deployed cloud/runtime before using syntax or feature claims.

  • Unity Catalog: Object scope and governance capabilities; inspect actual configuration.
  • Delta MERGE: Match semantics and conditional changes vary by runtime.
  • Change data feed: Implementation requirements, retained history and replay boundaries.

This workflow is proposed operating guidance, not a Databricks certification. No live-workspace validation is claimed.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.