agentleFS
roborracleroborracle/agent-workflow-kit/skills/contract-test/SKILL.md

contract-test

Skill0 starsChanged 3 months agoMITView on GitHub

Detect breaking API changes before merge. Covers response shape validation, backward compatibility checks, deprecation workflows, and consumer-driven contract testing patterns.

4 other projects use a version of this.

Adopted by

Most recently taken up by

The file

We split this skill into the rules it gives an agent

2 rules. 0 are common, 2 are distinctive, and 0 are very specific to this project.

  • 0

    Common

    Most of the 3 edited versions we read keep these.

  • 2

    Distinctive

    This author's own choices. Worth a look.

  • 0

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    Before merging any API change:

    line 26
  2. Distinctive:

    Every breaking change must bump the API version

    line 120

“Common” is measured: kept by at least 6 in 10 of the 3 edited versions of this file we could read. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Contract Testing & API Compatibility

Breaking Change Detection

What Constitutes a Breaking Change

ChangeBreaking?Safe Alternative
Remove a field from responseYesDeprecate first, remove after grace period
Rename a fieldYesAdd new field, keep old one, deprecate old
Change field type (string → number)YesAdd new field with new type
Change field from optional to requiredYesKeep optional, validate in business logic
Add a new optional fieldNoSafe to add anytime
Add a new required field to requestYesMake it optional with a default
Change error response formatYesVersion the error format
Remove an endpointYesReturn 410 Gone with migration guide
Change URL pathYesKeep old path as redirect/alias

Pre-Merge Compatibility Check

Before merging any API change:

  1. Diff response types — Compare before/after TypeScript types or JSON schemas
  2. Check all consumers — grep for endpoint usage across services and client apps
  3. Run contract tests — verify existing consumers still work with new response shape
  4. Check generated clients — if using OpenAPI codegen, regenerate and check for compile errors

Response Shape Validation

// Define the contract as a schema
const UserResponseSchema = z.object({
  id: z.string().uuid(),
  email: z.string().email(),
  name: z.string(),
  createdAt: z.string().datetime(),
  // Optional fields can be added without breaking
  avatar: z.string().url().optional(),
});

// Validate in integration tests
test('GET /users/:id returns valid response shape', async () => {
  const response = await api.get('/users/test-id');
  const result = UserResponseSchema.safeParse(response.data);
  expect(result.success).toBe(true);
});

Deprecation Workflow

Timeline

Week 0:  Add deprecation header + docs
         Deprecation: @{DEPRECATION_UNIX_SECONDS}
         Sunset: {SUNSET_HTTP_DATE}

Week 1-4: Monitor usage of deprecated endpoint/field
          Log warnings when deprecated features are accessed

Week 4:  Contact remaining consumers directly

Week 8:  Remove deprecated feature (or extend if consumers remain)

Deprecation Header Pattern

// Add to deprecated endpoints
// RFC 9745: Deprecation is a structured-field Date (@ + Unix seconds).
// RFC 8594: Sunset is an HTTP-date and must not be earlier than Deprecation.
res.setHeader('Deprecation', '@{DEPRECATION_UNIX_SECONDS}');
res.setHeader('Sunset', '{SUNSET_HTTP_DATE}'); // e.g. 'Wed, 30 Jun 2027 23:59:59 GMT'
res.setHeader('Link', '</api/v2/users>; rel="successor-version"');

Consumer-Driven Contract Testing

Provider Side (API)

// Contract test: verify the API still satisfies consumer expectations
describe('User API Contract', () => {
  it('returns fields that Consumer A depends on', async () => {
    const response = await request(app).get('/api/users/1');
    // Consumer A uses: id, email, name
    expect(response.body).toHaveProperty('id');
    expect(response.body).toHaveProperty('email');
    expect(response.body).toHaveProperty('name');
    expect(typeof response.body.id).toBe('string');
    expect(typeof response.body.email).toBe('string');
  });
});

Consumer Side (Client)

// Contract test: verify the client handles the expected response shape
describe('User API Client Contract', () => {
  it('correctly parses user response', () => {
    const mockResponse = { id: '123', email: 'test@example.com', name: 'Test' };
    const user = parseUserResponse(mockResponse);
    expect(user.id).toBe('123');
  });
});

API Versioning Strategy

StrategyProsConsWhen to Use
URL path (/v1/, /v2/)Clear, easy to routeURL pollutionPublic APIs with long-lived consumers
No versioning (evolve in place)SimplestMust never breakInternal + careful evolution

Rules

  • New fields: always optional (additive changes are safe)
  • Removed fields: deprecate with sunset date, never remove without warning
  • Type changes: add new field, never change existing field type
  • Every breaking change must bump the API version
  • Contract tests run in CI — failures block merge

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.