agentleFS
korchard333korchard333/claude-power-platform-community/.claude/skills/dataverse-web-api/SKILL.md

dataverse-web-api

Skill46 starsChanged 8 months agoMITView on GitHub

Dataverse Web API reference. Use when: CRUD operations, OData queries, FetchXML, bulk operations, batch requests, metadata operations, Custom APIs, file/image columns, change tracking, solution management via API, schema creation, programmatic builds.

  • Sends data out

1 other project uses a version of this.

Adopted by

Most recently taken up by

The file

Show its rules and text

We split this skill into the rules it gives an agent

16 rules. About 0 are common, 9 are distinctive, and 7 are very specific to this project.

  • ≈0

    Common · estimate

    Many files like this have a rule of this kind.

  • ≈9

    Distinctive · estimate

    This author's own choices. Worth a look.

  • 7

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Distinctive:

    Every component-creating request MUST include:

    line 16
  2. Very specific:

    Every column creation payload MUST include the correct @odata.type:

    line 25
  3. Very specific:

    Every custom table MUST have exactly one StringAttributeMetadata with IsPrimaryName: true included in the table creation payload.

    line 32
  4. Distinctive:

    After creating/modifying forms, views, sitemaps, or business rules, you MUST call:

    line 37
  5. Very specific:

    Every attribute in a view's layoutxml MUST also appear in the fetchxml.

    line 45
  6. Very specific:

    Do NOT use pac auth token (does not exist as a command).

    line 55
  7. Very specific:

    Always use .ps1 scripts on Windows for Web API calls.

    line 60
  8. Distinctive:

    If a computation is needed, use formula columns or plugins — not placeholder text columns that get updated by flows.

    line 71
  9. Distinctive:

    Create publisher (if not exists)

    line 76
  10. Distinctive:

    Handoff pattern: When the agent encounters one of these components, it should:

    line 86
  11. Distinctive:

    Wait for user confirmation that the manual step is complete

    line 89
  12. Distinctive:

    Before writing code that uses a Dataverse API pattern, verify it using the MS Learn MCP tools:

    line 96
  13. Distinctive:

    If MS docs contradict a skill file, trust MS docs and flag the discrepancy.

    line 101
  14. Distinctive:

    Every build script should be safe to re-run.

    line 104
  15. Very specific:

    Not handling pagination (@odata.nextLink)

    line 192
  16. Very specific:

    Not checking Prefer: odata.include-annotations for formatted values on choice/lookup fields

    line 199

≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Skill: Dataverse Web API

When to Use

Trigger when performing CRUD operations, managing metadata (tables, columns, relationships, views, forms), creating Custom APIs, managing solutions, or any direct HTTP interaction with the Dataverse Web API (OData v4.0).


CRITICAL RULES

1. Always Use MSCRM.SolutionUniqueName Header

Every component-creating request MUST include:

MSCRM.SolutionUniqueName: YourSolutionName

WHY: Omitting this header dumps components into the Default Solution — an ALM anti-pattern that makes the component nearly impossible to manage via solution transport. This is the single most common mistake when building via Web API.

2. @odata.type Is Required on All Column/Attribute Creation

Every column creation payload MUST include the correct @odata.type:

{ "@odata.type": "Microsoft.Dynamics.CRM.StringAttributeMetadata", ... }

WHY: Omitting or using the wrong type returns a 400 error. The API cannot infer the column type.

3. Every Table Needs a Primary Name Column

Every custom table MUST have exactly one StringAttributeMetadata with IsPrimaryName: true included in the table creation payload. WHY: Without it, the table is created but lookups, views, and forms cannot display a name.

4. Publish After Customization Changes

After creating/modifying forms, views, sitemaps, or business rules, you MUST call:

POST /api/data/v9.2/PublishXml

WHY: Customizations are not visible to users until published. Schema changes (tables, columns) are immediately effective, but UI customizations require publishing.

5. FormXml and FetchXml Must Stay in Sync

Every attribute in a view's layoutxml MUST also appear in the fetchxml. WHY: Missing attributes in fetchxml cause blank columns in the view.

6. Authentication: Use Azure CLI

az account get-access-token \
  --resource "https://[org].crm6.dynamics.com/" \
  --tenant "[tenant-id]" \
  --query accessToken -o tsv

Do NOT use pac auth token (does not exist as a command). For CI/CD, use service principal OAuth2 client_credentials flow.

7. Windows: Use PowerShell Scripts

On Windows, bash can mangle OData query parameters ($filter, $select, $expand). Always use .ps1 scripts on Windows for Web API calls.

8. Some Design Decisions Are PERMANENT

These cannot be changed after creation:

  • Table logical name (display name can change)
  • Column data type (cannot convert string to int)
  • Table ownership type (User-owned vs Organization-owned)
  • Publisher prefix (on existing components) Know these before creating. When in doubt, ask the user.

9. Never Use Placeholder Columns

If a computation is needed, use formula columns or plugins — not placeholder text columns that get updated by flows. Formula columns are evaluated server-side and always current.

10. Solution Context From Day 1

The FIRST operations in any build must be:

  1. Create publisher (if not exists)
  2. Create solution Then every subsequent operation uses MSCRM.SolutionUniqueName header.

11. Some Components Cannot Be Created via API

These components require manual creation in the maker portal or browser automation:

  • Connections — connection instances (not connection references) must be created interactively via the maker portal because they require OAuth consent flows
  • Some canvas app configurations — data source bindings in canvas apps require the maker portal
  • Power BI workspace connections — require interactive authentication

Handoff pattern: When the agent encounters one of these components, it should:

  1. Pause the automated build
  2. Instruct the user exactly what to create manually (provide names, types, and configuration values)
  3. Wait for user confirmation that the manual step is complete
  4. Resume the automated build

12. Verify API Patterns Against MS Learn Before Writing Code

Skill files can be wrong. L012 proved that a skill file stated privilege depth is an integer (0/1/2/3) when the API actually requires string enums ("Basic"/"Local"/"Deep"/"Global"). Every build that used the skill file failed.

Before writing code that uses a Dataverse API pattern, verify it using the MS Learn MCP tools:

  1. microsoft_docs_search("your specific API pattern") — quick overview
  2. microsoft_docs_fetch(url) — full page for detail when search is incomplete
  3. microsoft_code_sample_search("your pattern", language="python") — working examples

If MS docs contradict a skill file, trust MS docs and flag the discrepancy.

13. Use Idempotent Script Patterns

Every build script should be safe to re-run. Use check-before-create patterns:

  • GET to check existence before POST
  • Upsert with alternate keys (PATCH with If-Match/If-None-Match)
  • Log "Step N of M: [action] -- [created/skipped]" for progress tracking
  • Views and forms duplicate silently — savedqueries and systemforms have no unique constraint on name. Always check by name before POST. See auth-and-scripting.md section "Idempotent Script Patterns" for full examples.

API Fundamentals

Base URL

https://{org}.api.crm.dynamics.com/api/data/v9.2/

Region variants: .crm2. (South America), .crm3. (Canada), .crm4. (UK), .crm5. (Asia Pacific), .crm6. (Australia), .crm11. (Japan).

Authentication

# Service Principal (CI/CD, automation, scripts)
TOKEN=$(curl -s -X POST "https://login.microsoftonline.com/${TENANT_ID}/oauth2/v2.0/token" \
  -d "grant_type=client_credentials" \
  -d "client_id=${CLIENT_ID}" \
  -d "client_secret=${CLIENT_SECRET}" \
  -d "scope=https://${ORG}.crm.dynamics.com/.default" \
  | jq -r '.access_token')

# All API calls include:
Authorization: Bearer ${TOKEN}
Accept: application/json
OData-MaxVersion: 4.0
OData-Version: 4.0

Common Headers

HeaderValueWhen
AuthorizationBearer {token}Always
OData-MaxVersion4.0Always
OData-Version4.0Always
Acceptapplication/jsonAlways
Content-Typeapplication/jsonPOST, PATCH, PUT
Preferreturn=representationWhen you need the created/updated record returned
Preferodata.include-annotations="*"To get formatted values, lookup names
Preferodata.maxpagesize=100To control page size
If-Match*Update only if record exists
If-None-Match*Create only if record doesn't exist
MSCRM.SuppressDuplicateDetectionfalseEnable duplicate detection on create/update
MSCRM.CallerObjectId{user-guid}Impersonate another user
ConsistencyStrongForce strong consistency (eventual by default)

⚠️ REQUIRED: Load Sub-Files Before Implementation

SKILL.md is a summary only — it is NOT sufficient for implementation.

The detailed content (complete payloads, XML templates, working examples, edge-case handling) lives in sub-files in the same directory as this SKILL.md. Before writing any code, you MUST use read_file on the sub-files relevant to your task:

  • CRUD, Queries & Relationships — Create/Read/Update/Delete, $filter/$expand/$apply, FetchXML, pagination, formatted values, associate/disassociate
  • Bulk & Batch Operations — CreateMultiple/UpdateMultiple/DeleteMultiple, $batch requests, changesets, performance guidelines
  • Metadata (Schema Management) — Create tables/columns/relationships via API, column type reference, global option sets, query metadata
  • Customizations — Views (SavedQuery), Forms (SystemForm), Business Rules, Custom API definitions & invocation
  • File/Image & Change Tracking — Upload/download file & image columns, delta token sync
  • Solution Management — Solution CRUD, add components, export/import, publishing customizations, app modules
  • Error Handling & Patterns — Error codes, retry patterns, scripting patterns, SDK options
  • Authentication & Scripting — Azure CLI token method, PowerShell on Windows, token refresh, service principal OAuth2, script templates
  • Advanced Column Types — Rich text, file/image, auto-number, multi-select, formula, currency, customer (polymorphic lookup) columns
  • Parallelization Guide — Dependency graph for build order, parallel vs sequential, parallel agent strategies for GHCP and Claude Code
  • Dataverse Design Rules — Permanent decisions, managed vs unmanaged, performance considerations, solution layering
  • Formula Columns — Formula column creation via API, FormulaDefinition + SourceType:3, Power Fx syntax, supported return types, limitations
  • Grid Controls — Power Apps Grid Control (modern replacement for deprecated Editable Grid), configuration, nested grids, custom cell rendering
  • Business Rules API — Business rules via Workflow entity (Category=2), querying, activating/deactivating, bulk operations, scope types
  • Security Model API — Security role creation, privilege assignment (AddPrivilegesRole), column security profiles, field permissions, role assignment to users/teams
  • Environment Variables API — Environment variable definitions and values, types (String/Number/Boolean/JSON/Secret), Key Vault integration, per-environment overrides
  • Custom APIs — Custom API creation with request parameters and response properties, binding types, function vs action, plugin association
  • Conditional Operations — ETags, If-Match/If-None-Match, optimistic concurrency, conditional retrieve (304), limited upsert, read-modify-write pattern
  • Query Optimization — Service protection limits (429), Retry-After, entitlement vs service protection limits, query performance best practices, batch optimization
  • FetchXML Reference — Complete element reference (fetch/entity/filter/condition/link-entity/order), all condition operators by data type, link types, aggregation, paging cookies
  • Build Recipe — End-to-end Model-Driven App build sequence (publisher → tables → columns → relationships → views → forms → charts → dashboard → app module → sitemap → security roles → publish) with Python template and common failure points
  • Component Walkthroughs — Step-by-step recipes for creating every Dataverse component type via Web API: tables, columns, relationships, views, forms, charts, dashboards, app modules, sitemaps, security roles

Anti-Patterns

  • Missing $select on queries (fetches all columns — performance killer)
  • Querying inside loops without batching (N+1 problem — use $batch)
  • Hardcoding org URL instead of using environment variables
  • Not handling pagination (@odata.nextLink)
  • Using PUT instead of PATCH for updates (PUT replaces the entire record)
  • Ignoring 429 responses (will get throttled harder)
  • Creating metadata without publishing (PublishAllXml / PublishXml required)
  • Not URL-encoding FetchXML
  • Missing OData-Version: 4.0 header (causes unexpected behavior)
  • Using personal access tokens in automation (use service principals)
  • Not checking Prefer: odata.include-annotations for formatted values on choice/lookup fields
  • Using Web API inside plugins — plugins must use the Organization Service SDK, not Web API
  • Using the deprecated OData v2.0 Organization Data Service endpoint

Related Skills

  • code-apps — Code Apps consume Dataverse via generated services built on Web API
  • plugins — Server-side Dataverse operations complement Web API patterns
  • power-automate — HTTP connector and Dataverse actions use Web API
  • dataverse — Schema design that Web API queries target
  • alm — Solution lifecycle that depends on correct MSCRM.SolutionUniqueName usage
  • security — Security roles and column security profiles created via Web API
  • dataverse-mcp — Complementary tool for data queries and schema discovery

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.