DAAF-Contribution-Community

web-retrieval

DAAF-Contribution-Community/daaf/.claude/skills/web-retrieval/SKILL.md

DAAF's protocol for retrieving web documents that an agent needs to READ (docs pages, articles, API references, issue threads). Retrieval runs through the framework CLI `bash /daaf/scripts/web_fetch.sh URL DEST_DIR`, which saves the raw response, a deterministic extract, and a provenance manifest to disk — the built-in WebFetch is blocked because it returns an AI paraphrase, not source text. Covers when to fetch at all (check local skills first), tool syntax and flags, the two-artifact + MANIFEST provenance model, the exit-code failure table, the untrusted-content rule, thin-extract diagnosis, extract size rules, and destination conventions. Use when a permitted context (search-agent, data-ingest, debugger, orchestrator) must pull a specific web page into context to read or quote it. NOT for discovery — WebSearch stays built-in for finding URLs. NOT for pipeline data acquisition — Stage 5 / onboarding scripts fetching datasets into parquet are a separate, unchanged activity for any pipeline agent.