agentleFS
ZenRowsZenRows/cli/skills/extract/SKILL.md

extract

Skill16 starsChanged 27 days agoMITView on GitHub

Turn protected pages into structured data with Extract / CSS / Markdown (Autoparse is deprecated).

37 other projects use a version of this.

Adopted by

Most recently taken up by

Used with

Projects with it also use ai-act-readiness, c-level-agents and 10 more.

Other files people use alongside this one.

Files found in the same public projects as a version of this one, more often than they turn up anywhere else. Each project counts once, large collections count for less, and this file's own repository is left out.

The file

We split this skill into the rules it gives an agent

3 rules. 0 are common, 0 are distinctive, and 3 are very specific to this project.

  • 0

    Common

    Most of the 35 edited versions we read keep these.

  • 0

    Distinctive

    This author's own choices. Worth a look.

  • 3

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Very specific:

    When Extract refuses a page with 403 REQS007, zenrows extract says which of three cases it is and prints the next step.

    line 34
  2. Very specific:

    Check empty in --json output: true means every field came back null or empty, so the result is not data.

    line 80
  3. Very specific:

    If a field is missing, switch to --css with explicit selectors.

    line 82

“Common” is measured: kept by at least 6 in 10 of the 35 edited versions of this file we could read. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Extract

Convert protected pages into structured data. The value is protected page access + extraction, not generic LLM parsing.

Methods

zenrows extract <url>                              # extract=auto (default), any prepared domain
zenrows extract <url> --autoparse                  # deprecated general-purpose Autoparse (any domain)
zenrows extract <url> --css '{"title":"h1","price":".price"}'   # selector map
zenrows extract <url> --outputs emails,links       # built-in output filters → JSON
zenrows extract <url> --output markdown            # Markdown conversion
zenrows extract <url> --validate                   # fail if not valid JSON

When to use which

  • Extract (extract=auto, default): richest fields; works on any prepared domain (you can prepare one yourself, see below).
  • Autoparse (deprecated): only with --autoparse. Never automatic; do not build new work on it.
  • CSS: you know the exact fields/selectors and want determinism.
  • Markdown/plaintext: feed clean content to an LLM yourself.

REQS007: prepare the domain, then extract again

extract=auto works on any prepared domain, and you can prepare one yourself. When Extract refuses a page with 403 REQS007, zenrows extract says which of three cases it is and prints the next step. It never retries with Autoparse.

Error codeMeaningNext step
EXTRACT_DOMAIN_NOT_PREPAREDThe domain is not prepared yet (also the legacy 402 AUTH010).Prepare it (below), then extract again.
EXTRACT_PAGE_NOT_RECOGNISEDThe domain is prepared, but Extract did not recognise this page as one it can extract (a page with nothing to extract, such as a home page, or a transient failure).Try a product, article or listing page on the same site instead. If this page should work, retry it once in a few minutes; do not retry in a loop. Otherwise use --css. Preparing the domain again does not change this.
EXTRACT_DOMAIN_NOT_ENABLEDExtract is not enabled for the site.Use --css, or contact Zenrows support to have the site enabled. Preparing does not change this.

Preparing a domain:

zenrows extract https://www.example.com/products/a  # 1. fails: EXTRACT_DOMAIN_NOT_PREPARED
zenrows extract prepare example.com \
  --url https://www.example.com/products/a \
  --url https://www.example.com/products/b \
  --url https://www.example.com/products/c --wait
                                                    # 2. prepare it and wait until ready (a few minutes)
zenrows extract https://www.example.com/products/a  # 3. extract again
  • --url: 1 to 5 real pages you want to extract. One works; we recommend 3 or more of the same page type (e.g. 3 product pages), because Extract compares pages of one type to check the fields it found and fill in fields one page is missing. Several page types can share the 5 (e.g. 3 product pages + 2 search-result pages). With fewer than 3 the command prints a tip on stderr; it is never an error.
  • Without --wait the command returns at once; then check about every 30 seconds with zenrows extract prepare status example.com until it says ready. --wait polls at the same pace.
  • The domain is the host: shop.example.com and example.com are prepared separately, and a leading www. is dropped.
  • Preparing takes a few minutes and costs no credits. Each new domain uses one slot of the account's monthly allowance; prepare status shows used / limit / remaining.
  • EXTRACT_PREPARE_OUT_OF_ALLOWANCE: no slots left this month; use --css. EXTRACT_PREPARE_UNAVAILABLE: retry in a few minutes; do not loop. prepare sends each request once: --retries does not apply to it. A failed status prints the next step for its failure code and says whether the attempt used an allowance slot.
  • A domain that is already prepared answers ready at once (already_prepared) and uses no slot: run the extract. If it then fails with EXTRACT_PAGE_NOT_RECOGNISED, follow that row of the table, not prepare.

Rules

  • Validate on a single page before scaling across many URLs.
  • Check empty in --json output: true means every field came back null or empty, so the result is not data.
  • If a field is missing, switch to --css with explicit selectors. Auto mode already renders JS when the target needs it, so reach for --manual --js-render only after auto mode has returned an incomplete page: it costs several times a basic call ([[cost-control]]) and it makes the escalation yours.

See [[protected-fetch]] for retrieval semantics.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

Reviews can't be read right now.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.