agentleFS
ZenRowsZenRows/cli/skills/protected-fetch/SKILL.md

protected-fetch

Skill16 starsChanged 27 days agoMITView on GitHub

Use Zenrows Protected Fetch in auto mode for anti-bot-protected page retrieval. Auto mode handles the anti-bot escalation, so never enable JS rendering or premium proxies yourself on a first attempt.

The file

We split this skill into the rules it gives an agent

2 rules. About 0 are common, 0 are distinctive, and 2 are very specific to this project.

  • ≈0

    Common · estimate

    Many files like this have a rule of this kind.

  • ≈0

    Distinctive · estimate

    This author's own choices. Worth a look.

  • 2

    Very specific

    Tied to their project's names, files or tools. Probably skip.

  • Common
  • Distinctive
  • Very specific
  1. Very specific:

    Start with auto mode. Enabling --js-render and --premium-proxy yourself is the most expensive configuration this API offers, by a wide …

    line 38
  2. Very specific:

    Every run is saved under .zenrows/runs/<run-id>/ (no secrets).

    line 56

≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.

Keep what fits and drop the rest. Your version, ready for your agents.
Files
SKILL.md

Protected Fetch

Retrieve pages that normal fetch, generic scrapers, or naive browser tools cannot. This is the core primitive — backed by Zenrows Fetch (GET https://api.zenrows.com/v1/).

When to use

  • You have a known URL and want its content (HTML, Markdown, text, or a PDF).
  • The target has anti-bot protection, needs JS rendering, or geo-specific access.

How to call

Auto mode is the answer for anti-bot targets, Cloudflare included. It escalates for you and bills only for the configuration that succeeds.

zenrows fetch <url>                       # Adaptive Stealth Mode. Start here, always
zenrows fetch <url> --output markdown     # convert to Markdown
zenrows fetch <url> --proxy-country us    # geo-target, works in auto mode
zenrows fetch <url> --wait-for ".price"   # wait for a selector

Manual mode exists for the rare case where auto mode has already failed and a trace shows why. It costs more and it makes the escalation your problem:

zenrows fetch <url> --manual --js-render --premium-proxy   # the most expensive path, see [[cost-control]]

Rules

  • Start with auto mode. Enabling --js-render and --premium-proxy yourself is the most expensive configuration this API offers, by a wide margin, and auto mode reaches the same place only when the target actually needs it. The multipliers are in [[cost-control]].
  • A hard target is not a reason to skip auto mode. It is the reason auto mode exists.
  • In auto mode js_render and premium_proxy are managed for you. Passing them manually requires --manual, otherwise you get PARAM_CONFLICT_AUTO_MANUAL.
  • --proxy-country works in auto mode on its own; in --manual mode it also needs --premium-proxy (else PARAM_PROXY_COUNTRY_REQUIRES_PREMIUM).
  • You are billed only for the configuration that succeeds.
  • On failure, read zenrows trace explain <run-id> before escalating.
  • The CLI sends each request once. --retries <n> retries a 429, 502, 503 or 504 and a network error before the request reached the API, up to n times, within 90 s; prefer it to your own retry loop. It never retries a timeout, a connection closed after the request was sent, or a target status under --original-status.

Every run is saved under .zenrows/runs/<run-id>/ (no secrets). See [[extract]] for structured output and [[cost-control]] for the cost model.

Download now (ZIP)

Does it work?

Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.

No reviews yet

People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.

  • It worked
  • Partly
  • It didn't
What did you use it for? e.g. Reviewing pull requests in a Rails app

Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.

Your trail

Files you open will collect here, so you can find them again.

Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.

Now do this for your own.

Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.