protected-fetch
Skill16 starsChanged 27 days agoMITView on GitHub
Use Zenrows Protected Fetch in auto mode for anti-bot-protected page retrieval. Auto mode handles the anti-bot escalation, so never enable JS rendering or premium proxies yourself on a first attempt.
In this repository10 other files it gives its agents.
- AGENTS.mdAGENTS.md
- CLAUDE.mdCLAUDE.md
- batch-jobsSkill
- compliance-policySkill
- cost-controlSkill
- crawlSkill
- extractSkill
- interact-browserSkill
- trace-debugSkill
- zenrowsSkill
The file
We split this skill into the rules it gives an agent
2 rules. About 0 are common, 0 are distinctive, and 2 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈0
Distinctive · estimate
This author's own choices. Worth a look.
2
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Very specific: line 38
Start with auto mode. Enabling --js-render and --premium-proxy yourself is the most expensive configuration this API offers, by a wide …
- Very specific: line 56
Every run is saved under .zenrows/runs/<run-id>/ (no secrets).
≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Protected Fetch
Retrieve pages that normal fetch, generic scrapers, or naive browser tools
cannot. This is the core primitive — backed by Zenrows Fetch
(GET https://api.zenrows.com/v1/).
When to use
- You have a known URL and want its content (HTML, Markdown, text, or a PDF).
- The target has anti-bot protection, needs JS rendering, or geo-specific access.
How to call
Auto mode is the answer for anti-bot targets, Cloudflare included. It escalates for you and bills only for the configuration that succeeds.
zenrows fetch <url> # Adaptive Stealth Mode. Start here, always
zenrows fetch <url> --output markdown # convert to Markdown
zenrows fetch <url> --proxy-country us # geo-target, works in auto mode
zenrows fetch <url> --wait-for ".price" # wait for a selectorManual mode exists for the rare case where auto mode has already failed and a trace shows why. It costs more and it makes the escalation your problem:
zenrows fetch <url> --manual --js-render --premium-proxy # the most expensive path, see [[cost-control]]Rules
- Start with auto mode. Enabling
--js-renderand--premium-proxyyourself is the most expensive configuration this API offers, by a wide margin, and auto mode reaches the same place only when the target actually needs it. The multipliers are in [[cost-control]]. - A hard target is not a reason to skip auto mode. It is the reason auto mode exists.
- In auto mode
js_renderandpremium_proxyare managed for you. Passing them manually requires--manual, otherwise you getPARAM_CONFLICT_AUTO_MANUAL. --proxy-countryworks in auto mode on its own; in--manualmode it also needs--premium-proxy(elsePARAM_PROXY_COUNTRY_REQUIRES_PREMIUM).- You are billed only for the configuration that succeeds.
- On failure, read
zenrows trace explain <run-id>before escalating. - The CLI sends each request once.
--retries <n>retries a 429, 502, 503 or 504 and a network error before the request reached the API, up tontimes, within 90 s; prefer it to your own retry loop. It never retries a timeout, a connection closed after the request was sent, or a target status under--original-status.
Every run is saved under .zenrows/runs/<run-id>/ (no secrets). See [[extract]]
for structured output and [[cost-control]] for the cost model.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

