codex-web-render
Skill3 starsChanged 4 months agoMITView on GitHub
Fetch JavaScript-heavy, client-rendered, or bot-protected web pages that the built-in WebFetch tool cannot read (WebFetch returns an empty body, a loading spinner, an "enable JavaScript" notice, or just nav/boilerplate from an un-hydrated app shell). Drives a real system browser headless (no visible window, ~5-10s) and returns the page's fully rendered visible text, falling back to the Codex CLI only if that fails. Use this when the target URL matches the bundled problem-sites list (e.g. claude.ai/share links and other single-page apps), or when a WebFetch result for any URL comes back empty, truncated, or like an un-rendered SPA shell.
- Installs packages
In this repository8 other files it gives its agents.
- AGENTS.mdAGENTS.md
- CLAUDE.mdCLAUDE.md
- advanced-prompt-improverSkill
- codex-gateSkill
- deliverable-checkSkill
- freeing-disk-spaceSkill
- gmail-draftSkill
- codexSkill
The file
We split this skill into the rules it gives an agent
8 rules. About 0 are common, 4 are distinctive, and 4 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈4
Distinctive · estimate
This author's own choices. Worth a look.
4
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Distinctive: line 27
No visible window opens, it takes ~5-10s, and that automation flag is what clears Cloudflare's non-interactive "checking your browser" …
- Very specific: line 30
Codex fallback (opt-in): Only if the fast path fails (browser missing, still challenged, empty content) and RENDER_ALLOW_CODEX=1 is set …
- Distinctive: line 39
Use it in either of these cases:
- Very specific: line 41
The URL is on the known problem list: Before calling WebFetch, read problem-sites.txt in this skill's directory.
- Very specific: line 46
A
WebFetchresult looks un-rendered: If you did call WebFetch and the result looks like an un-hydrated shell, fall back to Codex. - Distinctive: line 55
Run the bundled wrapper script with the URL.
- Distinctive: line 62
Use the printed text as the page content for the rest of your task.
- Very specific: line 71
When you find a new domain that consistently returns an un-rendered shell from WebFetch, offer to add it so future fetches skip straight to …
≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
Codex Web Render
Render JavaScript-heavy or bot-protected pages with a real browser and return
the page's visible text. This exists because the built-in WebFetch retrieves
raw HTML without executing JavaScript, so client-rendered pages come back as
empty shells.
The script has two paths:
- Fast path (default). A pre-written Playwright renderer (
scripts/render.py) drives a real system browser (Brave Origin, then Chrome, then Chromium) in--headless=newmode with--disable-blink-features=AutomationControlled. No visible window opens, it takes ~5-10s, and that automation flag is what clears Cloudflare's non-interactive "checking your browser" challenge that plain headless Chromium gets blocked by. - Codex fallback (opt-in). Only if the fast path fails (browser missing,
still challenged, empty content) and
RENDER_ALLOW_CODEX=1is set does it hand the URL tocodex exec, which is far slower because it boots the full Codex agent to write and run its own browser script. Without that variable a failed fast path exits 3 with a message and nothing else runs. SetRENDER_NO_FAST=1to skip the fast path.
When to use this skill
Use it in either of these cases:
- The URL is on the known problem list. Before calling
WebFetch, readproblem-sites.txtin this skill's directory. If the target URL contains any pattern listed there, skipWebFetchentirely and render with Codex. The list is seeded withclaude.ai/share. - A
WebFetchresult looks un-rendered. If you did callWebFetchand the result looks like an un-hydrated shell, fall back to Codex. Tell-tale signs:- Near-empty body, or only nav/footer boilerplate with no real content.
- Text such as "You need to enable JavaScript to run this app".
- A loading spinner / skeleton and none of the content you asked about.
- The body is suspiciously short relative to what the page should contain.
How to render
Run the bundled wrapper script with the URL. It prints the rendered visible text to stdout:
bash ~/.claude/skills/codex-web-render/scripts/render-url.sh "<URL>"Use the printed text as the page content for the rest of your task. The script
tries the fast Playwright path first, so a typical run is ~5-10s with no window.
The first run may be a few seconds slower while uv resolves the playwright
package into its cache. If it exits 3 saying the Codex fallback is disabled,
report that to the User; only re-run with RENDER_ALLOW_CODEX=1 if they say so,
because that path gives Codex full access and a headed browser.
Maintaining the problem-sites list
When you find a new domain that consistently returns an un-rendered shell from
WebFetch, offer to add it so future fetches skip straight to Codex. Append one
URL substring per line to:
~/.claude/skills/codex-web-render/problem-sites.txtMatch on the most specific stable path that identifies the problem (a bare
domain like example.com, or a path prefix like example.com/app).
Prerequisites
- Fast path:
uvon PATH, plus a real Chromium-based browser installed (Brave Origin, Chrome, or Chromium).uvpulls inplaywrighton demand; no separate browser download is needed because it reuses the system browser binary. - Fallback path: the Codex CLI installed and authenticated (
npm i -g @openai/codexthencodex login). Only needed if the fast path can't render. The script runscodex exec --dangerously-bypass-approvals-and-sandboxso the run is unattended, and only whenRENDER_ALLOW_CODEX=1is set.
Notes and limitations
- The fast path is windowless and free; the Codex fallback spends Codex
usage/credits and is much slower. Only reach for this skill when
WebFetchcan't do the job. - It renders a single page's text. It does not log in, click through flows, or bypass paywalls or auth walls. It uses a throwaway browser profile, so a page needing your session returns whatever a logged-out browser sees.
- Output is the page's visible text, not raw HTML or structured data.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

