omniroute-free-llm-routing
Skill2 starsChanged 5 days agoMITView on GitHub
Configure and troubleshoot OmniRoute, Ollama, free-tier hosted LLMs, model fallback and token-conscious routing for Claude Code and OpenAI Codex CLI. Use when users request free/local models, provider routing, quota-aware fallback, or one gateway for coding agents.
- Installs packages
In this repository108 other files it gives its agents.
- AGENTS.mdAGENTS.md
- skills/composition-patterns/AGENTS.mdAGENTS.md
- skills/react-best-practices/AGENTS.mdAGENTS.md
- skills/react-view-transitions/AGENTS.mdAGENTS.md
- CLAUDE.mdCLAUDE.md
- skills/master-developer/references/CLAUDE.mdCLAUDE.md
- agent-fabricSkill
- api-anythingSkill
- creator-security-automationSkill
- feature-implementationSkill
- omniroute-free-llm-routingSkill
- repository-auditSkill
- security-reviewSkill
- unslopSkill
- youtube-studioSkill
- agent-developmentSkill
- agent-fabricSkill
- agent-security-hardeningSkill
- algorithmic-artSkill
- api-anythingSkill
- api-designSkill
- backend-patternsSkill
- brand-guidelinesSkill
- build-mcp-appSkill
- build-mcpbSkill
- build-mcp-serverSkill
- canvas-designSkill
- claude-apiSkill
- claude-md-improverSkill
- coding-standardsSkill
- command-developmentSkill
- vercel-composition-patternsSkill
- creator-security-automationSkill
- database-migrationsSkill
- deployment-patternsSkill
- dispatching-parallel-agentsSkill
- docker-patternsSkill
- e2e-testingSkill
- executing-plansSkill
- finishing-a-development-branchSkill
- frontend-a11ySkill
- frontend-designSkill
- frontend-patternsSkill
- hook-developmentSkill
- master-developerSkill
- mcp-builderSkill
- mcp-dependency-reviewSkill
- mcp-integrationSkill
- mdcp-self-checkSkill
- mdcp-token-meterSkill
- nextjs-turbopackSkill
- plugin-settingsSkill
- plugin-structureSkill
- postgres-patternsSkill
- prisma-patternsSkill
- vercel-react-best-practicesSkill
- vercel-react-view-transitionsSkill
- receiving-code-reviewSkill
- replica-architectSkill
- replica-backendSkill
- The first 60 shown.
The file
Show its rules and text
We split this skill into the rules it gives an agent
16 rules. About 0 are common, 15 are distinctive, and 1 is very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈15
Distinctive · estimate
This author's own choices. Worth a look.
1
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- could be automatic: a setting could enforce it
- Distinctive: line 10
Use a user-controlled local gateway to route compatible coding clients to local Ollama models and eligible hosted providers.
- Very specific: line 15
Check omniroute doctor, the local dashboard, and omniroute models list where supported by the installed version.
- Distinctive: line 17
Never print, commit, log or place API keys in shell history.
- Distinctive: line 18
Never assume a free provider is available in the user's region or account.
- Distinctive: line 44
Add the local Ollama provider in OmniRoute's provider settings and confirm it appears in the model list.
- Distinctive: line 45
Test a short request before selecting it for a large coding task.
- Distinctive: line 64
Use a local Ollama model for low-risk, private, repetitive tasks.
- Distinctive: line 65
Use a hosted free-tier model for tasks it can handle, while respecting limits.
- Distinctive: line 66
Prefer a stronger configured model for difficult debugging, security-sensitive review or final verification.
- Distinctive: line 67
Use fallback only across providers the user has explicitly connected and is allowed to use.
- Distinctive: line 68
Avoid repeated retries after quota/authentication failures.
- Distinctive: line 69
Never rotate accounts, forge identities, bypass rate limits, scrape credentials, or evade usage restrictions.
- Distinctive: line 70
Never claim a task is complete based solely on model output.
- Distinctive: line 76
Keep system instructions concise and reuse stable prefixes where provider prompt caching is supported.
- Distinctive: line 77
Avoid sending secrets, binaries, generated bundles or irrelevant repository files.
- Distinctive: line 79
Do not promise a fixed savings percentage or zero tokens.
≈ “Common” is an estimate: at least 1 in 5 of the 364,980 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
OmniRoute, Ollama and Free LLM Routing
Goal
Use a user-controlled local gateway to route compatible coding clients to local Ollama models and eligible hosted providers. Prefer local inference when privacy or recurring cost matters; use hosted free tiers only within provider terms.
Before changing configuration
- Inspect the installed OmniRoute version and its official documentation: https://github.com/akoeraste/omniroute
- Check
omniroute doctor, the local dashboard, andomniroute models listwhere supported by the installed version. - Preserve existing Claude Code, Codex, MCP and provider configuration. Back up files before any change.
- Never print, commit, log or place API keys in shell history. Use the gateway's credential UI or documented secret environment variables.
- Never assume a free provider is available in the user's region or account.
Recommended setup
npm install -g omniroute
omnirouteOpen http://localhost:20128, connect providers through the gateway's Providers UI, and copy the gateway API key from Dashboard → Endpoints. Verify the API with the gateway's documented /v1/models endpoint before configuring clients.
For Claude Code and Codex CLI, prefer OmniRoute's own CLI integration so it can set the correct environment and model mapping:
omniroute run claude --model auto/coding
omniroute run codex --model auto/coding
omniroute configure claude
omniroute configure codexConfirm the exact supported commands with omniroute --help for the installed version. Do not assume every provider/model supports every coding-agent feature such as tool calling, long context, vision or structured output.
Ollama local models
- Install Ollama from https://ollama.com and start the local service.
- Pull a model compatible with the machine's RAM/VRAM, e.g.
ollama pull qwen2.5-coder:7b(model availability and tags can change). - Add the local Ollama provider in OmniRoute's provider settings and confirm it appears in the model list.
- Test a short request before selecting it for a large coding task.
Local inference has no hosted provider token quota, but is bounded by hardware, speed, power and model license. Local use is not literally unlimited compute.
Free hosted providers
Examples to check in OmniRoute's current provider catalog:
- Google Gemini API free tier
- Groq developer free tier
- Cerebras developer tier
- Cloudflare Workers AI free allocation
- NVIDIA NIM developer access
- Hugging Face Inference free allowances
- OpenRouter models marked
:free
Availability, limits, model names, rate limits, regions and terms change. Use the current dashboard/catalog and each provider's official terms instead of hard-coded quota claims. Some free tiers require API keys, phone verification, payment details, or regional eligibility.
Routing policy
- Use a local Ollama model for low-risk, private, repetitive tasks.
- Use a hosted free-tier model for tasks it can handle, while respecting limits.
- Prefer a stronger configured model for difficult debugging, security-sensitive review or final verification.
- Use fallback only across providers the user has explicitly connected and is allowed to use.
- Avoid repeated retries after quota/authentication failures; respect Retry-After and provider cooldowns.
- Never rotate accounts, forge identities, bypass rate limits, scrape credentials, or evade usage restrictions.
- Never claim a task is complete based solely on model output; run tests and inspect results.
Token and context optimization
- Load the smallest relevant skill and project context.
- Summarize repository state once, then update the summary when facts change.
- Keep system instructions concise and reuse stable prefixes where provider prompt caching is supported.
- Avoid sending secrets, binaries, generated bundles or irrelevant repository files.
- Compression can reduce input tokens but may remove important details; preserve code, commands, paths, URLs, JSON and exact error messages.
- Do not promise a fixed savings percentage or zero tokens. Measure usage using the provider/gateway usage view.
Claude.ai and ChatGPT web
The browser-based Claude.ai and ChatGPT interfaces do not automatically route their own model inference through a local OmniRoute gateway. Reuse this skill as project instructions, or use a supported API client, custom action/connector or coding CLI. Do not tell users that adding a repository skill changes the provider's hosted chat backend.
Troubleshooting
- Gateway unavailable: verify process, port 20128, local firewall and dashboard.
- Empty model list: connect a provider and check its credentials, region and eligibility.
- Model rejected: refresh the provider catalog and select a model actually listed by the gateway.
- Quota errors: honor cooldowns, switch only to another configured eligible provider, or use Ollama.
- Tool calls fail: select a model/provider with tool-calling support and test a minimal tool call.
- Claude/Codex config conflicts: stop, back up the current config and use OmniRoute's guided configure/run command rather than hand-editing blindly.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

