build-with-openai
Skill1 starsChanged 5 months agoMITView on GitHub
Runs OpenAI API workflows for agents, function calling, voice/Realtime, fine-tuning (SFT/DPO/RFT), sandboxes, Codex coding agents, and multimodal products. Use when building with OpenAI Agents SDK, Realtime API, tool loops, enterprise agent rollout, microVM sandboxes, or GPT-4o vision/voice.
In this repository51 other files it gives its agents.
- architect-enterprise-aiSkill
- author-agent-skillsSkill
- build-agent-harnessesSkill
- build-aiewf-2024-ragSkill
- build-generative-mediaSkill
- build-multimodal-productsSkill
- build-rag-search-stacksSkill
- build-robotics-aiSkill
- build-with-deepmindSkill
- build-with-microsoft-aiSkill
- deploy-public-sector-aiSkill
- design-agent-skillsSkill
- evaluate-with-braintrustSkill
- lead-ai-engineering-teamsSkill
- lead-ai-transformationSkill
- learn-summit-2023-remoteSkill
- learn-summit-2023-talksSkill
- navigate-aie-europe-2026Skill
- navigate-aiewf-2024-keynotesSkill
- observe-ai-productionSkill
- operate-agent-memorySkill
- operate-legal-ai-agentsSkill
- operate-openclaw-agentsSkill
- optimize-llm-inferenceSkill
- plan-sovereign-aiSkill
- price-ai-productsSkill
- run-aiewf-2024-evalsSkill
- run-llm-evalsSkill
- run-summit-2023-workshopsSkill
- secure-ai-agentsSkill
- ship-ai-as-pmSkill
- ship-aiewf-2024-agentsSkill
- train-llms-locallySkill
- architecture-reviewSkill
- chat-failure-auditSkill
- create-a-skillSkill
- cross-model-reviewSkill
- cto-weekly-reviewSkill
- friction-auditSkill
- ig-carouselSkill
- pdf-reportSkill
- raise-prSkill
- reel-editSkill
- research-reportSkill
- ship-checkSkill
- spec-grounded-designSkill
- state-lifetime-decisionSkill
- ste100Skill
- scroll-engineeringSkill
- ui-uxSkill
- verify-like-a-userSkill
The file
Files
Build with OpenAI
Action playbook from twelve OpenAI @ AI Engineer talks. Do not summarize talks — pick a workflow theme and execute it.
Supporting files:
- workflows.md — voice, fine-tuning, function-calling, sandboxes, coding-agents, multimodal, agents-enterprise
- source-index.md
Optional deliverables: ./skill-outputs/build-with-openai/
Step 0 — Pick workflow theme
What is the user trying to do?
├─ Tool loops, schemas, parallel calls, RAG-as-tools → function-calling
├─ SFT / DPO / RFT, graders, shrink prompts → fine-tuning
├─ Realtime, speech-to-speech, WebRTC vs WebSocket → voice
├─ Isolate agent code exec, microVMs, RL rewards → sandboxes
├─ Codex harness, Agents SDK, PR/terminal agents → coding-agents
├─ Vision, image gen, video frames, GPT-4o modalities → multimodal
└─ Enterprise pilot, guardrails, co-create UX → agents-enterpriseOpen the matching section in workflows.md.
Install
cp -r skills/build-with-openai ~/.claude/skills/
cp -r skills/build-with-openai ~/.cursor/skills/
cp -r skills/build-with-openai ~/.codex/skills/
cp -r skills/build-with-openai ~/.agents/skills/Source: ingest-into-skills playlists/openai-ai-engineer/.
Cross-cutting rules
| Rule | Source |
| Agents = model + instructions + tools + runtime loop | [src-007 @ 0:01] |
| Default 10–20 tools per turn; route if more | [src-004 @ 1:16] |
| Eval tool execution, not just completions | [src-004 @ 1:21] |
| Single agent in prod first; guardrails on edges | [src-002 @ 12:13] |
| Speech-to-speech beats STT→LLM→TTS for latency | [src-008 @ 0:04] |
Output to user
- Name theme + deliverables
- Save artifacts under
./skill-outputs/build-with-openai/when requested - Do not auto-commit
Invocation examples
@build-with-openai design Realtime voice agent with tool delegation
RFT graders for our support bot tool routing
should we use WebRTC or WebSocket for this voice app?Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

