airflow
AGENTS.md47k starsChanged 2 days agoApache-2.0View on GitHub
breeze ci approve-workflow-runs (run by workflows/auto-approve-workflow-runs.yml) decides whether to approve an external contributor's CI runs from an estimate of the job-minutes they take. The numbers live in dev/breeze/src/airflowbreeze/utils/ciminutes_estimate.py and are medians measured on recent Tests (AMD) PR runs on public runners. After you change the CI workflows in a way that adds, removes, splits or resizes jobs (new test groups, a changed matrix, new composite workflows, a move between runner types), refresh the estimates once the change has run on…
We split this AGENTS.md into the rules it gives an agent
3 rules. About 0 are common, 1 is distinctive, and 2 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈1
Distinctive · estimate
This author's own choices. Worth a look.
2
Very specific
Tied to their project's names, files or tools. Probably skip.
- Common
- Distinctive
- Very specific
- Distinctive: line 22
After you change the CI workflows in a way that adds, removes, splits or resizes jobs (new test groups, a changed matrix, new composite …
- Very specific: line 31
When you add a new job group to the workflows, add a matching group to both ci_minutes_estimate.py (with the selective-check output that …
- Very specific: line 34
Run uv run --project dev/breeze pytest dev/breeze/tests/test_ci_minutes_estimate.py dev/breeze/tests/test_workflow_run_approval.py -xvs.
≈ “Common” is an estimate: at least 1 in 5 of the 36,368 AGENTS.md files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Files
<!-- SPDX-License-Identifier: Apache-2.0
https://www.apache.org/licenses/LICENSE-2.0 --><!-- START doctoc generated TOC please keep comment here to allow auto update --><!-- DON'T EDIT THIS SECTION, INSTEAD RE-RUN doctoc TO UPDATE -->Table of Contents generated with DocToc
- The
.githubfolder — Agent Instructions- Keep the CI-minutes estimates in sync with the workflows
<!-- END doctoc generated TOC please keep comment here to allow auto update -->The .github folder — Agent Instructions
Keep the CI-minutes estimates in sync with the workflows
breeze ci approve-workflow-runs (run by workflows/auto-approve-workflow-runs.yml) decides whether
to approve an external contributor's CI runs from an estimate of the job-minutes they take. The
numbers live in dev/breeze/src/airflow_breeze/utils/ci_minutes_estimate.py and are medians
measured on recent Tests (AMD) PR runs on public runners.
After you change the CI workflows in a way that adds, removes, splits or resizes jobs (new test groups, a changed matrix, new composite workflows, a move between runner types), refresh the estimates once the change has run on enough PRs, and in any case about once a month:
- Run
uv run dev/calibrate_ci_minutes_estimates.py --since <date>from the repository root with an authenticatedghCLI. Pick a date that covers at least a week of runs after the workflow change. - Copy the medians and fits it prints into the constants of
ci_minutes_estimate.py, and update the "Last calibrated" line next to them. - When you add a new job group to the workflows, add a matching group to both
ci_minutes_estimate.py(with the selective-check output that turns it on) and theJOB_GROUPSpatterns of the calibration script. Unmatched jobs fall into the base group. - Run
uv run --project dev/breeze pytest dev/breeze/tests/test_ci_minutes_estimate.py dev/breeze/tests/test_workflow_run_approval.py -xvs.
The estimates cover public runners only. Self-hosted (RunsOn) runners need their own set once there is enough data from them.
Trending
Steady talk.about the whole repository
Who's talking about apache/airflow
- Neil's Life Hacks“Apache Airflow in 12 Mins | Intro + Installation | Step By Step Guide”YouTube · Aug 15, 2020 · 24k views
- Talk Python“Apache Airflow Open-Source Workflow with Python - Talk Python to Me Ep. 330”YouTube · Aug 6, 2021 · 1.6k views
- EuroPython Conference“Orchestrating Python Workflows in Apache Airflow — Sebastien Crocquevieille”YouTube · Sep 19, 2023 · 1.4k views
- GithubTrends“Airflow Runs Unlimited Pipelines Free (Zapier Charges $29/mo) #Shorts”YouTube · Jun 19, 2026 · 1.3k views
- Repositorios que deberías conocer“Apache Airflow: orquesta tus pipelines de datos 🛫”YouTube · Jul 25, 2026 · 1.3k views
The biggest 5 of 78 mentions linking to the repository that our crawl found. Each line is their own headline.
See all 78
Talked about on Stack Overflow, YouTube, GitHub, Bluesky and Hacker News (78 times).
On Stack Overflow · 30
- Apr 8, 2020Starting Airflow webserver fails with sqlalchemy.exc.NoInspectionAvailable: No inspection system is available56 votes
- Oct 5, 2020Airflow - got an unexpected keyword argument 'conf'30 votes
- Jun 14, 2018Airflow: set a default value in code when Variable doesn't exist without an exception27 votes
- Jun 5, 2021Cannot install additional requirements to apache airflow21 votes · 3 answers
- Dec 13, 2019How to trigger airflow dag manually?21 votes
25 more on Stack Overflow
- Dec 14, 2021Proper way to create dynamic workflows in Airflow20 votes
- Jan 29, 2024airflow db migrate is giving TypeError: SqlAlchemySessionInterface.__init__() missing 6 required positional18 votes
- Nov 8, 2021How to pass pandas dataframe to airflow tasks17 votes
- Mar 24, 2020Pgbouncer: how to run within a kubernetes cluster properly17 votes
- May 1, 2020How to view code in a Github repository as of a specific release?13 votes · 3 answers
- Apr 10, 2020Airflow too many connections as a default13 votes
- Mar 29, 2019Airflow connection UI not visible12 votes
- Sep 18, 2021Airflow DAG fails when PythonOperator with error "Negsignal.SIGKILL"11 votes
- Sep 13, 2021How to access Airflow 2.0 cli11 votes
- Jul 2, 2020Airflow - Send email with AWS SES11 votes
- Aug 24, 2019Apache airflow: No module name 'airflow'11 votes · 1 answer
- May 18, 2022Airflow:Docker-Compose:"You are running pip as root Please use user to run pip"10 votes
- Jul 7, 2021Writing to Airflow Logs10 votes
- Nov 23, 2020Airflow webserver gettins valueError:Samesite10 votes
- Jun 5, 2023Why is my Airflow hanging up if I send a http request inside a task?9 votes
- May 24, 2019how to pass query parameter to sql file using bigquery operator8 votes
- Jul 3, 2022Branching in Apache Airflow using TaskFlowAPI7 votes
- Apr 13, 2022Airflow DockerOperator: connect sock.connect(self.unix_socket) FileNotFoundError: [Errno 2] No such file or directory7 votes
- Sep 14, 2021Cannot import name FlowerCommand from flower.command7 votes
- Apr 28, 2021Can I use a TriggerDagRunOperator to pass a parameter to the triggered dag? Airflow7 votes
- Apr 22, 2021import error after upgrade to airflow2.0.27 votes
- Mar 25, 2021No module named 'airflow' when initializing Apache airflow docker7 votes · 4 answers
- Mar 5, 2021Can I use a TriggerDagRunOperator to pass a parameter to the triggered dag? Airflow7 votes · 2 answers
- May 9, 2019Airflow 1.10.3 SubDag can only run 1 task in parallel even the concurrency is 87 votes
- Mar 18, 2020Airflow - How to use security authorization of REST API6 votes
On YouTube · 23
- Aug 15, 2020Apache Airflow in 12 Mins | Intro + Installation | Step By Step Guide — Neil's Life Hacks24k views · 37 comments
- Aug 6, 2021Apache Airflow Open-Source Workflow with Python - Talk Python to Me Ep. 330 — Talk Python1.6k views · 6 comments
- Sep 19, 2023Orchestrating Python Workflows in Apache Airflow — Sebastien Crocquevieille — EuroPython Conference1.4k views
- Jun 19, 2026Airflow Runs Unlimited Pipelines Free (Zapier Charges $29/mo) #Shorts — GithubTrends1.3k views
- Jul 25, 2026Apache Airflow: orquesta tus pipelines de datos 🛫 — Repositorios que deberías conocer1.3k views
18 more on YouTube
- Oct 1, 2023Better Support for Using Multiple Namespaces with KubernetesExecutor — Apache Airflow689 views · 1 comment
- Sep 24, 2026Improving security in Airflow 3 — Astronomer589 views · 10 comments
- Aug 10, 2023Airflow 2.7 Features Overview! — The Data and AI Guy411 views
- Apr 3, 2024How to Back-Up/Migrate Data from AWS DynamoDB to an S3 Bucket with Airflow! — The Data and AI Guy311 views
- Mar 9, 2026CVE-2025-69219: Apache Airflow Deserialization to RCE — Ahmet Artuç246 views · 1 comment
- Jan 25, 2024How to Pull Information from the Google Rest API and Store it in AWS S3 with Airflow! — The Data and AI Guy242 views
- Sep 13, 2020Data Pipeline using Airflow in Financial Organizations — LambdaEdge239 views
- Nov 16, 2024Behaviour Driven Development in Airflow — Apache Airflow175 views
- Aug 5, 2024Airflow with WSL - BashOperator and simple XComs example — DataSecOps166 views
- Sep 22, 2026Apache Airflow: The Self‑Hosted Workflow Powerhouse That Beats Zapier — CodeAZ123 views
- Aug 4, 2024Understanding Apache Airflow Components: A Comprehensive Guide — JC Course105 views
- Jan 15, 2025Airflow Scheduler - Playing around — Rafa Valero77 views
- Mar 26, 2026How to Evaluate Custom Agent Skills in Claude Code — GSoC 2026 Apache Airflow PoC — Michael Chen41 views
- Aug 20, 2024GitHub - apache/airflow: Apache Airflow - A platform to programmatically author, schedule, and mo... — GitHub Daily Trend AI Podcast16 views
- Jul 24, 2026Python開発者向け|Apache Airflowでバッチ処理の依存関係とリトライを一元管理する方法 — さつきのOSS研究室8 views · 1 comment
- Sep 22, 2026Apache Airflow Kafka Provider Flaw Can Reach the Scheduler — AISLabs AI7 views · 1 comment
- Oct 11, 2026Your 3 AM Report Failed and Nobody Knew. Apache Airflow Fixes That, Free #Shorts — Skynetlabs4 views
- Aug 9, 2026빌드팀 추천 GitHub 리포 EP.93 — airflow — 세균무기 germweapon3 views
On GitHub · 16
- Feb 15, 2021Helm post-install hooks are not triggered when used by `helm_release` and `wait = true` — hashicorp/terraform-provider-helm60 reactions · 16 comments
- Jun 16, 2024NumPy 2.0.0 on Python 3.12 causes binary compatibilty issues with numpy.dtype for pandas 2.1.1 — numpy/numpy43 reactions · 21 comments
- Feb 29, 2024Support `--user` flag from pip — astral-sh/uv42 reactions · 96 comments
- Apr 4, 2022Pushing cache to "registry" cache with multi-node builder only uploads cache from one node — docker/buildx31 reactions · 15 comments
- Apr 19, 2021Dealing with jobs failing with "lost communication with the server" errors — actions/actions-runner-controller30 reactions · 15 comments
11 more on GitHub
- Sep 11, 2023Allow `buildkit` build in `az acr build` — Azure/acr26 reactions · 14 comments
- Aug 14, 2020Generate id_token from default credentials — googleapis/google-cloud-python26 reactions · 5 comments
- Aug 29, 2025Pytest-rerunfailures==16.0 causes INTERNALERROR with XFAIL tests — pytest-dev/pytest-rerunfailures18 reactions · 3 comments
- Apr 9, 2025Python images (At least bookwork-slim) relased today break installation of sdist packages — docker-library/python18 reactions · 21 comments
- Apr 12, 2019Bump Airflow version to 1.10.3 — puckel/docker-airflow18 reactions · 2 comments
- Nov 17, 2022Support for "soft" or suggested constraints — python-poetry/poetry17 reactions · 27 comments
- May 20, 2020refactor: AUTH_LDAP/AUTH_OAUTH + implement role mapping — dpgaspar/Flask-AppBuilder8 reactions · 35 comments
- Apr 12, 2020Bump airflow version to 1.10.10 — puckel/docker-airflow8 reactions · 20 comments
- Oct 4, 2021fix: OAuth login flow — dpgaspar/Flask-AppBuilder5 reactions · 10 comments
- Jul 5, 2019Fix werkzeug dependency that breaks image build — puckel/docker-airflow5 reactions · 2 comments
- Apr 26, 2019Bump to 1.10.3 — puckel/docker-airflow5 reactions · 3 comments
On Bluesky · 6
- Apr 9, 2024Apache Airflow : une plateforme Open Source pour créer, planifier et monitorer des workflow de manière programmatique. ->… — @bearstech.com4 likes and reposts · 1 reply
- Jul 20, 2024📦 apache / airflow ⭐ 35,456 (+13) 🗒 Python Apache Airflow - A platform to programmatically author, schedule, and monitor workflows — @github-trending.bsky.social2 likes and reposts
- Mar 22, 2026https://github.com/apache/airflow — @tom-doerr.bsky.social1 likes and repost
- Sep 5, 2025📦 apache / airflow ⭐ 41,888 (+22) 🗒 Python Apache Airflow - A platform to programmatically author, schedule, and monitor workflows — @github-trending.bsky.social1 likes and repost
- Dec 21, 2024今日のGitHubトレンド apache/airflow このリポジトリは、Apache Airflowというワークフロー管理プラットフォームのソースコードを公開しています。 Apache… — @dailygithubtrends.bsky.social1 likes and repost
1 more on Bluesky
- Mar 28, 2024📦 apache / airflow ⭐ 34,035 (+19) 🗒 Python Apache Airflow - A platform to programmatically author, schedule, and monitor workflows — @github-trending.bsky.social1 likes and repost
On Hacker News · 3
- Jan 4, 2020Apache Airflow: programmatically author, schedule, monitor workflows6 points
- Jul 18, 2025Apache Airflow2 points
- Oct 12, 2022TemplateNotFound Error1 point
Where files are headingNew AGENTS.md files have more rules about keeping secrets out of the code, and fewer about code style.
Of the AGENTS.md files we read, the 28,693 first seen in the last six months, against the older ones: the kind of rule that gained most share, and the kind that lost most. About files like this in general, not this one, and an estimate, since a kind is a pattern in the words.
In this repository12 other files it gives its agents.
- AGENTS.mdAGENTS.md
- dev/AGENTS.mdAGENTS.md
- providers/AGENTS.mdAGENTS.md
- registry/AGENTS.mdAGENTS.md
- aip-user-storiesSkill
- airflow-java-sdkSkill
- airflow-new-sdkSkill
- airflow-pr-draft-summarySkill
- airflow-publish-changesSkill
- airflow-translationsSkill
- prepare-providers-documentationSkill
- upgrade-fab-providerSkill
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

