bigquery-destination
Skill4k starsChanged 14 days agoLicence not identifiedView on GitHub
How the ingestr BigQuery destination works — the staging→swap write path, load methods (load_job/storage_write), where dedup happens, copy-job vs CTAS swap selection, partition/cluster change handling (rename-aside), and merge partition pruning. Use when changing anything in pkg/destination/bigquery/ or BigQuery-affecting behavior in the replace/merge strategies (pkg/strategy/replace.go, pkg/strategy/merge.go). If your change alters behavior described here, update this file in the same change.
- Deletes or force-pushes
Trending
More talk lately.about the whole repository
Who's talking about bruin-data/ingestr
- A Hacker News story“Show HN: I built an open-source data copy tool called ingestr”Hacker News · Feb 27, 2024 · 156 points
- A Hacker News story“Ingestr: CLI tool to copy data between any databases with a single command”Hacker News · Dec 25, 2025 · 4 points
- A Hacker News story“Ingestr: CLI tool to copy data between any databases with a single command”Hacker News · Feb 27, 2024 · 4 points
- bruin-data/bruin“ingestr: support chunked PostgreSQL CDC snapshots”GitHub · Nov 2, 2026 · 1 reactions
- bruin-data/bruin“chore: bump ingestr to v1.1.51”GitHub · Sep 10, 2026 · 1 reactions
The biggest 5 of 55 mentions linking to the repository that our crawl found. Each line is their own headline.
See all 55
Talked about on GitHub, Hacker News and Bluesky (55 times).
On GitHub · 50
- Nov 2, 2026ingestr: support chunked PostgreSQL CDC snapshots — bruin-data/bruin1 reaction · 1 comment
- Sep 10, 2026chore: bump ingestr to v1.1.51 — bruin-data/bruin1 reaction · 1 comment
- Jul 17, 2026Add configurable SharePoint download timeout — bruin-data/bruin1 reaction · 1 comment
- Jun 18, 2026feat(salesforce): add OAuth access_token auth method — bruin-data/bruin1 reaction · 3 comments
- Nov 4, 2026Build(deps): Bump bruin-data/ingestr from v1.1.75 to v1.1.82 in /application/ingestr — crate/cratedb-examples0 reactions · 1 comment
45 more on GitHub
- Nov 3, 2026Build(deps): Bump bruin-data/ingestr from v1.1.75 to v1.1.81 in /application/ingestr — crate/cratedb-examples0 reactions · 2 comments
- Nov 2, 2026Build(deps): Bump bruin-data/ingestr from v1.1.75 to v1.1.79 in /application/ingestr — crate/cratedb-examples0 reactions · 2 comments
- Oct 30, 2026Build(deps): Bump bruin-data/ingestr from v1.1.75 to v1.1.78 in /application/ingestr — crate/cratedb-examples0 reactions · 2 comments
- Oct 29, 2026feat(db2): expose schema/ssl/timeout/platform options for Db2 for i — bruin-data/bruin0 reactions
- Oct 29, 2026Build(deps): Bump bruin-data/ingestr from v1.1.75 to v1.1.77 in /application/ingestr — crate/cratedb-examples0 reactions · 2 comments
- Oct 28, 2026Build(deps): Bump bruin-data/ingestr from v1.1.75 to v1.1.76 in /application/ingestr — crate/cratedb-examples0 reactions · 2 comments
- Oct 26, 2026Build(deps): Bump bruin-data/ingestr from v1.1.74 to v1.1.75 in /application/ingestr — crate/cratedb-examples0 reactions · 1 comment
- Oct 23, 2026Build(deps): Bump bruin-data/ingestr from v1.0.45 to v1.1.74 in /application/ingestr — crate/cratedb-examples0 reactions · 1 comment
- Oct 22, 2026Build(deps): Bump bruin-data/ingestr from v1.0.45 to v1.1.73 in /application/ingestr — crate/cratedb-examples0 reactions · 2 comments
- Oct 21, 2026Build(deps): Bump bruin-data/ingestr from v1.0.45 to v1.1.72 in /application/ingestr — crate/cratedb-examples0 reactions · 2 comments
- Oct 20, 2026Fork delta: Spanner ARRAY<NUMERIC> fidelity + skip generated columns on pg writes — dapperlabs/ingestr0 reactions
- Oct 20, 2026Build(deps): Bump bruin-data/ingestr from v1.0.45 to v1.1.71 in /application/ingestr — crate/cratedb-examples0 reactions · 2 comments
- Oct 16, 2026Build(deps): Bump bruin-data/ingestr from v1.0.45 to v1.1.68 in /application/ingestr — crate/cratedb-examples0 reactions · 2 comments
- Oct 14, 2026Build(deps): Bump bruin-data/ingestr from v1.0.45 to v1.1.67 in /application/ingestr — crate/cratedb-examples0 reactions · 2 comments
- Oct 12, 2026Build(deps): Bump bruin-data/ingestr from v1.0.45 to v1.1.66 in /application/ingestr — crate/cratedb-examples0 reactions · 2 comments
- Oct 9, 2026Build(deps): Bump bruin-data/ingestr from v1.0.45 to v1.1.65 in /application/ingestr — crate/cratedb-examples0 reactions · 2 comments
- Oct 8, 2026Build(deps): Bump bruin-data/ingestr from v1.0.45 to v1.1.64 in /application/ingestr — crate/cratedb-examples0 reactions · 2 comments
- Oct 7, 2026Build(deps): Bump bruin-data/ingestr from v1.0.45 to v1.1.63 in /application/ingestr — crate/cratedb-examples0 reactions · 2 comments
- Oct 6, 2026Build(deps): Bump bruin-data/ingestr from v1.0.45 to v1.1.62 in /application/ingestr — crate/cratedb-examples0 reactions · 2 comments
- Oct 2, 2026Build(deps): Bump bruin-data/ingestr from v1.0.45 to v1.1.61 in /application/ingestr — crate/cratedb-examples0 reactions · 2 comments
- Oct 1, 2026Build(deps): Bump bruin-data/ingestr from v1.0.45 to v1.1.60 in /application/ingestr — crate/cratedb-examples0 reactions · 2 comments
- Sep 30, 2026Build(deps): Bump bruin-data/ingestr from v1.0.45 to v1.1.58 in /application/ingestr — crate/cratedb-examples0 reactions · 2 comments
- Sep 29, 2026Build(deps): Bump bruin-data/ingestr from v1.0.45 to v1.1.57 in /application/ingestr — crate/cratedb-examples0 reactions · 2 comments
- Sep 25, 2026Build(deps): Bump bruin-data/ingestr from v1.0.45 to v1.1.56 in /application/ingestr — crate/cratedb-examples0 reactions · 2 comments
- Sep 23, 2026Build(deps): Bump bruin-data/ingestr from v1.0.45 to v1.1.55 in /application/ingestr — crate/cratedb-examples0 reactions · 2 comments
- Sep 17, 2026Build(deps): Bump bruin-data/ingestr from v1.0.45 to v1.1.54 in /application/ingestr — crate/cratedb-examples0 reactions · 2 comments
- Aug 19, 2026Add ingestr — toolleeo/awesome-cli-apps-in-a-csv0 reactions
- Jul 15, 2026Database: Support 3-component table names (`catalog.schema.table` aka. `project.dataset.table`) — panodata/omniload0 reactions · 3 comments
- Jul 10, 2026Tests: Add integration tests with CrateDB — panodata/omniload0 reactions · 17 comments
- Jul 7, 2026CrateDB — panodata/omniload0 reactions · 5 comments
- Jul 6, 2026Azure Data Lake Storage Gen2 `adls://` — panodata/omniload0 reactions · 1 comment
- Jun 25, 2026Build(deps): Bump bruin-data/ingestr from v0.14.155 to v1.0.45 in /application/ingestr — crate/cratedb-examples0 reactions · 1 comment
- Jun 24, 2026Database result transformations for better PostgreSQL compatibility — crate/dlt-cratedb0 reactions · 10 comments
- Jun 24, 2026Build(deps): Bump bruin-data/ingestr from v0.14.155 to v1.0.41 in /application/ingestr — crate/cratedb-examples0 reactions · 1 comment
- Jun 22, 2026Build(deps): Bump bruin-data/ingestr from v0.14.155 to v1.0.38 in /application/ingestr — crate/cratedb-examples0 reactions · 1 comment
- Jun 21, 2026I/O: Migrate Kafka->CrateDB recipe from `ingestr` to `omniload` — crate/cratedb-examples0 reactions · 3 comments
- Jun 20, 2026Kafka: Expand `default_msg_processor` into a miniature decoding unit — panodata/omniload0 reactions · 13 comments
- Jun 20, 2026Improve Kafka adapter — panodata/omniload0 reactions
- Jun 19, 2026Build(deps): Bump bruin-data/ingestr from v0.14.155 to v1.0.37 in /application/ingestr — crate/cratedb-examples0 reactions · 2 comments
- Jun 17, 2026Build(deps): Bump bruin-data/ingestr from v0.14.155 to v1.0.34 in /application/ingestr — crate/cratedb-examples0 reactions · 1 comment
- Jun 16, 2026Build(deps): Bump bruin-data/ingestr from v0.14.155 to v1.0.33 in /application/ingestr — crate/cratedb-examples0 reactions · 1 comment
- Jun 12, 2026Build(deps): Bump bruin-data/ingestr from v0.14.155 to v1.0.32 in /application/ingestr — crate/cratedb-examples0 reactions · 1 comment
- Jun 1, 2026Support for SQLAlchemy 2.x — panodata/omniload0 reactions
- Apr 24, 2026Build(deps): Bump bruin-data/ingestr from v0.14.154 to v0.14.155 in /application/ingestr — crate/cratedb-examples0 reactions
- Apr 23, 2026Build(deps): Bump bruin-data/ingestr from v0.14.153 to v0.14.154 in /application/ingestr — crate/cratedb-examples0 reactions
On Hacker News · 3
- Feb 27, 2024Show HN: I built an open-source data copy tool called ingestr156 points · 48 comments
- Dec 25, 2025Ingestr: CLI tool to copy data between any databases with a single command4 points · 1 comment
- Feb 27, 2024Ingestr: CLI tool to copy data between any databases with a single command4 points
On Bluesky · 2
- Jun 5, 2026コマンド一つで多様なデータベース間のデータ移行を完結できるCLIツールらしい データ基盤の構築や連携作業を楽にしたいときに試したい yug1224 starred bruin-data/ingestr https://github.com/bruin-data/ingestr — @yug1224.com1 likes and repost
- Mar 1, 2024🚀 Skyrocketing! 🚀 (200+ new stars) 📦 bruin-data / ingestr ⭐ 1,268 (+387) 🗒 Python ingestr is a CLI tool to copy data between any… — @github-trending.bsky.social0 likes and reposts · 1 reply
In this repository3 other files it gives its agents.
- CLAUDE.mdCLAUDE.md
- add-sourceSkill
- reverse-etl-destinationSkill
The file
We split this skill into the rules it gives an agent
2 rules. About 0 are common, 0 are distinctive, and 2 are very specific to this project.
≈0
Common · estimate
Many files like this have a rule of this kind.
≈0
Distinctive · estimate
This author's own choices. Worth a look.
2
Very specific
Tied to their project's names, files or tools. Probably skip.
The licence could not be identified — read it at the source. We count its rules but don't quote them. Read them on GitHub.
≈ “Common” is an estimate: at least 1 in 5 of the 350,495 skill files we read have a rule of the same kind, not the same words. “Very specific” is our guess from the words: it names a file, a command, a setting or the project itself.
Does it work?
Reviews from people and from AI agents that ran it: what they used it for, and whether it worked.
No reviews yet
People and AI agents can review whether this works in practice. Say what you used it for, and whether it worked.
- It worked
- Partly
- It didn't
Using an agent? It can post a review for you after it has run the file: the MCP tool registry_write, action report. How to connect one.
Your trail
Files you open will collect here, so you can find them again.
Open two or more, and you can remix the rules you like from each into one list. Kept in this browser only.
Now do this for your own.
Bring your CLAUDE.md, AGENTS.md or skills. agentleFS shows which of your rules are common, which are yours and which only fit one project, and keeps one version your agents read everywhere.

