Big Query Setup
How production data is replicated from AWS RDS/Aurora into Google BigQuery in near-real-time using Google Datastream (serverless change data capture).
AWS RDS / Aurora ──CDC (binlog/WAL)──▶ Datastream (GCP, serverless) ──native upsert──▶ BigQuery
Pages in this section
- Datastream Explained (PostgreSQL) — the PostgreSQL setup step by step, with what each command does and why, plus troubleshooting and a fix-up cheat sheet.
- Datastream Implementation Guide — the full A-Z guide covering both MySQL and PostgreSQL sources, from source preparation to go-live.