Fan-In CDC Topology for Multi-Source Postgres and MySQL to Snowflake
Separate source positions and add schema mapping to merge multiple databases safely.
Priya Subramaniam
Section
Data Warehouses
10 stories in Data Warehouses.
Data Warehouse Architecture Types for Real-Time Ingestion
Four warehouse architectures make different tradeoffs between freshness and consistency.
Priya Subramaniam
Snowflake Dynamic Tables vs Streams and Tasks for CDC
Declarative tables handle orchestration; engineers own the pipeline with streams and tasks.
Priya Subramaniam
BigQuery Storage Write API vs Streaming Insert for CDC Pipelines
Storage Write API's committed stream mode guarantees exactly-once delivery for CDC.
Tomasz Wierzbicki
Redshift Merge Performance at High CDC Throughput
Ghost rows from CDC updates overwhelm Redshift's block-level optimizations.
Dara Okonkwo
ClickHouse ReplacingMergeTree for CDC Workloads
How ReplacingMergeTree handles CDC's continuous stream of updates and deletes.
Tomasz Wierzbicki
Snowflake vs Bigquery vs Redshift for Real-Time Workloads
Priya Subramaniam
Fan-In Replication From Multiple Databases Into One Warehouse
Consolidating multiple databases into one warehouse surfaces identity collisions and schema drift.
Dara Okonkwo
Warehouse-Specific Schema Evolution Behavior Compared
Different warehouses handle schema changes at different speeds and costs during live replication.
Priya Subramaniam
Databricks Lakehouse Architecture for Operational Data Replication
Three architectural layers ensure reliable data replication into Databricks.
Dara Okonkwo