pg-cdc streams Postgres WAL to immutable Iceberg tables on S3
pg-cdc is a single-binary tool that reads Postgres Write Ahead Logs and writes typed, immutable Parquet files to AWS S3 in Iceberg format. It integrates with AWS Glue for metadata and enforces access control via Lake Formation tags, ensuring consumers never need database credentials. The architecture is strictly one-way, preventing any data from flowing back to the production database, which isolates analytics workloads from the source system.
Single binary implementation with no JVM dependency reduces deployment overhead.