OffNet Newsroom

Daily topic roundup

Database Technology

Saturday, September 12, 2026 · 7 stories, curated & summarized — click any story for the source.

Amazon RDS for Oracle now supports the Supplemental Patch Bundle (SPB) for the July 2026 Release Update for versions 19c and 26ai. This bundle replaces the former Oracle Spatial Patch Bundle and includes recommended patches for specific use cases like Spatial, Data Pump, and GoldenGate. Users can apply this update to new instances or upgrade existing ones using specific engine version labels.

  • SPB replaces the Oracle Spatial Patch Bundle starting with April 2026 releases
  • Includes patches for Oracle Spatial, Data Pump, and GoldenGate
  • Supports Oracle Database versions 19c and 26ai
  • Apply via new instance creation or upgrade to specific SPB engine versions
CHECKLISTSPB Update EssentialsReplaces Oracle Spatial Patch BundlePatches Spatial, Data Pump, GoldenGateSupports versions 19c and 26aiApply via new instance or upgrade

AWS now enables direct ad hoc SQL querying of DynamoDB data using DuckDB through a new zero-ETL integration. The solution automatically replicates DynamoDB tables into Apache Iceberg formats on Amazon S3 Tables. A Lambda function hosting DuckDB exposes this capability via an IAM-authorized function URL, eliminating the need for manual ETL pipelines.

  • Eliminates manual ETL by replicating DynamoDB to Iceberg on S3 automatically
  • Enables ad hoc SQL analysis using DuckDB without data movement overhead
  • Access is secured via Lambda function URLs with IAM authorization
  • Supports rapid prototyping for analytics on operational DynamoDB workloads
HOW IT WORKSZero-ETL Query Pipeline1DynamoDB data replicates to S32Data stored as Iceberg tables3Lambda hosts DuckDB engine4Ad hoc SQL queries execute

Christophe Pettus clarifies that PostgreSQL's max_files_per_process parameter functions as a recycled descriptor pool rather than a strict hard cap. When the pool is exhausted, the system silently recycles older file descriptors instead of throwing an error. This behavior ensures that applications continue to function even when approaching the configured limit.

  • Do not treat max_files_per_process as a hard failure threshold.
  • PostgreSQL recycles old descriptors when the pool is full.
  • Monitor actual descriptor usage to detect resource contention.
  • Adjust the setting if recycling causes performance latency.

Logical replication subscriptions in Postgres include a single, often overlooked configuration line that expands into over a dozen options affecting storage usage. While default subscriptions work fine for most users, production systems with multiple downstream replicas can experience rapid disk consumption from thousands of anonymous artifacts. This behavior occurs because the default settings do not explicitly restrict or manage how these replication artifacts are stored.

  • Review subscription configurations for logical replication to ensure storage options are explicit.
  • Monitor disk usage in replication directories if running multiple downstream replicas.
  • Default subscription settings may generate unexpected anonymous artifacts filling disk space.
  • The single configuration line for subscriptions controls over a dozen storage-affecting options.
CHECKLISTPrevent Disk FloodReview subscription configurations for logical replicationEnsure storage options are explicitMonitor disk usage in replication directoriesCheck for unexpected anonymous artifacts

Andrei Lepikhov highlights that built-in PostgreSQL aggregates like SUM(numeric) are often inefficient because they must handle the most general form of variable-length types. This inefficiency is particularly pronounced when partial aggregation fails to reduce the data volume, such as in ERP systems where monetary columns typically use fixed scales. The proposed solution involves creating custom extensions that tune aggregates to these specific, constrained data conditions rather than relying on generic implementations.

  • Built-in aggregates handle general cases, causing overhead on constrained data like fixed-scale numerics.
  • Partial aggregation often fails to help when the output set size remains comparable to the input.
  • Variable-length types suffer the most performance penalties in standard aggregate operations.
  • Custom extensions can optimize aggregates by targeting specific data constraints found in ERP systems.
TRADE-OFFGeneric vs Custom AggregatesBuilt-in AggregatesHandles general…High overhead on fixed dataInefficient partial aggregationCustom ExtensionsTargets specific data constraintsOptimized for fixed scalesBetter ERP performancevs
Hacker News (100+ points) general

Lessons from 5 Years Operating Petabyte-Scale ClickHouse Clusters

A practitioner shares operational insights gained from maintaining ClickHouse clusters at the petabyte scale over a five-year period. The article details practical experiences and architectural decisions made while managing high-throughput data workloads. These lessons focus on real-world stability, performance tuning, and infrastructure management challenges specific to large-scale deployments.

  • Operational complexity grows non-linearly with scale; plan for distinct monitoring and alerting thresholds.
  • Data modeling and partitioning strategies are critical for maintaining query latency at petabyte sizes.
  • Hardware provisioning must account for I/O bottlenecks and network saturation in distributed environments.
CHECKLIST5-Year ClickHouse Scale LessonsPlan non-linear monitoring thresholdsOptimize partitioning for latencyAddress I/O bottlenecksPrevent network saturation
PostgreSQL News database ↺ since 09-11

pg_vault_tde v1.7.1 adds TDE for PostgreSQL 17/18 with AES-256-GCM

The pg_vault_tde extension v1.7.1 enables transparent data encryption for PostgreSQL 17 and 18 using the encrypted_heap access method. It encrypts tuples with AES-256-GCM before storage and handles key management via HashiCorp Vault, OpenBao, PKCS#11, or local wallets. This release fixes AAD derivation for out-of-line TOAST values, but introduces a breaking change where TOAST data written by v1.7.0 or earlier will fail authentication.

  • Supports PostgreSQL 17 and 18 with OpenSSL 3.x and requires library preload configuration.
  • Uses AES-256-GCM for per-table encryption with online key rotation capabilities.
  • Integrates with external key managers like HashiCorp Vault, OpenBao, or HSMs.
  • Upgrade from v1.7.0 requires exporting and re-importing affected tables due to TOAST auth failures.
  • Applications remain unchanged as encryption is handled at the storage manager level.
TRADE-OFFpg_vault_tde v1.7.1 Key FeaturesEncryption CapabilitiesAES-256-GCM per-table encryptionSupports PostgreSQL versions 17…Online key rotation availableKey ManagementHashiCorp Vault and OpenBaoPKCS#11 and local walletsOpenSSL 3.x compatibilityvs
↑