OffNet Newsroom

Daily topic roundup

Database Technology

Friday, September 11, 2026 · 8 stories, curated & summarized — click any story for the source.

Dalibo has launched the first stable version of PostgreSQL Migrator, an open-source tool built in Go to migrate databases from Oracle and MySQL/MariaDB. The release features an interactive web UI for browsing catalogs, offline inspection capabilities, and complexity scoring to assess migration difficulty. It supports schema and data conversion, including datatype mapping and SQL expression transpilation for PL/SQL routines.

  • Pure Go binary with zero proprietary dependencies simplifies deployment.
  • Offline inspection allows catalog extraction and iterative conversion without live connections.
  • Complexity scoring helps prioritize and estimate effort for migration projects.
  • Interactive web UI enables searching objects and identifying blockers visually.
CHECKLISTKey Migration CapabilitiesPure Go binary with zero dependenciesOffline catalog inspection and conversionComplexity scoring for effort estimationInteractive web UI for blockers
Hacker News (100+ points) general

PlanetScale introduces Neki, a sharded Postgres solution

PlanetScale has launched Neki, a new database engine designed to provide sharded PostgreSQL capabilities. This release aims to address scalability challenges for large-scale applications by distributing data across multiple nodes while maintaining a familiar Postgres interface. The introduction marks a significant step in expanding PlanetScale's infrastructure offerings beyond their existing Vitess-based MySQL services.

  • Neki enables horizontal scaling for Postgres workloads via sharding.
  • Maintains Postgres compatibility for easier migration and development.
  • Expands PlanetScale's portfolio into the Postgres ecosystem.
  • Targets high-throughput applications requiring distributed data storage.

Christophe Pettus argues that max_connections functions primarily as a memory budget and circuit breaker rather than a hard limit on concurrent query execution. Actual concurrency is constrained by CPU cores and storage capacity, which are determined by the underlying hardware. This setting controls how many client backends the server can spawn, not how many queries run simultaneously.

  • max_connections is a memory budget and circuit breaker, not a query concurrency limiter.
  • Real concurrency limits are defined by CPU cores and storage I/O capacity.
  • Hardware selection, not GUC tuning, determines maximum simultaneous query load.
  • Adjust max_connections to manage backend memory overhead, not query throughput.

Microsoft has halted new customer onboarding for Azure SQL Data Sync, with a full service termination scheduled before 2027. While existing deployments remain operational, the vendor has not announced a direct replacement product. This leaves current users with limited visibility into the migration path for ongoing synchronization needs.

  • New onboarding for Azure SQL Data Sync is closed immediately.
  • Service termination is set before 2027, forcing eventual migration.
  • No like-for-like successor has been provided by Microsoft.
  • Existing customers can continue operations until the cutoff date.

The pg_vault_tde extension now supports PostgreSQL 17 and 18, offering transparent AES-256-GCM encryption at the table level via the encrypted_heap access method. This release fixes an Authenticated Encryption with Associated Data (AAD) derivation bug that breaks authentication for TOAST values created in v1.7.0. Consequently, any tables with out-of-line TOAST data encrypted under the previous version must be exported and re-imported to function correctly with v1.7.1.

  • Supports PostgreSQL 17 and 18 with AES-256-GCM tuple encryption without app changes.
  • Critical fix for AAD derivation in out-of-line TOAST values from v1.7.0.
  • Upgrading requires exporting and reloading affected tables to restore data integrity.
  • Keys integrate with HashiCorp Vault, OpenBao, PKCS#11, HSM, or local wallets.
  • Requires OpenSSL 3.x and configuration in shared_preload_libraries.

Fleet impact: For PostgreSQL fleets on AWS RDS/Aurora using pg_vault_tde, immediately audit tables with large TOAST payloads (e.g., JSONB, arrays, text) for potential data corruption after upgrade. If running v1.7.0, plan an export/import cycle for affected tables before applying v1.7.1 to ensure authentication succeeds on subsequent reads.

HOW IT WORKSFixing TOAST Data Integrity1Export encrypted tables2Upgrade to v1.7.13Re-import data

Observing repeated schema proposals with excessive index drops, the author investigated whether coding agents over-index. A test harness loaded 30 model-generated schemas into PostgreSQL, auditing 838 indexes across twelve samples. The results showed that most generated indexes were competent, with only ten serving no discernible requirement.

  • Coding agents tend to propose excessive indexes, even when the logic is sound.
  • Auditing 838 indexes revealed most were necessary, not just AI slop.
  • Review processes must account for high competence in AI-generated SQL.
  • Expect repetitive index-related questions to shift toward optimization.

Researchers introduce DNBENCH, a dataset of 3,275 samples evaluating how well LLMs handle database normalization from 1NF to BCNF. The benchmark assesses semantic equivalence, structural accuracy, and logical validity across simple, complex, and real-world scenarios. The study highlights recurring model failures in inferring functional dependencies and performing lossless join decompositions.

  • LLMs struggle with dependency inference and inter-table constraints during normalization tasks.
  • DNBENCH provides a rigorous three-axis protocol for validating generated schema structures.
  • Evaluation covers the full spectrum from 1NF through BCNF for comprehensive benchmarking.
  • Reliability gaps suggest caution when automating complex schema refactoring with LLMs.
BY THE NUMBERSDNBENCH Dataset Scale3,275Samples for LLM ReliabilityEvaluating schema normalization from 1NF to BCNF
AWS Database Blog awsdatabase ↺ since 09-10

Async Python with Tortoise ORM and Aurora DSQL

AWS details how to build high-concurrency async Python applications using Tortoise ORM alongside Amazon Aurora DSQL. The guide covers specific adaptations such as UUID primary keys, IAM-authenticated asyncpg connections, and individual DDL execution. It also outlines implementing optimistic concurrency control with retry logic to handle contention.

  • Use UUIDs for primary keys to support distributed async workloads effectively.
  • Patch asyncpg to handle IAM authentication for secure database connections.
  • Execute DDL statements individually to ensure compatibility with async patterns.
  • Implement OCC retry logic to manage concurrency conflicts in high-load scenarios.
↑