Tag

DuckDB

2 stories

DuckDB 2.0 adds a server mode and async I/O, and files that 1.x cannot open (duckdb.org)

The release adds a Quack server protocol, background reads for Parquet and CSV, VARIANT with automatic shredding, and triggers. A new PEG parser is now the default, ICU is gone, and 2.0 is supported until at least October 2027.

One user reports shrinking 7 TB of Azure NDJSON logs to 2.5% of their size in Parquet in under two hours on a medium VM.

Not just a headline — the discussion unpacked

The top HN threads: facts from the discussions, both sides, insider voices. Email, Telegram, or RSS.

Postgres 19 finally reorganizes tables without locking, and borrows GROUP BY ALL from DuckDB (snowflake.com)

Snowflake's Craig Kerstiens walks through the Postgres 19 beta: REPACK CONCURRENTLY reorganizes bloated tables without locks (no more pg_repack), partitions can now merge and split in place, autovacuum gets parallel workers, and SQL/PGQ brings graph queries to relational data.

The thread wanted what's still missing more than what shipped. A 15-year Postgres user in science flagged the absent columnar storage as datasets balloon; others miss materialized views and in-place major upgrades. And the top nitpick: GROUP BY ALL was DuckDB's idea first.