databases

RSS

1
Training a 4B model to produce 81% faster query plans than Postgres rohanbansal.com
A 4‑billion‑parameter open‑weight LLM, fine‑tuned with supervised learning and a custom RL loop, learns to emit PostgreSQL join plans that cut query latency by 44.7 % on a 113‑query benchmark. The author built a low‑noise measurement harness, a GRPO‑style reward function, and ran off‑policy distillation from ~500 GPT‑6‑style trajectories, demonstrating that a modest model can outperform Postgres’…
Hacker News front pagerohanbansal.com5d51 minHN692143
2
Python Workers are now generally available cloudflare.com
Python Workers are now GA on Cloudflare Workers. The runtime uses Pyodide‑compiled WebAssembly to run Python, adds first‑class support for Cloudflare bindings (queues, KV, etc.) without manual JS conversion, provides built‑in ASGI/WSGI adapters for FastAPI, Django, Flask, and implements a socket syscall bridge so standard Python DB drivers work via Hyperdrive. The team also pushed PEP 783 to stan…
Hacker News front pagecloudflare.com15h9 minreleaseHN17528
3
Introducing TIN: full-text search for Postgres planetscale.com
PlanetScale’s TIN is a new PostgreSQL extension that implements a full‑text search index supporting Boolean, phrase, span, fuzzy, wildcard, regex, case/accent folding, COUNT(*) and BM25 top‑k queries. In a suite of benchmarks on an i7i.8xlarge EC2 instance (8 vCPU, 32 GB RAM), TIN built in 8 min 10 s (50.7 GB index) and outperformed ParadeDB, pg_textsearch and the built‑in GIN index by large marg…
PlanetScaleplanetscale.comEric Ridge6d15 minHN20175
4
Constraint Decay: The Fragility of LLM Agents in Backend Code Generation arxiv.org
A systematic evaluation of LLM agents generating multi‑file backend code shows a sharp drop in correctness when structural constraints (framework conventions, ORM usage, API contracts) are added. Across 100 tasks in 8 Python web frameworks, assertion pass rates fall ~27 points, with data‑layer bugs (bad queries, ORM violations) driving most failures. Mid‑size models cope with minimal frameworks (…
arXiv cs.SE (Software Engineering)arxiv.orgFrancesco Dente, Dario Satriani, Paolo Papotti1d1 minpaperHN287197
5
BI-Agent and BI-Bench: Towards Automating End-to-End Business Intelligence arxiv.org
The paper introduces BI‑Bench, a new benchmark of real‑world BI questions derived from public dashboards, and BI‑Agent, a tool‑augmented LLM system that breaks BI workflows into search, join, and transform subtasks. Baseline LLMs hit <50 % accuracy on BI‑Bench. By orchestrating specialized data‑management tools and post‑training the model with supervised fine‑tuning and reinforcement learning on…
Hugging Face Daily Papersarxiv.orgChuxuan Hu, Yeye He, Penny Zhou, Wee Hyong Tok, Daniel Kang, Surajit Chaudhuri1d2 minpaper
6
Simple and Efficient Row-Level Security acadia.engineering
Unable to summarize – the article content was not provided.
Lobstersacadia.engineering6d1 minHN51 lobste.rs10
7
How a solo founder runs a five-continent tender platform on AlloyDB and MCP google.com
A solo founder runs a global tender platform using Google Cloud's AlloyDB for PostgreSQL and Model Context Protocol (MCP). This setup consolidated relational data, vector embeddings, and audit logs, reducing semantic search latency by 47x with ScaNN indexing and automating database operations.
Google Cloud Bloggoogle.comDavor Jerković5d4 minHN2
8
Relation algebra is not relational algebra remy.wang
The post clarifies the long‑standing confusion between *relation algebra* (a mathematical logic framework equivalent to FOL³) and *relational algebra* (Codd’s query language foundation). It outlines their histories, theoretical differences, and recent CS applications such as Alloy and the Prela query language, urging the community to adopt the term “Tarski’s Algebra of Relations” (TAR) to avoid m…
Lobstersremy.wang11h2 minlobste.rs8
9
Introducing Lead: TIN-compatible full-text search for CI planetscale.com
Lead is a Postgres full‑text search extension compatible with TIN, intended for CI and testing environments. It offers the same SQL and TINQL features but runs as a full table scan, making it orders of magnitude slower, so it’s only practical for small datasets.
PlanetScaleplanetscale.comPatrick Reynolds5d2 min
10
Uber Redesigns M3DB Sharding with Subclusters to Limit Failure Impact infoq.com
Uber reworked M3DB's shard placement by grouping nodes into fixed-size subclusters, each owning a disjoint shard range, to bound the blast radius of node failures. A greedy shard‑move algorithm (O(S log S) + O(S×N)) handles scaling while preserving existing placement tooling.
InfoQinfoq.comLeela Kumili14h2 min
11
Diagnosing PostgreSQL Index Bloat, Write Amplification, and Buffer Cache Hit Ratios sitepoint.com
This article details how to diagnose PostgreSQL index bloat, write amplification, and buffer cache inefficiency using SQL tools like pgstattuple and pg_buffercache. It provides a reusable SQL toolbox and a Docker environment to identify and understand performance bottlenecks caused by MVCC-related index fragmentation.
SitePointsitepoint.com2d18 min
12
Vibe coding security: How to be sure your vibe-coded apps are safe to use zapier.com
This article addresses common security vulnerabilities in AI-generated "vibe-coded" applications, such as exposed API keys and data breaches. It provides practical steps and agent skills to build securely from the start, perform security reviews, and protect sensitive data and keys.
Zapier Engineeringzapier.comMiguel Rebelo6d17 min
13
Replica-aware routing public beta clickhouse.com
Replica‑aware routing (public beta) lets ClickHouse Cloud users pin a query stream to a specific replica by sending a custom header (HTTP) or overriding the TLS SNI (native). The proxy (Envoy) hashes the tag and consistently forwards all requests with the same tag to that replica, giving read‑after‑write consistency for temporary tables, session objects, and warm replica caches. Stickiness is bes…
ClickHouseclickhouse.comAmy Chen, Jan Mensch7d6 min
14
M4N VM family, now GA: Highest per-core IOPS and throughput for I/O and memory-bound workloads google.com
Google Cloud’s GA‑available M4N VM family pairs 5th‑gen Intel Xeon CPUs with Google’s custom Titanium offload to deliver up to 1 M IOPS, 25 GiB/s block‑storage throughput, 400 Gbps VM‑to‑VM bandwidth, and a 26 GB/vCPU memory ratio (up to 5.9 TiB RAM). The design targets memory‑bound, I/O‑intensive workloads (Oracle, SAP HANA, vector search, real‑time analytics) and claims >20 % TCO reduction for…
Google Cloud Bloggoogle.comEduardo Mattos Duarte6d5 min
15
Announcing Native BM25 Ranking in AlloyDB and Cloud SQL google.com
Google Cloud adds native BM25 ranking to AlloyDB and Cloud SQL (PostgreSQL 17+) via the open‑source pg_textsearch extension, letting you run keyword‑based full‑text search inside the database. This removes the need for a separate search backend and, on AlloyDB, speeds up vector queries up to 10×.
Google Cloud Bloggoogle.comDarshana Sivakumar3d2 min
16
One Java Model from the App to PostgreSQL codenameone.com
Codename One introduces a backend runtime allowing a single Java model to define entities and validation rules for both client applications and the server. This approach aims to reduce duplication and ensure consistent data rules from the app to PostgreSQL.
CodeName Onecodenameone.comShai Almog3d7 min
17
Knowing When Your Composite Index Earns Its Write Cost tigerdata.com
This guide explains how to evaluate the trade-off of adding a composite index in PostgreSQL by quantifying its read benefits and write costs. It provides a method to measure the impact on ingest throughput and decide if the index earns its overhead based on your system's peak ingest ceiling.
Timescaletigerdata.comNanoHertz Communications4d8 min
18
Concurrency Control: Your Aggregate Is Single-Threaded. Your Cluster Isn’t.atomicobject.com
This article distinguishes between serialization (preventing concurrent access) and arbitration (permitting access and rejecting losers) in distributed concurrency control. It argues that arbitration should be responsible for correctness, as serialization guarantees are conditional and can fail silently in multi-process environments, leading to data corruption.
Atomic Objectatomicobject.comVlad Surganov16h14 min
19
MariaDB 13 Expands Oracle Compatibility and Improves Developer Experience and Observability infoq.com
MariaDB 13 GA adds Oracle‑compatible REF CURSOR and RECORD types, a RETURNING clause for UPDATE, and richer optimizer hint handling. It also exposes replication role and index options via system tables for better observability.
InfoQinfoq.comSergio De Simone3d2 minrelease
20
September 2026 newsletter clickhouse.com
ClickHouse's September 2026 newsletter highlights the 26.8 release with features like pipelined SQL and custom HTTP handlers, alongside previews for On-Demand Compute and a PromQL-compatible TimeSeries engine. It also covers new Postgres integration tools and a cost-performance benchmark for cloud data warehouses.
ClickHouseclickhouse.comMark Needham5d7 min
21
Database for AI Agents: 5 Evaluation Criteria databricks.com
Databricks outlines five criteria for a production‑ready database for AI agents—branch‑per‑agent isolation, serverless scale‑to‑zero, hybrid search, ACID guarantees, and a unified platform that eliminates ETL lag—illustrating each with features of its Lakebase offering and brief customer anecdotes.
Databricksdatabricks.com4d10 min
22
"Regex for Rows": Simplifying Pattern Detection in SQL with MATCH_RECOGNIZE databricks.com
Databricks announces MATCH_RECOGNIZE, a preview‑only SQL clause that lets you write regex‑style patterns over ordered rows. The post walks through four industry‑level use cases (security login‑failure sequences, V‑shaped stock trends, e‑commerce cart abandonment, IoT sensor‑driven failure prediction) and claims the operator replaces complex CTEs, window functions, and self‑joins. No actual syntax…
Databricksdatabricks.comKent Marten, Sergei Fedorov5d5 min
23
ClickHouse welcomes RunReveal clickhouse.com
ClickHouse announced it has acquired RunReveal, a security data platform built on ClickHouse, to deepen its expertise in security workloads. The deal promises better guidance for security teams while keeping RunReveal's product unchanged for existing customers.
ClickHouseclickhouse.com21d2 minHN7
24
datasette 0.65.5 simonwillison.net
Datasette 0.65.5 releases with a security fix: a trailing newline in a table name could bypass permissions and expose private rows (GHSA‑h547‑rmjf‑5m2m).
Simon Willisonsimonwillison.net5d1 minrelease
25
SQLite Across Every Port: One Contract, One Encrypted File Format codenameone.com
Codename One now ships a single, tested SQLite contract that works natively on Android, iOS, Windows, Linux, and in browsers via WebAssembly, with built‑in SQLCipher‑4 encryption supporting three key models. A conformance suite guarantees identical behavior across platforms, and migration helpers let legacy apps opt‑in. The update also adds a proper watch‑app model, DOM‑based text for JavaScript,…
CodeName Onecodenameone.comShai Almog1mo11 min
26
Migrations at Scale: Changing the Application Engine at 30,000 Feet bytebytego.com
The article outlines the challenges of swapping a production database without downtime and surveys common high‑level tactics—dual writes, feature flags, phased rollouts, and continuous sync—to keep the service available during large‑scale migrations.
ByteByteGobytebytego.com5d1 min
27
Supabase vs. Firebase: Which backend platform is right for you? [2026]zapier.com
Supabase and Firebase are the two leading BaaS platforms; Supabase offers an open‑source PostgreSQL backend while Firebase provides a proprietary Firestore document store with extensive built‑in services. The choice hinges on data model preferences, real‑time needs, open‑source vs lock‑in, and pricing predictability.
Zapier Engineeringzapier.comMiguel Rebelo7d19 min