proomt

Search

Search posts, papers, and topics

All posts

DatabricksBenjamin Nwokeleme, Firas Farah, Jen Darrouzet12 min readintermediate

A practical guide to cost optimization with Lakebase Postgres

Summary

Lakebase’s separated storage‑compute architecture lets you cut database costs by syncing only the active data, picking the right sync mode, and right‑sizing compute so the hot working set fits in cache. Follow the blog’s concrete steps—materialized‑view subsets, snapshot vs triggered vs continuous sync, autoscale bounds, and connection‑pooling—to keep spend predictable without sacrificing perform…

  • Sync only the working subset (e.g., a rolling 60‑day window) via materialized views to avoid unnecessary storage and sync costs.
  • Match sync mode to latency needs: Snapshot for >10% changes, Triggered for known cadence, Continuous only for real‑time requirements.
  • Right‑size compute so cache exceeds the hot working set; use the Lakebase Metrics dashboard to verify cache coverage.
  • Set min CU high enough for required max_connections or use a connection pooler to avoid connection limits.

Engineers running Lakebase or similar serverless Postgres workloads need practical ways to control spend while maintaining performance.

6/10

Related reading

  1. WAL + S3: Lakebase storage for the era of agents

    Neon's Lakebase Postgres redefines database storage by making the WAL the source of truth, stored on S3, rather than data files. This transaction-centric approach enables instant branching, time travel, and scalable, decoupled compute and storage for Postgres.

    Neonneon.com14 minHN4
  2. Postgres on NVMe: performance and the convergence of transactions and analytics

    Local NVMe storage cuts Postgres I/O latency from ms to µs, yielding ~9× higher TPS and 10× lower transaction latency on a 482 GiB pgbench workload. The gain comes from reduced IO wait, not more CPU work. To retain durability, combine NVMe with quorum synchronous replication and continuous WAL archiving (WAL‑G). For analytics, offload scans to ClickHouse via WAL‑based CDC (pg_clickhouse or the ne…

    ClickHouseclickhouse.com8 min
  3. Accelerating the borderless Lakehouse: Announcing preview of cross-cloud caching

    Google Cloud previewed cross‑cloud caching for its Borderless Lakehouse. The feature caches sub‑file Parquet blocks in Google Cloud, encrypts them with GMEK, isolates cache per tenant/region, and validates freshness via metadata checks. In tests it can reduce cross‑cloud data transfer to <5% of the original size, lowering query latency and cost for Iceberg tables stored in other clouds. BigQuery…

    Google Cloud Bloggoogle.com3 minrelease
  4. Supabase Select 2026 Recap

    Supabase announced a suite of new features at Select 2026, including native‑process local development, declarative schema files with pg‑delta migrations, a Compute platform for custom services, an MCP server with auth‑aware middleware, and scaling upgrades like Multigres HA and the OrioleDB storage engine. These changes aim to make Supabase more code‑first, observable, and ready for large‑scale p…

    Supabasesupabase.com4 min
  5. Handling hot shards

    This article explains how PlanetScale's Neki, built on Vitess, helps manage hot shards in sharded databases, using Slack's journey from workspace-based to channel-based sharding as a detailed case study. It outlines strategies like vertical scaling, tenant isolation, and resharding specific tables without downtime to adapt to changing data access patterns.

    PlanetScaleplanetscale.com6 min