proomt

Search

Search posts, papers, and topics

All posts

TimescaleAndrew Stebbins6 min readintermediate

How Meshtastic Metrics Exporter Turned Eight Prometheus Queries Into One with Tiger Data

Summary

A Python exporter reads Meshtastic mesh telemetry from MQTT and writes it directly into a TimescaleDB‑enabled PostgreSQL instance, replacing a Prometheus setup that hit ~0.5 M series for 10 k nodes. The single database lets Grafana dashboards join node metadata with eight time‑series tables in one query, eliminates scrape‑budget limits, and uses native retention/compression (14‑day compression, 3…

  • Prometheus cardinality blew up at ~10 k nodes (≈55 metrics/node → ~500 k series) and exceeded the 10 s scrape budget.
  • Moving to TimescaleDB (PostgreSQL 16 + extension) let the exporter write data directly, removing the scrape step and consolidating metrics and metadata in one store.
  • SQL joins replace eight separate Prometheus queries, enabling a single node‑drill‑down view that correlates hardware, role, telemetry, position, power, etc.
  • Retention/compression is handled declaratively: daily chunks, compression after 14 days, automatic drop after 30 days.

Shows a pragmatic path for high‑cardinality IoT/mesh monitoring workloads to avoid Prometheus limits by leveraging TimescaleDB’s hypertables and native SQL, while keeping ops simple for community‑run networks.

6/10

Related reading

  1. OpenTelemetry everywhere: Migrating a metrics platform at scale

    Atlassian replaced its decade‑old gostatsd‑based metrics pipeline with a fully OpenTelemetry‑based stack by keeping the StatsD‑UDP contract on the client side and swapping in purpose‑built OTel Collector distributions for collection, ingest, aggregation, and forwarding. The migration was done incrementally, saved ~3.9% CPU per service, cut sidecar cost ~30% fleet‑wide, halved aggregation CPU, and…

    CNCFcncf.io6 minHN1
  2. How we AI-updated 1,138 Error-code Docs Pages

    Twilio built a two‑phase pipeline that first scores each error‑code doc with a deterministic script, then feeds only low‑scoring pages to an LLM (gpt‑5.4) using a strict prompt. The model’s diff is applied via git, linted, and opened as a PR for a reviewer. In 12 weeks they updated 1,138 pages (≈34.6 s/page) with a human reviewing every change, cutting manual effort from an estimated 18 k hours a…

    Twiliotwilio.com11 min
  3. What's new in ClickStack - Aug ’26

    ClickStack August 2026 update adds general‑availability dashboard variables (including cross‑source SQL, Lucene, PromQL macros), chart formulas for derived metrics, a metrics explorer UI, release‑marker overlays, OIDC auth for the collector, and a beta LLM observability dashboard. It also introduces a private‑preview TimeSeries engine with PromQL support, letting ClickStack store and query Promet…

    ClickHouseclickhouse.com16 min
  4. Introducing TIN: full-text search for Postgres

    PlanetScale’s TIN is a new PostgreSQL extension that implements a full‑text search index supporting Boolean, phrase, span, fuzzy, wildcard, regex, case/accent folding, COUNT(*) and BM25 top‑k queries. In a suite of benchmarks on an i7i.8xlarge EC2 instance (8 vCPU, 32 GB RAM), TIN built in 8 min 10 s (50.7 GB index) and outperformed ParadeDB, pg_textsearch and the built‑in GIN index by large marg…

    PlanetScaleplanetscale.com15 minHN20175
  5. Open-weight models take 56% of token volume, Astra doubles Fable 5.1 spend

    Vercel’s September AI Gateway Production Index shows open‑weight models processing 56% of token volume (up from 7% in Dec 2025) while accounting for only 14% of spend. Token price fell 23.2% month‑over‑month. Anthropic’s Opus 5 captured 22.5% of spend, overtaking Fable 5 which dropped to 4.9%. OpenAI’s new GPT‑6 Astra grabbed ~7.7% of total gateway spend in its first 12 days, more than double Ant…

    Vercelvercel.com6 minHN2