proomt

Search

Search posts, papers, and topics

All posts

ClickHouseAditya Chidurala, Bentsi Leviav, Alex Francoeur5 min readintermediate

The official ClickHouse provider for Apache Airflow is now available

Read on clickhouse.com

Summary

The post announces the official ClickHouse provider for Apache Airflow, showing how to install it, configure a ClickHouse connection, and run queries using standard SQL operators or a ClickHouseHook. It includes examples for both self‑hosted Airflow and the Astronomer managed platform.

  • Install the provider via pip; it pulls in clickhouse-connect and common-sql automatically.
  • Create a `clickhouse` connection in Airflow UI or via AIRFLOW_CONN env var, using host, port 8443, and secure=true for TLS.
  • Run ClickHouse DDL/DML with the standard SQLExecuteQueryOperator—no custom operator needed.
  • Use ClickHouseHook.bulk_insert_rows for bulk or streaming inserts, leveraging ClickHouse's native columnar path.

Data engineers using Airflow need a supported, plug‑and‑play integration to query ClickHouse at scale without writing custom adapters.

6/10
cloudpythonclickhousedata warehousingorchestrationairflow

Related reading

  1. ClickHouse is now available on the dbt platform

    ClickHouse released a public‑beta dbt v2 adapter written in Rust that ships inside the dbt binary and talks to ClickHouse via the new ADBC driver. The adapter promises up to 30× faster dbt parsing and leverages ClickHouse’s sub‑second, high‑concurrency engine (e.g., materialized views, MCP server). A private‑beta integration on the dbt Platform now lets users develop, schedule, and catalog ClickH…

    ClickHouseclickhouse.com8 min

  3. September 2026 newsletter

    ClickHouse's September 2026 newsletter highlights the 26.8 release with features like pipelined SQL and custom HTTP handlers, alongside previews for On-Demand Compute and a PromQL-compatible TimeSeries engine. It also covers new Postgres integration tools and a cost-performance benchmark for cloud data warehouses.

    ClickHouseclickhouse.com7 min

  5. ClickHouse welcomes RunReveal

    ClickHouse announced it has acquired RunReveal, a security data platform built on ClickHouse, to deepen its expertise in security workloads. The deal promises better guidance for security teams while keeping RunReveal's product unchanged for existing customers.

    ClickHouseclickhouse.com2 minHN7

  6. Replica-aware routing public beta

    Replica‑aware routing (public beta) lets ClickHouse Cloud users pin a query stream to a specific replica by sending a custom header (HTTP) or overriding the TLS SNI (native). The proxy (Envoy) hashes the tag and consistently forwards all requests with the same tag to that replica, giving read‑after‑write consistency for temporary tables, session objects, and warm replica caches. Stickiness is bes…

    ClickHouseclickhouse.com6 min