proomt

Search

Search posts, papers, and topics

All posts

Google Cloud BlogAlex Barrett15 min readintermediate

What’s new in AI infrastructure and orchestration in September

Read on google.com

Summary

This Google Cloud blog post details September updates to its AI infrastructure and orchestration, focusing on scalability for 'agentic' AI workloads. Key enhancements include new GKE features like Agent Substrate for high-density sandboxes, native scale-to-zero, and Pod snapshots, alongside storage improvements like Filestore agent volumes and new M4N/Z4D VMs.

  • GKE Agent Substrate offers 10x higher density for agentic workloads with sub-500ms resume times and zero-trust isolation.
  • GKE now includes native scale-to-zero capabilities and HPA support for custom PromQL metrics.
  • GKE Pod snapshots can reduce AI inference startup by up to 89% by saving and restoring workload state.
  • Filestore agent volumes provide high-performance, elastic file storage tightly integrated with GKE Agent Substrate.

Engineers building and scaling AI/ML workloads on Google Cloud should care about these updates for improved performance, cost efficiency, and operational simplicity.

6/10
cloudstorageperformancekubernetesai infragke

Related reading

  1. Introducing Filestore agent volumes: fully managed storage for agent workspaces

    Google Cloud adds Filestore agent volumes, a fully‑managed, elastic file‑system that automatically provisions isolated POSIX workspaces for GKE‑based AI agent sandboxes. Volumes attach in milliseconds, support RWX with file‑level locking, and charge only for used capacity with automatic tiering, aiming to cut cold‑start latency and storage waste for large‑scale agent fleets.

    Google Cloud Bloggoogle.com4 min

  2. Agent Substrate brings high-density, scalable, trusted infrastructure to GKE

    Agent Substrate is an open‑source runtime for AI agents that runs on GKE. It uses Cloud Hypervisor microVMs or gVisor sandboxes to give kernel‑level isolation, a custom control‑ and data‑plane that can suspend/resume agents in <500 ms, and a “zero‑idle” model that packs >1 000 dormant agents per host (≈10× density vs. containers). GKE integration adds custom ComputeClasses, spot/on‑demand pools,…

    Google Cloud Bloggoogle.com6 min

  3. Reimagining service delivery in the agentic era with Google Public Sector

    Google Public Sector’s blog post outlines how several U.S. state and local agencies are using Google Cloud’s AI services (BigQuery, Gemini, document‑analysis models) to replace manual data‑entry pipelines, consolidate data silos, and accelerate specific projects. Reported outcomes include mapping 52 k parcels in <1 yr vs. a 33.5‑yr estimate (UT DOT), $1.3 M cost savings for real‑time translation…

    Google Cloud Bloggoogle.com4 min

  4. Google Open-Sources AX a Kubernetes Style Orchestrator for Autonomous AI Agents

    Google open‑sources AX, a Kubernetes‑style orchestrator for autonomous AI agents that treats each agent as a stateful actor, checkpointing idle sessions and resuming them in sub‑second latency. AX introduces four CRDs (Task, Workspace, Gateway, Model) and a Go CLI, runs on top of the Agent Substrate runtime, and uses gVisor sandboxes with Redis‑backed control plane. The design targets the bursty,…

    InfoQinfoq.com3 min

  5. Cloudflare Introduces the Agent Development Lifecycle to Replace Traditional SDLC

    Cloudflare’s Agent Development Lifecycle (ADLC) replaces the classic SDLC with an autonomous, event‑driven workflow system that lets AI agents handle code generation, testing, deployment, and maintenance. The platform builds on Cloudflare Workflows and the new @cloudflare/ci library to spin up containers, run headless browsers, and chain steps with caching and credential support. Observability is…

    InfoQinfoq.com2 min