proomt

Search

Search posts, papers, and topics

All posts

VercelSusan Aziz4 min readintermediate

How Factory scaled its cloud backend to one billion monthly requests on Vercel

Summary

Factory runs its entire SaaS backend on a single Next.js app deployed to Vercel, handling about a billion API requests per day with 350 ms p95 latency. They achieve this with Vercel’s Fluid compute to avoid cold starts, built‑in observability and WAF for security, and internal automation (“Droids”) that let non‑engineers deploy tools without extra infrastructure.

  • Using a single Next.js app on Vercel to serve API routes, middleware, and webhooks can handle ~1 billion daily requests with p95 latency ≤350 ms.
  • Fluid compute keeps serverless functions warm, eliminating cold‑start latency for latency‑sensitive workloads.
  • Vercel Observability plus the built‑in WAF give real‑time traffic insight and route‑level protection without a dedicated security team.
  • Internal “Droids” automate builds and deployments via Vercel’s API, letting non‑technical teams ship dashboards and demos without pulling engineers off product work.

SaaS teams evaluating serverless backends will see how a single Next.js deployment can scale to massive traffic while keeping ops overhead low.

6/10

Related reading

  1. Next.js 16.3 support on Vercel

    Vercel added full support for Next.js 16.3, bringing leaner prefetching, immutable static assets, and faster route metadata handling. Early adopters see up to 45% fewer prefetches, 24% less static traffic, and roughly 2× faster routing at scale.

    Vercelvercel.com4 min
  2. Secure Compute and Static IP builds start 64% faster

    Vercel’s Secure Compute and Static IP builds now start 64% faster by using prewarmed containers, cutting the time from deployment creation to build start from 6.7 s to 2.4 s. The change is automatic and requires no user action.

    Vercelvercel.com1 minrelease
  3. Run Terminal-Bench and other Harbor evals on Vercel Sandbox

    Vercel now supports running Harbor benchmarks, like Terminal‑Bench, inside its Sandbox using Firecracker microVMs. The integration with AI Gateway lets you benchmark multiple models by swapping the `--model` flag, scaling concurrency with `--n-concurrent`.

    Vercelvercel.com1 minrelease