proomt

Search

Search posts, papers, and topics

All posts

TemporalSimon Emms11 min readintermediate

Stop restarting your tests

Summary

This article proposes using Temporal to orchestrate large, flaky end-to-end test suites, treating each test execution as a durable unit of work. This approach allows retrying only failed individual tests or browser configurations, significantly reducing wasted CI time from transient failures.

  • Temporal orchestrates individual test executions (e.g., Playwright spec + browser) as independent, durable Activities.
  • Failed test executions can be retried individually without re-running successful parts of the suite, saving CI time.
  • Temporal acts as an orchestration layer *around* existing test runners, requiring no changes to the tests themselves.
  • Workflows use `Promise.allSettled` to fan out and await all test Activities, ensuring progress is made even if some fail.

Engineers managing large, slow, and flaky end-to-end test suites can adopt this pattern to improve CI reliability and reduce feedback cycle times.

7/10

Related reading

  1. The Flaky Test Confession: “We All Know We’re Ignoring Test Failures”

    Flaky tests silently erode CI reliability, waste compute and developer time, and let real bugs slip into production. The post quantifies the cost (≈2.5 % of developer time, $5.67 per manual investigation vs $0.02 for auto‑rerun) and critiques common band‑aid approaches (retries, quarantine, manual triage). It argues that visibility—detecting flaky tests, predictive test selection, and automated t…

    Codeshipcloudbees.com5 min
  2. Write End-to-End Tests in Your Backend’s Language

    This article advocates writing end-to-end tests in the backend's language to leverage domain models and persistence tools for efficient test data setup. It details a strategy for structuring E2E tests with inline data creation, small helpers, and parallel execution considerations.

    Atomic Objectatomicobject.com7 min
  3. Durable Digest: August highlights

    Temporal’s August digest rolls out a suite of new features: Serverless Workers for AWS Lambda (public preview), Projects for organizing Cloud resources, Standalone Nexus Operations, Google GenAI and Deep Agents integrations, Activity Operations and Workflow Pause controls, poller autoscaling GA, and .NET/TypeScript Nexus SDKs. It also adds a Web UI news feed, new tutorials, validated patterns, an…

    Temporaltemporal.io5 min
  4. How LlamaIndex uses Temporal to scale reliable document orchestration

    LlamaIndex migrated from RabbitMQ to Temporal for orchestrating complex, multi-stage document processing workflows, scaling to tens of millions of pages daily. This shift enabled them to replace ad-hoc state management and concurrency controls with Temporal's durable execution and workflow primitives, improving reliability and resource efficiency.

    Temporaltemporal.io7 min