proomt

Search

Search posts, papers, and topics

All posts

Hacker News front page8 min readintermediate

Backups Aren't Simple

Read on filipovski.netHN 353·222 comments

Summary

Backups involve more than copying files; you need snapshot rotation, deduplication, and off‑site storage to meet RPO goals while controlling storage and bandwidth. Using proven tools like Borg or Restic and regularly testing restores simplifies the mental load.

  • Apply the 3‑2‑1 rule: three copies, two media types, one off‑site location.
  • Rotate snapshots (daily, weekly, monthly) to balance recovery point objectives and storage cost.
  • Deduplicate with hard links or tools like rsnapshot to save space and bandwidth.
  • Prefer dedicated backup solutions (Borg, Restic) for encryption, chunk‑level deduplication, and reliability.

Sysadmins and devops engineers need reliable, low‑maintenance backup strategies to avoid data loss and costly downtime.

6/10
devopscloudstoragearchitecturebackupdeduplication

Related reading

  1. CloudBees CI Disaster Recovery(DR) proof of concept using Velero

    The post describes a proof‑of‑concept DR setup for CloudBees CI on EKS using Velero with custom patches for cross‑region EBS snapshot replication, achieving 15‑minute RPO and sub‑hour RTO. It also outlines the required backup of $JENKINS_HOME, metadata, DNS switch, and the experimental nature of the patches.

    Codeshipcloudbees.com12 min

  3. How Uber Protects Against Retry Storms

    Uber developed a context-aware mechanism to prevent retry storms in deep microservice dependency chains. It introduces "error ownership" where services claim errors they originate and unclaim errors they propagate, allowing upstream callers to make informed retry decisions and avoid amplifying load on already struggling services.

    Hacker News front pageuber.com12 minHN11949

  5. Agora: Git as Shared Memory for Collective AutoResearch

    Agora treats a Git repository as a shared, append‑only memory for autonomous research agents, recording each claim as an immutable commit in a DAG. In a 12‑day run with 13 language‑model workers it generated 1,703 reproducible contributions and closed 62 % of the gap to a trained GPT‑2‑124M, demonstrating that shared research state can accelerate discovery.

    Hugging Face Daily Papersarxiv.org2 minpaper

  6. Building a Reliable Script-to-Video Pipeline for Modern Web Applications

    A practical guide to building a reliable, observable script‑to‑video pipeline. It advocates a staged architecture (scene manifest → asset generation → voice → rendering → encoding), validates AI‑generated JSON with Zod, persists project and scene state, uses explicit workflow states, runs heavy work in background queues, limits concurrency, and stores voice, captions, and assets separately to ena…

    SitePointsitepoint.com11 min