proomt

Search

Search posts, papers, and topics

All posts

Hugging Face Daily PapersTaoyong Cui, Zhongyao Wang, Xinyue Xu1 min readpaperadvanced

JEPA-Anything: Learning Predictive Models across Different Worlds

Summary

JEPA-Anything extends joint‑embedding predictive architectures with orthogonal predictive factorization, letting a single model learn complementary latent factors that can be recombined for prediction across disparate domains. The paper shows consistent performance gains on ten dynamics tasks, molecular simulations, and clinical event forecasting, plus experimental validation of a biologically‑de…

  • OPF splits latent targets into orthogonal factors learned via dedicated pathways, enabling a shared predictive core across vision, biology, control, and physics domains.
  • On ten benchmark dynamics tasks JEPA-Anything beats domain‑specific JEPA baselines, cutting single‑intervention error on Interventional Pong by 34.8%.
  • It attains the lowest one‑step and 100‑step molecular dynamics errors across four chemical systems, outperforming prior methods.
  • A factor‑selected biological intervention predicted by the model was confirmed experimentally in cell co‑cultures, organoids, tumor fragments, and mice.

Researchers building general world models and engineers needing cross‑domain predictive systems should see a concrete, experimentally‑validated approach that unifies representation learning and intervention prediction.

8/10

Related reading

  1. Introducing System One Models and Jev

    TypeSafe AI announced its first “System One” model, Jev, a non‑text‑generating LLM that outputs type‑safe structured decisions with calibrated probabilities. It claims 40‑200× lower latency (70‑500 ms) and 100‑500× lower cost versus frontier LLMs, no hallucinations, and parallel sampling. The post includes a side‑by‑side demo, a custom “workflow” benchmark comparing Jev to GPT‑5.6/6 and other mod…

    Hacker News front pagetypesafe.ai9 minHN1824480lobste.rs26
  2. Laya the open source version of Jev

    Laya is an open‑source, bidirectional‑encoder model family for ultra‑fast, calibrated decision‑making (choice, score, boolean) over structured schemas. It runs 6‑8× faster than the closed‑source Jev, supports 100+ languages via three checkpoints, and includes a lightweight router that selects the appropriate checkpoint before inference. Benchmarks show higher accuracy, far better calibration (ECE…

    Hacker News front pageconvaiinnovations.com8 minreleaseHN1326313lobste.rs2
  3. Reverse-engineered Jev-like model

    Jevlike is an open‑source starter model that scores a list of text options in a single forward pass. It provides a minimal architecture (option queries, shared dot‑product scorer), synthetic data generation, training/evaluation CLI, and examples on Doom and chess. The repo supports a byte‑level encoder or a frozen Hugging‑Face encoder (e.g., Qwen2.5‑0.5B), runs on CPU/MPS/CUDA, and reports benchm…

    Hacker News front pagegithub.com4 minreleaseHN16224
  4. Zing-0.5: Toward Playable Worlds with Real-Time Joint Action and Text Control

    Zing‑0.5 is a 5 B autoregressive world model that lets users control generated environments in real time using both keyboard actions and text prompts. The paper introduces unified action‑text conditioning, segment‑level teacher distillation, and a low‑cost streaming inference pipeline that runs at 24 FPS (832×480) for about $0.009 per minute, achieving 81 % overall and 88.5 % consistency on a nav…

    Hugging Face Daily Papersarxiv.org1 minpaper
  5. Dynamically Scaled Activation Steering

    Dynamically Scaled Activation Steering (DSAS) is a method‑agnostic framework that learns per‑token, per‑layer scaling factors to turn existing activation‑steering interventions on only when a model is likely to produce undesired output (e.g., toxic text). The scaling can be optimized jointly with any steering function, improves the toxicity‑utility trade‑off on language models, transfers to text‑…

    Apple Machine Learning Researchapple.com1 minpaper