Out-of-sight world evolution

The world should keep evolving—beyond the observed state.

SeerWorld enables entities to remain active participants in a changing world, supports user-specified events, and renders causally plausible reactions throughout out-of-sight world evolution.

Papersoon Codesoon Modelsoon DatasetHF BenchmarkHF
01 event enters the world
Scroll to explore

VLM-guided rollout

Watch SeerWorld observe, reason, and evolve.

This recorded case follows one complete rollout: the visual renderer generates a segment, the VLM observes the realized world, updates memory, reasons about the event, and guides the next generation.

Case studyRuined cathedral · Colossal gargoyle lands

45.8 seconds · Recorded model rollout

ObserveRememberReasonRenderVerify

The challenge

A coherent world is more than a remembered frame.

When the observer looks away, new events should still alter the world. A successful model must execute the switched event, preserve the subject and scene, and render a causally plausible change when the camera returns.

Comparison of out-of-sight evolution failures across video world models
01

Look away

The camera leaves a visible subject and establishes an observation gap.

02

Change the world

A new event is introduced mid-rollout, without revealing the future response.

03

Return and reveal

The revisited subject must remain recognizable and show a plausible consequence.

The framework

A reasoning brain.
A visual world renderer.

SeerWorld separates world-state reasoning from rendering. A VLM continuously records what the renderer actually generated, then reasons about an appropriate subject state after an event is observed.

SeerWorld framework with VLM brain, autoregressive visual renderer, Identity-Anchored Attention, and two-stage training
01

VLM brain reasoning

The brain tracks persistent entities and world states, then reasons about event consequences before rendering each revisit.

02

Event rendering

Events emerge clearly and evolve while the focal subject remains outside the current view.

03

Causal subject reactions

Revisited subjects preserve their identity while responding plausibly to the intervening event.

Data & benchmark

Built for evolution beyond the frame.

SeerWorld-Data provides segment-level supervision for event realization, long-range continuity, and behavioral change. SeerWorld-Bench tests the full event–revisit–reaction chain.

~12kcurated videos
65event types
63scene types
14reaction types
120benchmark cases

Inside SeerWorld-Data

Structured examples.
Visible evolution.

Selected training videos from SeerWorld-Data's photorealistic and game domains illustrate its range of subjects, environments, camera trajectories, and event-driven changes. Click any example to inspect the full clip.

SeerWorld-DataPhotorealistic domain↗
SeerWorld-DataPhotorealistic domain↗
SeerWorld-DataPhotorealistic domain↗
SeerWorld-DataGame domain↗
SeerWorld-DataGame domain↗
SeerWorld-DataGame domain↗

Benchmark results

Consistent worlds.
Strong evolution.

SeerWorld improves out-of-sight reactive evolution while preserving visual quality and consistency.

Core task success90.8%

Core task success requires Revisit, Event, and Causal scores to equal 1.

Revisit success100.0
Event success97.5
Causal plausibility94.2
Reaction quality85.0
Subject consistency99.2
Background consistency98.3

SeerWorld-Bench evaluation

Scores in percent · higher is better

MethodCoreRevisitEventCausalReact.VisualSubj.Bg.Motion
LingBot-World15.892.577.529.231.368.887.694.698.0
LingBot-World-v220.076.768.327.125.476.782.692.598.4
YUME-1.515.862.586.722.520.065.472.988.7—
SANA-WM13.388.367.526.724.253.867.790.898.7
Echo-WM16.760.866.722.521.782.997.689.298.7
Evoke20.095.880.032.936.378.393.595.499.0
Evoke-Turbo21.798.389.232.529.665.497.096.299.1
SeerWorld ours90.8100.097.594.285.083.899.298.399.5

SeerWorld world evolution demos

Watch the world change.

Event A colossal gargoyle lands in the cathedral.

Reaction The knight raises his shield and braces.

Event Lava flows into the stone passage.

Reaction The explorer climbs onto the steps.

Event A shower pipe bursts and floods the floor.

Reaction The man steps back with a towel in hand.

Event A spectral knight forms from the marsh fog.

Reaction The ranger stands and draws her sword.

Event A dark monster appears by the boulder.

Reaction The archer nocks an arrow and takes aim.

Event Water bursts from the canal and floods the path.

Reaction The backpacker turns around and lowers the newspaper.

Citation

Build worlds that remember, reason, and evolve.

The BibTeX entry will be added when the paper is publicly available.

@inproceedings{seerworld2027,
  title  = {SeerWorld: Towards Out-of-Sight World
            Evolution in Generative Video Models},
  year   = {2027},
  note   = {Citation details forthcoming}
}