WorldRoam-Bench: An Open-World Benchmark for Long-Horizon Stability of Interactive World Models

Benchmark	Eval. Metrics	Eval. Models	Eval. Persp.	Categories
WildWorld	Segment	✕	✕	✕	✕	✕	~5–10s	5	0	✔	✕	✔	✕
iWorld-Bench	Trajectory	✕	✕	✕	✔	✕	~5–10s	10+	0	✔	✕	✔	✔
WorldOlympiad	Multi-chunk	✕	✕	✔	✕	✕	~10s	8	0	✔	✕	✔	✔
MIND	Trajectory	✕	✕	✕	✔	✕	~5–10s	2	0	✔	✔	✔	✕
WBench	Multi-turn	✕	✕	✔	✔	✕	~5–10s	10+	2	✔	✕	✔	✔
WorldMark	Frame/segment	✕	✕	✕	✔	✔	20/40/60s	10	0	✔	✔	✕	✔
WorldRoam-Bench (Ours)	Traj. + per-frame	✔	✔	✔	✔	✔	10–60s	10	2	✔	✔	✔	✔

Results

Leaderboard

Comprehensive evaluation of 10+ interactive world models across action following, visual quality, interaction physics, and memory consistency.

View:

Horizon:

Dimension:

Worst

Best

#	Model	Total ↑	Action Following						Visual Quality					Interaction Physics				Memory
#	Model	Total ↑	Score ↑	Act Acc ↑	Part Acc ↑	TrajScore ↑	nATE_t ↓	nATE_r ↓	Score ↑	Aesth ↑	Drift_A ↓	Imaging ↑	Drift_I ↓	Score ↑	Mech ↑	Optics ↑	3D Con ↑	Score ↑	Ret ↑	Anti-Halluc ↑
🥇	Genie 3 Closed-Source	70.32	76.31	62.04	78.06	88.83	11.48	10.85	66.21	53.41	17.22	54.53	25.87	66.67	61.50	60.60	77.90	72.09	73.93	77.44
🥈	Lyra 2.0 Open-Source	69.61	90.82	90.85	93.82	87.78	9.61	14.83	69.61	59.62	22.63	60.82	19.36	51.52	4.80	69.10	80.65	66.49	62.25	79.45
🥉	Happy Oyster Closed-Source	68.53	88.22	85.90	89.96	88.80	11.02	11.37	66.49	55.93	19.15	49.04	19.87	61.40	45.50	67.50	71.21	58.00	55.11	71.29
4	HY-World 1.5 Open-Source	63.97	87.38	83.21	88.49	90.44	8.63	10.49	66.06	58.22	27.06	55.11	22.04	40.43	0.00	48.80	72.50	62.02	59.34	71.26
5	LingBot-World 2.0 Open-Source	63.90	90.74	88.95	96.30	86.98	6.85	19.18	68.55	59.93	24.89	61.57	22.43	43.52	3.80	56.60	70.17	52.80	53.12	60.01
6	Matrix-Game 3.0 Open-Source	60.34	91.34	88.77	94.45	90.79	9.24	9.17	68.70	56.50	26.25	64.77	20.24	25.56	0.00	17.20	59.49	55.76	59.24	59.78
7	SANA-WM-AR Open-Source	59.37	75.73	71.56	76.66	78.96	23.23	18.86	74.40	60.08	18.36	69.08	13.20	22.88	6.40	41.20	21.05	64.48	62.79	77.44
8	LingBot-World Open-Source	58.77	90.78	91.17	94.38	86.80	9.92	16.47	69.28	60.81	21.20	59.96	22.47	31.08	3.80	51.20	38.25	43.93	38.77	62.16
9	SANA-WM Open-Source	54.61	70.42	61.91	69.77	79.59	22.60	18.22	71.42	57.17	21.83	67.80	17.48	17.38	3.20	44.70	4.23	59.23	60.09	72.51
10	Matrix-Game 2.0 Open-Source	51.92	89.67	88.11	92.79	88.10	11.57	12.23	60.83	53.69	32.43	48.52	26.46	12.21	0.00	9.70	26.92	44.96	45.29	54.66
11	Yume 1.5 Open-Source	47.06	71.77	58.45	76.41	80.45	18.91	20.18	69.07	57.97	23.91	64.64	22.42	14.33	7.40	10.30	25.30	33.05	30.67	48.72
12	minWM Open-Source	41.88	60.79	46.15	53.18	83.04	13.63	20.28	58.21	48.93	43.50	51.59	24.20	7.12	0.00	4.40	16.97	41.41	41.55	59.34

#	Model	Total ↑	Ctrl Rate ↑	Action Following					Visual Quality					Interaction Physics			Memory
#	Model	Total ↑	Ctrl Rate ↑	Score ↑	Part Acc ↑	TrajScore ↑	nATE_t ↓	nATE_r ↓	Score ↑	Aesth ↑	Drift_A ↓	Imaging ↑	Drift_I ↓	Score ↑	Mech ↑	Optics ↑	Score ↑	Ret ↑	Subject ↑	Anti-Halluc ↑
🥇	Happy Oyster Closed-Source	70.66	96.43	84.81	81.16	88.45	13.39	9.71	69.84	61.18	14.45	49.10	16.47	68.90	52.10	85.70	69.55	59.76	81.09	69.14
🥈	Genie 3 Closed-Source	61.86	83.82	84.76	79.83	89.68	10.78	9.86	72.03	60.65	12.21	57.60	17.92	67.15	70.70	63.60	71.27	66.56	77.99	72.19
🥉	LingBot-World 2.0 Open-Source	38.31	53.78	88.61	90.29	86.92	12.57	13.60	74.46	64.62	15.38	62.96	14.35	58.00	41.00	75.00	63.88	59.46	73.88	58.17
4	HY-World 1.5 Open-Source	28.07	39.71	91.46	91.88	91.03	9.14	8.80	71.52	63.25	17.83	56.29	15.65	51.35	41.20	61.50	68.41	72.86	67.52	74.90
5	LingBot-World Open-Source	23.73	35.50	82.29	81.28	83.30	19.55	13.85	73.47	62.25	14.49	62.37	16.27	53.85	35.00	72.70	57.75	49.52	62.22	70.02

#	Model	Total ↑	Action Following						Visual Quality					Interaction Physics				Memory
#	Model	Total ↑	Score ↑	Act Acc ↑	Part Acc ↑	TrajScore ↑	nATE_t ↓	nATE_r ↓	Score ↑	Aesth ↑	Drift_A ↓	Imaging ↑	Drift_I ↓	Score ↑	Mech ↑	Optics ↑	3D Con ↑	Score ↑	Ret ↑	Anti-Halluc ↑
🥇	Genie 3 Closed-Source	67.55	77.22	61.96	78.16	91.55	9.24	7.67	64.46	53.09	20.45	53.91	28.71	66.67	61.50	60.60	77.90	61.84	66.50	66.76
🥈	Lyra 2.0 Open-Source	64.82	89.26	89.18	92.24	86.37	10.01	17.25	64.58	57.40	30.08	58.81	27.81	51.52	4.80	69.10	80.65	53.91	47.05	75.80
🥉	Happy Oyster Closed-Source	63.28	87.02	84.31	87.31	89.44	9.87	11.25	63.36	55.07	24.89	48.97	25.72	61.40	45.50	67.50	71.21	41.32	41.14	54.71
4	LingBot-World 2.0 Open-Source	58.30	90.43	88.09	94.21	88.98	5.95	16.09	64.09	58.56	33.14	60.84	29.89	43.52	3.80	56.60	70.17	35.15	37.33	44.78
5	SANA-WM-AR Open-Source	55.92	72.29	65.15	71.31	80.40	19.61	19.59	71.33	57.97	24.55	68.64	16.73	22.88	6.40	41.20	21.05	57.18	53.44	77.88
6	HY-World 1.5 Open-Source	53.28	77.38	69.45	74.74	87.94	11.28	12.84	57.22	52.74	43.60	53.11	33.38	40.43	0.00	48.80	72.50	38.10	35.68	50.55
7	LingBot-World Open-Source	53.10	89.98	90.99	93.86	85.09	10.15	19.67	65.01	59.45	28.00	58.49	29.92	31.08	3.80	51.20	38.25	26.34	26.00	43.85
8	SANA-WM Open-Source	52.25	64.14	51.37	60.38	80.67	20.00	18.66	66.47	56.32	26.82	64.12	27.76	17.38	3.20	44.70	4.23	61.03	61.16	73.99
9	Matrix-Game 3.0 Open-Source	52.17	89.85	86.50	91.30	91.75	7.79	8.71	63.36	52.87	37.27	63.39	25.57	25.56	0.00	17.20	59.49	29.91	33.21	35.45
10	Matrix-Game 2.0 Open-Source	46.90	88.83	86.78	91.52	88.19	9.55	14.07	54.27	49.94	43.32	46.97	36.50	12.21	0.00	9.70	26.92	32.30	31.05	46.21
11	Yume 1.5 Open-Source	43.22	73.81	58.98	77.48	84.98	14.32	15.71	63.70	55.72	31.43	61.86	31.34	14.33	7.40	10.30	25.30	21.02	20.32	31.42
12	minWM Open-Source	37.15	55.31	32.36	44.16	89.41	7.98	13.21	48.86	39.55	58.36	48.73	34.50	7.12	0.00	4.40	16.97	37.31	35.58	66.70

#	Model	Total ↑	Ctrl Rate ↑	Action Following					Visual Quality					Interaction Physics			Memory
#	Model	Total ↑	Ctrl Rate ↑	Score ↑	Part Acc ↑	TrajScore ↑	nATE_t ↓	nATE_r ↓	Score ↑	Aesth ↑	Drift_A ↓	Imaging ↑	Drift_I ↓	Score ↑	Mech ↑	Optics ↑	Score ↑	Ret ↑	Subject ↑	Anti-Halluc ↑
🥇	Happy Oyster Closed-Source	68.20	96.26	86.65	82.99	90.31	10.69	8.70	67.68	60.95	18.13	48.92	21.01	68.90	52.10	85.70	60.15	48.29	73.34	62.14
🥈	Genie 3 Closed-Source	59.68	83.18	87.38	82.40	92.36	8.76	6.53	70.51	60.29	14.88	56.77	20.15	67.15	70.70	63.60	61.98	51.77	71.28	65.97
🥉	LingBot-World 2.0 Open-Source	37.70	55.14	89.34	87.49	91.18	6.87	10.76	70.35	63.39	22.66	61.98	21.31	58.00	41.00	75.00	55.82	39.49	69.70	53.99
4	HY-World 1.5 Open-Source	22.73	34.58	85.08	83.86	86.30	10.52	16.87	65.24	59.82	29.96	56.38	25.28	51.35	41.20	61.50	61.21	62.26	62.75	71.59
5	LingBot-World Open-Source	20.15	35.05	80.96	79.62	82.29	19.03	16.40	68.84	61.63	21.23	59.59	24.64	53.85	35.00	72.70	26.38	21.41	22.22	59.54

#	Model	Total ↑	Action Following						Visual Quality					Interaction Physics				Memory
#	Model	Total ↑	Score ↑	Act Acc ↑	Part Acc ↑	TrajScore ↑	nATE_t ↓	nATE_r ↓	Score ↑	Aesth ↑	Drift_A ↓	Imaging ↑	Drift_I ↓	Score ↑	Mech ↑	Optics ↑	3D Con ↑	Score ↑	Ret ↑	Anti-Halluc ↑
🥇	Lyra 2.0 Open-Source	70.63	91.02	92.04	94.29	86.73	10.03	16.52	70.47	60.08	22.22	61.56	17.56	51.52	4.80	69.10	80.65	69.52	65.78	79.66
🥈	Happy Oyster Closed-Source	69.99	88.94	87.24	90.84	88.73	9.79	12.76	66.90	56.37	18.29	49.17	19.67	61.40	45.50	67.50	71.21	62.72	57.56	77.11
🥉	Genie 3 Closed-Source	69.85	74.41	58.44	76.44	88.35	11.42	11.88	66.13	53.68	17.15	54.27	26.27	66.67	61.50	60.60	77.90	72.21	74.27	76.80
4	HY-World 1.5 Open-Source	66.85	91.08	88.66	92.88	91.70	6.80	9.80	68.32	59.61	23.52	55.98	18.78	40.43	0.00	48.80	72.50	67.58	64.67	76.23
5	LingBot-World 2.0 Open-Source	63.18	91.39	91.77	96.48	85.91	6.02	22.16	69.16	59.62	24.34	61.91	20.56	43.52	3.80	56.60	70.17	48.65	48.31	56.28
6	Matrix-Game 3.0 Open-Source	61.77	91.85	90.03	95.19	90.33	9.35	9.99	69.93	57.50	24.51	65.64	18.90	25.56	0.00	17.20	59.49	59.75	62.58	66.00
7	SANA-WM-AR Open-Source	61.54	84.74	83.46	88.11	82.65	15.44	19.27	74.48	60.23	18.54	69.25	13.03	22.88	6.40	41.20	21.05	64.05	62.23	75.78
8	LingBot-World Open-Source	58.94	90.83	91.50	94.13	86.86	8.66	17.61	69.87	61.38	20.57	60.47	21.81	31.08	3.80	51.20	38.25	43.96	38.00	62.56
9	SANA-WM Open-Source	54.13	79.27	74.39	81.23	82.18	17.63	18.01	73.40	58.82	18.87	68.09	14.46	17.38	3.20	44.70	4.23	46.48	48.78	62.48
10	Matrix-Game 2.0 Open-Source	51.75	89.85	89.46	93.24	86.84	11.74	14.58	60.91	53.81	33.54	49.00	25.65	12.21	0.00	9.70	26.92	44.04	43.78	53.84
11	Yume 1.5 Open-Source	46.39	69.97	55.84	75.78	78.28	20.71	22.74	68.98	58.04	25.06	65.00	22.08	14.33	7.40	10.30	25.30	32.28	30.14	48.60
12	minWM Open-Source	42.63	62.11	48.59	54.83	82.90	11.72	22.48	58.92	49.25	43.60	52.62	22.59	7.12	0.00	4.40	16.97	42.36	39.09	62.29

#	Model	Total ↑	Ctrl Rate ↑	Action Following					Visual Quality					Interaction Physics			Memory
#	Model	Total ↑	Ctrl Rate ↑	Score ↑	Part Acc ↑	TrajScore ↑	nATE_t ↓	nATE_r ↓	Score ↑	Aesth ↑	Drift_A ↓	Imaging ↑	Drift_I ↓	Score ↑	Mech ↑	Optics ↑	Score ↑	Ret ↑	Subject ↑	Anti-Halluc ↑
🥇	Happy Oyster Closed-Source	73.78	97.21	83.46	79.63	87.29	13.50	11.92	70.01	61.33	14.68	49.36	15.97	73.90	52.10	85.70	76.21	68.09	87.16	70.77
🥈	Genie 3 Closed-Source	62.81	83.72	83.50	77.06	89.93	9.73	10.40	71.68	60.74	12.30	57.20	18.92	66.30	70.70	63.60	78.64	76.80	83.46	78.75
🥉	LingBot-World 2.0 Open-Source	43.83	58.60	87.75	88.45	87.04	9.48	16.44	74.50	64.48	14.96	62.76	14.29	68.65	41.00	75.00	68.25	70.02	80.81	53.81
4	LingBot-World Open-Source	29.56	42.33	82.43	80.44	84.42	16.81	14.35	74.08	62.10	14.70	63.62	14.72	64.80	35.00	72.70	58.06	49.67	65.81	60.59
5	HY-World 1.5 Open-Source	27.88	38.14	91.95	92.98	90.91	8.91	9.27	70.54	62.64	19.51	55.46	16.45	54.90	41.20	61.50	75.02	92.19	65.56	84.12

#	Model	Total ↑	Action Following						Visual Quality					Interaction Physics				Memory
#	Model	Total ↑	Score ↑	Act Acc ↑	Part Acc ↑	TrajScore ↑	nATE_t ↓	nATE_r ↓	Score ↑	Aesth ↑	Drift_A ↓	Imaging ↑	Drift_I ↓	Score ↑	Mech ↑	Optics ↑	3D Con ↑	Score ↑	Ret ↑	Anti-Halluc ↑
🥇	Genie 3 Closed-Source	73.03	77.31	65.73	79.59	86.60	13.79	13.01	68.04	53.47	14.07	55.39	22.63	66.67	61.50	60.60	77.90	80.10	79.49	86.56
🥈	Lyra 2.0 Open-Source	72.80	92.16	91.32	94.91	90.25	8.77	10.73	73.80	61.39	15.59	62.09	12.70	51.52	4.80	69.10	80.65	73.72	71.10	82.25
🥉	Happy Oyster Closed-Source	71.60	88.71	86.16	91.71	88.25	13.42	10.09	69.21	56.37	14.29	48.98	14.22	61.40	45.50	67.50	71.21	67.06	64.22	79.13
4	HY-World 1.5 Open-Source	71.00	93.69	91.52	97.86	91.68	7.83	8.81	72.64	62.32	14.05	56.25	13.97	40.43	0.00	48.80	72.50	77.23	74.57	84.29
5	LingBot-World 2.0 Open-Source	69.52	90.42	86.97	98.22	86.06	8.58	19.30	72.39	61.61	17.19	61.97	16.85	43.52	3.80	56.60	70.17	71.77	71.21	76.54
6	Matrix-Game 3.0 Open-Source	65.91	92.31	89.78	96.85	90.30	10.59	8.82	72.79	59.12	16.98	65.28	16.26	25.56	0.00	17.20	59.49	72.96	77.26	73.37
7	LingBot-World Open-Source	63.36	91.55	91.03	95.16	88.45	10.96	12.13	72.95	61.60	15.03	60.92	15.68	31.08	3.80	51.20	38.25	57.84	49.73	76.26
8	SANA-WM-AR Open-Source	60.36	70.16	66.08	70.56	73.83	34.64	17.70	77.40	62.03	11.98	69.36	9.83	22.88	6.40	41.20	21.05	70.99	71.14	78.79
9	SANA-WM Open-Source	57.61	67.86	59.96	67.70	75.93	30.18	17.97	74.39	56.37	19.80	71.19	10.22	17.38	3.20	44.70	4.23	70.83	70.82	81.57
10	Matrix-Game 2.0 Open-Source	56.30	90.32	88.09	93.61	89.26	13.43	8.05	67.31	57.33	20.43	49.58	17.23	12.21	0.00	9.70	26.92	55.37	57.49	61.83
11	Yume 1.5 Open-Source	51.14	71.53	60.53	75.96	78.10	21.70	22.10	74.53	60.14	15.23	67.06	13.85	14.33	7.40	10.30	25.30	44.17	40.11	63.67
12	minWM Open-Source	45.45	64.96	57.51	60.55	76.83	21.19	25.16	66.84	58.01	28.55	53.41	15.50	7.12	0.00	4.40	16.97	42.86	46.89	52.82

#	Model	Total ↑	Ctrl Rate ↑	Action Following					Visual Quality					Interaction Physics			Memory
#	Model	Total ↑	Ctrl Rate ↑	Score ↑	Part Acc ↑	TrajScore ↑	nATE_t ↓	nATE_r ↓	Score ↑	Aesth ↑	Drift_A ↓	Imaging ↑	Drift_I ↓	Score ↑	Mech ↑	Optics ↑	Score ↑	Ret ↑	Subject ↑	Anti-Halluc ↑
🥇	Happy Oyster Closed-Source	73.89	97.35	84.28	80.84	87.72	16.01	8.55	71.86	61.26	10.49	49.04	12.37	73.90	52.10	85.70	73.57	64.15	83.04	80.00
🥈	Genie 3 Closed-Source	61.77	83.07	83.38	79.95	86.81	13.77	12.61	73.87	60.92	9.48	58.81	14.76	66.30	70.70	63.60	73.87	74.24	79.53	70.09
🥉	LingBot-World 2.0 Open-Source	50.03	65.61	88.83	93.95	83.70	19.40	13.19	77.42	65.65	10.46	63.83	9.34	68.65	41.00	75.00	70.14	75.39	69.23	72.60
4	LingBot-World Open-Source	39.09	54.50	82.91	82.72	83.10	21.62	12.17	75.55	62.69	10.74	63.04	12.79	64.80	35.00	72.70	63.62	54.95	65.56	84.37
5	HY-World 1.5 Open-Source	35.19	47.09	94.80	95.65	93.94	8.53	3.59	76.12	65.83	9.14	57.00	9.23	54.90	41.20	61.50	73.08	71.76	75.93	71.89

Until 2026.08.20

Evaluation Metrics

15 metrics across 4 dimensions. All scores normalized to [0, 100].

Action Following (5)

Act Acc ↑Per-frame exact-match action accuracy via pose estimation + latent-stride discretization

Part Acc ↑Per-frame partial accuracy; shared sub-action match

TrajScore ↑Trajectory shape fidelity via adaptive GT + arc-length resampling

nATE_t ↓Normalized absolute trajectory error (translation)

nATE_r ↓Normalized absolute trajectory error (rotation)

Visual Quality (4)

Aesth ↑CLIP-based LAION aesthetic predictor, per-frame averaged

Drift_A ↓Relative aesthetic quality drop from the best to the worst fixed-duration sliding window over the full rollout

Imaging ↑MUSIQ multi-scale image quality transformer

Drift_I ↓Relative imaging quality drop from the best to the worst fixed-duration sliding window over the full rollout

Interaction Physics (3)

Mech ↑Mechanics: collision, clipping, deformation, gravity

Optics ↑Reflection plausibility, shadow consistency

3D Con ↑3D geometric consistency across generated frames

Memory (3)

Ret ↑Measures how much of the geometry observed in the observation pass is still faithfully reconstructed in the revisit pass

Anti-Halluc ↑Measures how much of the revisit-pass geometry was already present in the observation pass

Subject ↑Subject consistency: SAM 2 tracking + VLM assessment of identity, structure, appearance

Submit Your Model

Submission Received

Dataset

WorldRoam-Bench

What is WorldRoam-Bench?

⌨ Action Following

✨ Visual Quality

⚙ Interaction Physics

👁 Memory

Key Findings

Benchmark Comparison

Evaluation Framework

Test Suite Gallery

Evaluated Models

Leaderboard

Evaluation Metrics

Scoring Gallery

Contributing Organizations

Benchmark	Eval. Metrics							Eval. Models		Eval. Persp.		Categories
Benchmark	Action Eval. Granularity	Discrete-action Accuracy	Visual Drift	Interaction Physics	Revisit Memory	Traj.-Aware Memory	Time Scale/Video	Open- Source	Closed- Source	First- Person	Third- Person	Game World	Real World
WildWorld	Segment	✕	✕	✕	✕	✕	~5–10s	5	0	✔	✕	✔	✕
iWorld-Bench	Trajectory	✕	✕	✕	✔	✕	~5–10s	10+	0	✔	✕	✔	✔
WorldOlympiad	Multi-chunk	✕	✕	✔	✕	✕	~10s	8	0	✔	✕	✔	✔
MIND	Trajectory	✕	✕	✕	✔	✕	~5–10s	2	0	✔	✔	✔	✕
WBench	Multi-turn	✕	✕	✔	✔	✕	~5–10s	10+	2	✔	✕	✔	✔
WorldMark	Frame/segment	✕	✕	✕	✔	✔	20/40/60s	10	0	✔	✔	✕	✔
WorldRoam-Bench (Ours)	Traj. + per-frame	✔	✔	✔	✔	✔	10–60s	10	2	✔	✔	✔	✔