EntityBench: Towards Entity-Consistent Long-Range Multi-Shot Video Generation
preprint

EntityBench: Towards Entity-Consistent Long-Range Multi-Shot Video Generation

Ruozhen He, Meng Wei, Ziyan Yang, Vicente Ordonez
arXiv:2605.15199
实验室新闻台

新闻稿摘要

本节特意采用记者式新闻稿的语气,面向普通读者撰写。

长篇视频叙事不仅要求单个镜头质量良好,还要求人物、物体和地点在很久后再次出现时保持可识别。EntityBench在140个叙事片段、2,491个镜头上衡量这一问题,并明确标注每个镜头应出现的实体。评测分别考察镜头质量、提示遵循和跨镜头一致性,错误的实体外观不会被计入一致性。论文还提出EntityMem,在持久记忆中保存每个实体的已验证视觉参考。实验显示,现有方法的一致性会随重现间隔增大而明显下降,而EntityMem在比较方法中取得最高的人物保真度。

摘要

Multi-shot video generation extends single-shot generation to coherent visual narratives, yet maintaining consistent characters, objects, and locations across shots remains a challenge over long sequences. Existing evaluations typically use independently generated prompt sets with limited entity coverage and simple consistency metrics, making standardized comparison difficult. We introduce EntityBench, a benchmark of 140 episodes (2,491 shots) derived from real narrative media, with explicit per-shot entity schedules tracking characters, objects, and locations simultaneously across easy / medium / hard tiers of up to 50 shots, 13 cross-shot characters, 8 cross-shot locations, 22 cross-shot objects, and recurrence gaps spanning up to 48 shots. It is paired with a three-pillar evaluation suite that disentangles intra-shot quality, prompt-following alignment, and cross-shot consistency, with a fidelity gate that admits only accurate entity appearances into cross-shot scoring. As a baseline, we propose EntityMem, a memory-augmented generation system that stores verified per-entity visual references in a persistent memory bank before generation begins. Experiments show that cross-shot entity consistency degrades sharply with recurrence distance in existing methods, and that explicit per-entity memory yields the highest character fidelity (Cohen's d = +2.33) and presence among methods evaluated.

引用

@article{heentitybench,
  title = {EntityBench: Towards Entity-Consistent Long-Range Multi-Shot Video Generation},
  author = {He, Ruozhen and Wei, Meng and Yang, Ziyan and Ordonez, Vicente},
  journal = {arXiv preprint arXiv:2605.15199},
  url = {https://arxiv.org/abs/2605.15199},
}

自动生成的本文相关问题、主要贡献与局限

本文有助于回答的问题

  • EntityBench衡量什么?它评估多镜头长视频中的人物、物体和地点能否保持一致。
  • 基准规模多大?包含140个片段和2,491个镜头,单个片段最多50个镜头,重现间隔最长48个镜头。
  • 如何评估一致性?镜头内质量、提示对齐和跨镜头一致性分别计分,并通过保真门控只统计正确的实体外观。
  • EntityMem是什么?它在生成前保存每个实体的已验证视觉参考,并在整段生成过程中持续使用。

主要贡献

  • EntityBench提供来自真实叙事媒体的人物、物体和地点逐镜头计划。
  • 基准设有易、中、难三级,单个片段最多包含13个重复人物、8个地点和22个物体。
  • 三支柱评测将视觉质量、提示对齐和长程实体一致性分开衡量。
  • EntityMem给出基于记忆的基线,并在实验中显著提高人物保真度。

局限与注意事项

  • 数据来自叙事媒体,交互视频或纪录片可能需要其他一致性维度。
  • EntityMem假设生成前已有经过验证的实体参考。
  • 运动风格、镜头语言和因果连续性可作为未来补充指标。
  • 长间隔下的性能下降说明问题仍未解决,也体现了该基准的诊断价值。

如何理解这一结果

EntityBench是针对长视频生成核心失效模式而精心设计的测试平台,拥有易解释的评测和实用的记忆基线。