Article Source

• Large World Model for Large Context MultiModal LLM

Large World Model for Large Context MultiModal LLM

Abstract

Large World Model (LWM) is a general-purpose large-context multimodal autoregressive model. It is trained on a large dataset of diverse long videos and books using RingAttention, and can perform language, image, and video understanding and generation.