Islam, Muhammad, Huang, Tao, Ahn, Euijoon, and Naseem, Usman (2026) Multimodal generative AI for human motion understanding and generation: A survey and way forward. Information Fusion, 135. 104435.

Preview

PDF (Published Version) - Published Version Available under License Creative Commons Attribution. Download (9MB) | Preview

Abstract

This paper presents an in-depth survey of the use of multimodal Generative Artificial Intelligence (GenAI) with autoregressive Large Language Models (LLMs) for human motion understanding and generation, offering insights into emerging methods and architectures and their potential to advance realistic and versatile motion synthesis. Focusing exclusively on text and motion modalities, this research investigates how textual descriptions can guide the generation of complex, human-like motion sequences. The paper explores various generative approaches, in-cluding multimodal autoregressive LLMs, multimodal diffusion, and multimodal transformers and their variants, and analyzes their strengths and limitations with respect to motion quality, computational efficiency, and adapt-ability. It highlights recent advances in text-conditioned motion generation, where textual inputs are used to control and refine motion outputs with greater precision. The use of LLMs further enhances these models by enabling semantic alignment between instructions and motion, improving coherence and contextual relevance. This systematic survey underscores the transformative potential of text-to-motion GenAI and LLM architectures in applications such as healthcare, humanoids, gaming, animation, and assistive technologies, while addressing ongoing challenges and research directions to guide future developments in human-centric GenAI.

Item ID:	93557
Item Type:	Article (Research - C1)
ISSN:	1872-6305
Copyright Information:	© 2026 The Author(s). Published by Elsevier B.V. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
Date Deposited:	17 Aug 2026 23:55
FoR Codes:	46 INFORMATION AND COMPUTING SCIENCES > 4602 Artificial intelligence > 460203 Evolutionary computation @ 100%
SEO Codes:	28 EXPANDING KNOWLEDGE > 2801 Expanding knowledge > 280110 Expanding knowledge in engineering @ 100%
Downloads:	Total: 1 Last 12 Months: 1
	More Statistics