multimodal data

The rapid advancement of immersive technologies has created new opportunities to transform human-machine collaboration in industry. This paper presents an immersive platform with a digital twin that combines both physical and cognitive characteristics of human dynamics. By integrating multimodal sensing, human biomechanics, and cognitive state into digital twin technology, the proposed system enhances operational safety and ensures better ergonomics. The main argument is that human digital twins are not only desirable but essential for next-generation industrial systems. We discuss the limitations of existing human modeling approaches, outline the conceptual foundations of human digital twins, and demonstrate their industrial relevance across safety, productivity, ergonomics and sustainability.