Human-Machine Interaction in the Metaverse: A Comprehensive Review and Proposed Framework

Abstract

The rise of the metaverse, a virtual shared space where users interact collectively, has generated significant interest in examining the dynamics of human-machine interaction within this digital environment. This study presents an extensive overview of current research on human-machine interaction (HMI) in the metaverse, encompassing a variety of technologies, methodologies, and consequences. By drawing upon a diverse array of academic references, this study delves into the fundamental aspects of HMI in the metaverse, such as gesture and motion tracking, voice recognition, virtual and augmented reality interfaces, haptic feedback, brain-computer interfaces, avatars, personalization, and collaborative engagement. Furthermore, this study addresses the obstacles and possibilities linked to HMI in the metaverse and provides a framework for swift integration of HMI in the metaverse.