The paper presents a method to develop Virtual Reality (VR) platforms based on serious games for the rehabilitation of severe memory loss. In particular, it is related to retrograde amnesia, a condition affecting patient’s quality of life usually caused by brain stroke. Nowadays, the standard rehabilitation process consists in showing pictures of patient’s familiar environments in order to recover the memory. Past research works have investigated the use of 3D scanners for the virtualization of real environment and virtual reality for the generation of more immersive interaction to design serious games for neurocognitive rehabilitation. Reached results highlighted a time-consuming development process to interface each new environment with the game logic specifically developed for the serious games. Furthermore, a complete VR platform must also consider the medical monitoring and the data management oriented to a more objective medical assessment. The proposed method allows the design of VR platforms based on patient-specific serious games for memory loss starting from the 3D scanning acquisition of familiar environments. The 3D acquisition is performed using the Occipital Structure Sensor and the Skanect application. A modular procedure has been designed to interface the virtual objects of each acquired environment with the modules of the game-logic developed with Unity. The immersive Virtual Reality is based on the use of the HTC Vive Pro head mounted display. Furthermore, the method permits to associate the patient-specific serious game to a set of software modules for the medical monitoring and the data management for the generation of reports useful for the evaluation. The solution has been evaluated by measuring the time needed to develop a whole VR platform for two different familiar environments. Less than 5 hours are required to complete the design process.

A Method to Develop Virtual Reality Platforms for the Medical Rehabilitation of Severe Memory Loss After Brain Stroke

Paper Proceedings: https://asmedigitalcollection.asme.org/IDETC-CIE/IDETC-CIE2021/volume/85369

ASME 2021 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference (IDETC/CIE2021)

Supporting the need among researchers worldwide for additional online and multimedia content, ASME now offers the ASME Conference Video Collection. This platform will collect and provide long-term access to conference presentation videos, encompassing all technology areas within ASME's technical conference and events program. About 30,000-40,000 engineers across all mechanical engineering and related disciplines participate in ASME conferences each year. This includes authors of approximately 6,000 to 8,000 technical papers published by ASME, the majority of whom also submit video presentations for our virtual conferences. The video collection will be available as an add-on to existing product packages or as a separate subscription.