Current research on Brain-Computer Interface (BCI) controllers has expanded the opportunities of robotic applications within the biomechanical field. With the implementation of a real-time BCI controller researchers have developed smart prosthetics, semi-autonomous wheelchairs and collaborative robots for human interactions, allowing patients with neuromuscular disabilities the freedom to interact with the world. These advances have been made possible by the ease of non-invasive procedures of recording and processing electroencephalography (EEG) signals from the human scalp. However, EEG based BCI controllers are limited in their ability to accurately process real-time signals and convert them into input for a system. This research seeks to develop a BCI controller for a semi-autonomous three-wheeled omnidirectional robot capable of processing accurate real-time commands. To date omnidirectional mobile robots are popularly employed as they can rotate and self translate simultaneously in narrow space. In this research paper, kinematical modeling of the omni-directional robot and the software architecture of the overall hybrid system with motion control algorithm are expounded. The system design, acquisition of the EEG signal, recognition processing technology and implementation are the main focus.

For the real-time input signal, EEG scans are recorded utilizing a sixteen electrode channel cap provided by Easycap utilizing Emotiv Epoc hardware. Signals are recorded and processed by a program called OpenVibe. Preprocessed signals, which are cleaned by EEGLAB and used to train OpenVibe classifiers to accurately identify the expected signals produced by the users. Once identified, the controller converts the signal into input commands of {forward, left, right, rotate, stop}, which are written in the Python syntax and delivered to the robot system. The robot, which utilises three omnidirectional wheels, has three degrees of freedom (DoF) allowing it to traverse its environment in any direction and orientation. The system is equipped with both the Intel RealSense Depth Camera D435 and Tracking Camera T265 as well as LidarLite sensors to build a full map of the robot’s surroundings. The robot is controlled with the Robot Operating System (ROS) which takes the inputs provided, computes a trajectory and navigates the robot along the trajectory. The sensor system provides feedback allowing for semi-autonomous control in order to avoid obstacles and keeps the user focused on driving. Overall, this paper demonstrates the architecture of the hybrid control system for omni-directional robot using BCI. The developed system integrates the EEG signal to control the motion of the robot and the experimental results show the system performance and effectiveness of possessing the user’s EEG signals.


Design of Omnidirectional Robot Using Hybrid Brain Computer Interface

Division / Sponsors: 
Aerospace, Bioengineering, Applied Mechanics, Design Engineering Division, Advanced Energy Systems, Manufacturing Engineering Division, Noise Control and Acoustics, Nondestructive Evaluation, Diagnosis, and Prognosis (NDPD), Nuclear Engineering Division, Process Industries Division, Fluids Engineering, Heat Transfer, Materials, Microelectromechanical Systems, Safety Engineering and Risk Analysis, Computers & Information in Engineering


Paper Proceedings: https://asmedigitalcollection.asme.org/IMECE/IMECE2020/volume/84478

IMECE2020 - Virtual Conference

Supporting the need among researchers worldwide for additional online and multimedia content, ASME now offers the ASME Conference Video Collection. This platform will collect and provide long-term access to conference presentation videos, encompassing all technology areas within ASME's technical conference and events program. About 30,000-40,000 engineers across all mechanical engineering and related disciplines participate in ASME conferences each year. This includes authors of approximately 6,000 to 8,000 technical papers published by ASME, the majority of whom also submit video presentations for our virtual conferences. The video collection will be available as an add-on to existing product packages or as a separate subscription.