Control of a VR game using a MI-BCI for training and rehabilitation of upper limb

Motor Imagery BCI system integrated with Virtual Reality gaming

VR Game Controlled by MI-BCI for Upper Limb Rehabilitation

The aim of this system is to integrate a rehabilitation environment for upper limb motor recovery in the form of a VR game with a MI-BCI. In the system, the user performs left and right arm MI, which is detected using ML algorithms to perform a movement and ability within the VR game. The left-hand MI triggers a fire ability while the right-hand MI triggers an ice ability. With these abilities the user attacks the enemies, fire beats the ice (blue) enemy and ice beats the fire (orange) enemy.

System Functionality
  • Motor Imagery Detection: Left/right arm MI detected by ML algorithms
  • VR Abilities:
    • Left MI triggers fire ability
    • Right MI triggers ice ability
  • Game Mechanics:
    • Fire defeats ice enemies
    • Ice defeats fire enemies
Project Lead

Oscar Mancha

Related Publication
Control of a Virtual Reality Environment for Upper Limb Movement using a Motor Imagery-based Brain Computer Interface

LatinX in AI Workshop @ CVPR 2023

View Publication

Project Highlights

  • Technology: VR + Motor Imagery BCI
  • Application: Upper limb rehabilitation
  • Key Feature: Gamified therapy environment

Technical Details

System Components
  • EEG Acquisition System
  • Machine Learning Classifier
  • Virtual Reality Environment
  • Game Logic Engine