Real-Time Control of a Video Game Using Eye Movements and Two Temporal EEG Sensors

Abdelkader Nasreddine Belkacem, Supat Saetia, Kalanyu Zintus-Art, Duk Shin, Hiroyuki Kambara, Natsue Yoshimura, Nasreddine Berrached, Yasuharu Koike

Research output: Contribution to journalArticlepeer-review

35 Citations (Scopus)

Abstract

EEG-controlled gaming applications range widely from strictly medical to completely nonmedical applications. Games can provide not only entertainment but also strong motivation for practicing, thereby achieving better control with rehabilitation system. In this paper we present real-time control of video game with eye movements for asynchronous and noninvasive communication system using two temporal EEG sensors. We used wavelets to detect the instance of eye movement and time-series characteristics to distinguish between six classes of eye movement. A control interface was developed to test the proposed algorithm in real-time experiments with opened and closed eyes. Using visual feedback, a mean classification accuracy of 77.3% was obtained for control with six commands. And a mean classification accuracy of 80.2% was obtained using auditory feedback for control with five commands. The algorithm was then applied for controlling direction and speed of character movement in two-dimensional video game. Results showed that the proposed algorithm had an efficient response speed and timing with a bit rate of 30 bits/min, demonstrating its efficacy and robustness in real-time control.

Original languageEnglish
Article number653639
JournalComputational Intelligence and Neuroscience
Volume2015
DOIs
Publication statusPublished - 2015
Externally publishedYes

ASJC Scopus subject areas

  • Computer Science(all)
  • Neuroscience(all)
  • Mathematics(all)

Fingerprint

Dive into the research topics of 'Real-Time Control of a Video Game Using Eye Movements and Two Temporal EEG Sensors'. Together they form a unique fingerprint.

Cite this