This project was made during the Br41n.io hackathon during the IEEE SMC Conference. The idea was to give Jos, who was at the conference to present a paper, a way to communicate with everyone back in Tilburg. Since using the phone or calling over discord was not good enough, we decided to give Jos control over one of the robots at Mindlabs.
We used a brain-controlled P300 speller to send commands over the internet, to move, speak and do gestures through the robot.
We also hooked up Caterina with an EEG cap, measuring her frontal alpha-asymmetry, which corresponds to valence. WIth this metric, Caterina was able to modulate the pitch of the robot's voice. The idea was to be able to get some emotion into the voice, instead of a monotone robot voice.
The project was presented in the IEEE hackathon and won the IEEE SMC prize. The presentation can be seen here