(Linkpost) Introduction to brain-computer interface series

Yoyo Yuan

10-07-2022

a/n: Completed during high school while under $1000 budget. There were rarely any guided tutorials back then. So, I needed to dig through documentation, numerous forums, debug software and hardware. This led to me assisting the Multisensory Brain and Cognition lab at UWaterloo.

Technical Article: How Neuralink Works and Where It’s Going

Summary: Neuralink’s chip can read and write to the brain.

In the near term, it plans to tackle brain and spine disorders. The Link, with the size of a coin, aims to replace the dangers of a surgery. It has decoded imagined movement in a monkey, and is capable of detecting touch on a pig.

Neuralink is mediocre neuroscience but solid engineering. Demos are based on existing research. It has made lab products easy to to use, but the 3 approaches of “better engineering” will eventually hit a neuroscience wall, due to a lack of control at microscale, lack of understanding at macro scale and variation in patient’s nervous systems.

In the long term, Neuralink can provide personalized workplaces, education and help improve learning speed. It lowers the technical knowledge required for creative output as well as helps people sleep.

There is rarely any information about BCIs online. The best solutions to this are expositions on existing research and funds that require new research to be open access.

Project: Playing the chrome dino game by blinking

Summary: I detected my blinking using the OpenBCI biosensing kit and wrote a python program to convert it into pressing the space bar.

How this works: Implemented electrooculography (EOG)! So, the eyeball is positively charged near the front (cornea) and negatively charged near the back. Blinks are vertical movements that cause significant spikes and valleys in the amplitudes of recorded brainwaves. A threshold is set in python script.

Project: Use fEMG to detect valence while viewing ads!

My revolutionary video! XD

Summary: How do your users feel about the ad? Getting non-sugarcoated feedback seems impossible–but wait: Smiling and frowning each correspond to activating of a muscle group. We can detect changes in voltage of these groups and connect the results to lighting up LEDs.

Unless the user is under muscle relaxants, this method always picks up the accurate responses, one-up surveys and computer vision analyses. This method can be combined to also output gaze direction and emotional response intensity, which has strong applications in marketing.

Project: Composing music with EEG data and MuseNet

Untitled

Summary:

First, a 20 sec musical sample is generated. The amplitudes of brainwaves are mapped into a good-sounding musical scale (C Locrian).

Then we iterate: The sample is repeatedly passed into MuseNet for 7+ times, which is an AI model for extending music.

Bonus Article: The application of BCIs in ADHD

Summary:

The current diagnosis for ADHD is subjective and slow. Some BCIs are approved to improve the accuracy of a specific subtype of ADHD.

The current medical treatment involves guess and checking the right drug, while CBT is an indirect solution and depend on willpower.

Some BCIs can directly alter biology by stimulating the brain. Some can provide fast feedback on focus while offering engaging games