Tagged EEG

EEG Data Crystals

I’ve had the Neurosky Mindwave headset in a box for over a year and just dove into it, as part of my ongoing Data Crystals research at Autodesk. The device is the technology backbone behind the project: EEG AR with John Craig Freeman (still working on funding).

The headset fits comfortably. Its space age retro look aesthetically pleases except that I’d cover up the logo in a final art project. The gray arm rests on your forehead and reads your EEG levels, translating them into a several values. The most useful are “attention” and “meditation”, which are calculations derived from a few different brainwave patterns.

eeg_headestI’ve written custom software in Java, using the Processing libraries and ModelBuilder to generate 3D models in real-time from the headset. But after copious user-testing, I found out that the effective sample rate of the headset was 1 sample/second.* Ugh.

This isn’t the first time I’ve used the Neurosky set. In 2010, I developed art piece, which is a portable personality kit called “After Thought”. That piece, however, relied on slow activity and was more like a tarot card reading where the headset readings were secondary to the performance.

The general idea for the Data Crystals is to translate data into 3D prints. I’ve worked with data from the San Francisco’s Data Portal. However, the idea of generating realtime 3D models from biometric data is hard to resist.

This is one of my first crystals — just a small sample of 200 readings. The black jagged squares represents “attention” and the white cubes correspond to “meditation”.

IMG_0963

Back to the sample rate…a real-time reading of 600 samples would take 10 minutes. Still, it’s great to be able to do real-time, so I imagine a dark room and a beanbag chair where you think about your day and then generate the prints.

Here’s what the software looks like. This is a video of my own EEG readings (recorded then replayed back at a faster rate).

And another view of the 3D print sample:

IMG_0965

What I like about this 3D print is the mixing of the two digital materials, where the black triangles intersect with the white squares. I still have quite a bit of refinement work to do on this piece.

Now, the challenge is what kind of environment for a 10-minute “3D Recording Session”. Many colleagues immediately suggest sexual arousal and drugs, which is funny, but I want to avoid. One thing I learned at the Exploratorium was how to appeal to a wide audience, i.e. a more family-friendly one. This way, you can talk to anyone about the work you’re doing instead of a select audience.

Some thoughts: just after crossing the line in an extreme mountain bike race, right after waking up in the morning, drink a pot of coffee (our workplace drug-of-choice) or soaking in the hot tub!

IMG_0966

* The website  advertises a “512Hz sampling rate – 1Hz eSense calculation rate.” Various blog posts indicate that the raw values often get repeated, meaning that the effective rate is super-slow.

 

After Thought at Art in Odd Places

Last Thursday, I exhibited After Thought, a performance-installation that I developed while at Eyebeam Art + Technology Center at Art in Odd Places in New York (check out their AIOP website, there’s some great projects there).

As the name implies, these performances that happen in unusual spots in the city, this one being at the 14th Street Y.

14_y_entrance

We scheduled this to happen during the CSA pick up where folks were picking up their weekly organic veggies.

csa

Here I am posing with my two assistants: Minha Lee and Zack Frater. We used the lab coat + eyeglasses props to reel people in.

3_of_us

I began with a short intake form with questions such as “What is your greatest physical fear?” I discovered that an inordinate number of people are afraid of snakes.

intake_form

After completing the intake form, people wear a brainwave-reading headset — I use the Neurosky Mindset — to capture stress and relaxation levels. They turn over flashcards while I monitor their reactions.

I can’t see what they are looking at. If their their stress or relaxation responses spike, I ask them for the card, then note it down on my result form. This person was especially negatively triggered by cockroaches.

scott_testing

And this gentleman was relaxed by the guys hanging out in the hot tub. Give me that flashcard!

scott_testing3

Minha, who interned for me at Eyebeam also administered tests. This subject has no reaction, good or bad to the image of the police car.
minha_testing

Here you can see how the intervention occurs. People had no idea why we were there. Many were suspicious, thinking that we our Scientology-style relaxation/stress test was trying to sell them something or lure them into a cult. Others were immediately intrigued. Some needed convincing. One respondent offered us a bundle of swiss chard for barter.

scott_testing4

Afterward, I would sit down with each respondent and we would talk about their results. “Why did you get stressed out by the cute puppy?”

scott_anaylzing

In the background here, you can see one of the two curators, Yaelle Amir, who demonstrates her ambidexterity by texting while typing.

scott_analyzing

One of my last tests of the day was with Stephanie Rothenberg, a good friend of mine. I knew her too well to provide unbiased analysis. The image of the crying baby was one of her stress indicators. Hmmm.

scott_testing_rothenberg