Sensum system (via Shimmer)
When you are watching a movie or playing a game, your engagement and appreciation are most easily observable by the sound you make or body movement. In reality, there are many more ways to measure the emotional investment that go unnoticed. The company Sensum is launching a product that works to personally detail the level of emotional engagement by measuring changes in heart rate and perspiration.
The device that measures these changes is called a galvanic skin response (GSR) sensor. These are simply mounted to the wrist where heart rate and sweating can be measured in real time. The idea is to use these sensors so that one can see how they personally were engaged in a movie, game or TV show.
The device communicates with a smart phone via Bluetooth (802.15.4) using the Sensum app. The system can also be connected to external sensors; gyro, ECG, EMG, GPS, temperature, magnetometer, and a strain gauge. It stores all of the data collected while you are watching or playing, and it then displays a personal graph that details different levels of engagement. At its heart is a uC at 8MHz sitting alongside a 3 axis accelerometer (), tilt/vibration switch, and a SD card port. Direct support for labVIEW and ShimmerConnect on top of the systems TinyOS firmware gives the device plenty of leeway for developers.
Sensum believes that this idea of emotional response entertainment can be applied to many entertainment platforms and even tailor stories and endings to best suit the level of emotional engagement. The device could also be paired with games to unlock new levels based on what got your heart pumping or made you sweat (especially good for exercise games). The device can also be used to synchronize emotional response and on screen content in real time.
The device was tested at the SXSW and the Tribeca Film Festival, and now Sensum is working with sci-fi writer Ian McDonald plans are being executed to write a full-length feature film that uses the data collected by the Sensum sensors to alter the music, special effects and movie plots in real time.
Sensum representative Gawain Morrison explains the purpose of the device,“ You’re getting rewarded for taking part… you’re getting a personal reward for engaging with the film. All the further content is led by how you engaged with it.”
No details as to when this device will be available to the public.