At CEATEC 2024, we visited the JVCKENWOOD sales space, which featured three areas themed round “Connecting folks, time, and area to create the long run.” This aligns with the corporate’s philosophy of “bringing pleasure and peace of thoughts to folks around the globe” by way of cutting-edge know-how to counterpoint lives. JVCKENWOOD showcased modern video, audio, and wi-fi options designed to create new worth for the long run. The primary space, labeled by the corporate “Impression – Leisure Space,” * featured tech demonstrations that engaged all 5 senses—imaginative and prescient, listening to, contact, odor, and style—offering a deeply immersive, multi-sensory expertise.
AI Creates Music and Video Primarily based On Your Unconscious Emotional Response
On the JVCKENWOOD sales space’s “Impression Leisure Space,”* we skilled an modern demo combining brainwave detection, human senses, and AI to create customized music and video. Members are uncovered to stimuli, resembling pre-prepared movies, designed to evoke emotional responses. A brainwave headset then detects the feelings generated, and AI makes use of this knowledge to compose music and venture corresponding photos in real-time. The end result, described as “the music and video you created,” is performed again. The AI additional classifies the participant’s unconscious reactions, robotically producing music and visuals that replicate their emotional state, providing a novel interactive expertise.
How Does The Know-how Behind the Emotion-driven AI-Generated Music And Video Creation Work?
Suguru Goto, Affiliate Professor within the Division of Musical Creativity and the Atmosphere at Tokyo College of the Arts, introduced a demo developed by a staff of researchers with the assist of JVCKENWOOD. Suguru Goto, who can also be a composer and a media artist, showcased the modern use of brain-computer interface know-how for artwork creation on the JVCKENWOOD sales space.
How Did The Demo Work?
The staff used an Emotiv Perception EEG headset designed to assist researchers and engineers develop modern options for brain-computer interfaces in varied fields. Having personally tested several Emotiv products of their early days, I can vouch for the robustness of their brainwave-enabled {hardware} instruments, which have turn into trusted options in neuroscience-based interface growth.
After we arrived on the demo, the headset was already calibrated to the participant’s brainwaves. In line with Suguru Goto, the system requires only a few minutes to calibrate for every new person. The method started with a quick meditation session, adopted by the participant viewing a number of pre-prepared movies designed to set off particular emotional responses. The Emotiv Perception headset recorded the brainwaves throughout these actions whereas AI-driven software program interpreted the info.
Suguru Goto defined that brainwaves are analyzed utilizing machine studying algorithms, which categorize the info into 28 emotional states. These states are organized on a Cartesian airplane, with the X-axis (horizontal) starting from discomfort (unpleasure) to pleasure, and the Y-axis (vertical) starting from alertness (arousing) to sleepiness.He additionally confirmed me a pill displaying a graphic illustration of how the software program additional divides these 28 emotional states into 64 subdivisions, offering a extra detailed view of the participant’s emotional responses.
After the participant accomplished the video periods, the system robotically generated music and video primarily based on his emotional responses. This demonstration highlighted how brainwave knowledge, mixed with synthetic intelligence, can create subconscious-based customized audio-visual content material, providing a glimpse into the potential of brain-computer interface applied sciences in artistic fields.
For the demo at CEATEC, the sound was performed by way of JVCKENWOOD wood audio system, and the AI-generated video was displayed on a big display.
The inventive idea of the venture, shared with me in a personal video, includes exhibiting emotion-triggering movies on a monitor going through the participant, whereas the AI-generated visuals are projected onto the ground in a darkish room the place the individual is seated.
Past AI-based Artwork: Unlock Limitless Potentialities For Human Wellness
Despite the fact that that is a formidable inventive analysis venture, Affiliate Professor Suguru Goto indicated that it provides important potential for health-related functions, notably psychological well being care.
I do know that Emotiv’s major objective is to supply high-quality EEG-based {hardware} and software program instruments to allow researchers to develop options that improve cognitive and mental health. This contains creating modern approaches to music neurofeedback therapy.
Along with video stimuli, different sensory inputs—resembling sound, style, and odor—might additionally set off emotional responses in members. For instance, the participant might maintain a JVCKENWOOD “Hug Speaker” (see photograph), which vibrates in sync with the sound, or enjoy the scent of the wooden from audio system crafted from varied kinds of pure wooden. These stimuli might complement the AI-generated video and music created from brainwave knowledge.
Though we didn’t expertise the demo for different sensory stimuli on the sales space, I’m assured they might work seamlessly with the identical demo setup and AI-driven software program, creating photos and music primarily based on the participant’s unconscious emotional response to this sensory stimulation.
* Editor’s observe: “Impression – Leisure Space” is an English translation by Google primarily based on JVCKENWOOD Japanese Press Release
Filed in AI (Artificial Intelligence), Brainwave, CEATEC, Ceatec 2024, Eeg, Emotiv and Japan.
. Learn extra aboutTrending Merchandise