' Chaos Flow '
Artist: Qiwei Zhang
Year: Nov 2021
Research:
Explore the user experience and technical path when connecting brainwave and metaverse.
Derivative work adds brainwave control view and sound based on third-party GLSL code.
GLSL code: https://glslsandbox.com/e#74309.0
"Chaos Flow" is a second project in the series of "FLOW" with brainwave interaction, exploring the interaction possibilities for brainwave and digital media.
The project was exhibited at the "Beyond Nature Exhibition" in London in Dec 2021.
Description
This is a brainwave interactive project, through brainwaves enter and control the virtual world.
The users though brainwaves to control the screen for interaction, and control the "shuttle state" and sound frequency in the screen by the degree of concentration, and the muscles of the head control the fault special effects.
This is the visualization of the chaotic state of energy, a form of energy that is like a life form in a mother's womb. Connect the virtual world with the real world through brain waves, find and feel the existence in the virtual world, and explore self-control and confrontation.
Run with a glimmer of light, and explore fearlessly.
Concept
· Brainwaves are the overall reflection of the electrophysiological activities of brain nerve cells on the cerebral cortex or scalp surface. As a kind of physiological data of human beings, brainwaves exist in the subconscious level of information output.
· The visual effect of clouds passing stimulates the visual effects of chaotic thoughts in the brain,
· From a philosophical point of view, this is a kind of control and self-exploration between virtual and reality.
Technical Path
Interactive Logic
Research Result
All of the nearly 100 experiencers could start interacting with the digital media device in about 30 seconds and understand how they would interact with the media and try to control it by trying it out within one minute. Users can experience the immersion and control of digital multimodal interaction in about 4 minutes.
User feedback 1 :
The interactive process enables the user to develop a sense of connection with the work. The user is immersed in the work and can participate in the direction and the changes it produces. And it is through brain waves, a very new and futuristic way of interacting. It will feel like the experience feels more than just watching, but is a real experience. The user is able to have an experience in the digital world rather than an external audience. The most intense experience is the ability to immerse the user in the digital work, controlling themselves forward or backward all the time. This interactive process would feel more real than interacting with a VR device.
User feedback 2:
It would literally feel like being in a cloud and the sound feedback would feel like being in a fetus, in the mother's womb. The images would feel like they created a different world inside the spirit world and the experience felt magical.
User feedback 3:
The digital images give a strong sense of control as if I'm really thinking seriously about being able to control my own movement forward or backward in the digital world. It really feels like you can control it with your consciousness. And the sound feedback in the piece is that the faster I concentrate, the faster the corresponding shuttle, and the faster the sound will ring. This kind of corresponding feedback when I am more focused instead gives me a sense of confrontation. How can I stay more focused when I am more focused. On the one hand, I know through the feedback that I am concentrating more, on the other hand, I have to fight against my own state. The experience of this sense of confrontation with the ego feels great.
Bibliography
[1] Herculano-Houzel, S. (2009). The human brain in numbers: a linearly scaled-up primate brain. Frontiers in human neuroscience, 31.
[2] Harari, Y. N. (2014). Sapiens: A brief history of humankind. Random House.
[3] Smith, J. M., & Maynard, S. J. (1993). The theory of evolution. Cambridge University Press.
[4] Haraway, D. (2006). A cyborg manifesto: Science, technology, and socialist-feminism in the late 20th century. In The international handbook of virtual learning environments (pp. 117-158). Springer, Dordrecht.
[5] Saindon, E. (2019). Alita: Battle Angel. In ACM SIGGRAPH 2019 Computer Animation Festival (pp. 1-1).
[6] Karunakaran, K., Androwis, G., & Foulds, R. (2017). Natural user-controlled ambulation of lower extremity exoskeletons for individuals with spinal cord injury. In Wearable Robotics: Challenges and Trends (pp. 121-125). Springer, Cham.
[7] MILANOVI, A. (2016). DISCURSIVE CONSTRUCTION OF THE BODY AND THE BODILY POTENTIAL FOR CREATING NEW NARRATIVES. The Crisis in the Humanities: Transdisciplinary Solutions, 110.
[8] Kieliba P, Clode D, Maimon-Mor R O, et al. Robotic hand augmentation drives changes in neural body representation[J]. Science robotics, 2021, 6(54): eabd7935.
[9] Haar Horowitz, Adam, et al. "Dormio: Interfacing with dreams." Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems. 2018.
[10] Harrison, Peter & Wolyniak, Joseph (2015). "The History of 'Transhumanism'". Notes and Queries. 62 (3): 465–467. doi:10.1093/notesj/gjv080.
[11] Moravec, Hans (1998). "When will computer hardware match the human brain?". Journal of Evolution and Technology. 1. Retrieved June 23, 2006.
[12] Oliver Gingrich, Evgenia Emets and Alain Renaud. Aura: A holographic brainwave interface. DOI: 10.14236/ewic/EVA2018.66
[13] Anton Nijholt & Chang S. Nam (2015) Arts and Brain-Computer Interfaces
(BCIs), Brain-Computer Interfaces, 2:2-3, 57-59, DOI: 10.1080/2326263X.2015.1100514
[14] Bourguet, M. L. (2003, September). Designing and Prototyping Multimodal Commands. In Interact (Vol. 3, pp. 717-720).
[15] Jantz, J., Molnar, A., & Alcaide, R. (2017). A brain-computer interface for extended reality interfaces. In ACM SIGGRAPH 2017 VR Village (pp. 1-2).
[16] Nuzhdin, Y. O., Shishkin, S. L., Fedorova, A. A., Trofimov, A. G., Svirin, E. P., Kozyrskiy, B. L., ... & Velichkovsky, B. M. (2017, March). The expectation based eye-brain-computer interface: an attempt of online test. In Proceedings of the 2017 ACM Workshop on An Application-oriented Approach to BCI out of the laboratory (pp. 39-42).
[17] Gu, R., Yang, Y., & Cai, Z. (2019, December). Research on Cross-sensory Information Enhancement Effect Based on the Analysis of Multi-mode Brain Imaging. In 2019 Photonics & Electromagnetics Research Symposium-Fall (PIERS-Fall) (pp. 2114-2119). IEEE.