Our lab envisions a transformation in the way we interact with technology through Heads-Up Computing. This new interaction paradigm is built on a wearable platform that includes modules for the head, hand, and body. These modules distribute the input and output capabilities of the device to align with human input and output channels. Heads-Up Computing proposes a voice and gesture multimodal interaction approach. Once realized, this could significantly alter our work and daily lives. Imagine attending to and manipulating information seamlessly during various indoor and outdoor activities such as cooking, exercising, hiking, or socializing.
Related publications: https://www.synteraction.org/publications/.
PROJECTS
Our project aims at developing a wearable device platform that significantly diverges from traditional screen-based interactions. By leveraging voice and gesture commands, the project seeks to create a more natural and intuitive user experience that allows individuals to remain engaged with their physical surroundings while accessing and interacting with digital information. This approach promises to facilitate a more seamless, just-in-time, and intelligent computing support system that can enhance productivity, safety, and overall quality of life without the cognitive and social drawbacks associated with current mobile technologies.
Key areas of focus for the project include:
- Hardware Design: The development of lightweight, comfortable, and aesthetically pleasing wearable devices capable of supporting advanced computing functionalities. This involves integrating sensors and input/output mechanisms that are conducive to voice and gesture-based interactions, ensuring that the technology is both accessible and practical for everyday use.
- Interaction Models: The creation of innovative interaction paradigms that can accurately interpret and respond to natural human behaviors. This includes refining voice recognition and gesture detection algorithms to understand a wide range of commands and gestures, thereby allowing for a more fluid and flexible user experience. We also investigate the use of multiple modes of interaction to provide a more robust and adaptable computing experience. By offering a variety of input and output options, the system can cater to diverse user preferences and situational requirements, ensuring that the technology remains effective across different contexts and use cases.
- Integration Methodologies: Exploring strategies to seamlessly blend computing into the user's sensory experience. This entails designing context-aware systems that can intelligently adjust to the user's environment and activities, providing relevant information and support without unnecessary interruptions or distractions. The project aims to achieve a balance between digital connectivity and real-world presence, enabling users to access digital resources in a manner that feels like an extension of their natural senses.
The ultimate goal of the "Heads-Up Computing" project is to pioneer a new era of mobile computing that enhances human capabilities and interactions without the downsides of screen dependency. Through innovative hardware design, intuitive interaction models, and intelligent integration methodologies, the project seeks to create a future where technology serves to augment human experiences in a way that is both empowering and harmonious with the physical world.
ACIM Team Research Fellowship, Applied Neuro-Design. Grant Amount: HK$50,000. PI: Maurice Benayoun
EC-RGC grant, Mindspaces HK. Grant amount: HK$2.6M. PI: Maurice Benayoun STARTS – HORIZON2020 EU Project, MindSpaces. Grant amount: HK$1.6M. PI: Maurice Benayoun
ACIM Team Research Fellowship, Challenges and Opportunities of the Blockchain Technology for Hong Kong. PI: Damien Charrieras; Co-Is: Maurice Benayoun, Daniel Howe
ASTRI Lab + Brain Cloud. Grant amount: HK$1.35M. PIs: Maurice Benayoun, Tobias Klein. Co-Is: Jeffrey Shaw, Richard William Allen. ACIM Team Research Fellowship, Reverse Neuro Design. Grant amount: HK$200,000. PI: Maurice Benayoun
Brain Factory Prototype. PI, Bains Numerique Biennial, Centre des Arts Enghien les Bains, RAN (Dig Art Network)
Zhang Y., Benayoun, M., The Emotional Statement: Profile Photo and Self Branding in the Art World, INDERSCIENCE, International Journal of Arts and Technology, 7 July 2020,
https://www.inderscience.com/info/inarticle.php?artid=108629
Benayoun, M., Sustainability, Value of Values, Edition of CENTERPOINT NOW 2020, World Council of Peoples for the United Nations, 2020.
Benayoun, M., Ag, T. R., After the Tunnel, the shifting ontology and ethology of the emerging art-subject, full paper, ISEA2020 online, proceedings, 2020.
Park, Lisa Soyoung, and Maurice Benayoun. “A Cautionary Tale of Urban Media Art: Media-Bait, Planned Censorship and Its Repercussions.” Leonardo 53, no. 2 (April 2, 2020): 135–44. https://doi.org/10.1162/leon_a_01611. (posted online January 24, 2018)
Benayoun, M., “On Digital Mutations in the Landscape of Chinese Contemporary Art.” On the Road – Young Media Artists in China, Hong Kong: School of Creative Media, City University of Hong Kong, English and Chinese, (March, 2018): pp. 12-18. http://www.academia.edu/36473999/On_Digital_Mutations_in_the_Landscape_of_Chinese_Contemporary_Art_-_Chief_curator_statement
Benayoun, M., “Value of Values in the MindSpaces”, Ars Electronica 2019, Linz, Austria, (September, 2019).
Benayoun, M., “Value of Values, Finance vs Ethics”, accepted paper, ISEA2019, Republic of Korea, (June, 2019).
Petros Alvanitopoulos, Sotiris Diplaris, Beatrice de Gelder, Alexander Shvets, Maurice Benayoun, Panagiota Koulali, Ayman Moghnieh, Yash Shekhawat, Christos Stentoumis, Tyson Hosmer, Refik Anadol, Marta Borreguero, Alejandro Martin, Piera Sciama, Kostas Avgerinakis, Panagiotis Petrantonakis, Alexia Briassouli, Simon Mille, Anastasios Tellios, Luis Fraguada, Holger Sprengel, Ilias Kalisperakis, Nestor Cabanas, Spiridon Nikolopoulos, Stavros Skouras, Verena Vogler, Despoina Zavraka, Jens Piesk, Lazaros Grammatikopoulos, Leo Wanner, Tobias Klein, Stefanos Vrochidis, Ioannis Kompatsiaris. “MindSpaces: Art-driven Adaptive Outdoors and Indoors Design”. Digital Presentation and Preservation of Cultural and Scientific Heritage, 9. (2019): pp 391-402.
Art Machines: Past/Present, Benayoun, M. Hong Kong Escape Views: Panoptical Memories. Interactive installation, 360 videos, and VR Binoculars. Neuro-Design Lab, ACIM, School of Creative Media, City University of Hong Kong, Indra and Harry Banga Gallery, City University of Hong Kong, Hong Kong, November 24 2020 – February 21, 2021.
Ars Electronica Festival 2020, Hong Kong Garden, Solo Exhibition III: Maurice Benayoun. Introduction to Value of Values project Video. Kelper’s Garden, Chair of Hong Kong Garden Benayoun, M., Neuro-Design Lab, ACIM, School of Creative Media, City University of Hong Kong, Hong Kong, September 9 – 13, 2020.
Ars Electronica Festival 2020, Hong Kong Garden and Garden Thessaloniki, Benayoun, M., Anadol, R. DïaloG: Alien life in the Telescope. Live experiment. MindSpaces & MindSpaces HK / CityUHK, Analog Native, Neuro-Design Lab, ACIM, School of Creative Media, City University of Hong Kong. September 9 – 13, 2020.
Ars Electronica Festival 2020, Hong Kong Garden, Benayoun, M. Chair, concept and Realisation. Introduction to Value of Values: Planetary Wine Tasting party. Osage Gallery, Hong Kong, September 13, 2020.
Ars Electronica Festival 2020, Hong Kong Garden, Benayoun, M. Hong Kong Escape Views. online version, 360 video panoramas, Neuro-Design Lab, ACIM, School of Creative Media, City University of Hong Kong, Hong Kong, September 9 – 13, 2020.
Benayoun, M., Invited Speaker, "Comment le Biofeedback sonore contribue au neuro-design des valeurs humaines", Mondes Spatialisé (Online Lecture), Université Jean Monnet Saint-Étienne, Lyon, France, 3-4 November 2020.
Benayoun, M., Host and Speaker. Ahmed, H., Briassouli, A., Fraguada, L., Georgakopoulou, N., Gollob, E.,Hosmer,T., Tellios, M. A., Dr A., Zavaraka, D., Invited Speakers. “Public Symposium: Why and How Artworks Feel?”, Collaborative project MindSpaces & MindSpaces HK / CityUHK, Online open lecture, Hong Kong Garden, Garden Thessaloniki, Ars Electronica Festival 2020, Neuro-Design Lab, ACIM, SCM, CityU, 9-13 September 2020.
Benayoun, M., Anadol, R., Invited Speakers, “Dialogue about DïaloG, Conversation between Refik Anadol (LA) and MoBen (HK)”, Collaborative project for the DïaloG project, MindSpaces & MindSpaces HK / CityUHK, Online open lecture, Hong Kong Garden, Garden Thessaloniki, Ars Electronica Voyage Channel, Ars Electronica Festival 2020, Ars Electronica, MindSpaces, Neuro-Design Lab, ACIM, SCM, CityU, 9 September 2020.
Benayoun, M., Keynote Speaker, “ART SHIFTS step by step”, Meet the Media Guru with Maurice Benayoun, Digital Innovation for Culture (Online Lecture), MEET Digital Communication srl Impresa Sociale, Milan, Italy, 30 June 2020.
Benayoun, M., Invited Speaker, “Art from connection to pervasion”, Pt.1 Telemechanics, 101. ALL in One Online Festival, 101 Mediapoetry, 20 June 2020.
People