Spatial computing technology, in the wave of digital transformation, has become one of the new driving forces for industrial innovation and gained more worldwide attention, especially after Apple’s release of the Vision Pro mixed reality headset. Integrating computer vision, graphics processing, data analysis, and Augmented Reality (AR) technology, it enables its users to interact with digital content in three-dimensional space. The burgeoning development of this technology stems from the rise of Virtual Reality (VR), Augmented Reality (AR), and Metaverse Industry in recent years. All long, Zhuoneng has been focusing on user experience (UX) design in the field of spatial computing, and has achieved extraordinary achievements as well as widespread international recognition in the field of AR/VR design in spatial computing.
How will spatial computing affect our way of life and work? What is the current competitive landscape and development status of the industry? In response to these issues, Zhuoneng has brought a lot of enlightenments in the interview.
Q：In your opinion, what is the core of UX design in the field of spatial computing?
In the field of spatial computing, aimed at providing an intuitive, efficient, and enjoyable user experience, UX design enables its users to better utilize spatial information as well as technology to complete tasks, access information, and interact with the environment. Therefore, my UX design pays attention to the combination of multiple aspects including spatial perception, visualization of geographic information, personalized user experience, function and applicability.
Q：Have those emerging technologies in recent years played any role in the field of spatial computing? How did you achieve their integration?
It was when I joined the UCLA Technology Studio that I began the leading-edge exploration of spatial design as well as the integration of emerging technologies, especially those cutting-edge technologies such as Interaction Design (IXD), AR, VR, etc. At that time, Elon Musk, the founder of SpaceX, proposed the Mars colonization plan when the rapid development of AR technology and VR technology provided new possibilities for simulating the space environment and constructing outer space residences. These factors had jointly driven human’s interest in Mars as a place of residence and brought new prospects for the application of some emerging technologies such as space computing, AR, and VR in space exploration. In the future background of human’s exploration of Mars, I created the Nomadic Cloud project, with the core goal of exploring human habitation and interaction design during the process of moving towards Mars. To convey the core concept of this project, I integrated some cutting-edge technologies and technological medias, including AR/VR experiences and 3D animated short films. These explorations were recognized by many awards from the field of spatial design as well as the film industry, and received extensive media interviews as well as recognitions from various medias such as cinemas, museums, and exhibitions. This was my first integration of spatial design and AR/VR, and it also motivated my future designs.
Q: Could you please introduce some of your innovative designs or projects about the practical application of AR/VR? What do they mean to users?
Of course! I would like to introduce some designs based on AR/VR. I vividly remember one project, a VR rowing experience, that stood out to me because I had the opportunity to push the boundaries of blending the virtual and real worlds so that it enabled users to experience an immersive, seemingly effortless but realistic rowing experience by combining real body movements with virtual environment. The lifelike interactivity and sense can provide users with a completely new experience, which enabled them to fully integrate virtual and real worlds. Finally, it was showcased at the 2019 Austin Design Week. Furthermore, I would like to introduce another interesting project called Beyond. This project was designed for Carnegie Museum of Natural History, By wearing the Hololens glasses, users can immerse themselves with the exhibits and personalize their collections as well as displays. This project was designed for Carnegie Museum of Natural History, and received some prestigious awards such as the Core77 Design Award, the Platinum Award of Muse Design, the Silver Award of New York Product Design, the Gold Award of Indigo Design, etc. Besides, I also delved into academic research, exploring the intersection of spatial computing and cognitive science. In the Augmented Perception Lab at Carnegie Mellon University, I participated in a project, Chameleon User Interfaces in Mixed Reality, so as to reduce the overload information caused by excessive interfaces in mixed reality environments, help users interact more effectively with mixed reality environments, and thus provide a more natural and comfortable experience for users. Currently at Microsoft, I’m working on an AR/VR product, that is, Microsoft Mesh, with the goal of addressing the emerging remote work needs worldwide. We still hope to provide immersive experiences on both PC and VR devices so that collaborators can feel more connected and productive when working together.
Q: What do you think of the development prospect of spatial computing technology in the future?
In my view, digital technology has been empowering and even restructuring thousands of industries. With the continuous improvement of industrial infrastructures, technologies such as AIGC, spatial computing, and cloud computing have been becoming increasingly mature, so the commercial values and application changes brought about by it will be enormous. With the support of emerging technologies such as AI, spatial computing will gradually reconstruct the ecological landscape of the virtual reality industry and move towards a new round of prosperity. The evolution of spatial computing technology also foreshadows a more freely flowing, intelligent and interconnected future. It is not only a product of technological progress, but also a part of humanity’s pursuit of a better life.
As an AR/VR designer full of passion and creativity, Zhuoneng’s career is filled with remarkable achievements and breakthroughs, and he has become an outstanding representative and also set an example for young designers in the AR/VR field. In the future, he will spare no efforts to promote the development of his industry with his more innovative designs.
