Painting Adventure is an XR exercise that transforms an ordinary chair into an interactive Unity scene. It explores the concept of tracking as input, incorporating actions such as following, trailing, and searching to examine how objects can autonomously track their position, rotation, and usage, as well as the user's position and posture. This exercise entails designing gestures to recognize various sitting positions, with the chair acting as a sensor that responds to the user's movements. It provides visual and auditory feedback for different gestures, enhancing the user's interaction with the chair. The culmination of the exercise is a demo where the user embarks on a virtual journey through the painting "A Thousand Li of Rivers and Mountains" while riding a crane, which serves as the interactive chair.
In collaboration with: Kangning Tang
Riding a crane, let’s embark on an exhilarating quest in the painting of “A Thousand Li of Rivers and Mountains”.
(This demo video includes an audio.)
Learned to map the physical object (chair) to virtual counterpart (crane) in Unity.
Discovered the location where the Oculus headset is initially put on determines the OVR (Oculus VR) origin position, which serves as the reference point for the user's head tracking and spatial orientation within the virtual environment.
Realized that the setup of the OVR origin position is crucial for ensuring that the virtual space corresponds accurately to the user's physical movements and interactions.
Introduce acceleration based on tilt angle for speed variation.
Enable interaction with both hands in the scene: one hand to control the crane, and the other hand to collect floating pottery using magical tools like a “fly whisk”.
Explore motion simulator features for enhanced realism, such as making the chair move up and down to simulate riding a crane.
