Back to Fun Projects

Look As Input: Augmenting How We See

——

Moon Adventure

Moon Adventure is an XR exercise that involves developing a Unity scene for mobile interactions, with a focus on the use of gaze as input. Users utilize their mobile phones as 'magic lenses' to discover new perspectives within a moon-themed adventure. By wearing the cardboard wing with a phone trigger, users can activate interactions within the scene, turning the act of looking into an interactive experience. This exercise explores the intricacies of visual engagement, from brief glances to in-depth scrutiny, to offer a varied and immersive exploration of sight and perception.

In collaboration with: Kangning Tang

Timeline /
Sep 2023
(
1.5 Days
)
Role /
XR Prototyping
Physical Object Prototyping
Tools /
Unity 3D
ChatGPT
Cinema 4D

Looking through a magical lens, we enter a mysterious realm on the moon. Let's illuminate the stars, dispel the clouds, and journey to a beautiful forest in search of celestial peaches and the moon.

Live Demo Recording
Physical Object - Wing

To create the wing, we utilized rubber bands threaded through the player's arm and holes in the cardboard, allowing the player to control the opening and closing of the wings through the swinging motion of their arm.

Subsequently, we secured a phone inside the sleeve to serve as a trigger mechanism, enabling the player to interact with various elements within the scene.

Design Process
What I Learned

Learned to use a Virtual Camera for mobile-Unity connection and interaction.

Practiced using tags for interactive objects.

Next Step

Implement faster wing swinging for higher flight.

Experiment with attaching phone to feet for forward movement tracking.

Add sound effects for successful actions.