Back to Fun Projects

Seeing as Input

——

Pastry Making

Pastry Making is an XR exercise that utilizes Unity for low-fidelity prototyping, focusing on the input of seeing - such as discerning, perceiving, and recognizing - to interact with virtual objects. This prototype involves designing a set of gestures that correspond with objects in the scene, triggering specific actions. The demo features a culinary adventure where the user virtually prepares a lotus pastry, with the process including lighting a fire, heating oil, and frying the dough. The exercise encourages users to experiment with different gestures and interactions, offering a unique, hands-on experience in pastry making simulation.

Timeline /
Oct 2023
(
2 Days
)
Role /
XR Prototyping
Tools /
Unity 3D
ChatGPT

Lighting a fire and heating oil, we drop the kneaded dough into the hot oil to fry until it blossoms into a lotus pastry. Hmm... It seems a bit overfried. No worries, let's discard it and make another!

(This demo video includes an audio explanation.)

Process

Design Process
What I Learned

Learned that we need to create a closed loop (where fingers touch each other or the palm) when recording gestures or using them to grab objects; otherwise, the gesture cannot be recorded or used to pick up objects.

Explored more natural ways of interacting with objects by using different gestures to grab and interact with objects of various shapes.

Practiced creating animations with VFX and C# code.

Next Step

Add sound first to provide auditory feedback for lightning fire, pouring oil, boiling oil, frying pastry, etc.

Utilize an iterative design process for material, lighting, VFX, and animation variations.