Pastry Making is an XR exercise that utilizes Unity for low-fidelity prototyping, focusing on the input of seeing - such as discerning, perceiving, and recognizing - to interact with virtual objects. This prototype involves designing a set of gestures that correspond with objects in the scene, triggering specific actions. The demo features a culinary adventure where the user virtually prepares a lotus pastry, with the process including lighting a fire, heating oil, and frying the dough. The exercise encourages users to experiment with different gestures and interactions, offering a unique, hands-on experience in pastry making simulation.
Lighting a fire and heating oil, we drop the kneaded dough into the hot oil to fry until it blossoms into a lotus pastry. Hmm... It seems a bit overfried. No worries, let's discard it and make another!
(This demo video includes an audio explanation.)
Learned that we need to create a closed loop (where fingers touch each other or the palm) when recording gestures or using them to grab objects; otherwise, the gesture cannot be recorded or used to pick up objects.
Explored more natural ways of interacting with objects by using different gestures to grab and interact with objects of various shapes.
Practiced creating animations with VFX and C# code.
Add sound first to provide auditory feedback for lightning fire, pouring oil, boiling oil, frying pastry, etc.
Utilize an iterative design process for material, lighting, VFX, and animation variations.