Immersive Interactive Experience, Unity

Mad Journey

An immersive experience that charts a distinctive odyssey as a painkiller through the human body

Date

2023

Collaborator

Erin Tao, Jiaxin Huang,

Coco Ma, Tony Li

Instructor

Jake Barton, Tamar Ziv

Role

Environment& Assets Design, Interaction Design

AR filter Design, Video Editing

Design & Developer Tools

Unity / Game Developing

OptiTrack / Motion Capture

Blender & C4D / Environment & Asset Design

Spark AR / AR filter

Mad Journey (2023), stands as a synthesis of virtual reality and physical immersion. Set within the confines of the Dreamcube, an avant-garde physical virtual reality platform, it presents participants with a unique expedition.

Through the lens of immersive storytelling, they step into the role of a painkiller, navigating the intricate labyrinth of the human body, and experiencing its vastness from an unparalleled perspective.

Experience Userflow

The journey is meticulously segmented into four pivotal stages, as detailed in the diagram below: beginning with eager anticipation, transitioning into the enlightening introduction, plunging into deep immersion at the Dreamcube's core, and culminating in a reflective finale.

How painkiller capsule works in the body basic steps

Mad Journey Userflow

Technical Details

The entirety of Mad Journey is meticulously designed and executed within Unity. Utilizing OptiTrack, we detect props adorned with reflective dots that are captured by the system. This real-time spatial data is relayed back to our server, initiating various dynamic elements which are then projected into the space. Complementing the visuals, over eight strategically placed spatial audio speakers enhance the immersion, wrapping participants in a rich auditory experience.

Dreamcube Technical Diagram

Testing on 1:1 recreation of Dreamcube in Unity

AR Filter - Painkiller Work Badge

Additionally, I've developed an AR filter allowing participants to embed their faces within a painkiller capsule badge. This enhances their immersion during the journey and provides a memorable keepsake afterward, serving both as a cherished memory and a promotional tool.

Final screen : Scan the QR code for the AR filter

AR Filter v2

AR Filter v1