Touch My Heart
An XR experience for Magic Leap that takes users deep into the inner workings of the human heart — a realistic, educational encounter with its anatomy and the sound of various diseases.
Inside the human heart
An immersive AR application built on three pillars — spatial display, mid-air touch and medically accurate content.
- /01Magic Leap AR glassesSpatial anatomy rendered in the user's real environment.ARSpatial
- /02Ultraleap hapticsMid-air touch — feel the heartbeat with your bare hands.HapticsHand tracking
- /03Accurate visuals & soundMedically correct anatomy paired with true disease sounds.MedicalAudio
Design Research
Mapping the whole problem
From day one my role was to understand every dimension of the project — and turn scattered inputs into a clear design direction, fast.
- Mapped the project boundaries and constraints
- Gathered early ideas from team and stakeholders
- Conceptualized the design direction quickly
Platforms Research
Learning from XR platforms
I studied design guidelines across the major platforms. With Apple Vision Pro freshly announced, its interaction patterns became a primary reference point.
ReferenceApple Vision ProFreshly announced, richly documented interaction model.
ReferenceMeta QuestMature hand-tracking and comfort guidelines.
ReferenceMicrosoft HoloLensEnterprise-grade spatial UX patterns.
TargetMagic LeapOur delivery device — the design had to fit its optics.
Medical Research
Two conditions, medically accurate
I produced precise 3D representations — shape, motion and sound — for the two most prevalent heart conditions.
- Condition 01 Aortic Stenosis A narrowed aortic valve — modeled with its characteristic restricted flow and murmur.
- Condition 02 Atrial Fibrillation An irregular, rapid rhythm — captured in both the motion and the sound of the beat.
Experience Concept
Beyond the technology
The concept had to transcend the hardware — designing for the full spectrum of human interaction inside the application.
- Human-centered interaction, not device-centered
- Natural gestures paired with haptic feedback
- An experience that teaches through presence
XR Prototype
A clickable XR prototype
A prototype of the forthcoming experience aligned the whole team early — and turned feedback into a better final product.
- Aligns team and stakeholders early
- Speeds up collaboration and development
- Collects user feedback before the build
Procedural Modelling
Realistic, yet adjustable
A non-destructive procedural workflow drives the heart model — realistic enough for medicine, flexible enough to refine each disease animation without rebuilding.
Heart States
One model, three conditions
The same procedural model drives a normal heart, aortic stenosis and atrial fibrillation — each with its own shape, motion and sound.
Shading & Lighting
The final look, in real time
Procedural shader graphs defined the ultimate appearance and texture for real-time — including interactive slicing of the heart across any axis.
Unity
Bringing it together in engine
Wiring interaction, slicing and real-time behaviour into the Magic Leap runtime.
- Interactive slicing across arbitrary axes
- Real-time disease animation states
- Magic Leap and Ultraleap input integration