top of page
  • Instagram
  • LinkedIn
logo-grayscale-inverted_edited_edited.jpg

HARMONIZING MINDS

Sensory based therapeutic immersive experience

MY ROLE

Creative technologist, System designer

COLLABORATOR

Jess Adriana Rivera

TAGS

AI system, Gesture detection, Bio Sensor, Immersive experience, TouchDesigner, Audio Reactive

DESCIPRTION

A Multisensory Therapeutic Experience for Focus, Well-being, and Nature Integration, which seeks to create a series of multisensory therapeutic sessions designed for individuals who struggle with focus due to conditions like bipolar disorder, PTSD, depression, and social anxiety.

PROJECT OBJECTIVES

> Build experiences utilizing heart rate and oxygen sensors, interactive environments, and sound therapy

> Explore the healing elements of nature alongside color theory to enhance concentration, emotional regulation, and overall well-being.

IMG_0997_edited.jpg

SYSTEM

> Arduino Uno

> MAX30102 Heart & Oxygen Sensor

> 2 Running PC

> 2 Projects

> 2 Spatial Speaker

> 1 Depth Camera

SYSTEM

The MAX30102 heart rate and oxygen sensor operates based on the principle of light absorption by blood in tissues and blood vessels. MAX30102 utilizes infrared (IR) and red light reflection technology to measure the oxygen saturation (SpO2) and heart rate (BPM) of the user.

unnamed (1).png

SYSTEM DIAGRAM

unnamed (4).png

MACHINE GENERATED 3D ENVIRONMENT 

Xnip2025-01-21_15-46-25.jpg

LOCOMOTION, DYNAMIC CAMERA

The dynamic camera movement is employed to introduce subtle tilts and shifts in the player's field of view, mimicking the organic movements one would feel while walking.

Xnip2025-01-16_20-48-04.png
Xnip2025-01-16_16-53-22_edited.jpg

GESTURE DETECTION FLOW

1. Centroid Calculation: The centroid (ci) is determined by averaging the coordinates of the gesture's data points.

2. Point Relocation: All points are adjusted to place the centroid at the origin, ensuring accurate recognition.

3. Scaling: The gesture is scaled within the range of -1 to 1, further enhancing recognition accuracy.

Xnip2025-01-16_17-30-17.png
Xnip2025-01-16_17-29-59.png

AI OPPONENT DEVELOPMENT

Xnip2025-01-16_17-30-38.png

COMPONENTS

This project aim create a kinetic wall installation featuring wave-shaped panels made from PMMA (acrylic) using CNC machining.  The design will utilize parametric modeling
in Rhino and Grasshopper, allowing for intricate and customizable shapes that mimic natural wave formations. 

Xnip2025-01-16_20-42-07.png

#1 AI PERCEPTION 

Xnip2025-01-16_17-30-48.png

#2 AI STIMULI 

Xnip2025-01-16_17-31-02.png

#3 DETECTION STSTEM

#4 DAMAGE REACTION

Xnip2025-01-16_20-28-14.png
Xnip2025-01-16_20-28-05_edited.png
Xnip2025-01-16_20-28-05_edited.png
Xnip2025-01-16_20-28-05_edited.png
Xnip2025-01-16_20-28-14.png

OTHER PROJECTS

3 STAGES PREVIEW

MACHINE GENERATED 3D ENVIRONMENT 

Xnip2025-01-21_15-46-25.jpg
bottom of page