“Experience the world as animals do. Animal Vision combines VR technology and the Proteus Effect* to evoke human empathy, reshape cognition”
*The Proteus Effect explores how cultural imagination and emotional projection in virtual environments shape user decision-making and behavior. By experiencing the world through the lens of animals, we challenge users to rethink their perceptions and relationships with the environment.
Source: https://marshmallowlaserfeast.com/project/in-the-eyes-of-the-animal/
Animal Vision leverages the advanced hardware capabilities of Meta Quest Pro combined with Unity's robust development framework to create a multi-sensory VR experience. The project incorporates the Meta XR SDK to facilitate precise spatial mapping, interaction handling, and sensory feedback.
- Unity Engine
- Core Components:
- XR Interaction Toolkit: Implemented redirected turning, teleportation, and gesture-based controls.
- Shader Graph:
- Developed unique visual effects for owl (low-light vision) and eagle (vibrant vision) models.
- Physics Engine: Simulated bird-like flight dynamics with synchronized haptic feedback.
- Audio Mixer:
- Designed environmental audio and wing-flapping sound effects for sensory immersion.
Leveraged the SDK for accurate hand and eye tracking to enable intuitive gesture controls and gaze-based interactions.
Controller Feedback:
Integrated the SDK’s haptics capabilities for vibration effects during flight simulation.
Spatial Mapping and Passthrough:
Utilized the SDK to overlay virtual animal perspectives onto the real environment, blending physical and virtual spaces seamlessly.
Key Features Developed
Created the illusion of extended head rotation (owl 360 degrees) using spatial mapping and visual offsets while maintaining real-world constraints.
- Perspective Teleportation:
Implemented gesture-based transitions between animal perspectives (owl, eagle, human) for immersive viewpoint changes.
- Bird-Like Flight Simulation:
Simulated flight using controller movements, haptic feedback, and synchronized sound effects, enhancing the realism of navigation.
By stepping into the role of a spider, users gain a newfound appreciation for creatures often feared or misunderstood. This immersive experience encourages users to rethink their relationship with smaller, overlooked species, fostering meaningful discussions on biodiversity and coexistence.
Potential Social Impact
Playing the role of animals, such as spider, users gain a newfound appreciation for creatures often feared or misunderstood. This interaction encourages reconsideration of their relationship with smaller, often overlooked creatures, contributing to discussions on biodiversity and coexistence.
Incorporating additional sensory modalities, such as olfactory and tactile feedback, and integrating biological data enhances personalized user experiences. Expanding the project to include a broader range of animals allows the exploration of diverse cognitive perspectives and provides a new medium for storytelling that challenges traditional anthropocentric views, emphasizing ecological diversity.
The project inspires design practices prioritizing non-human agency and inclusivity, reflecting a broader ethical framework. It equips technology creators with tools and methodologies to embed empathy, care, and responsibility into their designs. Animal perspectives also foster critical thinking about data, narrative, and design within specific environmental and cultural contexts.
Get Involved
For more details, please click 'Contact' to get in touch with me
- Incorporate additional sensory modalities, such as olfactory and tactile feedback.
- Expand to include a broader range of animals, exploring more diverse cognitive perspectives.
- Integrate biological data to enhance personalized user experiences.