01. Overview

This project involved designing a mixed reality (XR) interface that seamlessly integrates a large touch screen and a VR system. The primary device was a 150cm smart TV transformed into a touch interface using Displax touch foil, positioned horizontally within a custom-built table.

02. Challenge

The main challenge was creating a UI that functioned identically on both the large touch screen and Meta Quest 3 VR headsets, ensuring a unified user experience across both platforms.
Designing for a multi-device setup introduced unique challenges, including:
Touch Zone Mapping: Due to the large screen size, determining optimal button placement and interaction zones was crucial for usability.
Consistent UI Across Devices: Ensuring seamless visual and functional parity between the touch screen and VR experience.

03. Design Process

After analyzing user needs and creating the user flow and information architecture, I began with the touch interface design. I established UI rules, including touch mapping, button sizing, and ideal screen ratios to enhance usability.
Next, I worked on VR adaptation, ensuring the UI appeared and functioned identically on Meta Quest 3, providing a seamless transition between touch and VR interactions.
Despite limited testing opportunities, I conducted focused usability tests to refine interaction zones and enhance the overall experience.
A key aspect of this project was the custom-built table required to house the large touch display. I collaborated with industrial designers to create a futuristic and functional table that complemented the technology.

04. Results

This project resulted in a one-of-a-kind mixed reality interface:
A fully functional, multi-device UI that worked identically on both the large touch screen and Quest 3 VR headsets.
A responsive touch zone system optimized for the 150cm display.
A modular design system, allowing for future scalability and adaptability.

This rewarding challenge pushed the boundaries of XR interface design by blending physical touch interactions with immersive VR experiences. Additionally, as a product designer, I had the rare opportunity to design a physical product—a reminder that product design is not just digital!