Touch the Future

A touch-related interactive interface device for future spatial computing

TYPE
‍Individual Project
‍
‍DATE
‍May - July 2020
(4 Weeks)
‍
‍TOOLS
‍Illustrator, LeapMotion, Unity, Arduino

ABOUT
Upon mutual connection, VR can create a virtual world with multiple sensory stimulations and it can get users immersed in the virtual scene through tactile feedback. For a special group of people, it’s crucial to touch the virtual interface for a more convenient life. I hope to discuss the possibility of the interface and its application of extension using existing internet tools.
‍

◉ Background

A screen-free future is possible.

In the past few years, the development of Mixed reality (MR) and Internet of Things (IoT) have made a screen-free future possible. Three-dimensional virtual content has enriched our lives. Most people watch these 3D objects through virtual screens, and many interactive tools such as touchable screens and mouses are invented.

Join our team

However...

Are there more interesting possibilities related to virtual screen contact?

Join our team

◉ Problem Statement

The accessibility of the technology is very low.

Spatial interaction depends more on physical sensory functions, which brings challenges to its design. Most existing technologies rely on a limited number of body parts for interaction, thus reducing the accessibility of the technology. To make the virtual space more accessible to different groups of people, I hope to try a new user interface for deeper interactive operations on virtual content of the three-dimensional screen, rather than just using some tools.

Join our team

◉ Research

What tools may I use?

For the deeper interaction with 3D virtual content, I choose three tools as input, middle and output end respectively.

◉ Step Overview

How can I achieve it?

Join our team

◉ Concept

Feel virtual objects with touch.

Join our team

◉ Experiment Procedure

1st Step - Unity & Leap Motion.

In order to better understand people's needs, we interviewed different types of people to see if there are opportunities.

Join our team

2nd Step - Unity & Arduino.

I created code in Unity and Arduino respectively, and tried to connect Unity and Arduino.

Join our team

3rd Step - Unity & Leap Motion & Arduino.

After completing the two steps, I used three Connect and use electronic components to achieve mechanical feedback.

Join our team

◉ Future Direction

The combination of
3D screens and tactile interfaces.

The combination of 3D screens and tactile interfaces can be applied into various fields, which can witness the further development of digitalization with 3D scanning.