Smart Glasses & Leap Motion - Smart TV Interaction

Undergrad UX Design Intern
LG Electronics
2013. 4 - 2014. 2
Overview
This capstone project between Sogang University - LG Electronics was focused on developing novel concept ideas to create synergy between rookie devices and LG Electronics products. We developed working prototype and submitted eight user scenarios.
Methods & Toolkit
Ideation, Scenarios

Design Question

What is the next generation beyond touch screen?

Our team’s goal was to investigate the possibility of Leap Motion and smart glasses as new input devices on LG Smart TV. We developed several concept user scenarios applied on various circumstances.

Research

Before getting down to design, we carefully looked into the devices: Leap Motion, Google Glasses, and LG Smart TV. For several weeks, we individually collected the instruction the companies provided, the relevant patents, and the credible reviews on media and shared with other members. Simultaneously, we tried using the devices ourselves, in particular Smart TV at the LG R&D Center in Gangnam, South Korea. (At that moment, Google Glass were not released, so we relied on reviews)

Smart Glasses

Designing User Scenario

In the first half of the term, we focused on smart glasses interaction. I participated in coming up with ideas and further development with the team. Since Google smart glasses were not on the market at that moment, we designed concept user scenarios only based on paper research. Even though our main task was to design user scenarios for LG smart TV, we further contrived several possible user scenarios on different circumstances in daily life.

TV Display Expansion with Smart Glasses

In the first half of the term, we focused on smart glasses interaction. I participated in coming up with ideas and further development with the team. Since Google smart glasses were not on the market at that moment, we designed concept user scenarios only based on paper research. Even though our main task was to design user scenarios for LG smart TV, we further contrived several possible user scenarios on different circumstances in daily life.

It would be most important to create a reliable augmented reality by quick, accurate calculating the relative distance and direction between the smart glasses and the display.
We developed scenarios based on consideration of 1) ‘expanding’ that utilize expansion of the applications on the screen, 2) ’laying out’ that focused layout of the UI that is difficult to display on the screen.

Information Enhancement on TV

The information on the TV is often instantaneous, limited. Our design goal was to appropriately enhance the limited information on the Smart TV with additional information customized to the user on smart glasses so that encouraging the user to interact more with the product. The necessary technology for this service was to recognise the user’s gazing location on TV with recognition methods such as visual coding or ultrasound technology and to show the proper information on the user’s sight that is relatively matched with the TV location.

Other Applications

Leap Motion

User Scenario

For the interaction design with Leap Motion and LG Electronics products, our team developed user scenario focused on practical use on present product control.

Leap Motion and Smart TV

Since there are a number of basic TV controls that should be considered (such as next/prev, select, play, pause, volume/channel select), we focalized on finding the most appropriate control movements. I continuously iterated examination with trying assumed movement with the device with team members.

Leap Motion and Laptop

We set several situations that Leap Motion can be applicable input device on Laptop: As a control for graphic design applications, for web surfing, and for educational applications.

Smart TV Control Prototype

I participated in making concept video with other Art & Technology students. Moreover, we designed interactive prototype on LG smart TV with independent application. With other team members’ feedback, CS students developed the working prototype on TV with OpenGL. We could examine the prototype on the public in Hanieum Expo, Nov 2013. Students and visitors tried the prototype and gave positive responses for the noble interaction of Leap Motion.

At the booth in Hanieum Expo 2013
There were concept video and working prototype on TV at the booth

Outcome

We developed total eight user scenarios for smart glasses, working prototype for Leap Motion control on Smart TV, and created two concept videos for final presentation. These outcomes were presented in LG R&D center and also Hanieum Expo in Fall 2013. In addition, our team grants a patent for the Leap Motion control system in Korea.

For me, the project was my first opportunity to engage in service UX design. I could attain knowledge pertaining to the concept of user experience and the design development process. With the project, I got deeply interested in service design and UX designer as career.