HMD Control via Mobile Terminal Movement Sensing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems for controlling head-mounted displays (HMDs) lack efficient methods for optimized control and screen management, particularly in integrating movement sensing and user input for seamless interaction with virtual spaces.

Innovation Solution

A system comprising a mobile terminal connected to an HMD via a wired interface, equipped with a sensing unit and a controller that outputs specific regions of a virtual space based on movement, allowing for dynamic display adjustments and user input integration to enhance interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the HMD displays different regions of virtual space based on HMD movement, then the user interaction with virtual space is enhanced, but the system complexity increases due to integration of movement sensing and display control

Engineering Contradiction:
Improveuser interaction capabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent combines the mobile terminal and HMD into an integrated system where the mobile terminal's sensing unit detects movement and the controller coordinates display output across both devices. This merging allows enhanced user interaction through unified control while distributing system complexity across multiple components rather than concentrating it in the HMD alone.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The mobile terminal acts as an intermediary device that receives movement input, processes it through the sensing unit and controller, and transmits appropriate display region commands to the HMD. This intermediary role simplifies the HMD's control architecture while enabling sophisticated interaction capabilities through the mobile terminal's processing power.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If the mobile terminal senses movement and controls HMD display regions, then the control precision is improved, but the device complexity increases due to additional sensing and control components

Engineering Contradiction:
Improvemovement sensing precisionVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The mobile terminal utilizes its existing sensing unit and processing capabilities to detect movement and control the HMD display, rather than requiring the HMD to have dedicated high-precision sensors. This self-service approach leverages the mobile terminal's inherent capabilities to achieve precise movement sensing without adding complex hardware to the HMD.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The mobile terminal's sensing unit and controller serve multiple functions: detecting user movement, determining display region mapping, and coordinating HMD output. This multi-functionality allows the same components to achieve precise movement sensing and display control without requiring specialized dedicated components, thereby reducing overall device complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of operation

If the system maintains display output when HMD is stationary but terminal moves, then the user experience is enhanced, but the energy consumption increases due to continuous sensing and processing

Engineering Contradiction:
Improveuser experienceVSAvoidenergy consumption
Core Design Contradiction:
Ease of operationVSUse of energy by moving object

Solution Approach 1:

The system dynamically adjusts display output based on the relative movement between terminal and HMD. When the terminal moves while HMD is stationary, the system continues to update display regions to maintain proper orientation and user experience. This dynamic behavior ensures ease of operation while managing energy consumption by updating only when necessary relative movement occurs.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables intuitive control of HMDs by sensing movement and user input, providing optimized display management and enhancing user interaction with virtual spaces, even when the HMD is stationary, thus improving the overall user experience.

Implementation Method 1

a sensing unit configured to sense a movement of the terminal body

Methodology Applied
Scientific EffectMovement sensing: Accelerometer

Implementation Method 2

output a preset first region of a virtual space on the display unit of the HMD

Methodology Applied
Scientific EffectDisplay emission: Light Emitting Diode

Data Source

PatentEP3163426B1System and method of controlling the same
Publication Date: 2019.04.10 LG ELECTRONICS INC
  • EP3163426B1 patent drawingFigure 1A
  • EP3163426B1 patent drawingFigure 1B~1C
  • EP3163426B1 patent drawingFigure 2A~2B

AI summary

A system includes a head mounted display (HMD) having at least one of a display unit and a sensing unit and configured to be connected to a mobile terminal in a wired manner, and a mobile terminal configured to control the HMD, wherein the mobile terminal includes a terminal body, an interface unit provided in the terminal body, a sensing unit configured to sense a movement of the terminal body, and a controller configured to output a preset first region of a virtual space on the display unit of the HMD and control the display unit of the HMD to display a second region of the virtual space different from the first region of the virtual space on the basis of a movement of the HMD sensed through the sensing unit of the HMD. When the user applies a certain gesture to the terminal e.g. shaking it, the controller outputs the preset first region again to the display of the HMD in the current viewing direction. Thus this is some kind of reset function for the user's view in the virtual space.