VR Gamepad IMU Sensor for Direct Object Pointing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current VR gamepads lack an efficient object pointing function, leading to complex and time-consuming operations in non-game environments, reducing user experience due to the inability to directly point at objects without step-by-step key movements.

Innovation Solution

A method and device utilizing an Inertial Measurement Unit (IMU) orientation sensor in a gamepad to sense movement and convert absolute position coordinates from a reality scene into virtual coordinates within a VR scene, allowing direct pointing at target objects using a laser pointer or similar virtual pointing tool.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a gamepad uses step-by-step movement of operating keys to point at objects, then the gamepad can achieve object pointing function, but the operation time becomes longer and operation efficiency decreases

Engineering Contradiction:
Improveobject pointing operationVSAvoidtime for pointing at object
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The patent replaces the mechanical key-press system with an optical sensing system. The IMU sensor detects the physical movement and orientation of the gamepad controller, and this data is processed to generate a laser pointer that directly indicates the target object in the VR scene, eliminating the need for step-by-step key operations

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces a laser pointer as an intermediary tool between the gamepad controller and the target object. The laser pointer serves as a visual mediator that directly indicates the target, bridging the gap between the physical controller movement and the virtual object selection

Inventive Principle:
Principle #24Intermediary (Mediator)

2Device complexity

If a gamepad is designed without object pointing function, then the device complexity remains low, but the user experience and immersion in VR scene deteriorates

Engineering Contradiction:
Improvegamepad structureVSAvoidVR interaction capability
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent makes the gamepad controller multi-functional by integrating both traditional game control capabilities and object pointing functionality. The same gamepad hardware serves dual purposes: playing games and interacting with VR environments through direct pointing, eliminating the need for separate pointing devices

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The gamepad controller performs self-service by using its own motion sensing capabilities (IMU) to generate the pointing function. The controller detects its own movement and orientation, processes this data, and generates the corresponding laser pointer indication, making the system self-sufficient without requiring additional external sensors or devices

Inventive Principle:
Principle #25Self-service

3Adaptability or versatility

If a remote object pointing function is developed in gamepad, then the pointing capability is achieved, but the operation complexity increases due to multiple steps required

Engineering Contradiction:
Improveobject pointing functionVSAvoidpointing operation process
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent extracts the pointing indication function from the complex multi-step operation process and implements it through a simple laser pointer visual indicator. The complex coordinate transformation and position calculation processes are handled automatically by the system, leaving the user with a simple point-and-select interaction

Inventive Principle:
Principle #2Taking out (Extraction)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution enhances operation efficiency by enabling direct object pointing in VR scenes, reducing complexity and improving user experience by eliminating the need for step-by-step key operations.

Implementation Method 1

sensing, by a computing device, a movement of a gamepad from a first position to a second position in a reality scene through an Inertial Measurement Unit (IMU) orientation sensor

Methodology Applied
Scientific EffectInertial measurement: Accelerometer

Data Source

PatentUS11307677B2Method and device for object pointing in virtual reality (VR) scene using a gamepad, and VR apparatus
Publication Date: 2022.04.19 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • US11307677B2 patent drawing
  • US11307677B2 patent drawing
  • US11307677B2 patent drawing

AI summary

A method and device for pointing at an object in a Virtual Reality (VR) scene, and a VR apparatus are provided. The method includes sensing a movement of a gamepad from a first position to a second position in a reality scene through an Inertial Measurement Unit (IMU) orientation sensor. The IMU orientation sensor is mounted in the gamepad, and the gamepad is configured to control an object in a VR scene. The method also includes generating a first position vector based on the movement; acquiring a first absolute position coordinate of the second position in the reality scene according to a position coordinate of a starting point in the reality scene and the first position vector; converting the first absolute position coordinate into a first virtual position coordinate in the VR scene; and pointing at a target object located at the first virtual position coordinate in the VR scene.