HMD Touch Calibration via Display Position Mapping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing head-mounted display (HMD) systems for virtual reality and augmented reality face limitations in user operability due to the need for camera-based tracking, which complicates the system, increases costs, and restricts user motion. Additionally, users wearing HMDs cannot easily interact with external real-world environments.

Innovation Solution

A method for controlling a head-mounted display apparatus through touch operations on a touch operation surface, where the system performs calibration by having the user touch specific display positions while conscious of those positions, allowing the system to associate touch positions with intended display positions without the need for camera-based tracking.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If camera-based tracking is used to enable user operation in virtual space, then operability is improved, but device complexity and cost increase

Engineering Contradiction:
Improveuser operabilityVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent extracts the camera component from the HMD system entirely, replacing camera-based tracking with a touch operation surface. The touchpad is integrated into the HMD without requiring external cameras or complex tracking infrastructure, thereby simplifying the system while maintaining operability.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent replaces the optical/mechanical camera-based tracking system with a direct touch interface. Instead of using cameras to detect operation member positions in 3D space, the system uses a touchpad that directly senses finger touches and maps them to virtual space coordinates through calibration.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If camera-based tracking is used to enable user operation, then operability is improved, but cost increases

Engineering Contradiction:
Improveuser operabilityVSAvoidmanufacturing cost
Core Design Contradiction:
Ease of operationVSEase of manufacture

Solution Approach 1:

The patent employs a touchpad that can be manufactured at low cost using standard touchsensor technologies. Instead of expensive camera modules, processors, and tracking infrastructure, the system uses a simple touch-sensitive surface with basic coordinate mapping capabilities.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

3Adaptability or versatility

If HMD displays virtual space only, then immersion is improved, but user ability to interact with real world decreases

Engineering Contradiction:
Improvevirtual space immersionVSAvoidreal world interaction ability
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The touch operation surface serves multiple functions: it operates within the virtual space context when the HMD is worn, and can also be used for real-world interactions. The touchpad interface is versatile enough to handle both virtual object manipulation and external environment control without requiring separate input devices.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS20250165085A1Information processing apparatus for controlling head mounted display apparatus
Publication Date: 2025.05.22 CANON KK
  • US20250165085A1 patent drawing
  • US20250165085A1 patent drawing
  • US20250165085A1 patent drawing

AI summary

An information processing apparatus controls an HMD in accordance with touch operation on a touch operation surface. In calibration of the touch operation, the information processing apparatus controls the HMD such that a first display position, which is a position in an image displayed by the HMD, is identifiable, causes a user to perform touch on the touch operation surface while being conscious of the first display position, acquires information on a first touch position that is a position at which the touch is performed, controls the HMD such that a second display position that has a predetermined positional relation with the first display position is identifiable, causes the user to perform touch on the touch operation surface while being conscious of the second display position, and acquires information on a second touch position that is a position at which the touch is performed.