3D Gesture Interface for Detailed Facility Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional user interfaces fail to provide detailed information about objects in an image in response to simple user operations, limiting the clarity of visual recognition.

Innovation Solution

An information processing apparatus and method that utilizes a controller to transmit information about a target facility specified in a video captured by a user device, based on user gestures, to an output device within a predetermined range, using a three-dimensional space analysis to enhance detail display.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If conventional user interfaces manipulate image objects by zooming in and out, then the user can view the image at different scales, but the details of various objects contained in the image are not clearly shown

Engineering Contradiction:
Improvedetail informationVSAvoidoperation complexity
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent transitions from two-dimensional image manipulation (zooming) to three-dimensional spatial interaction. The system captures the user's physical position and movement in 3D space, and uses this spatial information to control the display of detailed information about objects in the image, creating a new dimension of interaction that provides details without requiring complex zoom operations

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent introduces an intermediary system that captures the user's physical gestures and spatial movements, processes this information, and translates it into appropriate information display actions. This intermediary layer (the information processing apparatus) mediates between the user's simple physical movements and the complex task of displaying detailed object information, making the interaction easier while maintaining information completeness

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If the system provides detailed information about objects in the image, then the user gains better visual recognition, but the system complexity increases

Engineering Contradiction:
Improveobject detail informationVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The information processing apparatus performs multiple functions using a unified approach: it captures the user's physical state, processes spatial information, identifies objects in the image, and displays detailed information. This multi-functional design avoids the need for separate complex subsystems for each function, reducing overall system complexity while still providing comprehensive object details

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system automatically processes the user's physical movements and spatial position without requiring explicit commands. The information processing apparatus self-adjusts the displayed information based on the user's natural movements, eliminating the need for complex user interface controls and reducing the operational complexity of the system

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS20250383718A1Information processing apparatus, information processing method, and non-transitory storage media
Publication Date: 2025.12.18 TOYOTA JIDOSHA KK
  • US20250383718A1 patent drawing
  • US20250383718A1 patent drawing
  • US20250383718A1 patent drawing

AI summary

A controller transmits, based on a command by a gesture of a user acquired via a user device, information about a target facility specified in a video captured by the user device, to the user device, or an output device existing in a predetermined range from the position of the user device. The target facility is specified based on the state of the user in the three-dimensional space or the state, in the three-dimensional space, of the user device moving with the user.