Augmented Reality Body Gestures for State Storage and Restoration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality (AR) systems lack efficient methods for users to store and restore AR applications without closing them, leading to loss of execution states and inconvenient user interactions, especially when hands are obstructed or gestures are not accurately detected.

Innovation Solution

An AR system that utilizes sensors on the user's body, particularly on the fingers, to detect positions and postures, allowing users to store and restore AR applications by gestures on their body parts, such as the back or waist, without needing to close the applications.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If users close AR applications to store them, then memory resources are freed, but execution states are lost and user convenience deteriorates

Engineering Contradiction:
Improvememory resourcesVSAvoiduser convenience
Core Design Contradiction:
Quantity of substanceVSEase of operation

Solution Approach 1:

The patent introduces a body part (such as the back or waist) as an intermediary storage location. When users perform gestures on this body part, the system stores AR application execution states associated with that body part, allowing users to retrieve applications without closing them, thus resolving the contradiction between memory management and user convenience

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system enables users to self-manage AR application storage through gestures on their own body parts. The gesture recognition system automatically associates and stores execution states without requiring manual intervention or closing the applications, making the memory management process self-service oriented

Inventive Principle:
Principle #25Self-service

2Ease of operation

If users use hand gestures to control AR applications, then operation convenience is improved, but accuracy deteriorates when hands are obstructed

Engineering Contradiction:
Improveoperation convenienceVSAvoidgesture detection accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent segments the body into multiple detectable parts (hands, arms, torso, head) and assigns different control functions to each. By allowing gestures on any body part, the system ensures that obstruction of one area (e.g., hand) does not prevent operation, maintaining both convenience and accuracy through distributed input options

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The gesture recognition system is designed to universally accept input from any body part, not just hands. This multi-functional approach ensures that users can operate AR applications accurately regardless of hand position or obstruction, as any body part can serve as the input interface

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of operation

If AR applications are displayed continuously, then user convenience is improved, but device complexity increases for managing execution states

Engineering Contradiction:
Improveuser convenienceVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system applies different quality levels of state management to different body parts. Instead of uniformly managing all body parts, it selectively associates execution states with specific body parts (such as back or waist) where gestures are detected, simplifying the overall system architecture while maintaining continuous display convenience

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS12380655B2Information processing device, information processing method, and augmented reality system
Publication Date: 2025.08.05 SONY GROUP CORP
  • US12380655B2 patent drawing
  • US12380655B2 patent drawing
  • US12380655B2 patent drawing

AI summary

Provided is an information processing device that processes information regarding augmented reality.The information processing device includes an acquisition unit configured to acquire a position and a posture, or a shape of a first part on a body of a user, and a control unit configured to control a virtual object to be displayed in a real space on a display device on the basis of the position and the posture, or the shape of the first part. When recognizing that the first part has performed a first operation for a second part on the body of the user on the basis of the position and the posture, or the shape of the first part acquired by the acquisition unit, the control unit stores an execution state of the virtual object in association with the second part, and stops display of the virtual object by the display device.