Information Processing System for Real Space User Action Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies fail to appropriately detect evaluation actions performed by users in real space, particularly in augmented reality environments, where users interact with objects through pointing gestures or utterances.

Innovation Solution

An information processing system that includes a processing unit to detect pointing actions and evaluation actions based on sensor signals, updating object evaluation information accordingly, utilizing a combination of gesture recognition and speech recognition to specify target objects and assess user feedback.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional marker detection technology is used, then object identification is achieved, but evaluation actions by users in real space cannot be detected

Engineering Contradiction:
Improvedetection accuracy of user actionsVSAvoidcapability to detect evaluation actions
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The sensor system is designed to perform multiple functions: detecting pointing actions to identify objects, detecting evaluation actions to assess user feedback, and tracking user interactions throughout the process. This multi-functional approach allows a single detection system to handle both object identification and evaluation detection, resolving the contradiction between measurement precision and adaptability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system continuously monitors sensor signals to detect both pointing actions (for object identification) and evaluation actions (for feedback collection). By implementing feedback mechanisms that process detection results in real-time and update evaluation information accordingly, the system achieves both accurate measurement and versatile detection capabilities simultaneously.

Inventive Principle:
Principle #23Feedback

2Extent of automation

If sensor-based detection is implemented, then real space actions can be detected, but the system complexity increases

Engineering Contradiction:
Improveautomatic detection of user actionsVSAvoidsystem configuration complexity
Core Design Contradiction:
Extent of automationVSDevice complexity

Solution Approach 1:

The sensor system automatically detects and processes user actions without requiring manual configuration or intervention. The processing unit autonomously analyzes sensor signals to identify pointing actions, evaluation actions, and update evaluation information, reducing the need for complex manual system setup and operation while maintaining high automation levels.

Inventive Principle:
Principle #25Self-service

3Reliability

If evaluation information is continuously updated, then accurate user feedback is recorded, but processing time and computational load increase

Engineering Contradiction:
Improveaccuracy of evaluation informationVSAvoidprocessing time for updates
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system updates evaluation information periodically based on detected evaluation actions rather than continuously processing every sensor signal. The processing unit monitors for specific evaluation actions and updates evaluation information at appropriate intervals, maintaining accurate feedback recording while reducing unnecessary processing time and computational load.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS11386584B2Information processing system and information processing method
Publication Date: 2022.07.12 SONY GROUP CORP
  • US11386584B2 patent drawing
  • US11386584B2 patent drawing
  • US11386584B2 patent drawing

AI summary

An information processing system includes a processing unit that detects a pointing action for a first user in a real space to specify a first object and an evaluation action on the first object by the first user based on a signal output from a sensor that senses actions in the real space and updates evaluation information of the first object specified by a detection result of the pointing action based on a detection result of the evaluation action.