Multi-User Manipulation Control via Detection Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing information processing devices struggle to effectively manage and control operations among multiple users performing simultaneous manipulations without dedicated devices, particularly in scenarios where grouping, ordering, or coordinating user interactions are required.

Innovation Solution

An information processing device that acquires detection results from multiple manipulators within a predetermined region and generates attribute information to control operations based on these manipulations, allowing for grouping, ordering, and coordination of user interactions without the need for dedicated devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If multiple users perform manipulations simultaneously without dedicated devices, then ease of operation is improved, but device complexity increases due to the need to manage and control operations among multiple users

Engineering Contradiction:
Improveease of operationVSAvoiddevice complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system segments user interactions by detecting individual manipulators (hands, fingers, or objects) in the detection region and assigning unique identification information to each. This segmentation allows the system to distinguish and track multiple users' manipulations independently, managing complexity through structured identification rather than requiring dedicated devices for each user.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system introduces an intermediary detection region between the users and the information processing device. This detection region captures images of manipulators and serves as a mediator that translates physical manipulations into digital signals with identification information, enabling multiple users to interact simultaneously without direct connection to the device.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If grouping and ordering mechanisms are implemented for multiple users, then reliability of user relation management is improved, but device complexity increases

Engineering Contradiction:
ImprovereliabilityVSAvoiddevice complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by detecting manipulators and assigning identification information before actual manipulation operations occur. It pre-establishes user relations through grouping and ordering mechanisms based on detection results, so that when manipulations happen, the system can reliably control operations according to pre-defined user relationships without complex real-time decision-making.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements feedback mechanisms by continuously monitoring the detection region, tracking manipulator positions and movements, and adjusting user relation management based on detected manipulation patterns. This feedback loop allows the system to dynamically manage multiple users while maintaining reliability through continuous observation and adaptation.

Inventive Principle:
Principle #23Feedback

3Productivity

If detection results from multiple manipulators are processed, then productivity of multi-user interaction is improved, but loss of information increases due to the complexity of managing multiple data streams

Engineering Contradiction:
ImproveproductivityVSAvoidloss of information
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The system segments multiple data streams by assigning unique identification information to each detected manipulator. This segmentation organizes the complex data from multiple users into distinct, trackable entities, preventing information loss through structured data management rather than processing all manipulations as a single undifferentiated stream.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system creates copies of manipulation data with associated identification information for each detected manipulator. Instead of processing original complex data streams directly, it generates simplified copies that retain essential manipulation information while incorporating user identification, making multi-user data management more efficient and less prone to information loss.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS10564712B2Information processing device, information processing method, and program
Publication Date: 2020.02.18 SONY GROUP CORP
  • US10564712B2 patent drawing
  • US10564712B2 patent drawing
  • US10564712B2 patent drawing

AI summary

There is provided an information processing device to set a condition indicating a relation of a plurality of users and control an operation according to a manipulation performed by each user on the basis of the condition, the information processing device including: an acquiring unit configured to acquire a detection result of information related to a manipulator for each of a plurality of manipulators placed in a predetermined region; and a generating unit configured to generate attribute information for controlling an operation based on a manipulation performed by each of the plurality of manipulators on a basis of the detection result.