Projection Device for Remote Device Selection via Body Form Estimation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users face difficulties in selecting the desired device to operate among multiple devices, particularly with gesture operations or remote controllers, leading to increased burden and time consumption.

Innovation Solution

An information processing apparatus and method that estimates the form of an operation subject to control the display and selection of devices, allowing users to select devices through projected operation objects based on their body form and movements, reducing the need for physical interaction with multiple devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If gesture operation is used to control devices remotely, then the user can operate devices without physical contact, but it becomes difficult to select the desired device among multiple devices

Engineering Contradiction:
Improveremote operation capabilityVSAvoiddevice selection difficulty
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent introduces a projection device as an intermediary between the user and the devices to be operated. The projection device displays operation objects in the air, allowing users to select devices through visual interaction without physical contact. This mediator enables both remote operation and clear device selection by projecting selectable device representations in the user's field of view.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent transitions from traditional 2D display interfaces to 3D spatial projection. Operation objects are projected into the air space around the user, creating a three-dimensional interaction environment. This dimensional change allows users to see and select multiple devices simultaneously in different spatial locations, resolving the selection difficulty while maintaining remote operation capability.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If multiple remote controllers are provided for multiple devices, then each device can be controlled independently, but the user has to find the correct remote controller among many

Engineering Contradiction:
Improvedevice control flexibilityVSAvoidtime to find remote controller
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent creates a universal control interface through the projection device that can display operation objects for multiple different devices. Instead of requiring separate physical remote controllers for each device, the projection system can project operation objects representing any device in the user's field of view, allowing one device to serve multiple functions and eliminating the need to search through multiple controllers.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system performs preliminary action by pre-projecting operation objects for multiple devices before the user needs to select one. The projection device displays available devices in advance, allowing the user to immediately select the desired device without first searching for or retrieving a remote controller, thus saving time while maintaining the ability to control any device.

Inventive Principle:
Principle #10Preliminary action

3Ease of operation

If the user moves to the device to operate it, then direct control is possible, but the user burden increases when multiple devices are present

Engineering Contradiction:
Improvedirect device controlVSAvoiddevice selection burden
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces the mechanical system of physical movement to devices with an optical/projection-based system. Instead of requiring the user to physically go to each device to operate it, the projection device creates visual representations of devices in the air, allowing users to select and control devices remotely through visual interaction, thereby eliminating the movement requirement while reducing selection burden.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10976828B2Information processing apparatus and information processing method to reduce user burden
Publication Date: 2021.04.13 SONY GROUP CORP
  • US10976828B2 patent drawing
  • US10976828B2 patent drawing
  • US10976828B2 patent drawing

AI summary

An information processing apparatus includes a display control unit that controls display of selection objects related to devices to be operated, which have been selected through first device selection based on information from which a form of a body of an operation subject directed to the devices to be operated is estimated and a device control unit that controls the devices to be operated, which have been selected through second device selection based on information related to a selecting operation performed by the operation subject to the selection objects.