Viewpoint Displacement via Operator Movement Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing information processing systems lack high operability in displaying images in three-dimensional virtual spaces, as they do not effectively utilize operator movement for intuitive navigation and control of the viewing perspective.

Innovation Solution

An information processing apparatus and method that includes an image generation unit, a detection unit, and a viewpoint displacement unit, which generates a viewpoint image in a three-dimensional virtual space and displaces the virtual viewpoint based on the detected movement of the operator, allowing for intuitive navigation by setting a watch point and displacing the virtual viewpoint accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a traditional keyboard and mouse interface is used for controlling viewpoint in three-dimensional virtual space, then the system structure is simple, but the ease of operation is poor and lacks intuitiveness

Engineering Contradiction:
Improveintuitiveness of viewpoint controlVSAvoidsystem structure complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces the mechanical keyboard and mouse interface with an optical detection system that captures images of the operator's face and body movements. The image processing apparatus detects movement of the operator from captured images and converts these movements into viewpoint displacement commands, eliminating the need for physical input devices and providing more intuitive control.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system uses the operator's own natural movements (head turning, body rotation) as the input mechanism for viewpoint control. Instead of requiring the operator to learn and operate external devices, the system automatically detects and utilizes the operator's inherent movements to control the viewpoint, making the interaction more natural and self-service oriented.

Inventive Principle:
Principle #25Self-service

2Measurement precision

If face parameters are detected using image sensors, then the measurement precision of operator movement is improved, but the device complexity increases

Engineering Contradiction:
Improveaccuracy of operator movement detectionVSAvoiddetection system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent employs a multi-functional detection approach where a single image processing apparatus performs multiple tasks: capturing images, detecting face parameters (head posture, watch direction, eye closure, expression), detecting body movements, and generating viewpoint control signals. This consolidation of multiple detection functions into one system achieves high measurement precision while managing device complexity through functional integration.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of operation

If the virtual viewpoint is displaced based on operator movement, then the ease of operation is improved, but the reliability of precise viewpoint control may deteriorate

Engineering Contradiction:
Improvenaturalness of navigationVSAvoidprecision of viewpoint positioning
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system implements feedback by continuously monitoring the operator's movements through image capture and processing. The detected movements are converted into viewpoint displacement commands that are applied in real-time, creating a closed-loop control system. This continuous feedback mechanism ensures that the viewpoint control remains both natural (easy to operate) and precise (reliable), as the system constantly adjusts based on the operator's actual movements.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS9342925B2Information processing apparatus, information processing method, and program
Publication Date: 2016.05.17 SONY GROUP CORP
  • US9342925B2 patent drawing
  • US9342925B2 patent drawing
  • US9342925B2 patent drawing

AI summary

An information processing apparatus includes an image generation unit configured to generate a viewpoint image in a case where a watch point set in a three-dimensional virtual space is viewed from a predetermined virtual viewpoint, a detection unit configured to detect a movement of an operator, and a viewpoint displacement unit configured to displace the virtual viewpoint with the set watch point as a reference on the basis of the detected movement of the operator.