Virtual Posture Viewpoint Generation for Fixed Camera Systems

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing posture visualization systems are limited in flexibility, as they require fixed image capture unit orientations, making it difficult for users to assess leaning forward, backward, leftward, or rightward posture while facing forward.

Innovation Solution

An image processing apparatus with a recognition unit, setting unit, generation unit, and display control unit that captures and displays a user's posture from a predetermined viewpoint, allowing for the generation and display of the posture viewed from a different viewpoint, enabling the user to see leaning levels and comparisons with a reference posture.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the image capture unit is fixedly disposed to capture images from a predetermined viewpoint, then the system structure is simple and stable, but the orientation of the posture to be displayed cannot be freely changed, limiting the user's ability to check leaning in various directions

Engineering Contradiction:
Improveviewpoint orientation flexibilityVSAvoidsystem structure complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent creates a virtual copy of the user's posture through image processing and displays it from a different viewpoint. The recognition unit captures the user's posture from a fixed viewpoint, then the generation unit produces a virtual image showing the posture from a selectable orientation (front, back, left, right). This allows viewpoint flexibility without physically moving the image capture unit, resolving the contradiction between adaptability and device complexity.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent transitions from a two-dimensional fixed viewpoint to a multi-dimensional viewpoint system. By processing the captured image data and generating virtual views from different orientations, the system adds the dimension of viewpoint selection without adding physical components. This enables flexible orientation checking while maintaining the simplicity of a fixed image capture unit.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If the image capture unit is positioned to capture posture from a side view, then the user can check forward and backward leaning, but the user cannot simultaneously check left and right leaning while facing forward

Engineering Contradiction:
Improveposture information completenessVSAvoiduser operation convenience
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent makes the display system multi-functional by enabling it to show posture information from multiple orientations simultaneously or selectively. The viewpoint setting unit allows selection among front, back, left, and right viewpoints, and the generation unit produces corresponding virtual images. This ensures complete posture information (all leaning directions) is available while the user maintains a natural forward-facing position, resolving the contradiction between information completeness and operational convenience.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces an intermediary processing system between the fixed image capture unit and the user's view. The recognition unit extracts posture information, the generation unit creates virtual images from different orientations, and the display control unit presents this processed information to the user. This intermediary processing enables complete posture assessment without requiring the user to physically reposition or the camera to move.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If multiple image capture units are positioned at different orientations to enable viewpoint switching, then viewpoint flexibility is improved, but the device complexity and cost increase

Engineering Contradiction:
Improveviewpoint switching capabilityVSAvoidnumber of image capture units
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

Instead of using multiple physical image capture units, the patent creates virtual copies of the posture view from different orientations through image processing. The single captured image is processed by the generation unit to produce multiple virtual viewpoints (front, back, left, right views). This eliminates the need for multiple cameras while achieving the same viewpoint switching capability, resolving the contradiction between adaptability and quantity of components.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical solution of multiple physical cameras with a computational solution. Instead of mechanically positioning multiple image capture units at different locations, the system uses image processing algorithms to generate virtual views from different orientations. This substitution reduces the quantity of hardware components while maintaining or improving viewpoint flexibility.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10657366B2Information processing apparatus, information processing method, and storage medium
Publication Date: 2020.05.19 CANON KK
  • US10657366B2 patent drawing
  • US10657366B2 patent drawing
  • US10657366B2 patent drawing

AI summary

In order to reduce limitations on an arrangement of a posture visualization system as a whole, a posture recognition unit recognizes, based on image data of a real space captured by an image capture unit from a predetermined viewpoint, a posture of an object in the image data of the real space. A posture visualization viewpoint setting unit sets a viewpoint different from the predetermined viewpoint. A posture visualization unit visualizes a mirror image of the posture of the object viewed from the viewpoint set by the posture visualization viewpoint setting unit based on the posture recognized by the posture recognition unit. A space display unit displays the mirror image of the posture of the object generated by the posture visualization unit and a mirror image of the real space at once.