Image Processing System for Pose-Specific Human Region Effects

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image processing systems require manual intervention to identify the position and pose of humans in images for applying effects, leading to difficulties in achieving natural and pose-specific manipulations in actual-captured images.

Innovation Solution

An image processing system that includes a database of specific pose data and effect manipulation data, with human region detection, pose recognition, and matching mechanisms to automatically apply manipulations based on the recognized pose, ensuring natural and pose-specific effects in images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If manual identification of human position and pose is performed, then flexibility in effect selection is maintained, but productivity and automation level are reduced

Engineering Contradiction:
Improveautomation levelVSAvoidsystem complexity
Core Design Contradiction:
Extent of automationVSDevice complexity

Solution Approach 1:

The patent pre-establishes a database linking pose data with effect manipulation data before image processing occurs. When human pose is recognized, the system automatically queries this pre-prepared database to retrieve appropriate effects, eliminating the need for manual effect selection while maintaining pose-specific appropriateness.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary database as a mediator between pose recognition and effect application. This database stores the correspondence between pose data and effect manipulation data, enabling automatic translation of pose information into appropriate effect selections without direct manual intervention.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If face recognition technique is used for manipulation, then ease of operation is improved, but measurement precision of pose-specific effects deteriorates

Engineering Contradiction:
Improveease of operationVSAvoidpose detection precision
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent segments the human figure into multiple pose indicators (head, torso, limbs) and analyzes their spatial relationships to determine pose. This segmentation allows precise pose detection beyond just face recognition, enabling accurate identification of body orientation and position for appropriate effect application.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from two-dimensional face detection to three-dimensional pose analysis by incorporating spatial relationships between multiple body parts. This dimensional expansion enables the system to understand human pose in space, allowing for more precise and natural effect application that accounts for body orientation and position.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Adaptability or versatility

If simple rule-based manipulation is applied, then device complexity is reduced, but adaptability to different poses and positions deteriorates

Engineering Contradiction:
Improveadaptability to poseVSAvoidprocessing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent changes the parameters for effect application based on recognized pose data. Different poses trigger different effect manipulation parameters, allowing the system to adapt to various human positions and orientations. This parameter adaptation enables versatile effect application while maintaining manageable processing complexity through database-based lookups.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS9020210B2Image processing system, image processing apparatus, image processing method, and program
Publication Date: 2015.04.28 SONY GROUP CORP
  • US9020210B2 patent drawing
  • US9020210B2 patent drawing
  • US9020210B2 patent drawing

AI summary

An image processing system includes a storing section that stores a database in which specific pose data representing each of specific poses of a human, and effect manipulation data specifying each of manipulations applied to an image are registered in association with each other, a human region detecting section that detects a human region that is a region where a human appears in an image on which to perform image processing, a human pose recognizing section that recognizes a pose of the human in the human region detected by the human region detecting section, a matching section that finds the specific pose data matching the pose recognized by the human pose recognizing section, by referencing the database, and a manipulating section that applies a manipulation to the image on the basis of the effect manipulation data associated with the specific pose data found by the matching section.