Virtual Object Pose Guidance for Motion Capture Calibration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The calibration process in motion capture technology for augmented reality applications can be confusing for users, leading to awkward poses and synchronization issues between user movements and virtual character animations.

Innovation Solution

An image processing apparatus and method that displays a human-figure virtual object in a specific pose to guide the user into taking necessary calibration poses, facilitating accurate joint position estimation and motion capture.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a calibration process is performed to calculate distances between joints for accurate motion capture, then measurement precision is improved, but the user experience deteriorates due to confusing instructions and awkward poses

Engineering Contradiction:
Improvejoint position estimation accuracyVSAvoiduser experience during calibration
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

A virtual character is introduced as an intermediary to mediate between the calibration system and the user. The virtual character visually demonstrates the required calibration poses through its body orientation and posture, serving as a intuitive guide that replaces confusing text or audio instructions. This mediator makes the calibration process more user-friendly while maintaining measurement accuracy.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If the calibration process is performed before motion capture to ensure accurate joint distances, then measurement precision is improved, but time loss increases due to the separate calibration step

Engineering Contradiction:
Improvejoint distance calculation accuracyVSAvoidcalibration process duration
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The calibration process and motion capture process are merged into a unified workflow. The virtual character continuously provides pose guidance throughout the entire process, eliminating the need for a separate, time-consuming calibration phase. Users can perform calibration naturally during normal movement capture, reducing time loss while maintaining precision.

Inventive Principle:
Principle #5Merging (Combining)

3Measurement precision

If the virtual character abruptly changes from reference pose to calibration pose when calibration ends, then measurement precision is achieved, but the visual continuity deteriorates creating an awkward gesture

Engineering Contradiction:
Improvecalibration accuracyVSAvoidvisual continuity of virtual character
Core Design Contradiction:
Measurement precisionVSStability of the object's composition

Solution Approach 1:

The virtual character's pose transitions are made dynamic and continuous rather than abrupt. During calibration, the character maintains a neutral or natural pose. When calibration completes, the character smoothly transitions to motion capture mode through gradual pose changes, maintaining visual continuity and avoiding awkward gestures while ensuring calibration accuracy was achieved.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10685394B2Image processing apparatus, image processing method, and program
Publication Date: 2020.06.16 SONY GROUP CORP
  • US10685394B2 patent drawing
  • US10685394B2 patent drawing
  • US10685394B2 patent drawing

AI summary

Disclosed herein is an image processing apparatus including a display control part configured to display a human-figure virtual object image in a pose from which to extract information necessary for motion capture, the human-figure virtual object image being the object to be handled corresponding to a person targeted to be recognized.