Camera Posture Tracking for Stable AR Effect Positioning

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing augmented reality (AR) technologies struggle with maintaining an accurate positional relationship between real and AR objects, leading to viewer discomfort due to positional deviations of applied effects.

Innovation Solution

An information processing method that extracts segments from a video corresponding to a label associated with an effect and adjusts the application position of the effect based on camera posture changes, utilizing acceleration data to maintain alignment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If an effect is applied to a video segment using AR technology, then the visual appeal and engagement are improved, but the positional accuracy of the effect relative to the real object deteriorates due to camera posture changes

Engineering Contradiction:

Improveeffect applicationVSAvoidapplication position accuracy

Core Design Contradiction:

Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The system continuously detects camera posture changes using acceleration data and uses this feedback to adjust the effect application position in real-time, ensuring the effect remains accurately positioned on the target segment despite camera movement

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The patent replaces mechanical tracking systems with sensor-based detection (acceleration sensors) to detect camera posture changes, and uses computational methods to calculate and apply position adjustments, substituting physical mechanical solutions with sensing and computing approaches

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If the effect application position is adjusted according to camera posture changes, then the positional accuracy is improved, but the system complexity increases due to additional sensing and calculation requirements

Engineering Contradiction:

Improveapplication position accuracyVSAvoidsystem complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The acceleration sensor serves multiple functions: it detects camera posture changes, provides data for position calculation, and enables real-time adjustment of effect positioning, allowing a single component to perform multiple tasks and reducing overall system complexity

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses the device's own built-in acceleration sensor to detect its posture changes, eliminating the need for external tracking cameras or additional specialized sensors, as the device serves itself for detection purposes

Inventive Principle:

Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Ensures accurate and seamless integration of AR effects by maintaining the application position relative to the detected segments, reducing viewer discomfort and enhancing the viewing experience.

Implementation Method 1

a posture of the camera is detected by utilization of information including acceleration data

Methodology Applied

Scientific EffectAcceleration data detection: Accelerometer

Data Source

PatentUS12394110B2Method, device and medium where an effect applied to a segment of a video is changed according to posture detected by a camera

Publication Date: 2025.08.19 SONY SEMICON SOLUTIONS CORP

AI summary

The information processing method includes segment extraction processing and adjustment processing. In the segment extraction processing, a segment corresponding to a label associated with an effect is extracted from a video of a camera (20). In the adjustment processing, an application position of the effect is adjusted according to a change in a posture of the camera (20), which posture is detected by utilization of information including acceleration data, in such a manner that the application position of the effect is not deviated from the extracted segment.