AR Image Interaction via Proximity Detection in HMD Video

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing video processing technologies fail to effectively generate and manage interactions between images associated with specific objects as their positions or directions change, leading to potential collisions or contacts between different images.

Innovation Solution

A video processing device and method that employs an AR image generator using an optically transmissive HMD, an imaging element, and a proximity acquirer to calculate interactions between AR images associated with markers, allowing the AR image generator to change the images based on acquired proximity, thereby producing interactive stereoscopic video.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If images are generated in association with specific objects, then the video content becomes more interactive and engaging, but the complexity of managing image interactions and positions increases

Engineering Contradiction:

Improveimage interaction capabilityVSAvoidimage management complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system calculates proximity between AR images and determines interactions based on this proximity information, creating a feedback loop where the spatial relationship between images directly influences their behavior and appearance in the video output

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The proximity acquirer acts as an intermediary component that computes the spatial relationship between AR images, enabling the interaction producer to determine appropriate interactions without directly calculating complex interaction scenarios

Inventive Principle:

Principle #24Intermediary (Mediator)

2Ease of manufacture

If AR images are dynamically adjusted based on proximity, then the visual experience is enhanced, but the processing time and computational resources increase

Engineering Contradiction:

Improvevisual experience qualityVSAvoidprocessing time

Core Design Contradiction:

Ease of manufactureVSLoss of time

Solution Approach 1:

The proximity acquirer continuously acquires proximity information between AR images in advance, so that when interaction is needed, the spatial relationship data is already ready for immediate use in determining image interactions

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system adjusts AR image attributes (such as position, size, or appearance) only when proximity-based interactions are detected, rather than continuously modifying all images, thereby reducing unnecessary processing overhead

Inventive Principle:

Principle #16Partial or excessive action

Data Source

PatentUS9639989B2Video processing device, video processing method, and video processing system

Publication Date: 2017.05.02 SONY INTERACTIVE ENTERTAINMENT LLC

AI summary

An AR image generator 526 employs, as a marker, a subject imaged by an imaging element that images the subject existing in a region including the field of view of a user who wears an optically transmissive HMD and is provided for the optically transmissive HMD, and generates an AR image to be presented by the optically transmissive HMD. A proximity acquirer 560 acquires the distance in a virtual three-dimensional space between a first AR image associated with a first marker and a second marker or a second AR image associated with the second marker. An interaction producer 570 calculates an interaction caused with the first AR image or the second AR image based on the distance acquired by the proximity acquirer 560. The AR image generator 526 changes at least either one image of the first AR image or the second AR image according to the interaction calculated by the interaction producer 570.