Augmented Reality Apparatus Context Identification Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Incorporating video footage into the live view of a hand-held device camera is challenging due to limited processing power and lack of functional codebase in built-in frameworks, making it difficult to provide an enhanced augmented reality experience.

Innovation Solution

An apparatus and method for a hand-held device with a camera that includes a context identification unit, virtual image retrieval unit, and virtual image positioning unit to display a virtual image, which can be a moving real-world image, previously stored as a sequence of still images or continuous video, synchronized with audio, allowing for augmented reality by identifying and positioning the image based on contextual information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If video footage is incorporated into the live camera view to provide augmented reality, then the user experience is enhanced, but the processing power requirements exceed the capabilities of most hand held devices

Engineering Contradiction:
Improveaugmented reality experienceVSAvoidprocessing power
Core Design Contradiction:
Adaptability or versatilityVSPower

Solution Approach 1:

The system segments the augmented reality processing into distinct functional units: context identification unit for analyzing the live view, virtual image retrieval unit for selecting appropriate images, and virtual image positioning unit for placing images in the correct locations. This segmentation allows each unit to perform its specific function efficiently within the constraints of handheld device processing power.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary actions by pre-identifying contexts and pre-positioning virtual images based on context information from the live view. The context identification unit analyzes the current scene in advance, and the virtual image positioning unit pre-calculates positioning parameters, reducing the computational burden during real-time display and maintaining smooth performance on devices with limited processing power.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If multiple functional units are added to enable context identification and virtual image processing, then augmented reality capability is improved, but device complexity increases

Engineering Contradiction:
Improveaugmented reality capabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The hand held device is designed with multi-functional units that perform multiple tasks. The context identification unit not only identifies contexts but also provides information to both the virtual image retrieval unit and positioning unit. The display unit integrates both the live camera view and virtual images. This multi-functionality reduces the need for separate dedicated components for each function, thereby managing device complexity while maintaining comprehensive augmented reality capability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Manufacturing precision

If virtual images are positioned and sized according to context information, then the realism of augmented reality is improved, but the processing requirements for image analysis increase

Engineering Contradiction:
Improveimage positioning precisionVSAvoidprocessing power
Core Design Contradiction:
Manufacturing precisionVSPower

Solution Approach 1:

The system applies partial action by focusing context identification and image positioning efforts on the most relevant virtual images and key contextual elements. Rather than analyzing and positioning all possible virtual images with equal detail, the system prioritizes those that most significantly enhance the augmented reality experience, achieving sufficient positioning precision for the most important elements while conserving processing power for devices with limited capabilities.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11361542B2Augmented reality apparatus and method
Publication Date: 2022.06.14 2MEE
  • US11361542B2 patent drawing
  • US11361542B2 patent drawing
  • US11361542B2 patent drawing

AI summary

An augmented reality experience is provided to a user of a hand held device, such as a mobile phone, which incorporates an electronic processor, a camera and a display. Images taken from video footage are displayed in a display of a hand held device together with a live camera view, to create the illusion that the subject of the video—i.e., the virtual moving image—is present in the field of view of the camera in real time. In this context the term “real world” image means an image taken from reality, such as a physical, real-world scenario using an electronic photo-capture technique, e.g. video recording. A camera of a hand held device is aimed at a well-known object, which is recognisable to the device. A moving virtual image of an actor playing the part of an historical figure, chosen because of its relevance to the object, is displayed.