Portable Device Augmented Reality via Image Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current augmented reality systems face registration problems due to sensor misalignment and complexity, making them non-portable and unsuitable for consumer applications.

Innovation Solution

A portable device with a display screen, image capture capability, and wireless networking that uses image recognition logic to analyze bar codes and overlay product information onto the real-world scene, providing enhanced shopping experiences without the need for special purpose equipment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If multiple sensors are used in augmented reality systems to capture real-world scenes, then the system can provide rich visual information, but registration problems occur due to different sensor speeds causing misalignment between computer graphics and real-world scene

Engineering Contradiction:
Improvevisual information completenessVSAvoidregistration accuracy
Core Design Contradiction:
Loss of informationVSMeasurement precision

Solution Approach 1:

A camera serves as an intermediary device to capture the real-world scene, replacing multiple sensors with a single imaging device. The camera captures complete visual information in one shot, eliminating the registration problems that arise from multiple sensors operating at different speeds. The captured image becomes the common reference frame for all subsequent processing.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

Multiple sensor functions are merged into a single camera system. Instead of using separate sensors for different measurements that require synchronization, the patent combines all visual capture functions into one camera that records the entire scene simultaneously, ensuring all visual information is captured without registration issues.

Inventive Principle:
Principle #5Merging (Combining)

2Measurement precision

If head tracking systems and cameras are used together in augmented reality systems, then spatial alignment can be achieved, but delays in merging computer graphics with real-world scene cause misalignment and user discomfort

Engineering Contradiction:
Improvespatial alignment accuracyVSAvoidprocessing delay
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The camera captures the complete real-world scene in advance before any processing occurs. By pre-capturing the entire scene as a single image or video frame, the system eliminates the need for continuous synchronization and merging operations that cause delays. The pre-captured image serves as the fixed reference for all augmented reality operations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent extracts the scene capture function from the complex head tracking system and assigns it to a dedicated camera. This separation removes the camera from the real-time processing chain, eliminating the delays that occur when the camera must continuously synchronize with the head tracking system. The camera operates independently, capturing scenes without being constrained by processing delays.

Inventive Principle:
Principle #2Taking out (Extraction)

3Adaptability or versatility

If complex augmented reality systems with multiple sensors and processing components are implemented, then enhanced reality features can be provided, but the systems become non-portable and unsuitable for consumer applications

Engineering Contradiction:
Improveaugmented reality functionalityVSAvoidsystem portability
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The camera serves multiple functions: capturing the real-world scene, providing reference images for augmented reality overlay, and enabling portable operation. By making the camera a universal component that performs all scene capture needs, the system eliminates the need for multiple specialized sensors and processing units, thereby reducing overall system complexity while maintaining augmented reality functionality.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10099147B2Using a portable device to interface with a video game rendered on a main display
Publication Date: 2018.10.16 SONY INTERACTIVE ENTERTAINMENT LLC
  • US10099147B2 patent drawing
  • US10099147B2 patent drawing
  • US10099147B2 patent drawing

AI summary

A method for interfacing with a video game is provided, including: rendering display data on a main display, the display data defining a scene rendered by the video game, the display data being configured to include a visual cue; capturing the display data by an image capture device incorporated into a portable device; analyzing the captured display data to identify the visual cue; in response to identification of the visual cue, determining additional information that is in addition to the scene of the video game that is displayed on the main display, the additional information defining graphics or text to be added to the scene of the video game; presenting the additional information on a personal display incorporated into the portable device, the presentation of the additional information being synchronized to the rendering of the display data on the main display.