AR Overlay of External Device Status on Camera Preview

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current technologies do not effectively provide the operation state of external devices using augmented reality, limiting users' ability to easily access information about the operational status of device components.

Innovation Solution

A method and apparatus that display a preview image of a camera, identify external devices, generate indicators for the operation state of these devices, and overlay these indicators onto the relevant areas within the image, utilizing a mobile terminal with a camera, display unit, and controller to provide augmented reality information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If augmented reality technology is used to display operation state information, then information accessibility is improved, but device complexity increases

Engineering Contradiction:
Improveinformation accessibilityVSAvoiddevice complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent uses a mobile terminal as an intermediary device between the external device and the user. The mobile terminal captures images of the external device, processes operation state information, and displays augmented reality overlays showing component status. This intermediary approach allows complex information processing to occur on the mobile terminal rather than requiring the external device itself to have augmented reality capabilities, thus improving information accessibility while limiting the increase in external device complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If operation state information is displayed on preview image, then ease of operation is improved, but information processing complexity increases

Engineering Contradiction:
Improveease of operationVSAvoidinformation processing complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent overlays operation state information as visual indicators on top of the camera preview image, adding an informational dimension to the existing visual display. Instead of requiring users to switch between viewing the device and checking separate status displays, the system superimposes status indicators directly on the image of the external device, showing component operation states at their corresponding physical locations. This dimensional approach improves ease of operation by making information immediately visible while concentrating processing requirements in the mobile terminal's software layer.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Measurement precision

If component information is matched to image area, then measurement precision is improved, but processing time increases

Engineering Contradiction:
Improvecomponent location accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system pre-stores correspondence data between external device components and their locations in the image. When capturing an image of the external device, the mobile terminal retrieves this pre-established mapping information and uses it to quickly place operation state indicators at the correct locations. This preliminary preparation of component-image location mappings allows the system to achieve precise component location accuracy without performing complex real-time image analysis, thus reducing processing time while maintaining measurement precision.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9247142B2Method and apparatus for providing the operation state of an external device
Publication Date: 2016.01.26 LG ELECTRONICS INC
  • US9247142B2 patent drawing
  • US9247142B2 patent drawing
  • US9247142B2 patent drawing

AI summary

The present invention provides a method for providing the operation state of an external device and an apparatus using the method. A method for providing the operation state of an external device according to the present invention comprises displaying a preview image of a camera; identifying an external device displayed on the preview image; generating an indicator corresponding to the operation state of the external device; and displaying the indicator by matching the indicator to an area in the preview image to which a component related to the operation state belongs. According to the present invention, information about the operation state of a component disposed inside of an external device can be checked by making use of augmented reality.