Method and apparatus for providing the operation state of an external device
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies fail to effectively provide the operation state of external devices using augmented reality, limiting users' ability to easily access information about the operational status of device components.
Innovation Solution
A method and apparatus that utilize augmented reality to display the operation state of external devices by combining component-specific information with preview images, allowing users to check the status through a mobile terminal, which identifies and displays indicators corresponding to the operation state of components within the device.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If augmented reality is used to display operation state information, then information accessibility is improved, but device complexity increases
Solution Approach 1:
The patent introduces a mobile terminal as an intermediary device between the external device and the user. The mobile terminal captures images of the external device, processes them to generate augmented reality preview images with operation state information, and displays them. This intermediary approach allows complex information processing to be offloaded from the external device to the mobile terminal, resolving the contradiction between information accessibility and device complexity.
Solution Approach 2:
The patent creates a virtual copy of the external device's operation state by generating augmented reality preview images that overlay information on captured images. Instead of modifying the external device itself, the system creates informational copies through image processing and displays them on the mobile terminal screen, enabling information access without increasing the external device's complexity.
2Loss of information
If component-specific information is displayed in preview images, then user understanding is improved, but information processing complexity increases
Solution Approach 1:
The patent segments the information display by identifying and extracting specific components from the external device in the captured image. The system divides the preview image into multiple regions, each corresponding to a specific component, and selectively overlays operation state information only on the relevant component regions. This segmentation approach improves user understanding of specific components while minimizing unnecessary information processing.
Solution Approach 2:
The patent applies local quality by displaying different types of information at different locations in the preview image. Each component's operation state information is displayed locally on or near the corresponding component in the image, rather than presenting a uniform information layout. This allows users to quickly understand specific component states by looking at relevant areas, reducing the cognitive load of processing overall information.
3Loss of information
If visual indicators are overlaid on preview images, then information visibility is improved, but image processing time increases
Solution Approach 1:
The patent applies partial action by selectively overlaying information only on the regions of the preview image that contain external devices or their components. Instead of processing and overlaying information on the entire image, the system identifies relevant regions and applies augmentation only there. This reduces the overall image processing time while maintaining information visibility where it is most needed.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The present invention provides a method for providing the operation state of an external device and an apparatus using the method. A method for providing the operation state of an external device according to the present invention comprises displaying a preview image of a camera; identifying an external device displayed on the preview image; generating an indicator corresponding to the operation state of the external device; and displaying the indicator by matching the indicator to an area in the preview image to which a component related to the operation state belongs. According to the present invention, information about the operation state of a component disposed inside of an external device can be checked by making use of augmented reality.