AR Operation Guidance for Undetected Device Portions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing information processing systems lack effective methods to generate and display operation description images for specific portions of devices, such as image forming apparatuses, especially when the target portion is not initially detected within captured images, leading to incomplete or inaccurate operation guidance.
Innovation Solution
An information processing apparatus equipped with an image capturing unit, display, and controller that captures images of a real space, generates operation description images using augmented reality techniques, and stores these images for display, allowing for sequential instruction and correction of operations on specific device portions, including manual feed trays, even when they are out of the camera's view.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the system waits for real-time detection of the specific portion in captured images before displaying operation guidance, then the guidance is contextually accurate, but the operation completion time increases when the target is out of view
Solution Approach 1:
The system stores operation description images in advance before the user needs them. When the specific portion is first detected, the controller prepares and stores the corresponding operation guidance images, so that when the portion becomes undetectable, the guidance can be displayed immediately from storage without waiting for re-detection.
2Reliability
If the system continuously monitors and recaptures images to maintain target detection, then the guidance remains updated, but the ease of operation decreases due to complex interaction requirements
Solution Approach 1:
The system automatically manages the operation guidance display without requiring continuous user intervention. Once the initial detection is made and guidance is provided, the system autonomously handles the display of stored guidance images when the target is out of view, eliminating the need for users to manually recapture or reposition the device.
3Measurement precision
If the system requires continuous visibility of the target portion for operation description, then the guidance remains contextually relevant, but the adaptability decreases when users need to perform operations away from the camera view
Solution Approach 1:
The system transitions from a real-time visual coupling dimension to a temporal storage dimension. By storing operation description images and retrieving them based on detection history rather than continuous visual input, the system decouples the guidance display from the camera's current field of view, enabling users to perform operations anywhere in space.
Data Source
AI summary
An information processing apparatus includes an image capturing unit, a display, and a controller. The image capturing unit is configured to capture images of a real space. The display is configured to display the images. If an image of a specific portion of a target an operation of which is to be described is included in the images captured by the image capturing unit, the controller generate operation description images by adding an image for instructing the operation to the captured images and controls the display to sequentially display the generated operation description images. When generating the operation description images, the controller stores a part of the generated operation description images. If the specific portion cannot be detected from the images captured by the image capturing unit before description on the operation of the specific portion is completed, the controller displays the stored operation description images on the display.