Object Image Procedure Guidance With Adaptive Overlay Switching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing information processing systems struggle to accurately superimpose procedural steps on object images due to issues with AR markers or feature points being unrecognizable due to camera tilt or light source interference, making it difficult to detect the correct display position for procedural steps.
Innovation Solution
An information processing apparatus that identifies the state of an object image and superimposes specific content when in a detectable state, switching to alternative content display when the object image is not in a detectable state, using a combination of feature point detection and image recognition to determine the appropriate display method.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If AR marker or feature point is used for positioning, then the position for displaying procedural steps can be detected, but the marker or feature point becomes unrecognizable due to camera tilt or light source interference
Solution Approach 1:
The system changes the parameter of content display by switching between tracking display mode and non-tracking display mode based on whether the object state can be identified. When the object state is identifiable, tracking display is used to superimpose content on the object. When unidentifiable, non-tracking display is used to show content at a predetermined position, thus adapting to varying recognition conditions.
2Ease of operation
If tracking display is used to superimpose content on the object, then the content follows the object position, but the system requires accurate object state identification which may not always be achievable
Solution Approach 1:
The system dynamically switches between two display modes based on object state identification results. The display method is not fixed but adapts in real-time: tracking display is activated when object state can be identified, and non-tracking display is activated when it cannot, making the system flexible and robust to varying conditions.
3Reliability
If non-tracking display is used to show content at a predetermined position, then the display is stable and simple, but the content does not follow the object position which reduces guidance effectiveness
Solution Approach 1:
The system uses feedback from object state identification to control the display mode. The identification result serves as feedback that determines whether to use tracking display or non-tracking display, creating a closed-loop control system that optimizes content presentation based on actual object recognition conditions.
Data Source
AI summary
An information processing apparatus includes a processor configured to: acquire an object image that is an image obtained by imaging an object; identify, at each step of a procedure to be performed on the object, whether or not the object image is in a specific state associated with the step; display, in a case where the object image is in the specific state, the object image in such a manner that first content associated with the specific state is superimposed on the object image; and display, in a case where the object image is not in the specific state, second, different content associated with the step.