AR Anchor Display Method Using Bezel Feature Matching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users working outside offices face limitations in utilizing multi-display functions due to the impracticality of carrying desktop displays, which hinders efficient processing and visualization of virtual information in augmented reality applications.
Innovation Solution
An augmented reality system and anchor display method that uses a head-mounted device to detect the position and depth of a display's bezel through feature matching, allowing virtual objects to be accurately anchored to the bezel, thereby enhancing the user experience and providing the convenience of multi-display functionality without the need for a physical desktop.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a desktop display is connected to a notebook computer to provide multi-display function, then the user can improve work efficiency, but the user cannot carry the desktop display all the time when working outside the office
Solution Approach 1:
The patent creates a virtual copy of the desktop display experience by projecting virtual images onto the notebook's screen bezel area. Instead of physically carrying a second display, the system captures images of the bezel and renders virtual display content that appears anchored to the bezel, providing multi-display functionality through virtual rather than physical means.
2Reliability
If virtual objects are displayed without accurate positioning, then the display is simple, but the virtual objects cannot be stably anchored to the screen bezel
Solution Approach 1:
The system performs preliminary actions by capturing images of the screen bezel in advance and pre-processing these images to establish reference coordinate systems and depth information. This pre-positioning data is stored and used to accurately anchor virtual objects to the bezel, ensuring stable positioning without complex real-time calculations during operation.
Solution Approach 2:
The patent replaces complex mechanical positioning systems with image processing and computational methods. Instead of using physical markers or complex hardware alignment mechanisms, the system uses image capture, feature matching, and depth estimation algorithms to achieve accurate and stable virtual object anchoring to the bezel.
3Measurement precision
If feature matching is performed between environmental image and display image, then the position information of screen bezel can be obtained, but the processing time and computational resources increase
Solution Approach 1:
The system extracts and focuses only on the relevant portion of the environmental image - specifically the screen bezel area - for feature matching. By isolating the bezel region rather than processing the entire environmental image, the system maintains high position accuracy while significantly reducing computational time and resource requirements.
Data Source
AI summary
An augmented reality system and an anchor display method thereof are provided. An environmental image is captured by an image capturing device disposed on a head-mounted device. A reference image block in the environmental image that matches a display image on a display is detected by performing feature matching between the environmental image and the display image. Position information of the reference image block in the environmental image is obtained. Depth information of the display is obtained according to an actual screen size of the display and a block size of the reference image block in the environmental image. At least one virtual object is displayed by the head-mounted device according to the position information and the depth information. The at least one virtual object is displayed as being anchored to at least one screen bezel of the display.