AR Display Menu on Real Object for Unobstructed View
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality (AR) glasses display methods interfere with users' views of real-world objects by overlaying function menus outside the user's current viewing range, affecting operation efficiency and usability.
Innovation Solution
A display method and electronic device that acquire object information within the user's viewing range, determine if a pre-set real object (such as a palm) is within the user's view, and output a function menu on that object, terminating the display when the object leaves the view range, with options to reduce the menu's display area or conceal content based on user interactions and focal points.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the function menu is displayed on a real object within the user's viewing range, then the user can easily access and operate the menu, but the menu may block the user's observation of the real-world object
Solution Approach 1:
The patent applies dynamics by making the menu display state changeable based on user interaction. The menu is dynamically displayed when the user performs a specific gesture (bending and extending finger toward the device) and dynamically hidden when the user performs another gesture or moves the object out of viewing range. This dynamic switching resolves the contradiction by allowing easy access when needed while preventing blocking during normal observation.
Solution Approach 2:
The patent implements periodic action through gesture-based toggling of the menu display. The menu appears periodically when the user performs the activation gesture and disappears when the deactivation gesture is performed or when the object leaves the viewing range. This periodic display pattern allows users to access the menu when needed while maintaining unobstructed view during normal use.
2Object-affected harmful factors
If the function menu is displayed outside the user's current viewing range, then the user's observation of the real-world is not blocked, but the user cannot readily see and operate the menu
Solution Approach 1:
The patent resolves this contradiction by dynamically positioning the menu within the user's viewing range when it is displayed. Through the camera's field of view detection and spatial relationship calculation, the system ensures the menu is rendered in a location that is both within the user's current view and does not completely obscure important real-world objects, achieving a balance between accessibility and observation.
3Ease of operation
If the function menu is continuously displayed, then the user can always access functions, but it interferes with the user's view of desired objects and reduces operation efficiency
Solution Approach 1:
The patent applies periodic action by displaying the menu only when needed rather than continuously. The menu is activated through specific user gestures and deactivated when the gesture is released or when the object moves out of viewing range. This on-demand periodic display improves operation efficiency by eliminating unnecessary visual clutter during normal observation while maintaining quick access capability when the user intends to use functions.
Solution Approach 2:
The patent extracts the menu display function from a continuous state and makes it conditional and separable. The menu is taken out (displayed) only when specific conditions are met (user gesture, object in viewing range) and is otherwise hidden. This extraction approach allows the system to provide menu access functionality without the continuous interference that would reduce operation efficiency.
Data Source
AI summary
A display method and an electronic device are provided to improve operation efficiency and to reduce probability of blocking a user's observation of an object when displaying a function menu. The display method includes: acquiring object information within a viewing range of a user; based on the object information, determining that a first real object is within the viewing range of the user; outputting an image of the function menu of the electronic device to make the user perceive the function menu being displayed on the first real object; and if the it is determined that the first real object leaves the viewing range of the user, terminating outputting the image of the function menu.