Display Terminal Object Recognition for Icon-Free App Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Display terminals with small display spaces, such as Head Mounted Displays (HMDs), face challenges in maintaining operability and convenience as the number of icons increases, requiring users to rotate their heads to select desired icons, reducing icon size and external field visibility.
Innovation Solution
A display terminal equipped with a photographing device that analyzes images to identify real objects in the external field, allowing the system to specify and start applications associated with those objects, and optionally acquire applications from a server if not locally stored.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If icons of all applications are displayed in segments around the user, then the number of accessible applications increases, but the icon size decreases and external field visibility is reduced
Solution Approach 1:
The patent extracts the icon selection process from the traditional cylindrical coordinate display and relocates icons to the external field view. Instead of requiring users to rotate their head through segmented displays, the system captures images of real-world objects and overlays relevant application icons directly onto those objects, allowing users to access applications while maintaining natural external field visibility.
Solution Approach 2:
The patent introduces an image processing unit as an intermediary that captures images of real objects in the external field and uses object recognition to determine which application icons to display. This intermediary layer bridges the gap between the physical external field and the virtual icon display, enabling seamless integration without compromising either application accessibility or external field visibility.
2Adaptability or versatility
If more segments are created to accommodate more icons, then more applications become accessible, but the space for each segment decreases
Solution Approach 1:
The patent transitions from a two-dimensional cylindrical coordinate system with segmented icon displays to a three-dimensional spatial mapping approach. By capturing images of real-world objects and overlaying icons in the same visual space, the system creates a new dimension for icon placement that eliminates the need for multiple segmented displays and head rotations.
Solution Approach 2:
The system automatically performs object recognition and icon matching without requiring user intervention for icon selection. The image processing unit captures images, identifies objects, and automatically displays relevant application icons, eliminating the need for users to manually navigate through multiple segments or rotate their heads to find desired applications.
3Adaptability or versatility
If the display shows all application icons, then application selection flexibility increases, but the time required to select an application increases
Solution Approach 1:
The system performs preliminary actions by pre-processing images of real-world objects and pre-identifying relevant application icons before user interaction. The image processing unit continuously captures and analyzes the external field, so when a user looks at a specific object, the corresponding application icons are already prepared and ready for immediate display, eliminating search and navigation time.
Solution Approach 2:
The system implements feedback by continuously monitoring the user's line of sight and the objects in the external field through image capture and object recognition. Based on this feedback, the system dynamically adjusts which application icons are displayed, ensuring that only relevant icons appear in the user's current field of view, thereby reducing selection time while maintaining flexibility.
Data Source
AI summary
Provide is a display terminal having a small display space, in which high operability is realized while convenience is maintained. A display terminal including a photographing device comprises: an image analysis unit configured to analyze an image captured by the photographing device, use region information that is information of a region on the image which corresponds to a real object existing in the external field, and refer to an icon DB so as to specify an icon related to the real object; and an app start unit configured to obtain an application associated with the specified icon from an app DB and start the application.