Robot Attention Eye Display for 3D Target Localization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional robot technologies struggle to accurately convey the target of attention in a three-dimensional real space, leading to ambiguity and hindrances in communication due to incompatibility between the displayed virtual space and the user's outer appearance, making it difficult for third parties to intuitively grasp the robot's focus.
Innovation Solution
A display system that includes a processor to determine the target of attention and generate an eye image displaying an image related to the target, which is overlain and displayed on a display device, allowing adjustments in transparency, location, and size, and can combine movement of the eye and background to convey attention effectively.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If a two-dimensional eye image is displayed on a display unit to show the robot's attention direction, then the robot can convey attention information, but the target of attention becomes ambiguous in three-dimensional real space
Solution Approach 1:
The patent transitions from two-dimensional eye image display to three-dimensional virtual space projection. The eye image is overlaid on a three-dimensional model of the robot's face, and the target of attention is projected onto three-dimensional objects in the real environment. This dimensional transformation allows the attention information to be conveyed with spatial accuracy, resolving the ambiguity of two-dimensional representation in three-dimensional space.
2Loss of information
If the virtual space is displayed on the front display of a head mounted display, then the user's attention location can be shown, but there is incompatibility between the displayed virtual space and the user's outer appearance
Solution Approach 1:
The patent merges the virtual eye image with the user's actual outer appearance by overlaying the eye image on a three-dimensional model that matches the user's facial features. This integration ensures that the displayed attention information is compatible with the user's physical appearance, eliminating the incompatibility issue while maintaining accurate attention location representation.
3Quantity of substance
If many objects exist in the real three-dimensional space, then the environment is complex and informative, but the user is prone to mistaking the target of attention
Solution Approach 1:
The patent applies local quality by projecting the eye image and target of attention information specifically onto the region where the robot's eye is located, rather than dispersing information across the entire three-dimensional space. This localized projection ensures that attention information is concentrated at the relevant position, making it easier to identify the correct target even when many objects are present in the environment.
Data Source
AI summary
A display system includes a target of attention determination portion that determines a target of attention; and an image generator that generates an eye image which displays an image related to a target of attention that is overlain and displayed in an eye or on the eye, and causes the eye image to be displayed on a display device. The image generator causes the eye image, which is a video of a changing target of attention that is overlain and displayed in the eye or on the eye according to determination results of the target of attention, to be displayed on the display device.