Wearable Display Hand Occlusion Removal via Background Copying
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In glasses-type wearable devices, the user's field of view is restricted by hand gestures during object operations, and typing on virtual keyboards is hindered by the hand obstructing the view of keys.
Innovation Solution
An information processing device with an image acquiring unit, hand detecting unit, background image generating unit, and output image generating unit that acquires and processes field-of-view images to superimpose a background image over the hand's area in the user's view, effectively removing the hand from the field of view.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the user performs hand gestures for object operation in glasses-type wearable devices, then the operation intuitiveness is improved, but the field of view is blocked by the hand
Solution Approach 1:
The system captures the background image that is blocked by the hand and creates a copy of this image. The copied background image is then superimposed over the hand area in the displayed field of view, allowing the user to see through the hand gesture area without losing the underlying background information.
2Ease of operation
If the user types on virtual keyboard, then the text input capability is improved, but the keys are hidden by the typing hand
Solution Approach 1:
The system captures the background image containing the virtual keyboard that is blocked by the typing hand and creates a copy. This copied keyboard image is then superimposed over the hand area, allowing the user to see the keyboard keys while typing without losing visibility of the keys being pressed.
Data Source
AI summary
There is provided an information processing device capable of securing the field of view of the user, the information processing device including: an image acquiring unit configured to acquire a field-of-view image corresponding to a field of view of a user; a hand detecting unit configured to detect a hand of the user from the field-of-view image; a background image generating unit configured to generate a background image of a background which is not visible to the user due to the hand on the basis of the field-of-view image; and an output image generating unit configured to generate a display image in which the background image is superimposed on an area occupied by the hand in the field of view of the user.