AR Superimposition via Gaze Detection for User-Friendly Display
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality technologies are limited in their ability to display virtual objects in real space images captured by cameras, requiring complex systems and being inaccessible to general users due to their complexity and limited functionality.
Innovation Solution
An information presentation device and method that includes a control unit for superimposing or projecting information on a reality space image, a line-of-sight detection unit to detect the direction of a person's gaze, and a position determination unit to determine the optimal placement of virtual objects based on detected line-of-sight, allowing for user-friendly augmented reality applications in digital cameras, head mount displays, and projectors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If augmented reality technology is displayed on a display unit for the user wearing the apparatus, then the user experience is improved, but the system complexity increases and general users cannot use it
Solution Approach 1:
The patent enables the augmented reality providing apparatus to display virtual objects not only for the user wearing it but also for persons photographed by the camera. The control unit determines display positions based on line-of-sight detection of photographed persons, allowing the system to serve multiple users simultaneously through the display unit, thus achieving multi-functionality and broader accessibility without requiring each user to have their own apparatus
2Reliability
If CG is continuously superimposed on a person who goes around, then the person can be tracked in real-time, but the system configuration becomes complicated and burdensome for general users
Solution Approach 1:
Instead of continuous tracking, the patent employs periodic action by detecting the line-of-sight of the photographed person at specific intervals (when captured in the image) and determining display positions based on these periodic detections. This approach maintains adequate tracking reliability while significantly reducing system complexity and computational burden compared to continuous tracking
Solution Approach 2:
The system uses the camera's existing imaging function to detect the photographed person's line-of-sight, leveraging resources already available in the apparatus. This self-service approach eliminates the need for additional complex tracking hardware or continuous processing, reducing system complexity while maintaining tracking capability
Data Source
AI summary
A digital camera functioning as an information presentation device is provided with a CG superimposition unit 17 which functions so that a virtual object is superimposed on a real space image captured by an imaging element 3, and is displayed on a display unit 23; a visual line detection unit 12 which detects a visual line of a person included in the real space image captured by the imaging element 3; and a superimposing position determination unit 11 which determines a superimposing position of the virtual object on the basis of the visual line detected by the visual line detection unit 12.