Gaze-Triggered Camera Image Transfer for Obscured Smartphone Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users of smartphones or similar devices face difficulties in capturing images when the display screen is difficult to see, such as when holding the device in front of their face or when their hand obstructs the view, leading to challenges in operating the camera functions effectively.
Innovation Solution
An information processing device equipped with a camera, display screen, line-of-sight sensor, and communication unit that transfers captured images to a separate image display device like a head-mounted display (HMD) when the user's line of sight is not directed at the display, allowing the HMD to display the image and enabling easier operation through extended shutter buttons or image correction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the user holds the smartphone in front of their face to capture images, then the camera can capture images in front of the user's eyes, but the display screen becomes difficult to see
Solution Approach 1:
The patent introduces a separate image display device (such as a head-mounted display or external monitor) as an intermediary to display the captured images. This mediator allows the user to view images without holding the smartphone in a position that blocks the display screen, thus resolving the contradiction between ease of capturing images and visibility of the display
Solution Approach 2:
The patent transfers the image display function from the two-dimensional smartphone screen to a different spatial dimension by using a separate display device (such as a head-mounted display worn on the head or an external monitor). This dimensional change allows simultaneous access to both the camera function and image viewing without mutual obstruction
2Ease of operation
If the user extends their hand to capture images with many people in front, then images can be captured, but the display screen becomes difficult to see
Solution Approach 1:
The separate image display device acts as a mediator that displays captured images independently from the smartphone. This allows the user to extend their hand for capturing images while simultaneously viewing the captured content on the external display, eliminating the visibility problem caused by hand extension
3Loss of information
If the captured image is transferred to a separate display device, then the user can view images when the smartphone display is obscured, but the user may not view images on the smartphone display when that is their intention
Solution Approach 1:
The patent implements dynamic switching between displaying images on the smartphone screen and transferring to a separate display device. The system can adaptively change the display destination based on detected user needs, allowing flexible switching between different viewing modes to match varying user intentions
Solution Approach 2:
The patent uses line-of-sight detection to provide feedback about user viewing behavior. Based on this feedback, the system automatically determines whether to display images on the smartphone or transfer to a separate device, ensuring the display method matches the user's actual viewing intention
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables users to clearly view and easily operate camera functions even when the smartphone's display is obscured, improving usability and reliability in capturing images.
Implementation Method 1
a line-of-sight sensor configured to detect a line of sight of a user and output line-of-sight information indicating a line-of-sight direction of the user
Data Source
AI summary
An information processing device comprises: a camera; a display screen for displaying a captured image; a line-of-sight sensor configured to detect a line of sight of a user and output line-of-sight information; a communication unit configured to provide communication with an image display device that is separate from the information processing device; and a processor, wherein the processor is configured to: determine whether a line-of-sight destination of the user is in the display screen based on the line-of-sight information while the camera is capturing an image; upon determining that the line-of-sight destination of the user is not in the display screen, transfer the captured image being displayed on the display screen to the image display device via the communication unit; and transmit, to the image display device, a display start signal for causing the image display device to display the captured image as transferred.