Under-Display Sensor Guidance Using Pixel Control and Darkened Regions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Display devices with front-facing sensors, such as smartphones, face interference issues due to the presence of the front display, leading to problems in processes like face detection and lack of user feedback during authentication and detection.
Innovation Solution
A method and display device that includes an illumination source, sensor, and imaging unit within the housing, behind the display unit, generating display control signals to control pixel functionality, providing user-related and process-related information without noticeable disturbance, using darkened areas to cover sensors and cameras during illumination, measuring, and recording.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If a front display is present in the display device, then the display area is increased and user interface is improved, but sensor measurement accuracy deteriorates due to interference from the display
Solution Approach 1:
The display area is segmented into active display regions and sensor regions. The sensor region is specifically designated for sensor placement where display functionality is reduced or eliminated, allowing sensors to operate without display interference while maintaining overall display area for user interface purposes.
Solution Approach 2:
Different regions of the display have different qualities: the sensor region has reduced or no display output to minimize interference with sensor measurements, while other regions maintain full display functionality. This local differentiation allows both display area and measurement precision to be optimized in their respective zones.
2Device complexity
If sensors are placed on the front side behind the display, then device integration is improved, but user awareness of sensor operation deteriorates
Solution Approach 1:
The system provides visual feedback to the user through the display when sensors are actively operating. The display shows icons, animations, or visual indicators that correspond to sensor activity, ensuring users are aware of what the sensors are detecting and what actions are being performed, thus compensating for the hidden placement of sensors.
Solution Approach 2:
The display acts as an intermediary between the hidden sensors and the user. It translates sensor operations and detected information into visual representations that users can understand, maintaining the benefits of integrated sensor placement while ensuring user awareness through visual mediation.
3Shape
If the camera position is hidden from user view, then device aesthetics are improved, but face detection accuracy deteriorates
Solution Approach 1:
The display provides visual feedback indicating camera position and face detection status. Users are guided on where to position their faces for optimal detection, and the system shows real-time feedback on detection progress and success, compensating for the hidden camera position while maintaining aesthetic design.
Solution Approach 2:
The display uses color changes and visual indicators to communicate camera status and guide users during face detection. Different colors or visual patterns indicate various states such as camera active, face detected, or adjustment needed, providing intuitive guidance without requiring visible camera components.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Improves user guidance and reduces display artifacts by directing user attention to correct sensor positions, enhancing the user experience and process efficiency through intuitive guidance and feedback.
Implementation Method 1
a projector illuminates a scene through the display
Implementation Method 2
a camera records the reflected light again through the display
Data Source
AI summary
Disclosed herein is a method for controlling a display device including: a) receiving (S1) a process request for executing a process including at least one step executable by the display device; b) determining (S2) user-related and/or process-related information based on the received process request; c) generating (S3) a display control signal based on the user-related and/or process-related information, where the display control signal is suitable for controlling the functioning of at least one pixel of a display unit of the display device; and d) providing (S4) the generated display control signal.