Eyesight Display Video Watermarking With rPPG Heart Rate Authentication
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing techniques for sharing data between devices lack accuracy and security, particularly in discrete data sharing functionalities.
Innovation Solution
Embedding information within a video displayed via a head-mounted device (HMD) using remote photoplethysmography (rPPG) to extract a user's heart rate, which is used for authentication and secure data transfer between devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is shared between devices using existing techniques, then data transfer is enabled, but accuracy and security are insufficient
Solution Approach 1:
The patent replaces traditional mechanical or manual authentication methods with a physiological-based authentication system using remote photoplethysmography (rPPG). The system captures video of the user's face and extracts heart rate information through optical detection of blood volume changes, substituting physical contact-based authentication (like fingerprint sensors) with non-contact optical measurement. This achieves higher security while maintaining user convenience.
Solution Approach 2:
The patent introduces an intermediary authentication mechanism that uses heart rate data as a mediator between the user and the data sharing process. Instead of direct device-to-device authentication, the system uses the user's physiological state (heart rate) captured via rPPG as an intermediary verification layer. This intermediary layer enhances security by confirming the user's identity and state without requiring complex cryptographic handshakes or manual verification.
2Measurement precision
If heart rate-based authentication is implemented, then user verification accuracy is enhanced, but system complexity increases
Solution Approach 1:
The patent replaces complex cryptographic verification systems with a simpler physiological measurement approach. Instead of implementing multi-factor authentication with multiple apps and devices, the system uses a single camera to capture facial video and extract heart rate through rPPG algorithms. This substitution achieves high verification accuracy using standard consumer-grade hardware and software processing, avoiding the need for specialized authentication hardware.
Solution Approach 2:
The system enables self-service authentication by automatically capturing the user's heart rate through the camera during normal video interaction. The rPPG algorithm continuously monitors blood volume changes in the facial region and extracts heart rate without requiring the user to perform any special actions or use separate authentication devices. This self-service approach maintains high accuracy while minimizing user burden and system complexity.
3Adaptability or versatility
If information is embedded in video displayed on HMD, then discrete data sharing is enabled, but data extraction accuracy must be maintained
Solution Approach 1:
The patent embeds data in the video stream by modulating it with periodic heart rate variations detected through rPPG. The system captures the user's natural heart rate rhythm and uses these periodic physiological signals as a carrier wave to encode information. This periodic action ensures that the embedded data maintains a consistent frequency pattern that can be reliably extracted by the receiving device, even in the presence of noise or compression artifacts.
Solution Approach 2:
The system creates an optical copy of the authentication data by embedding it in the visual video stream rather than transmitting it through separate communication channels. The embedded information is visually encoded into the video frames displayed on the HMD, allowing the receiving device to capture and decode the data through standard camera and image processing operations. This copying approach maintains data integrity while enabling versatile sharing across different device types.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables secure and accurate data transfer by using heart rate-based authentication, enhancing user verification and device-to-device communication.
Implementation Method 1
determining the heartrate may involve using remote photoplethysmography (rPPG) to extract an average intensity over a displayed portion of the user's face
Data Source
AI summary
Various implementations disclosed herein include devices, systems, and methods that embed information in video presented on an outward display of a wearable device. For example, a process may include generating a video signal depicting a current appearance of a face portion. Changes in an attribute of the face portion in the video signal over time may correspond to a current heart rate of a user wearing the wearable electronic device. The process may further include embedding data into the video signal by altering the attribute of the face portion in the video signal over time such that the changes in the attribute of the face portion in the video signal over time correspond to both the current heart rate and the data. The process may further include presenting the video signal depicting the current appearance of the face portion on an outward-facing display of the wearable electronic device.