Dual Camera Image Association Using Facial Expression Timing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Portable electronic devices with dual cameras face challenges in capturing composite images or videos that include both the action and the user's reaction simultaneously, as the user's reaction occurs after the action due to non-zero reaction time, resulting in temporal offsets between the images from the front and rear cameras.
Innovation Solution
The device employs a 'bothie' mode that contemporaneously captures images or videos from both cameras, using a processor to analyze facial expressions and associate images based on expression-time information, creating a time window to align action and reaction images, allowing for the generation of composite content that presents both simultaneously.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If images are captured contemporaneously from both cameras, then both action and reaction can be captured, but temporal offsets between images from front and rear cameras occur due to non-zero reaction time
Solution Approach 1:
The system captures a plurality of images from the rear camera over time in advance before the user's reaction occurs. This preliminary capture of multiple frames allows the system to have action images ready that can be associated with the reaction image later, effectively compensating for the reaction time delay.
Solution Approach 2:
The processor acts as an intermediary that associates the reaction image from the front camera with appropriate action images from the rear camera based on temporal relationships. It determines which rear camera image corresponds to the reaction by analyzing the sequence of captured images and their timing, thereby mediating the temporal offset between the two cameras.
2Adaptability or versatility
If multiple images are captured and processed to associate action and reaction, then composite content can be generated, but device complexity increases
Solution Approach 1:
The system automatically performs the association between action and reaction images without requiring manual user input. The processor autonomously analyzes the captured images, determines temporal relationships, and generates the composite content automatically, making the complex process transparent to the user while maintaining high adaptability.
Solution Approach 2:
The system changes the temporal parameter by capturing images over a period of time rather than a single instant. By capturing a sequence of rear camera images and associating them with the front camera image based on timing, the system transforms a complex temporal alignment problem into a manageable parameter-based association task.
Data Source
Figure 1~2
Figure 3
Figure 4~6
AI summary
An apparatus configured to, based on first imagery (301) of at least part of a body of a user (204), and contemporaneously captured second imagery (302) of a scene, the second imagery comprising at least a plurality of images taken over time, and based on expression-time information indicative of when a user expression of the user (204) occurs, provide a time window (303) temporally extending from a first time (t-1) prior to the time (t) of the expression-time information, to a second time (t-5) comprising a time equal to or prior to the first time (t-1), the time window (303) provided to identify at least one expression-causing image (305) from the plurality of images of the second imagery (302) that was captured in said time window, and provide for recordal of the at least one expression-causing image (305) with at least one expression-time image (306) comprising at least one image from the first imagery (301).