XR Avatar Capture Using Color-Sequence Frames and Monochrome Cameras
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Manually creating avatars in extended reality environments is time-consuming and cumbersome, especially for time-sensitive applications.
Innovation Solution
Utilizing monochromatic cameras for eye-tracking or face-tracking in extended reality devices to capture visible wavelengths, projecting sequences of color components, and generating realistic avatars based on these wavelengths.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If monochromatic cameras are used to capture visible wavelengths for avatar generation, then avatar creation speed is improved, but interference with eye-tracking and face-tracking functionalities may occur
Solution Approach 1:
The patent segments the spectral detection into multiple monochromatic channels, each capturing a specific wavelength range. This segmentation allows the system to capture visible wavelengths for avatar generation while maintaining separate, dedicated channels for eye-tracking and face-tracking, thereby preventing interference between these functionalities
Solution Approach 2:
The monochromatic camera system is designed to perform multiple functions: capturing visible wavelengths for realistic avatar generation, eye-tracking, and face-tracking. By making the camera system multi-functional with dedicated processing pipelines for each function, the system improves avatar creation speed while maintaining reliability of tracking functionalities
2Manufacturing precision
If sequences of color components are projected and captured to generate realistic avatars, then avatar realism is improved, but processing complexity increases
Solution Approach 1:
The patent segments the color capture process into sequential monochromatic frames, where each frame captures a specific color component. This segmentation simplifies the processing by allowing independent analysis of each wavelength range, reducing overall processing complexity while maintaining avatar realism through combination of the segmented color data
Solution Approach 2:
The system uses periodic projection and capture of color component sequences to gather spectral information. This periodic action allows the system to capture all necessary color data over time and then combine it to generate realistic avatars, managing processing complexity by distributing the computational load across multiple time steps
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Facilitates the rapid creation of realistic avatars by capturing and combining images of user characteristics, such as eye and skin colors, without interfering with eye-tracking and face-tracking functionalities.
Implementation Method 1
display, by at least one display of the electronic device, a sequence of frames to a user of the electronic device. The sequence of frames may include a first frame including a first color component, a second frame including a second color component, and a third frame including a third color component
Implementation Method 2
capture, by one or more cameras of the electronic device, a plurality of images of the user while displaying the sequence of frames to the user
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method for generating a realistic avatar of a user by an electronic device is presented. The method includes displaying, by at least one display, a sequence of frames to a user of the electronic device. The sequence of frames includes a first frame including a first color component, a second frame including a second color component, and third frame including a third color component. while displaying the sequence of images to the user, the method includes capturing, by one or more cameras, a plurality of images of the user. The method further includes determining, for each of the plurality of images, a visible wavelength for each of the first color component, the second color component, and the third color component, and generating a realistic avatar of the user based on the visible wavelength for each of the first color component, the second color component, and the third color component.