Virtual Masking via 3D Parametric Modeling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems face challenges in identifying and tracking content within images, especially when items move between frames in videos, making it difficult to apply virtual masks effectively.
Innovation Solution
A method and system that use a three-dimensional rigid parametric model to track the pose of an item in images, allowing for the generation and placement of a virtual mask that moves coincidentally with the item, using a 3D face tracker and alpha blending to create a composite image.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional pixel-based image processing is used to identify and track content, then the system can process images at the lowest level, but it becomes very difficult to identify content within the image and track items that move between frames
Solution Approach 1:
The patent transitions from 2D pixel-based processing to 3D parametric modeling. By representing objects in three-dimensional space with parametric models (such as 3D face models with pose parameters), the system can track objects across frames by matching 3D parameters rather than searching through 2D pixel patterns, significantly improving tracking accuracy and reducing complexity.
Solution Approach 2:
The patent uses parametric models where objects are defined by a set of parameters (position, orientation, scale, and other physical characteristics). Instead of comparing entire images or large image regions, the system tracks changes in these parameters between frames, making content identification and tracking much more efficient and accurate.
2Reliability
If a virtual mask is placed on a static image, then the mask appears correctly positioned, but the mask does not move with the item in subsequent images or video frames
Solution Approach 1:
The patent makes the virtual mask dynamic by linking it to the parametric model of the tracked object. As the object's parameters (position, orientation) change between frames, the mask's parameters are updated accordingly, allowing the mask to move and rotate with the object while maintaining correct positioning and appearance.
3Reliability
If simple block masks are used to cover user faces, then anonymity is achieved, but the appearance is meaningless and less visually appealing
Solution Approach 1:
The patent uses a mask image that copies or replaces the original object's appearance (such as a face) rather than using a generic block. The mask is warped to match the object's geometry and positioned according to tracked parameters, providing both anonymity and visual appeal by maintaining a realistic appearance.
Data Source
AI summary
Disclosed are systems and methods for masking at least a portion of one image with another image. Aspects of the present invention facilitate the placing of a virtual mask onto an item in an image even if that items moves in subsequent images, such as between different image frames in a video.