Head Pose Prediction Using Accessory Pose When Face Landmarks Are Obscured
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing head pose prediction systems are hindered by the obscuration of face landmark features due to head accessories, leading to degraded prediction quality, and require cumbersome wearable markers or infrared light emitters for accurate tracking.
Innovation Solution
A system and method that utilize both face landmark features and head accessory poses to enhance head pose prediction accuracy, employing tracking cameras and processors to determine the pose of head accessories in conjunction with face landmark features, even when face features are obscured.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If head accessories are worn to protect or style the user, then user comfort and style are improved, but face landmark features are obscured leading to degraded head pose prediction quality
Solution Approach 1:
The patent introduces head accessory pose detection as an intermediary element that mediates between the obscured face landmarks and the head pose prediction. When face landmarks are obscured by head accessories, the system detects the pose of the head accessory itself and uses it as a substitute reference to infer head pose, thereby maintaining prediction quality without compromising user comfort or style
Solution Approach 2:
The patent segments the face detection task into two independent parts: visible face landmark detection and head accessory pose detection. This segmentation allows the system to process each part separately based on what is visible in the image, combining both sources of information to achieve accurate head pose prediction even when part of the face is obscured
2Measurement precision
If wearable markers or infrared light emitters are used to track head pose accurately, then head pose prediction quality is improved, but device complexity and user convenience deteriorate
Solution Approach 1:
The patent enables the system to serve itself by using existing visual information from standard cameras to detect both face landmarks and head accessory poses. This eliminates the need for additional specialized hardware like wearable markers or infrared light emitters, thereby maintaining high measurement precision while reducing device complexity and improving user convenience
Solution Approach 2:
The patent makes the tracking camera system universal by enabling it to perform multiple functions: detecting face landmarks, detecting head accessory poses, and inferring head pose from either or both sources. This multi-functionality is achieved through software processing rather than requiring separate specialized hardware for each function
Data Source
AI summary
A set of images of a user are captured during a given time period, by employing at least one tracking camera. In each image, at least one face landmark feature of a face of the user is detected, and a position of the at least one face landmark feature is determined. When it is detected in a given image that the user is wearing at least one head accessory, a pose of the at least one head accessory in the given image is determined. A pose of a head of the user in the given image is then determined, based on the position of the at least one face landmark feature detected in the given image and the pose of the at least one head accessory in the given image.