Face Image Rendering via Eye Sight Line Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing face image processing methods cannot accurately reflect the real state of eyes by fixing rendering effects near the eye position, failing to follow the actual direction of the eyes.

Innovation Solution

A face image processing method that obtains sight line information using a preset recognition algorithm, determines a target area based on this information, and renders a preset effect material to the target area to create a target image that follows the eye's sight line, allowing for dynamic and realistic rendering effects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If rendering effects are fixed near the eye position, then the rendering process is simple, but the rendering effect cannot reflect the real state of the eyes

Engineering Contradiction:
Improveaccuracy of rendering effectVSAvoidcomplexity of rendering process
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent makes the rendering effect dynamic by tracking the eye's sight line direction in real-time. The rendering position is no longer fixed but dynamically adjusted according to where the eye is actually looking, achieved through obtaining sight line information and calculating the intersection point with the image edge.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the parameter of rendering position from a fixed coordinate near the eye to a dynamic coordinate determined by sight line direction. By using the intersection of the sight line with the image edge as the rendering position, the system adapts to different eye states and directions.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If rendering effects follow the eye's sight line, then the visual realism is improved, but the calculation and determination of target area becomes more complex

Engineering Contradiction:
Improvevisual realismVSAvoiddifficulty of determining target area
Core Design Contradiction:
ReliabilityVSDifficulty of detecting and measuring

Solution Approach 1:

The patent uses the eye's own sight line information to determine the rendering position. The sight line, which naturally extends from the eye to the object of focus, automatically provides the direction and position information needed, eliminating the need for complex external measurement systems.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces complex mechanical or manual methods of determining eye direction with an algorithmic approach. By using preset recognition algorithms to obtain sight line information and calculate intersection points, the system achieves accurate tracking without complex hardware.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Manufacturing precision

If the target area is determined based on sight line information, then the rendering accuracy is improved, but the processing time increases

Engineering Contradiction:
Improverendering accuracyVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary actions by obtaining sight line information and determining the target area before actually applying the rendering effect. This ensures that the rendering is applied to the correct position and area, improving accuracy while allowing for optimized processing through pre-calculation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates a simplified representation of the eye's sight line as a geometric entity that can be easily processed. By copying the essential directional information into a mathematical model (line segment with endpoints), the system achieves accurate rendering positioning without complex processing of actual eye anatomy.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11887325B2Face image processing method and apparatus, readable medium, and electronic device
Publication Date: 2024.01.30 DOUYIN VISION CO LTD
  • US11887325B2 patent drawing
  • US11887325B2 patent drawing
  • US11887325B2 patent drawing

AI summary

A face image processing method and apparatus, a readable medium, and an electronic device, relates to the field of image processing technologies. The method includes: obtaining (101) sight line information in a face image to be processed in accordance with a preset recognition algorithm, where the sight line information includes: a first coordinate and an edge coordinate for an eye, and the edge coordinate is used to indicate an intersection of a sight line of an eye and an edge of the face image; determining (102) a target area in the face image according to the sight line information, where the target area includes a sight line segment with the first coordinate and the edge coordinate as endpoints; and rendering (103) a preset effect material to target area to obtain a target image.