Multi-pass 3D Rendering for Emoticon Distortion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing three-dimensional models, such as the smiley face emoticon, face distortion and artifacts when rendered directly with facial features and head constrained to a specific geometric shape, like a sphere, leading to unsatisfactory visual representation.

Innovation Solution

Implementing a multi-pass rendering process where each pass is constrained to a specific three-dimensional geometric shape, rendering the sphere itself, then the facial features, and finally a visibility mask to composite the images without distortion, allowing for real-time animated rendering mirroring facial movements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If a three-dimensional model is rendered directly with facial features constrained to a specific geometric shape (e.g., sphere), then the rendering process is simple and fast, but distortion and artifacts occur in the visual representation

Engineering Contradiction:
Improverendering speedVSAvoidvisual accuracy
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The rendering process is divided into multiple passes: first rendering the base geometric shape (sphere), then rendering facial features separately, and finally compositing them together. This segmentation allows each element to be rendered with appropriate constraints, preventing distortion while maintaining rendering efficiency.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The solution moves from direct 3D-to-2D projection to a multi-layer compositing approach, adding a temporal dimension through multiple rendering passes. Each pass operates in the same 3D space but produces separate 2D layers that are combined, effectively adding a composition dimension that resolves the distortion problem.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Stability of the object's composition

If facial features are constrained to match a specific three-dimensional geometric shape, then the model maintains geometric consistency, but visual distortion and artifacts occur

Engineering Contradiction:
Improvegeometric consistencyVSAvoidvisual quality
Core Design Contradiction:
Stability of the object's compositionVSManufacturing precision

Solution Approach 1:

By separating the rendering of the geometric shape from the rendering of facial features, each can maintain its own geometric constraints independently. The sphere maintains its spherical geometry while facial features are rendered with their own anatomical constraints, and the compositing process combines them without mutual distortion.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different parts of the rendering process apply different geometric constraints: the base sphere uses spherical geometry constraints, while facial features use constraints appropriate to their anatomical structures. This local application of appropriate geometric qualities prevents universal distortion across all elements.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11074753B2Multi-pass object rendering using a three- dimensional geometric constraint
Publication Date: 2021.07.27 APPLE INC
  • US11074753B2 patent drawing
  • US11074753B2 patent drawing
  • US11074753B2 patent drawing

AI summary

A device for performing multi-pass object rendering using a three-dimensional geometric constraint may include at least one processor configured to receive a mesh of points corresponding to a head of a user. The at least one processor may be further configured to render an image of a sphere and to render elements corresponding to facial features based at least in part on the mesh of points. The at least one processor may be further configured to render an element visibility mask based at least in part on the mesh of points, the element visibility mask being constrained to the surface of the sphere. The at least one processor may be further configured to composite the sphere, the elements, and the element visibility mask to generate an output image. The at least one processor may be further configured to provide the output image for display.