3D Wearable Rendering for Real-Time Body Occlusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image display methods for adding decorative effects to real-time images struggle with poor fusion between the decorative effects and the original images, often resulting in goofs due to inadequate consideration of the posture and occlusion state of the body parts, especially when adding effects to hands and fingers.

Innovation Solution

An image display method that acquires a real-time image of a target body part and superposes a three-dimensional image of a wearable component onto the body part, rendering the component based on the real-time posture and unoccluded area to create a composite image, thereby improving the fusion of the decorative effect with the original image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional decorative effects are added to real-time images, then the fun of capturing images is increased, but the fusion of decorative effects with original images is poor and goofs occur frequently

Engineering Contradiction:
Improvefun of capturing imagesVSAvoidfusion quality of decorative effects
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent transitions from two-dimensional decorative effects to three-dimensional decorative effects that wrap around body parts. The 3D model is rendered with depth information and wrapped around the target body part in multiple dimensions, allowing the decorative effect to conform to the curvature and shape of the body part, thereby improving fusion quality while maintaining趣味性.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent changes the rendering parameters by introducing depth information and wrapping parameters. The 3D model is rendered with depth maps and wrapped around the body part using parameters such as wrap angle, wrap radius, and segmentation points. These parameter changes enable the decorative effect to adapt to the body part's shape, improving fusion quality.

Inventive Principle:
Principle #35Parameter changes

2Device complexity

If decorative effects are added without considering posture and occlusion state, then the processing complexity is reduced, but the occurrence of goofs increases and user experience deteriorates

Engineering Contradiction:
Improveprocessing complexityVSAvoiduser experience quality
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent performs preliminary actions by detecting the posture and occlusion state of the body part before rendering the 3D model. The system identifies key points, calculates posture angles, and determines occlusion regions in advance. This preliminary analysis allows the rendering process to adapt to the body part's state, improving user experience while managing complexity through structured preprocessing.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies different rendering qualities to different regions of the body part. The 3D model is rendered with higher detail in unoccluded regions and adjusted or hidden in occluded regions. This local quality approach ensures that the decorative effect looks realistic in visible areas while avoiding goofs in occluded areas, thereby improving user experience.

Inventive Principle:
Principle #3Local quality

3Reliability

If the three-dimensional model is rendered based on real-time posture and unoccluded area, then the fusion of decorative effect with original image is improved, but the rendering complexity and processing time increase

Engineering Contradiction:
Improvefusion quality of decorative effectVSAvoidrendering complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the body part into multiple regions based on posture and occlusion state. The 3D model is divided into segments corresponding to different body part regions, and each segment is rendered independently with appropriate depth and wrapping parameters. This segmentation reduces rendering complexity by breaking down the complex rendering task into manageable parts while maintaining high fusion quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies partial rendering by only rendering the portions of the 3D model that are visible in the unoccluded area. Occluded portions are either not rendered or rendered with reduced detail. This partial action approach reduces rendering complexity and processing time while maintaining high fusion quality in the visible regions.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS20240054719A1Image display method and apparatus, device, and medium
Publication Date: 2024.02.15 BEIJING ZITIAO NETWORK TECH CO LTD
  • US20240054719A1 patent drawing
  • US20240054719A1 patent drawing
  • US20240054719A1 patent drawing

AI summary

An image display method, a device, and a medium. The image display method includes acquiring a real-time image of a target body part; and displaying a composite image in real time. The composite image is an image obtained by superposing a target three-dimensional image onto the target body part in the real-time image, the target three-dimensional image is obtained by rendering a wearable component three-dimensional model based on a real-time posture and a real-time unoccluded area of the target body part, and the real-time posture and the real-time unoccluded area are determined based on the real-time image.