Live-Stream Item Display with Multi-Angle 3D Reconstruction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing live stream technologies fail to accurately represent the appearance of recommended items due to environmental and beautification distortions, preventing users from fully understanding the items being displayed.

Innovation Solution

Generate a three-dimensional image of the target item by fusing multiple depth images obtained from different angles, using AI and computer vision techniques to overcome environmental and beautification distortions, ensuring accurate representation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple depth images are fused to generate a three-dimensional image, then the accuracy of item appearance representation is improved, but the processing time and computational complexity increase

Engineering Contradiction:
Improveitem appearance representation accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system pre-generates three-dimensional images from multiple depth images captured at different angles before the live stream begins. This preliminary processing allows the accurate 3D representation to be ready for immediate display during the live stream, resolving the contradiction by performing the computationally intensive fusion operation in advance rather than in real-time during broadcasting.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates a three-dimensional copy of the physical item by fusing multiple depth images. This digital 3D copy accurately represents the item's appearance and can be displayed from any angle without requiring the physical item to be present, improving representation accuracy while reducing the need for complex real-time processing during the live stream.

Inventive Principle:
Principle #26Copying

2Loss of information

If three-dimensional images are generated and displayed, then user understanding of items is enhanced, but the device complexity increases

Engineering Contradiction:
Improveitem detail understandingVSAvoidimage processing system complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The system introduces a three-dimensional image as an intermediary representation between the physical item and the user. This 3D image serves as a mediator that captures all item details accurately while being computationally manageable for display, reducing the complexity of directly processing and displaying complex physical item data in real-time during the live stream.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Loss of information

If depth images are obtained from multiple angles, then the completeness of item representation is improved, but the quantity of data to be processed increases

Engineering Contradiction:
Improveitem appearance completenessVSAvoiddata volume
Core Design Contradiction:
Loss of informationVSQuantity of substance

Solution Approach 1:

The system segments the item representation task by capturing depth images from multiple discrete angles rather than attempting to capture all information simultaneously. Each angle provides specific view information, and the segmentation allows the system to process manageable data portions that can be fused into a complete three-dimensional representation, reducing the overall data processing burden.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS12430782B2Item display method, apparatus, and device, and storage medium
Publication Date: 2025.09.30 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • US12430782B2 patent drawing
  • US12430782B2 patent drawing
  • US12430782B2 patent drawing

AI summary

An item display method includes: displaying a live stream interface, the live stream interface including a live stream image, and the live stream image including a target item; obtaining a plurality of depth images of a target item according to a plurality of two-dimensional images of the target item, display angles of the target item in the plurality of two-dimensional images being different, and the depth images including pixel information and depth information; fusing the plurality of depth images to generate a three-dimensional image of the target item, and displaying the three-dimensional image through the live stream interface.