Holographic Video Processing via Multi-Camera Depth Mapping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current technologies face challenges in processing and presenting high-quality holographic videos due to the complexity of creating interactive holograms, high costs of holographic components, and excessive bandwidth consumption, making them impractical for mobile devices.

Innovation Solution

A method and apparatus that capture video frames using multiple cameras, perform segmentation, human body detection, tracking, texturing, and packaging processes to compress and transmit holographic data efficiently, enabling interactive holographic video processing and presentation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional holographic video processing methods are used, then high quality holographic videos can be produced, but the bandwidth consumption is excessive and device complexity is high

Engineering Contradiction:
Improveholographic video qualityVSAvoidbandwidth consumption
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

The patent segments the holographic video processing into distinct modules: capture module, segmentation module, human body detection module, tracking module, texturing module, and packaging module. Each module processes specific aspects of the holographic data independently, allowing for optimized transmission where only essential segmented data is transmitted rather than complete high-quality holographic data, thereby reducing bandwidth consumption while maintaining acceptable video quality

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent creates simplified representations (copies) of the original holographic video data through mesh generation and texturing processes. Instead of transmitting the full high-quality holographic data, the system transmits compressed mesh data and texture maps that can be reconstructed on the receiving end, significantly reducing bandwidth consumption while preserving the essential visual information

Inventive Principle:
Principle #26Copying

2Adaptability or versatility

If interactive holographic features are implemented, then user engagement is improved, but the device complexity and programming difficulty increase

Engineering Contradiction:
Improveinteractive capabilityVSAvoidprogramming complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements self-service mechanisms where the system automatically performs human body detection, pose estimation, and tracking without requiring complex pre-programming for each interaction scenario. The automated detection and tracking algorithms enable interactive holographic features to emerge from the processing pipeline itself, reducing the need for extensive programming while maintaining adaptability to user actions

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent creates a universal processing framework that handles multiple interaction scenarios through a single integrated system. The human body detection and tracking modules serve multiple functions including pose estimation, gesture recognition, and interaction triggering, allowing the system to adapt to various interactive scenarios without requiring separate programming for each case, thereby reducing overall device complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Reliability

If high resolution holographic components are used, then video quality is improved, but the cost increases

Engineering Contradiction:
Improvevideo qualityVSAvoidimplementation cost
Core Design Contradiction:
ReliabilityVSEase of manufacture

Solution Approach 1:

The patent extracts only the essential visual information from high-resolution holographic data through the packaging and compression process. By separating the critical mesh structure and texture data from the full high-resolution holographic stream, the system can use lower-cost components for capture and transmission while maintaining acceptable video quality through intelligent data selection and compression algorithms

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS11399141B2Processing holographic videos
Publication Date: 2022.07.26 BEIJING DAJIA INTERNET INFORMATION TECH CO LTD
  • US11399141B2 patent drawing
  • US11399141B2 patent drawing
  • US11399141B2 patent drawing

AI summary

An example holographic video recording system comprises: a first group of cameras positioned at a first position, a second group of cameras positioned at a second position, and a third group of cameras including a third infrared camera. The first group of cameras includes a first infrared camera and a first color camera; the second group of cameras includes a second infrared camera and a second color camera; and the third group of cameras includes a third infrared camera spatially positioned between the first and second infrared cameras. A depth map may be calculated using the first infrared camera and the second infrared camera in accordance with determining that an object is beyond a predefined distance from the holographic video recording system; or the first infrared camera and the third infrared camera in accordance with determining that the object is within the predefined distance from the holographic video recording system.