Depth Image Capture for Stereoscopic Display Positioning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current stereoscopic display technologies face challenges in capturing and displaying depth images effectively, particularly in determining the photographing direction based on the relative position relationship between a client device and a user-specified display position, which affects the vividness and immersion of the visual experience.

Innovation Solution

A method and apparatus that involve a client device communicating with a server to control an image capture device to capture depth images from a determined photographing direction, extracting the target object image, and displaying it at the specified position, utilizing pre-stored relationships between display positions and photographing directions to reduce data volume and enhance the stereoscopic display effect.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If stereoscopic display technology displays depth images to achieve three-dimensional visual effect, then visual effect quality is improved, but data volume increases

Engineering Contradiction:
Improvevisual effect qualityVSAvoiddata volume
Core Design Contradiction:
Illumination intensityVSQuantity of substance

Solution Approach 1:

The patent segments the complete scene into multiple candidate region images based on different photographing directions. Instead of transmitting all possible view images, only the relevant region corresponding to the user's gaze direction is selected and transmitted, reducing data volume while maintaining visual quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by transmitting high-quality depth image data only for the specific region of interest (determined by user gaze direction) rather than uniformly processing the entire scene. This focuses computational and transmission resources on the locally relevant area.

Inventive Principle:
Principle #3Local quality

2Area of stationary object

If multiple cameras are used to capture depth images from different directions, then photographing coverage is improved, but device complexity increases

Engineering Contradiction:
Improvephotographing coverageVSAvoiddevice complexity
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

The patent pre-stores correspondence relationships between display positions and photographing directions before runtime. When a user specifies a display position, the system quickly retrieves the corresponding photographing direction from pre-computed data, avoiding complex real-time calculations and reducing processing complexity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces a correspondence relationship table as an intermediary between display positions and photographing directions. This intermediary structure simplifies the mapping process by providing direct look-up paths rather than requiring complex geometric calculations during runtime.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Loss of information

If the system processes and transmits complete depth images, then image completeness is improved, but transmission cost increases

Engineering Contradiction:
Improveimage completenessVSAvoidtransmission cost
Core Design Contradiction:
Loss of informationVSLoss of energy

Solution Approach 1:

The patent extracts only the necessary portion of the depth image data corresponding to the user's gaze direction and transmits only that extracted region. This eliminates unnecessary data transmission while ensuring that the complete and relevant information is preserved for the user's viewing needs.

Inventive Principle:
Principle #2Taking out (Extraction)

4Measurement precision

If the photographing direction is determined based on relative position relationship, then positioning precision is improved, but calculation complexity increases

Engineering Contradiction:
Improvepositioning precisionVSAvoidcalculation complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent pre-calculates and stores the correspondence between display positions and photographing directions in a lookup table. During runtime, the system simply retrieves the pre-computed direction data based on the user's specified position, achieving precise positioning without performing complex real-time calculations.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP3599763B1Method and apparatus for controlling image display
Publication Date: 2024.10.16 BEIJING XIAOMI MOBILE SOFTWARE CO LTD
  • EP3599763B1 patent drawingFigure 1~2
  • EP3599763B1 patent drawingFigure 3~4
  • EP3599763B1 patent drawingFigure 5~7

AI summary

A method of controlling image display includes: receiving an image capture instruction from a client device, wherein the image capture instruction includes a photographing direction, and the photographing direction is determined by the client device according to a relative position relationship between a position of the client device and a user-specified display position; controlling an image capture device to perform image capture according to the photographing direction, to obtain a depth image comprising a target object image; extracting the target object image from the depth image; and sending the target object image to the client device such that the client device displays the target object image at the display position.