Multi-Viewpoint Image Display Using Polygonal Models and Interval Images

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current display systems for multi-viewpoint images are inefficient in processing and transmitting data, particularly for live broadcasting and large scenes, and lack user interaction capabilities, resulting in a passive viewing experience for users.

Innovation Solution

A display system and method utilizing a polygonal image model to reduce data throughput, allowing users to freely select viewpoint angles through a user interface, with a processing component generating interval images to bridge the switch between viewpoints, enhancing interactivity and fluency in displaying multi-viewpoint images on common terminal devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If simulation of three-dimensional images is used to change viewpoint angles, then viewpoint flexibility is improved, but calculation complexity increases and image fidelity is lost

Engineering Contradiction:
Improveviewpoint flexibilityVSAvoidcalculation complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent uses pre-captured images from multiple cameras as direct copies of real-world viewpoints, avoiding the need to simulate three-dimensional images through complex calculations. Each camera captures a real viewpoint, and these captured images are directly displayed or combined, eliminating the computational burden of rendering virtual viewpoints while maintaining image fidelity.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent extracts only the necessary viewpoint information by positioning cameras at specific locations around the subject. Instead of calculating all possible viewpoints, the system captures images from a有限 number of fixed camera positions and allows users to select from these pre-captured viewpoints, thereby reducing calculation complexity while maintaining viewpoint flexibility.

Inventive Principle:
Principle #2Taking out (Extraction)

2Adaptability or versatility

If multiple cameras are used to record one object, then viewpoint coverage is improved, but data volume increases and processing complexity increases

Engineering Contradiction:
Improveviewpoint coverageVSAvoiddata volume
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent segments the viewing experience into discrete viewpoint options, where each camera captures a specific viewpoint. Instead of transmitting and processing continuous multi-view data, the system divides the scene into separate viewpoint segments (one per camera) and allows selective display of these segmented viewpoints, reducing the amount of data that needs to be processed and transmitted.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent uses a有限 number of cameras positioned at key viewpoints around the subject, capturing only the essential perspectives needed for multi-viewpoint display. This partial coverage approach provides sufficient viewpoint diversity for most applications without requiring exhaustive coverage from numerous cameras, thereby controlling data volume while maintaining adequate viewpoint coverage.

Inventive Principle:
Principle #16Partial or excessive action

3Manufacturing precision

If post-production processing is used to generate virtual viewing-angle images, then image quality is improved, but processing time increases and live broadcasting capability is lost

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent performs all necessary image capture and basic processing in advance, during the recording phase. Multiple cameras simultaneously capture images from different viewpoints, and these pre-captured images are stored ready for display. When viewing, the system simply retrieves and displays the pre-captured images without requiring real-time processing or generation, enabling live broadcasting capability while maintaining image quality.

Inventive Principle:
Principle #10Preliminary action

4Manufacturing precision

If multi-viewpoint images are transmitted without compression, then image fidelity is improved, but network bandwidth requirement increases and transmission efficiency decreases

Engineering Contradiction:
Improveimage fidelityVSAvoidtransmission efficiency
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent extracts and transmits only the essential image data from each camera viewpoint, using selective display of pre-captured images. By allowing users to select from discrete viewpoint options rather than transmitting continuous multi-view data streams, the system reduces the amount of data that needs to be transmitted while maintaining adequate image fidelity for the selected viewpoints.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS9485493B2Method and system for displaying multi-viewpoint images and non-transitory computer readable storage medium thereof
Publication Date: 2016.11.01 INSTITUTE FOR INFORMATION INDUSTRY
  • US9485493B2 patent drawing
  • US9485493B2 patent drawing
  • US9485493B2 patent drawing

AI summary

A system for displaying multi-viewpoint images includes a terminal device having a communication component, a user interface (UI) component and a processing component. The communication component receives an image and a polygonal image model for establishing the relationship between each image and a corresponding viewing angle; one of the viewpoint angles is the current viewpoint angle. The UI component generates a UI for presenting the correspondence between the image of the current viewpoint angle and its viewpoint angle; the correspondence is used for selecting a target-viewpoint angle from the viewpoint angles. The processing component generates a switch instruction based on the target-viewpoint angle and allows UI to present an image corresponding to the target-viewpoint angle after UI presents an interval image being an image of an interval viewpoint angle between the current viewpoint angle and the target-viewpoint angle and is generated based on the image of the target-viewpoint angle.