Re-projection Module for Multiple-View Displays

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current 3D video technologies, such as stereography, lenticular displays, and parallax barriers, require significant processing power, time, and storage to render multiple viewpoints, leading to slow rendering times and undesirable results.

Innovation Solution

A system and method for creating multiple novel views using a re-projection module that receives a computer-generated image with depth information, generates alternate images by calculating disparity and distortion maps, and applies custom adaptive sharpening filters to enhance high-frequency components, allowing for rapid creation of 3D scenes and views for auto-stereographic and multiple view displays.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If current re-projection techniques are used to create multiple views, then 3D images can be generated, but the rendering process is slow and requires hundreds of hours per frame

Engineering Contradiction:
Improverendering speedVSAvoidrendering time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent pre-calculates and stores depth maps, disparity maps, and distortion maps before actual rendering. These pre-computed data structures enable rapid view synthesis without re-rendering geometry, reducing rendering time from hundreds of hours to minutes per frame.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Instead of rendering geometry from scratch for each view, the patent copies and transforms pixel data from a reference view using pre-computed disparity and distortion maps. This copying approach with transformation significantly accelerates the rendering process while maintaining image quality.

Inventive Principle:
Principle #26Copying

2Adaptability or versatility

If multiple views are provided for lenticular displays or parallax barriers, then different viewpoints can be achieved, but processing power and storage costs increase significantly

Engineering Contradiction:
Improveviewpoint varietyVSAvoidprocessing power
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The patent creates a universal set of pre-computed maps (depth, disparity, distortion) that can be used to generate any number of views from a single reference image. This multi-functional approach allows the same data structures to support multiple viewpoint generation, reducing processing power requirements compared to rendering each view independently.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent varies viewing parameters (viewpoint position, camera angle) by transforming the pre-computed maps rather than re-rendering geometry. This parameter-based approach enables efficient generation of multiple views with different viewpoints while minimizing processing power consumption.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If current re-projection techniques are used, then alternate views can be created, but the results are undesirable due to artifacts and quality issues

Engineering Contradiction:
Improveview generation capabilityVSAvoidimage quality
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent applies view-dependent sharpening filters that adapt to local image characteristics. The sharpening strength and parameters are adjusted based on the specific region being synthesized, preserving high-frequency details in important areas while avoiding artifacts in others, thereby improving overall image quality.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent replaces traditional geometry-based rendering with a texture-mapping approach using pre-computed disparity and distortion maps. This substitution eliminates many rendering artifacts while maintaining the ability to generate multiple views, significantly improving image quality without sacrificing view generation capability.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10931927B2Method and system for re-projection for multiple-view displays
Publication Date: 2021.02.23 SONY GROUP CORP
  • US10931927B2 patent drawing
  • US10931927B2 patent drawing
  • US10931927B2 patent drawing

AI summary

Systems and methods are provided that allow for the rapid creation of multiple novel views for applications. These multiple views may allow for not only stereo views but also for different viewpoints of a stereographic scene to be presented, or for a time progression of the stereo scene to be presented, where a viewpoint is altered with respect to time. The systems and methods may be employed to create the content for auto-stereographic displays or multiple view systems that use a plurality of novel views to display stereo media. Such displays or multiple view systems may include those employing parallax barriers or lenticular lenses.