3D Surround View Rendering with Precomputed Lookup Tables

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current 3D surround view systems for automotive applications require powerful graphics processors for real-time ray tracing, which increases costs and power consumption, and are inefficient due to the need for continuous ray-casting operations during image rendering.

Innovation Solution

The system employs a 2D warp hardware accelerator utilizing predetermined viewpoint lookup tables to divide the ray tracing process into offline and real-time operations, storing precomputed mappings for efficient rendering of 3D surround views from multiple viewpoints.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If powerful graphics processors are used for real-time ray tracing, then rendering quality is improved, but cost and power consumption increase

Engineering Contradiction:
Improverendering qualityVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent precomputes and stores ray tracing results in lookup tables during an offline phase, so that during real-time rendering, the system only needs to query precomputed data rather than performing intensive ray tracing calculations. This preliminary action eliminates the need for powerful graphics processors during operation, significantly reducing power consumption while maintaining rendering quality.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates simplified copies of ray tracing results by storing precomputed viewpoint mappings in lookup tables. Instead of performing actual ray tracing operations during real-time rendering, the system uses these precomputed copies to rapidly generate surround view images, maintaining visual quality while avoiding the high computational costs and power consumption of real-time ray tracing.

Inventive Principle:
Principle #26Copying

2Measurement precision

If continuous ray-casting operations are performed during image rendering, then rendering accuracy is improved, but processing efficiency deteriorates

Engineering Contradiction:
Improverendering accuracyVSAvoidprocessing efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent performs ray-casting operations in advance during an offline preprocessing phase, storing the results in lookup tables. During real-time rendering, the system retrieves precomputed mappings instead of performing continuous ray-casting operations. This maintains rendering accuracy by using precomputed geometric relationships while dramatically improving processing efficiency by eliminating repeated calculations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent divides the rendering process into two distinct phases: an offline phase where ray-tracing and geometric computations are performed, and a real-time phase where only simple table lookups and image composition are performed. This segmentation allows computationally intensive operations to be separated from time-sensitive rendering operations, maintaining accuracy while improving efficiency.

Inventive Principle:
Principle #1Segmentation

3Measurement precision

If real-time ray tracing is implemented, then view accuracy is improved, but computational load increases

Engineering Contradiction:
Improveview accuracyVSAvoidcomputational load
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent precomputes viewpoint mappings and stores them in lookup tables during an offline phase, eliminating the need for complex real-time ray tracing computations. During operation, the system achieves accurate views by querying precomputed data, maintaining view accuracy while reducing computational load to simple table lookups and image blending operations.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces lookup tables as an intermediary between the scene geometry and the final rendered image. These tables store precomputed ray-tracing results, acting as a mediator that provides accurate view information without requiring complex computational operations during real-time rendering. This intermediary structure maintains accuracy while dramatically simplifying the computational requirements.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11303806B2Three dimensional rendering for surround view using predetermined viewpoint lookup tables
Publication Date: 2022.04.12 TEXAS INSTRUMENTS INC
  • US11303806B2 patent drawing
  • US11303806B2 patent drawing
  • US11303806B2 patent drawing

AI summary

A method for displaying a surround view on a single display screen is disclosed. A plurality of image frames for a particular time may be received from a corresponding plurality of cameras. A viewpoint warp map corresponding to a predetermined first virtual viewpoint may be selected, wherein the viewpoint warp map defines a source pixel location in the plurality of image frames for each output pixel location in the display screen. The warp map was predetermined offline and stored for later use. An output image is synthesized for the display screen by selecting pixel data for each pixel of the output image from the plurality of image frames in accordance with the viewpoint warp map. The synthesized image is then displayed on a display screen.