Rolling Shutter Rendering Engine for Automated Driving Verification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In automated driving systems, using a sensor with a rolling shutter function for image sensing on vehicles results in significant reduction in execution speed due to the need for high time resolution in full-screen drawing to reproduce exposure in units of line blocks, leading to prolonged drawing times.

Innovation Solution

A rendering system that includes an image sensor model with a rolling shutter function and a rendering engine, where the image sensor model controls the rendering engine to draw only the region of the line block being exposed, thereby reducing drawing time by limiting the drawing region to the exposure position.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If full-screen drawing is performed with increased time resolution to reproduce exposure in units of line blocks, then the accuracy of rolling shutter modeling is improved, but the execution speed is significantly reduced and drawing time is prolonged

Engineering Contradiction:
Improverolling shutter modeling accuracyVSAvoiddrawing execution speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The screen is divided into multiple line blocks corresponding to the rolling shutter's exposure regions. Instead of processing the entire screen at once, the rendering system segments the drawing task into smaller regional tasks, where each line block is rendered independently according to its exposure timing. This segmentation maintains modeling accuracy while reducing the computational burden per frame.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs partial drawing actions by rendering only the currently exposed line block region rather than the full screen. This partial action approach processes a subset of the total pixels at each time step, which maintains the accuracy of rolling shutter effects for the active region while significantly reducing overall drawing time through progressive rendering.

Inventive Principle:
Principle #16Partial or excessive action

2Area of stationary object

If full-screen drawing is performed to maintain complete image coverage, then the completeness of image output is ensured, but the drawing time is significantly prolonged

Engineering Contradiction:
Improveimage coverage areaVSAvoiddrawing time
Core Design Contradiction:
Area of stationary objectVSLoss of time

Solution Approach 1:

The system performs preliminary rendering actions on individual line blocks before they become visible in the final image. By pre-rendering line blocks according to their exposure timing and accumulating them progressively, the system ensures complete image coverage is achieved over time without requiring all pixels to be processed simultaneously, thus reducing total drawing time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Instead of rendering the complete screen at full resolution simultaneously, the system performs partial rendering actions on subsets of pixels (line blocks) in sequence. This approach maintains complete image coverage through progressive accumulation while significantly reducing the time required for each rendering step.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS20230101876A1Rendering system and automated driving verification system
Publication Date: 2023.03.30 SONY SEMICON SOLUTIONS CORP
  • US20230101876A1 patent drawing
  • US20230101876A1 patent drawing
  • US20230101876A1 patent drawing

AI summary

The rendering system of the present disclosure includes an image sensor model having a rolling shutter function of performing exposure in units of line blocks using one or a plurality of pixel rows as one line block; and a rendering engine for processing and drawing image data. The image sensor model controls the rendering engine so that only a region of a line block being exposed is drawn.