In-Vehicle Camera Line-of-Sight Conversion Table Update

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing line-of-sight conversion technologies for in-vehicle cameras face challenges in updating conversion tables efficiently, leading to artificially looking images when the camera's mounting position or angle changes, particularly during vehicle maneuvers or deviations.

Innovation Solution

An image generation device and method that includes a correspondence relationship storage unit, image generation unit, deviation sensing unit, mounted state calculation unit, first region updating unit, and second region updating unit, allowing for prompt updating of correspondence relationships in priority and non-priority regions of the line-of-sight-converted image based on new mounting positions and angles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the conversion table is updated in accordance with a new mounting position and a new mounting angle when the mounting position and mounting angle of the camera change, then the line-of-sight-converted image can be restored to a natural-looking state, but the updating process takes a long time due to the large amount of data in the conversion table

Engineering Contradiction:
Improvenatural-looking line-of-sight-converted imageVSAvoidupdating time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The conversion table is divided into multiple regions (first region and second region) based on priority levels. The first region contains pixel correspondence relationships that require prompt updating for natural-looking images, while the second region contains less critical pixel data. This segmentation allows the system to update only the most important regions first, restoring natural appearance quickly without waiting for the entire table to be updated.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts and prioritizes critical pixel correspondence relationships from the conversion table into a first region that requires immediate updating. By separating essential pixel mappings from non-essential ones, the system can apply updates selectively to maintain image quality without processing the entire conversion table, thus reducing update time while preserving visual fidelity.

Inventive Principle:
Principle #2Taking out (Extraction)

2Measurement precision

If the entire conversion table is updated at once, then complete accuracy is achieved, but the processing time is excessively long causing artificial-looking images during the update period

Engineering Contradiction:
Improvepixel correspondence accuracyVSAvoidupdate completion time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

Instead of updating the entire conversion table, the system performs partial updating by focusing on the first region containing critical pixel correspondence relationships. This partial action is sufficient to restore the natural appearance of the line-of-sight-converted image, avoiding the excessive time required for complete table updates while maintaining acceptable accuracy for visual display.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

Different regions of the conversion table are assigned different update priorities based on their importance to image quality. The first region receives immediate updating with high priority to ensure natural-looking images, while the second region is updated later with lower priority. This local differentiation of quality requirements allows the system to achieve sufficient accuracy quickly without waiting for complete updates.

Inventive Principle:
Principle #3Local quality

3Productivity

If a predetermined region is updated first and other regions are updated after a predetermined updating condition is satisfied, then update efficiency is improved, but the system complexity increases

Engineering Contradiction:
Improveupdate speedVSAvoidupdating control logic
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The conversion table is pre-divided into first and second regions before updating begins, with the first region identified as requiring prompt updating. This preliminary organization allows the system to immediately update the critical region without complex real-time decision-making, simplifying the control logic while maintaining high update speed for the most important pixel correspondences.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10166923B2Image generation device and image generation method
Publication Date: 2019.01.01 DENSO CORP
  • US10166923B2 patent drawing
  • US10166923B2 patent drawing
  • US10166923B2 patent drawing

AI summary

An image generation device for referencing a correspondence relationship and generating a line-of-sight-converted image from a captured image of an in-vehicle camera mounted to a vehicle is provided. The image generation device includes a first region updating unit that, upon sensing deviation of at least one of the mounting position and the mounting angle of the in-vehicle camera and calculating a new mounting position and mounting angle, updates a correspondence relationship of a predetermined first region in the line-of-sight-converted image in accordance with the new mounting position and mounting angle, and a second region updating unit that, upon satisfaction of a predetermined updating condition after updating the correspondence relationship of the first region, updates the correspondence relationship for a second region in the line-of-sight-converted image in accordance with the new mounting position and mounting angle.