Line Memory Image Converter for Real-Time Vehicle Obstacle Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing systems for vehicle-mounted systems face delays in processing due to high bus load and inefficiencies in data transfer, limiting real-time capabilities and flexibility in generating multiple conversion results from a single input image.

Innovation Solution

An image converting device with an image input device, an image converter, and a line memory that uses conversion specifiers to manage data transmission and processing, allowing for flexible conversion and output of multiple images without saving all input data in a storage medium, utilizing triangle patches for efficient image transformation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If image data is saved in storage medium via bus for conversion, then image conversion can be performed, but bus load increases and processing time increases

Engineering Contradiction:
Improveimage conversion capabilityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent applies preliminary action by providing a line memory that preliminarily stores image data in a buffer before conversion. This allows the image data to be readily available for immediate conversion without requiring retrieval from storage medium, thereby reducing processing time while maintaining conversion capability.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary element (line memory) between the image pickup device and the conversion processing unit. This line memory acts as a buffer that decouples the data transfer from storage medium access, reducing bus load and enabling faster conversion by providing direct access to image data.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If small-volume buffer is provided between image-pickup device and converting device, then processing time is shortened and bus load is reduced, but flexible conversions cannot be carried out

Engineering Contradiction:
Improveprocessing speedVSAvoidconversion flexibility
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent applies universality by designing the line memory with sufficient capacity to support multiple conversion operations simultaneously. The line memory can store multiple frames of image data and support various conversion types (distortion correction, viewpoint transformation, etc.), enabling both high-speed processing and flexible conversions.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent applies dynamics by enabling the converting device to dynamically select and switch between different conversion operations based on the stored image data in the line memory. The system can adaptively perform different conversion types without requiring additional buffer memory, maintaining flexibility while utilizing the buffer efficiently.

Inventive Principle:
Principle #15Dynamics

3Adaptability or versatility

If multiple conversions are performed from one input image, then various transform images are obtained, but processing time increases

Engineering Contradiction:
Improvemultiple output capabilityVSAvoidconversion processing time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent applies preliminary action by storing multiple frames of image data in the line memory in advance. This allows the converting device to perform multiple different conversions on the same input image data without requiring repeated data retrieval, thereby reducing the time penalty for generating multiple output images.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies continuity of useful action by enabling the converting device to continuously perform multiple conversion operations on image data held in the line memory. Since the data is already in the buffer, the conversion operations can proceed back-to-back without interruption, maintaining high productivity while providing versatile output options.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS10027900B2Image converting device and image converting system
Publication Date: 2018.07.17 RENESAS ELECTRONICS CORP
  • US10027900B2 patent drawing
  • US10027900B2 patent drawing
  • US10027900B2 patent drawing

AI summary

Means which enables image conversion in which a plurality of conversion results can be output without once saving all of video-image data, which has been input from image-pickup means, in a storage medium is provided. A single line memory having a plurality of lines is used while switching the role thereof for a reading use by a video-image converting means and a use for inputting image data from the image-pickup means. The image converting means obtains an input image, which is in the line memory, and carries out conversion of the input image based on a conversion specifying means interpreted by an instruction decoder.