In-Vehicle Image Integrity Checking via Superimposed Reference Patterns

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In in-vehicle camera systems, image information transmitted from the initial-stage image processing IC may be altered before reaching the subsequent-stage image processing IC, leading to potential erroneous recognition, necessitating a method to determine the state of the transmitted image information.

Innovation Solution

An image processing device that includes an acquisition unit for capturing images, a superimposition unit for generating a superimposition image by overlaying patterns on unused areas of the captured image, and a determination unit that assesses the image state based on the characteristics of these overlays, allowing for identification of abnormalities such as image sticking, video masking, tone changes, or noise superimposition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If image information is transmitted from initial-stage image processing IC to subsequent-stage image processing IC, then recognition processing can be performed, but image information may be changed during transmission leading to erroneous recognition

Engineering Contradiction:
Improverecognition accuracyVSAvoidimage information integrity
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The patent applies preliminary action by superimposing a reference pattern on the captured image at the initial-stage image processing IC before transmission. This reference pattern serves as a pre-prepared marker that allows the subsequent-stage IC to verify image integrity upon receipt, enabling detection of any changes that occurred during transmission without affecting the primary recognition processing.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses a reference pattern as an intermediary element that is superimposed on the image data. This reference pattern acts as a mediator between the initial-stage and subsequent-stage image processing ICs, carrying verification information that enables the receiving IC to detect transmission alterations without directly interfering with the image recognition function.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If determination of image state is implemented to detect abnormalities, then recognition accuracy can be improved, but device complexity increases due to additional processing requirements

Engineering Contradiction:
Improverecognition accuracyVSAvoidimage processing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies partial action by performing determination processing only on specific portions of the image - namely the reference pattern areas - rather than analyzing the entire image data. This selective approach allows for effective image state verification while minimizing the additional processing load and complexity introduced by the determination function.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent segments the image processing into distinct functional areas: the reference pattern regions for verification purposes and the remaining image areas for primary recognition processing. This segmentation allows the determination unit to focus only on specific portions of the image data, reducing overall processing complexity while maintaining reliability.

Inventive Principle:
Principle #1Segmentation

3Reliability

If superimposition of images is performed on unused areas, then image state determination becomes possible without affecting primary processing, but processing time increases

Engineering Contradiction:
Improveimage state determination accuracyVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The reference pattern is superimposed on the captured image at the initial-stage IC before transmission to the subsequent-stage IC. This preliminary action allows the determination processing to occur in parallel with the primary image processing pipeline, as the reference pattern is already present when the image data arrives at the subsequent-stage IC, thereby minimizing additional processing time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses a simplified copy of verification information (the reference pattern) that is superimposed on the image. This reference pattern is a relatively simple structure compared to full image analysis, allowing for rapid determination processing that minimizes time loss while still providing effective verification of image integrity.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS12125167B2Image processing device, image processing method, and image processing system
Publication Date: 2024.10.22 SONY SEMICON SOLUTIONS CORP
  • US12125167B2 patent drawing
  • US12125167B2 patent drawing
  • US12125167B2 patent drawing

AI summary

An information processing device includes: an acquisition unit that acquires a captured image; a superimposition unit that generates a superimposition image in which images are superimposed on unused areas of the captured image; and a determination unit that determines a state of the captured image on the basis of characteristics of areas on which the images are superimposed in the superimposition image transmitted from the superimposition unit.