Camera System Simulation With Optical Filtering for HILS Evaluation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current Hardware In the Loop Simulators (HILS) cannot accurately input real video images to evaluation objects, such as camera systems, leading to incorrect video recognition and vehicle control due to the lack of timing signal feedback from the camera control ECU, resulting in inadequate evaluation of camera systems in simulated environments.

Innovation Solution

An evaluation apparatus that includes a video generation unit for simulating outside view video images, an optical filter unit for performing optical image processing to simulate camera output, and a camera image processing unit for generating vehicle control signals using the processed video images, allowing for proper evaluation of camera systems in HILS environments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a HILS is constructed using CG video images without optical processing, then the system complexity is reduced and ease of operation is improved, but the evaluation precision of the camera system deteriorates because the video images do not reflect actual camera output characteristics

Engineering Contradiction:
Improveevaluation precisionVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

An optical processing unit is introduced as an intermediary component between the CG video image generation unit and the camera system under evaluation. This unit applies optical processing (distortion, lightness, noise) to the CG video images to simulate actual camera output characteristics, thereby improving evaluation precision without requiring changes to the camera system itself

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The invention creates a virtual copy of the camera's optical characteristics by applying distortion processing, lightness processing, and noise processing to CG video images. This copying approach allows the evaluation system to replicate real camera behavior without using actual camera hardware, maintaining system simplicity while improving evaluation accuracy

Inventive Principle:
Principle #26Copying

2Reliability

If real video images are input to the evaluation object, then the evaluation realism is improved, but the system becomes inapplicable to simulated environments where real video input is impossible

Engineering Contradiction:
Improveevaluation realismVSAvoidenvironment adaptability
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The invention transforms the parameters of CG video images by applying optical processing functions (distortion coefficients, lightness adjustments, noise levels) to match the characteristics of real camera output. This allows virtual images to be adapted for use in HILS environments while maintaining evaluation realism

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The evaluation system is designed to universally handle both CG video images and processed video images through the same evaluation object. The optical processing unit enables the system to adapt to different input types and environments, making the evaluation system versatile for both simulated and potential real-world applications

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of operation

If the simulator inputs video images without timing signal feedback from the camera control ECU, then the ease of operation is improved, but the camera system cannot correctly recognize video images or control the vehicle

Engineering Contradiction:
Improveoperation simplicityVSAvoidvideo recognition accuracy
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The invention implements a feedback mechanism where the camera control ECU outputs timing signals that are fed back to control the optical processing unit. This ensures that optical processing is applied at the correct timing to match when the evaluation object actually demands video images, thereby ensuring reliable video recognition while maintaining ease of operation

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs preliminary optical processing on CG video images based on timing signals from the camera control ECU before the evaluation object requests the images. This preliminary action ensures that the images are ready and properly processed when needed, preventing recognition errors while keeping the system easy to operate

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12106455B2Autonomous vehicle system testing simulator
Publication Date: 2024.10.01 ASTEMO LTD
  • US12106455B2 patent drawing
  • US12106455B2 patent drawing
  • US12106455B2 patent drawing

AI summary

To provide evaluation by using a virtual video image generated by performing an optical image processing for lightness and distortion required by an evaluation object. An evaluation apparatus for a camera system including a camera for capturing a video image of outside view includes: a video generation unit for generating a simulation video image simulating the video image of outside view captured by the camera; an optical filter unit which performs an optical image processing on the simulation video image in order to simulate the video image outputted from the camera; and a camera image processing unit which generates a vehicle control signal by performing a recognition processing by using the processed video image.