A simulation test system and a simulation test method

Through the simulation test system and method, the scene of the ISP chip of the car camera ISP chip is abnormal in the real car test, and solves the problem of low efficiency and difficulty when the image processing function of ISP chips in the real car test. Research and development process.

CN115047787BActive Publication Date: 2025-01-28OMNIVISION INTEGRATED CIRCUITS (CHENGDU) CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202210868862.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-07-22
Publication Date
2025-01-28
Estimated Expiration
2042-07-22

AI Technical Summary

Technical Problem

In the actual vehicle test of ISP chips of on-board cameras, it is difficult to solve the problem efficiently when the image processing function is abnormal, resulting in low testing efficiency and high difficulty.

Method used

Provide a simulation test system and method, through the communication connection of the storage medium, simulation system, and simulation ISP chip, the scene of the abnormal conditions in the reality of the real car test, including preliminary processing modules, storage modules, control modules, cache modules, camera simulation modules And parameter control module.

Benefits of technology

The simulation test system can quickly build and reproduce the problem scenario in the room, reduce the workload and difficulty of ISP chip in the real car test, and improve the research and development efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115047787B_ABST
    Figure CN115047787B_ABST
Patent Text Reader

Abstract

The present invention provides a simulation test system and a simulation test method. The simulation test system includes a storage medium, a simulation system and a simulation ISP chip. The simulation ISP chip and the storage medium are respectively connected to the simulation system in communication. The storage medium is used to provide the simulation system with raw data of abnormal conditions in the actual vehicle test when the actual ISP chip processes the actual vehicle test. The simulation system is used to reproduce the data stream when the abnormal conditions occur in the actual vehicle test when the ISP chip processes the actual vehicle according to the raw data and the camera configuration parameters. The simulation ISP chip is used to provide the camera configuration parameters to the simulation system and process the data stream to reproduce the abnormal conditions. The simulation test system of the present invention is a semi-physical simulation system, which can be built successfully and conveniently, so that the abnormal conditions in the actual vehicle test process can reproduce the problem scene in the field, and can facilitate the debugging and testing of the ISP chip function during analysis, thereby reducing the workload and difficulty of the ISP chip during the actual vehicle test and improving the research and development efficiency.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of testing, and in particular to a simulation testing system and a simulation testing method for real-time image processing. Background Art

[0002] When the ISP (image signal processing) chip is used in a vehicle-mounted camera, it needs to be able to adapt to driving environments under various conditions, such as high and low temperatures, vibrations, places with large light and dark contrasts (such as tunnels), complex road conditions (such as intersections), etc. The algorithm of the ISP chip must ensure that it can work stably for people with different postures and different lane lines under different road conditions, weather, vehicle models, etc.

[0003] At present, when the ISP chip of the vehicle camera is tested on a real vehicle, if an image processing function abnormality occurs and affects the imaging quality of the vehicle camera, the R&D personnel can only be notified to go to the test site to solve the problem. This makes the real vehicle test inefficient and difficult. Summary of the invention

[0004] The purpose of the present invention is to provide a simulation test system and a simulation test method, which can be built and reproduced indoors for problematic scenarios, improve the efficiency of research and development, and reduce the difficulty of on-vehicle testing of ISP chips.

[0005] In order to solve the above problems, the present invention provides a simulation test method, including a storage medium, a simulation system and a simulation ISP chip, wherein the simulation ISP chip and the storage medium are respectively connected to the simulation system for communication;

[0006] The storage medium is used to provide the simulation system with original data of abnormal conditions in the ISP chip processing during the actual vehicle test;

[0007] The simulation system is used to reproduce the data flow when an abnormal condition occurs in the actual ISP chip processing according to the original data and the camera configuration parameters;

[0008] The simulated ISP chip is used to provide the camera configuration parameters to the simulation system and process the data stream to reproduce abnormal conditions.

[0009] Optionally, the simulation system includes a preliminary processing module, a storage module, a control module, a cache module, a camera simulation module and a parameter control module;

[0010] The parameter control module is connected to the preliminary processing module, the storage module, the control module, the cache module and the camera simulation module respectively, and is used to configure operating parameters to the preliminary processing module, the storage module, the control module, the cache module and the camera simulation module respectively;

[0011] The preliminary processing module is connected to the storage medium and the storage module respectively, and is used to call the original data from the storage medium, re-encode the original data to obtain transition data, and finally send the relevant parameters of the original data and the transition data to the storage module;

[0012] The storage module is connected to the control module and is used to store the relevant parameters of the original data and the transition data;

[0013] The control module is connected to the cache module and is used to automatically read the transition data from the storage module according to the relevant parameters of the original data, and send the transition data to the cache module;

[0014] The buffer module is connected to the camera simulation module and is used to store the transition data and configure the transition data outputted by it in real time; and

[0015] The camera simulation module is connected to the simulated ISP chip and is used to automatically read the transition data from the cache module and reproduce the data stream according to the camera configuration parameters and the transition data.

[0016] Furthermore, the cache module includes an error injection module, and the error injection module is used to modify the transition data output by the cache module.

[0017] Furthermore, the camera simulation module includes a monitoring module, and the monitoring module is used to save the camera configuration parameters.

[0018] Optionally, a simulation display device is also included, which is communicatively connected to the simulation ISP chip and is used to display abnormal conditions through images.

[0019] Optionally, the original data includes original image data and original video data.

[0020] Optionally, the simulated ISP chip and the measured ISP chip are the same ISP chip.

[0021] On the other hand, the present invention also provides a simulation test method, comprising the following steps:

[0022] Step S1: establishing a communication connection between a simulation system and a storage medium, wherein the storage medium provides the simulation system with raw data of abnormal conditions occurring during actual vehicle testing in the ISP chip processing;

[0023] Step S2: the simulation system reproduces the data flow when the abnormal situation occurs according to the original data and the camera configuration parameters provided by the simulation ISP chip; and

[0024] Step S3: The simulated ISP chip processes the data stream to reproduce the abnormal condition.

[0025] Optionally, the method for obtaining the raw data of abnormal conditions in the ISP chip processing in the actual vehicle test in step S1 includes:

[0026] The camera collects raw data and provides the raw data to the measured ISP chip, the measured ISP chip processes the raw data to obtain a processed data stream, and sends the data stream to the measured display device, and the measured display device displays an image according to the data stream; and

[0027] When an abnormal situation occurs in the measured ISP chip processing, the camera directly sends the original data to the storage medium, and the storage medium stores the original data.

[0028] Optionally, step S2 includes:

[0029] The preliminary processing module of the simulation system calls the original data from the storage medium, re-encodes the original data to obtain transition data, and then sends the relevant parameters of the original data and the transition data to the storage module of the simulation system;

[0030] The control module of the simulation system automatically reads the transition data from the storage module according to the relevant parameters of the original data, and sends the transition data to the cache module of the simulation system; and

[0031] The camera simulation module of the simulation system automatically reads the transition data from the cache module and reproduces the data stream according to the camera configuration parameters and the transition data.

[0032] Compared with the prior art, the present invention has the following beneficial effects:

[0033] The present invention provides a simulation test system and a simulation test method, wherein the simulation test system comprises a storage medium, a simulation system and a simulation ISP chip, wherein the simulation ISP chip and the storage medium are respectively connected to the simulation system in communication; the storage medium is used to provide the simulation system with raw data of abnormal conditions in the actual vehicle test when the actual ISP chip is processed; the simulation system is used to reproduce the data stream when the actual vehicle test when the ISP chip is processed abnormally according to the raw data and camera configuration parameters; the simulation ISP chip is used to provide the camera configuration parameters to the simulation system, and process the data stream to reproduce the abnormal conditions. The simulation test system of the present invention is a semi-physical simulation system, which can be built successfully and conveniently, so that the abnormal conditions in the actual vehicle test process can reproduce the problem scenario in the field, and can facilitate the debugging and testing of the ISP chip function during analysis, thereby reducing the workload and difficulty of the ISP chip during the actual vehicle test and improving the research and development efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1 It is a structural schematic diagram of a real vehicle test system;

[0035] Figure 2 A schematic diagram of the structure of a simulation test system provided by an embodiment of the present invention;

[0036] Figure 3 A flowchart of a simulation test method provided by one embodiment of the present invention.

[0037] Description of reference numerals:

[0038] 1- camera; 2- measured ISP chip; 2'- simulated ISP chip; 3- measured display device; 3'- simulated display device; 4- storage medium; 5- simulated system;

[0039] 10- preliminary processing module; 11- simulation database; 20- storage module; 30- control module; 40- cache module; 41- error injection module; 50- camera simulation module; 51- monitoring module; 60- parameter control module. DETAILED DESCRIPTION

[0040] A simulation test system and a simulation test method of the present invention will be described in further detail below. The present invention will be described in more detail below with reference to the accompanying drawings, in which preferred embodiments of the present invention are shown, and it should be understood that those skilled in the art can modify the present invention described herein and still achieve the beneficial effects of the present invention. Therefore, the following description should be understood as being widely known to those skilled in the art, and not as a limitation of the present invention.

[0041] For the sake of clarity, not all features of the actual embodiments are described. In the following description, well-known functions and structures are not described in detail because they would clutter the invention with unnecessary detail. It should be recognized that in the development of any actual embodiment, a large number of implementation details must be made to achieve the developer's specific goals, such as changing from one embodiment to another according to the limitations of the relevant system or the relevant business. In addition, it should be recognized that such development work may be complex and time-consuming, but it is just a routine task for those skilled in the art.

[0042] In order to make the purpose and features of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are further described below in conjunction with the accompanying drawings. It should be noted that the accompanying drawings are all in a very simplified form and use inaccurate ratios, which are only used to conveniently and clearly assist in explaining the purpose of the embodiments of the present invention.

[0043] Figure 1 Figure 1 is a schematic diagram of the structure of a real vehicle test system. Figure 1 As shown, when the test personnel conduct a real vehicle test on the measured ISP chip 2 in the field, the real vehicle test system includes a camera 1, a measured ISP chip 2, a measured display device 3 and a storage medium 4. The camera 1 is used to collect raw data and send the raw data to the measured ISP chip 2. The measured ISP chip 2 is used to process the raw data to obtain a processed data stream and send the data stream to the measured display device 3. The measured display device 3 displays images according to the data stream. The raw data includes raw image data and raw video data.

[0044] When the processing function of the measured ISP chip 2 is abnormal and affects the quality of imaging, the image displayed by the measured display device 3 is abnormal, that is, when the measured ISP chip 2 is abnormal in the actual vehicle test, the camera 1 and the measured ISP chip 2 are no longer transmitted data, and the camera 1 directly sends the raw data to the storage medium 4, and the storage medium 4 stores the raw data. Among them, the storage medium 4 can be a portable laptop, mobile hard disk, etc., and the storage medium 4 can carry the raw data of the abnormal situation back to the infield and provide it to the R&D design personnel for abnormal situation analysis.

[0045] Figure 2 This is a schematic diagram of the structure of the simulation test system provided in this embodiment. Figure 2As shown, the simulation test system used by the R&D personnel during the simulation test includes a storage medium 4, a simulation system 5, a simulation ISP chip 2' and a simulation display device 3'. The simulation system 5 is respectively connected to the simulation ISP chip 2' and the storage medium 4 in communication, that is, the simulation ISP chip 2' and the storage medium 4 are respectively connected to the simulation system 5 in communication, and the storage medium 4 is used to provide the simulation system 5 with the original data of the abnormal condition caused by the measured ISP chip 2 during the actual vehicle test; the simulation system 5 is used to reproduce the data stream when the measured ISP chip 2 is processed according to the original data and the camera configuration parameters; the simulation ISP chip 2' is used to provide the simulation system 5 with the camera configuration parameters, and process the data stream to reproduce the abnormal condition, and the simulation display device 3' is connected to the simulation ISP chip 2' in communication, and is used to display the abnormal condition through an image. Among them, the simulation ISP chip 2' and the measured ISP chip 2 are the same ISP chips, and the simulation display device 3' and the measured display device 3 can be the same display device or different display devices.

[0046] The simulation test system of this embodiment is a semi-physical simulation system, which can be easily and quickly built successfully, so that abnormal conditions during actual vehicle testing can reproduce problem scenarios on site, and can facilitate the debugging and testing of ISP chip functions during analysis, reducing the workload and difficulty of ISP chip testing in actual vehicles and improving research and development efficiency.

[0047] The simulation system 5 includes a preliminary processing module 10 , a storage module 20 , a control module 30 , a cache module 40 , a camera simulation module 50 and a parameter control module 60 .

[0048] The parameter control module 60 is connected to the preliminary processing module 10, the storage module 20, the control module 30, the cache module 40 and the camera simulation module 50, respectively, and is used to configure operating parameters to the preliminary processing module 10, the storage module 20, the control module 30, the cache module 40 and the camera simulation module 50, respectively, so that during the parsing process, the R&D personnel can change the operating parameters configured by the preliminary processing module 10, the storage module 20, the control module 30, the cache module 40 and the camera simulation module 50 online in real time through the parameter control module 60, thereby changing the timing of the image data in the data stream output by the simulation system 5, and the playback format of the video data, etc.

[0049] The preliminary processing module 10 is connected to the storage medium 4 in communication, and is also connected to the storage module 20. The preliminary processing module 10 is used to call the original data from the storage medium 4, re-encode the original data to obtain transition data, and finally send the relevant parameters of the original data and the transition data to the storage module 20. The preliminary processing module 10 is, for example, database software, and the preliminary processing module 10 includes a simulation database 11. The database software is connected to the storage medium 4 in communication, and is also connected to the storage module 20. The database software is used to call the original data in the storage medium 4, and classify and organize the original data into the simulation database 11. The database software also re-encodes the original data in the simulation database 11 according to a specified format to obtain transition data, and finally sends the transition data to the storage module 20, and also sends the relevant parameters of the original data (such as image size, original data type, configuration parameters of the camera 1, etc.) to the storage module 20. The simulation database 11 stores the original data of historical abnormal conditions, the original data of current abnormal conditions, and other data that are conducive to abnormal condition analysis.

[0050] The storage module 20 is connected to the control module 30 and is used to store the relevant parameters of the original data and the transition data. The storage module 20 is, for example, a non-volatile memory, so that the transition data stored in the storage module 20 is not easily lost.

[0051] The control module 30 is connected to the cache module 40 and is used to automatically read the transition data from the storage module 20 according to relevant parameters of the original data and send the transition data to the cache module 40 .

[0052] The cache module 40 is, for example, a high-speed cache memory, and is connected to the camera simulation module 50, and is used to store the transition data, and flexibly and in real time configure the transition data outputted by the cache module 40. The cache module 40 includes an error injection module 41, and the error injection module 41 is used to modify the transition data outputted by the cache module 40, so as to reproduce the abnormal condition during abnormal condition analysis, and can also make the abnormal condition more complicated, which is conducive to solving the abnormal condition during analysis or simulating a more complicated abnormal condition.

[0053] The camera simulation module 50 is connected to the simulated ISP chip 2' and is used to automatically read the transition data from the cache module 40, and reproduce the data flow when an abnormal situation occurs according to the transition data and the camera configuration parameters provided by the simulated ISP chip 2'. The camera simulation module 50 includes a monitoring module 51, which is used to save the camera configuration parameters provided by the simulated ISP chip 2' to record the camera configuration parameters before and after analysis and during analysis.

[0054] Figure 3 Flow chart of a simulation test method for real-time image processing provided by this embodiment. Figure 3 As shown, a simulation test method for real-time image processing provided by this embodiment includes the following steps:

[0055] Step S1: establishing a communication connection between a simulation system and a storage medium, wherein the storage medium provides the simulation system with raw data of abnormal conditions occurring during actual vehicle testing in the ISP chip processing;

[0056] Step S2: the simulation system reproduces the data flow when the abnormal situation occurs according to the original data and the camera configuration parameters provided by the simulation ISP chip; and

[0057] Step S3: The simulated ISP chip processes the data stream to reproduce the abnormal condition.

[0058] The simulation test method for real-time image processing provided by this embodiment is described in detail below.

[0059] First, step S1 is executed to establish a communication connection between the simulation system 5 and the storage medium 4, and the storage medium 4 provides the simulation system 5 with the original data of abnormal conditions occurring during the actual vehicle test when the ISP chip 2 is processed.

[0060] The method for obtaining the raw data of abnormal conditions processed by the ISP chip 2 in the actual vehicle test of this step includes:

[0061] First, the camera 1 collects raw data and provides the raw data to the measured ISP chip 2. The measured ISP chip 2 processes the raw data to obtain a processed data stream and sends the data stream to the measured display device 3. The measured display device 3 displays an image according to the data stream. The raw data includes raw image data and raw video data. The camera 1 is, for example, a vehicle-mounted camera.

[0062] Next, when an abnormal situation occurs in the processing of the measured ISP chip 2, the camera 1 directly sends the original data to the storage medium 4, and the storage medium 4 stores the original data.

[0063] Then, step S2 is executed, wherein the simulation system 5 reproduces the data stream when an abnormal situation occurs according to the original data and the camera configuration parameters provided by the simulation ISP chip 2'.

[0064] This step specifically includes:

[0065] First, the preliminary processing module 10 calls the original data from the storage medium 4 and re-encodes the original data to obtain transition data, and then sends the relevant parameters of the original data and the transition data to the storage module 20.

[0066] Next, the control module 30 automatically reads the transition data from the storage module 20 according to the relevant parameters of the original data, and sends the transition data to the cache module 40. Next, the camera simulation module 50 automatically reads the transition data from the cache module 40, and reproduces the data flow when the actual ISP chip 2 processes an abnormal situation according to the camera configuration parameters provided by the simulated ISP chip 2' and the transition data.

[0067] Then, step S3 is performed, the simulated ISP chip 2' processes the data stream to reproduce the abnormal condition. In detail, the simulated ISP chip 2' processes the data stream to reproduce the abnormal condition, and the simulated display device 3' displays the abnormal condition through an image.

[0068] In summary, the present invention provides a simulation test system and a simulation test method, wherein the simulation test system includes a storage medium and a simulation system, and a simulation ISP chip, wherein the simulation system is respectively connected to the simulation ISP chip and the storage medium in communication, wherein the storage medium is used to provide the simulation system with the original data of abnormal conditions in the actual vehicle test when the actual ISP chip is processed; the simulation system is used to reproduce the data stream when the actual vehicle test when the ISP chip is processed abnormally according to the original data and the camera configuration parameters; the simulation ISP chip is used to provide the camera configuration parameters to the simulation system, and process the data stream to reproduce the abnormal conditions. The simulation test system of the present invention is a semi-physical simulation system, which can be built successfully and conveniently, so that the abnormal conditions in the actual vehicle test process can reproduce the problem scenario in the field, and can facilitate the debugging and testing of the ISP chip function during analysis, thereby reducing the workload and difficulty of the ISP chip during the actual vehicle test and improving the research and development efficiency.

[0069] In addition, it should be noted that, unless otherwise specified or indicated, the terms "first" and "second" in the specification are only used to distinguish the various components, elements, steps, etc. in the specification, and are not used to indicate the logical relationship or sequential relationship between the various components, elements, steps, etc.

[0070] It is to be understood that, although the present invention has been disclosed as a preferred embodiment, the above embodiment is not intended to limit the present invention. For any person skilled in the art, without departing from the scope of the technical solution of the present invention, the technical content disclosed above can be used to make many possible changes and modifications to the technical solution of the present invention, or modified into equivalent embodiments of equivalent changes. Therefore, any simple modification, equivalent change and modification made to the above embodiments according to the technical essence of the present invention without departing from the content of the technical solution of the present invention still falls within the scope of protection of the technical solution of the present invention.

Claims

1. A simulation test system, characterized in that: It includes a storage medium, a simulation system and a simulation ISP chip, wherein the simulation ISP chip and the storage medium are respectively connected to the simulation system for communication; The storage medium is used to provide the simulation system with original data of abnormal conditions in the ISP chip processing during the actual vehicle test; The simulation system is used to reproduce the data flow when an abnormal condition occurs in the actual ISP chip processing according to the original data and the camera configuration parameters; The simulated ISP chip is used to provide the camera configuration parameters to the simulation system and process the data stream to reproduce the abnormal condition; Wherein, the simulation system includes a preliminary processing module, a storage module, a control module, a cache module, a camera simulation module and a parameter control module; The parameter control module is connected to the preliminary processing module, the storage module, the control module, the cache module and the camera simulation module respectively, and is used to configure operating parameters to the preliminary processing module, the storage module, the control module, the cache module and the camera simulation module respectively; The preliminary processing module is connected to the storage medium and the storage module respectively, and is used to call the original data from the storage medium, re-encode the original data to obtain transition data, and finally send the relevant parameters of the original data and the transition data to the storage module; The storage module is connected to the control module and is used to store the relevant parameters of the original data and the transition data; The control module is connected to the cache module and is used to automatically read the transition data from the storage module according to the relevant parameters of the original data, and send the transition data to the cache module; The buffer module is connected to the camera simulation module and is used to store the transition data and configure the transition data outputted by it in real time; and The camera simulation module is connected to the simulated ISP chip and is used to automatically read the transition data from the cache module and reproduce the data stream according to the camera configuration parameters and the transition data.

2. The simulation test system according to claim 1, characterized in that: The cache module includes an error injection module, and the error injection module is used to modify the transition data output by the cache module.

3. The simulation test system according to claim 1, characterized in that: The camera simulation module includes a monitoring module, and the monitoring module is used to save the camera configuration parameters.

4. The simulation test system according to claim 1, characterized in that: It also includes a simulation display device, which is communicatively connected to the simulation ISP chip and is used to display abnormal conditions through images.

5. The simulation test system according to claim 1, characterized in that: The original data includes original image data and original video data.

6. The simulation test system according to claim 1, characterized in that: The simulated ISP chip and the measured ISP chip are the same ISP chip.

7. A simulation test method, using the simulation test system according to any one of claims 1 to 6, characterized in that: The following steps are involved: Step S1: establishing a communication connection between a simulation system and a storage medium, wherein the storage medium provides the simulation system with raw data of abnormal conditions occurring during actual vehicle testing in the ISP chip processing; Step S2: the preliminary processing module of the simulation system calls the original data from the storage medium, re-encodes the original data to obtain transition data, and then sends the relevant parameters of the original data and the transition data to the storage module of the simulation system; the control module of the simulation system automatically reads the transition data from the storage module according to the relevant parameters of the original data, and sends the transition data to the cache module of the simulation system; and the camera simulation module of the simulation system automatically reads the transition data from the cache module, and reproduces the data stream according to the camera configuration parameters and the transition data; as well as Step S3: The simulated ISP chip processes the data stream to reproduce the abnormal condition.

8. The simulation test method according to claim 7, characterized in that: The method for obtaining the raw data of abnormal conditions in the ISP chip processing in the actual vehicle test in step S1 includes: The camera collects raw data and provides the raw data to the measured ISP chip, the measured ISP chip processes the raw data to obtain a processed data stream, and sends the data stream to the measured display device, and the measured display device displays an image according to the data stream; and When an abnormal situation occurs in the measured ISP chip processing, the camera directly sends the original data to the storage medium, and the storage medium stores the original data.

Citation Information

Patent Citations

  • Automatic driving data processing method and device and electronic equipment

    CN111611711A

  • Image data processing method and system, electronic device and storage medium

    CN114679581A