Anti-substitution method for ensuring picture safety of ADAS camera

Abstract

The invention relates to an anti-substitution method for ensuring ADAS camera picture safety, the anti-substitution method is suitable for an ADAS system, the ADAS system comprises a camera, a serial adding device, a deserializing device and a domain controller, and the camera, the serial adding device, the deserializing device and the domain controller are sequentially connected through flat cables; the domain controller periodically changes the AE parameters and the AWB parameters, calculates CRC information values of the AE parameters and the AWB parameters through an ADAS algorithm, and compares the CRC information values with CRC information values checked by the camera to identify the authenticity of the camera so as to judge whether the camera is replaced or not. According to the method, the CRC information value can be periodically checked with the camera in the working process of the camera, and it is guaranteed that the camera is not replaced.

Description

Technical Field

[0001] The present invention relates to the technical field of camera anti-counterfeiting, and in particular to an anti-substitution method for ensuring the safety of ADAS camera images. Background Art

[0002] At present, most of the underlying software systems of ADAS (Advanced Driver Assistance Systems) do not have the function of identifying the authenticity of cameras, and some companies now only have the ability to develop images collected by the front-view camera of the simulated domain controller, that is, the current domain controller only has the function of collecting images, and does not have the ability to periodically detect the authenticity of the camera. For example: A multi-spectral multi-eye camera anti-counterfeiting identification method and device is disclosed in a Chinese patent (patent number ZL201910350317.0, announcement date 2019.08.06), the multi-eye camera includes a first eye camera and a second eye camera, the first eye camera is a wide-angle lens, and the second eye camera is a telephoto lens, the method includes: the first eye camera obtains the first image information of the target to be identified from a first angle, and the target to be identified is the license plate of the vehicle; the second eye camera obtains the second image information of the target to be identified from a second angle, wherein the first angle and the second angle are different angles; the multi-eye camera obtains During the process of obtaining the first image information and the second image information, a composite light source illuminates a target to be identified, wherein the composite light source emits light of different wavelengths alternately under the control of a processor, and the light of different wavelengths includes at least visible light and infrared light; the processor obtains the first image information and the second image information from a multi-eye camera; the processor fits the first image information and the second image information to obtain a three-dimensional image of the target to be identified, and the three-dimensional image includes shape information and wavelength information of the target to be identified; if the processor determines that the three-dimensional image, shape information and wavelength information of the target to be identified are the same as the prefabricated information, the target to be identified is determined to be a true target.

[0003] Although there are solutions in the industry that can simulate the communication between cameras and domain controllers, such as FPGA (field programmable gate array) simulated camera replacement solutions, once the camera is replaced, it will pose a threat to the safety of ADAS (advanced driver assistance system).

[0004] The forms of replacing cameras are not limited to physical replacements, but also software replacements. Once someone uses specific software or applications to capture and process the real-time video stream of the camera and replace or modify the footage, it will cause immeasurable risks to the driving of the vehicle. Summary of the invention

[0005] The present invention aims to solve at least one of the technical problems existing in the prior art.

[0006] To this end, the present invention proposes an anti-substitution method to ensure the safety of ADAS camera images, which can periodically verify the CRC information value with the camera during the camera operation to ensure that the camera is not replaced.

[0007] An anti-substitution method for ensuring the safety of ADAS camera images according to an embodiment of the present invention is applicable to an ADAS system, wherein the ADAS system includes a camera, a serializer, a deserializer and a domain controller, wherein the camera, the serializer, the deserializer and the domain controller are sequentially connected via a cable; the domain controller periodically changes AE parameters and AWB parameters, calculates CRC information values ​​of the AE parameters and the AWB parameters through an ADAS algorithm, and compares the values ​​with the CRC information values ​​verified by the camera to identify the authenticity of the camera, thereby determining whether the camera has been replaced.

[0008] The beneficial effect of the present invention is that during the operation of the camera, as the external environment changes, the domain controller will periodically adjust the AE parameters and AWB parameters of the camera, thereby ensuring that the camera captures the best image. After the camera receives the AE parameters and AWB parameters, the camera will calculate a CRC information value about the AE parameters and the AWB parameters and store the CRC information value in a CRC register inside the camera. The domain controller will read the CRC information value in the CRC register, and the domain controller will compare the CRC information value about the AE parameters and the AWB parameters calculated by itself with the read CRC information value. At the same time, the domain controller will verify the AE parameters and the AWB parameters that have been sent to the camera. If the verification is correct, it means that the camera is working normally. If the verification is incorrect, it means that the camera is replaced, thereby ensuring that the camera will not be simulated or replaced, ensuring the safety of the camera output, and further ensuring the driving safety performance of the vehicle.

[0009] According to one embodiment of the present invention, the anti-substitution method specifically includes the following steps:

[0010] Step 1: Connect the camera to the domain controller and power it on;

[0011] Step 2: The domain controller sends the initialized AE parameters and AWB parameters to the camera, and the camera collects images according to the initialized AE parameters and AWB parameters;

[0012] Step 3: The domain controller obtains the image captured by the camera and analyzes it. The domain controller uses the ADAS algorithm to calculate new AE parameters and AWB parameters based on the image currently captured by the camera.

[0013] Step 4: The domain controller calculates the CRC information value of the new AE parameter and AWB parameter through the ADAS algorithm, which is value1. The domain controller reads the CRC register of the camera and obtains the CRC information value of the new AE parameter and AWB parameter calculated by the camera, which is value2.

[0014] Step 5: Determine whether value1 and value2 are consistent:

[0015] When it is determined that value1 is consistent with value2, the verification is passed, indicating that the ADAS camera has not been replaced, that is, the ADAS camera is in a normal state, and returns to step 2;

[0016] When it is determined that value1 and value2 are inconsistent, the verification fails, indicating that the ADAS camera has been replaced. The ADAS system is informed through diagnosis to perform functional downgrade.

[0017] According to one embodiment of the present invention, the AE parameter includes a high conversion gain value and a low conversion gain value.

[0018] According to an embodiment of the present invention, the AWB parameters include a red gain value, a green gain value and a blue gain value.

[0019] According to one embodiment of the present invention, the camera, the serializer, the deserializer and the domain controller are connected in sequence via a coaxial cable or a twisted pair cable.

[0020] According to one embodiment of the present invention, the ADAS algorithm used in the domain controller to calculate the CRC information values ​​of the AE parameters and the AWB parameters is the same as the ADAS algorithm used in the camera to calculate the CRC information values ​​of the AE parameters and the AWB parameters.

[0021] According to one embodiment of the present invention, the calculation method of the CRC information value is tabulated as follows:

[0022] Polynomial formula x16+x15+x2+1 width 16 bits Poly Value 0x8005 Initial Value 0x0000 Reference Input true Reference output true CRC flag bit 0x0000

[0023] According to one embodiment of the present invention, the AE parameter is calculated by the ADAS algorithm based on the image currently captured by the camera, and the calculation formula of the AE parameter is line*2^(ae_gain / 32), where line represents the brightness of a single pixel; ae_gain represents the digital gain of automatic exposure.

[0024] According to one embodiment of the present invention, the AWB parameter is calculated by the ADAS algorithm based on the image currently captured by the camera, and the calculation formula of the AWB parameter is line*2^(aw_gain / 32), where line represents the brightness of a single pixel; aw_gain represents the digital gain of automatic white balance.

[0025] According to one embodiment of the present invention, the domain controller changes the AE parameters and the AWB parameters every 25 milliseconds.

[0026] Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention are realized and obtained by the structures particularly pointed out in the description and the drawings.

[0027] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, preferred embodiments are given below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in this application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0029] Figure 1 It is a structural diagram of the ADAS system;

[0030] Figure 2 It is a flow chart of the anti-substitution method for ensuring the safety of ADAS camera images of the present invention. DETAILED DESCRIPTION

[0031] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0032] An anti-substitution method for ensuring the safety of an ADAS camera image according to an embodiment of the present invention will be described in detail below with reference to the accompanying drawings.

[0033] See Figure 1 and Figure 2, the anti-substitution method for ensuring the safety of the ADAS camera image of the present invention is applicable to the ADAS system, the ADAS system includes a camera, a serializer, a deserializer and a domain controller, the camera, the serializer, the deserializer and the domain controller are connected in sequence through a cable; specifically, the camera, the serializer, the deserializer and the domain controller are connected in sequence through a coaxial line or a twisted pair. In other words, the camera, the serializer, the deserializer and the domain controller are connected in sequence through a coaxial line; or, the camera, the serializer, the deserializer and the domain controller are connected in sequence through a twisted pair.

[0034] The camera may be a front-view camera, a rear-view camera, or a surround-view camera.

[0035] The domain controller periodically changes the AE parameters and AWB parameters, calculates the CRC information value of the AE parameters and AWB parameters through the ADAS algorithm, and compares it with the CRC information value of the camera verification to identify the authenticity of the camera, thereby determining whether the camera has been replaced. Specifically, the domain controller usually changes the AE parameters and AWB parameters every 25 milliseconds.

[0036] The anti-substitution method specifically comprises the following steps:

[0037] Step 1: Power on and start up, power on the camera, and initialize: connect the camera to the domain controller, power on and start up; initialization refers to configuring the camera's frame rate, horizontal resolution, vertical resolution and other parameters.

[0038] Step 2: Capture images according to AE parameters and AWB parameters: The domain controller sends the initialized AE parameters and AWB parameters to the camera, and the camera captures images according to the initialized AE parameters and AWB parameters; it should be noted that AE means automatic exposure in Chinese and AWB means automatic white balance in Chinese.

[0039] The AE parameters include a high conversion gain value and a low conversion gain value, and both the high conversion gain value and the low conversion gain value are calculated by an ADAS algorithm.

[0040] The AWB parameters include a red gain value, a green gain value, and a blue gain value, and the red gain value, the green gain value, and the blue gain value are calculated by an ADAS algorithm.

[0041] Step 3: The SOC (domain controller) obtains the image from the camera and analyzes it to calculate new AE parameters and AWB parameters: The domain controller obtains the image captured by the camera and analyzes it. The domain controller uses the ADAS algorithm to calculate new AE parameters and AWB parameters based on the image currently captured by the camera.

[0042] Step 4: Calculate the CRC information value of the AE parameter and AWB parameter, which is value1, and read the CRC information value value2 in the camera: The domain controller calculates the CRC information value of the new AE parameter and AWB parameter through the ADAS algorithm, which is value1. The domain controller reads the CRC register of the camera and obtains the CRC information value of the new AE parameter and AWB parameter calculated by the camera, which is value2; It should be noted that CRC is the abbreviation of Cyclic Redundancy Check, and its Chinese meaning is cyclic redundancy check. The CRC value is a random, uncertain value calculated according to the ADAS algorithm.

[0043] The ADAS algorithm used in the domain controller to calculate the CRC information values ​​of the AE parameters and the AWB parameters is the same as the ADAS algorithm used in the camera to calculate the CRC information values ​​of the AE parameters and the AWB parameters. In other words, the principles of the two algorithms are the same, but one algorithm is on the camera side and the other is on the domain controller side.

[0044] The calculation of value2 is performed inside the camera.

[0045] The calculation method of CRC information value is listed as follows:

[0046] Polynomial formula x16+x15+x2+1 width 16 bits Poly (short for polynomial) value 0x8005 Initial Value 0x0000 Reference input (inverted input) true Reference output (output inversion) true CRC flag bit 0x0000

[0047] The source code of the software is as follows:

[0048]

[0049]

[0050]

[0051]

[0052]

[0053]

[0054]

[0055] Step 5: Compare value1 and value2 to see if they are the same: Determine whether value1 and value2 are consistent:

[0056] Verification passed, return to normal, and continue to collect images: When it is judged that value1 is consistent with value2, the verification passed, indicating that the ADAS camera has not been replaced, that is, the ADAS camera is in normal state, and return to step 2;

[0057] If the verification fails, the ADAS system is informed through diagnosis and the function is downgraded: When it is judged that value1 and value2 are inconsistent, the verification fails, indicating that the ADAS camera has been replaced. The ADAS system is informed through diagnosis and the function is downgraded. It should be noted that function degradation means that when the system faces overload or failure, it reduces the quality of certain non-core functions or services or completely disables these functions to ensure the normal use of core services and most users.

[0058] The AE parameter is calculated by the ADAS algorithm based on the image currently captured by the camera. The calculation formula of the AE parameter is line*2^(ae_gain / 32), where line represents the brightness of a single pixel and ae_gain represents the digital gain of automatic exposure.

[0059] The AWB parameter is calculated by the ADAS algorithm based on the image currently captured by the camera. The calculation formula of the AWB parameter is line*2^(aw_gain / 32), where line represents the brightness of a single pixel and aw_gain represents the digital gain of automatic white balance.

[0060] The anti-substitution method for ensuring the safety of ADAS camera images is as follows: during the operation of the camera, as the external environment changes (for example, changes in the brightness of the external light, changes in the color of the photographed object), the domain controller will periodically adjust the AE parameters and AWB parameters of the camera to ensure that the camera captures the best image. After the camera receives the AE parameters and AWB parameters, the camera will calculate a CRC information value about the AE parameters and the AWB parameters and store the CRC information value in a CRC register inside the camera. The domain controller will read the CRC information value in the CRC register, and the domain controller will compare the CRC information value about the AE parameters and the AWB parameters calculated by itself with the read CRC information value. At the same time, the domain controller will verify the AE parameters and AWB parameters that have been sent to the camera. If the verification is correct, it means that the camera is working normally. If the verification is incorrect, it means that the camera has been replaced. This ensures that the camera will not be simulated or replaced, ensures the safety of the camera's output, and further ensures the driving safety performance of the vehicle.

[0061] The above are only preferred specific implementation modes of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can make equivalent replacements or changes according to the technical solutions and inventive concepts of the present invention within the technical scope disclosed by the present invention, which should be covered by the protection scope of the present invention.

Claims

1. A method for preventing substitution to ensure the safety of ADAS camera images, characterized in that: The anti-substitution method is applicable to an ADAS system, wherein the ADAS system includes a camera, a serializer, a deserializer, and a domain controller, wherein the camera, the serializer, the deserializer, and the domain controller are sequentially connected via a flat cable; The domain controller periodically changes the AE parameters and AWB parameters, calculates the CRC information values ​​of the AE parameters and AWB parameters through the ADAS algorithm, and compares them with the CRC information values ​​verified by the camera to identify the authenticity of the camera, thereby determining whether the camera has been replaced.

2. The anti-substitution method for ensuring the safety of ADAS camera images according to claim 1, characterized in that: The specific steps include: Step 1: Connect the camera to the domain controller and power it on; Step 2: The domain controller sends the initialized AE parameters and AWB parameters to the camera, and the camera collects images according to the initialized AE parameters and AWB parameters; Step 3: The domain controller obtains the image captured by the camera and analyzes it. The domain controller uses the ADAS algorithm to calculate new AE parameters and AWB parameters based on the image currently captured by the camera. Step 4: The domain controller calculates the CRC information value of the new AE parameter and AWB parameter through the ADAS algorithm, which is value1. The domain controller reads the CRC register of the camera and obtains the CRC information value of the new AE parameter and AWB parameter calculated by the camera, which is value2. Step 5: Determine whether value1 and value2 are consistent: When it is determined that value1 is consistent with value2, the verification is passed, indicating that the ADAS camera has not been replaced, that is, the ADAS camera is in a normal state, and returns to step 2; When it is determined that value1 and value2 are inconsistent, the verification fails, indicating that the ADAS camera has been replaced. The ADAS system is informed through diagnosis to perform functional downgrade.

3. The anti-substitution method for ensuring the safety of ADAS camera images according to claim 1, characterized in that: The AE parameters include a high conversion gain value and a low conversion gain value.

4. The anti-substitution method for ensuring the safety of ADAS camera images according to claim 1, characterized in that: The AWB parameters include a red gain value, a green gain value, and a blue gain value.

5. The anti-substitution method for ensuring the safety of ADAS camera images according to claim 1, characterized in that: The camera, the serializer, the deserializer and the domain controller are connected in sequence via a coaxial cable or a twisted pair cable.

6. The anti-substitution method for ensuring the safety of ADAS camera images according to claim 1, characterized in that: The ADAS algorithm used in the domain controller to calculate the CRC information values ​​of the AE parameters and the AWB parameters is the same as the ADAS algorithm used in the camera to calculate the CRC information values ​​of the AE parameters and the AWB parameters.

7. The anti-substitution method for ensuring the safety of ADAS camera images according to claim 1, characterized in that: The calculation method of the CRC information value is tabulated as follows:

8. The anti-substitution method for ensuring the safety of ADAS camera images according to claim 1, characterized in that: The AE parameter is calculated by the ADAS algorithm based on the image currently captured by the camera. The calculation formula of the AE parameter is line*2^(ae_gain / 32), where line represents the brightness of a single pixel; ae_gain represents the digital gain of automatic exposure.

9. The anti-substitution method for ensuring the safety of ADAS camera images according to claim 1, characterized in that: The AWB parameter is calculated by the ADAS algorithm based on the image currently captured by the camera. The calculation formula of the AWB parameter is line*2^(aw_gain / 32), where line represents the brightness of a single pixel; aw_gain represents the digital gain of automatic white balance.

10. The anti-substitution method for ensuring the safety of ADAS camera images according to claim 1, characterized in that: The domain controller changes the AE parameters and the AWB parameters every 25 milliseconds.

Images