Reverse video fixation detection system, detection method and system anomaly detection method

Abstract

The application discloses a reversing video fixation detection system, a detection method and a system anomaly detection method in the technical field of reversing imaging, and the reversing video fixation detection system comprises a Camera System, which is a reversing camera system, is used for collecting reversing videos, outputs a GVIF3 signal, is connected with an ADAS, and is used for video synthesis processing, sends the processed reversing video to an AVN, and is connected with the AVN. The Camera System sends the collected video to the ADAS, the ADAS synthesizes the video in the Camera System, and sends the video to the AVN, the AVN detects the video source input by the ADAS and displays imaging. The AVN comprises a SOC chip AC8025 with fast CRC checking, and processes and displays imaging of the fixed video. The application solves the risk problem caused by the lack of fixation detection of the reversing video, the problem that no risk prompt is given after the fixation of the reversing video is detected, the problem that the driving experience is poor due to frequent fixation of the reversing video caused by AVN video processing, and the problem that the fixation detection cannot be continued due to the lack of an abnormal error reporting mechanism of the AVN video processing module.

Description

Technical Field

[0001] This invention relates to a reversing video fixation detection system, detection method, and system anomaly detection method in the field of reversing imaging technology. Background Technology

[0002] Currently, in-vehicle central control systems with reversing imaging systems inform drivers of the relative position of the vehicle and obstacles in a clear way through images and sound, eliminating the trouble caused by blind spots in rearview mirrors, thus providing convenience for drivers to reverse and park, and eliminating safety hazards; however, due to a malfunction of a component in the system, the reversing video may become stuck (reversing video frozen), causing drivers to misjudge and thus leading to unpredictable risks. Summary of the Invention

[0003] The purpose of this invention is to provide a reversing video fixed vehicle detection system, detection method, and system anomaly detection method, which solves the problems of risks caused by the lack of fixed vehicle detection in reversing videos, the problem of no risk warning after detecting fixed vehicle movement, the problem of poor driving experience due to frequent fixed vehicle movement caused by AVN video processing, and the problem of being unable to continue fixed vehicle detection due to the lack of an error reporting mechanism in the AVN video processing module.

[0004] To achieve the above objectives, the present invention provides a reversing video fixation detection system, including a Camera System, which is a reversing camera system used to acquire reversing video and output GVIF3 signals. The Camera System is connected to ADAS, which is used for video synthesis processing and sends the processed reversing video to AVN. ADAS is connected to AVN.

[0005] As a further improvement of the present invention, the AVN includes a video deserializer, which is connected to a SOC, and the SOC is connected to both an MCU and a display screen.

[0006] As a further improvement of the present invention, the video deserializer uses the CXD4966 chip to convert the GVIF3 signal into a CSI signal. The CXD4966 chip is connected to ADAS and SOC respectively.

[0007] As a further improvement of the present invention, the SOC chip AC8025 is a central processing unit responsible for video stream switching and fixation detection. The SOC chip AC8025 is connected to the MCU, the chip CXD4966 and the display screen respectively.

[0008] As a further improvement of the present invention, the MCU chip R7F7015873AFP-C is a microcontroller responsible for reversing signal detection. The MCU chip R7F7015873AFP-C is connected to the SOC chip AC8025.

[0009] To achieve the above objectives, the present invention also provides a method for detecting fixed vehicle movement in reversing video, comprising the following steps: Step 1: The Camera System sends the reversing video signal to the ADAS via the GVIF3 bus; Step 2: ADAS synthesizes the reversing video signal from the Camera System and sends the signal to the CXD4966 chip via the GVIF3 bus. Step 3: The video deserialization chip CXD4966 converts the GVIF3 signal into a CSI signal and sends it to the SOC chip AC8025; Step 4: The MCU chip R7F7015873AFP-C detects the reversing signal transmitted by the vehicle body and notifies the SOC chip AC8025 via the SPI bus. Step 5: The SOC chip AC8025 receives the CSI signal sent by the chip CXD4966, and performs data stream fixation detection processing through fixation detection module 1 and fixation detection module 2 in the AC8025 chip. The processed video is sent to the display screen through the LVDS module of the SOC chip AC8025. Step 6: The display shows the reversing video sent by the LVDS module.

[0010] As a further improvement of the present invention, the specific content processed by the adhesion detection module 1 in step 5 is as follows: The fixation detection module 1 performs frame-by-frame CRC check on the images in the RVC Video of the AC8025 chip. If the calculated CRC result is the same for more than 30 consecutive frames, it is judged as fixed image; if any frame is different, the fixation is released. When no video fixation is detected, the R5F core in the AC8025 chip outputs the reversing video signal to Layer 0 of the internal DPU, and the A75 core in the chip outputs the UI interface to Layer 1 of the DPU. The two types of data are superimposed by the DPU's Mixer and then sent to the display screen for display. If video freezing is detected, the R5F core is notified not to output the reversing video signal, but instead output a black image to Layer0. The A75 core still outputs the UI interface to Layer1. The black image of Layer0 and the UI of Layer1 are superimposed in the Mixer and then sent to the display screen for display.

[0011] As a further improvement of the present invention, the specific content processed by the adhesion detection module 2 in step 5 is as follows: The fixation detection module 2 performs frame-by-frame CRC verification on the images in the LVDS module of the AC8025 chip. It determines whether the image is fixed by calculating the CRC result. If it is determined to be fixed, it notifies the R5F core of the AC8025 chip through a callback.

[0012] As a further improvement of the present invention, if the fixation detection module 1 and the fixation detection module 2 continuously detect more than 300 frames of fixation video, they notify Layer 1 not to output images to participate in the overlay, and the R5F core outputs the reversing video signal to Layer 0. The Mixer only outputs the reversing video transmitted from Layer 0 and sends it to the display screen for display.

[0013] To achieve the above objectives, the present invention provides an anomaly detection method for a reversing video fixation detection system, including the following specific contents: Step 1: The AC8025 chip has two watchdog modules inside, which are responsible for monitoring whether the system is working properly. If the watchdog module in the IVI domain of the DPU of the AC8025 chip detects an abnormality in the system operation of the IVI domain, it will notify the R5F core of the AC8025 chip, and the R5F core will reset the IVI domain of the DPU. Step 2: If the watchdog module of the Safety domain of the AC8025 chip to which the R5F core belongs detects an abnormality in the system operation of its Safety domain, it will actively perform a hardware reset. Step 3: The error detection module within the Safety domain is responsible for aggregating error information from various modules; Step 4: The error detection module transmits the system error information to the MCU through its signal pins.

[0014] Compared with existing technologies, the advantages of this invention are as follows: the Camera System sends the captured video to the ADAS; the ADAS synthesizes the video from the Camera System and sends it to the AVN; the AVN detects the video source input by the ADAS and displays the image. The AVN includes an AC8025 SOC chip with fast CRC check and processes and displays the fixed video. This solves the problems of risks caused by the lack of fixed vehicle detection in reversing videos, the lack of risk warnings after detecting fixed vehicles, the poor driving experience caused by frequent fixed reversing videos due to AVN video processing, and the inability to continue fixed vehicle detection due to the lack of an error reporting mechanism in the AVN video processing module. Attached Figure Description

[0015] Figure 1 This is a system configuration block diagram of the present invention.

[0016] Figure 2 This is a functional module logic block diagram of the present invention.

[0017] Figure 3 This is a data flow diagram for adhesion detection according to the present invention.

[0018] Figure 4 This is a security detection block diagram for abnormal error reporting in this invention.

[0019] Figure 5 The following is the flow chart of the adhesion detection module 1 of the present invention.

[0020] Figure 6 The following is the process flow of the adhesion detection module 2 of the present invention. Implementation

[0021] The present invention will be further described below with reference to the accompanying drawings: like Figure 1-6 The reversing video fixed detection system shown includes a Camera System, which is a reversing camera system used to acquire reversing video and output GVIF3 signal. The Camera System is connected to ADAS, which is used for video synthesis processing and sends the processed reversing video to AVN. ADAS is also connected to AVN.

[0022] The AVN includes a video deserializer, which is connected to the SOC chip AC8025. The SOC chip AC8025 is connected to the MCU chip R7F7015873AFP-C and the display screen. The video deserializer uses the CXD4966 chip to convert GVIF3 signals to CSI signals. The CXD4966 chip is connected to both the ADAS and the SOC.

[0023] The AC8025 SOC chip is a central processing unit responsible for video stream switching and motion detection. The AC8025 is connected to the MCU, the CXD4966 chip, and the display screen. The R7F7015873AFP-C MCU chip is a microcontroller responsible for reversing signal detection; the R7F7015873AFP-C is connected to the AC8025 SOC chip.

[0024] like Figure 1-6 The method for detecting fixed reversing video as shown includes the following steps: Step 1: The Camera System sends the reversing video signal to the ADAS via the GVIF3 bus; Step 2: ADAS synthesizes the reversing video signal from the Camera System and sends the signal to the CXD4966 chip via the GVIF3 bus. Step 3: The video deserialization chip CXD4966 converts the GVIF3 signal into a CSI signal and sends it to the SOC chip AC8025; Step 4: The MCU chip R7F7015873AFP-C detects the reversing signal transmitted by the vehicle body and notifies the SOC chip AC8025 via the SPI bus. Step 5: The SOC chip AC8025 receives the CSI signal sent by the chip CXD4966, performs fixation detection data stream processing through fixation detection module 1 and fixation detection module 2 in the chip AC8025, and sends the processed video to the display screen through the LVDS module of the chip AC8025. The fixation detection module 1 performs frame-by-frame CRC check on the images in the RVC Video of the AC8025 chip. If the calculated CRC result is the same for more than 30 consecutive frames, it is judged as fixed image; if any frame is different, the fixation is released. When no video fixation is detected, the R5F core in the AC8025 chip outputs the reversing video signal to Layer 0 of the internal DPU, and the A75 core in the chip outputs the UI interface to Layer 1 of the DPU. The two types of data are superimposed by the DPU's Mixer and then sent to the display screen for display. If video freezing is detected, the R5F core is notified not to output the reversing video signal, but instead output a black image to Layer0. The A75 core still outputs the UI interface to Layer1. The black image of Layer0 and the UI of Layer1 are superimposed in the Mixer and then sent to the display screen for display.

[0025] The fixation detection module 2 performs frame-by-frame CRC verification on the images in the LVDS module of the AC8025 chip. It determines whether the image is fixed by calculating the CRC result. If it is determined to be fixed, it notifies the R5F core of the AC8025 chip through a callback.

[0026] If the fixed video detected by fixed detection module 1 and fixed detection module 2 is greater than 300 frames, then Layer1 is notified not to output images for overlay. The R5F core outputs the reversing video signal to Layer0. The Mixer only outputs the reversing video transmitted from Layer0 and sends it to the display screen for display.

[0027] Step 6: The display shows the reversing video sent by the LVDS module.

[0028] like Figure 1-6 The anomaly detection method of the reversing video fixed detection system shown includes the following specific contents: Step 1: The AC8025 chip has two watchdog modules inside, which are responsible for monitoring whether the system is working properly. If the watchdog module in the IVI domain of the DPU of the AC8025 chip detects an abnormality in the system operation of the IVI domain, it will notify the R5F core of the AC8025 chip, and the R5F core will reset the IVI domain of the DPU. Step 2: If the watchdog module of the Safety domain of the AC8025 chip to which the R5F core belongs detects an abnormality in the system operation of its Safety domain, it will actively perform a hardware reset. Step 3: The error detection module within the Safety domain is responsible for aggregating error information from various modules; Step 4: The error detection module transmits the system error information to the MCU through its signal pins.

[0029] This invention includes a Camera System, ADAS, and AVN. The Camera System (reversing camera system) is used to acquire reversing video and outputs a GVIF3 signal. It is connected to the ADAS (Advanced Driving Assistance System), which performs video synthesis processing and sends the processed reversing video to the AVN (Audio Video Navigation System). The ADAS and AVN are connected. The Camera System sends the acquired video to the ADAS, which synthesizes the video from the Camera System and sends it to the AVN. The AVN detects the video signal input from the ADAS and displays the image. The AVN includes a SOC chip with fast CRC check and processes and displays the fixed video. This invention solves the problems of risks arising from the lack of fixed vehicle detection in reversing video, the lack of risk warnings after detecting fixed vehicles, the poor driving experience caused by frequent fixed reversing video due to AVN video processing, and the inability to continue fixed vehicle detection due to the lack of an error reporting mechanism in the AVN video processing module. Among them, such as Figure 1 As shown, the camera captures reversing video, which is then transmitted to ADAS (Advanced Driver Assistance System) for preliminary image synthesis. The image signal is then transmitted to AVN (Audio-Visual Navigation System) for video fixation detection and image output.

[0030] like Figure 2As shown, A is the MCU (Microcontroller Unit, responsible for reversing signal detection and logic control), using the R7F7015873AFP-C chip; B is the SOC (System-on-a-Chip), responsible for video stream switching and vehicle tracking detection, using the AC8025 chip; C is the TFT-LCD (TFT-LCD Display), responsible for image display; D is the CXD4966 (Video Deserializer, converting GVIF3 signals to CSI); E is the ADAS (Advanced Driver Assistance System), which sends the processed reversing video to the AVN (Automatic Vehicle Network); and F is the Camera System (Reversing Camera System, acquiring reversing video and outputting GVIF3 signals). Note: Figure 2 The AVN in the system contains four modules: A, B, C, and D.

[0031] The Camera System in F sends the reversing video signal to E via the GVIF3 bus; In E, the ADAS synthesizes the reversing video signal from F and sends the signal to D via the GVIF3 bus; In D, CXD4966 converts the GVIF3 signal into a CSI signal and sends it to B; In A, the MCU chip R7F7015873AFP-C detects a reversing signal and notifies the SOC chip AC8025 in B via the SPI bus. In B, the SOC chip AC8025 receives the CSI signal sent by D and follows the instructions. Figure 3 The fixation detection data stream is processed, and the processed video is sent to C via the LVDS module; The TET-LCD in section C displays the reversing video sent by the LVDS module.

[0032] like Figure 3 The diagram shows the internal workflow of video image fixation detection and processing within the SOC.

[0033] There are two video image fixation detection modules for reversing; First, the fixation detection module 1 performs frame-by-frame CRC check on the images in the RVC Video. If the calculated CRC result is the same for more than 30 consecutive frames, it is determined that the image is fixed. If any frame is different, the fixation is removed. When no video fixation is detected, the R5F core in the AC8025 chip outputs the reversing video signal to Layer 0 of the internal DPU, and the A75 core in the chip outputs the UI interface to Layer 1 of the DPU. The two types of data are superimposed by the DPU's Mixer and then sent to the display screen for display. If video freezing is detected, the R5F core is notified not to output the reversing video signal, but instead output a black image to Layer0. The A75 core still outputs the UI interface to Layer1. The black image of Layer0 and the UI of Layer1 are superimposed in the Mixer and then sent to the display screen for display.

[0034] Secondly, the fixation detection module 2 performs frame-by-frame CRC verification on the images in the LVDS module. It determines whether the image is fixed by calculating the CRC result. If it is determined to be fixed, it notifies the R5F core of the AC8025 chip through a callback.

[0035] If the two fixation detection modules continuously detect more than 300 frames of fixation video, they will notify Layer1 not to output images for overlay, and the R5F core will output a reversing video signal to Layer0. The Mixer will only output the reversing video transmitted from Layer0 and send it to the display screen for display.

[0036] like Figure 4 As shown, this is the system's safety detection mechanism for abnormal operation, ensuring that the reversing video fixation detection continues to run.

[0037] The AC8025 SOC chip has two watchdog modules inside, which are responsible for monitoring whether the system is working properly.

[0038] If the watchdog in the IVI domain to which the DPU belongs detects an abnormality in the system operation of this domain, it will notify the R5F core, and the R5F core will reset the IVI domain to which the DPU belongs.

[0039] If the watchdog of the Safety domain to which the R5F core belongs detects an abnormality in the system operation of its domain, it will automatically perform a hardware reset.

[0040] The Safety domain contains a Fault Monitor module, which is responsible for aggregating error information from various modules.

[0041] The Fault Monitor module transmits system error information to the MCU via dedicated signal pins.

[0042] The above solutions can effectively detect fixed vehicles using reversing videos, process the fixed videos, and prevent them from misleading drivers and causing unpredictable risks.

[0043] The following examples provide further explanation.

[0044] Example 1: When reversing, the reversing video signal captured by the reversing camera undergoes preliminary image synthesis and format conversion before entering the SOC's RVC Video module. The fixation detection module performs frame-by-frame CRC checks. After accumulating and comparing abnormal results, it finds that the cumulative number of abnormal frames exceeds 30, indicating that the video image is fixed. The detection module then notifies the R5F to stop outputting the reversing video signal and instead output a black image. This black image is also transmitted to the display screen. This serves as a notification to the driver that the reversing video image is faulty, preventing the driver from continuing to reverse while viewing the video and potentially causing a dangerous situation.

[0045] Example 2: During reversing, the reversing video signal captured by the reversing camera undergoes preliminary image synthesis and format conversion before entering the SOC's RVC Video module. The fixation detection module 1 performs frame-by-frame CRC checks and detects no anomalies. The reversing video and UI data are then synthesized in the DPU through multi-layer data processing and transmitted to the LVDS module, ready for output to the display screen. The fixation detection module 2 performs frame-by-frame CRC checks. After accumulating and comparing abnormal results, it finds that the cumulative number of abnormal frames exceeds 30, indicating video image fixation. The detection module sends a notification to R5F, ceasing output of the reversing video signal and instead directly outputting a black image. This black image is also transmitted to the display screen. This serves as a warning to the driver that the reversing video image is faulty, preventing the driver from continuing to reverse while watching the video and potentially causing a hazard. If continuous fixation exceeds 300 frames, Layer 1 is notified not to participate in synthesis, and only Layer 0 outputs the reversing video. The driver can then decide whether to continue reversing by watching the video without any prompts.

[0046] This invention can perform CRC verification on reversing video and determine whether the reversing video is stuck. It can quickly process stuck videos and switch them to a black image. For frequently stuck reversing videos, it can process the video by removing intermediate processing steps and directly displaying the externally input reversing video source signal. It can also reset the AVN video processing module in case of abnormal errors to ensure that the reversing video stuck detection continues to operate.

Claims

1. A method for detecting fixed reversing video, characterized in that: Includes the following steps, Step 1: The Camera System sends the reversing video signal to the ADAS via the GVIF3 bus; Step 2: ADAS synthesizes the reversing video signal from the Camera System and sends the signal to the CXD4966 chip via the GVIF3 bus. Step 3: The video deserialization chip CXD4966 converts the GVIF3 signal into a CSI signal and sends it to the SOC chip AC8025; Step 4: The MCU chip R7F7015873AFP-C detects the reversing signal transmitted by the vehicle body and notifies the SOC chip AC8025 via the SPI bus. Step 5: The SOC chip AC8025 receives the CSI signal sent by the chip CXD4966, performs data stream fixation detection processing through fixation detection module 1 and fixation detection module 2 in the chip AC8025, and sends the processed video to the display screen through the LVDS module of the chip AC8025. Step 6: The display screen shows the reversing video sent by the LVDS module; The anomaly detection method of the reversing video fixed detection system includes the following specific contents: Step 1: The AC8025 chip has two watchdog modules inside, which are responsible for monitoring whether the system is working properly. If the watchdog module in the IVI domain of the DPU of the AC8025 chip detects an abnormality in the system operation of the IVI domain, it will notify the R5F core of the AC8025 chip, and the R5F core will reset the IVI domain of the DPU. Step 2: If the watchdog module of the Safety domain of the AC8025 chip to which the R5F core belongs detects an abnormality in the system operation of its Safety domain, it will actively perform a hardware reset. Step 3: The error detection module within the Safety domain is responsible for aggregating error information from various modules; Step 4: The error detection module transmits the system error information to the MCU through its signal pins.

2. The reversing video fixation detection method according to claim 1, characterized in that: The specific processing steps of the adhesion detection module 1 in step 5 are as follows: The fixation detection module 1 performs frame-by-frame CRC check on the images in the RVC Video of the AC8025 chip. If the calculated CRC result is the same for more than 30 consecutive frames, it is judged as fixed image; if any frame is different, the fixation is released. When no video fixation is detected, the R5F core in the AC8025 chip outputs the reversing video signal to Layer 0 of the internal DPU, and the A75 core in the chip outputs the UI interface to Layer 1 of the DPU. The two types of data are superimposed by the DPU's Mixer and then sent to the display screen for display. If video freezing is detected, the R5F core is notified not to output the reversing video signal, but instead output a black image to Layer0. The A75 core still outputs the UI interface to Layer1. The black image of Layer0 and the UI of Layer1 are superimposed in the Mixer and then sent to the display screen for display.

3. The reversing video fixation detection method according to claim 2, characterized in that: The specific processing steps of the adhesion detection module 2 in step 5 are as follows: The fixation detection module 2 performs frame-by-frame CRC verification on the images in the LVDS module of the AC8025 chip. It determines whether the image is fixed by calculating the CRC result. If it is determined to be fixed, it notifies the R5F core of the AC8025 chip through a callback.

4. The reversing video fixation detection method according to claim 3, characterized in that: If the fixed video detected by fixed detection module 1 and fixed detection module 2 is greater than 300 frames, then Layer1 is notified not to output images for overlay. The R5F core outputs the reversing video signal to Layer0. The Mixer only outputs the reversing video transmitted from Layer0 and sends it to the display screen for display.

5. A reversing video fixation detection system, characterized in that: The reversing video fixation detection method according to any one of claims 1-4 includes a Camera System, which is a reversing camera system used to acquire reversing video and output GVIF3 signal. The Camera System is connected to ADAS, which is used for video synthesis processing and sends the processed reversing video to AVN. The ADAS is connected to AVN.

6. The reversing video fixation detection system according to claim 5, characterized in that: AVN includes a video deserializer, which is connected to the SOC. The SOC is connected to both the MCU and the display screen.

7. The reversing video fixation detection system according to claim 6, characterized in that: The video deserializer uses the CXD4966 chip to convert GVIF3 signals into CSI signals. The CXD4966 chip is connected to both ADAS and SOC.

8. The reversing video fixation detection system according to claim 7, characterized in that: The AC8025 SOC chip is a central processing unit responsible for video stream switching and fixation detection. The AC8025 SOC chip is connected to the MCU, the CXD4966 chip, and the display screen.

9. The reversing video fixation detection system according to claim 8, characterized in that: The MCU chip R7F7015873AFP-C is a microcontroller responsible for detecting the reversing signal. The MCU chip R7F7015873AFP-C is connected to the SOC chip AC8025.

Images