Camera offline monitoring method, device, vehicle and computer-readable storage medium

Abstract

The present invention discloses a camera offline monitoring method, device, vehicle and computer-readable storage medium, and belongs to the technical field of vehicle assisted driving. The present invention monitors whether there is a camera offline anomaly in real time, grasps the operating status of a panoramic surround view system in real time, and when a camera offline anomaly is detected, determines the channel mark corresponding to the camera according to the camera offline anomaly, and handles the abnormal situation in time through the channel mark to shield the video channel corresponding to the channel mark, reduce the video acquisition deviation, ensure the image output quality of the vehicle, and perform a re-power-on operation on the camera associated with the video channel, automatically restore the operation of the camera, and delete the channel mark of the video channel associated with the camera after the re-power-on operation is performed, further restore the operation of the video channel, improve the automation and intelligence of the panoramic surround view system, and ensure the output quality of the vehicle video image.

Description

Technical Field

[0001] The present invention relates to the field of vehicle assisted driving, and in particular to a camera offline monitoring method, device, vehicle and computer-readable storage medium. Background Art

[0002] With the development of science and technology, smart cars have entered people's lives. In order to facilitate drivers to understand the real-time information around the vehicle in real time during driving, the visual assistance solution of installing multiple cameras around the vehicle body to form a panoramic surround view system has been applied to many models. As an important component of the parking assistance system, the on-board panoramic surround view system is to display the full picture of the vehicle's surrounding environment in real time, provide the driver with dynamic images around the vehicle body without blind spots, and improve driving safety. The panoramic surround view system usually sets up 4 wide-angle high-sensitivity cameras around the car to cover all the fields of view around the vehicle. The images of the front, back, left and right of the car collected at the same time are converted into digital information by the acquisition component and sent to the video synthesis and processing component. After distortion restoration, perspective conversion, image splicing, and image enhancement by the image processing unit, it is converted into an analog signal output to generate a 360-degree top view of the vehicle body, and finally displayed on the screen of the center console. Among them, the camera for image acquisition occupies a very important position. However, when a link failure occurs in one or more video links in the panoramic view system, the camera will display a black screen, causing the vehicle center console to display stuck. Even if the link failure is repaired, the camera will not be able to recover quickly from the black screen, resulting in abnormal vehicle image display. Summary of the invention

[0003] The main purpose of the present invention is to provide a camera offline monitoring method, device, vehicle and computer-readable storage medium, aiming to solve the technical problem that the camera cannot be quickly restored after a offline failure occurs in a panoramic surround view system.

[0004] To achieve the above object, the present invention provides a camera offline monitoring method, the camera offline monitoring method comprising the following steps:

[0005] Real-time monitoring of whether there is an abnormal camera offline, if the abnormal camera offline is detected, determining the channel mark corresponding to the camera according to the abnormal camera offline;

[0006] Shielding the video channel corresponding to the channel mark, and re-powering on the camera associated with the video channel;

[0007] Removes the channel tag of the video channel associated with the camera after the power cycle operation.

[0008] Optionally, the step of real-time monitoring whether there is a camera offline abnormality, and if the camera offline abnormality is detected, determining a channel mark corresponding to the camera according to the camera offline abnormality includes:

[0009] Power on the camera;

[0010] Detect in real time whether the image collector corresponding to the camera is successfully configured, and determine whether the camera has a camera offline abnormality according to whether the image collector is successfully configured;

[0011] If it is determined that the camera is offline abnormally, the video channel corresponding to the camera is marked to generate a channel mark.

[0012] Optionally, the step of detecting in real time whether the image collector corresponding to the camera is configured successfully includes:

[0013] Determine the image collector corresponding to the camera;

[0014] Pairing the encoding unit in the image collector with the decoding unit in the image collector, and determining the pairing result;

[0015] Determine in real time whether the image collector is successfully configured based on the pairing result.

[0016] Optionally, the step of pairing the encoding unit in the image collector with the decoding unit in the image collector and determining the pairing result includes:

[0017] Pairing the encoding unit with the decoding unit;

[0018] If the pairing is successful, the pairing result is determined to be successful;

[0019] If the pairing fails, a preset number of pairing times is obtained, and a re-pairing operation of the encoding unit and the decoding unit is performed according to the preset number of pairing times, and a pairing result is determined according to the re-pairing operation.

[0020] Optionally, the step of performing a re-pairing operation on the encoding unit and the decoding unit according to the preset number of pairing times, and determining a pairing result according to the re-pairing operation includes:

[0021] If the preset pairing number is one, then the re-pairing operation of the encoding unit and the decoding unit is no longer performed, and the pairing result is determined to be a failure;

[0022] If the preset number of pairing times is multiple, continue the re-pairing operation of the encoding unit and the decoding unit until the encoding unit and the decoding unit are successfully paired or the number of re-pairing times corresponding to the re-pairing operation is equal to the preset number of pairing times;

[0023] The pairing result is determined according to whether the last pairing of the encoding unit and the decoding unit is successful.

[0024] Optionally, after the step of real-time monitoring whether there is an abnormal camera offline, the method further includes:

[0025] If no abnormal camera disconnection is detected, detecting whether there is video stream and / or control stream information;

[0026] If the video stream and / or control stream information exists, the start instruction is triggered, and the video channel corresponding to the start instruction is started.

[0027] Optionally, the step of triggering the start instruction if the video stream and / or control stream information exists includes:

[0028] If the video stream and / or control stream information exists, monitoring whether a preset error counter records abnormal information;

[0029] If the preset error counter does not record abnormal information, the start instruction is triggered.

[0030] In addition, to achieve the above-mentioned purpose, the present invention also provides a camera offline monitoring device, the camera offline monitoring device comprising:

[0031] The abnormality monitoring module is used to monitor in real time whether there is a camera offline abnormality. If the camera offline abnormality is detected, the channel is marked according to the camera offline abnormality;

[0032] A fault processing module, used for shielding the video channel corresponding to the channel mark, and performing a power-on operation on the camera associated with the video channel;

[0033] The mark deletion module is used to delete the channel mark of the video channel corresponding to the camera after the power-on operation is performed.

[0034] In addition, to achieve the above-mentioned purpose, the present invention also provides a vehicle, comprising a memory, a processor, and a camera offline monitoring program stored in the memory and executable on the processor, wherein: when the camera offline monitoring program is executed by the processor, the steps of the camera offline monitoring method as described above are implemented.

[0035] In addition, to achieve the above-mentioned purpose, the present invention also provides a computer-readable storage medium, on which a camera offline monitoring program is stored. When the camera offline monitoring program is executed by a processor, the steps of the camera offline monitoring method as described above are implemented.

[0036] The present invention proposes a camera offline monitoring method, device, vehicle and computer-readable storage medium, which monitor in real time whether there is a camera offline anomaly, grasp the operating status of a panoramic surround view system in real time, and when a camera offline anomaly is detected, determine the channel mark corresponding to the camera according to the camera offline anomaly, and handle the abnormal situation in time through the channel mark to shield the video channel corresponding to the channel mark, reduce the video acquisition deviation, ensure the image output quality of the vehicle, and perform a power-on operation on the camera associated with the video channel to automatically restore the operation of the camera, and delete the channel mark of the video channel associated with the camera after the power-on operation is performed, further restore the operation of the video channel, improve the automation and intelligence of the panoramic surround view system, and ensure the output quality of the vehicle video image. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] Figure 1 It is a schematic diagram of the structure of a vehicle in a hardware operating environment involved in an embodiment of the present invention;

[0038] Figure 2 A schematic diagram of the process of the first embodiment of the camera offline monitoring method of the present invention;

[0039] Figure 3 It is a structural schematic diagram of the camera offline monitoring device of the present invention.

[0040] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0041] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.

[0042] Reference Figure 1 , Figure 1 A schematic diagram of the vehicle structure of the hardware operating environment involved in the embodiment of the present invention.

[0043] like Figure 1As shown, the vehicle may include: a processor 1001, such as a central processing unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a wireless fidelity (WIreless-FIdelity, WI-FI) interface). The memory 1005 may be a high-speed random access memory (Random Access Memory, RAM) memory, or a stable non-volatile memory (Non-Volatile Memory, NVM), such as a disk memory. The memory 1005 may also be a storage device independent of the aforementioned processor 1001.

[0044] Those skilled in the art will understand that Figure 1 The structure shown in the figure does not constitute a limitation on the vehicle, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.

[0045] like Figure 1 As shown, the memory 1005 as a computer-readable storage medium may include an operating system, a data storage module, a network communication module, a user interface module, and a camera offline monitoring program.

[0046] exist Figure 1 In the vehicle shown, the network interface 1004 is mainly used for data communication with other devices; the user interface 1003 is mainly used for data interaction with the user; the processor 1001 and the memory 1005 in the vehicle of the present invention can be set in the vehicle, and the vehicle calls the camera offline monitoring program stored in the memory 1005 through the processor 1001, and executes the camera offline monitoring method provided in the embodiment of the present invention.

[0047] The embodiment of the present invention provides a camera offline monitoring method, referring to Figure 2 , Figure 2 The present invention is a flowchart of a first embodiment of a camera offline monitoring method of the present invention.

[0048] In this embodiment, the camera offline monitoring method includes:

[0049] Step S100, real-time monitoring of whether there is a camera offline abnormality, if the camera offline abnormality is detected, determining a channel mark corresponding to the camera according to the camera offline abnormality;

[0050] In this embodiment, it should be noted that the panoramic view system sets up four to eight wide-angle cameras around the car that can cover all the fields of view around the vehicle. The acquisition component converts the multiple images collected by the camera at the same time into digital information and sends it to the video synthesis and processing component. After the distortion restoration → perspective conversion → image splicing → image enhancement of the image processing unit of the video synthesis and processing component, it is converted into an analog signal output to generate a 360-degree top view of the vehicle body around the vehicle, and finally displayed on the screen of the center console, so that the driver can clearly check whether there are obstacles around the vehicle and understand the relative position and distance of the obstacles, helping the driver to park the vehicle easily. Not only is it very intuitive, but there is no blind spot, which can improve the driver's calm control of the vehicle to park or pass through complex roads, and effectively reduce the occurrence of scratches, collisions, sinking and other accidents. The panoramic view system may include multiple cameras, and collect images around the vehicle through multiple video channels. In the application process of the panoramic surround view system, due to reasons such as link failure of the panoramic surround view system, the camera may be offline and the screen may be black, causing the display screen of the vehicle center console to be stuck. In order to quickly restore the camera and the video channel corresponding to the camera after the link failure is repaired, the camera and the related video channel are monitored in real time, and the automatic recovery mechanism is triggered to realize the offline recovery of the camera and the video channel corresponding to the camera. In this embodiment, the camera offline abnormality means that the camera is offline and cannot work; the channel mark refers to an identification mark used to feedback the operability of the current video channel. Through the channel mark, it can be fed back whether the camera has an offline abnormality and whether the video channel corresponding to the camera needs to be shielded or restored. Specifically, the camera offline abnormality is monitored in real time to determine whether the camera is offline abnormal. When the camera offline abnormality is detected, the channel mark corresponding to the camera is determined according to the offline abnormality. It can be understood that in one embodiment, the detection of the camera offline abnormality can also be performed regularly, by setting a specified time, or setting an interval time to determine the time point or time range for monitoring the camera offline abnormality, and the camera offline abnormality is monitored between the time point or time range.

[0051] Step S200, shielding the video channel corresponding to the channel mark, and performing a power-on operation on the camera associated with the video channel;

[0052] In the present embodiment, it should be noted that if there is a channel mark, it can be considered that there is an abnormality in the current video channel and it needs to be shielded, and the camera is powered on again to reinitialize the camera and restart the operation. After the camera is powered on again, it is further determined whether the video channel needs to be marked again based on whether the image acquisition device is successfully configured. When the video channel is shielded, a close instruction is triggered, and the close instruction refers to an instruction for triggering shielding of the video channel. Specifically, when the channel mark is detected, the video channel corresponding to the channel mark is determined, and the close instruction is triggered. The video channel corresponding to the channel mark is shielded by the close instruction. After the video channel is shielded, the camera associated with the channel mark is determined, and the camera is powered on again.

[0053] Step S300, deleting the channel mark of the video channel associated with the camera after the power-on operation is performed.

[0054] In this embodiment, it should be noted that after the corresponding video channel is determined according to the channel mark and the video channel is shielded, the camera will be powered on again. At this time, the camera has been restarted. In order to avoid misidentification, the previous channel mark needs to be deleted. Specifically, after determining that the camera performs a power-on operation, the channel mark of the video channel associated with the camera is deleted.

[0055] In the embodiment of the present invention, whether there is a camera offline anomaly is monitored in real time, the operating status of the panoramic view system is grasped in real time, and when the camera offline anomaly is detected, the channel mark corresponding to the camera is determined according to the camera offline anomaly, and the abnormal situation is promptly handled through the channel mark to shield the video channel corresponding to the channel mark, reduce the video acquisition deviation, ensure the image output quality of the vehicle, and perform a power-on operation on the camera associated with the video channel to automatically restore the operation of the camera, and delete the channel mark of the video channel associated with the camera after the power-on operation is performed, further restore the operation of the video channel, improve the automation and intelligence of the panoramic view system, and ensure the output quality of the vehicle video image.

[0056] Further, based on the first embodiment of the camera offline monitoring method of the present invention, a second embodiment of the camera offline monitoring method of the present invention is proposed, wherein the step S100 monitors in real time whether there is a camera offline anomaly, and if the camera offline anomaly is detected, the step of determining the channel mark corresponding to the camera according to the camera offline anomaly includes:

[0057] Step a, powering on the camera;

[0058] Step b, detecting in real time whether the image collector corresponding to the camera is successfully configured, and determining whether the camera has a camera offline abnormality according to whether the image collector is successfully configured;

[0059] Step c: if it is determined that the camera is offline abnormally, the video channel corresponding to the camera is marked to generate a channel mark.

[0060] In this embodiment, it should be noted that before the panoramic view system starts working, the system initialization configuration needs to be performed. The configuration of the image collector includes other operations related to the initialization of the image collector, such as the communication connection and communication authentication between the internal components. Among them, the configuration of the image collector for data acquisition of the camera is associated with the operation of the camera and the video channel corresponding to the camera, that is, whether there is a camera offline abnormality. If the configuration of the image collector corresponding to the camera is unsuccessful, the video channel corresponding to the camera is marked to indicate that the video channel currently has an operation abnormality. Specifically, the camera is controlled to power on, the image collector corresponding to the camera is configured, and the image collector is detected to be successfully configured. When the image collector is not successfully configured, it is determined that there is a camera offline abnormality, and the video channel corresponding to the camera is marked to generate a channel mark; when the image collector is successfully configured, it is determined that there is no camera offline abnormality, and there is no need to mark the video channel corresponding to the camera.

[0061] In this embodiment, whether to mark the video channel is determined by the configuration result of the image collector, and the operability of the video channel corresponding to the camera is ensured before the video channel is run, thereby reducing the occurrence of black screen phenomenon and ensuring the quality of the output image.

[0062] Furthermore, the step of detecting in real time whether the image collector corresponding to the camera is configured successfully includes:

[0063] Step d, determining the image collector corresponding to the camera;

[0064] Step e, pairing the encoding unit in the image collector with the decoding unit in the image collector, and determining the pairing result;

[0065] Step f: determining in real time based on the pairing result whether the image collector is successfully configured.

[0066] In this embodiment, it should be noted that the image collector is composed of multiple units, including a coding unit and a decoding unit. The coding unit encodes the video signal and sends it to the decoding unit. After the decoding unit decodes the encoded video signal, it converts it into an image signal and sends it to the image output module to achieve the output of the image in the vehicle center console. When configuring the image collector, it is necessary to pair the coding unit and the decoding unit to determine whether the image collector is configured successfully based on the pairing result after the coding unit and the decoding unit are paired. Specifically, determine the image collector corresponding to the camera, and pair the coding unit and the decoding unit in the image collector to determine whether the coding unit is paired successfully with the decoding unit. If the coding unit is paired successfully with the decoding unit, it is determined that the image collector is paired successfully. If the coding unit fails to pair with the decoding unit, it is determined that the image collector configuration fails.

[0067] In this embodiment, by pairing the encoding unit and the decoding unit of the image collector, the effectiveness of image transmission is ensured, the occurrence of abnormal video image output is reduced, and the stability of link operation is improved.

[0068] Furthermore, the step of pairing the encoding unit in the image collector with the decoding unit in the image collector and determining the pairing result includes:

[0069] Step g, pairing the encoding unit with the decoding unit;

[0070] Step h: if the pairing is successful, determining the pairing result is successful;

[0071] Step i: If the pairing fails, a preset number of pairing times is obtained, and a re-pairing operation of the encoding unit and the decoding unit is performed according to the preset number of pairing times, and a pairing result is determined according to the re-pairing operation.

[0072] In the present embodiment, it should be noted that the pairing of the encoding unit and the decoding unit of the image acquisition device may be performed once or multiple times. If the encoding unit and the decoding unit are successfully paired for the first time, the pairing result may be determined to be successful. If the pairing fails for the first time, a preset number of pairing times is obtained, and it is determined whether to perform a re-pairing operation on the encoding unit and the decoding unit based on the preset number of pairing times. If a re-pairing operation is performed, the pairing result is determined based on the re-pairing operation.

[0073] Specifically, the step of performing a re-pairing operation of the encoding unit and the decoding unit according to the preset number of pairing times, and determining a pairing result according to the re-pairing operation includes:

[0074] Step j, if the preset pairing number is one, then the re-pairing operation of the encoding unit and the decoding unit is no longer performed, and the pairing result is determined to be a failure;

[0075] Step k, if the preset number of pairing times is multiple, continue the re-pairing operation of the encoding unit and the decoding unit until the encoding unit and the decoding unit are successfully paired or the number of re-pairing times corresponding to the re-pairing operation is equal to the preset number of pairing times;

[0076] Step 1: Determine a pairing result based on whether the last pairing of the encoding unit and the decoding unit is successful.

[0077] In this embodiment, it should be noted that, in order to reduce link problems caused by errors, the preset number of pairings for the encoding unit and the decoding unit of the image collector is multiple, and the preset number of pairings refers to the maximum number of times the encoding unit and the decoding unit are paired. Specifically, when pairing the encoding unit and the decoding unit, the number of pairings is synchronously recorded to determine whether the first pairing of the encoding unit and the decoding unit is successful. If the first pairing of the encoding unit and the decoding unit fails, the preset number of pairings is determined to be a few times. If it is one time, the re-pairing operation of the encoding unit and the decoding unit is no longer performed, and the pairing result is determined to be a failure; if it is multiple times, the encoding unit and the decoding unit are re-paired and the number of pairings is updated. Determine whether the next pairing is required based on the result of the re-pairing of the encoding unit and the decoding unit. Specifically, when the re-pairing of the encoding unit and the decoding unit is successful, there is no need to perform the next pairing, and the image acquisition device can be considered to be successfully configured at this time; if the re-pairing of the encoding unit and the decoding unit fails, continue to perform the next pairing, and synchronously update the pairing times until the pairing times reach the preset pairing times or before the preset pairing times are reached, the encoding unit and the decoding unit are successfully paired, and the pairing is stopped. When the pairing times are less than or equal to the preset pairing times, if the pairing is successful, the pairing result is determined to be successful, and the image acquisition device is considered to be successfully configured; if no pairing is successful when the pairing times are less than or equal to the preset pairing times, the pairing result is determined to be failed, and the image acquisition device is considered to be configured unsuccessfully.

[0078] In this embodiment, multiple pairing opportunities are provided for the encoding unit and the decoding unit to reduce link problems caused by errors, reduce the occurrence of black screen phenomena, and ensure the effectiveness of video acquisition.

[0079] Furthermore, after the step of determining the pairing result according to whether the last pairing of the encoding unit and the decoding unit is successful, the method further includes:

[0080] Step m, determining a pairing counter for recording the number of pairings;

[0081] Step n, initializing the pairing counter.

[0082] In this embodiment, it should be noted that the number of pairings between the encoding unit and the decoding unit of the image collector is recorded by a pairing counter, and the pairing counter is updated and recorded once each time the pairing occurs, so as to limit the number of pairings between the encoding unit and the decoding unit to within a limit range corresponding to a preset number of pairings. After the pairing result between the encoding unit and the decoding unit is obtained, the pairing counter needs to be initialized, that is, the data recorded by the pairing counter is cleared and reset, so that the pairing number is recorded again when the encoding unit and the decoding unit are monitored to be paired next time.

[0083] In this embodiment, by initializing the pairing counter, it is possible to avoid the situation where the pairing is abnormal due to abnormal recording of the number of pairing times, thereby ensuring the accuracy of the pairing result.

[0084] Furthermore, after the step of real-time monitoring whether there is an abnormal camera offline, the following steps are also included:

[0085] Step o, if the camera offline abnormality is not detected, then detecting whether there is video stream and / or control stream information;

[0086] Step p: if the video stream and / or control stream information exists, trigger the start instruction and start the video channel corresponding to the start instruction.

[0087] In this embodiment, it should be noted that the determination of the abnormal camera disconnection is determined according to the configuration of the image acquisition corresponding to the camera, and whether there is a synchronization signal, video stream and / or control stream information in the current video channel. When the configuration of the image acquisition corresponding to the camera is abnormal, or the current path loses the synchronization signal, video stream and / or control stream information, the video channel can be marked as a channel so that the video channel is shielded. When it is determined that there is no channel mark, it can be confirmed that the video channel is currently in an operational state. At this time, the video stream and control stream information are detected to determine whether it is necessary to trigger the opening of the video channel so that the video channel is turned on or resumed. The opening instruction refers to an instruction to open the video channel. After the opening instruction is triggered, the shutter of the camera corresponding to the video channel can be triggered by the opening instruction to start collecting images around the vehicle. Specifically, if the abnormal camera disconnection is not detected, the video stream and / or control stream information are detected to determine whether there is a video stream and / or control stream information. When the video stream and / or control stream information is detected, the opening instruction is triggered, and the video channel corresponding to the opening instruction is opened by the opening instruction.

[0088] In this embodiment, by detecting whether there is video stream and / or control stream information, when it is determined that the current video channel is normal, it is determined whether it is necessary to trigger the opening of the video channel according to the video stream and / or control stream information, thereby providing a reference basis for opening the video channel, so that when the video stream and / or control stream information is monitored, the opening instruction is triggered, and the video channel corresponding to the opening instruction is opened, and the operation of the video channel is automatically restored, thereby reducing the video acquisition deviation and ensuring the image output quality of the vehicle.

[0089] Furthermore, if the video stream and / or control stream information exists, the step of triggering the start instruction includes:

[0090] Step q, if the video stream and / or control stream information exists, monitoring whether a preset error counter records abnormal information;

[0091] Step r: If the preset error counter does not record abnormal information, triggering an opening instruction.

[0092] In this embodiment, it should be noted that the preset error counter is used to record the number of abnormalities in the link. If link abnormality information is monitored, the preset error counter is triggered to update the number of abnormalities. Specifically, after detecting the video stream and / or control stream information, if the preset error counter records abnormal information, it can be considered that there is an abnormality in the current link, and the camera needs to be powered on again to quickly resume operation; if the preset error counter does not record abnormal information, it can be considered that the current link is running normally, and the start instruction can be triggered to start the video channel and control the execution of image acquisition.

[0093] In this embodiment, whether there is abnormal information is determined by presetting an error counter, which provides a reference for whether to trigger the opening of the video channel and ensures the stability of the operation of the video channel.

[0094] In addition, reference Figure 3 The present invention also provides a camera offline monitoring device, the camera offline monitoring device comprising:

[0095] The abnormality monitoring module 2001 is used to monitor in real time whether there is a camera offline abnormality. If the camera offline abnormality is detected, the channel is marked according to the camera offline abnormality;

[0096] The fault processing module 2002 is used to shield the video channel corresponding to the channel mark and perform a power-on operation on the camera associated with the video channel;

[0097] The mark deletion module 2003 is used to delete the channel mark of the video channel corresponding to the camera after the power-on operation is performed.

[0098] Optionally, the abnormality monitoring module 2001 is further used to:

[0099] Power on the camera;

[0100] Detect in real time whether the image collector corresponding to the camera is successfully configured, and determine whether the camera has a camera offline abnormality according to whether the image collector is successfully configured;

[0101] If it is determined that the camera is offline abnormally, the video channel corresponding to the camera is marked to generate a channel mark.

[0102] Optionally, the abnormality monitoring module 2001 is further used to:

[0103] Determine the image collector corresponding to the camera;

[0104] Pairing the encoding unit in the image collector with the decoding unit in the image collector, and determining the pairing result;

[0105] Determine in real time whether the image collector is successfully configured based on the pairing result.

[0106] Optionally, the abnormality monitoring module 2001 is further used to:

[0107] Pairing the encoding unit with the decoding unit;

[0108] If the pairing is successful, the pairing result is determined to be successful;

[0109] If the pairing fails, a preset number of pairing times is obtained, and a re-pairing operation of the encoding unit and the decoding unit is performed according to the preset number of pairing times, and a pairing result is determined according to the re-pairing operation.

[0110] Optionally, the abnormality monitoring module 2001 is further used to:

[0111] If the preset pairing number is one, then the re-pairing operation of the encoding unit and the decoding unit is no longer performed, and the pairing result is determined to be a failure;

[0112] If the preset number of pairing times is multiple, continue the re-pairing operation of the encoding unit and the decoding unit until the encoding unit and the decoding unit are successfully paired or the number of re-pairing times corresponding to the re-pairing operation is equal to the preset number of pairing times;

[0113] The pairing result is determined according to whether the last pairing of the encoding unit and the decoding unit is successful.

[0114] Optionally, the abnormality monitoring module 2001 is further used to:

[0115] If no abnormal camera disconnection is detected, detecting whether there is video stream and / or control stream information;

[0116] If the video stream and / or control stream information exists, the start instruction is triggered, and the video channel corresponding to the start instruction is started.

[0117] Optionally, the abnormality monitoring module 2001 is further used to:

[0118] If the video stream and / or control stream information exists, monitoring whether a preset error counter records abnormal information;

[0119] If the preset error counter does not record abnormal information, the start instruction is triggered.

[0120] The specific implementation of the camera offline monitoring device of the present invention is basically the same as the embodiments of the above-mentioned camera offline monitoring method, and will not be repeated here.

[0121] In addition, the present invention also proposes a vehicle, characterized in that the vehicle includes a memory, a processor, and a camera offline monitoring program stored in the memory and executable on the processor, wherein: when the camera offline monitoring program is executed by the processor, the camera offline monitoring method described in each embodiment of the present invention is implemented.

[0122] In addition, the present invention also provides a computer-readable storage medium on which a camera offline monitoring program is stored. The computer-readable storage medium may be Figure 1 The memory 20 in the terminal may also be at least one of a ROM (Read-Only Memory) / RAM (Random Access Memory), a magnetic disk, and an optical disk. The computer-readable storage medium includes a plurality of instructions for enabling a vehicle with a processor to execute the camera offline monitoring method described in each embodiment of the present invention.

[0123] It is understood that, in the description of this specification, the description with reference to the terms "one embodiment", "another embodiment", "other embodiments", or "first to Nth embodiments" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0124] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or system. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or system including the element.

[0125] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0126] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a computer-readable storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes a number of instructions for enabling a terminal device (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present invention.

[0127] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A camera offline monitoring method, characterized in that: The camera offline monitoring method is applied to a panoramic surround view system, and the method comprises the following steps: Real-time monitoring of whether there is an abnormal camera offline, if the abnormal camera offline is detected, determining the channel mark corresponding to the camera according to the abnormal camera offline; Shielding the video channel corresponding to the channel mark, and re-powering on the camera associated with the video channel; Deleting the channel tag of the video channel associated with the camera after the power-on operation; The step of real-time monitoring whether there is a camera offline abnormality, and if the camera offline abnormality is detected, determining a channel mark corresponding to the camera according to the camera offline abnormality comprises: Power on the camera; Determine the image collector corresponding to the camera; Pairing the encoding unit in the image collector with the decoding unit in the image collector, and determining the pairing result; Determine in real time whether the image collector is successfully configured according to the pairing result, and determine whether the camera has a camera offline abnormality according to whether the image collector is successfully configured; If it is determined that the camera is offline abnormally, the video channel corresponding to the camera is marked to generate a channel mark.

2. The camera offline monitoring method according to claim 1, characterized in that: The step of pairing the encoding unit in the image collector with the decoding unit in the image collector and determining the pairing result comprises: Pairing the encoding unit with the decoding unit; If the pairing is successful, the pairing result is determined to be successful; If the pairing fails, a preset number of pairing times is obtained, and a re-pairing operation of the encoding unit and the decoding unit is performed according to the preset number of pairing times, and a pairing result is determined according to the re-pairing operation.

3. The camera offline monitoring method according to claim 2, characterized in that: The step of performing a re-pairing operation of the encoding unit and the decoding unit according to the preset number of pairing times, and determining a pairing result according to the re-pairing operation comprises: If the preset pairing number is one, then the re-pairing operation of the encoding unit and the decoding unit is no longer performed, and the pairing result is determined to be a failure; If the preset number of pairing times is multiple, continue the re-pairing operation of the encoding unit and the decoding unit until the encoding unit and the decoding unit are successfully paired or the number of re-pairing times corresponding to the re-pairing operation is equal to the preset number of pairing times; The pairing result is determined according to whether the last pairing of the encoding unit and the decoding unit is successful.

4. The camera offline monitoring method according to claim 1, characterized in that: After the step of real-time monitoring whether there is an abnormal camera offline, the method further includes: If no abnormal camera disconnection is detected, detecting whether there is video stream and / or control stream information; If the video stream and / or control stream information exists, the start instruction is triggered, and the video channel corresponding to the start instruction is started.

5. The camera offline monitoring method according to claim 4, characterized in that: The step of triggering the start instruction if the video stream and / or control stream information exists includes: If the video stream and / or control stream information exists, monitoring whether a preset error counter records abnormal information; If the preset error counter does not record abnormal information, the start instruction is triggered.

6. A camera offline monitoring device, characterized in that: The camera offline monitoring device is applied to a panoramic surround view system, and the device comprises: The abnormality monitoring module is used to monitor in real time whether there is a camera offline abnormality. If the camera offline abnormality is detected, a channel mark is performed according to the camera offline abnormality. The abnormality monitoring module is also used to perform a power-on operation on the camera; determine the image collector corresponding to the camera; pair the encoding unit in the image collector with the decoding unit in the image collector, and determine the pairing result; determine in real time based on the pairing result whether the image collector is successfully configured, and determine whether the camera has a camera offline abnormality according to whether the image collector is successfully configured; if it is determined that the camera is offline abnormal, the video channel corresponding to the camera is marked to generate a channel mark; A fault processing module, used for shielding the video channel corresponding to the channel mark, and performing a power-on operation on the camera associated with the video channel; The mark deletion module is used to delete the channel mark of the video channel corresponding to the camera after the power-on operation is performed.

7. A vehicle, characterized in that: The vehicle comprises: a memory, a processor, and a camera offline monitoring program stored in the memory and executable on the processor, wherein the camera offline monitoring program is configured to implement the steps of the camera offline monitoring method according to any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a camera offline monitoring program, and when the camera offline monitoring program is executed by the processor, the steps of the camera offline monitoring method according to any one of claims 1 to 5 are implemented.

Images