Panoramic bit error rate monitoring method, device, system and vehicle

Abstract

The invention relates to the technical field of vehicles, in particular to a panoramic error rate monitoring method, device and system and a vehicle, and the method comprises the steps: obtaining the starting time of video stream transmission between a vehicle-mounted terminal deserializer and multiple cameras of a panoramic system; starting from the starting moment of video stream transmission, periodically reading bit error rate data of each camera in a panoramic system from a vehicle machine deserializer, and starting an engineering mode of a vehicle; and in the engineering mode, storing the accumulated bit error rate data of each path of camera into a memory variable, displaying the bit error rate data of each path of camera in the memory variable on a display interface of the engineering mode, and storing the accumulated bit error rate data of each path of camera in the memory variable after the vehicle is powered off. Therefore, the problems of high troubleshooting difficulty, long period, low efficiency and the like caused by loss of error code data after power failure of the integrated panorama and difficulty in reproduction of error code conditions when faults occur in related technologies are solved.

Description

Technical Field

[0001] The present application relates to the field of vehicle technology, and in particular to a panoramic bit error rate monitoring method, device, system and vehicle. Background Art

[0002] As a key driver assistance feature, panoramic imaging systems are widely used for parking and driving safety monitoring. Images are captured by four cameras (front, rear, left, and right) and transmitted to the vehicle's computer system via a serial link, providing a 360-degree panoramic image. Video signal transmission relies on the serial link. The camera uses a serial chip to convert parallel signals into serial signals, which are then transmitted to the vehicle's system-level chip for image data processing.

[0003] However, long link transmissions can be affected by electromagnetic interference, vibration, and environmental changes, leading to signal errors. Related technologies store bit error rate data in non-volatile memory, and the error information can be read using external diagnostic equipment. However, the error data is only valid when the vehicle is powered on and is cleared after power is removed. This makes it impossible to reproduce the error conditions at the time of the fault, complicating troubleshooting. Summary of the Invention

[0004] The present application provides a panoramic bit error rate monitoring method, device, vehicle and storage medium to solve the problems in related technologies such as the loss of error data after power failure in the integrated panoramic view, making it difficult to reproduce the error situation when the fault occurs, resulting in difficulty in troubleshooting, long cycle and low efficiency.

[0005] The first aspect of the present application provides a panoramic bit error rate monitoring method, including the following steps: obtaining the start time of video stream transmission between a vehicle-mounted deserializer and multiple cameras of a panoramic system; starting from the start time of video stream transmission, periodically reading the bit error rate data of each camera in the panoramic system from the vehicle-mounted deserializer, and starting the engineering mode of the vehicle; in the engineering mode, storing the accumulated bit error rate data of each camera in a memory variable, displaying the bit error rate data of each camera in the memory variable on a display interface of the engineering mode, and saving the accumulated bit error rate data of each camera in the memory variable after the vehicle is powered off.

[0006] Optionally, in one embodiment of the present application, the accumulated bit error rate data of each camera in the memory variable is saved after the vehicle is powered off, and it also includes: using the vehicle's local non-volatile memory to store the accumulated bit error rate data of each camera, and / or uploading the accumulated bit error rate data of each camera to the cloud.

[0007] Optionally, in one embodiment of the present application, after saving the bit error rate data of each camera accumulated in the memory variable after the vehicle is powered off, it also includes: locating the faulty camera link in the panoramic system based on the bit error rate data of each camera.

[0008] Optionally, in one embodiment of the present application, the vehicle-mounted deserializer is provided with a plurality of registers, and the bit error rate data of each camera is stored in a different register.

[0009] Optionally, in one embodiment of the present application, the vehicle-computer deserializer is connected to the camera driver, and a middleware server and a middleware client are set between the camera driver and the engineering mode. In the engineering mode, the accumulated bit error rate data of each camera is stored in the memory variable, including: the bit error rate data of each camera read by the camera driver is transparently transmitted to the middleware server, the middleware server transmits the bit error rate data of each camera to the middleware client, and the middleware client transmits the bit error rate data of each camera to the memory variable in the engineering mode through the middleware protocol.

[0010] Optionally, in one embodiment of the present application, before periodically reading the bit error rate data of each camera in the panoramic system from the vehicle computer deserializer, it also includes: obtaining the processor performance of the vehicle computer and the stability level of the camera link in the panoramic system; setting the reading period according to the processor performance and stability level.

[0011] Optionally, in one embodiment of the present application, before obtaining the start time of video stream transmission between the vehicle-mounted deserializer and the multi-channel cameras of the panoramic system, it also includes: initializing the multi-channel cameras of the panoramic system after the vehicle is powered on; establishing a video stream connection handshake protocol between the vehicle-mounted deserializer and the serializer of the multi-channel cameras; and starting video stream transmission after the handshake between the vehicle-mounted deserializer and the serializer of the multi-channel cameras is successful.

[0012] The second aspect of the present application provides a panoramic bit error rate monitoring device, including: an acquisition module, used to obtain the starting time of video stream transmission between the vehicle-mounted deserializer and multiple cameras of the panoramic system; a reading module, used to periodically read the bit error rate data of each camera in the panoramic system from the vehicle-mounted deserializer starting from the starting time of the video stream transmission, and start the engineering mode of the vehicle; a monitoring module, used to store the accumulated bit error rate data of each camera in a memory variable in the engineering mode, display the bit error rate data of each camera in the memory variable on the display interface of the engineering mode, and save the accumulated bit error rate data of each camera in the memory variable after the vehicle is powered off.

[0013] Optionally, in one embodiment of the present application, the monitoring module is further used to use the vehicle's local non-volatile memory to store the accumulated bit error rate data of each camera, and / or upload the accumulated bit error rate data of each camera to the cloud.

[0014] Optionally, in one embodiment of the present application, the panoramic bit error rate monitoring device further includes: a positioning module, which is used to locate the faulty camera link in the panoramic system based on the bit error rate data of each camera after saving the bit error rate data of each camera accumulated in the memory variable after the vehicle is powered off.

[0015] Optionally, in one embodiment of the present application, the vehicle-mounted deserializer is provided with a plurality of registers, and the bit error rate data of each camera is stored in a different register.

[0016] Optionally, in one embodiment of the present application, the monitoring module is further used to transmit the bit error rate data of each camera read by the camera driver to the server of the middleware, and the server of the middleware transmits the bit error rate data of each camera to the client of the middleware, and the client of the middleware transmits the bit error rate data of each camera to the memory variable in the engineering mode through the middleware protocol.

[0017] Optionally, in one embodiment of the present application, the panoramic bit error rate monitoring device further includes: a reading module, which is used to obtain the processor performance of the vehicle computer and the stability level of the camera link in the panoramic system before periodically reading the bit error rate data of each camera in the panoramic system from the vehicle computer deserializer, and set the reading cycle according to the processor performance and stability level.

[0018] Optionally, in one embodiment of the present application, the panoramic bit error rate monitoring device further includes: an initialization module, used to initialize the multi-channel cameras of the panoramic system before obtaining the start time of the video stream transmission between the vehicle-machine deserializer and the multi-channel cameras of the panoramic system after the vehicle is powered on; a connection module, used to establish a video stream connection handshake protocol between the vehicle-machine deserializer and the serializer of the multi-channel cameras; a transmission module, used to start video stream transmission after the handshake between the vehicle-machine deserializer and the serializer of the multi-channel cameras is successful.

[0019] The third aspect of the present application provides a panoramic bit error rate monitoring system, including: a vehicle-mounted deserializer, multiple cameras of a panoramic system, a camera driver, a middleware server, a middleware client, and an engineering mode display interface, wherein the vehicle-mounted deserializer is connected to the camera driver, and the camera driver periodically reads the bit error rate data of each camera in the panoramic system from the vehicle-mounted deserializer starting from the start time of video stream transmission, and transparently transmits it to the middleware server; the middleware server transmits the bit error rate data of each camera to the middleware client, and the middleware client transmits the bit error rate data of each camera to a memory variable in engineering mode through a middleware protocol; in engineering mode, the accumulated bit error rate data of each camera is stored in the memory variable, the bit error rate data of each camera in the memory variable is displayed on the engineering mode display interface, and the accumulated bit error rate data of each camera in the memory variable is saved after the vehicle is powered off.

[0020] The fourth aspect of the present application provides a vehicle, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement a panoramic bit error rate monitoring method as described in the above embodiment.

[0021] Therefore, this application has the following beneficial effects:

[0022] The embodiment of the present application can periodically read the bit error rate data of each camera at the beginning of the video stream transmission, start the engineering mode of the vehicle, and realize real-time monitoring of the quality of video stream transmission. In engineering mode, the accumulated bit error rate data will be stored in the memory variable and displayed in the engineering mode interface to provide an accurate error record, which is convenient for tracing and locating the specific problem link when a fault occurs. In addition, after the vehicle is powered off, the accumulated bit error rate data in the memory variable is saved after the vehicle is powered off, thereby avoiding the problem of data loss after power failure and solving the problem of difficulty in reproducing the fault. It is then possible to obtain the bit error value of any camera system link signal, accurately locate the problem, reduce the troubleshooting cycle when the panoramic system is abnormal, improve the troubleshooting efficiency, and enhance the user experience. Thus, it solves the problem that the integrated panoramic view in the related technology loses the error data after power failure, making it difficult to reproduce the error situation when the fault occurs, resulting in difficulty in troubleshooting, long cycle, and low efficiency.

[0023] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0025] Figure 1 This is a flowchart of a panoramic bit error rate monitoring method provided according to an embodiment of the present application;

[0026] Figure 2 A schematic diagram of a panoramic bit error rate monitoring system provided according to one embodiment of the present application;

[0027] Figure 3 This is an example diagram of a panoramic bit error rate monitoring device provided according to an embodiment of the present application;

[0028] Figure 4 A schematic structural diagram of a vehicle provided according to an embodiment of the present application. DETAILED DESCRIPTION

[0029] The following describes in detail embodiments of the present application. Examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present application, and should not be construed as limiting the present application.

[0030] The following describes, with reference to the accompanying drawings, a panoramic bit error rate monitoring method, apparatus, vehicle, and storage medium according to embodiments of the present application. To address the issues mentioned in the background art, the present application provides a panoramic bit error rate monitoring method. In this method, embodiments of the present application periodically read the bit error rate data for each camera at the start of video stream transmission, activate the vehicle's engineering mode, and implement real-time monitoring of video stream transmission quality. In engineering mode, the accumulated bit error rate data is stored in a memory variable and displayed in the engineering mode interface, providing an accurate error record and facilitating tracing and locating the specific problematic link when a fault occurs. Furthermore, after the vehicle is powered off, the accumulated bit error rate data in the memory variable is saved, thereby avoiding data loss after power outages and resolving the difficulty of reproducing faults. This allows the bit error value of any camera system link signal to be obtained, accurately locating the problem, reducing the troubleshooting cycle for panoramic system anomalies, improving troubleshooting efficiency, and enhancing the user experience. This solves the problem in related technologies where integrated panoramic systems lose error data after power outages, making it difficult to reproduce the error conditions at the time of the fault, resulting in difficult, lengthy, and inefficient troubleshooting.

[0031] Specifically, Figure 1 A flowchart of a panoramic bit error rate monitoring method provided in an embodiment of the present application.

[0032] like Figure 1 As shown, the panoramic bit error rate monitoring method includes the following steps:

[0033] In step S101 , the start time of video stream transmission between the vehicle-mounted deserializer and the multi-channel cameras of the panoramic system is obtained.

[0034] The vehicle-mounted deserializer converts the serial video signal from the camera back into a parallel signal so that the onboard computing platform can process the image data. Video streaming refers to the process of transmitting continuous video data captured by a camera over a network or data link. In a panoramic imaging system, the video captured by the camera is encoded into a data stream and sent to the vehicle-mounted computer via a serial transmission link. The deserializer on the vehicle-mounted computer receives and recovers the data, processes it, and ultimately displays it on the vehicle screen, enabling 360-degree panoramic imaging or other driver assistance features.

[0035] It is understandable that the start time of obtaining the video stream in the embodiment of the present application clarifies the starting point of the video stream transmission, so that the bit error rate monitoring starts from the valid data and avoids the statistics of invalid information. In fault diagnosis, the bit error rate data combined with the timestamp is helpful to analyze the error change trend and accurately locate the problem. In addition, the engineering mode of some vehicles relies on the start of the video stream as a trigger condition. This step lays the foundation for subsequent data storage and display, thereby ensuring the accuracy and consistency of the bit error rate data collection and providing reliable support for troubleshooting.

[0036] In step S102 , starting from the start of the video stream transmission, the bit error rate data of each camera in the panoramic system is periodically read from the vehicle deserializer to start the vehicle's engineering mode.

[0037] Among them, the bit error rate data refers to the proportion of erroneous bits caused by factors such as signal interference and poor transmission quality during the data transmission process. For example, the frame rate of the camera data stream in the embodiment of the present application can be 30 frames / s. Errors may occur in the data packets of each frame. If an error occurs, a bit error will be generated, which will be accumulated. Periodic reading refers to the repeated acquisition of specific data at regular intervals or at a certain interval. It can be set according to actual conditions. For example, the reading period can be set to 2s, 3s, etc., without specific limitations. For example, a 2s periodicity is set to read the bit error value from the deserializer. Engineering mode is a special mode in the vehicle system, which is used for debugging, diagnosis, testing and other functions of the vehicle. After being enabled, it can provide more diagnostic information, data storage and setting functions, and is usually used for troubleshooting and performance debugging.

[0038] As you can see, by reading the bit error rate data for each camera and activating engineering mode at the start of video streaming, we can ensure real-time monitoring of bit errors during video streaming, preventing data delays or loss. Periodically reading data and activating engineering mode can help accurately identify and locate link issues with faulty cameras, allowing for timely detection and troubleshooting.

[0039] In step S103, in engineering mode, the accumulated bit error rate data of each camera is stored in a memory variable, and the bit error rate data of each camera in the memory variable is displayed on the display interface of engineering mode. After the vehicle is powered off, the accumulated bit error rate data of each camera in the memory variable is saved.

[0040] In engineering mode, hexadecimal accumulation can be used. Based on the vehicle lifecycle and vehicle usage, using hexadecimal error accumulation ensures data overflow.

[0041] As you can see, saving the accumulated bit error rate data in the memory variables after the vehicle is powered off effectively avoids the risk of data loss due to power outages, ensuring that this data is retained after a power outage and supporting subsequent analysis and application. Furthermore, displaying this data in real time allows maintenance personnel or technicians to promptly understand the signal quality of each camera, quickly locate the source of the problem, and improve troubleshooting efficiency.

[0042] For example, after the vehicle is powered on, it begins reading error data from each camera and enables engineering mode. Assuming each camera's video stream has a frame rate of 30 frames per second and a bit error can occur every second, the accumulated bit error data for each camera will reach two every two seconds. The accumulated error values ​​for each camera are stored and displayed on the engineering mode interface. Specifically, the interface displays two error data points for each of the front, rear, left, and right cameras. The vehicle's engineering mode uses hexadecimal for accumulation. As the vehicle continues to operate, error data accumulates and is stored in memory variables. After the vehicle is powered off, this accumulated error data is saved to non-volatile memory to prevent data loss.

[0043] In an embodiment of the present application, after the vehicle is powered off, the accumulated bit error rate data of each camera is saved in the memory variable, which also includes: using the vehicle's local non-volatile memory to store the accumulated bit error rate data of each camera, and / or uploading the accumulated bit error rate data of each camera to the cloud.

[0044] Non-volatile memory is a storage device that can retain data even after power is removed. It is often used to store important data or retain certain settings, records, or statistical information after the device is turned off. It is typically used to store vehicle operating data, configuration files, etc. The cloud generally refers to a remote server system that provides data storage and computing services via the internet and is used to store and analyze various types of data uploaded from the vehicle. In this embodiment of the application, the data uploaded to the cloud includes front, rear, left, and right bit error values.

[0045] It's understandable that using the vehicle's local non-volatile memory to store the accumulated bit error rate data for each camera ensures that data is retained even after a power outage, preventing information loss due to power outages and supporting long-term, stable data analysis and trend tracking. With data uploaded to the cloud, manufacturers or service providers can remotely analyze and diagnose vehicle status, reducing trips to repair shops and improving troubleshooting efficiency. By storing data in the cloud, centralized analysis of multiple vehicles can be performed to identify common failure modes or trends in system performance degradation, helping manufacturers provide early warnings and improve designs.

[0046] In an embodiment of the present application, after saving the bit error rate data of each camera accumulated in the memory variable after the vehicle is powered off, it also includes: locating the faulty camera link in the panoramic system based on the bit error rate data of each camera.

[0047] As you can see, locating faulty camera links based on each camera's bit error rate data allows for quick and accurate identification of problematic cameras or links, improving fault diagnosis efficiency. By promptly capturing bit error rate anomalies, blind troubleshooting is avoided, saving time and costs, enhancing vehicle system reliability, ensuring stable operation of the panoramic imaging system, and improving driving safety and user experience.

[0048] Suppose the video streams from the vehicle's front, rear, left, and right cameras are all transmitting normally. Suddenly, the bit error rate (BER) of the left camera increases. After monitoring the data for a period of time, it is found that the BER of the left camera continues to increase abnormally. By locating the BER data, it is possible to quickly identify the problem in the left camera link. This avoids unnecessary checks of other functioning cameras, saving time and money, and ensuring that the problem is quickly resolved, restoring normal panoramic imaging.

[0049] In an embodiment of the present application, the vehicle-mounted deserializer is provided with a plurality of registers, and the bit error rate data of each camera is stored in a different register.

[0050] Among them, the register is a small storage unit inside the chip used to store and manage data. Each register can store a specific type of data, such as bit error rate, status information, etc.

[0051] As you can see, by storing the bit error rate data for each camera in different registers within the vehicle's deserializer, the link status of each camera can be independently monitored, facilitating rapid fault location. When the bit error rate of a particular camera increases abnormally, the data in the corresponding register can be directly read to accurately determine whether the problem lies with the individual camera, the wiring harness, or the deserializer itself. This not only improves fault diagnosis efficiency but also reduces unnecessary hardware replacement and maintenance costs, enhancing the reliability and user experience of the panoramic imaging system.

[0052] In an embodiment of the present application, the vehicle-computer deserializer is connected to the camera driver, and a middleware server and a middleware client are set between the camera driver and the engineering mode. In the engineering mode, the accumulated bit error rate data of each camera is stored in the memory variable, including: the bit error rate data of each camera read by the camera driver is transparently transmitted to the middleware server, the middleware server transmits the bit error rate data of each camera to the middleware client, and the middleware client transmits the bit error rate data of each camera to the memory variable in the engineering mode through the middleware protocol.

[0053] Transparent transmission refers to the direct transmission of data from the sender to the receiver without any processing or conversion during the transmission process. It is usually used to transmit data in its original form in network communications, thus avoiding intermediate processing or format conversion. In the embodiment of the present application, the camera driver is based on the QNX camera framework, and the middleware server and client use SOME / IP (Scalable Service-Oriented Middleware over IP) to transmit and receive data.

[0054] It is understandable that the embodiment of the present application transparently transmits the bit error rate data for each camera read by the camera driver to the middleware server, ensuring that the bit error rate data can be obtained from the camera and transferred to the memory variables in the engineering mode with almost no loss, thus ensuring the integrity and accuracy of the data. At the same time, because data transmission relies on a standardized middleware protocol, the system's scalability and compatibility are improved, and it can support more cameras and different transmission requirements. This simplifies the communication process between modules, improves the stability and reliability of the entire system, and can quickly provide accurate data support, especially during fault diagnosis.

[0055] Suppose a vehicle starts up and its camera driver, based on the QNX framework, begins reading the camera video streams. Each camera generates bit error rate data during the video stream transmission. For example, if the bit error rates for the front, rear, left, and right cameras are 3, 2, 4, and 1, respectively, the camera driver transparently transmits this bit error rate data to the middleware server through the QNX camera framework. The server then uses the SOME / IP protocol to transmit each camera's bit error rate data to the middleware client. The middleware client receives this bit error data via the SOME / IP protocol and transfers it to memory variables in the vehicle's engineering mode. At this point, the bit error rate data for the front, rear, left, and right cameras are stored in the memory variables and can be displayed in real time on the engineering mode interface. The bit error rate for the front camera is 0x03 (hexadecimal), the rear camera is 0x02, the left camera is 0x04, and the right camera is 0x01.

[0056] In an embodiment of the present application, before periodically reading the bit error rate data of each camera in the panoramic system from the vehicle computer deserializer, it also includes: obtaining the processor performance of the vehicle computer and the stability level of the camera link in the panoramic system; setting the reading cycle according to the processor performance and stability level.

[0057] Benchmarking tools can be used to evaluate the processor's computing power, single-core and multi-core performance, power management, and thermal stability. High-load tasks can also be used to test response time, frame rate, and power consumption. The stability level of the surround-view system camera link can be assessed through long-term monitoring and analysis using specialized equipment in simulated environments, based on parameters such as frame loss rate, bit error rate, and interference immunity. For example, in a smart car, the processor equipped with the vehicle's computer demonstrated strong multi-core performance and low power consumption through benchmark testing, effectively supporting tasks such as navigation and voice recognition. Stability testing of the surround-view system's camera link demonstrated a low frame loss rate, signal latency less than 50 milliseconds, and strong interference immunity under normal driving conditions, resulting in high link stability. Based on the processor's high performance and the camera link's excellent stability, the camera's bit error rate data is read every 2 seconds. If the processor's performance is lower and the link stability is poor, the reading can be set to every 10 seconds, with no specific limit. This allows the reading cycle to be adjusted based on processor performance and link stability, optimizing system performance and ensuring timely monitoring of link quality.

[0058] It's understandable that dynamically adjusting the read cycle based on processor performance and link stability effectively balances system load and real-time data acquisition. When the processor is performing well, it can quickly process more data, shortening the read cycle and improving the accuracy of error monitoring. When the processor is performing poorly or the link is unstable, extending the read cycle reduces system burden and avoids excessive resource usage. This improves the data acquisition efficiency of the panoramic imaging system while ensuring accurate and timely troubleshooting.

[0059] In an embodiment of the present application, before obtaining the start time of video stream transmission between the vehicle-mounted deserializer and the multi-channel cameras of the panoramic system, it also includes: after the vehicle is powered on, initializing the multi-channel cameras of the panoramic system; establishing a video stream connection handshake protocol between the vehicle-mounted deserializer and the serializer of the multi-channel cameras; and starting video stream transmission after the handshake between the vehicle-mounted deserializer and the serializer of the multi-channel cameras is successful.

[0060] Vehicle power-up refers to turning on the vehicle's power supply, enabling the operation of the vehicle's electronic systems and related equipment, including the vehicle computer system and cameras. A serializer refers to a hardware module within a camera, such as a camera serializer chip, which converts the parallel video signals captured by the camera into serial signals for transmission via the vehicle's serial data link. The video stream connection handshake protocol refers to the protocol process for establishing a connection between the vehicle computer deserializer and the camera. During this process, both parties confirm and coordinate parameters such as the video signal transmission format and rate to ensure accurate and efficient data transmission.

[0061] It's understandable that by initializing the panoramic system's multiple cameras after the vehicle is powered on and establishing a video stream connection handshake protocol between the vehicle's deserializer and the camera's serializer, stable and synchronized video stream transmission is ensured from the outset. A successful handshake ensures smooth video stream transmission, ensuring system reliability during the initial stages, reducing transmission errors caused by connection issues, and improving communication efficiency between the camera and vehicle.

[0062] According to the panoramic bit error rate monitoring method proposed in the embodiment of the present application, the bit error rate data of each camera can be periodically read at the beginning of the video stream transmission, the engineering mode of the vehicle can be started, and real-time monitoring of the video stream transmission quality can be achieved. In engineering mode, the accumulated bit error rate data will be stored in the memory variable and displayed in the engineering mode interface to provide an accurate error record, which is convenient for tracing and locating the specific problem link when a fault occurs. In addition, after the vehicle is powered off, the accumulated bit error rate data in the memory variable is saved after the vehicle is powered off, thereby avoiding the problem of data loss after power failure and solving the problem of difficulty in reproducing the fault. It is then possible to obtain the bit error value of any camera system link signal, accurately locate the problem, reduce the troubleshooting cycle when the panoramic system is abnormal, improve the troubleshooting efficiency, and enhance the user experience. Thus, it solves the problem that the integrated panoramic view in the related technology loses the error data after power failure, making it difficult to reproduce the error situation when the fault occurs, resulting in difficulty in troubleshooting, long cycle, and low efficiency.

[0063] The following describes a method for monitoring the full-view bit error rate through a specific embodiment. Figure 2 The specific process of the panoramic bit error rate monitoring system shown is as follows:

[0064] ① When the vehicle is powered on, the vehicle deserializer and camera serializer are initialized and video stream data transmission begins. During the data transmission process, data errors, i.e., bit errors, may occur due to factors such as link quality and interference. Each bit error is recorded as +1 and stored in the vehicle deserializer register. Bit errors generated by the four camera links are stored in four different registers.

[0065] ②The QNX camera framework driver reads the deserializer register every 2 seconds to obtain the bit error value;

[0066] ③ The obtained bit error value is directly transmitted to the SOME / IP server;

[0067] ④The bit error value is transmitted from the SOME / IP server to the SOME / IP client;

[0068] ⑤ The bit error value of each camera is accumulated and displayed in the engineering mode interface, and can be saved after power off;

[0069] ⑥Upload the current error value data of each camera to the cloud before powering off, and the backend can query it in real time.

[0070] In summary, after the vehicle is powered on and the four cameras are initialized, the vehicle's deserializer chip and the camera serializer chip establish a video stream connection handshake protocol. After the handshake is successful, normal video stream transmission proceeds. The QNX camera framework driver reads the transmission link bit error count from the vehicle's deserializer every 2 seconds and transmits it to the engineering mode via the SOME / IP server and SOME / IP client. The engineering mode accumulates the bit errors in hexadecimal. After the vehicle is powered off and before entering sleep mode, this accumulated value is stored in the engineering mode and uploaded to the cloud. This allows for real-time acquisition of the signal quality bit error value for a specific camera system link, accurately locating the fault location. This solves the long and inefficient troubleshooting cycle for occasional image anomalies in one or more cameras due to physical link stability in integrated panoramic systems, thereby improving user satisfaction.

[0071] Next, a panoramic bit error rate monitoring device proposed according to an embodiment of the present application is described with reference to the accompanying drawings.

[0072] Figure 3 3 is a block diagram of a panoramic bit error rate monitoring device according to an embodiment of the present application.

[0073] like Figure 3 As shown, the panoramic bit error rate monitoring device 10 includes: an acquisition module 100 , a reading module 200 and a monitoring module 300 .

[0074] Among them, the acquisition module 100 is used to obtain the starting time of the video stream transmission between the vehicle-mounted deserializer and the multiple cameras of the panoramic system; the reading module 200 is used to periodically read the bit error rate data of each camera in the panoramic system from the vehicle-mounted deserializer starting from the starting time of the video stream transmission, and start the engineering mode of the vehicle; the monitoring module 300 is used to store the accumulated bit error rate data of each camera in the engineering mode to the memory variable, display the bit error rate data of each camera in the memory variable on the display interface of the engineering mode, and save the accumulated bit error rate data of each camera in the memory variable after the vehicle is powered off.

[0075] In one embodiment of the present application, the monitoring module 300 is further used to use the vehicle's local non-volatile memory to store the accumulated bit error rate data of each camera, and / or upload the accumulated bit error rate data of each camera to the cloud.

[0076] In one embodiment of the present application, the panoramic bit error rate monitoring device 10 further includes: a positioning module.

[0077] Among them, the positioning module is used to save the bit error rate data of each camera accumulated in the memory variable after the vehicle is powered off, and then locate the faulty camera link in the panoramic system based on the bit error rate data of each camera.

[0078] In one embodiment of the present application, the vehicle-mounted deserializer is provided with a plurality of registers, and the bit error rate data of each camera is stored in a different register.

[0079] In one embodiment of the present application, the monitoring module 300 is further used to transmit the bit error rate data of each camera read by the camera driver to the server of the middleware, and the server of the middleware transmits the bit error rate data of each camera to the client of the middleware, and the client of the middleware transmits the bit error rate data of each camera to the memory variable in the engineering mode through the middleware protocol.

[0080] In one embodiment of the present application, the panoramic bit error rate monitoring device 10 further includes: a performance module and a cycle module.

[0081] Among them, the performance module is used to obtain the processor performance of the vehicle computer and the stability level of the camera link in the panoramic system before periodically reading the bit error rate data of each camera in the panoramic system from the vehicle computer deserializer; the cycle module is used to set the reading cycle according to the processor performance and stability level.

[0082] In one embodiment of the present application, the panoramic bit error rate monitoring device 10 further includes: an initialization module, a connection module, and a transmission module.

[0083] Among them, the initialization module is used to obtain the start time of the video stream transmission between the vehicle-mounted deserializer and the multi-channel cameras of the panoramic system, and initialize the multi-channel cameras of the panoramic system after the vehicle is powered on; the connection module is used to establish a video stream connection handshake protocol between the vehicle-mounted deserializer and the serializer of the multi-channel cameras; the transmission module is used to start video stream transmission after the handshake between the vehicle-mounted deserializer and the serializer of the multi-channel cameras is successful.

[0084] It should be noted that the above explanation of the embodiment of the panoramic bit error rate monitoring method is also applicable to the panoramic bit error rate monitoring device of this embodiment, and will not be repeated here.

[0085] According to the panoramic bit error rate monitoring device proposed in the embodiment of the present application, at the beginning of the video stream transmission, the bit error rate data of each camera is periodically read, the engineering mode of the vehicle is started, and real-time monitoring of the video stream transmission quality is achieved. In engineering mode, the accumulated bit error rate data will be stored in the memory variable and displayed in the engineering mode interface to provide an accurate error record, which is convenient for tracing and locating the specific problem link when a fault occurs. In addition, after the vehicle is powered off, the accumulated bit error rate data in the memory variable is saved after the vehicle is powered off, thereby avoiding the problem of data loss after power failure and solving the problem of difficulty in reproducing the fault. It is then possible to obtain the bit error value of any camera system link signal, accurately locate the problem, reduce the troubleshooting cycle when the panoramic system is abnormal, improve the troubleshooting efficiency, and enhance the user experience. Thus, it solves the problem that the integrated panoramic view in the related technology loses the error data after power failure, making it difficult to reproduce the error situation when the fault occurs, resulting in difficulty in troubleshooting, long cycle, and low efficiency.

[0086] Figure 2 This is a schematic diagram of a panoramic bit error rate monitoring system provided by an embodiment of the present application.

[0087] like Figure 2 As shown, a panoramic bit error rate monitoring system includes: a vehicle-mounted deserializer, multiple cameras in the panoramic system, a camera driver, a middleware server, a middleware client, and an engineering mode display interface. The vehicle-mounted deserializer is connected to the camera driver. The camera driver periodically reads the bit error rate data of each camera in the panoramic system from the vehicle-mounted deserializer from the start of video stream transmission and transparently transmits it to the middleware server.

[0088] The middleware server transmits the bit error rate data of each camera to the middleware client. The middleware client transmits the bit error rate data of each camera to the memory variable in the engineering mode through the middleware protocol.

[0089] In engineering mode, the accumulated bit error rate data of each camera is stored in a memory variable. The bit error rate data of each camera in the memory variable is displayed on the display interface of engineering mode. After the vehicle is powered off, the accumulated bit error rate data of each camera in the memory variable is saved.

[0090] Figure 4 A schematic diagram of the structure of a vehicle provided in an embodiment of the present application. The vehicle may include:

[0091] Memory 401 , processor 402 , and computer programs stored in the memory 401 and executable on the processor 402 .

[0092] When the processor 402 executes the program, the panoramic bit error rate monitoring method provided in the above embodiment is implemented.

[0093] Furthermore, the vehicle further comprises:

[0094] The communication interface 403 is used for communication between the memory 401 and the processor 402 .

[0095] The memory 401 is used to store computer programs that can be run on the processor 402 .

[0096] The memory 401 may include a high-speed RAM (Random Access Memory) memory, and may also include a non-volatile memory, such as at least one disk memory.

[0097] If the memory 401, the processor 402, and the communication interface 403 are implemented independently, the communication interface 403, the memory 401, and the processor 402 can be connected to each other via a bus and communicate with each other. The bus can be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component Interconnect) bus, or an EISA (Extended Industry Standard Architecture) bus. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 4 Only one thick line is used in the diagram, but this does not mean that there is only one bus or one type of bus.

[0098] Optionally, in a specific implementation, if the memory 401, the processor 402 and the communication interface 403 are integrated on a chip, the memory 401, the processor 402 and the communication interface 403 can communicate with each other through an internal interface.

[0099] The processor 402 may be a CPU (Central Processing Unit), or an ASIC (Application Specific Integrated Circuit), or one or more integrated circuits configured to implement the embodiments of the present application.

[0100] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described can be combined in any one or N embodiments or examples in a suitable manner. In addition, those skilled in the art can combine and combine different embodiments or examples described in this specification and features of different embodiments or examples without contradiction.

[0101] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be understood to indicate or imply relative importance or implicitly specify the number of technical features indicated. Thus, a feature specified as "first" or "second" may explicitly or implicitly include at least one such feature. In the description of this application, "N" means at least two, for example, two, three, etc., unless otherwise specifically defined.

[0102] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, fragment or portion of code comprising one or N executable instructions for implementing a custom logical function or process step, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may be performed in a different order than shown or discussed, including performing functions in a substantially simultaneous manner or in a reverse order depending on the functions involved, which should be understood by those skilled in the art to which the embodiments of the present application pertain.

[0103] It should be understood that various parts of the present application can be implemented using hardware, software, firmware, or a combination thereof. In the above-described embodiments, the steps or methods can be implemented using software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented using hardware, as in another embodiment, any one of the following technologies known in the art or a combination thereof can be used to implement the method: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application-specific integrated circuit having a suitable combination of logic gate circuits, a programmable gate array, a field programmable gate array, etc.

[0104] A person skilled in the art may understand that all or part of the steps carried out in the method for implementing the above-mentioned embodiment may be completed by instructing the relevant hardware through a program, and the above-mentioned program may be stored in a computer-readable storage medium, which, when executed, includes one of the steps of the method embodiment or a combination thereof.

[0105] Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations on the present application. Ordinary technicians in this field can change, modify, replace and modify the above embodiments within the scope of the present application.

Claims

1. A panoramic bit error rate monitoring method, characterized in that: The following steps are involved: Get the start time of video stream transmission between the vehicle deserializer and the multi-channel cameras of the panoramic system; Starting from the start time of the video stream transmission, periodically reading the bit error rate data of each camera in the panoramic system from the vehicle deserializer, and starting the vehicle engineering mode; In the engineering mode, the accumulated bit error rate data of each camera is stored in a memory variable, and after the vehicle is powered off, the accumulated bit error rate data of each camera in the memory variable is saved.

2. The panoramic bit error rate monitoring method according to claim 1, characterized in that: After the vehicle is powered off, the bit error rate data of each camera accumulated in the memory variable is saved, further comprising: The accumulated bit error rate data of each camera is stored in the local non-volatile memory of the vehicle, and / or the accumulated bit error rate data of each camera is uploaded to the cloud.

3. The panoramic bit error rate monitoring method according to claim 1, wherein: After the vehicle is powered off, after the bit error rate data of each camera accumulated in the memory variable is saved, the method further includes: According to the bit error rate data of each camera, the faulty camera link in the panoramic system is located.

4. The panoramic bit error rate monitoring method according to claim 1, wherein: The vehicle-machine deserializer is provided with a plurality of registers, and the bit error rate data of each camera is stored in different registers.

5. The panoramic bit error rate monitoring method according to claim 1, wherein: The vehicle-mounted deserializer is connected to the camera driver. A middleware server and a middleware client are provided between the camera driver and the engineering mode. In the engineering mode, the accumulated bit error rate data of each camera is stored in a memory variable, including: The bit error rate data of each camera read by the camera driver is transparently transmitted to the server of the middleware, and the server of the middleware transmits the bit error rate data of each camera to the client of the middleware. The client of the middleware transmits the bit error rate data of each camera to the memory variable in the engineering mode through the middleware protocol.

6. The panoramic bit error rate monitoring method according to claim 1, characterized in that: Before periodically reading the bit error rate data of each camera in the panoramic system from the vehicle-mounted deserializer, the method further includes: Obtaining the processor performance of the vehicle computer and the stability level of the camera link in the panoramic system; The reading cycle is set according to the processor performance and the stability level.

7. The panoramic bit error rate monitoring method according to claim 1, characterized in that: Before obtaining the start time of video stream transmission between the vehicle deserializer and the multi-channel cameras of the panoramic system, the following is also included: After the vehicle is powered on, initializing the multi-channel cameras of the panoramic system; Establishing a video stream connection handshake protocol between the vehicle-mounted deserializer and the serial adder of the multi-channel camera; After the vehicle-mounted deserializer and the serial adder of the multi-channel camera successfully shake hands, video stream transmission begins.

8. A panoramic bit error rate monitoring device, characterized in that: include: An acquisition module is used to obtain the start time of video stream transmission between the vehicle deserializer and the multi-channel cameras of the panoramic system; a reading module, configured to periodically read the bit error rate data of each camera in the panoramic system from the vehicle-mounted deserializer starting from the start time of the video stream transmission, and start the vehicle's engineering mode; The monitoring module is used to store the accumulated bit error rate data of each camera in the engineering mode to a memory variable, display the bit error rate data of each camera in the memory variable on the display interface of the engineering mode, and save the accumulated bit error rate data of each camera in the memory variable after the vehicle is powered off.

9. A panoramic bit error rate monitoring system, characterized in that: include: Car machine deserializer, multi-channel cameras of panoramic system, camera driver, middleware server, middleware client and engineering mode display interface, among which, The vehicle-mounted deserializer is connected to the camera driver. The camera driver periodically reads the bit error rate data of each camera in the panoramic system from the vehicle-mounted deserializer starting from the start of video stream transmission, and transparently transmits the data to the server of the middleware. The middleware server transmits the bit error rate data of each camera to the middleware client, and the middleware client transmits the bit error rate data of each camera to the memory variable in the engineering mode through the middleware protocol; In the engineering mode, the accumulated bit error rate data of each camera is stored in a memory variable, and the bit error rate data of each camera in the memory variable is displayed on the display interface of the engineering mode. After the vehicle is powered off, the accumulated bit error rate data of each camera in the memory variable is saved.

10. A vehicle, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the panoramic bit error rate monitoring method according to any one of claims 1 to 7.

Images