Intelligent driving car test monitoring system

Through the intelligent driving car test monitoring system, wireless communication, internal display and voice communication functions are used to solve the safety risks and efficiency problems in real car testing, and a safe and efficient intelligent driving system testing is achieved.

CN114763153BActive Publication Date: 2024-11-01FAW VOLKSWAGEN AUTOMOTIVE CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202110021887.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-01-08
Publication Date
2024-11-01
Estimated Expiration
2041-01-08

AI Technical Summary

Technical Problem

There are safety risks in the actual vehicle testing of intelligent driving systems. The test process is complex and requires frequent manual intervention, which leads to safety officers who need to monitor the vehicle status and deal with potential risks at the same time, affecting the testing efficiency.

Method used

An intelligent driving car test monitoring system is designed, including vehicle-end and server-end devices, which transmit sensor information, line-based information and intelligent driving algorithm information through wireless communication, and provides internal display and voice communication functions, allowing safety officers to perform outside the vehicle. Monitoring and debugging to reduce the number of people in the car and ensure safety risks.

Benefits of technology

It realizes safe and timely monitoring and prompts in actual vehicle tests, reduces the number of testers and equipment, improves test safety and efficiency, allows safety officers to focus on safety risks, and ensures the safe and efficient testing of intelligent driving systems. .

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114763153B_ABST
    Figure CN114763153B_ABST
Patent Text Reader

Abstract

The present invention provides an intelligent driving car test monitoring system, including a vehicle-side device and a server-side device. The vehicle-side device includes a vehicle-side voice communication module, a vehicle-side internal display module, an intelligent driving car test monitoring system processor and a vehicle-side wireless transceiver module. The server-side device includes a server-side voice communication module, a server-side monitor, an intelligent driving car test monitoring system server and a server-side wireless transceiver module. Functions such as vehicle-side information prompts, server-side data information monitoring, and real-time voice communication can be realized between the vehicle-side device and the server-side device. The system reduces the number of testers and test equipment in the car during actual vehicle testing, ensures that the safety officer can smoothly communicate with the testers outside the car through voice and information, ensures that the safety officer can obtain safety prompt information in a timely manner, and ensures the safety and efficiency of the actual vehicle testing of the intelligent driving system.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Embodiments of the present invention generally relate to the field of intelligent driving technology, and more specifically, to an intelligent driving vehicle testing and monitoring system. Background Art

[0002] The rapid development and popularization of automobiles have changed people's travel methods and brought great convenience to people's lives. However, it has also brought a series of problems that need to be solved urgently, and frequent traffic accidents are one of them. According to statistics, 50 million people are injured in traffic accidents and 1.2 million people die in traffic accidents every year worldwide, with direct economic losses reaching more than 510 billion US dollars. Worldwide, the main causes of traffic accidents are generally recognized as driver violations and mistakes (fatigue driving, drunk driving, speeding, low driving level, poor psychological quality, etc.). In my country, traffic accidents caused by drivers account for about 90%. At present, intelligent driving systems have become an important future development direction of the automotive industry as a solution that can improve the safety of automobile driving and reduce traffic accidents and congestion.

[0003] Today, smart driving cars are still in the research and development stage, and smart driving systems (including but not limited to system architecture, perception algorithms, decision-making and planning algorithms, etc.) need to be frequently iterated to quickly improve maturity. Therefore, in order to verify the performance of the smart driving system, such as safety, reliability and comfort, smart driving vehicles need to undergo frequent testing and verification activities. Actual vehicle testing, including closed-field testing and open road testing, is an important part of the testing and verification activities of the smart driving system. It plays an irreplaceable and important role in ensuring the safety of smart driving cars, improving the efficiency of the research and development of smart driving systems, and shortening the development cycle of smart driving systems. Since the maturity of the smart driving system is an iterative improvement process, this situation also brings considerable safety risks to the actual vehicle testing activities.

[0004] The actual vehicle test of the intelligent driving system usually refers to the function and performance test of the intelligent driving car in a designated closed area or on a public road, with a safety officer. During the test, there will be other controlled or random traffic participants around the intelligent driving car, such as the test cooperation vehicle in the closed area as a controlled traffic participant, and pedestrians, bicycles, motorcycles, and other vehicles on the public road as random traffic participants. The safety officer sits in the driving seat of the test vehicle and is responsible for monitoring the vehicle status, timely, reasonable, and effective manual intervention, taking over and controlling the test vehicle, and avoiding safety risks. One or more algorithm engineers responsible for debugging the program are usually also in the car, monitoring and analyzing the intelligent driving system and vehicle status data in real time; when necessary, the algorithm engineer also needs to modify the algorithm and software parameters of the intelligent driving system and update the algorithm and software version. Summary of the invention

[0005] In order to solve the above problems in the prior art, an embodiment of the present invention provides an intelligent driving car test monitoring system, characterized in that the intelligent driving car test monitoring system includes a vehicle-side device and a server-side device. Wherein, the vehicle-side device includes a vehicle-side voice communication module, a vehicle-side internal display module, an intelligent driving car test monitoring system processor and a vehicle-side wireless transceiver module. The server-side device includes a server-side voice communication module, a server-side monitor, an intelligent driving car test monitoring system server and a server-side wireless transceiver module. And wherein, the intelligent driving car test monitoring system processor is used to: read monitoring information from the intelligent driving system of the intelligent driving car and send the monitoring information to the server-side device through the vehicle-side wireless transceiver module, wherein the monitoring information includes one or more of sensor information, line control information and intelligent driving algorithm information; generate internal display summary information according to the monitoring information and send it to the vehicle-side internal display module; receive the server-side data tag information sent by the intelligent driving car test monitoring system server through the vehicle-side wireless transceiver module, and store the server-side data tag information in association with the monitoring information; and transmit voice communication information between the vehicle-side voice communication module and the vehicle-side wireless transceiver module. The vehicle-side internal display module is used to display the internal display summary information and / or the sensor information. The vehicle-side wireless transceiver module and the server-side wireless transceiver module are used to perform wireless communication between the intelligent driving car test monitoring system processor and the intelligent driving car test monitoring system server. The intelligent driving car test monitoring system server is used to: receive the monitoring information through the server-side wireless transceiver module and send the monitoring information to the server-side monitor; receive the server-side data tag information input by the server-side user, and send the server-side data tag information to the vehicle-side device through the server-side wireless transceiver module; and transmit the voice communication information between the server-side wireless transceiver module and the server-side voice communication module. The server-side monitor is used to display the monitoring information sent by the intelligent driving car test monitoring system server.

[0006] In some embodiments, the intelligent driving car test monitoring system server is also used to: upon receiving the parameter or software update request input by the server-side user, generate update request information, and send the update request information to the vehicle-side device through the server-side wireless transceiver module. The intelligent driving car test monitoring system processor is also used to: receive the update request information sent by the intelligent driving car test monitoring system server through the vehicle-side wireless transceiver module, generate update prompt information, and prompt the vehicle-side user through the vehicle-side internal display module and / or the vehicle-side voice communication module; upon receiving the update consent information input by the vehicle-side user, the updated parameters or software are flashed into the intelligent driving system.

[0007] In some embodiments, the intelligent driving car test monitoring system server is also used to check whether the update request information conflicts, and when it is confirmed that the update request information does not conflict, the update request information is sent to the vehicle-side device through the server-side wireless transceiver module.

[0008] In some embodiments, the intelligent driving car test monitoring system further includes a remote device, and the remote device can communicate with the server device through a network. In addition, the intelligent driving car test monitoring system server is also used to send the monitoring information to the remote device through the network; receive and store the data processing information sent by the remote device. The remote device is used to: receive the monitoring information sent by the intelligent driving car test monitoring system server; display the monitoring information; and perform data processing on the monitoring information to generate data processing information, and send the data processing information to the intelligent driving car test monitoring system server.

[0009] In some implementations, the remote device is further configured to send a data retrieval request to the intelligent driving vehicle test monitoring system server. The intelligent driving vehicle test monitoring system server is further configured to respond to the data retrieval request and send the data requested by the data retrieval request to the remote device.

[0010] In some embodiments, the remote device is further configured to receive remote selection information of the monitoring information input by a remote user on the remote device, and store the remote selection information in association with the monitoring information.

[0011] In some embodiments, the remote device is also used to: upon receiving a parameter or software update request input by a remote user, generate update request information, and send the update request information to the server device through the server-side wireless transceiver module. The intelligent driving car test monitoring system server is also used to check whether the update request information conflicts, and upon confirming that the update request information does not conflict, send the update request information to the vehicle-side device through the server-side wireless transceiver module. The intelligent driving car test monitoring system processor is also used to: receive the update request information sent by the intelligent driving car test monitoring system server through the vehicle-side wireless transceiver module, generate update prompt information, and prompt the vehicle-side user through the vehicle-side internal display module and / or the vehicle-side voice communication module; upon receiving the update consent information input by the vehicle-side user, the updated parameters or software are flashed into the intelligent driving system.

[0012] In some embodiments, the remote device is also used to: receive remote data tag information input by a remote user, and send the remote data tag information to the server device through the network. The intelligent driving car test monitoring system server is also used to receive the remote data tag information sent by the remote device, and send the remote data tag information to the vehicle device through the server-side wireless transceiver module. The intelligent driving car test monitoring system processor is also used to receive the remote data tag information sent by the intelligent driving car test monitoring system server through the vehicle-side wireless transceiver module, and store the remote data tag information in association with the monitoring information.

[0013] In some embodiments, the vehicle-side device further includes a vehicle-side mobile storage device, and the intelligent driving vehicle test monitoring system processor further includes a mobile storage interface, and the mobile storage interface is connected to the vehicle-side mobile storage device. In addition, the intelligent driving vehicle test monitoring system processor is further used to store one or more of the monitoring information, the voice communication information, the server-side data tag information, and the remote-side data tag information in the vehicle-side mobile storage device.

[0014] In some embodiments, the vehicle-side device further includes a vehicle-side external prompt module. Furthermore, the intelligent driving vehicle test monitoring system processor is further configured to generate external prompt information according to the monitoring information and send the external prompt information to the vehicle-side external prompt module. The vehicle-side external prompt module is configured to display and / or broadcast the external prompt information.

[0015] In some embodiments, the processor of the intelligent driving car test monitoring system includes a controller power module, a voice module, a display screen interface, an embedded computer or a computer system on a chip, a display screen interface of an internal display device on the vehicle side, a button interface of an internal display device on the vehicle side, a wireless transceiver module interface on the vehicle side, and a vehicle network interface. Wherein, the output end of the controller power module is connected to the power input end of the voice module, the display screen interface, the embedded computer or the computer system on a chip, the display screen interface of the internal display device on the vehicle side, the button interface of the internal display device on the vehicle side, the wireless transceiver module interface on the vehicle side, and the vehicle network interface, and supplies power to them. In addition, the voice module is connected to the vehicle-side voice communication module, the display screen interface is connected to the internal display module on the vehicle side, the vehicle network interface is connected to the bus of the intelligent driving car, the display screen interface of the internal display device on the vehicle side is connected to the display screen of the internal display module on the vehicle side, the button interface of the internal display device on the vehicle side is connected to the button of the internal display module on the vehicle side, and the wireless transceiver module interface on the vehicle side is connected to the wireless transceiver module on the vehicle side.

[0016] In some embodiments, the intelligent driving car test monitoring system server is also used to receive server-side selection information of the monitoring information input by the server-side user on the server-side device, and store the server-side selection information in association with the monitoring information.

[0017] In some embodiments, the internal display summary information includes one or more of map information, location information, trajectory planning information, surrounding traffic participant information, and surrounding traffic participant trajectory prediction information.

[0018] In some embodiments, the same server-side device wirelessly communicates with the vehicle-side devices of one or more of the smart driving cars.

[0019] The intelligent driving car test monitoring system proposed in the embodiment of the present invention can provide the safety officer with comprehensive, timely and effective test monitoring information, safety tips and warnings in combination with the environment and the intelligent driving car's own vehicle status during the intelligent driving car actual vehicle test; provide the intelligent driving system tester and other traffic participants with safety tips and warnings based on the intelligent driving car's own vehicle status and the intelligent driving system's working conditions; the intelligent driving system tester debugs the intelligent driving system algorithm parameters and updates the software outside the intelligent driving car; the intelligent driving system tester monitors the intelligent driving system's working status outside the car and can remotely mark the test data of interest.

[0020] By using the intelligent driving car test monitoring system proposed in the embodiment of the present invention, the intelligent driving system tester does not need to complete vehicle status monitoring, data marking, algorithm parameter modification and software version refresh in the car, but only needs to complete these operations on the server side or remote side, which reduces the number of testers and test equipment in the car during the actual vehicle test, and only retains the safety officer and necessary communication equipment, ensuring that when safety risks occur, the safety officer can focus on handling safety risks without having to take into account other testers and test equipment in the car. It ensures that the safety officer can communicate smoothly with the tester outside the car through voice and information, ensures that the safety officer can obtain safety prompt information in a timely manner, can clearly understand the test items, algorithm parameter adjustments, and software update content, so as to be able to predict possible test risks. The safety and efficiency of the actual vehicle test of the intelligent driving system are ensured. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The above and other objects, features and advantages of the embodiments of the present invention will become readily understood by reading the following detailed description with reference to the accompanying drawings. In the accompanying drawings, several embodiments of the present invention are shown in an exemplary and non-limiting manner, in which:

[0022] Figure 1 A block diagram of an intelligent driving vehicle testing and monitoring system according to an embodiment of the present invention is shown;

[0023] Figure 2 A schematic diagram showing information content collected by a sensor displayed by a vehicle-side internal display device of an intelligent driving vehicle test monitoring system according to an embodiment of the present invention is shown;

[0024] Figure 3 A schematic diagram showing summary information displayed by a vehicle-side internal display device of an intelligent driving vehicle test monitoring system according to an embodiment of the present invention is shown;

[0025] Figure 4 A schematic diagram showing the structure of an internal display module of a vehicle end of an intelligent driving vehicle test monitoring system according to an embodiment of the present invention is shown;

[0026] Figure 5 A schematic block diagram showing the structural composition and connection relationship of the MSTIDV processor of the intelligent driving vehicle test monitoring system according to an embodiment of the present invention is shown;

[0027] Figure 6 A flowchart of parameter adjustment and software refresh of an intelligent driving vehicle test monitoring system according to an embodiment of the present invention is shown;

[0028] Figure 7 A block diagram of an embodiment of a smart driving vehicle test monitoring system according to an embodiment of the present invention is shown;

[0029] Figure 8A schematic diagram of the exterior layout of an embodiment of a smart driving vehicle test monitoring system according to an embodiment of the present invention is shown;

[0030] Fig. 9 A schematic diagram of the in-vehicle layout of an embodiment of an intelligent driving vehicle test monitoring system according to an implementation manner of the present invention is shown.

[0031] In the drawings, the same or corresponding reference numerals represent the same or corresponding parts. DETAILED DESCRIPTION

[0032] The principle and spirit of the present invention will be described below with reference to several exemplary embodiments. It should be understood that these embodiments are provided only to enable those skilled in the art to better understand and implement the present invention, and are not intended to limit the scope of the present invention in any way.

[0033] In one aspect, an embodiment of the present invention provides a smart driving vehicle test monitoring system. Figure 1 , which shows a schematic diagram of the structure organization of the intelligent driving car test monitoring system according to an embodiment of the present invention. Figure 1 As shown, the intelligent driving car test monitoring system may include a vehicle-side device and a server-side device.

[0034] The vehicle-side device may include a vehicle-side voice communication module 1, a vehicle-side internal display module 2, a Monitor System for Testing of Intelligent Driving Vehicle (MSTIDV) processor 5, and a vehicle-side wireless transceiver module 4. The vehicle-side devices are all installed on the intelligent driving vehicle to be tested. In general, the vehicle-side device can correspond to the intelligent driving system one by one, and one vehicle-side device corresponds to the intelligent driving system of one intelligent driving vehicle. As an example, the vehicle-side voice communication module 1 may include a microphone and a speaker.

[0035] The MSTIDV processor can be used to: read monitoring information from the intelligent driving system of the intelligent driving car and send the monitoring information to the server-side device through the vehicle-side wireless transceiver module, wherein the monitoring information includes one or more of sensor information, wire control information and intelligent driving algorithm information; generate internal display summary information according to the monitoring information and send it to the vehicle-side internal display module; receive server-side data tag information sent by the intelligent driving car test monitoring system server through the vehicle-side wireless transceiver module, and store the server-side data tag information in association with the monitoring information; and transmit voice communication information between the vehicle-side voice communication module and the vehicle-side wireless transceiver module.

[0036] The vehicle-side internal display module can be used to display internal display summary information and / or sensor information.

[0037] The vehicle-side wireless transceiver module and the server-side wireless transceiver module can be used for wireless communication between the processor of the intelligent driving car test monitoring system and the server of the intelligent driving car test monitoring system.

[0038] The intelligent driving system is installed on the vehicle and is part of the intelligent driving car. In order to more clearly illustrate the embodiments of the present invention, as an example, the intelligent driving system may include an intelligent driving car sensor group 7, an intelligent driving car domain controller 8, and an intelligent driving car wire control system 9. It should be noted that the description of the intelligent driving system in this specification is only an example, and the present invention has no restrictions on the structure, connection and functionality of the intelligent driving system.

[0039] The smart driving car sensor group 7 can be a sensor equipped by people in the field of smart driving to realize smart driving functions, including but not limited to millimeter wave radar, camera, laser radar, positioning system, ultrasonic radar and other sensors.

[0040] The smart driving car domain controller 8 is a controller applicable in the field of smart driving. The controller carries the smart driving car algorithm (including perception, decision-making, planning, control, etc.), takes the information collected by the smart driving car sensor group 7 as input, and after being processed by the smart driving car algorithm, generates a smart driving car wire control signal, which is output to the smart driving car wire control system 9 for controlling the smart driving car.

[0041] The intelligent driving car wire control system 9 may be a wire control system commonly used in the field of intelligent driving cars. The intelligent driving car wire control system 9 receives a control signal from the intelligent driving car domain controller 8 to control the intelligent driving car. At the same time, the intelligent driving car wire control system 9 also feeds back the wire control state of the intelligent driving car to the intelligent driving car domain controller 8. The wire control state includes the throttle opening, steering wheel angle, etc. of the intelligent driving car.

[0042] The smart driving car sensor group 7 and the smart driving car wire control system 9 are respectively connected to the smart driving car domain controller 8.

[0043] The vehicle-side internal display module 2 can display customized content, and can be used to display information collected by one or more sensors in the smart driving vehicle sensor group 7 read by the smart driving vehicle domain controller 8, and can also be used to display summary information during vehicle testing. The summary information can be customized. The information collected by the sensor is the raw data of the sensor, for example, it can include camera video data, laser radar point cloud, etc.

[0044] refer to Figure 2, which shows a schematic diagram of the information content collected by the sensor displayed by the vehicle-side internal display device of the intelligent driving car test monitoring system according to an embodiment of the present invention. In this example, the display screen of the vehicle-side internal display module 2 is used to display the image content of the left front camera, front camera, rear camera, and right front camera equipped on the vehicle.

[0045] As an embodiment of the present invention, the internal display summary information may include one or more of map information, location information, trajectory planning information, surrounding traffic participant information, and surrounding traffic participant trajectory prediction information.

[0046] Summary information refers to information about traffic participants (pedestrians, bicycles, vehicles, etc.) around the smart car, high-precision map information, etc., which can help safety officers evaluate whether the vehicle is driving safely. Summary information is obtained by combining and organizing sensor information, wire control information and intelligent driving algorithm information. It can be used to indicate the status of the test vehicle and surrounding traffic participants, and can also be used to indicate the deviation between the current control state of the test vehicle and the trajectory planning. Sensor information may include a sensor target list and / or sensor raw data. Wire control information may include one or more of the electronic throttle opening, vehicle longitudinal acceleration, steering wheel angle and steering wheel torque of the vehicle's wire control system feedback signal. Intelligent driving algorithm information may include one or more of the target list after fusion of the perception algorithm in the intelligent driving car domain controller 8, the planning instructions calculated by the planning algorithm, and the control instructions calculated by the control algorithm. Reference Figure 3 , which shows a schematic diagram of displaying summary information on the internal display device of the vehicle end of the intelligent driving car test monitoring system according to an embodiment of the present invention. The summary information displayed in this example includes HD (High Definition) map information, vehicle location information, trajectory planning, traffic participants (pedestrians, bicycles, surrounding vehicles) and their trajectory predictions, where traffic participants are the targets after the perception algorithm is integrated.

[0047] The vehicle-side internal display module 2 can realize page turning, confirmation, and cancellation functions through buttons or touch screen. Figure 4 , which shows a schematic diagram of the structure of the internal display module of the vehicle end of the intelligent driving car test monitoring system according to an embodiment of the present invention. As an example, Figure 4The vehicle-side internal display module 2 is shown to realize page turning, confirmation, and cancel functions by key mode. The device has five buttons: "Next Page", "Previous Page", "Confirm", "Cancel", and "Switch". "Next Page" and "Previous Page" are used to realize the page turning function and switch between different display contents on the screen. The "Confirm" and "Cancel" buttons are used to realize the confirmation and cancel functions. When the MSTIDV processor 5 sends information that needs to be confirmed by the safety officer to the screen of the vehicle-side internal display module 2, the safety officer performs input operations through the "Confirm" and "Cancel" buttons. The "Switch" button is used to turn the display screen on and off. The vehicle-side internal display module 2 also has a display screen interface, and the interface type can be, for example, HDMI (High-DefinitionMultimedia Interface) / VGA (Video Graphics Array), which is used to receive video signals. The vehicle-side internal display module 2 also has a key interface, and the interface type is I / O, which is used to send key signals.

[0048] The vehicle-side wireless transceiver module 4 may be a radio frequency communication module dedicated to the field of wireless communication, and the wireless communication range may be, for example, 5 km. As a specific example, the vehicle-side wireless transceiver module 4 may be a SX1278 or SX1262 wireless module in the field of wireless communication using a LoRa (Long Range Radio) modulation mode.

[0049] As an embodiment of the present invention, the vehicle-side device may further include a vehicle-side external prompt module 3. The vehicle-side external prompt module 3 may be one or more of a light-emitting diode (LED) display screen, an indicator light, and a voice alarm. In this embodiment, the processor of the intelligent driving vehicle test monitoring system may also be used to generate external prompt information based on the monitoring information and send the external prompt information to the vehicle-side external prompt module. The vehicle-side external prompt module 3 may be used to display and / or broadcast external prompt information.

[0050] As an embodiment of the present invention, the processor of the intelligent driving car test monitoring system may include a controller power module, a voice module, a display screen interface, an embedded computer or a computer system on a chip, a display screen interface of an internal display device on the vehicle side, a button interface of an internal display device on the vehicle side, a wireless transceiver module interface on the vehicle side, and a vehicle network interface. Among them, the output end of the controller power module can be connected to the power input end of the voice module, the display screen interface, the embedded computer or the computer system on a chip, the display screen interface of the internal display device on the vehicle side, the button interface of the internal display device on the vehicle side, the wireless transceiver module interface on the vehicle side, and the vehicle network interface, and supply power to them. The voice module can be connected to the vehicle-side voice communication module, the display screen interface can be connected to the vehicle-side internal display module, the vehicle-side network interface can be connected to the bus of the intelligent driving car, the display screen interface of the internal display device on the vehicle side can be connected to the display screen of the internal display module on the vehicle side, the button interface of the internal display device on the vehicle side can be connected to the button of the internal display module on the vehicle side, and the wireless transceiver module interface on the vehicle side can be connected to the wireless transceiver module on the vehicle side.

[0051] As one embodiment of the present invention, Figure 5The structural composition and connection relationship schematic block diagram of the MSTIDV processor of the intelligent driving car test monitoring system according to an embodiment of the present invention is shown. In this embodiment, the MSTIDV processor 5 includes a controller power module, a voice module, a display screen interface, an embedded computer or a computer system on a chip, a display screen interface of the internal display module of the vehicle end, a button interface of the internal display module of the vehicle end, a wireless transceiver module interface of the vehicle end, and a vehicle network interface. Among them, the vehicle network interface may include interfaces such as a controller area network (Controller Area Network, CAN), a local interconnect network (Local Interconnect Network, LIN), and Ethernet. The voice module may include an I / O interface and a voice module interface. As a specific example, the voice module interface may be one of a universal serial bus (Universal Serial Bus, USB), a universal asynchronous receiver / transmitter (Universal Asynchronous Receiver / Transmitter, UART), a serial peripheral interface (Serial Peripheral Interface, SPI), and RS485. The display screen interface may be an RS485 or a transmission control protocol / Internet protocol (Transmission Control Protocol / Internet Protocol, TCP / IP) interface. The display screen interface of the internal display module of the vehicle end may be an HDMI or VGA interface. The button interface of the vehicle-side internal display module can be an I / O interface. The vehicle-side wireless transceiver module interface can be a USB, RS232 or RS485 interface. The mobile storage interface can be a SATA interface.

[0052] The connection relationship inside the MSTIDV processor 5 is as follows: the output end of the power supply module before the control is connected to the voice module, the display screen interface, the embedded computer or the on-chip computer system, the display screen interface of the vehicle-side internal display module, the key interface of the vehicle-side internal display module, the vehicle-side wireless transceiver module interface and the vehicle-mounted network interface, and the mobile storage interface power input end, and supplies power to them. The voice module interface input end of the voice module is connected to the output end of the single-chip voice module interface by wire. The display screen interface input end is connected to the output end of the single-chip display screen interface by wire. The output ends of the CAN interface, LIN interface and Ethernet interface in the vehicle-mounted network interface are respectively connected to the CAN interface, LIN interface and Ethernet interface input ends of the embedded computer or the on-chip computer system by wire. The display screen interface of the vehicle-side internal display module is connected to the display screen interface of the embedded computer or the on-chip computer system by wire. The key interface of the vehicle-side internal display module is connected to the key interface of the embedded computer or the on-chip computer system by wire. The vehicle-side wireless transceiver module interface is connected to the vehicle-side wireless transceiver interface of the embedded computer or the on-chip computer system by wire. The mobile storage interface is connected to the mobile storage interface of the embedded computer or the on-chip computer system by wire.

[0053] As an embodiment of the present invention, the vehicle-side device may further include a vehicle-side mobile storage device 6. As a specific example, the vehicle-side mobile storage device 6 may be a mobile storage array. In this embodiment, the intelligent driving car test monitoring system processor further includes a mobile storage interface, and the mobile storage interface is connected to the vehicle-side mobile storage device. In addition, the intelligent driving car test monitoring system processor may also be used to store one or more of monitoring information, voice communication information, server-side data tag information, and remote-side data tag information in the vehicle-side mobile storage device.

[0054] like Figure 5As shown, the positive pole of the vehicle-mounted 12VDC power supply can be connected to the controller power module of the MSTIDV controller 5 in a single line, and the negative pole is grounded. The I / O ports of the vehicle-side voice communication module 1 (microphone), the vehicle-side voice communication module 1 (speaker), and the vehicle-side external prompt module 3 (voice alarm speaker) can be connected to the three I / O interfaces of the voice module of the MSTIDV controller 5 by wire. The display screen interface of the vehicle-side internal display module 2 is connected to the vehicle-side internal display module interface of the MSTIDV controller 5 through an HDMI or VGA cable. The key interface of the vehicle-side internal display module 2 is connected to the vehicle-side internal display module key interface of the MSTIDV controller 5 through a wire. The vehicle-side external prompt module 3 (display screen) can be connected to the display screen interface of the MSTIDV controller 5 through a shielded twisted pair (RS485) or a TCP / IP network cable. The output port of the vehicle-side wireless transceiver module 4 can be connected to the vehicle-side wireless transceiver module interface of the MSTIDV controller 5 through an RS232 serial port line or a shielded twisted pair (RS485). The output ends of the CAN interface, LIN interface and Ethernet interface in the intelligent driving car domain controller 8 can be connected by wires to the output ends of the CAN interface, LIN interface and Ethernet interface in the vehicle network interface of the MSTIDV controller 5. The input port of the vehicle-side mobile storage device 6 can be connected to the mobile storage interface of the MSTIDV controller 5 by wires.

[0055] like Figure 1 As shown, the server-side device may include a server-side voice communication module 11, a server-side monitor 12, an intelligent driving vehicle test monitoring system (MSTIDV) server 13 and a server-side wireless transceiver module 10. The server-side device can be quickly deployed in an equipped laboratory, office or test accompanying vehicle, and its location can be within 5 km of the location of the test vehicle, for example.

[0056] As an embodiment of the present invention, the same server-side device can wirelessly communicate with the vehicle-side devices of one or more smart driving cars to achieve simultaneous monitoring of multiple smart driving cars.

[0057] The MSTIDV server can be used to: receive monitoring information through the server-side wireless transceiver module and send the monitoring information to the server-side monitor; receive server-side data tag information input by the server-side user, and send the server-side data tag information to the vehicle-side device through the server-side wireless transceiver module; and transmit voice communication information between the server-side wireless transceiver module and the server-side voice communication module.

[0058] The server-side monitor can be used to display the monitoring information sent by the smart driving car test monitoring system server.

[0059] The server-side wireless transceiver module 10 may be a radio frequency communication module, and the wireless communication range may be, for example, 5 km. As a specific example, it may be a SX1278 or SX1262 wireless module using the LoRa modulation mode in the field of wireless communication.

[0060] The server-side voice communication module 11 may include a microphone and a speaker.

[0061] The server-side monitor 12 may be a monitor group, or a collection of one or more display screens. The connection between the display screen and the MSTIDV server 13 may be, for example, an HDMI or VGA cable connection, and the display mode may include an extended display mode.

[0062] The MSTIDV server 13 can be a high-performance notebook, or a desktop or server with a mouse and keyboard. The MSTIDV server 13 can have a wireless or wired port and can be connected to a communication network in a wireless or wired manner.

[0063] The internal connection relationship of the server-side device can be, for example, as follows: the microphone and speaker signal ends of the server-side voice communication module 11 are connected to the microphone and speaker interface wires in the MSTIDV server 13; the signal input end of the server-side monitor 12 is connected to the video port in the MSTIDV server 13 via an HDMI or VGA cable; the input / output end of the server-side wireless transceiver module 10 is connected to the wireless input / output module in the MSTIDV server 13 by wires.

[0064] As an embodiment of the present invention, the server of the intelligent driving car test monitoring system can also be used to: upon receiving a parameter or software update request input by a server-side user, generate update request information, and send the update request information to the vehicle-side device through the server-side wireless transceiver module. In this embodiment, the processor of the intelligent driving car test monitoring system can also be used to: receive the update request information sent by the server of the intelligent driving car test monitoring system through the vehicle-side wireless transceiver module, generate update prompt information, and prompt the vehicle-side user through the vehicle-side internal display module and / or the vehicle-side voice communication module; upon receiving the update consent information input by the vehicle-side user, the updated parameters or software are flashed into the intelligent driving system.

[0065] As an embodiment of the present invention, the intelligent driving car test monitoring system server can also be used to check whether the update request information conflicts, and when it is confirmed that the update request information does not conflict, the update request information is sent to the vehicle-side device through the server-side wireless transceiver module.

[0066] As an embodiment of the present invention, the intelligent driving car test monitoring system server can also be used to receive server-side selection information of monitoring information input by the server-side user on the server-side device, and can store the server-side selection information in association with the monitoring information.

[0067] The communication network can be any wired or wireless network that currently exists or will appear in the future in the computer field.

[0068] As an embodiment of the present invention, the intelligent driving car test monitoring system may further include a remote device, and the remote device and the server device may communicate via a network. In this embodiment, the intelligent driving car test monitoring system server may also be used to send monitoring information to the remote device via the network; and receive and store data processing information sent by the remote device.

[0069] The remote device may include a remote operation console 14. The remote operation console 14 may be one or more high-performance notebooks, or a desktop or server with a mouse, keyboard, and display. One or more intelligent driving testers may simultaneously monitor the test vehicle in real time and initiate parameter or algorithm update requests on one or more notebooks, desktops, or servers on the remote operation console 14. The remote device is not restricted by geographical location and may be in a different city from the server device and the vehicle device.

[0070] As an embodiment of the present invention, the remote device can be used to: receive monitoring information sent by the intelligent driving car test monitoring system server; display the monitoring information; and perform data processing on the monitoring information, generate data processing information, and send the data processing information to the intelligent driving car test monitoring system server.

[0071] As an embodiment of the present invention, the remote device can also be used to send a data retrieval request to the intelligent driving car test monitoring system server. The intelligent driving car test monitoring system server can also be used to respond to the data retrieval request and send the data requested by the data retrieval request to the remote device.

[0072] As an embodiment of the present invention, the remote device may also be used to receive remote selection information of the monitoring information input by the remote user on the remote device, and store the remote selection information in association with the monitoring information.

[0073] As an embodiment of the present invention, the remote device can also be used to: upon receiving a parameter or software update request input by a remote user, generate update request information, and send the update request information to the server device via a server-side wireless transceiver module. The intelligent driving vehicle test monitoring system server is also used to check whether the update request information conflicts, and when confirming that the update request information does not conflict, send the update request information to the vehicle device via the server-side wireless transceiver module.

[0074] In the above embodiment, the processor of the intelligent driving car test monitoring system can also be used to: receive update request information sent by the intelligent driving car test monitoring system server through the vehicle-side wireless transceiver module, generate update prompt information, and prompt the vehicle-side user through the vehicle-side internal display module and / or the vehicle-side voice communication module; when receiving the update consent information input by the vehicle-side user, the updated parameters or software are flashed into the intelligent driving system.

[0075] As an embodiment of the present invention, the remote device can also be used to: receive remote data tag information input by the remote user, and send the remote data tag information to the server device through the network. The intelligent driving car test monitoring system server is also used to receive the remote data tag information sent by the remote device, and send the remote data tag information to the vehicle device through the server-side wireless transceiver module.

[0076] In the above embodiment, the intelligent driving car test monitoring system processor can also be used to receive remote data marking information sent by the intelligent driving car test monitoring system server through the vehicle-side wireless transceiver module, and store the remote data marking information in association with the monitoring information.

[0077] As an example, the connection relationship between the vehicle-side device, the intelligent driving system, the server-side device, the remote-side device, and the communication network can be: the vehicle-side device uses the vehicle-side wireless transceiver module 4 and the server-side wireless transceiver module 10 to exchange data with the server-side device through a direct wireless communication link, and the maximum communication distance of the direct wireless communication is, for example, 5km; the server-side device and the communication network are connected by a wired or wireless network; the remote monitoring device and the communication network are connected by a wired or wireless network.

[0078] The system architecture, algorithm, software and hardware equipment of the intelligent driving system in the research and development stage inevitably have unknown or undiscovered safety risks before the actual vehicle test, or the test scenario itself has certain safety risks. The intelligent driving car test monitoring system proposed in the embodiment of the present invention can provide the safety officer with comprehensive, timely and effective test monitoring information, safety tips and warnings in combination with the environment and the state of the intelligent driving car during the actual vehicle test of the intelligent driving car; provide safety tips and warnings to the intelligent driving system tester and other traffic participants according to the state of the intelligent driving car and the working condition of the intelligent driving system; the intelligent driving system tester debugs the algorithm parameters of the intelligent driving system and updates the software outside the intelligent driving car; the intelligent driving system tester monitors the working state of the intelligent driving system outside the car and can remotely mark the test data of interest.

[0079] By using the intelligent driving car test monitoring system proposed in the embodiment of the present invention, the intelligent driving system tester does not need to complete vehicle status monitoring, data marking, algorithm parameter modification and software version refresh in the car, but only needs to complete these operations on the server side or remote side, which reduces the number of testers and test equipment in the car during the actual vehicle test, and only retains the safety officer and necessary communication equipment, ensuring that when safety risks occur, the safety officer can focus on handling safety risks without having to take into account other testers and test equipment in the car. It ensures that the safety officer can communicate smoothly with the tester outside the car through voice and information, ensures that the safety officer can obtain safety prompt information in a timely manner, can clearly understand the test items, algorithm parameter adjustments, and software update content, so as to be able to predict possible test risks. The safety and efficiency of the actual vehicle test of the intelligent driving system are ensured.

[0080] The following describes the working process and principle of the intelligent driving car test monitoring system proposed in the embodiment of the present invention. The working process of the intelligent driving car test monitoring system may include vehicle-side information prompts, server-side / remote-side data information monitoring, real-time voice communication, parameter adjustment and software version refresh, and vehicle-side information storage.

[0081] refer to Figure 1 , the function of vehicle-side information prompt includes the following steps:

[0082] Step 1: Reading of sensor information and wire control information. The MSTIDV processor 5 reads the sensor information of the smart driving car sensor group 7 through the smart driving car domain controller 8; the MSTIDV processor 5 reads the wire control information of the smart driving car wire control system 9 through the smart driving car domain controller 8. At the same time, the MSTIDV processor 5 directly reads the smart driving algorithm information of the smart driving car domain controller 8.

[0083] Step 2: Generate summary information and external prompt information. The MSTIDV processor 5 generates summary information and external prompt information. Summary information refers to the information about traffic participants (pedestrians, bicycles, vehicles, etc.) around the smart car, high-precision map information, etc., which can help the safety officer assess whether the vehicle is driving safely. Custom information is obtained by combining sensor information, line control information, and intelligent driving algorithm information. It can be used to indicate the status of the test vehicle and surrounding traffic participants, and can also be used to indicate the deviation between the current control state of the vehicle and the trajectory planning. Reference Figure 3 As shown, the display screen of the internal display module 2 of the vehicle is used to display an example of summary information content. The summary information displayed in this example includes high-definition map (HD map) information, vehicle location information, trajectory planning, traffic participants (pedestrians, bicycles, surrounding vehicles) and their trajectory predictions, where traffic participants are the targets after the perception algorithm is integrated. External prompt information includes display screen display information and language broadcast information. The display screen display information and language broadcast information content can be customized. For example, the content can be to remind traffic participants that the current vehicle is in the intelligent driving state in the intelligent driving state, or to warn traffic participants to stay away from the intelligent driving car when the vehicle fails.

[0084] Step 3: Display inside and outside the vehicle. The MSTIDV processor 5 sends the sensor information and summary information to the vehicle internal display module 2. The display content of the vehicle internal display module 2 can be information collected by one or more sensors in the smart driving vehicle sensor group 7 read by the smart driving vehicle domain controller 8, and can also be used to display the summary information generated by the MSTIDV processor 5 in step 2. Figure 2 As shown in FIG. 1 , an example of monitoring content of an intelligent driving car equipped with four cameras is shown. In this example, the display screen of the vehicle-side internal display module 2 is used to display the image content of the left front camera, the front camera, the rear camera, and the right front camera equipped by the vehicle. The MSTIDV processor 5 sends the external prompt information generated in step 2 to the vehicle-side external prompt module 3 to give a prompt to the person outside the vehicle.

[0085] refer to Figure 1 , the server-side / remote-side information monitoring implementation steps are as follows:

[0086] Step 1, reading of sensor recognition target information and wire control information. The MSTIDV processor 5 reads the sensor recognition target information of the smart driving car sensor group 7 through the smart driving car domain controller 8; the MSTIDV processor 5 reads the wire control information of the smart driving car wire control system 9 through the smart driving car domain controller 8, and at the same time, the MSTIDV processor 5 directly reads the smart driving algorithm information of the smart driving car domain controller 8. The sensor recognition target information can be a target list output by the sensor. The wire control information can include one or more of the electronic throttle opening or the longitudinal acceleration of the vehicle, the steering wheel angle, or the steering wheel torque of the feedback signal of the vehicle wire control system. The intelligent driving algorithm information can include one or more of the target list after the perception algorithm is fused in the smart driving car domain controller 8, the planning instructions calculated by the planning algorithm, and the control instructions calculated by the control algorithm.

[0087] Step 2: Sending and receiving information for server-side monitoring. The MSTIDV processor 5 sends the information for server-side monitoring to the MSTIDV server 13 through the vehicle-side wireless transceiver module 4 and the server-side wireless transceiver module 10. The information for server-side monitoring may include one or more of sensor recognition target information, wire control information, and intelligent driving algorithm information.

[0088] Step 3: Server-side data operation. After receiving the information for server-side monitoring, the MSTIDV server 13 processes and distributes the data according to the operation of the intelligent driving system tester on the server. The operation on the server side includes five parts:

[0089] 1) The intelligent driving system tester customizes the server-side display information on the server side according to the specific needs of testing or debugging, and then the MSTIDV server 13 sends and displays the customized server-side display information to the server-side monitor group 12; the customized server-side display information can be the information that the intelligent driving system tester selects from the information used for server-side monitoring, or the intelligent driving system tester processes the acquired data through programming to obtain new data with reference significance (for example, obtaining the vehicle acceleration jerk value by derivation of acceleration, etc.).

[0090] 2) The intelligent driving system tester monitors the data and curves displayed on the server-side monitor group 12, confirms the time point of interest in real time, and then operates on the MSTIDV server 13 to mark the data and intervals of interest. Afterwards, the MSTIDV server 10 sends the marking information to the MSTIDV processor 5 through the server-side wireless transceiver module 10 and the vehicle-side wireless transceiver module 4. Finally, the MSTIDV processor 5 stores the marking information in the vehicle-side mobile storage device 6. The marking information can be used in conjunction with the data stored in the vehicle-side mobile storage device 6 in the vehicle-side information prompt and storage function, which is convenient for algorithm debuggers to quickly and efficiently locate the data segments of interest.

[0091] 3) The intelligent driving system tester operates on the server side, selects the information he is interested in from the information received for server-side monitoring, and stores it in the local folder specified by the server.

[0092] 4) The intelligent driving system tester retrieves the data stored in the specified folder of the server on the server side and plays back the data.

[0093] Step 4: Remote data operation. After receiving the information for server-side monitoring, the MSTIDV server 13 sends the data to the remote operation station 14 through the communication network. The intelligent driving system tester processes the data at the remote operation station 14. The data processing at the remote operation station 14 includes four parts:

[0094] 1) The intelligent driving system tester customizes the remote operating console display information on the remote operating console 14 according to the specific needs of testing or debugging, and then displays it on the display screen of the remote operating console 14; the customized remote operating console display information can be the information of interest selected by the intelligent driving system tester from the sensor recognition target information, line control information, and intelligent driving algorithm information, or it can be the intelligent driving system tester processing the acquired data through programming to obtain new data with reference significance (for example, obtaining the vehicle jerk value by derivation of acceleration, etc.).

[0095] 2) The intelligent driving system tester operates on the remote control console 14, selects the information of interest from the received sensor recognition target information, line control information, and intelligent driving algorithm information, and stores it in a local folder specified by the server.

[0096] 3) The intelligent driving system tester retrieves the data stored in the designated folder of the server on the remote operation console 14 and plays back the data.

[0097] For the working process of voice communication, refer to Figure 1The voice information is transmitted through the vehicle-side voice communication module 1, the MSTIDV processor 5, the vehicle-side wireless transceiver module 4, the server-side wireless transceiver module 10 and the server-side voice communication module 11. During the test, real-time voice communication is used to realize real-time communication between the in-vehicle safety officer and the server-side algorithm debugging personnel, facilitating the timely and reliable exchange of information during the test.

[0098] refer to Figure 6 , which shows a flow chart of parameter adjustment and software refresh of the intelligent driving vehicle test monitoring system according to an embodiment of the present invention. Figure 6 As shown, the steps for adjusting parameters and refreshing software versions are as follows:

[0099] The automated driving system tester submits a parameter or software update request. The algorithm personnel can submit modification requests in two ways: a) The algorithm debugging personnel directly submits a parameter or software update request on the MSTIDV server 13. b) The algorithm debugging personnel submits a parameter or software update request through the remote operation console 14, and then submits the parameter or software update request to the MSTIDV server 13 through the communication network.

[0100] The MSTIDV server 13 receives the parameter or software update request.

[0101] The MSTIDV server 13 checks whether the request conflicts. When the parameter or software update request submitted directly by the algorithm debugger on the MSTIDV server 13 and the parameter or software update request submitted from the remote operation console 14 are detected at the same time, the detection result is conflict, otherwise it is not conflict.

[0102] When the MSTIDV server 13 checks that the request does not conflict, the parameter or software update request submitted directly by the algorithm debugger on the MSTIDV server 13 or the parameter or software update request submitted through the remote operation console 14 is submitted to the MSTIDV server 13 .

[0103] When the MSTIDV server 13 checks for request conflicts, the MSTIDV server 13 generates update request information, displays a conflict reminder on the server-side monitor group 12, and prompts the intelligent driving system tester to confirm. The server-side monitor group 12 displays the content of the update request information, for example, "The MSTIDV server currently receives software book refresh requests from both the local and remote ends. Please select the final parameters: 1. Local request; 2. Remote request; 3. Cancel all requests."

[0104] The intelligent driving system tester selects the final request. The intelligent driving system tester selects the final request according to the conflict reminder displayed by the server-side monitor group 12.

[0105] When the intelligent driving system tester has not completed the selection, the program will continue to remind the intelligent driving system tester to make a selection.

[0106] When the intelligent driving system tester completes the selection, the selected algorithm parameters or software version are submitted to the MSTIDV server 13 .

[0107] The MSTIDV server 13 submits the parameter or software update request to the MSTIDV processor 5 through the server-side wireless transceiver module 10 and the vehicle-side wireless transceiver module 4 .

[0108] The MSTIDV processor 5 generates parameter or software version update prompt information. The update prompt information includes brief parameter modification information or software version information. A specific example is "The vehicle will update the software version. Software version: V002; Source: Local request. Please confirm whether to update."

[0109] The update prompt information is sent to the vehicle-side internal display module 2 and the vehicle-side voice communication module 1, which prompt the safety officer simultaneously through visual and auditory means, and require the safety officer to confirm.

[0110] When the safety officer refuses to update by pressing the "Cancel" button on the vehicle-side internal display module, the vehicle-side prompts the safety officer to refuse the update request. A specific example of update rejection information is "The safety officer refuses this update". The update rejection information is generated by the MSTIDV processor 5, and then the MSTIDV processor 5 sends the update rejection information to the vehicle-side display screen 2 and the vehicle-side voice communication module 1, and prompts the safety officer on the vehicle-side display screen 2 and the vehicle-side voice communication module 1 by voice and visual means respectively.

[0111] When the safety officer refuses to update by pressing the "Cancel" button on the vehicle-side internal display module, the server-side prompts the safety officer to refuse the update request. A specific example of update rejection information is "The safety officer refuses this update". The update rejection information is sent by the MSTIDV processor 5 to the server-side voice communication module 11 and the server-side monitor group 12 through the vehicle-side wireless transceiver module 4, the server-side wireless transceiver module 10, and the MSTIDV server 13, respectively, and the algorithm personnel are prompted with the prompt information on the server-side voice communication module 11 and the server-side monitor group 12 by voice and visual means.

[0112] When the safety officer agrees to the update by pressing the "Confirm" button on the internal display module of the vehicle, the MSTIDV processor 5 will flash the modified parameters or new software to the smart driving car domain controller 8.

[0113] When the update is not completed, the vehicle prompts the safety officer that the update is not completed. The MSTIDV processor 5 generates a prompt message that the update is not completed. A specific example is "vehicle parameters or software version is being updated". The MSTIDV processor 5 sends the prompt message to the vehicle display screen 2 and the vehicle voice communication module 1, and prompts the safety officer on the vehicle display screen 2 and the vehicle voice communication module 1 by voice and visual means respectively.

[0114] When the update is not completed, the server prompts the intelligent driving system tester that the update is not completed. A specific example of the prompt information of the incomplete update is "vehicle parameters or software version is being updated". The prompt information is generated by the MSTIDV processor 5, and then sent to the server-side voice communication module 11 and the server-side monitor group 12 through the vehicle-side wireless transceiver module 4, the server-side wireless transceiver module 10, and the MSTIDV server 13, respectively, and the algorithm personnel are prompted with the prompt information on the server-side voice communication module 11 and the server-side monitor group 12 by voice and vision respectively.

[0115] When the update is completed, the vehicle-side prompts the safety officer that the update is complete. The MSTIDV processor 5 generates an update completion prompt message, a specific example of which is "the vehicle parameters or software version has been updated". The MSTIDV processor 5 sends the prompt message to the vehicle-side internal display module 2 and the vehicle-side voice communication module 1, and prompts the safety officer on the vehicle-side display device 2 and the vehicle-side voice communication module 1 by voice and visual means respectively.

[0116] When the update is completed, the server side prompts the intelligent driving system tester that the update is complete. The server side prompts the algorithm personnel that the vehicle has completed the update. A specific example of the update completion prompt information is "the vehicle parameters or software version has been updated." The prompt information is generated by the MSTIDV processor 5, and then sent to the server-side voice communication module 11 and the server-side monitor group 12 through the vehicle-side wireless transceiver module 4, the server-side wireless transceiver module 10, and the MSTIDV server 13, respectively, and the algorithm personnel are prompted with the prompt information on the server-side voice communication module 11 and the server-side monitor group 12 by voice and vision respectively.

[0117] refer to Figure 1 ,The working process of vehicle-side information storage is as follows.

[0118] During the vehicle test, the MSTIDV processor 5 will store the important data of the entire system in the vehicle-side mobile storage device 6. The important data of the entire system include: the voice signal generated by the vehicle-side voice communication module 1 and the server-side voice communication module 11 during real-time voice communication; the tag information generated by the MSTIDV server 13 during parameter adjustment and software version refresh; when the vehicle-side information prompts, the MSTIDV processor 5 reads the sensor information of the smart driving car sensor group 7 through the smart driving car domain controller 8; when the vehicle-side information prompts, the MSTIDV processor 5 reads the line control information of the smart driving car line control system 9 through the smart driving car domain controller 8, and when the vehicle-side information prompts, the MSTIDV processor 5 directly reads the smart driving algorithm information of the smart driving car domain controller 8. When the vehicle-side information prompts, the MSTIDV processor 5 generates external prompt information and summary information; when the parameter adjustment and software version refresh, the MSTIDV processor 5 generates update rejection information, update completion prompt information, update prompt information, and update incomplete information. When the important data of the entire system are stored in the vehicle-side mobile storage device 6, the time information corresponding to the information will be stored at the same time. The important data of the entire system stored is mainly used for detailed algorithm debugging and accident analysis.

[0119] refer to Figure 7 , which shows a block diagram of an embodiment of a smart driving car test monitoring system according to an embodiment of the present invention. As an example only, the vehicle-side external prompt module 3 may include a vehicle-side external LED display screen 301 and a vehicle-side external voice prompt 302. The smart driving car sensor group 7 may include a front-end millimeter wave radar 701, a right front camera 702, a left front camera 703, a front camera 704, a laser radar 705, a positioning module 706, a right rear millimeter wave radar 707, a left rear millimeter wave radar 708, a rear camera 709, a right rear ultrasonic radar 710, a rear ultrasonic radar 711, and a left rear ultrasonic radar 712. The server-side monitor group 12 may include a sensor data monitor 1201, a planning control data monitor 1202, and a perception fusion data monitor 1203.

[0120] refer to Figure 8, which shows a schematic diagram of the exterior layout of an embodiment of the intelligent driving car test monitoring system according to an embodiment of the present invention. As an example, the front millimeter wave radar 701 is fixed on the front bumper 15; the right front camera 702 and the left front camera 703 are respectively fixed on the right rearview mirror housing 16 and the left rearview mirror housing 17; the front camera 704 is fixed on the front windshield 18; the laser radar 705 and the positioning module 706 are fixed on the roof 19; the right rear millimeter wave radar 707 and the left rear millimeter wave radar 708 are fixed on the body side 20; the rear camera 709 is fixed on the rear windshield 21, and the right rear ultrasonic radar 710, the rear ultrasonic radar 711, and the left rear ultrasonic radar 712 are fixed on the rear bumper 22. The fixing method of the intelligent driving car sensor group 7 (including 701-712) can be clamping, welding, bonding, screw connection or bolt connection, etc. The display screen 301 and the vehicle-side external voice prompt 302 can be fixed on the vehicle roof 19, and the fixing method can be snap connection, welding, bonding, screw connection or bolt connection, etc.

[0121] refer to Fig. 9 , which shows a schematic diagram of the in-vehicle layout of an embodiment of an intelligent driving car test monitoring system according to an implementation mode of the present invention. The vehicle-side voice communication module 1 and the vehicle-side internal display module 2 can be fixed on the interior cover plate 23, and the fixing position thereof is close to the vehicle steering wheel 24 side, and the fixing method can be bonding. The vehicle-side wireless transceiver module 4 can be fixed on the interior cover plate 23, and the fixing position thereof is close to the A-pillar 25 side, and the fixing method can be bonding. The vehicle-side mobile storage device 6 and the MSTIDV processor 5 can be fixed on the co-pilot side floor 27 under the glove box 26, and the fixing method can be screw connection.

[0122] Compared with the prior art, the intelligent driving car test monitoring system proposed in the embodiments of the present invention has the following beneficial effects:

[0123] The intelligent driving car test monitoring system proposed in the embodiment of the present invention adopts the MSTIDV processor to directly read sensor information, line control information, and intelligent driving algorithm information from the intelligent driving car domain controller, so as to obtain rich information in a timely and accurate manner, reasonably monitor the status of the vehicle and surrounding traffic participants, and reduce the risks during the test process.

[0124] The intelligent driving car test monitoring system proposed in the embodiment of the present invention has a server-side information monitoring function. The intelligent driving system tester can monitor the vehicle status on the server side or remotely, so only one safety officer can be retained on the vehicle, reducing the number of people on the vehicle and reducing the risk of testing.

[0125] The intelligent driving car test monitoring system proposed in the embodiment of the present invention has server-side and remote parameter adjustment and software version refresh functions. Intelligent driving system testers can perform parameter debugging and software version refresh on the server side or remotely, thereby improving the safety of algorithm debuggers and the efficiency of algorithm debugging.

[0126] The intelligent driving car test monitoring system proposed in the embodiment of the present invention adopts four parts: vehicle-side information prompts, server-side / remote-side data information monitoring and real-time voice communication to perform real-time test monitoring. The monitoring also includes real-time voice and image reminders to ensure the safety of vehicle testing through different channels.

[0127] The intelligent driving vehicle test monitoring system proposed in the embodiment of the present invention stores important data of the entire system such as voice signals, marking information, sensor information, line control information, intelligent driving algorithm information, external prompt information, summary information, update rejection information, update completion prompt information, update prompt information, and update incomplete information during the vehicle test process in a vehicle-side mobile storage device. At the same time, the marking information is used to mark the data segments of interest to the intelligent driving system tester, so that the algorithm debugger can quickly and efficiently locate the data segments of interest to carry out detailed algorithm debugging and accident analysis.

[0128] The intelligent driving car test monitoring system proposed in the embodiment of the present invention can be applied to the test link in the future development of intelligent driving cars. Some of its functions can also be used in the test scenarios of non-intelligent driving cars. The intelligent driving car test monitoring system proposed in the embodiment of the present invention can reduce the danger of real car testing, improve the efficiency of real car testing, and shorten the development cycle of vehicle models.

[0129] For the purpose of illustration, the foregoing description of the embodiments of the present invention has been given, which is not exhaustive nor intended to limit the present invention to the disclosed exact form. It will be appreciated by those skilled in the art that various changes can be made without departing from the scope of the present invention, and that the elements therein can be replaced with equivalents. In addition, without departing from the basic scope of the present invention, many modifications can be made so that specific situations or materials are adapted to the teachings of the present invention. Therefore, the present invention is not intended to be limited to the specific embodiments disclosed as the best mode for realizing the present invention, and the present invention will include all embodiments falling within the scope of the appended claims.

Claims

1. An intelligent driving car test monitoring system, characterized in that: The intelligent driving car test monitoring system includes a vehicle-side device and a server-side device, wherein: The vehicle-side device includes a vehicle-side voice communication module, a vehicle-side internal display module, a smart driving car test monitoring system processor and a vehicle-side wireless transceiver module; The server-side device includes a server-side voice communication module, a server-side monitor, an intelligent driving car test monitoring system server and a server-side wireless transceiver module; And among them, The processor of the intelligent driving car test monitoring system is used to: read monitoring information from the intelligent driving system of the intelligent driving car and send the monitoring information to the server-side device through the vehicle-side wireless transceiver module, wherein the monitoring information includes one or more of sensor information, wire control information and intelligent driving algorithm information; generate internal display summary information according to the monitoring information and send it to the vehicle-side internal display module; receive server-side data tag information sent by the server of the intelligent driving car test monitoring system through the vehicle-side wireless transceiver module, and store the server-side data tag information in association with the monitoring information; and transmit voice communication information between the vehicle-side voice communication module and the vehicle-side wireless transceiver module; The vehicle-side internal display module is used to display the internal display summary information and / or the sensor information; The vehicle-side wireless transceiver module and the server-side wireless transceiver module are used to perform wireless communication between the intelligent driving car test monitoring system processor and the intelligent driving car test monitoring system server; The intelligent driving car test monitoring system server is used to: receive the monitoring information through the server-side wireless transceiver module and send the monitoring information to the server-side monitor; receive the server-side data tag information input by the server-side user, and send the server-side data tag information to the vehicle-side device through the server-side wireless transceiver module; and transmit the voice communication information between the server-side wireless transceiver module and the server-side voice communication module; The server-side monitor is used to display the monitoring information sent by the smart driving car test monitoring system server.

2. The intelligent driving car test monitoring system according to claim 1, characterized in that: The intelligent driving car test monitoring system server is also used to: upon receiving a parameter or software update request input by the server-side user, generate update request information, and send the update request information to the vehicle-side device through the server-side wireless transceiver module; The processor of the intelligent driving car test monitoring system is also used to: receive the update request information sent by the intelligent driving car test monitoring system server through the vehicle-side wireless transceiver module, generate update prompt information, and prompt the vehicle-side user through the vehicle-side internal display module and / or the vehicle-side voice communication module; when receiving the update consent information input by the vehicle-side user, the updated parameters or software are flashed into the intelligent driving system.

3. The intelligent driving car test monitoring system according to claim 2 is characterized in that: The intelligent driving car test monitoring system server is also used to check whether the update request information conflicts, and when it is confirmed that the update request information does not conflict, send the update request information to the vehicle-side device through the server-side wireless transceiver module.

4. The intelligent driving car test monitoring system according to claim 1, characterized in that: The intelligent driving car test monitoring system also includes a remote device, which can communicate with the server device via a network, and The intelligent driving car test monitoring system server is also used to send the monitoring information to the remote device through the network; receive and store the data processing information sent by the remote device; The remote device is used to: receive the monitoring information sent by the intelligent driving car test monitoring system server; display the monitoring information; and perform data processing on the monitoring information to generate data processing information, and send the data processing information to the intelligent driving car test monitoring system server.

5. The intelligent driving car test monitoring system according to claim 4, characterized in that: The remote device is also used to send a data retrieval request to the intelligent driving car test monitoring system server; The intelligent driving car test monitoring system server is also used to respond to the data retrieval request and send the data requested by the data retrieval request to the remote device.

6. The intelligent driving car test monitoring system according to claim 4, characterized in that: The remote device is further used for receiving remote selection information of the monitoring information input by a remote user on the remote device, and storing the remote selection information in association with the monitoring information.

7. The intelligent driving car test monitoring system according to claim 4, characterized in that: The remote device is further used to: generate update request information when receiving a parameter or software update request input by a remote user, and send the update request information to the server device through the server wireless transceiver module; The intelligent driving car test monitoring system server is also used to check whether the update request information conflicts, and when it is confirmed that the update request information does not conflict, send the update request information to the vehicle-side device through the server-side wireless transceiver module; The processor of the intelligent driving car test monitoring system is also used to: receive the update request information sent by the intelligent driving car test monitoring system server through the vehicle-side wireless transceiver module, generate update prompt information, and prompt the vehicle-side user through the vehicle-side internal display module and / or the vehicle-side voice communication module; when receiving the update consent information input by the vehicle-side user, the updated parameters or software are flashed into the intelligent driving system.

8. The intelligent driving car test monitoring system according to claim 4, characterized in that: The remote device is also used to: receive remote data tag information input by a remote user, and send the remote data tag information to the server device through the network; The intelligent driving car test monitoring system server is also used to receive the remote end data marking information sent by the remote end device, and send the remote end data marking information to the vehicle end device through the server end wireless transceiver module; The intelligent driving car test monitoring system processor is also used to receive the remote end data marking information sent by the intelligent driving car test monitoring system server through the vehicle-end wireless transceiver module, and store the remote end data marking information in association with the monitoring information.

9. The intelligent driving car test monitoring system according to claim 8, characterized in that: The vehicle-side device further includes a vehicle-side mobile storage device, and the intelligent driving vehicle test monitoring system processor further includes a mobile storage interface, and the mobile storage interface is connected to the vehicle-side mobile storage device, and, The intelligent driving car test monitoring system processor is also used to store one or more of the monitoring information, the voice communication information, the server-side data marking information, and the remote-side data marking information in the vehicle-side mobile storage device.

10. The intelligent driving car test monitoring system according to claim 1, characterized in that: The vehicle-end device also includes a vehicle-end external prompt module, and, The intelligent driving vehicle test monitoring system processor is also used to generate external prompt information according to the monitoring information and send the external prompt information to the vehicle-side external prompt module; The vehicle-side external prompt module is used to display and / or broadcast the external prompt information.

11. The intelligent driving car test monitoring system according to claim 1, characterized in that: The processor of the intelligent driving car test monitoring system includes a controller power module, a voice module, a display screen interface, an embedded computer or a computer system on a chip, a display screen interface of an internal display device on the vehicle side, a button interface of an internal display device on the vehicle side, a wireless transceiver module interface on the vehicle side, and a vehicle network interface, wherein: The output end of the controller power module is connected to the power input end of the voice module, the display screen interface, the embedded computer or on-chip computer system, the display screen interface of the vehicle-side internal display device, the key interface of the vehicle-side internal display device, the vehicle-side wireless transceiver module interface and the vehicle-mounted network interface, and supplies power to them; and, The voice module is connected to the vehicle-side voice communication module, the display screen interface is connected to the vehicle-side internal display module, the vehicle-mounted network interface is connected to the bus of the smart driving car, the vehicle-side internal display device display screen interface is connected to the display screen of the vehicle-side internal display module, the vehicle-side internal display device button interface is connected to the button of the vehicle-side internal display module, and the vehicle-side wireless transceiver module interface is connected to the vehicle-side wireless transceiver module.

12. The intelligent driving car test monitoring system according to claim 1, characterized in that: The intelligent driving car test monitoring system server is also used to receive server-side selection information of the monitoring information input by the server-side user on the server-side device, and store the server-side selection information in association with the monitoring information.

13. The intelligent driving car test monitoring system according to claim 1, characterized in that: The internal display summary information includes one or more of map information, location information, trajectory planning information, surrounding traffic participant information, and surrounding traffic participant trajectory prediction information.

14. The intelligent driving car test monitoring system according to claim 1, characterized in that: The same server-side device wirelessly communicates with the vehicle-side devices of one or more of the smart driving vehicles.