Intelligent network connection vehicle testing method and device and vehicle

Abstract

The invention relates to an intelligent network connection vehicle testing method and device and a vehicle, and relates to the technical field of intelligent driving. The method comprises the following steps: acquiring vehicle external scene test data and vehicle internal display data; collecting a vehicle state behavior signal, an event prompt signal and a timestamp signal in a test stage; based on the timestamp signal, fusing the vehicle state behavior signal corresponding to the target test moment and the vehicle external scene test data to obtain test data marked with vehicle state behavior information; and on the basis of the timestamp signal, determining vehicle internal display data, test data, vehicle state behavior information and event prompt information corresponding to the target test moment, and performing partitioned visual display. The vehicle internal display, the vehicle external test scene, the vehicle state and the event prompt corresponding to the same moment can be visually displayed at the same time, the test result can be visually compared and rapidly obtained, and the test accuracy is ensured.

Description

Technical Field

[0001] The present disclosure relates to the field of intelligent driving technology, and in particular to an intelligent networked vehicle testing method, device and vehicle. Background Art

[0002] Intelligent connected vehicles are new vehicles equipped with vehicle-side dynamic data collection modules and V2X equipment. They pursue "safety, comfort, efficiency, and energy saving" during driving and have great potential in alleviating traffic congestion and reducing accident rates. The testing of intelligent connected vehicles has a very important impact on their development.

[0003] Currently, when testing intelligent connected vehicles, when an incident occurs during the test, testers are required to manually observe or use handheld cameras to record test content such as the screen display inside the vehicle. However, manual observation may result in negligence and omissions, and since the equipment in the vehicle is widely distributed, handheld camera records cannot guarantee complete capture, which will result in incomplete records and ultimately lead to inaccurate test analysis.

[0004] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present disclosure, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention

[0005] The present invention provides a method, device, electronic equipment and storage medium for testing an intelligent connected vehicle.

[0006] According to a first aspect of an embodiment of the present disclosure, a method for testing an intelligent connected vehicle is provided, comprising:

[0007] Obtain vehicle external scene test data and vehicle internal display data;

[0008] Collect vehicle status behavior signals, event prompt signals and timestamp signals during the test phase;

[0009] Based on the timestamp signal, the vehicle state behavior signal corresponding to the target test time and the vehicle external scene test data are integrated to obtain test data marked with vehicle state behavior information;

[0010] Based on the timestamp signal, determine the vehicle internal display data, test data, vehicle status behavior information and event prompt information corresponding to the target test time;

[0011] The partitioned visualization displays the vehicle's internal display data, test data, vehicle status behavior information and event prompt information corresponding to the target test time.

[0012] In some embodiments, collecting vehicle status behavior signals, event prompt signals, and timestamp signals during the test phase includes:

[0013] In response to the vehicle being in the test phase, the vehicle state behavior signal, the event prompt signal and the timestamp signal are collected in real time via a vehicle signal transmission bus.

[0014] In some embodiments, a method for testing an intelligent connected vehicle is provided, further comprising:

[0015] In response to the marking trigger operation, determining a triggering time;

[0016] Among them, obtaining vehicle external scene test data and vehicle internal display data includes:

[0017] Based on the triggering moment, a prompt tag is inserted into the acquired vehicle external scene test data and vehicle internal display data.

[0018] In some embodiments, collecting vehicle status behavior signals, event prompt signals, and timestamp signals during the test phase includes:

[0019] The log data of the test phase is acquired through a vehicle signal transmission bus, and the vehicle state behavior signal, the event prompt signal and the timestamp signal are extracted from the log data.

[0020] In some embodiments, a method for testing an intelligent connected vehicle is provided, further comprising:

[0021] Based on the triggering moment, a prompt tag is inserted into the log data.

[0022] In some embodiments, based on the timestamp signal, the vehicle state behavior signal corresponding to the target test time and the vehicle external scene test data are fused to obtain test data marked with vehicle state behavior information, including:

[0023] In response to the vehicle external scene test data being a vehicle external scene test video, determining a vehicle external scene test video frame corresponding to the target test time;

[0024] Based on the timestamp signal, determining the vehicle state behavior information corresponding to the target test time;

[0025] The vehicle state behavior information corresponding to the target test time is marked on the vehicle external scene test video frame corresponding to the target test time to obtain the test data.

[0026] In some embodiments, the vehicle state behavior signal includes: a first vehicle state behavior signal and a second vehicle state behavior signal;

[0027] Wherein, the first vehicle state behavior signal is collected by the intelligent networked vehicle;

[0028] The second vehicle status behavior signal is received by the intelligent connected vehicle through a vehicle interconnection system.

[0029] In some embodiments, a method for testing an intelligent connected vehicle is provided, further comprising:

[0030] The vehicle internal display data, test data, vehicle status behavior information and event prompt information corresponding to the target test time are compared to obtain the test result corresponding to the target test time.

[0031] According to a second aspect of an embodiment of the present disclosure, there is provided a smart connected vehicle testing device, comprising:

[0032] A data acquisition module is used to acquire vehicle external scene test data and vehicle internal display data;

[0033] Signal acquisition module, used to collect vehicle status behavior signals, event prompt signals and timestamp signals during the test phase;

[0034] An information labeling module, configured to fuse the vehicle state behavior signal corresponding to the target test time and the vehicle external scene test data based on the timestamp signal to obtain test data labeled with vehicle state behavior information;

[0035] An information determination module, used to determine the vehicle internal display data, test data, vehicle state behavior information and event prompt information corresponding to the target test time based on the timestamp signal;

[0036] A display device is used to visually display the vehicle internal display data, test data, vehicle status behavior information and event prompt information corresponding to the target test time in partitions.

[0037] In some embodiments, the data acquisition module is synchronized with the clock of the signal acquisition module.

[0038] According to a third aspect of an embodiment of the present disclosure, a vehicle is provided, comprising:

[0039] processor;

[0040] a memory for storing processor-executable instructions;

[0041] Among them, the processor is configured to: implement the intelligent connected vehicle testing method described in the first aspect above.

[0042] According to the fourth aspect of an embodiment of the present disclosure, a non-temporary computer-readable storage medium is provided. When the instructions in the storage medium are executed by a processor of a mobile terminal, the mobile terminal is enabled to execute the intelligent connected vehicle testing method described in the first aspect above.

[0043] The technical solution provided by the embodiments of the present disclosure may have the following beneficial effects:

[0044] By acquiring the vehicle external scene test data and the vehicle internal display data; collecting the vehicle state behavior signal, event prompt signal and timestamp signal during the test phase; based on the timestamp signal, integrating the vehicle state behavior signal and the vehicle external scene test data corresponding to the target test time, obtaining the test data marked with the vehicle state behavior information; based on the timestamp signal, determining the vehicle internal display data, test data, vehicle state behavior information and event prompt information corresponding to the target test time; partitioning and visualizing the vehicle internal display data, test data, vehicle state behavior information and event prompt information corresponding to the target test time. By comprehensively collecting the vehicle internal display, vehicle external test scene, vehicle state and event prompt for partitioned visual display, and based on the timestamp signal, ensuring that the vehicle internal display, vehicle external test scene, vehicle state and event prompt corresponding to the same time are visualized at the same time, the test results can be intuitively compared and quickly obtained to ensure the accuracy of the test. And by obtaining the test data marked with the vehicle state behavior information, the vehicle state is marked and displayed in the vehicle external test scene, so as to more intuitively observe the correspondence between the vehicle performance and the test process during the test, and more intuitively verify the effectiveness of the vehicle function and performance.

[0045] The general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] The accompanying drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the specification are used to explain the principles of the present disclosure. Obviously, the accompanying drawings described below are only some embodiments of the present disclosure, and for ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without creative work.

[0047] Figure 1 The following is a process of testing a method for intelligent connected vehicles according to some embodiments of the present disclosure. Figure 1 .

[0048] Figure 2 is a flowchart of an implementation process of step S106 according to some embodiments of the present disclosure.

[0049] Figure 3The following is a process of testing a method for intelligent connected vehicles according to some embodiments of the present disclosure. Figure 2 .

[0050] Figure 4 It is a working logic diagram of a testing tool according to a specific example shown in some embodiments of the present disclosure.

[0051] Figure 5 It is a block diagram of a smart connected vehicle testing device according to some embodiments of the present disclosure.

[0052] Figure 6 It is a schematic diagram of a functional block diagram of a vehicle according to some embodiments of the present disclosure. DETAILED DESCRIPTION

[0053] Some embodiments of the present disclosure will be described in detail here, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. Various changes, modifications and equivalents of the methods, devices and / or systems described herein will become apparent after understanding the present disclosure. For example, the order of operations described herein is merely an example and is not limited to those orders set forth herein, but can be changed as becomes apparent after understanding the present disclosure, except for operations that must be performed in a specific order. In addition, for clarity and brevity, descriptions of features known in the art may be omitted.

[0054] The embodiments described in some embodiments of the present disclosure below do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0055] The specific implementation of the embodiment of the present disclosure is described in detail below with reference to the accompanying drawings.

[0056] Figure 1 The following is a process of testing a method for intelligent connected vehicles according to some embodiments of the present disclosure. Figure 1 ,like Figure 1 As shown, the intelligent connected vehicle testing method can be applied to electronic devices, including but not limited to vehicles, which use C-V2X (Cellular Vehicle-to-Everything, referring to vehicle wireless communication technology based on cellular networks).

[0057] Figure 1 The intelligent connected vehicle testing method shown includes the following steps.

[0058] In step S102, vehicle external scene test data and vehicle internal display data are obtained.

[0059] It should be noted that the vehicle external scene test data represents the data that needs to be recorded when the intelligent connected vehicle verifies C-V2X during road testing. It may include: traffic condition data including road structure and position, lane width, driving direction, lane line type and traffic signs; environmental perception data including visibility, lighting, temperature and humidity data of the current environment; obstacle data including the position and shape of static obstacles such as other vehicles, pedestrians, guardrails, telephone poles and curbs.

[0060] It is understandable that the test method provided in the embodiment of the present disclosure is not limited to the test scenario, and can be a fixed test scenario or a real vehicle test scenario, and the embodiment of the present disclosure is not limited here.

[0061] It should be noted that the vehicle internal display data represents the display of the C-V2X function in the vehicle during the test, and may include, for example: the vehicle dashboard information displayed on the instrument screen, including the speedometer, speed, mileage, fuel remaining or battery power, the status of various warning and fault indicator lights; the HMI (Human Machine Interface) prompt information, map data and navigation prompt information displayed on the central control screen, etc. In a specific embodiment, when the vehicle provides the user with the corresponding function, it may also provide the user with a voice reminder, and the vehicle internal display data may also include the voice data corresponding to each screen display.

[0062] It should be noted that the vehicle test performed in the embodiments of the present disclosure may be a test of the performance of C-V2X applications, for example, it may include C-V2X Day1 test, and Day1 function refers to the first phase application of C-V2X technology, which mainly focuses on basic safety-related services, such as collision warning, emergency electronic brake light notification, etc. These functions are intended to improve road safety and reduce traffic accidents. Day1 applications are usually standardized, which means that they follow industry standards, such as the functions defined in 3GPP Release 14. It may also include C-V2X Day2, which represents the next stage of C-V2X technology, including more advanced services, which may involve functions such as traffic efficiency improvement and autonomous driving support. Day2 has more diverse functions and may include more non-standardized or semi-standardized services. For example, to optimize traffic flow, vehicle platoon driving, remote driving assistance, and other customized functional scenarios, it is necessary to simultaneously collect: real road environment scenes, audio (voice) and image (screen text) prompts at the time of the event, timestamps, scene event prompts, vehicle key signals, vehicle map positioning location and other information to verify the effectiveness of functions and performance.

[0063] Those skilled in the art will appreciate that the above-mentioned vehicle external scene test data, vehicle internal display data and vehicle test examples are merely examples, and the vehicle external scene test data and vehicle internal display data are adaptively adjusted as the vehicle test changes, and are not used to limit the scope of protection of the embodiments of the present disclosure.

[0064] In an exemplary embodiment of the present disclosure, an image acquisition device such as a camera or a sensor may be installed outside the vehicle to capture a test image of a scene outside the vehicle, and the sensor may be set to collect environmental perception data to obtain test data of the scene outside the vehicle. The test data of the scene outside the vehicle may also be obtained by reusing the sensors and cameras originally installed on the vehicle and sending a data call instruction to the vehicle intelligent driving system.

[0065] In an exemplary embodiment of the present disclosure, the vehicle interior display data can be obtained by recording the vehicle interior screen and / or installing an image acquisition device to record, and recording the corresponding voice data. Compared with the images taken by the tester handheld, there may be interference factors such as jitter, shaking, and noise. The present embodiment of the present disclosure can achieve high-quality data collection through screen recording and dedicated equipment collection.

[0066] In step S104, the vehicle state behavior signal, event prompt signal and time stamp signal in the test phase are collected.

[0067] It should be noted that the vehicle state behavior signal represents the vehicle state and vehicle behavior. Specifically, the vehicle state behavior signal includes: a first vehicle state behavior signal and a second vehicle state behavior signal; wherein the first vehicle state behavior signal is collected by the intelligent networked vehicle; and the second vehicle state behavior signal is received by the intelligent networked vehicle through the vehicle interconnection system (V2X system). The first vehicle state behavior signal represents the data generated by the vehicle itself, which can be used to describe the state and behavior of the vehicle, for example, including vehicle speed, steering wheel angle, brake mark, turn signal, hazard light, acceleration, ecall event, collision event, heading angle, GNSS positioning signal, road and lane. The second vehicle state behavior signal represents data about other vehicles received from other vehicles or other measuring devices (such as roadside units, pedestrian handheld terminals), that is, information from "remote vehicles", for example, including vehicle speed, steering wheel angle, brake mark, turn signal, hazard light, acceleration, ecall event, collision event, heading angle, GNSS positioning signal, road and lane.

[0068] It should be noted that the event prompt signal represents the prompt information issued by the vehicle after an event occurs during the operation of the vehicle, and may include, for example, safety event warnings, road status warnings, service event prompts, signal light phase prompts, etc.

[0069] It should be noted that the timestamp signal represents the clock signal of the system in the vehicle, which is a data tag with time information to represent the time information corresponding to the vehicle status behavior signal and the event prompt signal.

[0070] In an exemplary embodiment of the present disclosure, in response to the vehicle being in a test phase, the vehicle state behavior signal, event prompt signal and time stamp signal are collected in real time through the vehicle signal transmission bus. By accessing the vehicle signal transmission bus, the vehicle state behavior signal, event prompt signal and time stamp signal can be collected in real time when the system in the vehicle generates them. The vehicle signal transmission bus can be a CAN (Controller Area Network) bus, or a LIN (Local Interconnect Network) or a higher level Ethernet technology.

[0071] In step S106, based on the timestamp signal, the vehicle state behavior signal corresponding to the target test time and the vehicle external scene test data are fused to obtain test data marked with vehicle state behavior information.

[0072] It should be noted that the test phase includes multiple test moments, and the target test moment can be any test moment in the test phase.

[0073] In step S108, based on the timestamp signal, the vehicle interior display data, test data, vehicle state behavior information and event prompt information corresponding to the target test time are determined.

[0074] It should be noted that based on the timestamp signal, the vehicle internal display data, test data, vehicle state behavior signal and event prompt signal corresponding to the target test time can be determined, and the vehicle state behavior signal and event prompt signal can be converted into vehicle state behavior information and event prompt information that can be viewed by the user. The vehicle internal display data and test data can be video frames, which can be viewed as images.

[0075] In step S110, the vehicle internal display data, test data, vehicle status behavior information and event prompt information corresponding to the target test time are displayed in a partitioned visual manner.

[0076] It should be noted that in order to facilitate intuitive comparison and viewing by testers, the vehicle's internal display data, test data, vehicle status behavior information and event prompt information corresponding to the target test time are displayed in partitions on the same page of the display device, so as to compare whether the corresponding functions of the vehicle are realized and the implementation effect.

[0077] In an exemplary embodiment of the present disclosure, in response to the vehicle interior display data containing audio data, an audio mark is added during display, and an audio playback function can be provided to play the audio data contained in the vehicle interior display data. And the target test time is set to each test time of the test phase, and a continuous partition display test item comparison video can be obtained. In response to the test item with audio recorded, a trigger switch for audio playback is set, and the corresponding audio can be played.

[0078] It can be seen from the above steps that the intelligent networked vehicle testing method provided by the embodiment of the present disclosure obtains vehicle external scene test data and vehicle internal display data; collects vehicle status behavior signals, event prompt signals and timestamp signals during the test phase; based on the timestamp signal, fuses the vehicle status behavior signal and vehicle external scene test data corresponding to the target test moment to obtain test data marked with vehicle status behavior information; based on the timestamp signal, determines the vehicle internal display data, test data, vehicle status behavior information and event prompt information corresponding to the target test moment; and visually displays the vehicle internal display data, test data, vehicle status behavior information and event prompt information corresponding to the target test moment in a partitioned manner. By comprehensively collecting the vehicle internal display, vehicle external test scene, vehicle status and event prompts for partitioned visual display, and by ensuring that the vehicle internal display, vehicle external test scene, vehicle status and event prompts corresponding to the same moment are simultaneously visualized based on the timestamp signal, the test results can be intuitively compared and quickly obtained to ensure the accuracy of the test. By obtaining test data annotated with vehicle status behavior information, the vehicle status is marked and displayed in the vehicle's external test scene, so as to more intuitively observe the correspondence between the vehicle performance during the test and the test process, and more intuitively verify the effectiveness of the vehicle's functions and performance.

[0079] Those skilled in the art can understand that by comparing the vehicle internal display data, test data, vehicle status behavior information and event prompt information corresponding to the target test time displayed in the partition, the test result corresponding to the target test time can be obtained, and the test result corresponding to the target test time can be obtained, whether the test is passed, and how the performance test effect is. In other words, the intelligent networked vehicle testing method provided by the embodiment of the present disclosure also includes: comparing the vehicle internal display data, test data, vehicle status behavior information and event prompt information corresponding to the target test time, and obtaining the test result corresponding to the target test time.

[0080] In some exemplary embodiments of the present disclosure, in order to ensure that various information and data collection are synchronized during the test process, the clocks of various systems in the vehicle are synchronized in advance to ensure that the time system of each system is the same.

[0081] like Figure 2As shown, it is a flowchart of the implementation process of step S106 provided for some exemplary embodiments of the present disclosure, including the following steps.

[0082] In step S202, in response to the vehicle external scene test data being a vehicle external scene test video, a vehicle external scene test video frame corresponding to a target test moment is determined.

[0083] It should be noted that the vehicle external scene test data can be a collected video, including video frames corresponding to multiple test moments, and the vehicle external scene test video frame corresponding to the target test moment can be determined, that is, a vehicle external scene test image.

[0084] In step S204, based on the timestamp signal, the vehicle state behavior information corresponding to the target test time is determined.

[0085] In some exemplary embodiments of the present disclosure, based on the timestamp signal, a vehicle state behavior signal corresponding to the target test time can be determined, and the vehicle state behavior signal corresponding to the target test time can be converted into vehicle state behavior information corresponding to the target test time. For example, the vehicle speed can be 25Km / h and the steering angle can be 6°.

[0086] In step S206, the vehicle state behavior information corresponding to the target test time is annotated on the vehicle external scene test video frame corresponding to the target test time to obtain test data.

[0087] In some exemplary embodiments of the present disclosure, the vehicle status behavior information corresponding to the target test moment may be marked at the corresponding position of the vehicle external scene test image, and the vehicle status behavior information may be marked in the form of a watermark by adding a watermark layer so that the test personnel can view it more intuitively.

[0088] The disclosed embodiment annotates the vehicle state behavior information on the vehicle external scene test video frame to integrate the vehicle state behavior information with the vehicle external scene test environment, so as to more intuitively determine whether the vehicle provides the correct response function for the test item. For example, the vehicle external scene test environment shows that the distance between the wheel and the obstacle is very close, and the marked vehicle speed is 50km / h. The tester can directly judge the obstacle judgment error based on the annotated image displayed in the test data.

[0089] In some exemplary embodiments of the present disclosure, during the testing process, the tester can record the testing process. When the tester manually finds a problem in the test, a marking trigger operation can be performed, that is, the problem marking is triggered through human-computer interaction, so as to timely record the time when the problem occurs during the testing process, so as to facilitate subsequent rapid backtracking or problem reminder.

[0090] Accordingly, Figure 3The following is a process of testing a method for intelligent connected vehicles according to some embodiments of the present disclosure. Figure 2 , Figure 3 Steps S306 to S312 in the intelligent connected vehicle testing method shown in FIG. Figure 1 Steps S104 to S110 in the intelligent connected vehicle testing method shown correspond to each other and will not be repeated here.

[0091] In some embodiments of the present disclosure, Figure 1 Based on the intelligent connected vehicle testing method shown, Figure 3 The intelligent connected vehicle testing method shown may also include the following steps.

[0092] In step S302, in response to the mark trigger operation, a trigger time is determined.

[0093] In step S304, based on the triggering moment, a prompt tag is inserted into the acquired vehicle external scene test data and vehicle internal display data.

[0094] It should be noted that based on the trigger moment, a prompt label is inserted into the acquired vehicle external scene test data and the data corresponding to the trigger moment in the vehicle internal display data to remind that there may be test problems at this moment and to alert the tester.

[0095] In an exemplary embodiment of the present disclosure, a text annotation or a graphic mark can be inserted into the video frame corresponding to the triggering moment as a prompt label, so that when tracing back the test problem later, the prompt label can be screened to realize the rapid location of the problem.

[0096] In some exemplary embodiments of the present disclosure, the implementation of step S306 may include: obtaining the log data of the test phase through the vehicle signal transmission bus, and extracting the vehicle state behavior signal, event prompt signal and timestamp signal from the log data. Accordingly, in order to timely record the time when the problem occurs, the intelligent networked vehicle testing method provided by the embodiment of the present disclosure also includes: inserting a prompt tag into the log data based on the triggering time, that is, the vehicle state behavior signal, event prompt signal and timestamp signal extracted from the log data all carry prompt tags to mark the test problem, so that when tracing the test problem later, the prompt tag can be screened to achieve rapid location of the problem.

[0097] It should be noted that vehicle log data is the operating data of the vehicle's internal systems, including information collected from various sensors, electronic control units (ECUs) and other systems of the vehicle. This data is very important for diagnosis, maintenance, performance analysis and accident investigation. Log data can be obtained through the on-board diagnostic system (OBD-II) interface or dedicated data recording equipment.

[0098] In some exemplary embodiments of the present disclosure, the provided intelligent connected vehicle testing method also includes: storing the collected vehicle status behavior signals, event prompt signals and timestamp signals, the acquired vehicle external scene test data and vehicle internal display data, and the test data marked with vehicle status behavior information, so as to archive the data for subsequent viewing, analysis, backtracking and other operations.

[0099] In order to better illustrate the intelligent connected vehicle testing method provided by the embodiment of the present disclosure, a specific example is now provided for further explanation. Figure 4 As shown, it is a working logic diagram of the test tool constructed by the intelligent connected vehicle testing method provided by the embodiment of the present disclosure in this specific example.

[0100] The vehicle is equipped with C-V2X system functions, including at least the C-V2X hardware system, a screen for displaying V2X events, a screen for displaying map information, and a speaker for playing voice prompts of V2X events. The various systems in the vehicle complete time synchronization to achieve the same time system baseline.

[0101] The test tool includes at least: an image acquisition module, which may include an external forward-facing camera (the vehicle's own camera or sensor may be reused) and an in-vehicle screen recording unit, a vehicle signal transmission bus access device, a data storage device, a controller, a label marking module, and an independent display device. The above-mentioned functional modules complete time synchronization to achieve the same time system baseline.

[0102] Among them, the data storage device is not shown in the figure, which is used to store the information and data collected and processed by the test tool to archive the data.

[0103] like Figure 4 As shown, the working logic of each functional module of the test tool includes:

[0104] The label marking module inserts labels into the vehicle's log data or the data collected by the vehicle signal transmission bus access device, as well as the video material collected by the image acquisition module, for rapid location of test problems.

[0105] The image acquisition module collects vehicle external images, HMI (Human Machine Interface) prompts, audio and video, map display and other information.

[0106] Access the vehicle signal bus through the vehicle signal transmission bus access device to collect V2X event signals (including safety event alarms, road status alarms, service event prompts, signal light phase prompts, etc.), timestamp signals, own vehicle key signals and remote vehicle key signals. The own vehicle key signal is the first vehicle state behavior signal, and the remote vehicle key signal is the second vehicle state behavior signal.

[0107] The controller marks the vehicle's external image with a watermark based on the timestamp signal, the ego vehicle's key signal, and the remote vehicle's key signal for easy observation and comparison;

[0108] The controller integrates the above data and information and outputs it to an independent display device, where multiple sections of content are displayed on the device page to determine the verification results of V2X event triggering through images, prompt labels, event information, status behavior information, etc. When the image is displayed, it is marked that there is audio, and a trigger switch for audio playback is set to selectively play audio.

[0109] It can be seen from the above working logic that the test tool provided by this specific example does not require the tester to use an external camera to record images, which is convenient for the tester to operate and use; compared with the solution of handheld collection by the tester, it can avoid the problems of image jitter and noisy sounds in the cabin during the vehicle driving, which cause the problem of information processing caused by the loss of image and audio recording content. It can also avoid the inability to accurately trace the location of the vehicle on the map due to the inability to simultaneously frame multiple screens or the poor accuracy of the framing information, so as to collect data with higher quality; the collected information and the processed information can be intuitively compared to directly determine whether the current function result conforms to the scene algorithm; it can realize the alignment of multi-system timestamps, so that when aligning the V2X scene event prompts and log information in the future, they can be aligned at all times for easy reverse tracing. Tags can also be inserted into the collected materials to quickly locate the occurrence of test problems.

[0110] It should be noted that the acquisition, storage, use, and processing of data in the technical solution disclosed in this disclosure are in compliance with the relevant provisions of national laws and regulations.

[0111] The following are embodiments of the device disclosed herein, which can be used to execute the method embodiments disclosed herein. For details not disclosed in the device embodiments disclosed herein, please refer to the method embodiments disclosed herein.

[0112] Figure 5 is a block diagram of a smart connected vehicle testing device according to some embodiments of the present disclosure. Figure 5 The device includes: a data acquisition module 501, a signal acquisition module 502, an information marking module 503, an information determination module 504 and a display device 505.

[0113] The data acquisition module 501 is used to acquire vehicle external scene test data and vehicle internal display data;

[0114] The signal acquisition module 502 is used to collect vehicle status behavior signals, event prompt signals and time stamp signals during the test phase;

[0115] The information labeling module 503 is used to fuse the vehicle state behavior signal corresponding to the target test time and the vehicle external scene test data based on the timestamp signal to obtain the test data labeled with the vehicle state behavior information;

[0116] An information determination module 504 is used to determine the vehicle internal display data, test data, vehicle state behavior information and event prompt information corresponding to the target test time based on the timestamp signal;

[0117] The display device 505 is used to visually display the vehicle internal display data, test data, vehicle status behavior information and event prompt information corresponding to the target test time in partitions.

[0118] In some exemplary embodiments of the present disclosure, the clocks of the data acquisition module and the signal acquisition module are synchronized to ensure data acquisition in the same time system, which can be achieved through NTP (Network Time Protocol) protocol, PTP (Precision Time Protocol) protocol, GPS (Global Positioning System) protocol, hardware clock synchronization, etc.

[0119] In some exemplary embodiments of the present disclosure, the signal acquisition module 502 is configured as follows:

[0120] In response to the vehicle being in the test phase, the vehicle state behavior signal, the event prompt signal and the time stamp signal are collected in real time through the vehicle signal transmission bus.

[0121] In some exemplary embodiments of the present disclosure, the information annotation module 503 is configured to:

[0122] In response to the vehicle external scene test data being a vehicle external scene test video, determining a vehicle external scene test video frame corresponding to a target test time;

[0123] Based on the timestamp signal, determine the vehicle state behavior information corresponding to the target test time;

[0124] The vehicle state behavior information corresponding to the target test time is annotated on the vehicle external scene test video frame corresponding to the target test time to obtain test data.

[0125] In some exemplary embodiments of the present disclosure, the vehicle state behavior signal includes: a first vehicle state behavior signal and a second vehicle state behavior signal; wherein the first vehicle state behavior signal is collected by an intelligent connected vehicle; and the second vehicle state behavior signal is received by the intelligent connected vehicle through a vehicle interconnection system.

[0126] In some exemplary embodiments of the present disclosure, a smart connected vehicle testing device is provided, further comprising: a tag marking module, configured to: determine a triggering moment in response to a tag triggering operation.

[0127] Accordingly, the data acquisition module 501 is configured to insert a prompt tag into the acquired vehicle external scene test data and vehicle internal display data based on the triggering moment. The signal acquisition module 502 is configured to acquire the log data of the test phase through the vehicle signal transmission bus, and extract the vehicle state behavior signal, event prompt signal and timestamp signal from the log data.

[0128] In some exemplary embodiments of the present disclosure, the tag marking module is configured to insert a prompt tag into the log data based on a triggering moment.

[0129] In some exemplary embodiments of the present disclosure, the provided intelligent connected vehicle testing device also includes: a test analysis module, which is used to compare the vehicle internal display data, test data, vehicle status behavior information and event prompt information corresponding to the target test time to obtain the test result corresponding to the target test time.

[0130] Figure 6 6 is a block diagram of a vehicle 600 according to an exemplary embodiment. For example, the vehicle 600 may be a hybrid vehicle, a non-hybrid vehicle, an electric vehicle, a fuel cell vehicle, or other types of vehicles. The vehicle 600 may be an autonomous vehicle, a semi-autonomous vehicle, or a non-autonomous vehicle.

[0131] Reference Figure 6 , the vehicle 600 may include various subsystems, for example, an infotainment system 610, a perception system 620, a decision control system 630, a drive system 640, and a computing platform 650. The vehicle 600 may also include more or fewer subsystems, and each subsystem may include multiple components. In addition, each subsystem and each component of the vehicle 600 may be interconnected by wire or wireless means.

[0132] In some embodiments, the infotainment system 610 may include a communication system, an entertainment system, and a navigation system, etc.

[0133] The perception system 620 may include several sensors for sensing information about the environment around the vehicle 600. For example, the perception system 620 may include a global positioning system (the global positioning system may be a GPS system, or a Beidou system or other positioning systems), an inertial measurement unit (IMU), a laser radar, a millimeter wave radar, an ultrasonic radar, and a camera.

[0134] The decision control system 630 may include a computing system, a vehicle controller, a steering system, a throttle, and a braking system.

[0135] The drive system 640 may include components that provide powered motion for the vehicle 600. In one embodiment, the drive system 640 may include an engine, an energy source, a transmission system, and wheels. The engine may be one or a combination of an internal combustion engine, an electric motor, and an air compression engine. The engine is capable of converting energy provided by the energy source into mechanical energy.

[0136] Some or all functions of the vehicle 600 are controlled by a computing platform 650. The computing platform 650 may include at least one processor 651 and a memory 652, and the processor 651 may execute instructions 653 stored in the memory 652.

[0137] The processor 651 may be any conventional processor, such as a commercially available CPU. The processor may also include, for example, a Graphic Process Unit (GPU), a Field Programmable Gate Array (FPGA), a System on Chip (SOC), an Application Specific Integrated Circuit (ASIC), or a combination thereof.

[0138] The memory 652 may be implemented by any type of volatile or nonvolatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0139] In addition to the instructions 653 , the memory 652 may also store data, such as road maps, route information, and data such as the location, direction, and speed of the vehicle. The data stored in the memory 652 may be used by the computing platform 650 .

[0140] In the embodiment of the present disclosure, the processor 651 can execute instruction 653 to complete all or part of the steps of the above-mentioned intelligent connected vehicle testing method.

[0141] In some embodiments of the present disclosure, a non-temporary computer-readable storage medium, when instructions in the storage medium are executed by a processor of a mobile terminal, enables the mobile terminal to execute the above-mentioned intelligent connected vehicle testing method.

[0142] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0143] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A method for testing an intelligent connected vehicle, characterized in that: include: Obtain vehicle external scene test data and vehicle internal display data; Collect vehicle status behavior signals, event prompt signals and timestamp signals during the test phase; Based on the timestamp signal, the vehicle state behavior signal corresponding to the target test time and the vehicle external scene test data are integrated to obtain test data marked with vehicle state behavior information; Based on the timestamp signal, determine the vehicle internal display data, test data, vehicle status behavior information and event prompt information corresponding to the target test time; The partitioned visualization displays the vehicle's internal display data, test data, vehicle status behavior information and event prompt information corresponding to the target test time.

2. The intelligent connected vehicle testing method according to claim 1, characterized in that: Collect vehicle status behavior signals, event prompt signals, and timestamp signals during the test phase, including: In response to the vehicle being in the test phase, the vehicle state behavior signal, the event prompt signal and the timestamp signal are collected in real time via a vehicle signal transmission bus.

3. The intelligent connected vehicle testing method according to claim 1, characterized in that: Also includes: In response to the marking trigger operation, determining a triggering time; Among them, obtaining vehicle external scene test data and vehicle internal display data includes: Based on the triggering moment, a prompt tag is inserted into the acquired vehicle external scene test data and vehicle internal display data.

4. The intelligent connected vehicle testing method according to claim 3, characterized in that: Collect vehicle status behavior signals, event prompt signals, and timestamp signals during the test phase, including: The log data of the test phase is acquired through a vehicle signal transmission bus, and the vehicle state behavior signal, the event prompt signal and the timestamp signal are extracted from the log data.

5. The intelligent connected vehicle testing method according to claim 4, characterized in that: Also includes: Based on the triggering moment, a prompt tag is inserted into the log data.

6. The intelligent connected vehicle testing method according to claim 1, characterized in that: Based on the timestamp signal, the vehicle state behavior signal corresponding to the target test time and the vehicle external scene test data are integrated to obtain test data marked with vehicle state behavior information, including: In response to the vehicle external scene test data being a vehicle external scene test video, determining a vehicle external scene test video frame corresponding to the target test time; Based on the timestamp signal, determining the vehicle state behavior information corresponding to the target test time; The vehicle state behavior information corresponding to the target test time is marked on the vehicle external scene test video frame corresponding to the target test time to obtain the test data.

7. The intelligent connected vehicle testing method according to claim 1, characterized in that: The vehicle state behavior signal comprises: a first vehicle state behavior signal and a second vehicle state behavior signal; Wherein, the first vehicle state behavior signal is collected by the intelligent networked vehicle; The second vehicle status behavior signal is received by the intelligent connected vehicle through a vehicle interconnection system.

8. The intelligent connected vehicle testing method according to claim 1, characterized in that: Also includes: The vehicle internal display data, test data, vehicle status behavior information and event prompt information corresponding to the target test time are compared to obtain the test result corresponding to the target test time.

9. An intelligent networked vehicle testing device, characterized in that: include: A data acquisition module is used to acquire vehicle external scene test data and vehicle internal display data; Signal acquisition module, used to collect vehicle status behavior signals, event prompt signals and timestamp signals during the test phase; An information labeling module, configured to fuse the vehicle state behavior signal corresponding to the target test time and the vehicle external scene test data based on the timestamp signal to obtain test data labeled with vehicle state behavior information; An information determination module, used to determine the vehicle internal display data, test data, vehicle state behavior information and event prompt information corresponding to the target test time based on the timestamp signal; A display device is used to visually display the vehicle internal display data, test data, vehicle status behavior information and event prompt information corresponding to the target test time in partitions.

10. The intelligent connected vehicle testing device according to claim 9, characterized in that: The data acquisition module is synchronized with the clock of the signal acquisition module.

11. A vehicle, characterized in that: include: processor; a memory for storing processor-executable instructions; Wherein, the processor is configured to: Implement a smart connected vehicle testing method as described in any one of claims 1 to 8.

12. A non-temporary computer-readable storage medium, when the instructions in the storage medium are executed by a processor of a mobile terminal, enables the mobile terminal to execute a smart connected vehicle testing method as described in any one of claims 1 to 8.

Images