An evaluation method, device and equipment of an automobile remote updating system and a storage medium

Abstract

This application discloses an evaluation method, apparatus, device, and storage medium for a remote vehicle update system, used for automated evaluation of the remote vehicle update system. The method includes: upon receiving an instruction to remotely update a vehicle via the remote vehicle update system, performing a simulated remote update operation on the vehicle's central control screen; during the simulated remote update operation on the central control screen, acquiring the vehicle's response data to the simulated operation; comparing the vehicle's response data to the simulated operation with pre-stored standard information to obtain a first comparison result; and evaluating the remote vehicle update system based at least on the first comparison result. Using the solution provided in this application, automated evaluation of the remote vehicle update system is achieved, saving labor costs, and the evaluation results are not affected by subjective human factors.

Description

Technical Field

[0001] This application relates to the field of automotive technology, and in particular to an evaluation method, apparatus, device, and storage medium for a remote update system for automobiles. Background Technology

[0002] Remote online vehicle updates allow cars to upgrade and update their systems and functions via the internet. This can improve user experience, fix software vulnerabilities, and avoid recall risks. In the current automotive market, remote updates have expanded beyond traditional in-vehicle entertainment system updates to encompass all electronic control modules, including powertrain, safety, chassis, and body control systems. Consequently, remote update systems are becoming increasingly complex, incorporating more functions and scenarios, thus demanding higher standards for functionality and stability assessment.

[0003] Currently, the evaluation of automotive remote update systems is usually conducted manually. This involves human operators using the in-vehicle central control screen for touchscreen operation, supplemented by signal monitoring equipment to observe and evaluate the vehicle's performance during the remote upgrade process. However, manual evaluation is time-consuming, requires significant human resources, is inefficient, and is prone to subjective bias, leading to inaccurate and subjective results.

[0004] Therefore, how to provide an automated evaluation method for automotive remote update systems to reduce manual workload and accurately and efficiently complete the automated evaluation of automotive remote update systems has become an urgent technical problem to be solved. Summary of the Invention

[0005] This application provides an evaluation method, apparatus, device, and storage medium for a vehicle remote update system, which is used to automate the evaluation of the vehicle remote update system, reduce manual workload, improve efficiency, and complete a comprehensive evaluation of various operating conditions.

[0006] This application provides an evaluation method for a vehicle remote update system, including:

[0007] Upon receiving an instruction to remotely update the vehicle via the vehicle remote update system, a remote update simulation operation is performed on the vehicle's central control screen.

[0008] During the process of remotely updating the car's central control screen in a simulated operation, the response data of the car to the simulated operation is acquired.

[0009] The vehicle's response data to the simulated operation is compared with pre-stored standard information to obtain a first comparison result;

[0010] The vehicle remote update system shall be evaluated at least based on the first comparison result.

[0011] The beneficial effects of this application are as follows: Upon receiving a remote update command, the system automatically controls the vehicle's central control screen to perform a simulated operation, automatically collects the vehicle's response data to the simulated operation, and compares it with pre-stored standard information. Based on the comparison results, an evaluation of the vehicle's remote update system is generated. Therefore, no manual operation is required throughout the entire simulation and evaluation process, achieving automatic and efficient evaluation of the vehicle's remote update system. Furthermore, because the comparison standards are unified, the evaluation results are accurate and unique, unaffected by subjective human factors.

[0012] In one embodiment, the simulated remote update operation of the vehicle's central control screen includes:

[0013] A preset program script is sent to a robotic arm capable of touch operation on the car's central control screen, so that the robotic arm can perform a remote update simulation operation on the car's central control screen according to the operation instructions in the preset program script. The instructions stored in the preset program script are the operation instructions for the central control screen during the remote update process.

[0014] In one embodiment, acquiring the vehicle's response data to the simulated operation during the remote update simulation of the vehicle's central control screen includes:

[0015] During the simulated operation of the car's central control screen, the screen's display image is captured by a camera.

[0016] In one embodiment, capturing the image displayed on the central control screen via a camera includes:

[0017] The camera captures the display screen corresponding to the screen switching process of the central control screen.

[0018] In one embodiment, comparing the vehicle's response data to the simulated operation with pre-stored standard information to obtain a first comparison result includes:

[0019] Calculate the similarity between the vehicle's response data to the simulated operation and pre-stored standard information;

[0020] The similarity is determined as the first comparison result.

[0021] In one embodiment, evaluating the vehicle remote update system based at least on the first comparison result includes:

[0022] When the first comparison result is used to characterize the similarity between the vehicle's response data to the simulated operation and the pre-stored standard information, the similarity is greater than a preset similarity, the vehicle remote update system is determined to be qualified.

[0023] When the first comparison result, used to characterize the similarity between the vehicle's response data to the simulated operation and the pre-stored standard information, is less than a preset similarity, the vehicle remote update system is determined to be unqualified.

[0024] In one embodiment, the method further includes:

[0025] During the remote update and installation of the corresponding upgrade package, data related to the installation process is obtained;

[0026] The data related to the installation process is compared with pre-stored standard information to obtain a second comparison result;

[0027] The evaluation of the vehicle remote update system based at least on the first comparison result includes:

[0028] The vehicle remote update system shall be evaluated based at least on the first comparison result and the second comparison result.

[0029] This application also provides an evaluation device for a vehicle remote update system, comprising:

[0030] The simulation module is used to perform a remote update simulation operation on the central control screen of the vehicle when it receives an instruction to remotely update the vehicle through the vehicle remote update system.

[0031] The acquisition module is used to acquire the vehicle's response data to the simulated operation during the process of remotely updating the vehicle's central control screen.

[0032] The comparison module is used to compare the vehicle's response data to the simulated operation with pre-stored standard information to obtain a first comparison result;

[0033] An evaluation module is used to evaluate the vehicle remote update system based at least on the first comparison result.

[0034] This application also provides an evaluation device for a vehicle remote update system, comprising:

[0035] At least one processor; and,

[0036] A memory communicatively connected to the at least one processor; wherein,

[0037] The memory stores instructions that can be executed by the at least one processor to implement the evaluation method for the vehicle remote update system described in any of the above embodiments.

[0038] This application also provides a computer-readable storage medium, which, when the instructions in the storage medium are executed by a processor corresponding to an evaluation system for a vehicle remote update system, enables the evaluation system for a vehicle remote update system to implement the evaluation method for a vehicle remote update system described in any of the above embodiments.

[0039] Other features and advantages of this application will be set forth in the description which follows, and will be apparent in part from the description, or may be learned by practicing the application. The objectives and other advantages of this application may be realized and obtained by means of the structures particularly pointed out in the written description, claims, and drawings.

[0040] The technical solution of this application will be further described in detail below with reference to the accompanying drawings and embodiments. Attached Figure Description

[0041] The accompanying drawings are provided to further illustrate the present application and form part of the specification. They are used together with the embodiments of the present application to explain the application and do not constitute a limitation thereof. In the drawings:

[0042] Figure 1 This is a flowchart of an evaluation method for a vehicle remote update system according to an embodiment of this application;

[0043] Figure 2 This is a flowchart of an evaluation method for a vehicle remote update system according to another embodiment of this application;

[0044] Figure 3 This is a block diagram of an automated evaluation device for remote vehicle updates according to an embodiment of this application;

[0045] Figure 4 A structural block diagram of an automated evaluation platform for a remote vehicle update system, as described in one embodiment of the application, for automatically evaluating a remote vehicle update system.

[0046] Figure 5 This is a schematic diagram illustrating the automated triggering of the automated evaluation platform for the vehicle remote update system in one embodiment of this application;

[0047] Figure 6 This is a schematic diagram simulating user operation of an automated evaluation platform for a vehicle remote update system in one embodiment of this application;

[0048] Figure 7 This is a schematic diagram illustrating the automated monitoring and evaluation of the upgrade package installation progress by the automated evaluation platform of the vehicle remote update system in one embodiment of this application;

[0049] Figure 8 This is a schematic diagram of the hardware structure of an evaluation device for a remote vehicle update system according to this application. Detailed Implementation

[0050] The preferred embodiments of this application are described below with reference to the accompanying drawings. It should be understood that the preferred embodiments described herein are for illustration and explanation only and are not intended to limit this application.

[0051] Figure 1 This is a flowchart of an evaluation method for a vehicle remote update system according to an embodiment of this application. This method can be used to automatically evaluate vehicle remote update systems, such as... Figure 1 As shown, the method can be implemented as follows: S101-S104:

[0052] In step S101, when an instruction is received to remotely update the vehicle through the vehicle remote update system, a remote update simulation operation is performed on the vehicle's central control screen.

[0053] In step S102, during the process of remotely updating the car's central control screen, the response data of the car to the simulated operation is acquired.

[0054] In step S103, the response data of the vehicle to the simulated operation is compared with pre-stored standard information to obtain a first comparison result;

[0055] In step S104, the vehicle remote update system is evaluated at least based on the first comparison result.

[0056] The method described in this application can be applied to an automated evaluation platform for automotive remote update systems. Figure 4 This is a structural block diagram of an automated evaluation platform for a remote vehicle update system, as described in one embodiment of the application, for automatically evaluating a remote vehicle update system. Figure 4 As shown, the platform consists of four subsystems: "Vehicle Status Monitoring System", "Touchscreen Control System", "Text and Image Capture System", and "Return Result Comparison and Evaluation System".

[0057] The "Vehicle Status Monitoring System" connects to the vehicle's CAN bus network via a CANoe (CAN open environment, automotive bus development environment) device, monitors vehicle bus communication data in real time, and automatically sends and receives data according to pre-set program scripts. This system has two main functions: first, it reads and records certain remote update-related data on the bus at specific time points for subsequent evaluation of the vehicle's remote update system's behavior on the bus data; second, it sends certain specific data at specific time points to simulate some user operations, such as shifting gears and opening and closing doors. These operations can enrich the simulated scenarios and working conditions, ensuring that the automated evaluation platform can cover various daily user scenarios.

[0058] The "touchscreen control system" consists of a programmable, 6-DOF robotic arm. After fixing the position of the car's central control screen, the robotic arm can execute various screen touch operations according to a pre-entered program script, thereby simulating the user's operations on the central control screen in the car. It can also press the ignition switch to change the vehicle's ignition status. The robotic arm has universal applicability, working with both Android and Linux-based in-vehicle infotainment systems without requiring intrusion into the vehicle's system to control the central control screen.

[0059] The "text and image capture system" monitors the central control screen in real time via a camera. The shooting action is controlled by a pre-written program, capturing the display screen at the appropriate time. After the image is captured, the text and graphic information in the image are extracted and transmitted to the "result comparison and evaluation system" for comparison with the input standard information, realizing automated evaluation of images and text.

[0060] The "Return Result Comparison and Evaluation System" has two main functions. First, it determines the current progress of the remote update based on the information and data returned by the other three systems and decides on the next steps. Second, it compares the data returned by the other three systems with pre-input standard information to evaluate whether each stage of the remote update meets the design requirements, and then summarizes and integrates all the comparison results to generate an evaluation report.

[0061] In this application, upon receiving an instruction to remotely update a vehicle via a remote vehicle update system, a simulated remote update operation is performed on the vehicle's central control screen. In one embodiment, a preset program script is sent to a robotic arm capable of touch-operating the vehicle's central control screen. This allows the robotic arm to perform a simulated remote update operation on the central control screen according to the operation instructions in the preset program script. The instructions stored in the preset program script are the operation instructions for the central control screen during the remote update process. Specifically, the preset program script sends the required remote update operation instructions to the robotic arm in the "touchscreen control system," enabling the robotic arm to simulate manual remote update operations. It is understood that this simulated operation includes, but is not limited to, automated triggering of the remote update function, simulated user interaction, and upgrade package installation during the remote update process.

[0062] During the simulated remote update operation of the vehicle's central control screen, the vehicle's response data to the simulated operation is acquired. To determine the performance of the remote update system during the remote upgrade process, the vehicle's response during the simulated operation needs to be analyzed. In one embodiment of this application, during the simulated operation of the vehicle's central control screen, the screen display is captured by a camera. Specifically, the screen display is acquired through a text and image capture system, and vehicle bus communication data is acquired in real time through a vehicle status monitoring system. Then, the acquired response data is transmitted back to a result comparison and evaluation system. The step of capturing the central control screen display by camera includes capturing the display screen corresponding to the screen switching process. For example, in the automated triggering operation of the remote update function, a robotic arm clicks at a designated location on the central control screen, triggering the user to actively check for a remote update of the vehicle software. The camera captures the switching process of the central control screen before and after the robotic arm clicks to determine whether the triggering operation was successful. Understandably, in addition to the aforementioned page switching process, the camera also records the entire simulated operation process, including triggering, interaction, and updates, during the simulation, in order to analyze and evaluate the entire update process. Furthermore, to reflect the performance of the update system, the response data may also include response time to analyze the speed and smoothness of the software update.

[0063] The vehicle's response data to the simulated operation is compared with pre-stored standard information to obtain a first comparison result. This comparison process is completed in a feedback result comparison and evaluation system.

[0064] To achieve automated evaluation, the acquired response data needs to be processed and compared with standard pre-stored information to obtain objective evaluation results. Before comparing the response data with standard information, the response data must first be standardized. Specifically, this includes separating and extracting graphics and text from the central control screen display interface captured by the camera to facilitate judgment on whether the interactive information meets expectations; determining the coordinates of the robotic arm's touch position in the image to analyze the accuracy of the robotic arm's click location; and analyzing the response time of the central control screen switching after the robotic arm touches the screen to analyze the timeliness and stability of the system response.

[0065] After data standardization, the response data of the simulated operation needs to be compared with the pre-stored standard information. In one embodiment of this application, the similarity between the vehicle's response data to the simulated operation and the pre-stored standard information is calculated; the similarity is determined as the first comparison result. In one embodiment, the similarity between the display screen corresponding to the central control screen switching process captured by the camera and the pre-stored standard screen switching process corresponding to the simulated operation is obtained by comparing the display screen corresponding to the central control screen switching process with the pre-stored standard screen switching process corresponding to the simulated operation. There are many methods for calculating similarity, which are not specifically listed here. In this embodiment, the response data includes not only the page switching process but also the response time. Therefore, the similarity calculation in this embodiment includes four aspects: First, whether the executed operation meets the expected performance, that is, whether the operation content in the simulated operation screen is consistent with that in the standard screen. For example, if the standard screen executes the next step, the operation in the simulated screen is monitored to see if it is the next step. Second, the accuracy of the executed operation, that is, the accuracy of the robot's click position. For example, clicking in the exact center of the interactive button results in high accuracy, while the further away from the exact center of the interactive button, the lower the accuracy. Third, the sensitivity of the executed operation. The shorter the page switching response time, the higher the sensitivity. Fourth, the stability of the executed operation. The smoother the installation process in the remote update operation, the higher the stability.

[0066] The vehicle remote update system is evaluated at least based on the first comparison result. After obtaining the comparison result of the simulated operation, the evaluation of the vehicle remote update system is completed based on the comparison result. Specifically, when the similarity between the first comparison result, which indicates that the vehicle's response data to the simulated operation is greater than a preset similarity value, and the pre-stored standard information is greater than a preset similarity value, the vehicle remote update system is determined to be qualified; when the first comparison result, which indicates that the similarity between the first comparison result, which indicates that the vehicle's response data to the simulated operation is less than a preset similarity value, the vehicle remote update system is determined to be unqualified. For example, when the first comparison result is the comparison result of page switching, the similarity can be used to judge whether the executed operation meets the expected performance. When the similarity is greater than a preset value, it means that the operation content in the simulated operation screen is consistent with that in the standard screen, indicating that the system can complete the preset update operation, and the system is qualified; otherwise, it means that the system cannot complete the preset update operation, and the system is unqualified. It is understood that, in addition to judging whether the system is qualified, the similarity can also be standardized to form an evaluation score for the system. Especially when comprehensively evaluating a vehicle remote update system using multiple similarity scores, the performance of the vehicle remote update system in various aspects can be determined by the scores of each similarity score, and the overall score of the vehicle remote update system can be obtained to determine the overall performance of the vehicle remote update system.

[0067] In one embodiment of this application, during the installation of the upgrade package corresponding to a remote update, data related to the installation process is acquired; the data related to the installation process is compared with pre-stored standard information to obtain a second comparison result; the evaluation of the vehicle remote update system based at least on the first comparison result includes: evaluating the vehicle remote update system based at least on the first comparison result and the second comparison result. Specifically, when the upgrade package downloaded from the cloud backend to the vehicle begins installation via the vehicle's CAN bus, the camera simultaneously captures the installation progress displayed on the central control screen to monitor the progress bar display behavior; simultaneously, the CANoe monitors and records the data on the CAN bus; when the CANoe detects data indicating installation completion, the camera also simultaneously captures the image of the installation progress bar completion. The installation progress, the data on the CAN bus monitored by the CANoe, and the installation completion image are compared with pre-input standard data to evaluate whether the upgrade package installation process is normal.

[0068] In one embodiment of this application, in order to obtain a sufficient number of test results for evaluation, vehicle bus communication data during vehicle use is also recorded for the evaluation of vehicle remote update automation. Furthermore, after all scenarios have been run, the previously recorded data and evaluation results for each scenario and step are entered into a report template, and a final vehicle remote update automation evaluation report is automatically generated.

[0069] The beneficial effects of this application are as follows: Upon receiving a remote update command, the system automatically controls the vehicle's central control screen to perform a simulated operation, automatically collects the vehicle's response data to the simulated operation, and compares it with pre-stored standard information. Based on the comparison results, an evaluation of the vehicle's remote update system is generated. Therefore, no manual operation is required throughout the entire simulation and evaluation process, achieving automatic and efficient evaluation of the vehicle's remote update system. Furthermore, because the comparison standards are unified, the evaluation results are accurate and unique, unaffected by subjective human factors.

[0070] In one embodiment, step S101 above can be implemented as step A1 as follows:

[0071] In step A1, a preset program script is sent to a robotic arm capable of performing touch operations on the car's central control screen, so that the robotic arm can perform a remote update simulation operation on the car's central control screen according to the operation instructions in the preset program script. The instructions stored in the preset program script are the operation instructions for the central control screen during the remote update process.

[0072] In this embodiment, a preset program script is sent to a robotic arm capable of touch-operating the vehicle's central control screen. This allows the robotic arm to perform a remote update simulation operation on the central control screen according to the operation instructions in the preset program script. Specifically, the preset program script stores the operation instructions for the central control screen during the remote update process. The remote update operation instructions to be executed are sent to the robotic arm in the "touchscreen control system" through the preset program script, enabling the robotic arm to simulate manual remote update operations. It is understood that this simulated operation includes, but is not limited to, automated triggering of the remote update function, simulated user interaction, and upgrade package installation during the remote update process. Figure 5 This is a schematic diagram illustrating the automated triggering of the automated evaluation platform for a vehicle remote update system in one embodiment of this application. Figure 5 As shown, during the automatic triggering process, the upgrade package to be pushed to the vehicle is configured in the cloud backend. After the automation program starts running, the robotic arm is controlled to click at a designated location on the central control display screen, thereby triggering the user to actively check for remote vehicle software updates. After the central control screen returns the user's command to check for remote updates to the vehicle's electronic system, the vehicle will access the cloud backend through its built-in 4G network to check the remote task. After receiving the request from the vehicle, the backend will send the pre-configured remote task to the vehicle. At this time, remote-related information interaction will appear on the central control screen of the vehicle, and the remote update function has been successfully triggered.

[0073] In one embodiment, step S102 above can be implemented as step B1 as follows:

[0074] In step B1, during the simulated operation of the car's central control screen, the camera captures the screen's display.

[0075] In this embodiment, during the simulated operation of the vehicle's central control screen, the display screen's image is captured by a camera. This capture includes capturing the display screen's image during the switching process, specifically through a text and image capture system. For example, in the automated triggering of a remote update function, a robotic arm clicks at a designated location on the central control screen, triggering the user to actively check for a remote update of the vehicle's software. The camera captures the switching process of the central control screen before and after the robotic arm's click to determine if the triggering operation was successful. Furthermore, in this embodiment, the acquired response data also includes real-time acquisition of vehicle bus communication data through a vehicle status monitoring system, and then the acquired response data is transmitted back to a result comparison and evaluation system.

[0076] Understandably, in addition to the aforementioned page switching process, the camera also records the entire simulated operation process, including triggering, interaction, and updates, during the simulation, in order to analyze and evaluate the entire update process. Furthermore, to reflect the performance of the update system, the response data may also include response time to analyze the speed and smoothness of the software update.

[0077] In one embodiment, step B1 above can be implemented as step B11:

[0078] In step B11, the camera captures the display screen corresponding to the screen switching process of the central control screen.

[0079] In this embodiment, the display screen corresponding to the screen switching process of the central control screen is captured by a camera. Figure 6 This is a schematic diagram simulating user operation of an automated evaluation platform for a vehicle remote update system in one embodiment of this application, as shown below. Figure 6 As shown, when the car's remote update function is triggered, the camera captures the display interface of the central control screen. After the image is transmitted back, the graphic and text information is extracted and compared with the pre-input standard information to evaluate whether the interaction and information display meet expectations. Furthermore, in this embodiment, the evaluation platform finds clickable icons in the image, calculates their coordinates, and sends touch screen commands to the robotic arm. Upon receiving the next command, the robotic arm continues to execute the touch screen commands, and a new interactive interface appears on the central control screen. The camera captures the new screen transition process, and then the previous process is repeated until all user operations are completed.

[0080] In one embodiment, step S103 above can be implemented as steps C1-C2 as follows:

[0081] In step C1, the similarity between the vehicle's response data to the simulated operation and pre-stored standard information is calculated;

[0082] In step C2, the similarity is determined to be the first comparison result.

[0083] In this embodiment, the similarity between the vehicle's response data to the simulated operation and pre-stored standard information is calculated; the similarity is then determined as the first comparison result. This comparison process is completed in a feedback result comparison and evaluation system. Specifically, the similarity between the display screen corresponding to the central control screen's screen switching process captured by the camera and the pre-stored standard screen switching process corresponding to the simulated operation is obtained by comparing them.

[0084] Since there are many methods for calculating similarity, this application will not list them all. Therefore, in this embodiment, the similarity of the screen switching process can be used to determine whether the operation meets the expected performance by comparing the operation content in the simulated operation screen with that in the standard screen; the accuracy of the operation can also be determined by the accuracy of the robot's click position. For example, clicking in the exact center of the interactive button results in high accuracy, while clicking further away from the center results in lower accuracy. In addition, in this embodiment, the response data includes not only the page switching process but also the response time and the stability of the update installation, which are used to determine the sensitivity of the operation and the stability of the remote update operation, respectively.

[0085] In one embodiment, step S104 above can be implemented as steps D1-D2 as follows:

[0086] In step D1, when the first comparison result, used to characterize the similarity between the vehicle's response data to the simulated operation and the pre-stored standard information, is greater than a preset similarity, the vehicle remote update system is determined to be qualified.

[0087] In step D1, when the similarity between the first comparison result, which characterizes the vehicle's response data to the simulated operation, and the pre-stored standard information is less than a preset similarity, the vehicle remote update system is determined to be unqualified.

[0088] After the comparison process is completed in the feedback result comparison and evaluation system, the vehicle remote update system is evaluated based on the comparison results. In this embodiment, when the first comparison result, which indicates that the similarity between the vehicle's response data to the simulated operation and the pre-stored standard information is greater than a preset similarity, the vehicle remote update system is determined to be qualified; when the first comparison result, which indicates that the similarity between the vehicle's response data to the simulated operation and the pre-stored standard information is less than a preset similarity, the vehicle remote update system is determined to be unqualified.

[0089] For example, if the first comparison result is a page switching comparison, the similarity score can be used to determine whether the executed operation meets the expected performance. If the similarity score is greater than a preset value, it means that the operation content in the simulated operation screen is consistent with that in the standard screen, indicating that the system can complete the preset update operation and is qualified; otherwise, it means that the system cannot complete the preset update operation and is unqualified. It is understandable that, in addition to determining whether the system is qualified, the similarity score can also be standardized to generate an evaluation score for the system. Especially when comprehensively evaluating a vehicle remote update system using multiple similarity scores, both the individual similarity scores can determine the performance of the vehicle remote update system in various aspects, and a comprehensive score can be obtained to determine the overall performance of the vehicle remote update system.

[0090] Figure 2 This is a flowchart of an evaluation method for a vehicle remote update system according to another embodiment of this application, such as... Figure 2 As shown, the method further includes the following steps S201-S202:

[0091] In step S201, during the remote update of the corresponding upgrade package installation process, data related to the installation process is obtained;

[0092] In step S202, the data related to the installation process is compared with pre-stored standard information to obtain a second comparison result;

[0093] The above step S104 can also be implemented as the following step S203:

[0094] In step S203, the vehicle remote update system is evaluated based at least on the first comparison result and the second comparison result.

[0095] In this embodiment, during the remote update of the corresponding upgrade package installation process, data related to the installation process is obtained. Figure 7 This is a schematic diagram illustrating the automated monitoring and evaluation of the upgrade package installation progress by the automated evaluation platform of the vehicle remote update system in one embodiment of this application. Figure 7As shown, the relevant data during the installation process includes: when the upgrade package downloaded from the cloud backend to the vehicle begins to be installed via the vehicle's CAN bus, the camera simultaneously captures the installation progress displayed on the central control screen; the CANoe monitors and records the data on the CAN bus; when the CANoe detects data indicating that the installation is complete, the camera will also simultaneously capture the image of the installation progress bar being completed.

[0096] Data related to the installation process is compared with pre-stored standard information to obtain a second comparison result. The installation progress, data on the CAN bus monitored by CANoe, and the installation completion screen are compared with pre-input standard data, such as text, images, and signals, to form a comparison result, which is used to assess whether the upgrade package installation process is normal. In this embodiment, the resulting comparison result is similarity data.

[0097] The evaluation of the vehicle remote update system based at least on the first comparison result includes: evaluating the vehicle remote update system based at least on the first comparison result and the second comparison result. This application evaluates the vehicle remote update system in four aspects through page switching comparison results and installation process comparison results: First, whether the executed operation meets the expected performance, i.e., determining whether the operation content in the simulated operation screen is consistent with that in the standard screen; for example, if the standard screen executes the next step, monitoring whether the operation in the simulated screen is the next step. Second, the accuracy of the executed operation, i.e., the accuracy of the robotic arm's click position; for example, clicking in the exact center of the interactive button results in high accuracy, while clicking further away from the center results in lower accuracy. Third, the sensitivity of the executed operation; the shorter the page switching response time, the higher the sensitivity. Fourth, the stability of the executed operation; the smoother the installation process during the remote update operation, the higher the stability.

[0098] Figure 3 This is a block diagram of an automated evaluation device for remote vehicle updates according to one embodiment of this application, such as... Figure 3 As shown, the evaluation device for the vehicle remote update system includes the following modules:

[0099] The simulation module 301 is used to perform a remote update simulation operation on the central control screen of the vehicle when it receives an instruction to remotely update the vehicle through the vehicle remote update system.

[0100] The acquisition module 302 is used to acquire the vehicle's response data to the simulated operation during the process of remotely updating the vehicle's central control screen.

[0101] The comparison module 303 is used to compare the vehicle's response data to the simulated operation with pre-stored standard information to obtain a first comparison result;

[0102] Evaluation module 304 is used to evaluate the vehicle remote update system based at least on the first comparison result.

[0103] Figure 5 This is a schematic diagram of the hardware structure of an evaluation device for a remote vehicle update system according to this application, as shown below. Figure 5 As shown, it includes:

[0104] At least one processor 520; and,

[0105] Memory 504 is communicatively connected to at least one processor; wherein,

[0106] The memory 504 stores instructions that can be executed by at least one processor, which is executed by at least one processor 520 to implement the evaluation method of the vehicle remote update system described in any of the above embodiments.

[0107] Reference Figure 5 The vehicle remote update system 500 may include one or more of the following components: processing component 502, memory 504, power supply component 506, multimedia component 508, audio component 510, input / output (I / O) interface 512, sensor component 514, and communication component 516.

[0108] Processing component 502 typically controls the overall operation of the vehicle remote update system 500. Processing component 502 may include one or more processors 520 to execute instructions to complete all or part of the steps of the methods described above. Furthermore, processing component 502 may include one or more modules to facilitate interaction between processing component 502 and other components. For example, processing component 502 may include a multimedia module to facilitate interaction between multimedia component 508 and processing component 502.

[0109] Memory 504 is configured to store various types of data to support the operation of the vehicle remote update system 500. Examples of this data include instructions for any application or method operating on the vehicle remote update system 500, such as text, images, videos, etc. Memory 504 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0110] Power supply assembly 506 provides power to various components of the vehicle remote update system 500. Power supply assembly 506 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the vehicle control system 500.

[0111] Multimedia component 508 includes a screen that provides an output interface between the vehicle remote update system 500 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of touch or swipe actions but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 508 may also include a front-facing camera and / or a rear-facing camera. When the vehicle remote update system 500 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or rear-facing camera may receive external multimedia data. Each front-facing and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0112] Audio component 510 is configured to output and / or input audio signals. For example, audio component 510 includes a microphone (MIC) configured to receive external audio signals when the vehicle remote update system 500 is in an operating mode, such as alarm mode, recording mode, voice recognition mode, and voice output mode. The received audio signals may be further stored in memory 504 or transmitted via communication component 516. In some embodiments, audio component 510 also includes a speaker for outputting audio signals.

[0113] I / O interface 512 provides an interface between processing component 502 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.

[0114] Sensor assembly 514 includes one or more sensors for providing status assessments of various aspects of the vehicle remote update system 500. For example, sensor assembly 514 may include a sound sensor. Additionally, sensor assembly 514 may detect the on / off state of the vehicle remote update system 500, the relative positioning of components (e.g., the display and keypad of the vehicle remote update system 500), the operational status of the vehicle remote update system 500 or its components, the orientation or acceleration / deceleration of the vehicle remote update system 500, and temperature changes of the vehicle remote update system 500. Sensor assembly 514 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 514 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 514 may also include an accelerometer, a gyroscope, a magnetometer, a pressure sensor, and a temperature sensor.

[0115] Communication component 516 is configured to enable the vehicle remote update system 500 to provide wired or wireless communication capabilities with other devices and cloud platforms. The vehicle remote update system 500 can access wireless networks based on communication standards, such as WiFi, 2G, or 3G, or combinations thereof. In one exemplary embodiment, communication component 516 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 516 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0116] In an exemplary embodiment, the vehicle remote update system 500 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the vehicle remote update method described in any of the above embodiments.

[0117] This application also provides a computer-readable storage medium, which, when the instructions in the storage medium are executed by a processor corresponding to an evaluation system for a vehicle remote update system, enables the evaluation system for a vehicle remote update system to implement the evaluation method for a vehicle remote update system described in any of the above embodiments.

[0118] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, disk storage and optical storage) containing computer-usable program code.

[0119] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart... Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0120] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0121] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0122] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the spirit and scope of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application also intends to include such modifications and variations.

Claims

1. An evaluation method for a vehicle remote update system, characterized in that, include: Upon receiving an instruction to remotely update the vehicle via the vehicle remote update system, a remote update simulation operation is performed on the vehicle's central control screen. During the process of remotely updating the car's central control screen in a simulated operation, the response data of the car to the simulated operation is acquired. The vehicle's response data to the simulated operation is compared with pre-stored standard information to obtain a first comparison result; The vehicle remote update system shall be evaluated at least based on the first comparison result; The simulated remote update operation of the vehicle's central control screen includes: A preset program script is sent to a robotic arm capable of touch operation on the car's central control screen, so that the robotic arm performs a remote update simulation operation on the car's central control screen according to the operation instructions in the preset program script. The instructions stored in the preset program script are operation instructions for the central control screen during the remote update process. The simulation operation includes the automated triggering operation of the remote update function, the simulated user interaction operation, and the upgrade package installation operation during the remote update process. The step of comparing the vehicle's response data to the simulated operation with pre-stored standard information to obtain a first comparison result includes: Calculate the similarity between the vehicle's response data to the simulated operation and pre-stored standard information; determine the similarity as the first comparison result; The calculation of the similarity between the vehicle's response data to the simulated operation and the pre-stored standard information includes: comparing the display screen corresponding to the central control screen screen switching process captured by the camera with the pre-stored standard screen switching process corresponding to the simulated operation to obtain the similarity between the display screen corresponding to the central control screen screen switching process and the pre-stored standard screen switching process corresponding to the simulated operation.

2. The method as described in claim 1, characterized in that, During the process of remotely updating the vehicle's central control screen in a simulated operation, acquiring the vehicle's response data to the simulated operation includes: During the simulated operation of the car's central control screen, the screen's display image is captured by a camera.

3. The method as described in claim 2, characterized in that, The step of capturing the image displayed on the central control screen via a camera includes: The camera captures the display screen corresponding to the screen switching process of the central control screen.

4. The method as described in claim 1, characterized in that, The step of comparing the vehicle's response data to the simulated operation with pre-stored standard information to obtain a first comparison result includes: Calculate the similarity between the vehicle's response data to the simulated operation and pre-stored standard information; The similarity is determined as the first comparison result.

5. The method as described in claim 1, characterized in that, The evaluation of the vehicle remote update system based at least on the first comparison result includes: When the first comparison result is used to characterize the similarity between the vehicle's response data to the simulated operation and the pre-stored standard information, the similarity is greater than a preset similarity, the vehicle remote update system is determined to be qualified. When the first comparison result, used to characterize the similarity between the vehicle's response data to the simulated operation and the pre-stored standard information, is less than a preset similarity, the vehicle remote update system is determined to be unqualified.

6. The method as described in claim 1, characterized in that, The method further includes: During the remote update and installation of the corresponding upgrade package, data related to the installation process is obtained; The data related to the installation process is compared with pre-stored standard information to obtain a second comparison result; The evaluation of the vehicle remote update system based at least on the first comparison result includes: The vehicle remote update system shall be evaluated based at least on the first comparison result and the second comparison result.

7. An evaluation apparatus for a vehicle remote update system, used in the evaluation method for a vehicle remote update system as described in any one of claims 1-6, characterized in that, include: The simulation module is used to perform a remote update simulation operation on the central control screen of the vehicle when it receives an instruction to remotely update the vehicle through the vehicle remote update system. The acquisition module is used to acquire the vehicle's response data to the simulated operation during the process of remotely updating the vehicle's central control screen. The comparison module is used to compare the vehicle's response data to the simulated operation with pre-stored standard information to obtain a first comparison result; An evaluation module is used to evaluate the vehicle remote update system based at least on the first comparison result.

8. An evaluation device for a vehicle remote update system, characterized in that, include: At least one processor; as well as, A memory communicatively connected to the at least one processor; wherein, The memory stores instructions executable by the at least one processor to implement the evaluation method for a vehicle remote update system as described in any one of claims 1-6.

9. A computer-readable storage medium, characterized in that, When the instructions in the storage medium are executed by the processor corresponding to the evaluation system of the vehicle remote update system, the evaluation system of the vehicle remote update system is able to implement the evaluation method of the vehicle remote update system as described in any one of claims 1-6.

Images