Simultaneously test whether multiple electronic devices connected via a communication network handle exceptions correctly

With the help of electronic processors, status query and fuzzy data messages are sent to multiple electronic devices at the same time to record the response situation, and the problem of low testing efficiency and inability to simulate high load conditions in the prior art is solved, and multiple Efficient testing and fault identification for abnormal handling of electronic equipment.

CN113169903BActive Publication Date: 2024-11-19ROBERT BOSCH GMBH
View PDF 18 Cites 0 Cited by

Patent Information

Application Number
CN201980080460.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2018-12-07
Filing Date
2019-12-06
Publication Date
2024-11-19
Estimated Expiration
2039-12-06

AI Technical Summary

Technical Problem

When testing electronic devices connected via communication networks, existing systems are inefficient and need to test each device separately, and cannot effectively simulate high load and delay conditions, making it difficult to discover problems caused by communication networks.

Method used

A system and method are designed to send status query messages and fuzzy data to multiple electronic devices simultaneously through an electronic processor to record response conditions, and ensure that the device correctly handles exceptions, including sending a first state query message, fuzzy data and a second state Query the message and log the fault log to identify devices that are not properly handled by exceptions.

Benefits of technology

The correct exception handling of multiple electronic devices is realized at the same time, the testing efficiency and resource utilization are improved, and the load and delay problems caused by communication networks can be more effectively discovered.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113169903B_ABST
    Figure CN113169903B_ABST
Patent Text Reader

Abstract

A system for simultaneously testing whether multiple electronic devices connected via a communication network correctly handle anomalies. The system includes a communication network, and multiple electronic devices and a test device connected via the communication network. The test device includes an electronic processor. The electronic processor is configured to send a first status query message to the multiple electronic devices, send fuzzy data to one or more of the multiple electronic devices, and send a second status query message to the multiple electronic devices. The electronic processor is also configured to, for each electronic device that responds to the first status query message with a valid response and responds to the second status query message with an invalid response or fails to respond to the second status query message, record the electronic device in a fault log.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] Related Applications

[0002] This application claims priority to U.S. Provisional Patent Application No. 62 / 776,581 filed on December 7, 2018, the entire contents of which are hereby incorporated by reference. Background Art

[0003] It is important for software developers to test whether electronic devices connected via a communication network properly handle exceptions thrown in response to receiving corrupted data. Improper handling of exceptions may cause the electronic device to become unresponsive, allow unauthorized access to the electronic device, or have other undesirable consequences. An example of an electronic device connected via a communication network is a plurality of electronic devices included in a vehicle, which are connected by, for example, a control area network (CAN) bus. In existing systems, a user test device connected via a communication network included in a vehicle must test each electronic device individually. Summary of the invention

[0004] Using existing systems to test electronic devices connected via a communication network is an inefficient use of time and an inefficient use of computing resources because each device is tested individually. In addition, testing multiple electronic devices simultaneously simulates real-world situations where electronic devices are constantly communicating via a communication network (e.g., a bus) with high loads and delays. Testing electronic devices individually reduces the chance of discovering problems that are at least partially caused by increased loads or delays in the communication network. Embodiments described herein provide systems and methods for simultaneously testing whether multiple electronic devices connected via a communication network are properly handling exceptions.

[0005] One embodiment provides a system for simultaneously testing whether multiple electronic devices connected via a communication network correctly handle anomalies. The system includes a communication network, and multiple electronic devices and a test device connected via the communication network. The test device includes an electronic processor. The electronic processor is configured to send a first status query message to multiple electronic devices via the communication network, send fuzzy data to one or more of the multiple electronic devices via the communication network, and send a second status query message to the multiple electronic devices via the communication network. The electronic processor is also configured to, for each electronic device that responds to the first status query message with a valid response and responds to the second status query message with an invalid response or fails to respond to the second status query message, record the electronic device in a fault log.

[0006] Another embodiment provides a method for simultaneously testing whether multiple electronic devices connected via a communication network correctly handle anomalies. The method includes using an electronic processor to send a first status query message to multiple electronic devices via the communication network, using the electronic processor to send fuzzy data to one or more of the multiple electronic devices via the communication network, and using the electronic processor to send a second status query message to the multiple electronic devices via the communication network. The method also includes, for each electronic device that responds to the first status query message with a valid response and responds to the second status query message with an invalid response or fails to respond to the second status query message, recording the electronic device in a fault log.

[0007] Other aspects, features, and embodiments will become apparent by consideration of the detailed description and accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] Figure 1 is a block diagram of a system for simultaneously testing multiple electronic devices connected via a communication network according to one embodiment.

[0009] Figure 2A According to an embodiment Figure 1 Block diagram of the test equipment of the system.

[0010] Figure 2B According to an embodiment Figure 1 A block diagram of a first electronic device of the system.

[0011] Figure 3 According to one embodiment, Figure 1 A flowchart of a method for simultaneously testing a plurality of electronic devices connected via a communication network.

[0012] Figure 4 yes Figure 3 illustrative examples of steps 305 and 310 of the method.

[0013] Figure 5 According to one embodiment Figure 3 3. An illustrative example of a status query message sent by a test device in steps 320 and 330 of the method.

[0014] Figure 6 According to one embodiment Figure 3 illustrative examples of messages sent by the test device in steps 320, 325 and 330 of the method.

[0015] Figure 7 According to one embodiment Figure 3 Illustrative examples of messages sent by the test equipment in steps 320, 325, and 330 of the method and responses received by the test equipment when the electronic device properly handles the anomaly.

[0016] Figure 8 According to one embodiment Figure 3 Illustrative examples of messages sent by the test equipment in steps 320, 325, and 330 of the method and responses received by the test equipment when an electronic device does not properly handle an exception. DETAILED DESCRIPTION

[0017] Before explaining any embodiments in detail, it will be understood that the present disclosure is not intended to limit its application aspects to the details of construction and the arrangement of components set forth in the following description or illustrated in the following drawings. The embodiments are capable of other configurations and of being practiced or carried out in various ways.

[0018] Various embodiments may be implemented using a plurality of hardware and software-based devices and a plurality of different structural components. In addition, embodiments may include hardware, software, and electronic components or modules, which, for purposes of discussion, may be illustrated and described as if most components were implemented only in hardware. However, one of ordinary skill in the art and based on a reading of this detailed description will recognize that, in at least one embodiment, the electronic-based aspects of the present invention may be implemented in software that is executable by one or more processors (e.g., stored on a non-transitory computer-readable medium). For example, the "control unit" and "controller" described in the specification may include one or more electronic processors, one or more memory modules including a non-transitory computer-readable medium, one or more communication interfaces, one or more application-specific integrated circuits (ASICs), and various connections (e.g., a system bus) connecting the various components.

[0019] Figure 1 A system 100 for simultaneously testing whether multiple electronic devices connected via a communication network correctly handle anomalies is illustrated. In the illustrated example, the system 100 includes a test device 105 (which is an electronic device), a first electronic device 110, a second electronic device 115, and a third electronic device 120 (collectively referred to herein as electronic devices 110, 115, 120) connected via a communication network 125. Although the communication network 125 is illustrated herein as a bus (e.g., a CAN bus), the communication network 125 can be implemented using other network protocols and other network modalities, including, for example, a wide area network such as the Internet, a local area network such as a Wi-Fi network, a short-range wireless network such as a Bluetooth network™, a near field communication connection, and combinations or derivatives thereof. Figure 1 The embodiment illustrated in the Figures only provides one example of the components and connections of the system 100. In other embodiments, these components and connections may be configured in other ways than those illustrated and described herein. For example, the system 100 may include Figure 1The four electronic devices shown in the figure are compared to different numbers of electronic devices.

[0020] Figure 2A yes Figure 1 1 is a block diagram of an example of a test device 105 of the system 100. The test device 105 includes a plurality of electrical and electronic components that provide power, operational control, and protection to components and modules within the test device 105. The test device 105 includes, among other things, an electronic processor 200 (such as a programmable electronic microprocessor, microcontroller, or similar device), a memory 205 (e.g., a non-transitory computer or machine-readable memory), a communication interface 210, a display device 215, and an input device 220. The display device 215 can be, for example, a touch screen, a liquid crystal display (“LCD”), a light emitting diode (“LED”) display, an organic LED (“OLED”) display, an electroluminescent display (“ELD”), etc. The input device 220 can be, for example, a keypad, a mouse, a touch screen (e.g., as part of the display device 215), a microphone, a camera, etc. The electronic processor 200 is communicatively connected to the memory 205, the communication interface 210, the display device 215, and the input device 220. The electronic processor 200 in cooperation with the memory 205 and the communication interface 210 is configured to implement, among other things, the methods described herein. For example, the electronic processor 200 can execute fuzzer software 225 included in the memory 205 to create fuzzy data. The test device 105 can include a submodule that includes an additional electronic processor, memory, or application-specific integrated circuit (ASIC) for handling communication functions, signal processing, and application of the methods listed below. In some embodiments, the test device 105 includes additional, fewer, or different components. In some embodiments, the functions described as being performed by the test device 105 can be distributed among multiple devices.

[0021] Figure 2B yes Figure 1100. The first electronic device 110 includes a plurality of electrical and electronic components that provide power, operational control, and protection to components and modules within the first electronic device 110. The first electronic device 110 includes, among other things, an electronic processor 230 (such as a programmable electronic microprocessor, microcontroller, or similar device), a memory 235 (e.g., a non-transitory computer or machine-readable memory), and a communication interface 240. The electronic processor 230 is communicatively connected to the memory 235 and the communication interface 240. The electronic processor 230, in cooperation with the memory 235 and the communication interface 240, is configured to implement, among other things, the methods described herein. The first electronic device 110 may include sub-modules that include additional electronic processors, memories, or application-specific integrated circuits (ASICs) for handling communication functions, signal processing, and application of the methods listed below. In some embodiments, the first electronic device 110 includes additional, fewer, or different components. Although not illustrated herein, it should be noted that the second electronic device 115 and the third electronic device 120 include the same components as those included in the first electronic device 110. Figure 2B Additionally, the second electronic device 115 and the third electronic device 120 perform functions similar to those described herein as performed by the first electronic device 110 .

[0022] Figure 3 3 is a flowchart illustrating an example method 300 for simultaneously testing whether a plurality of electronic devices (e.g., a first electronic device 110, a second electronic device 115, and a third electronic device 120) connected via a communication network (e.g., a communication network 125) correctly handle an exception. In some embodiments, the method 300 begins when the electronic processor 200 sends a first message to a plurality of electronic devices via the communication network 125 in step 305 to determine which of the electronic devices responds. For example, in the system 100, the electronic processor 200 sends a first message to the first electronic device 110, the second electronic device 115, and the third electronic device 120. As will be described in further detail below, the header of the first message includes a global identifier. Assuming that the electronic devices 110, 115, 120 and the communication network 125 are properly functioning, each of the electronic devices 110, 115, 120 receives the first message and sends a response message to the electronic processor 200 confirming that they are connected to the communication network 125. Figure 4 A graphical example of step 305 is provided. Figure 4 In the example embodiment illustrated in FIG. 1 , a personal computer sends a first message to a plurality of electronic control units (ECUs) connected via a CAN bus.

[0023] In step 310, the electronic processor 200 creates a record or log of each electronic device from which it receives a response to the first message. For example, the electronic processor 200 can record a unique identifier for each electronic device that replies to the first message. It should be noted that when an electronic device is described herein as being included or recorded in a log or record, it is a unique identifier of the electronic device recorded in the log. The reply log is a log of electronic devices that can be used for testing. The electronic processor 200 can display the log of electronic devices that can be used for testing to the user via the display device 215, so that the user can select a specific electronic device that the user wishes to test. In step 315, the electronic processor 200 receives a selection of one or more electronic devices to be tested or confirms that each of the multiple electronic devices that can be used for testing should be tested.

[0024] In step 320, the electronic processor 200 sends a first status query message to each electronic device (e.g., electronic devices 110, 115, 120) connected to the communication network 125. The first status query message queries whether the electronic device is operating correctly. As will be described in further detail below, the header of the first status query message includes a global identifier. Although the first status query message is sent to each electronic device connected to the communication network 125, the electronic processor 200 only records the valid responses it receives from the selected electronic devices in the response log to the first status query. For example, the electronic processor 200 can record the unique identifier of each electronic device that replies to the first status query message with a valid response. In some instances, not all selected electronic devices respond. Therefore, the record or log of responses to the first status query created by the electronic processor 200 provides an indication of which of the selected electronic devices is operating correctly or helps confirm it. In some embodiments, the method 300 starts at step 320 instead of step 305, and the electronic processor 200 records each electronic device from which the electronic processor 200 receives a valid response to the first status query message in the response log to the first status query. In step 325, the electronic processor 200 sends a message with obfuscated data to one or more of the plurality of electronic devices (e.g., each of the plurality of electronic devices or each of the selected electronic devices). In general, the obfuscated data includes a large amount of data that is random, intentionally damaged, or specified to cause the electronic device to malfunction. For example, the obfuscated data may include data of an inappropriate type or size, which, when received by the electronic device, causes the electronic device to perform an operation that causes the electronic device (more specifically, the electronic processor of the electronic device) to throw an exception. If the computer executable instructions stored in the memory of the electronic device include instructions for handling the exception, the electronic device will continue to operate normally after the exception is thrown. Otherwise, the electronic device will fail after the exception is thrown, for example, by becoming unresponsive.

[0025] In some embodiments, the electronic processor 200 receives a file such as an ARXML (Autosar XML) file and uses the fuzzifier software 225 to parse the ARXML file to create a message with fuzzy data. By parsing the ARXML file, the electronic processor 200 determines the valid message that the electronic device 110, 115, 120 is configured to receive. In order to create the fuzzy data, the electronic processor 200 can change the data length field of the valid message, the arbitration ID of the valid message, the length of the valid message, the payload of the valid message, etc. Slightly changing the valid message instead of creating a message including random data increases the possibility that the electronic processor 200 creates a message that causes the electronic device to throw an exception when received by the electronic device.

[0026] In step 330, the electronic processor 200 sends a second status query message to the electronic device. As will be described in further detail below, the header of the second status query message includes a global identifier. The electronic processor 200 records each electronic device that replies to the second status query message with a valid response in a response log to the second query message. For example, the electronic processor 200 can record the unique identifier of each electronic device that replies to the second status query message with a valid response. It should be noted that in some cases where the electronic processor 200 receives a selection of electronic devices, only the selected device that replies to the second status query message with a valid response is recorded in the response log to the second query message. The response log to the second query message provides an indication of which electronic devices are operating properly after receiving the ambiguous data. As should be clear, the electronic processor 200 does not record the unique identifier of the electronic device that does not reply to the second status query message or does not reply to the second query message with a valid response. A predetermined amount of time after the second status query message is sent to the electronic device, the electronic processor 200 compares the unique identifier of the electronic device that responds to the first status query message with a valid response with the unique identifier of the electronic device that responds to the second status query message with a valid response. Through this comparison, the electronic processor 200 determines whether one or more selected electronic devices have not properly handled the exception. In step 335, the electronic processor 200 records the electronic devices that have not properly handled the exception (the electronic devices that responded to the first status query message with a valid response and responded to the second status query message with an invalid response or failed to respond to the second status query message) in the fault log.

[0027] In some embodiments, after a predetermined amount of time, the electronic processor 200 sends a third status query message to each electronic device recorded in the fault log. In some embodiments, when the electronic device recorded in the fault log does not respond to the third status query message or replies with an invalid response, the electronic processor 200 sends an alert to the mobile device, or displays an option to restart the failed electronic device (power cycle) via the display device 215. In response to receiving a selection of the option to restart the failed electronic device from the input device 220 or the mobile device, the electronic processor 200 sends a message to the failed electronic device to restart the failed electronic device. In other embodiments, when the electronic device recorded in the fault log does not respond to the third status query message or replies with an invalid response, the electronic processor 200 automatically sends a message to the failed electronic device to restart the failed electronic device. In some embodiments, the electronic processor 200 receives new or revised computer executable instructions and sends the new or revised computer executable instructions to the electronic device recorded in the fault log. The new or revised computer executable instructions replace the computer executable instructions previously stored in the memory of the electronic device. New computer executable instructions are specified to prevent the electronic device from malfunctioning when the electronic device receives data in the future that is similar to the ambiguous data that caused it to be recorded in the malfunction log.

[0028] Figure 5 An example of a status query message sent by electronic processor 200 to an electronic device is illustrated. Unlike the status query message of the previous system, which includes a device identifier unique to a single electronic device in the header of the status query message, the header of the status query message sent by system 100 includes a global identifier for querying each electronic device connected to communication network 125. The headers of the first message and the second query message will also include the global identifier.

[0029] Figure 6 is a diagram similar to that illustrating steps 320, 325, and 330 of method 300. Figure 4 Graphic illustration of .

[0030] Figure 7 is similar to Figure 6 Graphic illustration of . Figure 7 Steps 320, 325, and 330 of method 300 are illustrated when each of the selected electronic devices responds to the first status query message and the second status query message with a valid response.

[0031] Figure 8 is similar to Figure 7 Graphic illustration of . Figure 8Steps 320 , 325 , and 330 of method 300 are illustrated when each of the selected electronic devices responds to the first status query message with a valid response, but electronic device ECU_n- 2 does not respond to the second status query message.

[0032] Thus, the embodiments described herein provide, among other things, a system and method for simultaneously testing whether multiple electronic devices connected via a communication network properly handle anomalies. Various features and advantages of the embodiments are set forth in the following claims.

Claims

1. A system for simultaneously testing whether a plurality of electronic devices connected via a communication network correctly handle anomalies, the system comprising: Communications networks; as well as A plurality of electronic devices and a test device connected via a communication network, the test device comprising: An electronic processor configured to: Sending a first status query message to the plurality of electronic devices via a communication network; sending the obfuscated data to the plurality of electronic devices via a communication network; sending a second status query message to the plurality of electronic devices via the communication network; and For each electronic device that responds to the first status query message with a valid response and responds to the second status query message with an invalid response or fails to respond to the second status query message, the electronic device is recorded in a fault log. 2 . The system of claim 1 , wherein a header of the first status query message and a header of the second status query message include a global identifier.

3. The system according to claim 1, wherein: The electronic processor is configured to send a first status query message to the plurality of electronic devices via the communication network by: sending a first message to the plurality of electronic devices via a communication network; for each electronic device that responds to the first message, recording the electronic device in a log of electronic devices available for testing; as well as A selection of an electronic device is received from a log of electronic devices available for testing.

4. The system according to claim 3, wherein: The electronic processor is configured to: For each selected electronic device that responds to the first status query message with a valid response and responds to the second status query message with an invalid response or fails to respond to the second status query message, the electronic device is recorded in a fault log.

5. The system according to claim 1, wherein: The electronic processor is further configured to send a third status inquiry message to each electronic device recorded in the fault log a predetermined amount of time after sending the second status inquiry message; as well as When the electronic device recorded in the fault log does not respond to the third status query message or replies with an invalid response, a message is sent to the electronic device to restart the electronic device.

6. The system according to claim 1, wherein: The electronic processor is further configured to receive revised computer executable instructions configured to prevent a malfunction of the electronic device recorded in the malfunction log when the electronic device receives data similar to the ambiguous data; as well as The revised computer executable instructions are sent to the electronic device recorded in the fault log, wherein the electronic device recorded in the fault log replaces the computer executable instructions previously stored in its memory with the revised computer executable instructions.

7. The system according to claim 1, wherein: The obfuscated data is configured to cause the electronic device to malfunction.

8. The system according to claim 1, wherein: The electronic processor is further configured to: Receive documents; parsing the file to determine, for each of the plurality of electronic devices, valid messages that the electronic device is configured to receive; as well as Change the effective message to create obfuscated data.

9. A method for simultaneously testing whether a plurality of electronic devices connected via a communication network correctly handle anomalies, the method comprising: Using an electronic processor to send a first status query message to a plurality of electronic devices via a communication network; transmitting, using an electronic processor, the obfuscated data to the plurality of electronic devices via a communications network; sending, using the electronic processor, a second status query message to the plurality of electronic devices via the communication network; as well as For each electronic device that responds to the first status query message with a valid response and responds to the second status query message with an invalid response or fails to respond to the second status query message, the electronic device is recorded in a fault log.

10. The method of claim 9, wherein a header of the first status query message and a header of the second status query message include a global identifier.

11. The method according to claim 9, wherein sending the first status query message to the plurality of electronic devices via the communication network comprises: sending a first message to the plurality of electronic devices via a communication network; for each electronic device that responds to the first message, recording the electronic device in a log of electronic devices available for testing; as well as A selection of an electronic device is received from a log of electronic devices available for testing.

12. The method according to claim 11, further comprising: For each selected electronic device that responds to the first status query message with a valid response and responds to the second status query message with an invalid response or fails to respond to the second status query message, the electronic device is recorded in a fault log.

13. The method according to claim 9, further comprising: sending a third status query message to each electronic device recorded in the fault log; as well as A message is sent to each electronic device recorded in the fault log that did not respond to the third status query message or replied with an invalid response to restart the electronic device.

14. The method according to claim 9, further comprising: receiving revised computer executable instructions configured to prevent a malfunction of the electronic device recorded in a malfunction log when the electronic device receives data similar to the ambiguous data; as well as The revised computer executable instructions are sent to the electronic device recorded in the fault log, wherein the electronic device recorded in the fault log replaces the computer executable instructions previously stored in its memory with the revised computer executable instructions.

15. The method according to claim 9, wherein: The obfuscated data is configured to cause the electronic device to malfunction.

16. The method according to claim 9, further comprising: Receive documents; parsing the file to determine, for each of the plurality of electronic devices, valid messages that the electronic device is configured to receive; as well as Change the effective message to create obfuscated data.

Citation Information

Patent Citations

  • Multi-equipment management method and device

    CN102236340A

  • Method and device for realizing storage device test of storage area network (SAN)

    CN102594618A

  • Method and system for testing performances of DSL (digital subscriber line) access equipment and DSL access equipment

    CN103051492A

  • Method for testing remote communication storm by utilizing power substation measuring and control device remote communication traffic testing system

    CN103368257A

  • Method for testing telecommand response time through substation measuring and control device telecommand quantity testing system

    CN103490506A