System and method for automatically synchronizing test information

Abstract

To provide a system, method, and device for automatically synchronizing test information of a test for testing a software of an embedded system.SOLUTION: A method for automatically synchronizing test information of testing may be implemented by at least one processor and may include the steps of: collecting at least one test result of the testing; determining at least one test case associated with the at least one test result; determining, from among a plurality of test requirements of the at least one test case, at least one test requirement associated with the at least one test result; and synchronizing the at least one test result having the at least one test requirement.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] Systems and methods consistent with example embodiments of the present disclosure relate to test information management, and more particularly, to automatically synchronizing test information for testing of software associated with vehicle systems. [Background technology]

[0002] Software testing is required to ensure that the software functions as intended, meets specified requirements, and performs reliably in a variety of scenarios. Software testing is an important part of the Software Development Life Cycle (SDLC) and is performed to identify defects, errors, or bugs in the software before it is deployed into live systems.

[0003] Whenever software includes complex features and / or is required to interoperate with other software, software testing can become complex and involve multiple procedures and users / stakeholders. For example, in the context of development of vehicle-related features in vehicle systems such as lane change assist, mobile smart key, and the like, multiple electronic control units (ECUs) may be developed and interoperate with each other to perform the intended features.

[0004] For example, each of the multiple ECUs may be managed by a different user located at a different geographic location. For example, a first ECU may be developed by a first developer (e.g., a vehicle manufacturer's in-house development engineer) located at a first location, and the first ECU may need to interoperate with a second ECU developed by a second developer (e.g., a vendor) located at a second location. As another example, the first ECU may be tested by a third user (e.g., a test engineer) located at a third location. In addition, the first ECU may interoperate with hardware (e.g., a physical ECU) managed by a fourth user located at a fourth location, and thus testing of the first ECU requires the involvement of the hardware.

[0005] In view of the above, it is important that information associated with testing, such as test requirements information, test results information, or the like, is synchronized in a timely manner and presented appropriately to users to ensure that users involved in testing are always on the same page regarding test information and have a consistent understanding of the testing.

[0006] Nevertheless, in the related art, it is excessively difficult to ensure that all testing information is synchronized in a timely, consistent manner, especially when testing involves a significant number of test artifacts (e.g., ECUs developed by different users) and / or a significant number of users, the associated users being located in different geographic locations (which may result in communication delays due to time zone differences, etc.), and / or the associated users having different levels of technical background.

[0007] Furthermore, in related technologies, the process of synchronizing test results with specific test cases and corresponding test requirements often requires manual intervention by a user, which can lead to human error, delays, and reduced productivity. For example, a user performing testing (e.g., the third user mentioned above) may need to prepare the test results in a readable format, then manually collect information or data associated with the test results (e.g., test logs, metadata, etc.), review the data, and then further process the data to map the test results to the corresponding test cases and associated test requirements.

[0008] Furthermore, in the related art, it is difficult to adequately present test information to all users associated with a testing, especially when the number of users involved in the testing is enormous. For example, the test information may be prepared to include a significant amount of technical detail, which may not be understandable by users without a sufficient technical background. Conversely, the test information may be prepared to include only general information without much technical detail, which may not be useful to users with a sufficient technical background who wish to examine the test information in detail.

[0009] In view of the above, test information management techniques and processes in the related art are time-consuming, ineffective, and burdensome to users. As a result, it is excessively difficult (if not impossible) to ensure that all test information is timely, consistent, and synchronized. Therefore, software testing in the related art can be time-consuming and inefficient, and can delay software development. Summary of the Invention

[0010] Exemplary embodiments consistent with the present disclosure provide methods and systems for efficiently and effectively managing test information for testing. Specifically, exemplary embodiments of the present disclosure provide systems, methods, devices, or the like for efficiently and effectively synchronizing and presenting test information. The exemplary embodiments of the present disclosure enable test information to be synchronized in a timely and consistent manner, and enable the synchronized test information to be effectively and efficiently presented to users with different levels of technical background.

[0011] According to an embodiment, a method for automatically synchronizing test information of a testing may be provided. The method may be implemented by at least one processor. The processor may include collecting at least one test result of the testing, determining at least one test case associated with the at least one test result, determining at least one test requirement associated with the at least one test result from among multiple test requirements of the at least one test case, and synchronizing the at least one test result with the at least one test requirement. The testing may include testing of software of a vehicle system, and the software may include a virtual electronic control unit (ECU).

[0012] According to an embodiment, synchronizing the at least one test result with the at least one test requirement may include generating a mapping of the at least one test result and the determined at least one test requirement. Alternatively or additionally, synchronizing the at least one test result with the at least one test requirement may include updating the mapping of the at least one test result and the determined at least one test requirement.

[0013] According to an embodiment, collecting at least one test result may include establishing communication with at least one test execution environment, collecting one or more pieces of test data from the at least one test execution environment, and extracting information associated with the test result from the one or more pieces of test data.

[0014] According to an embodiment, determining the at least one test case may include processing the at least one test result to obtain at least one identification parameter associated with the at least one test case, and identifying the at least one test case based on the at least one identification parameter. The at least one identification parameter may include at least one of a keyword associated with the at least one test case, a unique identifier (ID) associated with the at least one test case, and a tag associated with the at least one test case.

[0015] According to an embodiment, determining the at least one test requirement may include processing the at least one test result to obtain at least one test parameter associated with the at least one test requirement, and determining the at least one test requirement from among the plurality of test requirements for the at least one test case based on the at least one test parameter. The at least one test parameter may include at least one of a keyword associated with the at least one test requirement, a description that defines at least a portion of the at least one test requirement, and a tag associated with the at least one test requirement.

[0016] According to an embodiment, the processor may further include obtaining information associated with one or more users, determining a presentation format based on the information of the one or more users, and presenting the synchronized test information to the one or more users based on the mapping and the presentation format. Presenting the synchronized test information may include generating a first graphical user interface (GUI) based on the mapping and the presentation format and presenting the first GUI to the first user. Further, presenting the synchronized test information may include generating a second GUI based on the mapping and the presentation format and presenting the second GUI to the second user. The presentation format may be a generic format or a specific format.

[0017] According to an embodiment, a system for automatically synchronizing test information of a testing may be provided. The system may include a memory storage that stores instructions and at least one processor communicatively connected to the memory storage. The at least one processor may be configured to execute the instructions to collect at least one test result of the testing, determine at least one test case associated with the at least one test result, determine at least one test requirement associated with the at least one test result from among multiple test requirements of the at least one test case, and synchronize the at least one test result with the at least one test requirement. The testing may include testing of software of a vehicle system, and the software may include a virtual electronic control unit (ECU).

[0018] According to an embodiment, the at least one processor may be configured to synchronize the at least one test result with the at least one test requirement by executing instructions to generate a mapping of the at least one test result and the determined at least one test requirement. Additionally or alternatively, the at least one processor may be configured to synchronize the at least one test result with the at least one test requirement by executing instructions to update the mapping of the at least one test result and the determined at least one test requirement.

[0019] According to an embodiment, at least one processor may be configured to collect at least one test result by executing instructions to establish communication with at least one test execution environment, gather one or more pieces of test data from the at least one test execution environment, and extract information associated with the test result from the one or more pieces of test data.

[0020] According to an embodiment, at least one processor may be configured to determine the at least one test case by executing instructions to process the at least one test result to obtain at least one identification parameter associated with the at least one test case, and identifying the at least one test case based on the at least one identification parameter. The at least one identification parameter may include at least one of a keyword associated with the at least one test case, a unique identifier (ID) associated with the at least one test case, and a tag associated with the at least one test case.

[0021] According to an embodiment, at least one processor may be configured to determine the at least one test requirement by executing instructions to process the at least one test result to obtain at least one test parameter associated with the at least one test requirement, and to determine the at least one test requirement from among the plurality of test requirements of the at least one test case based on the at least one test parameter, wherein the at least one test parameter comprises at least one of a keyword associated with the at least one test requirement, a description that defines at least a portion of the at least one test requirement, and a tag associated with the at least one test requirement.

[0022] According to an embodiment, the at least one processor may be further configured to execute instructions to obtain information associated with one or more users, determine a presentation format based on the information of the one or more users, and present the synchronized test information to the one or more users based on the mapping and the presentation format. The at least one processor may be configured to execute instructions to generate a first graphical user interface (GUI) based on the mapping and the presentation format and present the first GUI to a first user to present the synchronized test information. Furthermore, the at least one processor may be further configured to execute instructions to generate a second GUI based on the mapping and the presentation format and present the second GUI to a second user to present the synchronized test information. The presentation format may be a generic format or a specific format.

[0023] Additional aspects will be set forth in part in the description that follows, and in part will be apparent from the description, or may be learned by practice of presented embodiments of the present disclosure. [Brief explanation of the drawings]

[0024] The features, advantages, and importance of preferred embodiments of the present disclosure will be described below with reference to the accompanying drawings, in which like reference numerals refer to like elements. [Figure 1] FIG. 1 illustrates a block diagram of an exemplary system architecture for managing test information associated with tests for testing software, according to one or more embodiments. [Figure 2] FIG. 2 illustrates a block diagram of example components of a test information management system according to one or more embodiments. [Figure 3] FIG. 3 illustrates a flow diagram of an exemplary method for automatically synchronizing test information for testing software, according to one or more embodiments. [Figure 4] FIG. 4 illustrates an example test case and associated test requirements, according to one or more embodiments. [Figure 5] FIG. 5 illustrates an example use case diagram of the method 300, according to one or more embodiments. [Figure 6] FIG. 6 illustrates a flow diagram of an exemplary method for presenting synchronized test information according to one or more embodiments. [Figure 7] FIG. 7 illustrates an exemplary graphical user interface (GUI) according to one or more embodiments. [Figure 8] FIG. 8 shows another exemplary GUI according to one or more embodiments. DETAILED DESCRIPTION OF THE INVENTION

[0025] The following detailed description of preferred embodiments refers to the accompanying drawings. The foregoing disclosure provides illustration and description, but is not intended to be exhaustive or to limit implementations to the precise form disclosed. Modifications and variations are possible in light of the above disclosure or may be acquired from practice of implementations. Furthermore, one or more features or components of one embodiment may be incorporated into or combined with another embodiment (or one or more features of another embodiment). Furthermore, in the flowcharts and descriptions of operations provided below, it is understood that one or more operations may be omitted, one or more operations may be added, one or more operations may occur (at least partially) concurrently, or the order of one or more operations may be switched.

[0026] Although particular combinations of features are recited in the claims and / or disclosed herein, such combinations are not intended to limit the disclosure of possible implementations. Indeed, many of the features may be combined in ways not specifically recited in the claims and / or disclosed herein. Although each dependent claim listed below may depend directly on only one claim, the disclosure of possible implementations includes each dependent claim in combination with all other claims in the claim set.

[0027] No element, act, or instruction used herein should be construed as critical or required unless expressly stated otherwise. Also, as used herein, the articles "a" and "an" are intended to include one or more items and may be used interchangeably with "one or more." Where only one item is intended, the term "a" or similar terms are used. Also, as used herein, the terms "has," "have," "having," "include," "including," and the like are intended to be open-ended terms. Furthermore, the phrase "based on" is intended to mean "based at least in part on," unless expressly stated otherwise. Furthermore, phrases such as "at least one of [A] and [B]" or "at least one of [A] or [B]" should be understood to include A only, B only, or both A and B.

[0028] References throughout this specification to "one embodiment," "an embodiment," "a non-limiting preferred embodiment," or similar terms mean that a particular feature, structure, or characteristic described in connection with the illustrated embodiment is included in at least one embodiment of the solution. Thus, the phrases "in one embodiment," "in an embodiment," "a non-limiting preferred embodiment," and similar terms throughout this specification may, but do not necessarily, all refer to the same embodiment.

[0029] Furthermore, the described features, advantages, and characteristics of the present disclosure may be combined in any suitable manner in one or more embodiments. Those skilled in the art will recognize, in light of the description herein, that the present disclosure may be practiced without one or more of the specific features or advantages of a particular embodiment. In other instances, additional features and advantages may be recognized in certain embodiments that may not be present in all embodiments of the present disclosure.

[0030] Additionally, as used herein, the term "vehicle" or the like may refer to any motorized and / or mechanical machine capable of carrying or transporting people and / or cargo, such as cars, trucks, motorcycles, buses, bicycles, mobility scooters, and the like.

[0031] As used herein, the terms “testing information,” “test information,” and the like may refer to information associated with testing software associated with a vehicle system. Such information may include information on one or more test requirements, information on one or more test cases, information on one or more testing results, and / or any other suitable information involved in testing.

[0032] As used herein, the terms "test artifact," "testing artifact," and the like may refer to one or more components that make up testing. For example, a test artifact may include one or more software-based components (e.g., virtual ECUs, emulated ECUs, vehicle models, etc.), one or more hardware-based components (e.g., physical ECUs, vehicle hardware components, etc.), one or more test configurations (e.g., test environment configurations, test cycles, test runs, etc.), one or more test scenarios, one or more test cases, one or more test packages, and the like.

[0033] Exemplary embodiments consistent with the present disclosure provide methods, systems, and apparatus for efficiently and effectively managing test information for testing. Specifically, exemplary embodiments of the present disclosure provide systems, methods, devices, or the like for efficiently and effectively synchronizing and presenting test information.

[0034] According to embodiments, a system, method, or the like provided by exemplary embodiments may automatically collect one or more test results, automatically determine test cases and test requirements associated with the one or more test results, and automatically synchronize the one or more test results with the corresponding test requirements. Furthermore, the system, method, or the like provided by exemplary embodiments may automatically determine an appropriate presentation format according to user information and present the synchronized test information to one or more users according to the appropriate presentation format. The test information may be associated with tests for testing one or more software of one or more vehicle systems, for example, one or more on-board ECUs.

[0035] The exemplary embodiments of the present disclosure allow test information to be synchronized in a timely and consistent manner, and the synchronized test information can be effectively and efficiently presented to users with different levels of technical background. Therefore, software testing can be more efficiently performed and managed, the burden on users can be significantly reduced, and the time required to develop software can be significantly reduced.

[0036] It is envisioned that the features, advantages, and significance of the exemplary embodiments described herein above are merely part of the present disclosure and are not intended to be exhaustive or to limit the scope of the present disclosure. A further description of the features, components, configuration, operation, and implementation aspects of the exemplary embodiments of the present disclosure, as well as associated technical advantages and significance, is provided below.

[0037] 1 illustrates a block diagram of an exemplary system architecture 100 for managing test information associated with tests for testing software, according to one or more embodiments. According to an embodiment, the software may include one or more on-board electronic control units (ECUs), such as physical ECUs, emulated ECUs, virtualized ECUs, or combinations thereof. As shown in FIG. 1, system architecture 100 may include test information management system 110, multiple user equipments (UEs) 120-1 through 120-N, multiple nodes 130-1 through 130-N, and network 140.

[0038] Generally, test information management system 110 may be communicatively coupled to multiple UEs 120-1-120-N and multiple nodes 130-1-130-N via network 140 and may be configured to interoperate with multiple UEs 120-1-120-N and multiple nodes 130-1-130-N to manage test information for one or more associated users. A description of example components that may be included in test information management system 110 is provided below with reference to FIG. 2, and descriptions of associated operations and use cases are provided below with reference to FIGS. 3-8.

[0039] Each of the plurality of UEs 120-1 through 120-N may include one or more machines, devices, or the like that can receive, generate, store, process, and / or provide information when utilized by an associated user. For example, one or more of the plurality of UEs 120-1 through 120-N may include a computing device (e.g., a desktop computer, a laptop computer, a tablet computer, a handheld computer, a smart speaker, a server, etc.), a mobile device (e.g., a smartphone, etc.), a wearable device (e.g., a pair of smart glasses or a smart watch), a SIM-based device, or any other suitable device that may be associated with one or more users involved in software testing.

[0040] Multiple UEs 120-1 through 120-N may be utilized by one or more associated users to access and utilize test information management system 110. For example, a user may access test information management system 110 via an associated UE to view one or more available test deliverables and / or one or more available test requirements and manage one or more test requirements based thereon. Additionally, a user may also utilize test information management system 110 to obtain (e.g., view, download, etc.) information associated with one or more test results.

[0041] According to an embodiment, at least some of the plurality of UEs 120-1 to 120-N may be located in different geographic locations. For example, a first portion of the plurality of UEs 120-1 to 120-N may be utilized by a first user having a first role (e.g., a business manager), and the first user may be located at a first location, while a second portion of the plurality of UEs 120-1 to 120-N may be utilized by a second user having a second role (e.g., a test engineer), and the second user may be located at a second location different from the first location.

[0042] On the other hand, each of the plurality of nodes 130-1 to 130-N may include one or more devices, equipment, systems, or any other suitable components that may receive, host, store, deploy, process, provide, or the like, information and data associated with testing.

[0043] According to an embodiment, at least some of the plurality of nodes 130-1 through 130-N may be configured to host, deploy, store, provide, or the like, one or more test artifacts or components. For example, some of the plurality of nodes 130-1 through 130-N may include devices or equipment that may be utilized to build, store, execute, simulate, execute, or the like, one or more computer-executable software applications, such as one or more virtualized ECUs, one or more emulated ECUs, and / or any other suitable software-based components of a vehicle system (e.g., a vehicle model, a data communication module (DCM) model, a heating, ventilation, and air conditioning (HVAC) model, etc.). As another example, some of the plurality of nodes 130-1 through 130-N may include or be communicatively connected to one or more hardware components, such as one or more fully developed physical ECUs, one or more partially developed physical ECUs, one or more vehicle hardware components (e.g., a powertrain, an engine, etc.), or the like.

[0044] According to an embodiment, at least some of the plurality of nodes 130-1 through 130-N may be associated with one or more test execution environments. For example, the portion of the nodes may have at least one software-based test execution environment (e.g., a software-in-the-loop (SIL) test environment, a virtual ECU (V-ECU) test environment, a model-in-the-loop (MIL) test environment, a processor-in-the-loop (PIL) test environment, etc.) and / or at least one hardware-based test execution environment (e.g., a hardware-in-the-loop (HIL) test environment, etc.) communicatively coupled (e.g., wired, wireless, etc.) thereto or deployed thereto.

[0045] Additionally, at least some of the plurality of nodes 130-1 to 130-N may include one or more storage media, such as a server or server cluster, that may be configured to store, publish, or the like, one or more data or information provided by test information management system 110, one or more of the plurality of UEs 120-1 to 120-N, and / or another portion of the plurality of nodes 130-1 to 130-N.

[0046] According to an embodiment, multiple nodes 130-1 through 130-N may include a test management system that may be configured to allow one or more users to specify one or more test requirements, create test cases, view test information, and the like.

[0047] According to an embodiment, one or more of the plurality of nodes 130-1 through 130-N may include one or more interfaces, each of which may be configured to communicatively connect the associated node to the test information management system 110. For example, one or more of the plurality of nodes may include a hardware interface, a software interface (e.g., a programmatic interface, an application program interface (API), etc.), and / or the like.

[0048] According to an embodiment, at least a portion of the plurality of nodes 130-1 to 130-N are located in a geographic location that is different from test information management system 110, different from one or more of the plurality of UEs 120-1 to 120-N, and / or different from another portion of the plurality of nodes 130-1 to 130-N.

[0049] Network 140 may include one or more wired and / or wireless networks configured to connect test information management system 110, multiple UEs 120-1 through 120-N, and multiple nodes 130-1 through 130-N to one another. For example, network 140 may include a cellular network (e.g., a fifth-generation (5G) network, a long-term evolution (LTE) network, a third-generation (3G) network, a code division multiple access (CDMA) network, etc.), a public land mobile network (PLMN), a local area network (LAN), a wide area network (WAN), a metropolitan area network (MAN), a telephone network (e.g., a public switched telephone network (PSTN)), a private network, an ad hoc network, an intranet, the Internet, an optical fiber-based network, or the like, and / or a combination of these or other types of networks.

[0050] According to an embodiment, network 140 may include a virtual network, which may include one or more physical network components (e.g., Ethernet, WiFi modules, telecommunications network hardware, etc.) on which one or more virtualized network functions (e.g., a Control Area Network (CAN) bus, etc.) are implemented.

[0051] 2 illustrates a block diagram of example components of a test information management system 200, according to one or more embodiments. Test information management system 200 may be similar to test information management system 110 of FIG.

[0052] As shown in FIG. 2, test information management system 200 may include at least one communication interface 210, at least one storage 220, and at least one processor 230, although it may be understood that test information management system 200 may include more or fewer components than those shown, and / or the components included therein may be arranged in any manner different from that shown, without departing from the scope of the present disclosure.

[0053] Communications interface 210 may include transceiver-like components (e.g., a transceiver, a separate receiver and transmitter, etc.) that enable test information management system 200 (or one or more components included therein) to communicate with one or more components external to test information management system 200, such as via a wired connection, a wireless connection, or a combination of wired and wireless connections. For example, communications interface 210 may connect test information management system 200 (or one or more components included therein) to multiple UEs (e.g., UEs 120-1 through 120-N in FIG. 1 ) and multiple nodes (e.g., nodes 130-1 through 130-N in FIG. 1 ), thereby enabling them to communicate with and interoperate with each other. As another example, communications interface 210 may enable components of test information management system 200 to communicate with each other. For example, communications interface 210 may connect storage 220 to processor 230, thereby enabling them to communicate with and interoperate with each other.

[0054] According to an embodiment, communication interface 210 may include a hardware-based interface, such as a bus interface, an Ethernet interface, an optical interface, a coaxial interface, an infrared interface, a radio frequency (RF) interface, a universal serial bus (USB) interface, a Wi-Fi interface, a cellular network interface, a software interface, or the like. According to an embodiment, communication interface 210 may include at least one controller area network (CAN) bus, which is configurable to communicatively couple components of test information management system 200 (e.g., storage 220, processor 230, etc.) to multiple UEs (e.g., UEs 120-1 through 120-N) and multiple nodes (e.g., nodes 130-1 through 130-N). Additionally or alternatively, communication interface 210 may include a software-based interface, such as an application programming interface (API), a virtualized network interface (e.g., a virtualized CAN bus, etc.), or the like.

[0055] According to an embodiment, communications interface 210 may be configured to receive information from one or more components external to test information management system 200 and provide the information to processor 230 for further processing and / or to storage 220 for storage. For example, communications interface 210 may receive one or more user inputs from multiple UEs specifying one or more test requirements (e.g., test scenarios, test cases, test plans, test cycles, etc.) and provide the user inputs to processor 230 and / or storage 220. Similarly, communications interface 210 may be configured to enable processor 230 of test information management system 200 to provide one or more pieces of information to one or more components external to test information management system 200. For example, communications interface 210 may enable processor 230 to present one or more graphical user interfaces (GUIs) to multiple UEs.

[0056] At least one storage 220 may include one or more storage media suitable for storing data, information, and / or computer-readable / computer-executable instructions therein. According to an embodiment, storage 220 may include random access memory (RAM), read-only memory (ROM), and / or another type of dynamic or static storage device (e.g., flash memory, magnetic memory, and / or optical memory) that stores information and / or instructions for use by processor 230.

[0057] Additionally or alternatively, storage 220 may include a hard disk (e.g., a magnetic disk, an optical disk, a magneto-optical disk, and / or a solid-state disk), a compact disk (CD), a digital versatile disk (DVD), a floppy disk, a cartridge, a magnetic tape, and / or another type of non-transitory computer-readable medium, along with a corresponding drive.

[0058] According to an embodiment, storage 220 may be configured to store information utilized by processor 230 to facilitate automatic test information synchronization. For example, storage 220 may be configured to store one or more test requirements specified by one or more users, store information associated with one or more users involved in testing, store one or more test results, and the like.

[0059] At least one processor 230 may include one or more processors that are programmable to perform functions or operations to facilitate automatic test information synchronization. For example, processor 230 may be configured to execute computer-readable instructions stored on a storage medium (e.g., storage 220, etc.) to thereby perform one or more acts or operations described herein. A description of exemplary operations that may be performed by processor 230 is provided below with reference to FIGS. 3 and 6.

[0060] According to an embodiment, processor 230 may be configured to receive one or more signals (e.g., via communications interface 210, etc.) that define one or more instructions to perform one or more operations. Furthermore, processor 230 may be implemented in hardware, firmware, or a combination of hardware and software. Processor 230 may include a central processing unit (CPU), a graphics processing unit (GPU), an accelerated processing unit (APU), a microprocessor, a microcontroller, a digital signal processor (DSP), a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), and / or another type of processing or computational component.

[0061] 3 illustrates a flow diagram of an example method 300 for automatically synchronizing test information for testing software, according to one or more embodiments. Upon execution of computer-executable instructions stored in at least one memory storage (e.g., storage 220), one or more operations of method 300 may be performed by at least one processor (e.g., processor 230) of an example embodiment test information management system. The software being tested may include on-board electronic control units (ECUs) and / or any other software components associated with vehicle systems.

[0062] Generally, a test information management system (or at least one processor associated therewith) may be configured to collect one or more test results, determine one or more test cases associated with the collected one or more test results, and synchronize the one or more test results with one or more test requirements of the one or more test cases. A description of the operation of Figure 3 is provided below along with descriptions of the example use cases of Figures 4-5.

[0063] FIG. 4 illustrates an exemplary test case and associated test requirements, according to one or more embodiments. In this exemplary use case, a test case has an ID "#ABC," and the ID "#ABC" includes multiple test requirements. The test requirements are associated with a test scenario (depicted as "Scenario D" in FIG. 4) that tests the functionality of an ECU (depicted as "Function A" and "ECU A" in FIG. 4, respectively), while the testing involves testing a service (depicted as "Service E"). As shown in FIG. 4, the functional features and test scenario content are specified in a generic format (described further below with reference to FIGS. 6 and 7). It can be understood that in addition to test scenarios (as shown in FIG. 4), other test requirements, such as test plans, test executions, test configurations, test cycles, and the like, can be specified in a similar manner.

[0064] The test cases in FIG. 4 may be specified or created by a first user through use of a test information management system and / or a test management system separate from the test information management system. Upon specifying the test cases and associated test requirements, testing may be performed based thereon. In this regard, testing may include multiple tasks, such as tasks associated with hardware-based testing and / or tasks associated with software-based testing, each of which may be assigned to a respective test execution environment. For example, tasks associated with hardware-based testing may be assigned to one or more hardware-based test execution environments (e.g., HIL test environments, etc.), while tasks associated with software-based testing may be assigned to one or more software-based test execution environments (e.g., SIL test environments, etc.). Thus, testing of multiple test requirements may be performed in multiple test execution environments, and multiple test results (each associated with a test requirement) may be generated.

[0065] 3 , at operation S310, at least one processor of the test information management system may be configured to collect at least one test result. Specifically, the at least one processor may establish communication (via a communication interface of the test information management system) with at least one node associated with at least one test execution environment to obtain test data from the at least one node, and extract information / data associated with at least one test result from the test data. The information associated with the at least one test result may include identification parameters (described further below with reference to operation S320), test parameters (described further below with reference to operation S330), test status (e.g., success, failure, etc.), test log information, test images (e.g., screenshots, etc.), and the like.

[0066] According to an embodiment in which multiple tests are performed in multiple test execution environments, at least one processor may establish communication with and collect multiple test results from multiple nodes associated with the multiple test execution environments, either simultaneously or sequentially, in a manner similar to that described above, a description of an associated example use case is provided below with reference to FIG.

[0067] According to an embodiment, at least one processor of the test information management system may be configured to continuously (or periodically) communicate with nodes associated with the test execution environment to continuously (or periodically) collect test results from the nodes in real time or near real time.

[0068] In view of the above, at least one processor of the test information management system may be configured to collect test results according to the test requirements, and thus may be able to process the test results and synchronize the test results with the respective test requirements as soon as they are available, without having to wait for completion of testing for all test requirements.

[0069] Still referring to FIG. 3, upon collecting at least one test result at operation S310, method 300 may proceed to operation S320, where at least one processor of the test information management system may be configured to determine at least one test case associated with the collected at least one test result.

[0070] Specifically, the at least one processor may be configured to process the collected test results to obtain at least one identification parameter associated with the at least one test case. In this regard, an "identification parameter" as described herein may refer to a parameter that may be utilized by the at least one processor to identify a target test case. The identification parameter associated with the at least one test case may include one or more of a keyword associated with the at least one test case, a unique identifier (ID) associated with the at least one test case, a name or label of the at least one test case, and a custom tag associated with the at least one test case.

[0071] The at least one processor may be configured to process the obtained at least one test result to obtain one or more identification parameters of the at least one test case via various operations. For example, the at least one processor may perform natural language processing (NLP) operations to extract one or more keywords of the at least one test case from the test results, perform search operations to determine an ID and / or custom tag of the at least one test case from the test results, and the like.

[0072] Upon obtaining the at least one identification parameter, the at least one processor may be configured to identify at least one test case associated with the collected at least one test result based on the at least one identification parameter. For example, assuming that the at least one processor obtains an ID of "#ABC" from the test result, the at least one processor may search for any test case having the same ID "#ABC" among multiple test cases stored in storage (e.g., storage 220) and / or managed by the test management system. It is envisioned that the at least one processor may identify at least one test case having other identification parameters (e.g., name, label, tag, etc.) in a similar manner.

[0073] Upon identifying the at least one test case based on the at least one identification information parameter, the at least one processor may be configured to retrieve information for the identified at least one test case. For example, the at least one processor may retrieve the identified at least one test case from storage in a test information management system. As another example, the at least one processor may retrieve the identified at least one test case from a test management system (e.g., via one or more API calls).

[0074] It may be understood that in some implementations, the at least one processor may be configured to perform operation S320 before operation S310 without departing from the scope of the present disclosure. For example, the at least one processor may first receive at least one test case, determine parameters associated with one or more test requirements of the at least one test case, and collect one or more test results associated with the one or more test requirements based on the determined parameters.

[0075] Further, in operation S330, the at least one processor of the test information management system may be configured to determine, from among the plurality of test requirements of the at least one test case, at least one test requirement that is associated with the at least one test result.

[0076] Specifically, the at least one processor may be configured to process the collected at least one test result to obtain at least one test parameter. In this regard, a "test parameter" as described herein may refer to a parameter that may be utilized by the at least one processor to identify a target test requirement. The test parameter may include one or more of a keyword associated with the at least one test requirement, a description defining the test requirement, and a custom tag associated with the at least one test requirement. The at least one processor may be configured to obtain the one or more test parameters in a manner similar to the manner in which the one or more identification parameters are obtained (e.g., by performing an NLP operation, performing a search operation, etc.).

[0077] Upon determining the at least one test requirement, method 300 may proceed to operation S340, where at least one processor of the test information management system may be configured to synchronize the at least one test result with the at least one test requirement. According to an embodiment, the at least one processor may synchronize the at least one test result with the at least one test requirement by generating a mapping of the at least one test result and the at least one test requirement. According to an embodiment in which the mapping was generated in a previous operation, the at least one processor may retrieve the generated mapping (e.g., from storage in the test information management system) and update the generated mapping with the latest test results. A description of an exemplary mapping is provided below with reference to FIG. 5.

[0078] According to an embodiment, upon synchronizing at least one test result with at least one test requirement, at least one processor of the test information management system may be configured to present the synchronized information to one or more users. For example, the at least one processor may generate at least one GUI including information of the mapping based on a mapping of the at least one test result and the at least one test requirement, and may present the at least one GUI to the associated user by transmitting the at least one GUI to at least one UE associated with the user. Alternatively or additionally, the at least one processor may provide the mapping to the test management system, which may then be configured to generate and present the at least one GUI to the user. According to an embodiment, the at least one GUI may be generated based on user information (e.g., user role, etc.). A description of an exemplary GUI including synchronized information is provided below with reference to FIGS. 7 and 8.

[0079] Below, a description of an example use case of method 300 is provided with reference to Figure 5. Generally, test information management system 510 (or at least one processor associated therewith) may be configured to collect multiple test results 520, determine and obtain test cases 530 associated with the collected test results, and synchronize the collected test results with the associated test requirements of the test cases 530 by generating / updating mappings 540. Test information management system 510 may be similar to the test information management systems described herein with reference to other figures.

[0080] Test results 520 may include test results 1-4, each of which may be associated with a test requirement of a test case (e.g., the test case of FIG. 4). At least some of test results 1-4 may be associated with testing performed in different test execution environments and may be collected by test information management system 510 (or at least one processor associated therewith) from different nodes. In this regard, test information management system 510 (or at least one processor associated therewith) may be configured to perform operation S310 and communicate with and collect multiple test results from multiple nodes simultaneously (or sequentially).

[0081] Upon acquiring at least one of test results 1-4, test information management system 510 (or at least one processor associated therewith) may be configured to associate the acquired test result with a corresponding test case. Specifically, test information management system 510 (or at least one processor associated therewith) may perform operation S320 to acquire identification information parameters from the test results, determine at least one test case associated with the at least one test result (based on the identification information parameters), and then acquire information for the at least one test case. For example, upon collecting at least one of test results 1-4, test information management system 510 (or at least one processor associated therewith) may be configured to acquire at least one identification information parameter from the collected test result. In the example use case of FIG. 5, test results 1 and 2 include a keyword for the test case (denoted as "ABC" in FIG. 5), and test results 3 and 4 include an ID for the test case (denoted as "#ABC" in FIG. 5). Based on the identification information parameter, the at least one processor may determine that the collected test results are associated with a test case having an ID of "#ABC" or a name / ID / description associated with a keyword of "ABC." Accordingly, the at least one processor may be configured to obtain information of the determined test case.

[0082] It may be understood that in some implementations, the test information management system 510 (or at least one processor associated therewith) may be configured to first obtain information about the test cases (e.g., from storage in the test information management system 510, from the test management system, etc.) and then collect test results associated with the test cases without departing from the scope of the present disclosure.

[0083] Upon obtaining the test results and the associated test case information, the test information management system 510 (or at least one processor associated therewith) may be configured to associate the obtained test results with the corresponding test requirements of the test cases. Specifically, the test information management system 510 (or at least one processor associated therewith) may perform operation S330 to obtain test parameters from the test results and determine, from among the multiple test requirements of the test case, at least one test requirement (based on the test parameters) to be associated with the at least one test result. For example, in the exemplary use case of FIG. 5 , test case 530 includes multiple test requirements 1-N, each of which has a parameter associated therewith, and test results 1 and 2 include keywords that define the respective test requirements, while test results 3 and 4 include descriptions of the test requirements. Based on the test parameters, the at least one processor may determine the test requirements to be associated with the collected test results.

[0084] Thereafter, the test information management system 510 (or at least one processor associated therewith) may be configured to perform operation S340 to synchronize the obtained test results with the corresponding test requirements. For example, the at least one processor may generate a new mapping 540 (or update a generated mapping 540) that includes the synchronized information.

[0085] Upon synchronizing the test information (e.g., test results and corresponding test requirement information), the test information management system 510 (or at least one processor associated therewith) may be configured to present the synchronized test information to one or more users. A description of an exemplary method associated therewith is presented below with reference to FIG. 6, and a description of an exemplary GUI associated therewith is presented below with reference to FIGS. 7 and 8.

[0086] 6 illustrates a flow diagram of an example method 600 for presenting synchronized test information according to one or more embodiments. One or more operations of method 600 may be performed by at least one processor of a test information management system and / or may be performed by a system / device separate from the test information management system (e.g., test management system, etc.).

[0087] 6, in operation S610, mapping information is obtained. According to embodiments in which operation S610 is performed by the test information management system (or at least one processor associated therewith), the mapping information may be obtained in real time or near real time via method 300, or may be obtained from storage of the test information management system (e.g., storage 220). According to embodiments in which operation S610 is performed by the test management system, the mapping information may be obtained by the test management system from the test information management system via one or more API calls.

[0088] Upon obtaining the mapping information, method 600 may proceed to operation S620, where information of one or more users associated with the test case or testing is obtained. For example, the test information management system (or at least one processor associated therewith) may determine one or more users associated with the test case or testing based on the test case information (e.g., identification parameters, e.g., test case ID, keywords, tags, etc.) included in the mapping information, and then subsequently obtain information of the one or more users (e.g., from storage 220, a node hosting user information, etc.). The user information may include user role, user title, user job description, past submission information, and / or the like. In embodiments in which operation S620 is performed by a test management system, it is contemplated that the test management system may be configured to obtain user information in a similar manner.

[0089] Upon obtaining the user information, method 600 may proceed to operation S630, where a presentation format associated with the user is determined. For example, the test information management system (or at least one processor associated therewith) may determine a presentation format containing information suitable for the user based on the user information (e.g., the user's role / persona / job information).

[0090] According to an embodiment, the presentation format may include a generic format or a specific format. In this regard, the term "general format" as used herein may refer to any format of presentation including descriptions that can be understood by a user without (or with limited) a particular level of technical background. Conversely, the term "specific format" as used herein may refer to any format of presentation including descriptions that can be understood by a user with a particular level of technical background. For example, the specific format may refer to programming code or any other computer-executable language that can be understood by a user with knowledge of a particular type of programming code or system. In embodiments in which operation S630 is performed by a test management system, it is contemplated that the test management system may be configured to determine the presentation format in a similar manner.

[0091] Upon determining the presentation format, method 600 may proceed to operation S640, where the synchronized test information is presented. For example, the test information management system (or at least one processor associated therewith) may generate a GUI including the synchronized test information based on the mapping information and the presentation format and then present the GUI to the user. The generated GUI may present the synchronized test information in a presentation format associated with the user. In embodiments in which operation S640 is performed by a test management system, it is contemplated that the test management system may be configured to present the synchronized test information in a similar manner.

[0092] For this reason, the synchronized test information can be presented to the user efficiently and effectively. Specifically, the GUI presented to the user can include appropriate content that is suitable for the user, taking into account the user's level of technical background. A description of an exemplary GUI generated according to the generic format is provided below with reference to FIG. 7, and a description of an exemplary GUI generated according to the specific format is provided below with reference to FIG. 8.

[0093] 7 illustrates an exemplary GUI 700, according to one or more embodiments. The GUI 700 may be generated by at least one processor of a test information management system (or test management system) and presented to a first user (via a UE associated with the first user) to present synchronized test information to the first user in a universal format.

[0094] 7, GUI 700 may include a first portion 710 and a second portion 720. First portion 710 may include a description of one or more test requirements for a test case, while second portion 720 may include synchronized test information (i.e., one or more test results along with the corresponding one or more test requirements) and multiple interactive elements 721.

[0095] According to an embodiment, one or more test requirements in the first portion 710 may be presented in the form of one or more interactive elements (e.g., selectable text, etc.), such that each time the first user interacts with an intended test requirement, the at least one processor may present the associated test result to the first user (e.g., presenting the test result in an overlay window, highlighting the test result in the second portion 720, etc.). In some implementations, the interactive elements associated with one or more test requirements may be presented according to the associated test result. For example, in the example of FIG. 7, the test requirement "aggregate status is warning" is presented in an italic format to inform the user that the requirement has a different test result (e.g., failure) than the other test requirements (e.g., success).

[0096] 7, the one or more test results are presented with respective icons in the second portion 720 (e.g., a check icon defines a "success" test result, an X icon defines a "fail" test result, etc.). It will be appreciated that alternatively or in addition to an icon-based presentation, the test results may be presented in the form of a text-based presentation (e.g., the terms "success," "fail," or the like may be presented, etc.), a color-based presentation (e.g., green indicates a "success" test result, red indicates a "fail" test result, etc.).

[0097] Additionally, the test requirement may be presented with one or more interactive elements (e.g., selectable text, buttons, etc.) so that upon interaction by the first user, the at least one processor may present further details associated with the test result. For example, in the example of FIG. 7, the test requirement "its aggregate status is warning" is presented with the selectable text "see more details." Upon determining user interaction with the selectable text, the at least one processor may cause the GUI 700 to proceed backwards to present further information (e.g., reason for failure, etc.) of the associated test result (e.g., in a pop-up window, etc.).

[0098] Additionally, each of the plurality of interactive elements 721, when interacted with by a first user, may perform one or more operations that manage test results. For example, in the example of FIG. 7, the “Download” button, when interacted with by a first user, may provide test results and associated information (e.g., a test log, etc.) to a UE associated with the first user. Further, the “View Test Log” button, when interacted with by the first user, may configure at least one processor to present the test log to the first user (e.g., in a pop-up window, etc.). Further, the “Exit” button, when interacted with by the first user, may enable the first user to terminate a current process (e.g., close GUI 700, redirect the first user to a previous page of GUI 700, etc.). It may be understood that GUI 700 may include any other suitable interactive elements associated with any other suitable operations without departing from the scope of the present disclosure.

[0099] 8 illustrates another exemplary GUI 800 according to one or more embodiments. GUI 800 may be generated by at least one processor of a test information management system (or test management system) and presented to a second user (via a UE associated with the second user) to present synchronized test information in a format specific to the second user.

[0100] The components of GUI 800 may be similar to those of GUI 700 (described above with reference to FIG. 7 ). For example, GUI 800 may also include a first portion 810 that may include a description of one or more test requirements for a test case, while second portion 720 may include synchronized test information (i.e., one or more test results along with one or more test requirements) and multiple interactive elements 821. Furthermore, GUI 800 may also be generated and presented by at least one processor in a manner similar to that described herein with reference to FIG. 7 . The content of GUI 800 differs from GUI 700 in that test requirements are presented in a specific format in first portion 810 and test results are presented with the associated test requirements in a specific format in second portion 720. Accordingly, redundant descriptions associated with components in GUI 800 may be omitted below for brevity.

[0101] To this end, exemplary embodiments of the present disclosure provide a test information management system (and a method for utilizing the test information management system) that can automatically collect, process, and synchronize test information. Furthermore, the test information management system can present the synchronized test information to multiple users in a presentation format that is suitable for each user. Thus, exemplary embodiments of the present disclosure enable test information to be synchronized and presented automatically, effectively, and efficiently, thereby addressing the problems in the related art as described above.

[0102] It is understood that the specific order or hierarchy of blocks in the process / flow diagrams disclosed herein is an example of an example approach. Based on design preferences, it is understood that the specific order or hierarchy of blocks in the process / flow diagrams may be rearranged. Furthermore, some blocks may be combined or omitted. The accompanying method claims present elements of the various blocks in a sample order and are not meant to be limited to the specific order or hierarchy presented.

[0103] Some embodiments may relate to systems, methods, and / or computer-readable media at any possible level of technical detail of integration. Additionally, as described herein, one or more of the above components described above may be implemented as instructions stored on a computer-readable medium and executable by at least one processor (and / or may include at least one processor). The computer-readable medium may include a computer-readable non-transitory storage medium (or media) having computer-readable program instructions for causing a processor to perform operations.

[0104] A computer-readable storage medium may be a tangible device that can hold and store instructions for use by an instruction-execution device. A computer-readable storage medium may be, for example, but is not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination thereof. A non-exhaustive list of more specific examples of computer-readable storage media includes the following: portable computer diskettes, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disk read-only memory (CD-ROM), digital versatile disk (DVD), memory sticks, floppy disks, mechanically encoded devices such as punch cards or ridge-in-groove structures with instructions recorded thereon, and any suitable combination thereof. As used herein, computer-readable storage media should not be construed as being transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., light pulses passing through a fiber optic cable), or electrical signals transmitted over wires.

[0105] The computer-readable program instructions described herein may be downloaded to each computing / processing device from a computer-readable storage medium, or may be downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network may include copper transmission cables, optical fiber transmissions, wireless transmissions, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in the respective computing / processing device.

[0106] The computer-readable program code / instructions for performing operations may be assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, configuration data for integrated circuits, or source or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, or the like, and procedural programming languages ​​such as the "C" programming language or similar programming languages. The computer-readable program instructions may be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection to the external computer may be made (e.g., through the Internet using an Internet Service Provider). In some embodiments, electronic circuitry including, for example, a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA) may execute computer-readable program instructions by utilizing state information of the computer-readable program instructions to personalize the electronic circuitry to perform an aspect or operation.

[0107] The computer-readable program instructions may be provided to a processor of a general-purpose computer, special-purpose computer, or other programmable data processing apparatus to create a machine, such that the instructions, executed by the processor of the computer or other programmable data processing apparatus, create means for implementing the function(s) / act(s) specified in the block(s) of the flowcharts and / or block diagrams. The computer-readable program instructions may also be stored on a computer-readable storage medium that can direct a computer, programmable data processing apparatus, and / or other device to function in a particular manner, such that the computer-readable storage medium having instructions stored therein comprises an article of manufacture including instructions that implement aspects of the function(s) / act(s) specified in the block(s) of the flowcharts and / or block diagrams.

[0108] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or another device to cause the computer, other programmable apparatus, or other device to perform a series of operational steps to create a computer-implemented process, such that the instructions executing on the computer, other programmable apparatus, or other device implement the function(s) / act(s) specified in the flowchart and / or block diagram block or blocks.

[0109] The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer-readable media according to various embodiments. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of instructions comprising one or more executable instructions that implement a specified logical function. The methods, computer systems, and computer-readable media may include additional, fewer, different, or differently arranged blocks compared to those depicted in the figures. In some alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks shown in succession may in fact be executed concurrently or substantially concurrently, or the blocks may even be executed in the reverse order, depending on the functionality involved. It should also be noted that each block of the block diagrams and / or flowchart diagrams, and combinations of blocks in the block diagrams and / or flowchart diagrams, may be implemented by a dedicated hardware-based system that performs the specified functions or acts or executes a combination of dedicated hardware and computer instructions.

[0110] It will be apparent that the systems and / or methods described herein may be implemented in various forms of hardware, firmware, or combinations of hardware and software. The actual specialized control hardware or software code used to implement the systems and / or methods is not a limitation of the implementation. Thus, the operation and behavior of the systems and / or methods are described herein without reference to specific software code, and it will be understood that software and hardware can be designed to implement the systems and / or methods based on the description herein.

Claims

1. 1. A method for automatically synchronizing test information for testing, the method being implemented by at least one processor, comprising: The processor: collecting at least one test result of said testing; determining at least one test case associated with the at least one test result; determining at least one test requirement from among a plurality of test requirements of at least one of the test cases, the at least one test requirement being associated with at least one of the test results; performing a process for synchronizing at least one of the test results with at least one of the test requirements; The method, wherein synchronizing the at least one test result with the at least one test requirement includes updating a mapping of the at least one test result and the determined at least one test requirement.

2. synchronizing the at least one test result with the at least one test requirement includes generating a mapping of the at least one test result and the determined at least one test requirement. The method of claim 1.

3. The collection of at least one test result comprises: Establishing communication with at least one test execution environment; collecting one or more test data from the at least one test execution environment; extracting information associated with the test results from the one or more test data; 3. The method of claim 1 or 2, comprising:

4. The determination of the at least one test case includes: processing at least one of said test results to obtain at least one identification parameter associated with at least one of said test cases; identifying at least one of the test cases based on at least one of the identification parameters; Including, the at least one identification parameter comprises at least one of a keyword associated with the at least one test case, a unique identifier (ID) associated with the at least one test case, and a tag associated with the at least one test case; 3. The method according to claim 1 or 2.

5. Determining at least one of the test requirements includes: processing at least one of said test results to obtain at least one test parameter associated with at least one of said test requirements; determining at least one test requirement from among a plurality of test requirements for at least one of the test cases based on the at least one test parameter; Including, the at least one test parameter comprises at least one of a keyword associated with the at least one test requirement, a description defining at least a portion of the at least one test requirement, and a tag associated with the at least one test requirement.

3. The method according to claim 1 or 2.

6. Obtaining information associated with one or more users; determining a presentation format based on the information of one or more of the users; presenting the synchronized test information to one or more of the users based on the mapping and the presentation format; The method of claim 2 further comprising:

7. The synchronized presentation of the test information includes: generating a first graphical user interface (GUI) based on the mapping and the presentation format; presenting the first GUI to a first user; Including, The presentation format is a universal format. The method of claim 6.

8. The synchronized presentation of the test information includes: generating a second GUI based on the mapping and the presentation format; presenting the second GUI to a second user; Further comprising: The presentation format is a specific format. The method of claim 7.

9. the testing includes testing software of a vehicle system, the software comprising a virtual electronic control unit (ECU); 3. The method according to claim 1 or 2.

10. 1. A system for automatically synchronizing test information for testing, the system comprising: a memory storage for storing instructions; at least one processor; wherein the at least one processor executes the instructions to collecting at least one test result of said testing; determining at least one test case associated with at least one of said test results; determining at least one test requirement from among a plurality of test requirements of at least one of the test cases, the at least one test requirement being associated with at least one of the test results; configured to synchronize at least one of the test results with at least one of the test requirements; at least one of the processors is configured to execute the instructions to synchronize at least one of the test results with at least one of the test requirements by updating a mapping of the at least one of the test results and the determined at least one of the test requirements.

11. 11. The system of claim 10, wherein at least one of the processors is configured to execute the instructions to generate a mapping of the at least one test result and the determined at least one test requirement, thereby synchronizing the at least one test result with the at least one test requirement.

12. At least one of the processors executes the instructions to Establishing communication with at least one test execution environment; collecting one or more test data from at least one of said test execution environments; extracting information associated with said test results from one or more of said test data; and collecting at least one of the test results by 12. A system according to claim 10 or 11.

13. At least one of the processors executes the instructions to processing at least one of said test results to obtain at least one identification parameter associated with at least one of said test cases; identifying at least one of the test cases based on at least one of the identification parameters; and configured to determine at least one of the test cases by the at least one identification parameter comprises at least one of a keyword associated with the at least one test case, a unique identifier (ID) associated with the at least one test case, and a tag associated with the at least one test case; 12. A system according to claim 10 or 11.

14. At least one of the processors executes the instructions to processing at least one of said test results to obtain at least one test parameter associated with at least one of said test requirements; determining at least one test requirement from among a plurality of test requirements for the at least one test case based on the at least one test parameter; and configured to determine at least one of the test requirements by the at least one test parameter comprises at least one of a keyword associated with the at least one test requirement, a description defining at least a portion of the at least one test requirement, and a tag associated with the at least one test requirement.

12. A system according to claim 10 or 11.

15. At least one of the processors further executes the instructions to: Obtaining information associated with one or more users; determining a presentation format based on the information of the one or more users; configured to present the synchronized test information to the one or more users based on the mapping and the presentation format. The system of claim 11.

16. At least one of the processors executes the instructions to generating a first graphical user interface (GUI) based on the mapping and the presentation format; presenting the first GUI to a first user; and configured to present the synchronized test information by The presentation format is a universal format. The system of claim 15.

17. At least one of the processors further executes the instructions to: generating a second GUI based on the mapping and the presentation format; presenting the second GUI to a second user; and configured to present the synchronized test information by The presentation format is a specific format.

17. The system of claim 16.

18. the testing includes testing software for the vehicle system; the software comprises a virtual electronic control unit (ECU); 12. A system according to claim 10 or 11.

Images