Method, system, device and medium for service performance testing of 5g industrial applications

Abstract

The application relates to a service performance test method, system, device and medium for 5G industrial application, which comprises the following steps: selecting a corresponding category of 5G industrial application according to obtained service demand, and determining service indexes for the category of 5G industrial application; selecting a network delay test direction or an application delay test direction according to the service indexes and the type of a terminal to be tested; and performing one-way and / or two-way delay test on the terminal to be tested through a pre-set test device and test case in the determined test direction. The application builds a simulated scene meeting the service demand of a customer and close to an actual operation scene according to the customer demand, achieves the purpose of targeted test, and reduces the measurement difficulty. Meanwhile, key index measurement such as delay, bandwidth and reliability is performed in the test, the service performance of the terminal to be tested including timeliness, data volume and system stability is fully considered, and the test efficiency and accuracy are improved.

Description

Technical Field

[0001] This invention relates to the field of industrial communication environment testing technology, and in particular to a service performance testing method, system, equipment, and medium for 5G industrial applications. Background Technology

[0002] Different industries have different needs for 5G, but in mainstream industrial applications and real-time scenarios, 5G theoretically needs to support millisecond-level air interface latency. In terms of 5G industrial applications, network providers, represented by major operators, have provided extensive application support in industries such as machinery manufacturing, coal, steel, cement, and chemicals.

[0003] In particular, communication network technologies used in industrial settings must meet the more stringent requirements of industrial applications, including but not limited to meeting corresponding standards in terms of data transmission real-time performance, determinism, availability, reliability, security, and interference resistance. Furthermore, considering the more complex operating environments in industrial settings, such as high temperatures, dust, and electromagnetic interference, it is essential to ensure that the operating environment is free from adverse factors to maintain the stable and reliable operation of 5G equipment.

[0004] Currently, the testing environment for industrial sites only uses laboratory air interface testing and on-site wireless signal testing. These testing environments have problems such as difficulty in testing indicators, low testing efficiency, and low accuracy, which makes it difficult to meet the growing user business needs. This results in high subsequent 5G operation and maintenance costs and seriously affects the large-scale application of 5G. Summary of the Invention

[0005] (a) Technical problems to be solved

[0006] In view of the above-mentioned shortcomings and deficiencies of the prior art, the present invention provides a business indicator testing method for 5G industrial applications, which solves the technical problems of existing testing environments having difficulty in conducting targeted indicator testing according to customer needs, difficulty in indicator testing, low testing efficiency, and low accuracy.

[0007] (II) Technical Solution

[0008] To achieve the above objectives, the main technical solutions adopted by the present invention include:

[0009] In a first aspect, embodiments of the present invention provide a service performance testing method for 5G industrial applications, comprising:

[0010] Select the appropriate category of 5G industrial applications based on the obtained business requirements, and determine the business indicators for the category of the 5G industrial applications.

[0011] Based on the aforementioned business metrics and the type of terminal to be tested, select either the network latency test direction or the application latency test direction.

[0012] Under a defined test direction, the terminal under test is subjected to one-way and / or two-way latency tests using pre-set test equipment and test cases;

[0013] The network latency refers to the time required for one information transmission at the network layer between the terminal under test and the test equipment that have a communication relationship; the application latency refers to the time required for one information transmission at the application layer between the terminal under test and the test equipment that have a communication relationship.

[0014] Optionally, the categories of industrial applications include:

[0015] Data acquisition industrial applications, wherein the business data operated by the data acquisition industrial applications includes equipment operation data and sensor data;

[0016] Visual industrial applications, wherein the business data operated by the visual industrial applications includes video data and image data;

[0017] Control-type industrial applications, wherein the business data executed by the control-type industrial applications includes control command data;

[0018] Hybrid industrial applications, wherein the business data operated by the hybrid industrial applications includes at least two of the following: video data, image data, and control command data.

[0019] Optionally,

[0020] The testing equipment is a 5G device including 5G+AGV, 5G+controller, 5G+video equipment, 5G+robot and 5G gateway, and the testing equipment uses 5G CPE or 5G gateway or built-in 5G module to access the 5G network.

[0021] The test cases are either formatted data containing videos, images, text, and business data, or unformatted data containing videos, images, text, and business data.

[0022] Optionally, based on the business metrics and the type of terminal under test, the network latency test direction or application latency test direction can be selected, including:

[0023] Based on the aforementioned business metrics, latency testing will be conducted on the terminal to be tested.

[0024] If the terminal to be tested is an application-fixed device, then select the network latency test direction;

[0025] If the terminal to be tested is an application-non-fixed device, then select the application latency test direction.

[0026] Optionally, if the terminal under test is an application-fixed device, after the terminal under test obtains the network latency, an estimated value of the application latency is obtained through a first compensation formula, wherein the first compensation formula is: T Y =T W +T1, T Y For application latency, T W Network latency, T1 is the first compensation value, and the value of T1 ranges from 100 microseconds to 1 millisecond.

[0027] Optionally, performing unidirectional and / or bidirectional latency testing on the terminal under test using pre-set test equipment and test cases in a determined test direction includes:

[0028] Under the determined test direction, the terminal under test is subjected to the following one-way latency test using pre-set test equipment and test cases:

[0029] Synchronize the clocks of all test devices;

[0030] For test equipment with built-in 5G modules, a timestamp is written in the data field of the service communication protocol or the reserved field of the message header, and the one-way delay is obtained by calculating the difference between the service data in the test case from the sending end to the receiving end based on the timestamp.

[0031] For test equipment using 5G CPE or 5G gateway, the test latency is obtained by calculating the difference between the service data in the test case from the sending end to the receiving end, and the one-way latency is obtained by compensating the test latency using a second compensation formula, wherein the second compensation formula is: T D =T C -T2,T D For unidirectional delay, T C For the test latency, T2 has a value range of 100 microseconds to 1 millisecond;

[0032] And / or,

[0033] Under the determined test direction, the terminal under test is subjected to the following bidirectional latency test using pre-set test equipment and test cases:

[0034] For bidirectional latency, bidirectional latency data is obtained by calculating the difference between the sending time and receiving time of the business data in the test case on the test equipment side or the terminal under test side.

[0035] Optionally, after performing unidirectional and / or bidirectional latency tests on the terminal under test using pre-set test equipment and test cases in a determined test direction, the method further includes:

[0036] Based on the aforementioned business metrics, the following bandwidth and reliability testing steps will be performed on the terminal under test using pre-set test equipment and test cases:

[0037] If the latency obtained in the latency test is less than the transmission period, the bandwidth is obtained based on the amount of data transmitted and the transmission frequency.

[0038] If the latency obtained in the latency test is greater than the transmission period, the transmission period is adjusted to be no less than the latency, and the test continues. The bandwidth is then obtained based on the amount of data transmitted and the transmission frequency at this time.

[0039] Furthermore, based on the amount of data sent by the transmitting end and the amount of data received by the receiving end, a reliability coefficient is obtained through a reliability formula, wherein the reliability formula is: R=1-(k1-k2) / k1, where R is the reliability coefficient, k1 is the amount of data sent by the transmitting end, and k2 is the amount of data received by the receiving end.

[0040] Secondly, embodiments of the present invention provide a service performance testing system for 5G industrial applications, comprising:

[0041] The business indicator determination module is used to select the corresponding category of 5G industrial applications based on the acquired business requirements, and determine the business indicators for the category of the 5G industrial applications.

[0042] The test direction selection module is used to select either network latency test direction or application latency test direction based on the business indicators and the type of terminal to be tested.

[0043] The latency testing module is used to perform one-way and / or two-way latency tests on the terminal under test using pre-set test equipment and test cases in a determined test direction.

[0044] The network latency refers to the time required for one information transmission at the network layer between the terminal under test and the test equipment that have a communication relationship; the application latency refers to the time required for one information transmission at the application layer between the terminal under test and the test equipment that have a communication relationship.

[0045] Thirdly, embodiments of the present invention provide a service performance testing device for 5G industrial applications, comprising:

[0046] At least one database;

[0047] And a memory that is communicatively connected to the at least one database;

[0048] The memory stores instructions that can be executed by the at least one database, which are then executed by the at least one database to enable the at least one database to perform a service performance testing method for a 5G industrial application as described above.

[0049] Fourthly, embodiments of the present invention provide a computer-readable medium having computer-executable instructions stored thereon, wherein the executable instructions, when executed by a processor, implement a service performance testing method for a 5G industrial application as described above.

[0050] (III) Beneficial Effects

[0051] The beneficial effects of this invention are as follows: This invention accurately selects 5G industrial applications that meet the customer's business needs, selects and matches test business indicators for these applications, and further subdivides the test direction based on the business indicators and the type of the terminal under test, thereby completing the test. In this way, this invention builds a simulated scenario that meets the customer's business needs and closely resembles the actual operating scenario, achieving the purpose of targeted testing and reducing the difficulty of measurement. Simultaneously, by measuring key indicators such as latency during the testing of the device under test, the invention fully considers the business performance of the terminal under test, including timeliness, data volume, and system stability, thereby improving testing efficiency and accuracy. Attached Figure Description

[0052] Figure 1 A flowchart illustrating a service performance testing method for 5G industrial applications provided by this invention;

[0053] Figure 2 A schematic diagram illustrating the communication between the test equipment and the terminal under test in a service performance testing method for 5G industrial applications provided by this invention.

[0054] Figure 3 A flowchart illustrating the one-way latency test in step S3 of the service performance testing method for 5G industrial applications provided by the present invention.

[0055] Figure 4 A flowchart illustrating the bidirectional latency test in step S3 of the service performance testing method for 5G industrial applications provided by this invention.

[0056] Figure 5 A schematic diagram illustrating the specific process after step S3 of the service performance testing method for 5G industrial applications provided by the present invention.

[0057] Figure 6 This is a schematic diagram of the computer system structure of a service performance testing device for 5G industrial applications.

[0058] [Explanation of Labels in the Attached Image]

[0059] 200: Computer system; 201: CPU; 202: ROM; 203: RAM; 202: First bus; 205: I / O interface; 206: Input section; 207: Output section; 208: Storage section; 209: Communication section; 210: Driver; 211: Removable media. Detailed Implementation

[0060] To better explain and facilitate understanding of the present invention, the present invention will be described in detail below with reference to the accompanying drawings and specific embodiments.

[0061] like Figure 1 As shown in the embodiment of the present invention, a service performance testing method for 5G industrial applications includes: first, selecting the corresponding category of 5G industrial applications based on the obtained service requirements, and determining service indicators for the category of 5G industrial applications; second, selecting a network latency testing direction or an application latency testing direction based on the service indicators and the type of the terminal to be tested; and third, conducting one-way and / or two-way latency tests on the terminal to be tested using pre-set test equipment and test cases under the determined test direction.

[0062] This invention precisely selects 5G industrial applications that meet the client's business needs, and then selects the appropriate testing metrics for each application. Based on these metrics and the type of terminal under test, the testing direction is further subdivided to complete the test. In this way, the invention builds a simulated scenario that meets the client's business requirements and closely resembles actual operating scenarios, achieving targeted testing and reducing measurement difficulty. Simultaneously, by measuring key indicators such as latency during the testing of the device under test, the invention fully considers the terminal's performance, including timeliness, data volume, and system stability, thereby improving testing efficiency and accuracy.

[0063] To better understand the above technical solutions, exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present invention are shown in the drawings, it should be understood that the present invention can be implemented in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that the present invention can be understood more clearly and thoroughly, and that the scope of the present invention can be fully conveyed to those skilled in the art.

[0064] Specifically, the present invention provides a service performance testing method for 5G industrial applications, comprising:

[0065] S1. Select the appropriate category of 5G industrial applications based on the obtained business requirements, and determine the business indicators for the category of 5G industrial applications.

[0066] Furthermore, the categories of industrial applications include:

[0067] Data acquisition-based industrial applications generate business data including equipment operation data and sensor data.

[0068] Visual industrial applications generate business data including video and image data.

[0069] Control-type industrial applications, the business data that control-type industrial applications run includes control command data.

[0070] Hybrid industrial applications are those that run business data including at least two of the following: video data, image data, and control command data.

[0071] Data acquisition applications are mainly high-bandwidth, high-concurrency services that are not sensitive to latency and packet loss; vision applications are mainly visual inspection and cloud control services; control applications are mainly control and collaboration services; hybrid applications refer to service types that contain at least two of the following: A, B, and C.

[0072] Furthermore, the test equipment includes actual business terminal equipment or test equipment with similar performance. The test equipment can be actual equipment using 5G communication, such as 5G+AGV, 5G+controller, 5G+video equipment, 5G+robot, and 5G gateways. If actual business equipment cannot be tested, simulation equipment with similar performance needs to be used instead to evaluate business performance. Therefore, the test equipment uses a 5G CPE, a 5G gateway, or a built-in 5G module to access the 5G network. Moreover, the test cases are formatted data containing video, images, text, and business data, or unformatted data containing video, images, text, and business data.

[0073] like Figure 2 As shown, network latency refers to the time required for one information transmission at the network layer between the terminal under test and the test equipment, which have a communication relationship; application latency refers to the time required for one information transmission at the application layer between the terminal under test and the test equipment, which have a communication relationship. The terminal under test and the test equipment can communicate via a cellular network or a wired network.

[0074] S2. Based on the business metrics and the type of terminal to be tested, select either the network latency test direction or the application latency test direction.

[0075] Further, step S2 includes:

[0076] Based on the aforementioned business metrics, latency testing is determined for the terminal to be tested.

[0077] If the terminal to be tested is an application-fixed device, then select the network latency test direction.

[0078] If the terminal to be tested is an application-non-fixed device, then select the application latency test direction.

[0079] Among them, application-fixed devices refer to devices where the application is fixed on the terminal under test and cannot be changed or erased; while application-non-fixed devices refer to devices where the application on the terminal under test is not fixed and can be changed and erased.

[0080] Furthermore, if the terminal under test is an application-fixed device, after the terminal under test obtains the network latency, the application latency is obtained through the first compensation formula, wherein the first compensation formula is: T Y =T W +T1, T Y For application latency, T W Network latency, T1 is the first compensation value, and the value of T1 ranges from 100 microseconds to 1 millisecond.

[0081] In addition, some devices with built-in modules are generally not testable, and application latency can only be estimated by network latency. That is, when application latency cannot be tested, application latency can be evaluated by testing network latency.

[0082] Due to the limitations of industrial equipment, in order not to affect operational safety, it is generally not allowed to add new applications for testing, such as PLC controllers. Application latency can only be estimated by testing network latency, and different empirical values ​​are used to compensate for processors with different computing capabilities, such as microcontrollers and ARM processors.

[0083] S3. Under the determined test direction, perform one-way and / or two-way latency tests on the terminal under test using pre-set test equipment and test cases.

[0084] Furthermore, such as Figure 3 As shown, the one-way latency test includes:

[0085] S32a. Under the determined test direction, the terminal to be tested is subjected to the following one-way latency test using pre-set test equipment and test cases.

[0086] S33a. Synchronize the clocks of all test equipment. Synchronizing the clocks of all test equipment is to ensure test accuracy.

[0087] S34a. For test equipment with built-in 5G modules, write a timestamp in the data field of the service communication protocol or the reserved field of the message header, and calculate the one-way delay by calculating the difference between the service data in the test case from the sending end to the receiving end based on the timestamp.

[0088] S35a. For test equipment using 5G CPE or 5G gateway, the test latency is obtained by calculating the difference between the service data in the test case from the sending end to the receiving end, and the one-way latency is obtained by compensating for the test latency using a second compensation formula, wherein the second compensation formula is: T D =T C -T2,T D For unidirectional delay, T C For the test latency, T2 has a value range of 100 microseconds to 1 millisecond;

[0089] And / or,

[0090] Furthermore, such as Figure 4 As shown, the bidirectional delay test includes:

[0091] S32b. Under the determined test direction, the terminal under test is subjected to the following bidirectional latency test using pre-set test equipment and test cases.

[0092] S33b. For bidirectional latency, bidirectional latency data is obtained by calculating the difference between the sending time and receiving time of the business data in the test case on the test equipment side or the terminal under test side.

[0093] Furthermore, after step S3, as... Figure 5 As shown, it also includes:

[0094] A31. Using pre-set test equipment and test cases, perform the following bandwidth and reliability tests on the terminal under test.

[0095] A32a. If the latency obtained in the latency test is less than the transmission period, the bandwidth is obtained based on the amount of data transmitted and the transmission frequency; where bandwidth = amount of data transmitted. How many times per second.

[0096] A33a. If the latency obtained in the latency test is greater than the transmission period, then adjust the transmission period to be no less than the latency, and then continue the test. The bandwidth is then obtained based on the amount of data transmitted and the transmission frequency at this time.

[0097] A32b, and, based on the amount of data sent by the transmitting end and the amount of data received by the receiving end, the reliability coefficient is obtained through the reliability formula, wherein the reliability formula is: R=1-(k1-k2) / k1, R is the reliability coefficient, k1 is the amount of data sent by the transmitting end, and k2 is the amount of data received by the receiving end.

[0098] Furthermore, this invention also provides a service performance testing system for 5G industrial applications, comprising:

[0099] The business indicator determination module is used to select the corresponding category of 5G industrial applications based on the acquired business requirements, and to determine the business indicators for the category of 5G industrial applications.

[0100] The test direction selection module is used to select either network latency test direction or application latency test direction based on business indicators and the type of terminal to be tested.

[0101] The latency testing module is used to perform one-way and / or two-way latency tests on the terminal under test using pre-set test equipment and test cases in a defined test direction.

[0102] Among them, network latency refers to the time required for one information transmission at the network layer between the terminal under test and the test equipment that have a communication relationship; application latency refers to the time required for one information transmission at the application layer between the terminal under test and the test equipment that have a communication relationship.

[0103] Meanwhile, the present invention also provides a service performance testing device for 5G industrial applications, comprising: at least one database; and a memory communicatively connected to the at least one database; wherein the memory stores instructions executable by the at least one database, the instructions being executed by the at least one database to enable the at least one database to perform a service performance testing method for a 5G industrial application as described above.

[0104] Figure 6 A schematic diagram of the computer system structure of a service performance testing device for 5G industrial applications provided in an embodiment of the present invention is shown below. Figure 6 It shows a schematic diagram of the structure of a computer system 200 suitable for implementing a service performance testing device for 5G industrial applications according to an embodiment of this application. Figure 6 The 5G industrial application service performance testing equipment shown is merely an example and should not impose any limitations on the functionality and scope of use of the embodiments of this application.

[0105] like Figure 6 As shown, the computer system 200 includes a central processing unit (CPU) 201, which can perform various appropriate actions and processes based on programs stored in read-only memory (ROM) 202 or programs loaded from storage section 208 into random access memory (RAM) 203. The RAM 203 also stores various programs and data required for the operation of the computer system 200. The CPU 201, ROM 202, and RAM 203 are interconnected via a bus 204. An input / output interface (I / O interface) 205 is also connected to the bus 204.

[0106] The following components are connected to I / O interface 205: an input section 206 including a keyboard, mouse, etc.; an output section 207 including a cathode ray tube (CRT), liquid crystal display (LCD), etc., and speakers, etc.; a storage section 208 including a hard disk, etc.; and a communication section 209 including a network interface card such as a LAN card, modem, etc. The communication section 209 performs communication processing via a network such as the Internet. Drive 210 is also connected to I / O interface 205 as needed. Removable media 211, such as a disk, optical disk, magneto-optical disk, semiconductor memory, etc., are installed on drive 210 as needed so that computer programs read from them can be installed into storage section 208 as needed.

[0107] In particular, according to embodiments of the present invention, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of the present invention include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication section 209, and / or installed from removable medium 211. When the computer program is executed by central processing unit (CPU) 201, it performs the functions defined above in the system of this application.

[0108] Furthermore, the present invention also provides a computer-readable medium storing computer-executable instructions thereon. This computer-readable medium may be included in the device described in the above embodiments, or it may exist independently and not assembled into the device. The aforementioned computer-readable medium carries one or more programs, which, when executed by one or more of the devices, implement a service performance testing method for a 5G industrial application as described above.

[0109] Since the systems / devices described in the above embodiments of the present invention are systems / devices used to implement the methods of the above embodiments of the present invention, those skilled in the art can understand the specific structure and modifications of the systems / devices based on the methods described in the above embodiments of the present invention, and therefore will not be repeated here. All systems / devices used in the methods of the above embodiments of the present invention fall within the scope of protection of the present invention.

[0110] Those skilled in the art will understand that embodiments of the present invention can be provided as methods, systems, or computer program products. Therefore, the present invention can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0111] This invention is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, as well as combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions.

[0112] It should be noted that any reference numerals placed between parentheses in the claims should not be construed as limiting the claims. The word "comprising" does not exclude the presence of components or steps not listed in the claims. The word "a" or "an" preceding a component does not exclude the presence of a plurality of such components. The invention can be implemented by means of hardware comprising several different components and by means of a suitably programmed computer. In claims that enumerate several means, several of these means may be embodied by the same hardware. The use of the terms first, second, third, etc., is merely for convenience of expression and does not indicate any order. These terms can be understood as part of the component names.

[0113] Furthermore, it should be noted that in the description of this specification, the terms "one embodiment," "some embodiments," "embodiment," "example," "specific example," or "some examples," etc., refer to specific features, structures, materials, or characteristics described in connection with that embodiment or example, which are included in at least one embodiment or example of the present invention. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples. Furthermore, without contradiction, those skilled in the art can combine and integrate the different embodiments or examples described in this specification, as well as the features of different embodiments or examples.

[0114] Although preferred embodiments of the invention have been described, those skilled in the art, upon learning the basic inventive concept, can make other changes and modifications to these embodiments. Therefore, the claims should be interpreted to include both the preferred embodiments and all changes and modifications falling within the scope of the invention.

[0115] Obviously, those skilled in the art can make various modifications and variations to this invention without departing from its spirit and scope. Therefore, if these modifications and variations fall within the scope of the claims of this invention and their equivalents, then this invention should also include these modifications and variations.

Claims

1. A service performance testing method for 5G industrial applications, characterized in that, include: Select the appropriate category of 5G industrial applications based on the obtained business requirements, and determine the business indicators for the category of the 5G industrial applications. Based on the business metrics and the type of the terminal under test, the method of selecting either network latency testing or application latency testing includes: determining whether to conduct latency testing on the terminal under test based on the business metrics; if the terminal under test is an application-fixed device, selecting the network latency testing method; if the terminal under test is an application-non-fixed device, selecting the application latency testing method; if the terminal under test is an application-fixed device, after obtaining the network latency, obtaining an estimated value of the application latency using a first compensation formula, wherein the first compensation formula is: T Y =T W +T1, T Y For application latency, T W For network latency, T1 is the first compensation value, and the value of T1 ranges from 100 microseconds to 1 millisecond; among them, application-fixed devices refer to applications that are fixed on the terminal under test and cannot be changed or erased; while application-non-fixed devices refer to applications on the terminal under test that are not fixed and can be changed and erased. Under a defined test direction, the terminal under test is subjected to one-way and / or two-way latency tests using pre-set test equipment and test cases; The network latency refers to the time required for one information transmission at the network layer between the terminal under test and the test equipment that have a communication relationship; the application latency refers to the time required for one information transmission at the application layer between the terminal under test and the test equipment that have a communication relationship.

2. The service performance testing method for 5G industrial applications as described in claim 1, characterized in that, The categories of industrial applications include: Data acquisition industrial applications, wherein the business data operated by the data acquisition industrial applications includes equipment operation data and sensor data; Visual industrial applications, wherein the business data operated by the visual industrial applications includes video data and image data; Control-type industrial applications, wherein the business data executed by the control-type industrial applications includes control command data; Hybrid industrial applications, wherein the business data operated by the hybrid industrial applications includes at least two of the following: video data, image data, and control command data.

3. The service performance testing method for 5G industrial applications as described in claim 1, characterized in that, The testing equipment is a 5G device including 5G+AGV, 5G+controller, 5G+video equipment, 5G+robot and 5G gateway, and the testing equipment uses 5G CPE or 5G gateway or built-in 5G module to access the 5G network. The test cases are either formatted data containing videos, images, text, and business data, or unformatted data containing videos, images, text, and business data.

4. The service performance testing method for 5G industrial applications as described in claim 3, characterized in that, Under a defined test direction, the terminal under test is subjected to unidirectional and / or bidirectional latency testing using pre-set test equipment and test cases, including: Under the determined test direction, the terminal under test is subjected to the following one-way latency test using pre-set test equipment and test cases: Synchronize the clocks of all test devices; For test equipment with built-in 5G modules, a timestamp is written in the data field of the service communication protocol or the reserved field of the message header, and the one-way delay is obtained by calculating the difference between the service data in the test case from the sending end to the receiving end based on the timestamp. For test equipment using 5G CPE or 5G gateway, the test latency is obtained by calculating the difference between the service data in the test case from the sending end to the receiving end, and the one-way latency is obtained by compensating the test latency using a second compensation formula, wherein the second compensation formula is: T D =T C -T2,T D For unidirectional delay, T C For the test latency, T2 has a value range of 100 microseconds to 1 millisecond; and / or Under the determined test direction, the terminal under test is subjected to the following bidirectional latency test using pre-set test equipment and test cases: For bidirectional latency, bidirectional latency data is obtained by calculating the difference between the sending time and receiving time of the business data in the test case on the test equipment side or the terminal under test side.

5. A service performance testing method for 5G industrial applications as described in any one of claims 1-4, characterized in that, After performing unidirectional and / or bidirectional latency tests on the terminal under test using pre-set test equipment and test cases under a defined test direction, the process further includes: Based on the aforementioned business metrics, the following bandwidth and reliability testing steps are performed on the terminal under test using pre-set testing equipment and test cases: If the latency obtained in the latency test is less than the transmission period, the bandwidth is obtained based on the amount of data transmitted and the transmission frequency. If the latency obtained in the latency test is greater than the transmission period, the transmission period is adjusted to be no less than the latency, and the test continues. The bandwidth is then obtained based on the amount of data transmitted and the transmission frequency at this time. Furthermore, based on the amount of data sent by the transmitting end and the amount of data received by the receiving end, a reliability coefficient is obtained through a reliability formula, wherein the reliability formula is: R=1-(k1-k2) / k1, where R is the reliability coefficient, k1 is the amount of data sent by the transmitting end, and k2 is the amount of data received by the receiving end.

6. A service performance testing system for 5G industrial applications, characterized in that, include: The business indicator determination module is used to select the corresponding category of 5G industrial applications based on the acquired business requirements, and determine the business indicators for the category of the 5G industrial applications. The test direction selection module is used to select either a network latency test direction or an application latency test direction based on the business indicators and the type of the terminal under test. This includes: determining whether to use latency testing for the terminal under test based on the business indicators; selecting a network latency test direction if the terminal under test is an application-fixed device; selecting an application latency test direction if the terminal under test is an application-non-fixed device; and if the terminal under test is an application-fixed device, after obtaining the network latency, obtaining an estimated application latency value using a first compensation formula, wherein the first compensation formula is: T Y =T W +T1, T Y For application latency, T W For network latency, T1 is the first compensation value, and the value of T1 ranges from 100 microseconds to 1 millisecond; among them, application-fixed devices refer to applications that are fixed on the terminal under test and cannot be changed or erased; while application-non-fixed devices refer to applications on the terminal under test that are not fixed and can be changed and erased. The latency testing module is used to perform one-way and / or two-way latency tests on the terminal under test using pre-set test equipment and test cases in a determined test direction. The network latency refers to the time required for one information transmission at the network layer between the terminal under test and the test equipment that have a communication relationship; the application latency refers to the time required for one information transmission at the application layer between the terminal under test and the test equipment that have a communication relationship.

7. A service performance testing device for 5G industrial applications, characterized in that, include: At least one database; and a memory that is communicatively connected to the at least one database; The memory stores instructions that can be executed by the at least one database, which are executed by the at least one database to enable the at least one database to perform a service performance testing method for a 5G industrial application as described in any one of claims 1-5.

8. A computer-readable medium having computer-executable instructions stored thereon, characterized in that, When the executable instructions are executed by the processor, they implement a service performance testing method for 5G industrial applications as described in any one of claims 1-5.

Images