Automatic production test method and system based on test BOM and medium

By obtaining test BOM and generating production test system, collecting and processing test record data, and calculating test reliability index, the problem of lack of systematicity and accuracy of traditional test BOM is solved, and the reliability and product quality of automated production tests are improved. .

CN119417066APending Publication Date: 2025-02-11深圳市华芯控股有限公司
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202510017762.0
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-01-06
Publication Date
2025-02-11

AI Technical Summary

Technical Problem

Traditional test BOMs lack systematicity and accuracy, making it difficult to effectively evaluate the reliability of automated production tests. Especially in complex production environments, test BOMs may not be able to reflect the actual production of the product in a timely manner, resulting in inaccurate test results and affecting product quality. .

Method used

By obtaining the test BOM based on the production test needs, and generating a production test system based on the test BOM, collecting the operation monitoring information of the production test system within the preset time period, and extracting test record data, including system operation feature data, test process feature data, and test The result record data and the equipment operation characteristic data. Based on these data, the test accuracy index, test integrity index, test stability index, test efficiency index are obtained, and the test reliability index is calculated based on these indexes, and corresponding adjustments and optimization measures are taken.

Benefits of technology

The technology of automated production testing based on test BOM is realized, which improves the accuracy, completeness, stability and efficiency of the test, ensures the reliability of production testing, and thus improves product quality.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119417066A_ABST
    Figure CN119417066A_ABST
Patent Text Reader

Abstract

The invention provides an automatic production test method and system based on a test BOM and a medium. The method comprises the following steps: obtaining a test BOM according to a production test demand, generating a production test system based on the test BOM, collecting operation monitoring information of the production test system in a preset time period, and extracting test record data including system operation feature data, test process feature data, test result record data and equipment operation feature data, performing various processing according to the test record data to correspondingly obtain a test accuracy index, a test integrity index, a test stability index and a test efficiency index, and performing processing according to the test accuracy index, the test integrity index and the test stability index in combination with the test efficiency index to obtain a test reliability index; and corresponding adjustment and optimization measures are taken, so that an automatic production test technology based on the test BOM is realized.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of automated production testing technology, and in particular, to an automated production testing method, system and medium based on a test BOM. Background Art

[0002] In the automated production process, product quality and reliability are crucial. Test BOM (Bill of Materials) is a key document used to guide the testing process. In the manufacturing industry, product BOM is important information shared by all links to guide product production.

[0003] However, traditional test BOMs often lack systematicity and accuracy, making it difficult to effectively evaluate the reliability of automated production testing. For example, in a complex production environment, the test BOM may not be able to reflect the actual production situation of the product in a timely manner, resulting in inaccurate test results and affecting product quality.

[0004] In view of the above problems, effective technical solutions are urgently needed. Summary of the invention

[0005] The purpose of the present application is to provide an automated production testing method, system and medium based on a test BOM. The test BOM can be obtained according to production testing requirements, and a production testing system can be generated based on the test BOM. Operation monitoring information of the production testing system within a preset time period can be collected, and test record data can be extracted, including system operation characteristic data, test process characteristic data, test result record data and equipment operation characteristic data. Multiple processing can be performed on the test record data to obtain a corresponding test accuracy index, a test integrity index, a test stability index and a test efficiency index. Further processing can be performed to obtain a test reliability index, and corresponding adjustment and optimization measures can be taken to realize the technology of automated production testing based on the test BOM.

[0006] The present application also provides an automated production test method based on a test BOM, comprising the following steps: Obtain a test BOM according to production test requirements, and generate a production test system based on the test BOM; Collecting operation monitoring information of the production test system within a preset time period, and extracting test record data, including system operation characteristic data, test process characteristic data, test result record data, and equipment operation characteristic data; Processing the test process characteristic data and the test result record data to obtain a test accuracy index; Processing the system operation characteristic data and the test process characteristic data to obtain a test integrity index; Processing the test result record data and the equipment operation characteristic data to obtain a test stability index; Processing the system operation characteristic data to obtain a test efficiency index; The test accuracy index, the test integrity index and the test stability index are processed in combination with the test efficiency index to obtain a test reliability index, and corresponding adjustment and optimization measures are taken.

[0007] Optionally, in the automated production test method based on the test BOM described in the present application, the processing according to the test process characteristic data and the test result record data to obtain the test accuracy index includes: Extract and process the test process characteristic data and the test result record data to obtain test data deviation rate data, qualified judgment accuracy rate data, repeated test consistency rate data and test data distribution compliance data; The test data deviation rate data, the qualified judgment accuracy rate data, the repeated test consistency rate data and the test data distribution conformity data are processed to obtain a test accuracy index.

[0008] Optionally, in the automated production test method based on the test BOM described in the present application, the processing according to the system operation characteristic data and the test process characteristic data to obtain the test integrity index includes: Extract and process the system operation characteristic data and the test process characteristic data to obtain test item coverage data, functional test integrity ratio data and boundary condition test coverage data; The test item coverage data, the functional test integrity ratio data and the boundary condition test coverage data are processed to obtain a test integrity index.

[0009] Optionally, in the automated production test method based on the test BOM described in the present application, the processing according to the test result record data and the equipment operation characteristic data to obtain the test stability index includes: Extract and process the test result record data to obtain the deviation rate extreme value data of repeated test results; Extract and process the equipment operation characteristic data to obtain equipment failure rate data; The test stability index is obtained by processing the deviation rate extreme value data of the repeated test results in combination with the equipment failure rate data.

[0010] Optionally, in the automated production test method based on the test BOM described in the present application, the processing according to the system operation characteristic data to obtain the test efficiency index includes: Extract and process the system operation characteristic data to obtain average test cycle data, throughput data, resource utilization data, and test process parallelism data; The test efficiency index is obtained by processing the average test cycle data, throughput data, resource utilization data and test process parallelism data.

[0011] Optionally, in the automated production test method based on the test BOM described in the present application, the test accuracy index, the test integrity index and the test stability index are processed in combination with the test efficiency index to obtain a test reliability index, and corresponding adjustment and optimization measures are taken, including: According to the test accuracy index, the test integrity index and the test stability index, combined with the test efficiency index, a test reliability index is obtained; Comparing the test reliability index with a preset test reliability threshold to obtain a threshold comparison result; Judging whether the reliability of the automated production test of the production test system meets the production requirements according to the threshold comparison result; If the threshold comparison result is less than the preset threshold, the automated production test reliability of the production test system does not meet the requirements, and corresponding adjustment and optimization measures need to be taken for the production test system.

[0012] In a second aspect, the present application provides an automated production test system based on a test BOM, the system comprising: a memory and a processor, the memory comprising a program of an automated production test method based on a test BOM, the program of the automated production test method based on a test BOM being executed by the processor to implement the following steps: Obtain a test BOM according to production test requirements, and generate a production test system based on the test BOM; Collecting operation monitoring information of the production test system within a preset time period, and extracting test record data, including system operation characteristic data, test process characteristic data, test result record data, and equipment operation characteristic data; Processing the test process characteristic data and the test result record data to obtain a test accuracy index; Processing the system operation characteristic data and the test process characteristic data to obtain a test integrity index; Processing the test result record data and the equipment operation characteristic data to obtain a test stability index; Processing the system operation characteristic data to obtain a test efficiency index; The test accuracy index, the test integrity index and the test stability index are processed in combination with the test efficiency index to obtain a test reliability index, and corresponding adjustment and optimization measures are taken.

[0013] Optionally, in the automated production test system based on the test BOM described in the present application, the processing according to the test process characteristic data and the test result record data to obtain the test accuracy index includes: Extract and process the test process characteristic data and the test result record data to obtain test data deviation rate data, qualified judgment accuracy rate data, repeated test consistency rate data and test data distribution compliance data; The test data deviation rate data, the qualified judgment accuracy rate data, the repeated test consistency rate data and the test data distribution conformity data are processed to obtain a test accuracy index.

[0014] Optionally, in the automated production test system based on the test BOM described in the present application, the processing according to the system operation characteristic data and the test process characteristic data to obtain the test integrity index includes: Extract and process the system operation characteristic data and the test process characteristic data to obtain test item coverage data, functional test integrity ratio data and boundary condition test coverage data; The test item coverage data, the functional test integrity ratio data and the boundary condition test coverage data are processed to obtain a test integrity index.

[0015] In the third aspect, the present application also provides a computer-readable storage medium, which stores an automated production test method program based on a test BOM. When the automated production test method program based on a test BOM is executed by a processor, the steps of the automated production test method based on a test BOM as described in any one of the above items are implemented.

[0016] From the above, it can be seen that the automated production testing method, system and medium based on the test BOM provided by the present application obtain the test BOM according to the production testing requirements, and generate a production testing system based on the test BOM, collect the operation monitoring information of the production testing system within a preset time period, and extract the test record data, including system operation characteristic data, test process characteristic data, test result record data and equipment operation characteristic data, process the test process characteristic data and the test result record data to obtain the test accuracy index, process the test process characteristic data and the test result record data to obtain the test integrity index, process the test result record data and the equipment operation characteristic data to obtain the test stability index, process the system operation characteristic data to obtain the test efficiency index, process the test accuracy index, the test integrity index and the test stability index in combination with the test efficiency index to obtain the test reliability index, and take corresponding adjustment and optimization measures, thereby realizing the technology of automated production testing based on the test BOM.

[0017] Other features and advantages of the present application will be described in the following description, and partly become apparent from the description, or understood by practicing the embodiments of the present application. The purpose and other advantages of the present application can be realized and obtained by the structures specifically pointed out in the written description and the drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments of the present application will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0019] Figure 1 A flowchart of an automated production test method based on a test BOM provided in an embodiment of the present application; Figure 2 A flow chart of obtaining a test accuracy index for an automated production test method based on a test BOM provided in an embodiment of the present application; Figure 3 A flowchart of obtaining a test integrity index for an automated production test method based on a test BOM provided in an embodiment of the present application; Figure 4 A flow chart of obtaining a test stability index for an automated production test method based on a test BOM provided in an embodiment of the present application. DETAILED DESCRIPTION

[0020] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all of the embodiments. The components of the embodiments of the present application described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the application claimed for protection, but merely represents the selected embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present application.

[0021] It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings. At the same time, in the description of this application, the terms "first", "second", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance.

[0022] Please refer to Figure 1 , Figure 1 1 is a flow chart of an automated production test method based on a test BOM in some embodiments of the present application. The automated production test method based on a test BOM is used in terminal devices, such as computers, mobile phone terminals, etc. The automated production test method based on a test BOM includes the following steps: S11, obtaining a test BOM according to production test requirements, and generating a production test system based on the test BOM; S12, collecting operation monitoring information of the production test system within a preset time period, and extracting test record data, including system operation characteristic data, test process characteristic data, test result record data, and equipment operation characteristic data; S13, processing the test process characteristic data and the test result record data to obtain a test accuracy index; S14, processing the system operation characteristic data and the test process characteristic data to obtain a test integrity index; S15, processing the test result record data and the equipment operation characteristic data to obtain a test stability index; S16, processing the system operation characteristic data to obtain a test efficiency index; S17. According to the test accuracy index, the test integrity index and the test stability index, the test reliability index is obtained by combining the test efficiency index, and corresponding adjustment and optimization measures are taken.

[0023] It should be noted that in the automated production process, the quality and reliability of the product are of vital importance. The test BOM (Bill of Materials) is a key document used to guide the testing process. In the manufacturing industry, the product BOM is important information shared by all links to guide product production. However, traditional test BOMs often lack systematicity and accuracy, and it is difficult to effectively evaluate the reliability of automated production testing. For example, in a complex production environment, the test BOM may not be able to reflect the actual production situation of the product in a timely manner, resulting in inaccurate test results and affecting product quality. Therefore, it is necessary to seek an automated production testing method based on the test BOM to solve the above problems. In this embodiment, the test BOM is first obtained according to the production test requirements, and a production test system is generated based on the test BOM, and the operation monitoring information of the production test system within a preset time period is collected. And extract test record data, including system operation characteristic data, test process characteristic data, test result record data and equipment operation characteristic data, process the test process characteristic data and the test result record data to obtain the test accuracy index, process the system operation characteristic data and the test process characteristic data to obtain the test integrity index, process the test result record data and the equipment operation characteristic data to obtain the test stability index, process the system operation characteristic data to obtain the test efficiency index, process the test accuracy index, the test integrity index and the test stability index in combination with the test efficiency index to obtain the test reliability index, and take corresponding adjustment and optimization measures to realize the technology of automated production testing based on test BOM.

[0024] Please refer to Figure 2 , Figure 2 The flowchart of obtaining the test accuracy index of the automated production test method based on the test BOM in some embodiments of the present application. According to the embodiment of the present invention, the test accuracy index is obtained by processing the test process characteristic data and the test result record data, including: S21, extracting and processing the test process characteristic data and the test result record data to obtain test data deviation rate data, qualified judgment accuracy rate data, repeated test consistency rate data and test data distribution compliance data; S22, processing is performed according to the test data deviation rate data, the qualified judgment accuracy rate data, the repeated test consistency rate data and the test data distribution conformity data to obtain a test accuracy index.

[0025] It should be noted that the test data deviation rate, qualified judgment accuracy rate, repeated test consistency rate and test data distribution conformity data are obtained by extracting and processing the test process characteristic data and the test result record data. Among them, the test data deviation rate refers to the degree of deviation between the actual test data and the standard test data (the data specified in the test BOM), the qualified judgment accuracy rate refers to the proportion of correctly judged qualified or unqualified products, the repeated test consistency rate refers to the proportion of consistent test results when the same product is tested repeatedly, and the test data distribution conformity means that when a batch of products is tested, the test data should conform to a certain distribution law (such as normal distribution). Statistical methods (such as chi-square test) can be used to test the distribution of actual test data and the theoretical distribution (based on product quality standards and test BOM expectations). Then, the above data are processed to obtain the test accuracy index; The calculation formula of the test accuracy index is: ; in, To test the accuracy index, , , , They are test data deviation rate data, qualified judgment accuracy data, repeated test consistency rate data, and test data distribution conformity data. , , , It is the preset characteristic coefficient (the characteristic coefficient is obtained by querying the preset automated production test database).

[0026] Please refer to Figure 3 , Figure 3 The flowchart of obtaining the test integrity index of the automated production test method based on the test BOM in some embodiments of the present application. According to the embodiment of the present invention, the processing according to the system operation characteristic data and the test process characteristic data to obtain the test integrity index includes: S31, extracting and processing the system operation characteristic data and the test process characteristic data to obtain test item coverage data, functional test integrity ratio data and boundary condition test coverage data; S32: Process the test item coverage data, the functional test integrity ratio data, and the boundary condition test coverage data to obtain a test integrity index.

[0027] It should be noted that the test item coverage, functional test integrity ratio and boundary condition test coverage data are obtained by extracting and processing the system operation characteristic data and the test process characteristic data. Among them, the test item coverage refers to the percentage of the number of items actually tested to the total number of items that should be tested in the test BOM, the functional test integrity ratio refers to the ratio of items specifically tested for all functions of the product to the total number of test items, and the boundary condition test coverage refers to the percentage of the number of items tested under various boundary conditions (such as maximum / minimum input values, extreme working environments, etc.) to the total number of items that should be tested under boundary conditions. Then, the above data are processed to obtain the test integrity index; The calculation formula of the test integrity index is: ; in, To test the integrity index, , , They are test item coverage data, functional test completeness ratio data, and boundary condition test coverage data. , It is the preset characteristic coefficient (the characteristic coefficient is obtained by querying the preset automated production test database).

[0028] Please refer to Figure 4 , Figure 4 The flowchart of obtaining the test stability index of the automated production test method based on the test BOM in some embodiments of the present application. According to the embodiment of the present invention, the test result record data and the equipment operation characteristic data are processed to obtain the test stability index, including: S41, extracting and processing the test result record data to obtain the deviation rate extreme value data of the repeated test results; S42, extracting and processing the equipment operation characteristic data to obtain equipment failure rate data; S43, processing the deviation rate extreme value data of the repeated test results in combination with the equipment failure rate data to obtain a test stability index.

[0029] It should be noted that the test result record data is extracted and processed to obtain the repeated test result deviation rate extreme value data, where the repeated test result deviation rate refers to the deviation rate between each test result and the average test result when the same product is tested multiple times. The equipment operation characteristic data is extracted and processed to obtain the equipment failure rate data, where the equipment failure rate refers to the number of times the test equipment fails within a certain period of time (such as a quarter or a year). Finally, the repeated test result deviation rate extreme value data is combined with the equipment failure rate data to obtain the test stability index. Wherein, the calculation formula of the test stability index is: ; in, To test the stability index, To repeat the test result deviation rate extreme value data, is the equipment failure rate data, , It is the preset characteristic coefficient (the characteristic coefficient is obtained by querying the preset automated production test database).

[0030] According to an embodiment of the present invention, the processing according to the system operation characteristic data to obtain the test efficiency index includes: Extract and process the system operation characteristic data to obtain average test cycle data, throughput data, resource utilization data, and test process parallelism data; The test efficiency index is obtained by processing the average test cycle data, throughput data, resource utilization data and test process parallelism data.

[0031] It should be noted that the average test cycle, throughput, resource utilization and test process parallelism data are obtained by extracting and processing the system operation characteristic data, where the test cycle refers to the time required to complete all test items of a single product, the average test cycle is the average of all test cycles, throughput refers to the number of products tested per unit time, resource utilization includes the utilization of hardware resources (such as test equipment, computers, etc.) and software resources (such as memory and CPU occupied by test software), and test process parallelism refers to the ratio of the number of test items or test steps that can be performed simultaneously to the total number of test items or steps in the automated testing process. Then, the test efficiency index is obtained by processing the above data; The calculation formula of the test efficiency index is: ; in, is the test efficiency index, , , , They are average test cycle data, throughput data, resource utilization data, and test process parallelism data. , , , , It is the preset characteristic coefficient (the characteristic coefficient is obtained by querying the preset automated production test database).

[0032] According to an embodiment of the present invention, the test accuracy index, the test integrity index and the test stability index are processed in combination with the test efficiency index to obtain a test reliability index, and corresponding adjustment and optimization measures are taken, including: According to the test accuracy index, the test integrity index and the test stability index, combined with the test efficiency index, a test reliability index is obtained; Comparing the test reliability index with a preset test reliability threshold to obtain a threshold comparison result; Judging whether the reliability of the automated production test of the production test system meets the production requirements according to the threshold comparison result; If the threshold comparison result is less than the preset threshold, the automated production test reliability of the production test system does not meet the requirements, and corresponding adjustment and optimization measures need to be taken for the production test system.

[0033] It should be noted that the test accuracy index, the test integrity index and the test stability index are processed in combination with the test efficiency index to obtain the test reliability index, which is then compared with the preset test reliability threshold to obtain the threshold comparison result. According to the threshold comparison result, it is judged whether the automated production test reliability of the production test system meets the production requirements. If the threshold comparison result is less than the preset threshold, the automated production test reliability of the production test system does not meet the requirements, and corresponding adjustments and optimization measures need to be taken for the production test system. Wherein, the calculation formula of the test reliability index is: ; in, To test the reliability index, , , , They are test accuracy index, test integrity index, test stability index, and test efficiency index. , , , It is the preset characteristic coefficient (the characteristic coefficient is obtained by querying the preset automated production test database).

[0034] In a second aspect, the present invention further discloses an automated production test system based on a test BOM, comprising a memory and a processor, wherein the memory comprises an automated production test method program based on the test BOM, and when the automated production test method program based on the test BOM is executed by the processor, the following steps are implemented: Obtain a test BOM according to production test requirements, and generate a production test system based on the test BOM; Collecting operation monitoring information of the production test system within a preset time period, and extracting test record data, including system operation characteristic data, test process characteristic data, test result record data, and equipment operation characteristic data; Processing the test process characteristic data and the test result record data to obtain a test accuracy index; Processing the system operation characteristic data and the test process characteristic data to obtain a test integrity index; Processing the test result record data and the equipment operation characteristic data to obtain a test stability index; Processing the system operation characteristic data to obtain a test efficiency index; The test accuracy index, the test integrity index and the test stability index are processed in combination with the test efficiency index to obtain a test reliability index, and corresponding adjustment and optimization measures are taken.

[0035] It should be noted that in the automated production process, the quality and reliability of the product are of vital importance. The test BOM (Bill of Materials) is a key document used to guide the testing process. In the manufacturing industry, the product BOM is important information shared by all links to guide product production. However, traditional test BOMs often lack systematicity and accuracy, and it is difficult to effectively evaluate the reliability of automated production testing. For example, in a complex production environment, the test BOM may not be able to reflect the actual production situation of the product in a timely manner, resulting in inaccurate test results and affecting product quality. Therefore, it is necessary to seek an automated production testing method based on the test BOM to solve the above problems. In this embodiment, the test BOM is first obtained according to the production test requirements, and a production test system is generated based on the test BOM, and the operation monitoring information of the production test system within a preset time period is collected. And extract test record data, including system operation characteristic data, test process characteristic data, test result record data and equipment operation characteristic data, process the test process characteristic data and the test result record data to obtain the test accuracy index, process the system operation characteristic data and the test process characteristic data to obtain the test integrity index, process the test result record data and the equipment operation characteristic data to obtain the test stability index, process the system operation characteristic data to obtain the test efficiency index, process the test accuracy index, the test integrity index and the test stability index in combination with the test efficiency index to obtain the test reliability index, and take corresponding adjustment and optimization measures to realize the technology of automated production testing based on test BOM.

[0036] According to an embodiment of the present invention, the processing according to the test process characteristic data and the test result record data to obtain the test accuracy index includes: Extract and process the test process characteristic data and the test result record data to obtain test data deviation rate data, qualified judgment accuracy rate data, repeated test consistency rate data and test data distribution compliance data; The test data deviation rate data, the qualified judgment accuracy rate data, the repeated test consistency rate data and the test data distribution conformity data are processed to obtain a test accuracy index.

[0037] It should be noted that the test data deviation rate, qualified judgment accuracy rate, repeated test consistency rate and test data distribution conformity data are obtained by extracting and processing the test process characteristic data and the test result record data. Among them, the test data deviation rate refers to the degree of deviation between the actual test data and the standard test data (the data specified in the test BOM), the qualified judgment accuracy rate refers to the proportion of correctly judged qualified or unqualified products, the repeated test consistency rate refers to the proportion of consistent test results when the same product is tested repeatedly, and the test data distribution conformity means that when a batch of products is tested, the test data should conform to a certain distribution law (such as normal distribution). Statistical methods (such as chi-square test) can be used to test the distribution of actual test data and the theoretical distribution (based on product quality standards and test BOM expectations). Then, the above data are processed to obtain the test accuracy index; The calculation formula of the test accuracy index is: ; in, To test the accuracy index, , , , They are test data deviation rate data, qualified judgment accuracy data, repeated test consistency rate data, and test data distribution conformity data. , , , It is the preset characteristic coefficient (the characteristic coefficient is obtained by querying the preset automated production test database).

[0038] According to an embodiment of the present invention, the processing according to the system operation characteristic data and the test process characteristic data to obtain the test integrity index includes: Extract and process the system operation characteristic data and the test process characteristic data to obtain test item coverage data, functional test integrity ratio data and boundary condition test coverage data; The test item coverage data, the functional test integrity ratio data and the boundary condition test coverage data are processed to obtain a test integrity index.

[0039] It should be noted that the test item coverage, functional test integrity ratio and boundary condition test coverage data are obtained by extracting and processing the system operation characteristic data and the test process characteristic data. Among them, the test item coverage refers to the percentage of the number of items actually tested to the total number of items that should be tested in the test BOM, the functional test integrity ratio refers to the ratio of items specifically tested for all functions of the product to the total number of test items, and the boundary condition test coverage refers to the percentage of the number of items tested under various boundary conditions (such as maximum / minimum input values, extreme working environments, etc.) to the total number of items that should be tested under boundary conditions. Then, the above data are processed to obtain the test integrity index; The calculation formula of the test integrity index is: ; in, To test the integrity index, , , They are test item coverage data, functional test completeness ratio data, and boundary condition test coverage data. , It is the preset characteristic coefficient (the characteristic coefficient is obtained by querying the preset automated production test database).

[0040] According to an embodiment of the present invention, the processing of the test result record data and the equipment operation characteristic data to obtain the test stability index includes: Extract and process the test result record data to obtain the deviation rate extreme value data of repeated test results; Extract and process the equipment operation characteristic data to obtain equipment failure rate data; The test stability index is obtained by processing the deviation rate extreme value data of the repeated test results in combination with the equipment failure rate data.

[0041] It should be noted that the test result record data is extracted and processed to obtain the repeated test result deviation rate extreme value data, where the repeated test result deviation rate refers to the deviation rate between each test result and the average test result when the same product is tested multiple times. The equipment operation characteristic data is extracted and processed to obtain the equipment failure rate data, where the equipment failure rate refers to the number of times the test equipment fails within a certain period of time (such as a quarter or a year). Finally, the repeated test result deviation rate extreme value data is combined with the equipment failure rate data to obtain the test stability index. Wherein, the calculation formula of the test stability index is: ; in, To test the stability index, To repeat the test result deviation rate extreme value data, is the equipment failure rate data, , It is the preset characteristic coefficient (the characteristic coefficient is obtained by querying the preset automated production test database).

[0042] According to an embodiment of the present invention, the processing according to the system operation characteristic data to obtain the test efficiency index includes: Extract and process the system operation characteristic data to obtain average test cycle data, throughput data, resource utilization data, and test process parallelism data; The test efficiency index is obtained by processing the average test cycle data, throughput data, resource utilization data and test process parallelism data.

[0043] It should be noted that the average test cycle, throughput, resource utilization and test process parallelism data are obtained by extracting and processing the system operation characteristic data, where the test cycle refers to the time required to complete all test items of a single product, the average test cycle is the average of all test cycles, throughput refers to the number of products tested per unit time, resource utilization includes the utilization of hardware resources (such as test equipment, computers, etc.) and software resources (such as memory and CPU occupied by test software), and test process parallelism refers to the ratio of the number of test items or test steps that can be performed simultaneously to the total number of test items or steps in the automated testing process. Then, the test efficiency index is obtained by processing the above data; The calculation formula of the test efficiency index is: ; in, is the test efficiency index, , , , They are average test cycle data, throughput data, resource utilization data, and test process parallelism data. , , , , It is the preset characteristic coefficient (the characteristic coefficient is obtained by querying the preset automated production test database).

[0044] According to an embodiment of the present invention, the test accuracy index, the test integrity index and the test stability index are processed in combination with the test efficiency index to obtain a test reliability index, and corresponding adjustment and optimization measures are taken, including: According to the test accuracy index, the test integrity index and the test stability index, combined with the test efficiency index, a test reliability index is obtained; Comparing the test reliability index with a preset test reliability threshold to obtain a threshold comparison result; Judging whether the reliability of the automated production test of the production test system meets the production requirements according to the threshold comparison result; If the threshold comparison result is less than the preset threshold, the automated production test reliability of the production test system does not meet the requirements, and corresponding adjustment and optimization measures need to be taken for the production test system.

[0045] It should be noted that the test accuracy index, the test integrity index and the test stability index are processed in combination with the test efficiency index to obtain the test reliability index, which is then compared with the preset test reliability threshold to obtain the threshold comparison result. According to the threshold comparison result, it is judged whether the automated production test reliability of the production test system meets the production requirements. If the threshold comparison result is less than the preset threshold, the automated production test reliability of the production test system does not meet the requirements, and corresponding adjustments and optimization measures need to be taken for the production test system. Wherein, the calculation formula of the test reliability index is: ; in, To test the reliability index, , , , They are test accuracy index, test integrity index, test stability index, and test efficiency index. , , , It is the preset characteristic coefficient (the characteristic coefficient is obtained by querying the preset automated production test database).

[0046] A third aspect of the present invention provides a readable storage medium, which stores an automated production test method program based on a test BOM. When the automated production test method program based on a test BOM is executed by a processor, the steps of the automated production test method based on a test BOM as described in any one of the above items are implemented.

[0047] The present invention discloses an automated production test method, system and medium based on a test BOM. The test BOM is obtained according to production test requirements, and a production test system is generated based on the test BOM. Operation monitoring information of the production test system within a preset time period is collected, and test record data, including system operation characteristic data, test process characteristic data, test result record data and equipment operation characteristic data, is processed according to the test process characteristic data and the test result record data to obtain a test accuracy index, is processed according to the system operation characteristic data and the test process characteristic data to obtain a test integrity index, is processed according to the test result record data and the equipment operation characteristic data to obtain a test stability index, is processed according to the system operation characteristic data to obtain a test efficiency index, is processed according to the test accuracy index, the test integrity index and the test stability index, and is processed in combination with the test efficiency index to obtain a test reliability index, and corresponding adjustment and optimization measures are taken, thereby realizing the technology of automated production testing based on a test BOM.

[0048] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms.

[0049] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; they may be located in one place or distributed on multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0050] In addition, all functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may be separately used as a unit, or two or more units may be integrated into one unit; the above-mentioned integrated units may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0051] Those skilled in the art can understand that: all or part of the steps of implementing the above method embodiments can be completed by hardware related to program instructions, the aforementioned program can be stored in a readable storage medium, and when the program is executed, it executes the steps of the above method embodiments; and the aforementioned storage medium includes: mobile storage devices, read-only memories (ROM, Read-Only Memory), random access memories (RAM, Random Access Memory), disks or optical disks, and other media that can store program codes.

[0052] Alternatively, if the above-mentioned integrated unit of the present invention is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present invention can be essentially or partly reflected in the form of a software product that contributes to the prior art. The software product is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the methods described in each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROM, RAM, magnetic disks or optical disks.

Claims

1. The automated production test method based on the test BOM is characterized by: The following steps are involved: Obtain a test BOM according to production test requirements, and generate a production test system based on the test BOM; Collecting operation monitoring information of the production test system within a preset time period, and extracting test record data, including system operation characteristic data, test process characteristic data, test result record data, and equipment operation characteristic data; Processing the test process characteristic data and the test result record data to obtain a test accuracy index; Processing the system operation characteristic data and the test process characteristic data to obtain a test integrity index; Processing the test result record data and the equipment operation characteristic data to obtain a test stability index; Processing the system operation characteristic data to obtain a test efficiency index; The test accuracy index, the test integrity index and the test stability index are processed in combination with the test efficiency index to obtain a test reliability index, and corresponding adjustment and optimization measures are taken.

2. The automated production test method based on test BOM according to claim 1, characterized in that: The processing according to the test process characteristic data and the test result record data to obtain the test accuracy index includes: Extract and process the test process characteristic data and the test result record data to obtain test data deviation rate data, qualified judgment accuracy rate data, repeated test consistency rate data and test data distribution compliance data; The test data deviation rate data, the qualified judgment accuracy rate data, the repeated test consistency rate data and the test data distribution conformity data are processed to obtain a test accuracy index.

3. The automated production test method based on test BOM according to claim 2, characterized in that: The processing according to the system operation characteristic data and the test process characteristic data to obtain the test integrity index includes: Extract and process the system operation characteristic data and the test process characteristic data to obtain test item coverage data, functional test integrity ratio data and boundary condition test coverage data; The test item coverage data, the functional test integrity ratio data and the boundary condition test coverage data are processed to obtain a test integrity index.

4. The automated production test method based on test BOM according to claim 3, characterized in that: The processing of the test result record data and the equipment operation characteristic data to obtain the test stability index includes: Extract and process the test result record data to obtain the deviation rate extreme value data of repeated test results; Extract and process the equipment operation characteristic data to obtain equipment failure rate data; The test stability index is obtained by processing the deviation rate extreme value data of the repeated test results in combination with the equipment failure rate data.

5. The automated production test method based on test BOM according to claim 4, characterized in that: The processing according to the system operation characteristic data to obtain the test efficiency index includes: Extract and process the system operation characteristic data to obtain average test cycle data, throughput data, resource utilization data, and test process parallelism data; The test efficiency index is obtained by processing the average test cycle data, throughput data, resource utilization data and test process parallelism data.

6. The automated production test method based on test BOM according to claim 5, characterized in that: The test accuracy index, the test integrity index and the test stability index are processed in combination with the test efficiency index to obtain a test reliability index, and corresponding adjustment and optimization measures are taken, including: According to the test accuracy index, the test integrity index and the test stability index, combined with the test efficiency index, a test reliability index is obtained; Comparing the test reliability index with a preset test reliability threshold to obtain a threshold comparison result; Judging whether the reliability of the automated production test of the production test system meets the production requirements according to the threshold comparison result; If the threshold comparison result is less than the preset threshold, the automated production test reliability of the production test system does not meet the requirements, and corresponding adjustment and optimization measures need to be taken for the production test system.

7. The automated production test system based on the test BOM is characterized by: The system includes: a memory and a processor, wherein the memory includes a program of an automated production test method based on a test BOM, and when the program of the automated production test method based on a test BOM is executed by the processor, the following steps are implemented: Obtain a test BOM according to production test requirements, and generate a production test system based on the test BOM; Collecting operation monitoring information of the production test system within a preset time period, and extracting test record data, including system operation characteristic data, test process characteristic data, test result record data, and equipment operation characteristic data; Processing the test process characteristic data and the test result record data to obtain a test accuracy index; Processing the system operation characteristic data and the test process characteristic data to obtain a test integrity index; Processing the test result record data and the equipment operation characteristic data to obtain a test stability index; Processing the system operation characteristic data to obtain a test efficiency index; The test accuracy index, the test integrity index and the test stability index are processed in combination with the test efficiency index to obtain a test reliability index, and corresponding adjustment and optimization measures are taken.

8. The automated production test system based on test BOM according to claim 7, characterized in that: The processing according to the test process characteristic data and the test result record data to obtain the test accuracy index includes: Extract and process the test process characteristic data and the test result record data to obtain test data deviation rate data, qualified judgment accuracy rate data, repeated test consistency rate data and test data distribution compliance data; The test data deviation rate data, the qualified judgment accuracy rate data, the repeated test consistency rate data and the test data distribution conformity data are processed to obtain a test accuracy index.

9. The automated production test system based on test BOM according to claim 8, characterized in that: The processing according to the system operation characteristic data and the test process characteristic data to obtain the test integrity index includes: Extract and process the system operation characteristic data and the test process characteristic data to obtain test item coverage data, functional test integrity ratio data and boundary condition test coverage data; The test item coverage data, the functional test integrity ratio data and the boundary condition test coverage data are processed to obtain a test integrity index.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes an automated production test method program based on a test BOM. When the automated production test method program based on a test BOM is executed by a processor, the steps of the automated production test method based on a test BOM as described in any one of claims 1 to 6 are implemented.

Citation Information

Patent Citations

  • Processing method for automated production test server and related device

    CN109144804A

  • Automatic test method and device, computer device and storage medium

    CN109857647A

  • Automatic test effect evaluation method

    CN117033226A

  • Laboratory management method and device, computer equipment and storage medium

    CN118822433A

  • Method and system for constructing software test management framework and measurement system

    CN119201754A