System and method for automatically collecting logs, analyzing reasons and judging defects

Through automatic log collection and intelligent analysis system, manual log analysis problems in software testing are solved, automatic defect determination and real-time submission are realized, testing efficiency and accuracy are improved, and defect management process is simplified.

CN119025370APending Publication Date: 2024-11-26HAIER CONSUMER FINANCE CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410938074.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-12
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

In software testing, testers need to manually collect and analyze a large amount of log information to locate problems, resulting in high time consumption, easy to miss key information, lack of real-time and intelligent analysis, and complex defect management.

Method used

Design a system for automatic log collection, cause analysis and defect determination, including log collection module, analysis module, defect determination module and automatic submission module. Through real-time monitoring and automated testing, key information is extracted, machine learning is used to identify failure modes, and automatically submit it. Defect to defect management tools.

Benefits of technology

It improves testing efficiency, reduces manual intervention, realizes intelligent analysis and real-time, improves the accuracy of testing and problem positioning efficiency, and simplifies defect management.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119025370A_ABST
    Figure CN119025370A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of software testing, and provides an automatic log acquisition, reason analysis and defect judgment system, which comprises a log acquisition module for monitoring the execution process of an automatic test framework in real time and triggering log acquisition when detecting that the execution of a test case fails; the log analysis module is used for analyzing the collected logs, extracting key information and carrying out intelligent analysis; the defect judgment module is used for automatically judging whether the test case has defects or not according to a preset defect judgment rule; the defect automatic submitting module is used for automatically submitting the test cases which are judged to be defective to a defect management tool; and the log recording and storing module is used for recording the test execution process and log information in real time and performing secure storage. According to the technical scheme, the problem that a large amount of time and energy are often consumed due to the fact that a tester needs to check failed test cases one by one and manually collects and analyzes corresponding log information in the prior art is solved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of software testing, and in particular to a system and method for automatic log collection, cause analysis and defect determination. Background Art

[0002] In the field of software testing, automated testing has become an important means to improve testing efficiency and accuracy. However, during the execution of automated testing, test case execution failures are inevitable. At this time, testers are usually required to manually intervene to collect and analyze relevant execution logs and logs of the server under test to locate the cause of the problem. This traditional approach has the following shortcomings:

[0003] Testers need to check failed test cases one by one and manually collect and analyze the corresponding log information, which often takes a lot of time and effort.

[0004] Easy to miss key information: Since log information is usually large and complex, testers are prone to miss key information during manual analysis, resulting in inaccurate problem location.

[0005] Lack of real-time performance: Testers usually need to start analyzing logs after the test is completed, which leads to delayed problem discovery and is not conducive to timely repair of defects.

[0006] Lack of intelligent analysis: Traditional log analysis methods mainly rely on the experience and intuition of testers, lack intelligent analysis methods, and it is difficult to accurately determine the cause of failure.

[0007] Defect management is cumbersome: When testers determine that a failed case is a defect, they need to manually fill out a defect report and submit it to the defect management tool, which increases the complexity and workload of defect management. Summary of the invention

[0008] The present invention proposes an automatic log collection, cause analysis and defect determination system, which solves the problem in related technologies that testers need to check failed test cases one by one and manually collect and analyze corresponding log information, which often takes a lot of time and effort.

[0009] The technical solution of the present invention is as follows:

[0010] A system for automatic log collection, cause analysis and defect determination, comprising:

[0011] The log collection module is used to monitor the execution process of the automated testing framework in real time and trigger log collection when a test case execution failure is detected;

[0012] Log analysis module, used to parse the collected logs, extract key information, and perform intelligent analysis;

[0013] A defect determination module is used to automatically determine whether a test case has defects according to preset defect determination rules;

[0014] The defect automatic submission module is used to automatically submit test cases that are determined to be defects to the defect management tool;

[0015] The logging and storage module is used to record the test execution process and log information in real time and store them securely.

[0016] Preferably, the log collection module further comprises the following steps:

[0017] A1. Collect information on test steps, input data, output results, and assertion results;

[0018] A2. Remotely collect system logs, application logs and database logs on the server under test through SSH, FTP and RSYNC protocols.

[0019] Preferably, the log analysis module comprises the following steps:

[0020] B1. Extract error code, exception type and stack trace information from log text;

[0021] B2. Extract information from log content that is more descriptive;

[0022] B3. Train and identify common failure modes and abnormal modes.

[0023] Preferably, the defect determination module comprises the following steps:

[0024] C1. Clarify the definition and classification standards of defects and formulate corresponding judgment basis;

[0025] C2. Match the results of log analysis with defect determination rules to automatically determine whether there are defects in the test case.

[0026] Preferably, the defect automatic submission module includes the following steps:

[0027] D1. Integrate detailed information of defects, including test case name, failure description, defect category, severity and related log links;

[0028] D2. Convert the integrated defect information into a specified data format and generate a corresponding data structure;

[0029] D3. Connect with the defect management tool through API and send defect information to the API interface of the defect management tool through HTTP request.

[0030] Preferably, the log recording and storage module comprises the following steps:

[0031] E1. Record the execution process of automated testing, including the execution order, execution time and execution results of test cases;

[0032] E2. Archive the collected logs in chronological order;

[0033] E3. Store log information in a secure and reliable storage medium and use encryption technology to ensure data security and integrity.

[0034] Preferably, in said B1, the algorithm for detecting anomalies is: Where n is the number of features, w i is the weight of the i-th feature, f i (log) is the function of the i-th feature calculated based on the log, and A is used to evaluate the abnormality of the log.

[0035] Preferably, in step B3, the model training algorithm is:

[0036] Where L is the loss function, m is the number of training samples, and y j is the true label of the jth sample, usually taking the value of 0 or 1. is the probability that the model predicts that the jth sample is class 1, log is the natural logarithm, λ is the coefficient of the regularization term, which is used to control the strength of regularization, ||θ|| 2 It is the L-norm of the model parameter θ, which represents the square root of the sum of the squares of the parameters and is used to prevent the model from overfitting.

[0037] Preferably, in step C1, the algorithm of defect determination logistic regression is: Among them, F is the feature vector extracted from the log, θ is the weight vector, β is the bias term, and P is the probability that the test case is a defect given the feature set.

[0038] A method for automatic log collection, cause analysis and defect determination, using any of the automatic log collection, cause analysis and defect determination systems described above, comprising the following steps:

[0039] S1. Real-time monitoring and collection of logs during the automated testing process through the log collection module;

[0040] S2. Parse and analyze the collected logs through the log analysis module;

[0041] S3, automatically determine defects according to the analysis results through the defect determination module;

[0042] S4. Submit the test cases determined to be defects to the defect management tool through the defect automatic submission module;

[0043] S5. Record and store log information through a log recording and storage module.

[0044] The working principle and beneficial effects of the present invention are:

[0045] The present invention proposes a system and method for automatic log collection, cause analysis and defect determination. The system can automatically collect the execution logs of the use cases that failed to run and the logs of the tested server during the execution of the automated test, and analyze the collected log information after the test is completed, and give the failure reasons for the use cases that failed to run. If it is determined to be a defect, it is automatically submitted to the defect management tool. This can not only improve the test efficiency and reduce the need for manual intervention, but also realize intelligent log analysis and defect management, and improve the accuracy and real-time performance of the test. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] The preferred implementation modes will be described below in a clear and understandable manner with reference to the accompanying drawings to further illustrate the above-mentioned characteristics, technical features, advantages and implementation methods of the present invention.

[0047] Figure 1 It is a structural schematic diagram of the present invention;

[0048] Figure 2 It is a schematic diagram of the process of the present invention. DETAILED DESCRIPTION

[0049] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the specific implementation methods of the present invention will be described below with reference to the accompanying drawings. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings and other implementation methods can be obtained based on these drawings without creative work.

[0050] In order to simplify the drawings, only the parts related to the invention are schematically shown in each figure, and they do not represent the actual structure of the product. In addition, in order to simplify the drawings and facilitate understanding, in some figures, only one of the parts with the same structure or function is schematically shown, or only one of them is marked. In this article, "one" not only means "only one", but also means "more than one", and "several" includes "two" and "more than two".

[0051] In this document, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0052] In addition, in the description of the present application, the terms "first", "second", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance.

[0053] Reference Figure 1-Figure 2 , is an embodiment of the present invention, and proposes

[0054] A system for automatic log collection, cause analysis and defect determination, comprising:

[0055] The log collection module is used to monitor the execution process of the automated testing framework in real time and trigger log collection when a test case execution failure is detected;

[0056] Log analysis module, used to parse the collected logs, extract key information, and perform intelligent analysis;

[0057] A defect determination module is used to automatically determine whether a test case has defects according to preset defect determination rules;

[0058] The defect automatic submission module is used to automatically submit test cases that are determined to be defects to the defect management tool;

[0059] The logging and storage module is used to record the test execution process and log information in real time and store them securely.

[0060] Preferably, the log collection module further comprises the following steps:

[0061] A1. Collect information on test steps, input data, output results, and assertion results;

[0062] A2. Remotely collect system logs, application logs and database logs on the server under test through SSH, FTP and RSYNC protocols.

[0063] Preferably, the log analysis module comprises the following steps:

[0064] B1. Extract error code, exception type and stack trace information from log text;

[0065] B2. Extract information from log content that is more descriptive;

[0066] B3. Train and identify common failure modes and abnormal modes.

[0067] Preferably, the defect determination module comprises the following steps:

[0068] C1. Clarify the definition and classification standards of defects and formulate corresponding judgment basis;

[0069] C2. Match the results of log analysis with defect determination rules to automatically determine whether there are defects in the test case.

[0070] Preferably, the defect automatic submission module includes the following steps:

[0071] D1. Integrate detailed information of defects, including test case name, failure description, defect category, severity and related log links;

[0072] D2. Convert the integrated defect information into a specified data format and generate a corresponding data structure;

[0073] D3. Connect with the defect management tool through API and send defect information to the API interface of the defect management tool through HTTP request.

[0074] Preferably, the log recording and storage module comprises the following steps:

[0075] E1. Record the execution process of automated testing, including the execution order, execution time and execution results of test cases;

[0076] E2. Archive the collected logs in chronological order;

[0077] E3. Store log information in a secure and reliable storage medium and use encryption technology to ensure data security and integrity.

[0078] Preferably, in said B1, the algorithm for detecting anomalies is: Where n is the number of features, w i is the weight of the i-th feature, f i (log) is the function of the i-th feature calculated based on the log, and A is used to evaluate the abnormality of the log.

[0079] Preferably, in step B3, the model training algorithm is:

[0080] Where L is the loss function, m is the number of training samples, and y j is the true label of the jth sample, usually taking the value of 0 or 1. is the probability that the model predicts that the jth sample is class 1, log is the natural logarithm, λ is the coefficient of the regularization term, which is used to control the strength of regularization, ||θ|| 2 It is the L-norm of the model parameter θ, which represents the square root of the sum of the squares of the parameters and is used to prevent the model from overfitting.

[0081] Preferably, in step C1, the algorithm of defect determination logistic regression is: Among them, F is the feature vector extracted from the log, θ is the weight vector, β is the bias term, and P is the probability that the test case is a defect given the feature set.

[0082] A method for automatic log collection, cause analysis and defect determination, using any of the automatic log collection, cause analysis and defect determination systems described above, comprising the following steps:

[0083] S1. Real-time monitoring and collection of logs during the automated testing process through the log collection module;

[0084] S2. Parse and analyze the collected logs through the log analysis module;

[0085] S3, automatically determine defects according to the analysis results through the defect determination module;

[0086] S4. Submit the test cases determined to be defects to the defect management tool through the defect automatic submission module;

[0087] S5. Record and store log information through a log recording and storage module.

[0088] (I) Automatic log collection module

[0089] 1. Real-time monitoring

[0090] Test framework integration: deeply integrate the log collection module into the automated test framework (such as Selenium, Appium, JUnit, etc.), and capture every key event in the test execution process through the hook function or event monitoring mechanism provided by the framework.

[0091] Failure event detection: When a test case execution failure is detected (such as assertion failure, exception throwing, etc.), the log collection module is immediately triggered and the log collection process is started.

[0092] 2. Comprehensive collection

[0093] Test execution log: Use the log capture tool or framework’s log interface to collect detailed logs during the test execution process, including test steps, input data, output results, assertion results, etc.

[0094] Server logs: Remotely collect system logs, application logs, database logs, etc. on the server under test through SSH, FTP, RSYNC and other protocols.

[0095] 3. Unified log format

[0096] Timestamp standardization: Ensure that all collected logs use a unified UTC timestamp format and are accurate to milliseconds to facilitate cross-system and cross-time zone log comparison and analysis.

[0097] Log field standardization: Develop a set of common log field standards, such as timestamp, log_level, source, message, etc., to convert non-standardized log text into structured data.

[0098] (II) Log Analysis Module

[0099] 1. Log analysis

[0100] Analyze the logs through the log analysis module. Regular expression parsing: Write a series of regular expressions to extract key information from the log text, such as error codes, exception types, stack traces, etc.

[0101] NLP analysis: For log content with strong descriptiveness, natural language processing (NLP) technologies such as text segmentation, part-of-speech tagging, and named entity recognition are used to extract key information.

[0102] 2. Log filtering

[0103] Custom filtering rules: Allow users to customize log filtering rules, such as keyword filtering, log level filtering, time range filtering, etc., to remove information that is not related to test failures.

[0104] Desensitizing sensitive information: Write desensitizing rules to desensitize sensitive information in logs, such as replacing sensitive fields such as usernames, passwords, and credit card numbers with placeholders or hash values.

[0105] 3. Intelligent analysis

[0106] Machine learning model training: Use historical test data and log data to train machine learning models, such as decision trees, random forests, neural networks, etc., to identify common failure modes and abnormal patterns.

[0107] Contextual correlation analysis: Combine the execution context of the test case (such as test environment, test data, test steps, etc.) and the server log, and use the correlation analysis algorithm to find out the specific cause of the test failure.

[0108] (III) Defect determination module

[0109] 1. Rule setting

[0110] Defect definition: Clarify the definition and classification standards of defects in the project, such as functional defects, performance defects, safety defects, etc., and formulate corresponding judgment basis.

[0111] Rule formulation: Based on the defect definition, formulate a set of detailed defect determination rules, including keyword matching rules, anomaly number threshold rules, performance indicator threshold rules, etc.

[0112] 2. Automatic determination

[0113] Rule matching: Match the results of log analysis with defect determination rules to automatically determine whether there are defects in the test case.

[0114] Manual confirmation: For test cases that are automatically determined to be defects, manual confirmation and verification are performed to ensure the accuracy of the determination. Manual confirmation can be performed through email notifications, work order systems, etc.

[0115] (IV) Defect automatic submission module

[0116] 1. Information Integration

[0117] Defect details integration: Integrate detailed information of defects, including test case name, failure description, defect category, severity, related log links, screenshots, etc.

[0118] Format conversion: According to the requirements of the defect management tool, the integrated defect information is converted into the specified data format (such as JSON, XML, etc.) and the corresponding data structure is generated.

[0119] 2. Automatic submission

[0120] API connection: Connect with defect management tools (such as JIRA, Bugzilla, TestRail, etc.) through API, and send defect information to the API interface of the defect management tool through HTTP request.

[0121] Status synchronization: The status changes of defects in the defect management tool, such as repair progress, verification results, etc., are synchronized in real time through the API interface, and displayed and updated in the system.

[0122] (V) Log Recording and Storage

[0123] 1. Real-time recording

[0124] Execution process record: Real-time record of the execution process of automated testing, including the execution order, execution time, execution results and other information of test cases, and store them in the database.

[0125] Log archiving: The collected logs are archived in chronological order to facilitate subsequent query and backtracking.

[0126] 2. Long-term storage

[0127] Secure storage: Store log information in secure and reliable storage media, such as encrypted databases, cloud storage, etc., to ensure data security and integrity.

[0128] Backup and recovery: Back up log data regularly and set up an automatic recovery mechanism to prevent data loss and damage.

[0129] The collection, analysis and determination of logs by the above system and method have the following effects:

[0130] 1. Real-time, comprehensive and adaptive automatic log collection technology:

[0131] It is deeply integrated into the automated testing framework to monitor the test execution process in real time and realize real-time log collection.

[0132] It can not only collect test execution logs, but also remotely collect system, application and database logs on the server to achieve comprehensive collection.

[0133] Adopt adaptive collection strategies to dynamically adjust the collection method according to test requirements and log types to improve collection efficiency and accuracy.

[0134] 2. Intelligent log analysis and filtering technology:

[0135] Combine regular expressions and NLP technology to achieve accurate parsing of logs and extraction of key information.

[0136] Allow users to customize filtering rules, flexibly filter logs, and remove irrelevant information.

[0137] Introduce machine learning models to perform intelligent analysis of logs and identify common failure modes and abnormal patterns.

[0138] 3. Log analysis technology based on context association:

[0139] Correlate the execution context of the test case with the server log to pinpoint the exact cause of the test failure.

[0140] Through the correlation analysis algorithm, cross-comparison and comprehensive analysis between logs can be achieved to improve the accuracy and efficiency of problem location.

[0141] 4. Automated defect determination and submission technology:

[0142] Formulate detailed defect determination rules and automatically determine whether a test case has defects through rule matching.

[0143] Integrate detailed information of defects and automatically submit them to defect management tools to achieve automated defect management.

[0144] Real-time synchronization with defect management tools is achieved through API docking to ensure the accuracy and timeliness of defect information.

[0145] 5. Efficient and secure logging and storage technology:

[0146] Record the execution process and log information of automated tests in real time to ensure data integrity and traceability.

[0147] Use safe and reliable storage media and encryption technology to ensure the security and confidentiality of log information.

[0148] Regularly back up and restore log data to prevent data loss and damage and ensure long-term data availability.

[0149] These innovations make the log management system of the present invention have significant advantages and competitiveness in the field of automated testing, and can provide users with more efficient, more accurate and more secure log management solutions.

[0150] 6. Real-time monitoring and comprehensive collection improve the integrity and timeliness of log data:

[0151] By deeply integrating into the automated testing framework, this patent enables real-time monitoring of the test execution process, ensuring that key events and log data can be captured and recorded in the first place. This real-time monitoring capability greatly improves the timeliness and accuracy of log data, helping to discover and solve problems in a timely manner.

[0152] At the same time, the comprehensive collection technology enables this patent to not only collect test execution logs, but also remotely collect various logs on the server. This comprehensive log data collection provides a rich data source for subsequent log analysis and problem location.

[0153] 7. Intelligent analysis and filtering improve the efficiency and accuracy of log processing:

[0154] This patent adopts a log parsing method that combines regular expressions and NLP technology, which can more accurately extract key information in logs and reduce the errors and time costs of manual analysis.

[0155] User-defined filtering rules further improve the flexibility of log analysis, allowing analysts to quickly filter out valuable information based on their needs.

[0156] The introduction of machine learning models for intelligent analysis can automatically identify common failure modes and abnormal modes, greatly improving the efficiency and accuracy of problem discovery.

[0157] 8. Contextual correlation analysis enables accurate problem location:

[0158] By correlating the execution context of the test case with the server log, this patent can more accurately identify the specific cause of the test failure. This precise problem location capability significantly shortens the troubleshooting time and improves the stability and reliability of the system.

[0159] 9. Automated defect determination and submission optimizes the defect management process:

[0160] This patent achieves automatic defect determination and rapid submission by formulating detailed defect determination rules and automated submission mechanisms. This not only reduces the workload of manual determination and submission, but also improves the efficiency and accuracy of defect management. At the same time, real-time synchronization with defect management tools also ensures timely update and sharing of defect information.

[0161] 10. Efficient and secure logging and storage ensure data security and availability:

[0162] This patent adopts efficient and secure logging and storage technology to ensure the security and long-term availability of log data. Encryption technology and reliable storage media selection effectively prevent the risk of data leakage and damage, while regular data backup and recovery mechanisms further ensure data integrity.

[0163] In summary, this patent significantly improves the efficiency, accuracy and security of log management through technical means such as real-time monitoring and comprehensive collection, intelligent analysis and filtering, contextual correlation analysis, automated defect determination and submission, and efficient and secure log recording and storage. These advantages make this patent have broad application prospects and practical value in the field of automated testing.

[0164] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical solutions of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical solutions of the present invention, which should all be included in the scope of the claims of the present invention.

Claims

1. A system for automatic log collection, cause analysis and defect determination, characterized in that: include: The log collection module is used to monitor the execution process of the automated testing framework in real time and trigger log collection when a test case execution failure is detected; Log analysis module, used to parse the collected logs, extract key information, and perform intelligent analysis; A defect determination module is used to automatically determine whether a test case has defects according to preset defect determination rules; The defect automatic submission module is used to automatically submit test cases that are determined to be defects to the defect management tool; The logging and storage module is used to record the test execution process and log information in real time and store them securely.

2. The system for automatic log collection, cause analysis and defect determination according to claim 1, characterized in that: The log collection module further includes the following steps: A1. Collect information on test steps, input data, output results, and assertion results; A2. Remotely collect system logs, application logs and database logs on the server under test through SSH, FTP and RSYNC protocols.

3. The automatic log collection, cause analysis and defect determination system according to claim 1 or 2, characterized in that: The log analysis module includes the following steps: B1. Extract error code, exception type and stack trace information from log text; B2. Extract information from log content that is more descriptive; B3. Train and identify common failure modes and abnormal modes.

4. The automatic log collection, cause analysis and defect determination system according to claim 1 is characterized in that: The defect determination module comprises the following steps: C1. Clarify the definition and classification standards of defects and formulate corresponding judgment basis; C2. Match the results of log analysis with defect determination rules to automatically determine whether there are defects in the test case.

5. The automatic log collection, cause analysis and defect determination system according to claim 1 is characterized in that: The automatic defect submission module includes the following steps: D1. Integrate detailed information of defects, including test case name, failure description, defect category, severity and related log links; D2. Convert the integrated defect information into a specified data format and generate a corresponding data structure; D3. Connect with the defect management tool through API and send defect information to the API interface of the defect management tool through HTTP request.

6. The system for automatic log collection, cause analysis and defect determination according to claim 1, characterized in that: The logging and storage module includes the following steps: E1. Record the execution process of automated testing, including the execution order, execution time and execution results of test cases; E2. Archive the collected logs in chronological order; E3. Store log information in a secure and reliable storage medium and use encryption technology to ensure data security and integrity.

7. The automatic log collection, cause analysis and defect determination system according to claim 3 is characterized in that: In the B1, the algorithm for detecting anomalies is: Where n is the number of features, w i is the weight of the i-th feature, f i (log) is the function of the i-th feature calculated based on the log, and A is used to evaluate the abnormality of the log.

8. The system for automatic log collection, cause analysis and defect determination according to claim 3, characterized in that: In step B3, the model training algorithm is: Where L is the loss function, m is the number of training samples, and y j is the true label of the jth sample, usually taking the value of 0 or 1. is the probability that the model predicts that the jth sample is class 1, log is the natural logarithm, λ is the coefficient of the regularization term, which is used to control the strength of regularization, ||θ|| 2 It is the L-norm of the model parameter θ, which represents the square root of the sum of the squares of the parameters and is used to prevent the model from overfitting.

9. The system for automatic log collection, cause analysis and defect determination according to claim 4, characterized in that: In step C1, the algorithm of defect determination logistic regression is: Among them, F is the feature vector extracted from the log, θ is the weight vector, β is the bias term, and P is the probability that the test case is a defect given the feature set.

10. A method for automatic log collection, cause analysis and defect determination, characterized in that: Using a log automatic collection, cause analysis and defect determination system as described in any one of claims 1 to 6, comprising the following steps: S1. Real-time monitoring and collection of logs during the automated testing process through the log collection module; S2. Parse and analyze the collected logs through the log analysis module; S3, automatically determine defects according to the analysis results through the defect determination module; S4. Submit the test cases determined to be defects to the defect management tool through the defect automatic submission module; S5. Record and store log information through a log recording and storage module.