Test result error type classification method, device, equipment and storage medium

Abstract

The present application provides a method, device, equipment and storage medium for classifying the error types of test results, which belongs to the field of program testing technology. The method includes: in response to the end of test execution, obtaining the test results, all preset keywords and all historical error information in the database, wherein the historical error information includes error keywords and error pictures, and the historical error information has a corresponding error type; determining the paragraph containing the preset field in the test result as the error segment; using the preset keyword contained in the error segment as the target keyword; taking a screenshot of the error segment to obtain the target error picture; according to the target keyword, target error picture, error keyword and error picture, determining the target historical error information that matches the test result in all historical error information; determining the error type corresponding to the target historical error information as the target error type of the test result. The method of the present application solves the problem of high time cost required to obtain the error type.

Description

Technical Field

[0001] The present application relates to the field of program testing technology, and in particular to a method, apparatus, device, and storage medium for classifying test result error types. Background Art

[0002] Currently, a large number of services can be implemented through the Internet. Before Internet services are launched, they need to be tested. After analyzing the test results, the service implementation method is adjusted to reduce service errors.

[0003] Currently, in the prior art, when a test result contains an error, a technician usually manually analyzes the test result to obtain the error type corresponding to the error.

[0004] However, the inventors have discovered that the prior art has at least the following technical problems: the time cost required for technicians to analyze the test results and determine the error type is relatively high. Summary of the Invention

[0005] The present application provides a method, apparatus, device and storage medium for classifying test result error types, so as to solve the problem that it takes a long time for technicians to obtain error types.

[0006] In the first aspect, the present application provides a method for classifying test result error types, including: in response to the end of test execution, obtaining test results, all preset keywords and all historical error information in a database, wherein the historical error information includes error keywords and error pictures, and the historical error information has corresponding error types; determining a paragraph containing a preset field in the test result as an error segment; using the preset keyword contained in the error segment as a target keyword; taking a screenshot of the error segment to obtain a target error picture; determining the target historical error information that matches the test result in all historical error information based on the target keyword, target error picture, error keyword and error picture; and determining the error type corresponding to the target historical error information as the target error type of the test result.

[0007] In one possible implementation, target historical error information that matches the test result is determined in all historical error information based on the target keyword, target error picture, error keyword and error picture, including: based on the overlap between the target keyword and the error keyword, at least one historical error information to be determined that matches the test result is determined in the historical error information; if the number of historical error information to be determined is one, the historical error information to be determined is determined as the target historical error information; if the number of historical error information to be determined is at least two, the target error picture is compared with the error pictures corresponding to each historical error information to be determined to obtain the corresponding picture repetition; based on the picture repetition, the target historical error information is determined in each historical error information to be determined.

[0008] In one possible implementation, target historical error information is determined from each historical error information to be determined based on the image repetition, including: determining the error image with the highest image repetition as the matching image; and determining the historical error information to be determined corresponding to the matching image as the target historical error information.

[0009] In one possible implementation, the historical error information also includes the number of errors corresponding to the error type; accordingly, based on the image repetition, the target historical error information is determined in each historical error information to be determined, including: all matching images whose image repetition exceeds a preset value and whose corresponding number of errors exceeds a preset number are determined as images to be reviewed; the images to be reviewed and the target error images are sent to the corresponding terminal device of the tester, and the target images to be reviewed sent by the terminal device are received; and the historical error information to be determined corresponding to the target images to be reviewed is determined as the target historical error information.

[0010] In a possible implementation, after determining the error type corresponding to the target historical error information as the target error type of the test result, the method further includes: increasing the number of error reports corresponding to the target error type by N times, where N is a preset positive integer.

[0011] In one possible implementation method, after sending the picture to be reviewed and the target error picture to the corresponding terminal device of the tester, it also includes: receiving the actual error type and actual error information sent by the terminal device; determining the actual error type as the target error type; jointly determining the actual error type, actual error information and target error picture as new historical error information, and storing the new historical error information in the database.

[0012] In one possible implementation, a screenshot of the error segment is taken to obtain a target error image, including: opening the test results to display the test result window, the test result window including a test result display area, a slider and a slide rail, the slider is used to move on the slide rail, and controls the display content of the result display area according to its position on the slide rail; obtaining the number of rows of the error segment in the test results, the total number of rows of the test results and the length of the slide rail; dividing the number of rows of the error segment in the test results by the total number of rows to obtain the position ratio; multiplying the position ratio by the length of the slide rail to obtain the target distance from the top of the slide rail; controlling the slider to move to a position at the target distance from the top so that the result display area displays the error segment; intercepting the test result display area to obtain the target error image.

[0013] In one possible implementation, before obtaining the test results, all preset keywords and all historical error information in the database, it also includes: sending the existing error information and existing error pictures obtained in advance to the terminal device corresponding to the tester; receiving the corresponding error type sent by the terminal device, where the corresponding error type is determined by the tester based on the existing error information and existing error pictures; jointly determining the existing error information, existing error pictures and corresponding error types as historical error information, and storing them in the database.

[0014] In the second aspect, the present application provides a test result error type classification device, including: an acquisition module, used to obtain test results, all preset keywords and all historical error information in a database in response to the end of test execution, wherein the historical error information includes error keywords and error pictures, and the historical error information has corresponding error types; an error segment determination module, used to determine the paragraph containing preset fields in the test result as an error segment; a keyword determination module, used to use the preset keywords contained in the error segment as target keywords; an image acquisition module, used to take a screenshot of the error segment to obtain a target error picture; a target information determination module, used to determine the target historical error information that matches the test result in all historical error information based on the target keyword, target error picture, error keyword and error picture; a type determination module, used to determine the error type corresponding to the target historical error information as the target error type of the test result.

[0015] In a third aspect, the present application provides an electronic device comprising: a processor, and a memory communicatively connected to the processor; the memory stores computer-executable instructions; the processor executes the computer-executable instructions stored in the memory, so that the processor executes the test result error type classification method described in the first aspect.

[0016] In a fourth aspect, the present application provides a computer-readable storage medium, in which computer-executable instructions are stored. When the computer-executable instructions are executed by a processor, they are used to implement the test result error type classification method described in the first aspect.

[0017] The test result error type classification method, device, equipment and storage medium provided in the present application obtain test results, and determine the paragraph containing preset fields in the test results as an error segment, use the preset keywords contained in the error segment as target keywords, intercept the target error image of the error segment, combine the target keywords, target error images, error keywords in the database and error images in the database, determine the target historical error information that matches the test results in all historical error information, and determine the error type corresponding to the target test result as the target error type of the test result, so as to obtain the error type corresponding to the test result by comparing the test results with the historical error information, thereby reducing the time for manual determination of the error type. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0019] Figure 1 A schematic diagram of an application scenario of the method for classifying test result error types provided in an embodiment of the present application;

[0020] Figure 2 A flow chart of a method for classifying test result error types provided in an embodiment of the present application;

[0021] Figure 3 A schematic diagram of the structure of a device for classifying test result error types provided in an embodiment of the present application;

[0022] Figure 4 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

[0023] The above drawings illustrate specific embodiments of the present application, which will be described in more detail below. These drawings and the textual description are not intended to limit the scope of the present application in any way, but rather to illustrate the concepts of the present application to those skilled in the art by reference to specific embodiments. DETAILED DESCRIPTION

[0024] Exemplary embodiments will be described in detail herein, with examples illustrated in the accompanying drawings. In the following description, when referring to the drawings, identical numerals in different figures represent identical or similar elements, unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.

[0025] With the continuous development of Internet technology, various activities such as learning, shopping, and entertainment can now be carried out through the Internet. Before implementing various services on the Internet, it is necessary to test the programs that implement the services. If an error occurs during the test, it is also necessary to determine the error type so that the program can be updated.

[0026] In the prior art, it is usually necessary to manually review the test results to find the error type of the test error, which is time-consuming.

[0027] In response to the above technical problems, the inventors proposed the following technical concept: by comparing the test results obtained with the historical error information in the database, the historical error information matching the test results is obtained, and the error type of the matching historical error information is used as the error type of the test result.

[0028] Figure 1 Schematic diagram of the application scenario of the test result error classification method provided in the embodiment of the present application. Figure 1 In this scenario, it includes: server 101 and database 102.

[0029] The server 101 may be a separate service, or it may be implemented using a server or a cluster of multiple servers with more powerful processing capabilities and higher security. Where possible, a computer or laptop with stronger computing power may be used as a substitute.

[0030] The database 102 may include a single database or a combination of multiple databases, such as one or more of an Oracle database, a MySQL database, a DRDS database, an Elasticsearch database, etc., and this application does not impose any particular restrictions on this.

[0031] The connection between the server 101 and the database 102 can be through a wired connection or a wireless network connection, wherein the network used for the wireless network connection can include various types of wired and wireless networks, such as but not limited to: the Internet, local area network, Wireless Fidelity (Wireless Fidelity, WIFI), Wireless Local Area Networks (Wireless Local Area Networks, WLAN), General Packet Radio Service (General Packet Radio Service, GPRS), Code Division Multiple Access (Code Division Multiple Access, CDMA), 2G / 3G / 4G / 5G cellular networks, satellite communication networks, etc.

[0032] During the specific implementation process, server 101 is used to obtain the test results after the test execution is completed, read the historical error information in the database, determine the target historical error information that matches the test results among all the historical error information, and determine the error type corresponding to the target historical error information as the target error type of the test result, thereby obtaining the error type corresponding to the test result.

[0033] It is understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the method for classifying test result error types. In other feasible implementations of the present application, the above architecture may include more or fewer components than shown in the figure, or combine or split certain components, or arrange the components differently. The specific configuration can be determined according to the actual application scenario and is not limited here. Figure 1 The components shown can be implemented by hardware, software, or a combination of software and hardware.

[0034] The following specific embodiments describe in detail the technical solution of the present application and how the technical solution of the present application solves the above-mentioned technical problems. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present application will be described below in conjunction with the accompanying drawings.

[0035] Figure 2 A flow chart of the method for classifying test result error types provided in the embodiment of the present application. The execution subject of the embodiment of the present application may be Figure 1 The server 101 in the embodiment may also be a computer and / or a mobile phone, etc., and this embodiment does not impose any particular restrictions on this. Figure 2 As shown, the method includes:

[0036] S201: In response to the end of the test execution, the test results, all preset keywords and all historical error information in the database are obtained, wherein the historical error information includes error keywords and error pictures, and the historical error information has corresponding error types.

[0037] In this step, the test process or test results can be continuously monitored, and the test execution is determined to be completed when the test process is interrupted or a preset prompt appears in the test results. The test execution can also be determined to be completed when an error pop-up window, an error window, or an error appears in the test results. Obtaining the test results can be reading a test result file or reading the test results on a web page. The preset keywords can be stored in a database or stored in a storage unit and obtained by direct reading. The error image can be a screenshot of the error content, a screenshot of the error web page, or a screenshot of the error window, etc.

[0038] Among them, error keywords such as "IndentationError", "NameError", "invalid syntax", etc. can be set in advance by the tester.

[0039] S202: Determine the paragraph containing the preset field in the test result as an error reporting paragraph.

[0040] In this step, the preset fields may be pre-calibrated by the tester.

[0041] The preset fields include, for example, "ERROR", "Error" or "Waring".

[0042] S203: Using the preset keyword contained in the error reporting segment as the target keyword.

[0043] In this step, each preset keyword may be searched in the error reporting segment. If the search results in the same content as the keyword, the preset keyword that can be searched is used as the target keyword.

[0044] For example, if the current error segment contains "NameError" among the error keywords above, "NameError" is determined as the target keyword. For another example, if the current error segment contains "NameError" and "invalidsyntax" among the error keywords above, both "NameError" and "invalid syntax" are determined as target keywords.

[0045] S204: Taking a screenshot of the error segment to obtain a target error image.

[0046] In this step, the test result file can be opened to display the test result window, jump the display content to the error section, and take a screenshot of the test result window. Alternatively, the page where the error section is located can be screenshoted to obtain the target error image.

[0047] For example, during testing, if an error pop-up window appears and the error segment is within the pop-up window, a screenshot of the pop-up window will be taken. Another example is if a webpage contains an error segment during testing, the webpage display content will be redirected to the error segment and a screenshot of the webpage will be taken. Another example is if an error window appears and the error segment is within the window, a screenshot of the window will be taken.

[0048] In a possible implementation, the target error image includes a pop-up image.

[0049] Accordingly, in the above step S204, taking a screenshot of the error segment to obtain a target error image includes:

[0050] S204A: Take a screenshot at a preset location on the web page to obtain a pop-up window image.

[0051] In this step, the preset position may be a display position pre-calibrated by a staff member.

[0052] The display position may be calibrated in pixel coordinates. For example, a rectangle may be calibrated with diagonal coordinates of (1000, 700) and (1700, 1300). Another example may be a rectangle calibrated with diagonal coordinates of (2000, 900) and (3000, 1400).

[0053] S205: Determine target historical error information that matches the test result from all historical error information based on the target keyword, the target error picture, the error keyword, and the error picture.

[0054] In this step, the first matching degree between the error keyword and the target keyword in each historical error message and the second matching degree between the error picture and the target error picture can be calculated, and the target historical error information that matches the test result can be determined based on the first matching degree and the second matching degree.

[0055] Specifically, the historical error messages with a first matching degree exceeding a first threshold may be first determined as the error messages to be filtered, and the error messages with the second highest matching degree among the error messages to be filtered may be determined as the target historical error messages. Alternatively, the first matching degree may be multiplied by a first coefficient to obtain a first product, the second matching degree may be multiplied by a second coefficient to obtain a second product, the first product and the second product may be added together to obtain a total matching degree, and the historical error message with the highest matching degree may be determined as the target historical error message.

[0056] The degree of matching can be obtained through a preset script, program, or software. The preset program may be, for example, a preset neural network model. The degree of image matching can be similarity. The degree of keyword matching can be repetition.

[0057] S206: Determine the error type corresponding to the target historical error information as the target error type of the test result.

[0058] In this step, the target error type may be obtained by searching for a correspondence between the historical error information and the error type based on the target historical error information.

[0059] The correspondence between historical error information and error types may be stored in a table, a dictionary, a key-value pair, or the like.

[0060] From the description of the above embodiments, it can be seen that the embodiments of the present application obtain test results, and determine the paragraph containing preset fields in the test results as an error segment, use the preset keywords contained in the error segment as target keywords, intercept the target error picture of the error segment, combine the target keywords, target error pictures, error keywords in the database and error pictures in the database, determine the target historical error information that matches the test results in all historical error information, and determine the error type corresponding to the target test result as the target error type of the test result, so as to obtain the error type corresponding to the test result by comparing the test results with the historical error information, thereby reducing the time for manual determination of the error type.

[0061] In a possible implementation, in step S205, the target historical error information that matches the test result is determined from all historical error information based on the target keyword, the target error image, the error keyword, and the error image, including:

[0062] S2051: Determine at least one historical error message to be determined that matches the test result in the historical error message based on the degree of overlap between the target keyword and the error keyword.

[0063] In this step, the degree of overlap between the target keyword and the error keyword may be calculated, and based on the degree of overlap, at least one piece of historical error information to be determined that matches the test result is determined in the historical error information.

[0064] Specifically, the degree of overlap between the target keyword and the error keyword can be calculated using a preset script, program, or software. Alternatively, the degree of overlap can be calculated by dividing the number of target keywords by the number of error keywords to obtain the degree of overlap. Based on the degree of overlap, at least one historical error message to be determined that matches the test result is identified from the historical error messages. The historical error message whose degree of overlap exceeds a preset threshold value of overlap can be identified as the historical error message to be determined.

[0065] For example, if the number of target keywords is 4 and the number of error keywords is 8, the repetition rate is 50%; if the number of target keywords is 2 and the number of error keywords is 8, the repetition rate is 25%; if the number of target keywords is 3 and the number of error keywords is 7, the repetition rate is 43%.

[0066] S2052: If the number of the historical error information to be determined is one, the historical error information to be determined is determined as the target historical error information.

[0067] In this step, when only one piece of historical error information is determined as the historical error information to be determined, this piece of historical error information may be determined as the target historical error information.

[0068] For example, if there is only one historical error message whose overlap between the target keyword and the error keyword exceeds a preset overlap threshold of 70%, then this historical error message to be determined is determined as the target historical error message.

[0069] S2053: If the number of historical error messages to be determined is at least two, compare the target error image with the error images corresponding to the historical error messages to be determined to obtain the corresponding image repetitions. According to the image repetitions, determine the target historical error information in the historical error messages to be determined.

[0070] In this step, the target error image is compared with the error images corresponding to each of the historical error information to be determined, which can also be performed using a preset script, program or software. According to the image repetition, the target historical error information is determined in each of the historical error information to be determined. The historical error information with the highest corresponding image repetition can be determined as the target historical error information, or the error image with an image repetition exceeding a preset repetition threshold and the target error image can be sent to the corresponding terminal device of the tester, and the determined error image sent by the terminal device is received, wherein the determined error image is one of the error images, and the historical error information corresponding to the determined error image is determined as the target historical error information.

[0071] In a possible implementation, in this step, target historical error information is determined from each historical error information to be determined based on the image repetition rate, specifically including:

[0072] S20531: Determine the error picture with the highest picture repetition rate as the matching picture.

[0073] In this step, the error picture corresponding to the highest picture repetition degree may be determined as the matching picture.

[0074] For example, there are currently three error pictures, and the corresponding picture repetitions are 60%, 70%, and 90%, respectively. The error picture corresponding to the 90% picture repetition is determined as the matching picture.

[0075] S20532: Determine the to-be-determined historical error information corresponding to the matching image as the target historical error information.

[0076] In this step, the historical error information to be determined that contains the matching image may be determined as the target historical error information.

[0077] From the description of the above embodiments, it can be seen that the embodiments of the present application determine the historical error information to be determined in the historical error information by calculating the overlap between the target keyword and the error keyword, and when there is only one historical error information to be determined, the historical error information to be determined is determined as the target historical error information. When there are at least two historical error information to be determined, the target error picture is compared with the error pictures corresponding to each historical error information to be determined to obtain the picture repetition, and the target historical error information in each historical error information to be determined is determined by the picture repetition, thereby achieving the effect of automatically determining the target historical error information or reducing the screening time by the target keyword, target error picture, error keyword and error picture, thereby reducing the workload of testers.

[0078] In a possible implementation, the historical error reporting information also includes the number of error reports corresponding to the error type.

[0079] Accordingly, in the above step S2053, based on the image repetition rate, the target historical error information is determined from the various historical error information to be determined, specifically including:

[0080] S20533: All matching images whose image repetition exceeds a preset value and whose corresponding error reporting times exceed a preset number are determined as images to be reviewed.

[0081] In this step, since the historical error information includes the error image, if the historical error information includes the error count corresponding to the error type, the error image and the error count belong to the same historical error information, then the error image and the error count correspond to each other. The preset count can be pre-set by the tester.

[0082] For example, all matching images with a repetition rate exceeding 80% and corresponding error reporting exceeding 3 times are identified as images to be reviewed. Another example is that all matching images with a repetition rate exceeding 90% and corresponding error reporting exceeding 5 times are identified as images to be reviewed. Another example is that all matching images with a repetition rate exceeding 70% and corresponding error reporting exceeding 2 times are identified as images to be reviewed.

[0083] S20534: Send the image to be reviewed and the target error image to the corresponding terminal device of the tester, and receive the target image to be reviewed sent by the terminal device.

[0084] In this step, all images to be reviewed may be sent to the terminal device. The target image to be reviewed may be the image that the tester has found to be most similar to the target error image among all images to be reviewed, or may be an image selected by the tester from among all images to be reviewed that has the same or similar error type as the target error image.

[0085] In a possible implementation, after the image to be reviewed and the target error image are sent to the tester's corresponding terminal device, the target error type sent by the terminal device can also be received. In this case, the above step S206 does not need to be performed.

[0086] S20535: Determine the undetermined historical error information corresponding to the target image to be reviewed as the target historical error information.

[0087] In this step, the to-be-determined historical error information containing the target to-be-examined picture may be determined as the target historical error information.

[0088] For example, in the above step S20534, the pictures to be reviewed A, B, C and the target error picture are sent to the corresponding terminal device of the tester. When the picture to be reviewed sent by the terminal device is received, the picture to be reviewed A is the target picture to be reviewed, and the historical error information containing the picture to be reviewed A is determined as the target historical error information.

[0089] From the description of the above embodiments, it can be seen that the embodiments of the present application determine all matching images whose image repetition is greater than or equal to a preset value and whose corresponding error number exceeds a preset number as images to be reviewed, and send the images to be reviewed and the target error pictures to the corresponding terminal device of the tester, so as to realize manual judgment of the image to be reviewed corresponding to the target error picture, receive the target image to be reviewed sent by the terminal device, and thereby determine the historical error information to be determined corresponding to the target image to be reviewed as the target historical error information, so as to realize the determination of the target historical error information by the manually determined target image to be reviewed. Since the image repetition is screened, the target historical error information can be accurately obtained while reducing the amount of images to be manually screened.

[0090] In a possible implementation, after the above steps S20533 to S20535 are performed and the error type corresponding to the target historical error information is determined as the target error type of the test result in S206, the following further steps are included:

[0091] S207: Increase the number of error reports corresponding to the target error type by N times, where N is a preset positive integer.

[0092] In this step, historical error reporting information of the target error type may be searched, and the number of error reporting times included in this historical error reporting information may be increased by N times.

[0093] Among them, N can be 1. If the tester wants to increase the number of error reports each time, it can also be 2, 3, 5, 7, etc., which will not be repeated here.

[0094] From the description of the above embodiments, it can be seen that the embodiments of the present application automatically increase the number of error reports by increasing the number of error reports corresponding to the target error type by N times after determining the target error type, so that the error type with more error reports is more likely to be determined as the target error type, thereby reducing the manual screening time.

[0095] In a possible implementation, after sending the image to be reviewed and the target error image to the tester's corresponding terminal device in step S20534, the following steps are further included:

[0096] S20536: Receive the actual error type and actual error information sent by the terminal device.

[0097] In this step, the actual error type can be distinguished from any of the above error types, and the actual error information may include the actual error keyword, and may include or may not include the target error picture.

[0098] The actual error type and actual error message may be input by the tester on the terminal device.

[0099] S20537: Determine the actual error type as the target error type.

[0100] In this step, the actual error type may be used as the target error type.

[0101] For example, if the actual error type received is "error type 7", then the target error type is "error type 7". This embodiment does not limit the specific naming or content of the actual error type.

[0102] S20538: The actual error type, actual error message, and target error image are collectively determined as new historical error information, and the new historical error information is stored in a database.

[0103] In this step, the actual error type, actual error message, and target error image may be taken as a new historical error message and written into the database.

[0104] From the description of the above embodiments, it can be seen that the embodiments of the present application determine the actual error type as the target error type by receiving the actual error type and actual error information sent by the terminal device, determine the new historical error information based on the actual error type, actual error information and target error picture, and write the new historical error information into the database, thereby realizing the determination of the target error type of the test results and the update of the data in the database, and realizing the update of the database when a new error type occurs.

[0105] In a possible implementation, in step S204, taking a screenshot of the error segment to obtain a target error image includes:

[0106] S2041: Open the test result to display the test result window. The test result window includes a test result display area, a slider and a slide track. The slider is used to move on the slide track and control the display content of the result display area according to its position on the slide track.

[0107] In this step, the test result can be a file. If the test result is not a file, the test result can be written to a file and then opened. The opened test result is displayed in the form of a window. If the test result window can display the contents of all test results without flipping up and down, the slider and rail can be omitted, and steps S2042 to S2045 below are not executed. Step S2046 is directly executed to obtain the target error image.

[0108] S2042: Obtain the number of rows of the error segment in the test result, the total number of rows of the test result, and the length of the slide rail.

[0109] In this step, the number of test result lines containing the error segment can be obtained by obtaining the starting line number of the error segment. The number of test result lines containing the error segment, the total number of test result lines, and the length of the slide rail can be obtained using a preset script, program, or software, and this embodiment of the application does not impose any special limitations on this.

[0110] S2043: Divide the number of lines of the error segment in the test result by the total number of lines to obtain the position ratio.

[0111] In this step, for example, if the error segment has 20 lines in the test result and the total number of lines is 100, the position ratio is 0.2; if the error segment has 40 lines in the test result and the total number of lines is 150, the position ratio is 0.27; if the error segment has 60 lines in the test result and the total number of lines is 120, the position ratio is 0.5.

[0112] S2044: Multiply the position ratio by the length of the slide rail to obtain the target distance from the top end of the slide rail.

[0113] In this step, the unit of the rail length may be centimeters, millimeters, or pixels, etc., and this application does not impose any special restrictions thereon. The target distance from the top of the rail may be the target distance from the top or midpoint of the slider to the top of the rail.

[0114] For example, if the track length is 920 mm and the position ratio is 0.2, the target distance is 184 mm; if the track length is 700 pixels and the position ratio is 0.5, the target distance is 350 pixels; if the track length is 800 pixels and the position ratio is 0.7, the target distance is 560 pixels.

[0115] S2045: The control slider is moved to a position away from the top target distance so that the error segment is displayed in the result display area.

[0116] In this step, the coordinates of the top end of the slide rail may be obtained, the coordinates of the top end of the slide rail and the target distance may be added along the slide rail direction to obtain the target position, and the slider may be moved to the target position.

[0117] For example, if the coordinates of the top of the slide rail are (100, 100) and the target distance is 40, then the coordinates of the target position are (100, 140); for another example, if the coordinates of the top of the slide rail are (112, 140) and the target distance is 100, then the coordinates of the target position are (100, 240). The embodiment of the present application does not limit the specific values ​​of the coordinate base target distance.

[0118] S2046: Capture the test result display area to obtain the target error image.

[0119] In this step, a preset script, program or software may be used to take a screenshot to obtain a target error picture.

[0120] From the description of the above embodiments, it can be seen that the embodiment of the present application opens the test results, calculates the position ratio according to the number of rows where the test results are located and the total number of rows, calculates the target distance of the slider from the top of the slide rail according to the position ratio and the length of the slide rail, and moves the slider to the position of the target distance from the top of the slide rail, thereby displaying the error segment, taking a screenshot of the test result display area, and obtaining the target error picture, thereby realizing the automatic positioning of the error segment position and the target error picture, and avoiding the manual screenshot process.

[0121] In a possible implementation, before obtaining the test results, all preset keywords, and all historical error information in the database in step S201, the following steps are further included:

[0122] S210: Send the existing error information and the existing error pictures obtained in the pre-test to the terminal device corresponding to the tester.

[0123] In this step, the existing error information obtained in the pre-test may be error information obtained by the script or program test before the current test.

[0124] S211: Receive a corresponding error type sent by the terminal device, wherein the corresponding error type is determined by the tester based on existing error information and existing error pictures.

[0125] In this step, the error type may be calibrated by the tester and input into the terminal device.

[0126] S212: Determine the existing error information, the existing error image and the corresponding error type as historical error information and store them in a database.

[0127] This step can be similar to step S20538 above, and can also store the mapping relationship between existing error information, existing error images, and corresponding error types in the database. Testers can also calibrate historical test results, such as the test system name, system version number, process name, test script name, error type, error message keywords, error cause, error count, and error screenshots.

[0128] In any of the above embodiments, the terminal device may be any device such as a server, a computer, a laptop, a mobile phone, etc. Error types may include process problems, script problems, system problems, etc.

[0129] From the description of the above embodiments, it can be seen that the embodiments of the present application determine the existing error information, existing error pictures and corresponding error types as historical error information by sending existing error information and existing error pictures to the terminal device corresponding to the tester, and receiving the corresponding error type sent by the terminal device, thereby establishing a basic database to facilitate subsequent comparison of test results with historical error information.

[0130] In one possible implementation, after the initial execution of the script test or test process, the test results are analyzed and entered into the test result database. When the same test process is executed again later, the error message is compared with the historical error information stored in the database. If the error message for the same script has the same keyword, it is marked and the historical error message is the same as it. The consistency is manually analyzed. If not, an error message is added and the database is updated. If multiple historical error messages are successfully compared, the probability is calculated based on the number of times each historical error has occurred. Manual judgment can start from the error cause with the highest probability, reducing manual judgment time. When there is enough historical error data, the error analysis results will be more accurate, and error-related information can be automatically generated based on the problem, saving the tester the time cost of analyzing the results and reporting error-related information.

[0131] Figure 3 This is a schematic diagram of the structure of the device for classifying test result error types provided in the embodiment of the present application. Figure 3 As shown, the test result error type classification device 300 includes: an acquisition module 301, an error segment determination module 302, a keyword determination module 303, an image acquisition module 304, a target information determination module 305 and a type determination module 306.

[0132] The acquisition module 301 is used to obtain the test results, all preset keywords and all historical error information in the database in response to the end of the test execution, wherein the historical error information includes error keywords and error pictures, and the historical error information has corresponding error types.

[0133] The error segment determination module 302 is configured to determine a segment containing a preset field in the test result as an error segment.

[0134] The keyword determination module 303 is configured to use the preset keyword contained in the error reporting segment as a target keyword.

[0135] The picture acquisition module 304 is used to take a screenshot of the error segment to obtain a target error picture.

[0136] The target information determination module 305 is used to determine the target historical error information that matches the test result from all historical error information based on the target keyword, target error picture, error keyword and error picture.

[0137] The type determination module 306 is configured to determine the error type corresponding to the target historical error information as the target error type of the test result.

[0138] The device provided in this embodiment can be used to execute the technical solution of the above method embodiment. Its implementation principle and technical effects are similar and will not be described in detail in this embodiment.

[0139] In one possible implementation, the target information determination module 305 is specifically configured to determine, based on the degree of overlap between the target keyword and the error keyword, at least one historical error message to be determined that matches the test result in the historical error information. If the number of historical error messages to be determined is one, the historical error message to be determined is determined as the target historical error message. If the number of historical error messages to be determined is at least two, the target error image is compared with the error images corresponding to each historical error message to be determined to obtain the corresponding image repetition. Based on the image repetition, the target historical error message is determined in each historical error message to be determined.

[0140] The device provided in this embodiment can be used to execute the technical solution of the above method embodiment. Its implementation principle and technical effects are similar and will not be described in detail in this embodiment.

[0141] In a possible implementation, the target information determination module 305 is specifically configured to determine the error-reporting picture with the highest picture repetition as the matching picture, and determine the to-be-determined historical error information corresponding to the matching picture as the target historical error information.

[0142] The device provided in this embodiment can be used to execute the technical solution of the above method embodiment. Its implementation principle and technical effects are similar and will not be described in detail in this embodiment.

[0143] In one possible implementation, the historical error information also includes the number of error reports corresponding to the error type. Accordingly, in one possible implementation, the target information determination module 305 is specifically configured to determine as images to be reviewed all matching images whose image repetition exceeds a preset value and whose corresponding number of error reports exceeds a preset number. The image to be reviewed and the target error image are sent to the tester's corresponding terminal device, and the target image to be reviewed sent by the terminal device is received. The historical error information to be determined corresponding to the target image to be reviewed is determined as the target historical error information.

[0144] The device provided in this embodiment can be used to execute the technical solution of the above method embodiment. Its implementation principle and technical effects are similar and will not be described in detail in this embodiment.

[0145] In a possible implementation, the test result error type classification device 300 further includes: a number increasing module 307 .

[0146] The number increasing module 307 is used to increase the number of error reports corresponding to the target error type by N times, where N is a preset positive integer.

[0147] The device provided in this embodiment can be used to execute the technical solution of the above method embodiment. Its implementation principle and technical effects are similar and will not be described in detail in this embodiment.

[0148] In a possible implementation, the test result error type classification device 300 further includes: an information storage module 308 .

[0149] The information storage module 308 is configured to receive the actual error type and actual error message sent by the terminal device, determine the actual error type as the target error type, and collectively determine the actual error type, actual error message, and target error image as new historical error information, and store the new historical error information in a database.

[0150] The device provided in this embodiment can be used to execute the technical solution of the above method embodiment. Its implementation principle and technical effects are similar and will not be described in detail in this embodiment.

[0151] In one possible implementation, the image acquisition module 304 is specifically used to open the test results to display the test result window. The test result window includes a test result display area, a slider and a slide rail. The slider is used to move on the slide rail and control the display content of the result display area according to its own position on the slide rail. The number of rows of the error segment in the test results, the total number of rows of the test results and the length of the slide rail are obtained. The number of rows of the error segment in the test results is divided by the total number of rows to obtain the position ratio. The position ratio is multiplied by the length of the slide rail to obtain the target distance from the top of the slide rail. The control slider moves to a position at the target distance from the top so that the result display area displays the error segment. The test result display area is intercepted to obtain the target error image.

[0152] The device provided in this embodiment can be used to execute the technical solution of the above method embodiment. Its implementation principle and technical effects are similar and will not be described in detail in this embodiment.

[0153] In a possible implementation, the test result error type classification device 300 further includes: a history information acquisition module 309 .

[0154] The historical information acquisition module 309 is used to send the existing error information and existing error pictures obtained in advance to the terminal device corresponding to the tester; receive the corresponding error type sent by the terminal device, where the corresponding error type is determined by the tester based on the existing error information and existing error pictures; and jointly determine the existing error information, existing error pictures and corresponding error types as historical error information and store them in the database.

[0155] The device provided in this embodiment can be used to execute the technical solution of the above method embodiment. Its implementation principle and technical effects are similar and will not be described in detail in this embodiment.

[0156] In order to implement the above embodiment, the embodiment of the present application also provides an electronic device.

[0157] refer to Figure 4 , which shows a schematic structural diagram of an electronic device 400 suitable for implementing an embodiment of the present application. The electronic device 400 may be a terminal device or a server. The terminal device may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (Portable Android Devices, PADs), portable multimedia players (PMPs), in-vehicle terminals (such as in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. Figure 4 The electronic device shown is merely an example and should not limit the functions and scope of use of the embodiments of the present application.

[0158] like Figure 4 As shown, the electronic device 400 may include a processor (such as a central processing unit, a graphics processing unit, etc.) 401, and a memory 402 connected to the processor communication, which can perform various appropriate actions and processes according to the program stored in the memory 402, the computer execution instruction or the program loaded from the storage device 408 into the random access memory (Random Access Memory, referred to as RAM) 403, to achieve the test result error type classification method in any of the above embodiments, wherein the memory can be a read-only memory (Read Only Memory, referred to as ROM). In RAM 403, various programs and data required for the operation of the electronic device 400 are also stored. The processing device 401, the memory 402 and the RAM 403 are connected to each other via a bus 404. An input / output (I / O) interface 405 is also connected to the bus 404.

[0159] Typically, the following devices may be connected to the I / O interface 405: an input device 406 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 407 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 408 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 409. The communication device 409 may allow the electronic device 400 to communicate with other devices wirelessly or by wire to exchange data. Although Figure 4 The electronic device 400 is shown with various devices, but it should be understood that it is not required to implement or possess all of the devices shown. More or fewer devices may be implemented or possessed instead.

[0160] In particular, according to an embodiment of the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer-readable storage medium, and the computer program includes program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network via the communication device 409, or installed from the storage device 408, or installed from the memory 402. When the computer program is executed by the processing device 401, the above-mentioned functions defined in the method of the embodiment of the present application are performed.

[0161] It should be noted that the computer-readable storage medium mentioned above in this application can be a computer-readable signal medium or a computer storage medium, or any combination of the two. The computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any combination of the above. More specific examples of computer-readable storage media can include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this application, a computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device, or device. In this application, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. This propagated data signal can take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable storage medium other than a computer-readable storage medium that can transmit, propagate, or convey a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable storage medium may be conveyed using any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0162] The computer-readable storage medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0163] The computer-readable storage medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device executes the method shown in the above embodiment.

[0164] The computer program code for performing the operations of the present application can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (for example, using an Internet service provider to connect via the Internet).

[0165] The flow charts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present application. In this regard, each box in the flow chart or block diagram can represent a module, program segment or a part of code, and the module, program segment or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be implemented by a dedicated hardware-based system that performs the specified function or operation, or can be implemented by a combination of dedicated hardware and computer instructions.

[0166] The modules described in the embodiments of this application may be implemented in software or hardware. In some cases, the name of a unit does not limit the module itself. For example, the image acquisition module may also be described as a "target error image acquisition module."

[0167] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0168] The present application also provides a computer-readable storage medium, which stores computer-executable instructions. When the processor executes the computer-executable instructions, the technical solution of the test result error type classification method in any of the above-mentioned embodiments is implemented. Its implementation principle and beneficial effects are similar to the implementation principle and beneficial effects of the test result error type classification method. Please refer to the implementation principle and beneficial effects of the test result error type classification method, and no further details will be given here.

[0169] In the context of the present application, a machine-readable medium can be a tangible medium that can contain or store a program for use by an instruction execution system, device or equipment or used in combination with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0170] The present application also provides a computer program product, including a computer program. When the computer program is executed by a processor, it implements the technical solution of the test result error type classification method in any of the above-mentioned embodiments. Its implementation principle and beneficial effects are similar to the implementation principle and beneficial effects of the test result error type classification method. Please refer to the implementation principle and beneficial effects of the test result error type classification method, and no further details will be given here.

[0171] The above description is merely a preferred embodiment of the present application and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of disclosure in this application is not limited to the technical solutions formed by a specific combination of the above-mentioned technical features, but also encompasses other technical solutions formed by any combination of the above-mentioned technical features or their equivalents without departing from the above-mentioned disclosed concepts. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in this application.

[0172] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present application that follow the general principles of the present application and include common knowledge or customary techniques in the art not disclosed herein. The description and examples are to be considered as exemplary only, and the true scope and spirit of the present application are indicated by the following claims.

[0173] It should be understood that the present application is not limited to the exact structure described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.

Claims

1. A method for classifying test result error types, characterized in that: include: In response to the test execution being completed, obtaining the test results, all preset keywords, and all historical error information in the database, wherein the historical error information includes error keywords and error images, and the historical error information has corresponding error types; Determine the paragraph containing the preset field in the test result as an error reporting paragraph; Using the preset keyword contained in the error segment as the target keyword; Taking a screenshot of the error segment to obtain a target error picture; Determining at least one to-be-determined historical error information that matches the test result in the historical error information according to the degree of overlap between the target keyword and the error keyword; If the number of the historical error information to be determined is one, determining the historical error information to be determined as the target historical error information; If the number of the historical error information to be determined is at least two, comparing the target error image with the error images corresponding to the historical error information to be determined to obtain corresponding image repetitions; and determining the target historical error information in the historical error information to be determined based on the image repetitions; The step of determining the target historical error information from each piece of historical error information to be determined based on the image repetition level includes: Determine the error-reporting picture with the highest picture repetition rate as the matching picture; Determine the to-be-determined historical error information corresponding to the matching image as the target historical error information; Determining the error type corresponding to the target historical error information as the target error type of the test result; The historical error information also includes the number of error reports corresponding to the error type; Accordingly, determining the target historical error information from each piece of historical error information to be determined based on the image repetition level includes: Determine all matching images whose image repetition exceeds a preset value and whose corresponding error reporting times exceed a preset number as images to be reviewed; Send the image to be reviewed and the target error image to the tester's corresponding terminal device, and receive the target image to be reviewed sent by the terminal device; Determine the to-be-determined historical error information corresponding to the target image to be reviewed as the target historical error information; The step of taking a screenshot of the error segment to obtain a target error picture includes: Open the test result to display a test result window, wherein the test result window includes a test result display area, a slider and a slide track, wherein the slider is used to move on the slide track and control the display content of the result display area according to its position on the slide track; Obtain the number of rows of the error segment in the test result, the total number of rows of the test result, and the length of the slide rail; Divide the number of rows of the error segment in the test result by the total number of rows to obtain the position ratio; Multiplying the position ratio by the length of the slide rail to obtain a target distance from the top end of the slide rail; Controlling the slider to move to a position at the target distance from the top, so that the result display area displays the error segment; The test result display area is intercepted to obtain the target error picture.

2. The method according to claim 1, characterized in that After determining the error type corresponding to the target historical error information as the target error type of the test result, the method further includes: The number of error reports corresponding to the target error type is increased by N times, where N is a preset positive integer.

3. The method according to claim 1, characterized in that After sending the image to be reviewed and the target error image to the terminal device corresponding to the tester, the method further includes: Receiving the actual error type and actual error information sent by the terminal device; determining the actual error type as the target error type; The actual error type, actual error information and target error picture are collectively determined as new historical error information, and the new historical error information is stored in the database.

4. The method according to any one of claims 1 to 2, characterized in that Before obtaining the test results, all preset keywords and all historical error information in the database, the following steps are also included: Send the error information and error pictures obtained in the pre-test to the corresponding terminal device of the tester; Receiving a corresponding error type sent by the terminal device, wherein the corresponding error type is determined by a tester based on the existing error information and the existing error image; The existing error information, the existing error picture and the corresponding error type are collectively determined as historical error information and stored in the database.

5. A device for classifying test result error types, characterized in that: include: An acquisition module, configured to acquire, in response to the completion of the test execution, the test results, all preset keywords, and all historical error information in the database, wherein the historical error information includes error keywords and error images, and the historical error information has corresponding error types; An error segment determination module, configured to determine a segment containing a preset field in the test result as an error segment; A keyword determination module, configured to use a preset keyword contained in the error reporting segment as a target keyword; An image acquisition module is used to take a screenshot of the error segment to obtain a target error image; a target information determination module, configured to determine target historical error information that matches the test result from all historical error information based on the target keyword, the target error picture, the error keyword, and the error picture; A type determination module, configured to determine the error type corresponding to the target historical error information as the target error type of the test result; The target information determination module is specifically configured to determine, based on the degree of overlap between the target keyword and the error keyword, at least one historical error information to be determined that matches the test result in the historical error information; If the number of the historical error information to be determined is one, determining the historical error information to be determined as the target historical error information; If the number of the historical error information to be determined is at least two, comparing the target error image with the error images corresponding to the historical error information to be determined to obtain corresponding image repetitions; and determining the target historical error information in the historical error information to be determined based on the image repetitions; The target information determination module is specifically configured to determine the error-reporting picture with the highest picture repetition rate as the matching picture; Determine the to-be-determined historical error information corresponding to the matching image as the target historical error information; The historical error information also includes the number of error reports corresponding to the error type; the target information determination module is specifically used to determine all matching images whose image repetition exceeds a preset value and whose corresponding number of error reports exceeds a preset number as images to be reviewed; Send the image to be reviewed and the target error image to the tester's corresponding terminal device, and receive the target image to be reviewed sent by the terminal device; Determine the to-be-determined historical error information corresponding to the target image to be reviewed as the target historical error information; The image acquisition module is specifically used to open the test results to display a test result window, wherein the test result window includes a test result display area, a slider and a slide rail, wherein the slider is used to move on the slide rail and control the display content of the result display area according to its position on the slide rail; Obtain the number of rows of the error segment in the test result, the total number of rows of the test result, and the length of the slide rail; Divide the number of rows of the error segment in the test result by the total number of rows to obtain the position ratio; Multiplying the position ratio by the length of the slide rail to obtain a target distance from the top end of the slide rail; Controlling the slider to move to a position at the target distance from the top, so that the result display area displays the error segment; The test result display area is intercepted to obtain the target error picture.

6. An electronic device, characterized in that: include: a processor, and a memory communicatively connected to the processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the processor performs the test result error type classification method according to any one of claims 1 to 4.

7. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer-executable instructions, which are used to implement the test result error type classification method according to any one of claims 1 to 4 when executed by a processor.

8. A computer program product comprising computer-executable instructions, characterized in that: When the computer-executable instructions are executed by a processor, they are used to implement the test result error type classification method according to any one of claims 1 to 4.

Images