Association method and device, computer equipment and storage medium

By automatically associating test cases and task information, the inefficiency problem caused by relying on manual operations in the existing technology is solved, and efficient correlation and convenient post-operation are achieved.

CN119807020APending Publication Date: 2025-04-11TENCENT TECHNOLOGY (SHENZHEN) CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202311306021.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-10-08
Publication Date
2025-04-11

AI Technical Summary

Technical Problem

In the prior art, the association between test cases and task information relies on manual operations, resulting in low association efficiency.

Method used

By obtaining the image and task information generated by the operations performed by the target task, it is associated, and the first correlation information is generated; then the test case is obtained and associated with the image is generated, and the second correlation information is generated; finally, the correlation information between the test case and the task information is generated based on the two to realize automatic correlation.

Benefits of technology

It avoids manual operations, improves the efficiency of correlation between test cases and task information, and facilitates post-query and operations, improving the experience of testers.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119807020A_ABST
    Figure CN119807020A_ABST
Patent Text Reader

Abstract

The invention discloses an association method and device, computer equipment and a storage medium, which can be applied to various scenes such as games, data processing, application testing and the like, and the method comprises the following steps: acquiring an image and task information generated by an operation executed for a target task, associating the image with the task information to generate first association information, and obtaining a test case generated by an operation executed for the target task, associating the test case with the image to generate second association information, and generating association information between the test case and the task information based on the first association information and the second association information. According to the method, the image and the task information generated by the operation executed for the target task are associated with the test case, so that automatic association of the test case and the task information is realized, manual operation is avoided, and the association efficiency is improved. Furthermore, the test cases are automatically associated with the task information, so that later query and operation are facilitated, and the experience degree of testers is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to an association method, apparatus, computer device and storage medium. Background Art

[0002] Precision testing refers to the process of collecting program execution logic and other test data by computer software during black box testing. During this testing process, it is necessary to complete the association of test cases and task information to map functional tests directly to the code layer. Among them, a test case is a set of test inputs, execution conditions, and expected results compiled for a specific goal, which is used to verify whether a specific software requirement is met.

[0003] At present, the solution for associating test cases with task information is generally a manual method, that is, it is necessary to manually identify the task information, or rely on semi-automatic tools to record the data generated during the execution of test cases, and then manually associate the task information with the corresponding test cases.

[0004] However, the above methods rely on manual operations, resulting in low association efficiency. Summary of the invention

[0005] The main purpose of the present application is to provide an association method, apparatus, computer equipment and storage medium, which can realize automatic association between test cases and task information, avoid manual operation and improve association efficiency.

[0006] In order to achieve the above objectives, in a first aspect, the present application provides an association method, which is applied to a server, comprising:

[0007] Obtaining images and task information generated by operations performed on a target task;

[0008] Associating the image with the task information to generate first associated information;

[0009] Obtain test cases generated by operations performed on target tasks;

[0010] Associating the test case with the image to generate second association information;

[0011] Based on the first association information and the second association information, association information between the test case and the task information is generated.

[0012] In a second aspect, an embodiment of the present invention provides an association method, which is applied to a client and includes:

[0013] In response to a trigger operation performed by a recording control in a screen interface for a target task, an image generated by the operation performed for the target task is recorded, task information generated by the operation performed for the target task is acquired, and the image and task information are sent to a server;

[0014] In response to a trigger operation performed on the test case, sending the test case to the server;

[0015] After the test case is executed, the server obtains the correlation information of the test case and the task information generated by associating the image, the task information and the test case;

[0016] A notification message is displayed based on the associated information, wherein the notification message is used to notify that the association between the test case and the task information is completed.

[0017] In a third aspect, an embodiment of the present invention provides an association device, including:

[0018] A first acquisition module is used to acquire images and task information generated by operations performed on a target task;

[0019] A first association module, used to associate the image with the task information to generate first association information;

[0020] A second acquisition module is used to acquire test cases generated by operations performed on the target task;

[0021] A second association module, used to associate the test case with the image to generate second association information;

[0022] The association information generating module is used to generate association information between the test case and the task information based on the first association information and the second association information.

[0023] In a fourth aspect, an embodiment of the present invention provides an association device, characterized in that it includes:

[0024] A first operation module is used to respond to a trigger operation performed by a recording control in a screen interface for a target task, record an image generated by the operation performed for the target task, obtain task information generated by the operation performed for the target task, and send the image and task information to a server;

[0025] A second operation module, configured to send the test case to the server in response to a trigger operation performed on the test case;

[0026] The acquisition module is used to obtain the associated information of the test case and the task information generated by the server according to the association of the image, the task information and the test case after the test case is executed;

[0027] The display module is used to display a notification message based on the associated information, wherein the notification message is used to notify that the association between the test case and the task information is completed.

[0028] In a fifth aspect, an embodiment of the present invention provides a computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of any of the above-mentioned association methods when executing the computer program.

[0029] In a sixth aspect, an embodiment of the present invention provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of any of the above association methods are implemented.

[0030] The embodiments of the present invention provide an association method, apparatus, computer equipment and storage medium, including: first obtaining an image and task information generated by an operation performed on a target task, associating the image and task information to generate first association information, then obtaining a test case generated by an operation performed on the target task, associating the test case and the image to generate second association information, and then generating association information between the test case and the task information based on the first association information and the second association information. The present invention associates the image and task information generated by the operation performed on the target task with the test case to achieve automatic association of the test case and the task information, thereby avoiding manual operation and improving association efficiency. Furthermore, the test case and the task information are automatically associated, which is convenient for later query and operation, and improves the experience of the tester. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] The drawings constituting a part of this application are used to provide a further understanding of this application, so that other features, purposes and advantages of this application become more obvious. The schematic embodiment drawings and their descriptions of this application are used to explain this application and do not constitute an improper limitation on this application. In the drawings:

[0032] Figure 1 is a schematic diagram of an application scenario of an association method provided by an embodiment of the present invention;

[0033] Figure 2 is a flowchart of an association method provided by an embodiment of the present invention;

[0034] Figure 3 It is a schematic diagram of an interface of a game store interface provided by an embodiment of the present invention;

[0035] Figure 4 It is a schematic diagram of an advanced experience medicine area provided by an embodiment of the present invention;

[0036] Figure 5is a schematic diagram of an operation information type provided by an embodiment of the present invention;

[0037] Figure 6 It is a flowchart of a method for associating a test case with an image provided by an embodiment of the present invention;

[0038] Figure 7 is a schematic diagram of a song playing interface provided by an embodiment of the present invention;

[0039] Figure 8 is a schematic diagram of a voice icon provided by an embodiment of the present invention;

[0040] Fig. 9 is a schematic diagram of a speaker icon provided by an embodiment of the present invention;

[0041] Fig.10 is a schematic diagram of a tag information adding page provided by an embodiment of the present invention;

[0042] Fig.11 is a flowchart of another association method provided by an embodiment of the present invention;

[0043] Fig.12 is a schematic diagram of a game homepage provided by an embodiment of the present invention;

[0044] Fig.13 is a schematic diagram of an interface of a notification message provided by an embodiment of the present invention;

[0045] Fig.14 is a flowchart of another association method provided by an embodiment of the present invention;

[0046] Fig.15 is a structural schematic diagram of an association device provided by an embodiment of the present invention;

[0047] Fig.16 is a structural schematic diagram of another association device provided by an embodiment of the present invention;

[0048] Fig.17 It is a schematic diagram of a computer device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0049] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0050] The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of the present invention and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the numbers used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in sequences other than those illustrated or described herein.

[0051] It should be understood that in various embodiments of the present invention, the size of the sequence number of each process does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

[0052] It should be understood that in the present invention, "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or apparatus comprising a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to these processes, methods, products or apparatuses.

[0053] It should be understood that in the present invention, "plurality" refers to two or more than two. "And / or" is merely a description of the association relationship of associated objects, indicating that three relationships may exist. For example, and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. "Contains A, B and C", "Contains A, B, C" means that A, B, and C are all included, "Contains A, B or C" means that one of A, B, and C is included, and "Contains A, B and / or C" means that any one, any two, or any three of A, B, and C are included.

[0054] It should be understood that in the present invention, "B corresponding to A", "B corresponding to A", "A corresponds to B" or "B corresponds to A" means that B is associated with A and B can be determined based on A. Determining B based on A does not mean determining B based only on A, but B can also be determined based on A and / or other information. A and B match when the similarity between A and B is greater than or equal to a preset threshold.

[0055] Depending on the context, "if" as used herein may be interpreted as "when" or "when" or "in response to determining" or "in response to detecting."

[0056] The data involved in the present disclosure may be data authorized by testers or fully authorized by all parties. The collection, dissemination, and use of the data shall comply with the requirements of relevant national laws and regulations. The implementation methods / examples of the present disclosure may be combined with each other.

[0057] The embodiments of the present application can be applied to various scenarios such as games, data processing, application testing, virtual reality, life applications (such as shopping applications, social applications, map applications), etc.

[0058] The technical solution of the present invention is described in detail with specific embodiments below. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.

[0059] In order to make the purpose, technical solutions and advantages of the present invention more clear, specific embodiments will be described below in conjunction with the accompanying drawings.

[0060] Precision testing refers to the process of collecting program execution logic and other test data by computer software during black box testing. During this testing process, it is necessary to complete the association of test cases and task information to map functional tests directly to the code layer. Among them, a test case is a set of test inputs, execution conditions, and expected results compiled for a specific goal, which is used to verify whether a specific software requirement is met.

[0061] At present, the solution for associating test cases with task information is generally a manual method, that is, it is necessary to manually identify the task information, or rely on semi-automatic tools to record the data generated during the execution of test cases, and then manually associate the task information with the corresponding test cases.

[0062] Taking the task information as game information as an example, when recording samples, if you want to associate test cases with game information (for example: functions, protocols, UI control (User Interface Control) names), you need to first mark the game test cases, then print the relevant information, and then manually associate. Even if it can be automatically associated, you need to specify the test case first, otherwise you cannot confirm which test case is executing the operation. For example: If the tester wants to know which protocols will be triggered when the first case in test case A is executed, then before executing the first case, you need to manually or through a tool mark the start of a protocol, then execute it, confirm the reported information, and then manually or through a tool mark the end of a protocol. In this way, you can determine the protocol triggered by the execution of the first case.

[0063] However, the above methods rely on manual operations, resulting in low association efficiency.

[0064] Based on this, the present application provides an association method to avoid reliance on manual operations and improve association efficiency through automatic association.

[0065] See also Figure 1 , Figure 1 A schematic diagram of an application scenario of an association method provided in an embodiment of the present application.

[0066] like Figure 1 As shown, the client 102 communicates with the server 104. The client 102 responds to the trigger operation performed by the recording control in the screen interface of the target task, records the image generated by the operation performed on the target task, obtains the task information generated by the operation performed on the target task, and sends the image and the task information to the server 104, and then the server 104 associates the image with the task information to generate first association information; the client 102 responds to the trigger operation performed on the test case, sends the test case to the server 104, and then the server 104 associates the test case with the image to generate second association information; finally, the server 104 generates association information between the test case and the task information based on the first association information and the second association information, and sends the association information between the test case and the task information to the client 102. When the test case is executed, the client 102 displays a notification message based on the association information, wherein the notification message is used to notify that the association between the test case and the task information is completed.

[0067] Among them, the client 102 and the server 104 can communicate through any communication method, including but not limited to network communication, and the above network can include but not limited to: wired network, wireless network, wherein the wired network includes: local area network, metropolitan area network and wide area network, and the wireless network includes: Bluetooth, WIFI, and other networks that realize wireless communication. Among them, the client 102 includes but is not limited to at least one of the following: mobile phone (such as Android mobile phone, iOS mobile phone, etc.), laptop computer, tablet computer, PDA, mobile Internet device (Mobile Internet Devices, MID), PAD, desktop computer, smart TV, etc. Among them, the server 104 can be an on-site server or a remote server, wherein both the on-site server and the remote server can be implemented as independent servers or service clusters composed of multiple servers. The above is only an example, and no limitation is made to this in this embodiment.

[0068] See also Figure 2 , Figure 2 A flowchart of an association method provided in an embodiment of the present application.

[0069] like Figure 2 As shown, this method is applied to Figure 1 The server 104 shown includes the following steps:

[0070] Step S201: Acquire images and task information generated by operations performed on a target task.

[0071] The target task is any task, including but not limited to game tasks, shopping tasks, work tasks, instant messaging tasks, map navigation tasks, simulation tasks, etc., and the task information and images are generated by executing the target task. For different tasks, the operations to be executed may be the same or different, and are not specifically limited here.

[0072] For example, if the target task is a purchase task during the game, the tester needs to click the store button, enter the store interface, click to select virtual attack props, pay the amount, etc. For the above operations, such as click, enter, etc., the corresponding images and task information will be generated.

[0073] In one embodiment, the image may be a screenshot of the screen interface on which the operation is performed and a screenshot of the operation area, where the operation area is an area in the screen interface.

[0074] In one embodiment, obtaining an image generated by an operation performed on a target task includes: using a preset recording tool to record the screen interface on which the operation is performed to obtain a screenshot of the screen interface; using a preset color algorithm to identify the screenshot of the screen interface to obtain a screenshot of the operation area on which the operation is performed.

[0075] Among them, the preset recording tools include but are not limited to Snipclip, Camtasia, etc., which can capture game clips in real time, take screenshots and manage performance, etc. The preset color algorithms include but are not limited to HSV (Hue, Saturation, Value), RGB (Red, Green, Blue), etc.

[0076] When the tester performs an operation for the target task, the recording tool can be used to record the screen interface on which the operation is performed in real time to obtain a screenshot of the screen interface, and then further identify and obtain a screenshot of the operation area on which the operation is performed through a preset color algorithm.

[0077] For example, when the tester performs a purchase task, he needs to first enter Figure 3 The store interface is shown, and then click on the store interface to select the virtual attack props you want to buy, such as advanced experience potions.

[0078] During this operation, a screenshot of the store interface is first obtained through a recording tool, and then the screenshot of the store interface is identified through a color algorithm to obtain a screenshot of the operation area clicked by the tester, such as Figure 4 A screenshot of the Advanced Experience Potion area shown.

[0079] In addition, while the recording tool is used to record the screen interface on which the operation is performed in real time to obtain a screenshot of the screen interface, the recording tool also records in real time the operation time and operation location of clicking to purchase advanced experience potions.

[0080] It should be noted that this solution is applied to testing scenarios. The content recorded by the recording tool is the tester's operation process of the game during the test, and does not involve recording of game players. The acquisition and processing of data is in compliance with regulations.

[0081] After obtaining a screenshot of the store interface, a screenshot of the advanced experience potion area, the time and location of clicking to purchase the advanced experience potion, the above information can be stored.

[0082] Exemplarily, the executed code is stored as follows:

[0083]

[0084] Among them, image_full_name represents a screenshot of the store interface (full-screen screenshot), image_small_name represents a screenshot of the advanced experience potion area (small picture of the operation area), img_clock_time is the time to click to purchase advanced experience potions, specifically 20230910_10:00am, and img_pos represents the operation position, that is, the position at the store interface coordinates [601, 83]. The origin position of the store interface is not specifically limited.

[0085] In addition, the screenshot of the advanced experience potion area named small_1662624717.jpg and the screenshot of the store interface named full_1662624717.jpg are both stored in the H:\\proj\\store folder. The naming of this folder can be set according to the situation. This is just an example.

[0086] It should be noted that the storage methods corresponding to other operations are similar to the above storage methods and will not be repeated here.

[0087] Task information refers to various information generated during the execution of an operation, including but not limited to the log of the target task, the operation time, the operation location, the button targeted by the operation, and the button-related path.

[0088] In one embodiment, the task information generated by the operation performed on the target task is mainly obtained through a built-in software development kit (SDK).

[0089] Based on the above example, the task information may include a log of the purchase task, the time and location of the operation to click to purchase the advanced experience potion, the click button for the purchase, and the path associated with the click button.

[0090] After the above task information is obtained through the SDK, the above task information can be stored.

[0091] The images and task information generated by the operations performed on the target task can be obtained at the same time, and the information obtained by the recording tool, including the image, operation location, operation time, and the task information obtained by the SDK can be stored in the same file.

[0092] Step S202: Associating the image with the task information to generate first associated information.

[0093] After the image and task information are acquired in the previous step, the image and task information may be associated to generate first associated information.

[0094] In one embodiment, associating the image with the task information to generate the first associated information includes: acquiring operation information generated by the operation performed on the target task, and then associating the image with the task information based on the operation information to generate the first associated information.

[0095] Any operation will have its corresponding operation information, such as operation time, operation location, operation object, and type of operation object, etc. The operation information may include one type of operation information or a combination of multiple types of operation information.

[0096] For example, if the operation information is a combination of multiple operation information, that is, the operation time and the operation position are combined, that is, the operation information includes the operation time and the operation position. Then, in the present application, the image and the task information are associated based on the operation information to generate the first associated information, specifically, the image and the task information are associated based on the operation time and the operation position to generate the first associated information.

[0097] In one embodiment, associating the image and the task information based on the operation information to generate the first associated information includes: obtaining first matching information matching the operation information from the image, and obtaining second matching information matching the operation information from the task information, and then associating the first matching information, the second matching information and the operation information to obtain the first associated information. The first matching information is used to represent the image matching the operation information, and the second matching information is used to represent the task information matching the operation information.

[0098] For the same operation of the same target task, taking the operation information including the operation time and operation position as an example, since the screen interface on which the operation is performed is recorded in real time by the recording tool to obtain a screenshot of the screen interface, the recording tool also records the operation time and operation position of the operation in real time, so that an image matching the operation time and operation position can be directly obtained. And since the task information includes the operation time and operation position of the operation, the task information matching the operation time and operation position can be directly obtained from the task information.

[0099] Based on the above example, the screenshots of the store interface, the screenshots of the advanced experience potion area, the operation time and operation location of clicking to purchase advanced experience potions obtained through the recording tool are stored in a folder. Then, the screenshots of the store interface and the screenshots of the advanced experience potion area can be directly obtained through the operation time and operation location of clicking to purchase advanced experience potions, and used as the first matching information.

[0100] The task information includes the log of the purchase task, the operation time and operation position of clicking to purchase the advanced experience potion, the click button targeted for purchase, and the path associated with the click button. The log of the purchase task, the click button targeted for purchase, and the path associated with the click button can be obtained as the second matching information based on the operation time and operation position of clicking to purchase the advanced experience potion.

[0101] After obtaining the first matching information and the second matching information, they can be directly associated to form the first associated information, which mainly includes the operation time and operation location of clicking to purchase advanced experience potions, screenshots of the store interface, screenshots of the advanced experience potion area, logs of purchase tasks, click buttons targeted for purchase, and the path associated with click buttons.

[0102] Furthermore, whether obtaining images through recording tools or obtaining task information through SDK, delays may be stored. That is to say, the operation time corresponding to the above information may be delayed, but the delay time is fixed each time. Therefore, you only need to calculate the fixed delay time, and then you can directly include the fixed delay time into the operation time of the operation mark to determine the final operation time of the operation.

[0103] To address the problem of operation time delay, this application determines the operation time in the following way. It is necessary to first determine the time when the image is first acquired and the time when the task information is first acquired. Then, the time difference is calculated by subtracting the time when the image is first acquired from the time when the task information is first acquired to obtain the time difference, and then the time difference is included in the operation time.

[0104] For example, the time difference can be calculated by the difference between the time of first acquiring the image and the time of first acquiring the task information, that is, the fixed delay time t. When performing an operation, the operation time of this operation is t1, then the fixed delay time t can be included in the operation time t1, that is, the operation time t2 of this operation is obtained = t1 + t.

[0105] Step S203: Acquire test cases generated by operations performed on the target task.

[0106] Test cases are displayed in the form of three types of operation information: operation, operation object, and operation object type, such as Figure 5 As shown, operations include but are not limited to clicking, tapping, selecting, etc., operation objects include but are not limited to malls, settings, warehouses, etc., and types of operation objects include but are not limited to buttons, icons, entrances, etc.

[0107] The following are some test cases in the use case list, as follows:

[0108] Test case #1--[1. Click the Personalize button, 2. Click the Personalize tab, '1'];

[0109] Test case #2--[1. Enter the music listening interface, 2. Click the microphone icon, '2'];

[0110] Test case #3 - [1. Click the store button, 2. Enter the store interface, 3. Click to select the virtual attack item, '3'].

[0111] The Arabic numerals in each test case represent the operation steps for executing a target task. For example, in test case #1, the first operation step is "click the personalized button", and the second operation step is "click the personalized tab". '1' represents the case number. The operation steps in test case #2 and test case #3 are not repeated here.

[0112] Step S204: Associating the test case with the image to generate second association information.

[0113] To associate test cases with images, you need to use Figure 6 The judgment logic shown is implemented, specifically,

[0114] In one embodiment, the test case and the image are associated to generate second association information, including: using a preset recognition tool to perform text recognition on the image; if text information is recognized, using a preset language processing tool to perform semantic recognition on the operation steps in the test case to obtain the name of the operation object corresponding to the operation step; and associating the text information with the name of the operation object corresponding to the operation step to obtain the second association information.

[0115] For example, the preset recognition tool may include a recognition tool based on optical character recognition (OCR). It refers to the use of optical technology and computer technology to detect the text in the image, and then identify the text content in the image. The basic principle of OCR text recognition is to input the image to be recognized into the computer through a scanner; then the computer extracts the image of each character; and converts it into the code of Chinese characters. The Chinese characters on the image may be printed Chinese characters or handwritten Chinese characters. Then the Chinese characters in these images are recognized. For printed characters, the document data is first converted into an original black and white dot matrix image file by an optical method, and then the text in the image is converted into a text format through recognition software for further processing by the word processing software. The OCR recognition process based on traditional algorithms may include: image preprocessing, text line positioning, text line recognition and post-processing, etc. The OCR recognition process based on deep learning may include: input image, deep learning text area detection, image preprocessing, feature extraction, deep learning recognizer, deep learning post-processing, etc.

[0116] For example, in order to better locate and identify text lines and thus improve recognition accuracy, image preprocessing is usually required. Commonly used image preprocessing may include: background removal, tilt correction, perspective transformation, image enhancement, direction correction, reflection processing, inversion processing, etc.

[0117] For example, text line positioning is to locate all text lines in a document image. The accuracy of text line positioning directly affects the overall effect of subsequent text recognition and layout analysis.

[0118] For example, text line recognition is the core algorithm of OCR, which converts text line information into editable text information.

[0119] For example, post-processing can correct the recognition results based on rules and big data analysis to improve the accuracy of character recognition.

[0120] For example, let the test case be test case #3--[1. Click the store button, 2. Enter the store interface, 3. Click to select a virtual attack item, '3'], and the target task is a purchase task.

[0121] Combination Figure 3 and Figure 4 , when the tester performs the purchase task, the image at this time is Figure 3 The store interface shown, and Figure 4 The screenshot of the advanced experience potion area is shown. Then, text recognition is performed on the screenshot of the store interface and the advanced experience potion area, and text information such as "store, return, honor, friendship, advanced experience potion" can be recognized.

[0122] After the above text information is recognized, semantic recognition is performed on each operation step in test case #3, and the name of the operation object "store, virtual attack props" can be obtained.

[0123] Through the above Figure 3 , Figure 4 and identification of test case #3, it can be determined Figure 3 The text information "Shop" in the test case #3 is the same as the name of the operation object "Shop" in the operation step, which means Figure 3 can be associated with the test case, then the second association information can be generated, wherein the second association information includes the name of the operation object "store", Figure 3 , Figure 4 And test case #3 - [1. Click the store button, 2. Enter the store interface, 3. Click to select the virtual attack prop, '3'].

[0124] In another embodiment, the test case and the image are associated to generate second association information, including: using a preset recognition tool to perform text recognition on the image; if no text information is recognized, querying whether there is text information matching the image in the sample library; if so, using a preset language processing tool to perform semantic recognition on the operation steps in the test case to obtain the name of the operation object corresponding to the operation step; and associating the text information with the name of the operation object corresponding to the operation step to obtain the second association information.

[0125] For example, let the test case be test case #2--[1. Enter the music listening interface, 2. Click the microphone icon, '2'], and the target task be a voice chat task.

[0126] When the tester performs a voice chat task in the song playback interface, the images at this time include Figure 7 The song playback interface shown, and Figure 8 Then perform text recognition on the screenshots of the song playback interface and the voice icon. If no text information is recognized, you can search the sample library to see if there is a similar text in the example above. Figure 8 The text information that matches the voice icon shown, if any, is “microphone.” The sample library at least stores images of various operation objects and their corresponding names.

[0127] After the text information "microphone" is obtained, semantic recognition is performed on each operation step in test case #2, and the name of the operation object "listening to music, microphone" can be obtained.

[0128] Through the above Figure 7 , Figure 8 and identification of test case #2, it can be determined Figure 8 The text information "microphone" in the image is the same as the name of the operation object "microphone" in the operation step in test case #2, which means that the image and the test case can be associated, and the second association information can be generated, wherein the second association information includes the name of the operation object "microphone", Figure 7 , Figure 8 And test case #2--[1. Enter the music listening interface, 2. Click the microphone icon, '2'].

[0129] In the above two embodiments, a preset language processing tool is used to perform semantic recognition on the operation steps in the test case to obtain the name of the operation object corresponding to the operation step, including: searching for the operation steps in the test case; understanding the subject-verb phrase in the operation step to obtain the name of the operation object corresponding to the operation step.

[0130] For example, if the test case is test case #2--[1. Enter the music listening interface, 2. Click the microphone icon, '2'], then the verb-object phrase in each operation step in test case #2 is searched, and this verb-object phrase is used as the name of the operation object of this operation step. For example, if the verb-object phrase in operation step 1 "enter the music listening interface" is "listen to music", then "listen to music" is the name of the operation object of step 1. Similarly, the name of the operation object of step 2 is "microphone".

[0131] Furthermore, the preset recognition tools in the above two embodiments include but are not limited to OCR recognition methods, template matching algorithms, Bayesian classification algorithms, and neural network algorithms. The preset language processing tools include but are not limited to natural language processing (NLP) methods, such as text classification algorithms, word segmentation algorithms, named entity recognition algorithms, etc.

[0132] Based on the previous embodiment, it is queried whether there is text information matching the image in the sample library. If not, the operation steps performed on the image are traced back; the image is associated with the operation steps performed on the image and stored in the sample library.

[0133] For example, let the test case be test case #2--[1. Enter the music listening interface, 2. Click the microphone icon, '2'], and the target task be a voice chat task.

[0134] When the tester performs a voice chat task in the song playback interface, the images at this time include Figure 7 The song playback interface shown, and Fig. 9 Then perform text recognition on the screenshots of the song playing interface and the speaker icon. If no text information is recognized, you can search the sample library to see if there is a similar text in the example above. Fig. 9If there is no text information matching the speaker icon shown in the figure, the operation steps performed on the image can be traced back to the operation steps of "clicking the speaker icon". Then "clicking the speaker icon" can be used as a new test case and compared with Figure 7 and Fig. 9 Make association and store in sample library.

[0135] To store a new test case in the sample library, you need to first Fig.10 In the Add Tag Information page shown, add the tag keyword "speaker" and upload it before it can be stored in the sample library. The sample library stores icons in the following way:

[0136] Table 1 Sample library

[0137] Serial number address Tag Keywords Module Name 1 H:\\proj\\icon speaker Personalization 2 H:\\proj\\icon refresh Personalization

[0138] Among them, because the "speaker icon" and Figure 7 , Fig. 9 The sample library also stores Figure 7 and Fig. 9 The link address is H:\\proj\\icon.

[0139] By continuously storing new icons in the sample library and associating images with test cases, the test cases are continuously enriched, making it easier for subsequent testers to quickly identify various test cases.

[0140] Step S205: Generate association information between the test case and the task information based on the first association information and the second association information.

[0141] By associating the image and the task information through the above steps to generate the first association information, and associating the test case and the image to generate the second association information, association information between the test case and the task information can be generated based on the first association information and the second association information.

[0142] For example, if the target task is a purchase task and the test case is test case #3, the first associated information mainly includes the operation time and operation location of clicking to purchase advanced experience potion, a screenshot of the store interface, a screenshot of the advanced experience potion area, a log of the purchase task, the click button targeted by the purchase, and the path associated with the click button. The second associated information includes the name of the operation object "store", Figure 3 , Figure 4 And test case #3 - [1. Click the store button, 2. Enter the store interface, 3. Click to select the virtual attack prop, '3'].

[0143] By merging the first association information and the second association information, association information between test case #3 and task information can be generated, that is, the association information includes the operation time and operation location of clicking to purchase advanced experience potion, a screenshot of the store interface, a screenshot of the advanced experience potion area, a log of the purchase task, the click button for the purchase, and the path associated with the click button, the name of the operation object "store", Figure 3 , Figure 4 And test case #3 - [1. Click the store button, 2. Enter the store interface, 3. Click to select the virtual attack prop, '3'].

[0144] An embodiment of the present invention provides an association method, including: first obtaining an image and task information generated by an operation performed on a target task, associating the image and the task information to generate first association information, then obtaining a test case generated by the operation performed on the target task, associating the test case and the image to generate second association information, and then generating association information between the test case and the task information based on the first association information and the second association information. The present invention associates the image and task information generated by the operation performed on the target task with the test case to achieve automatic association of the test case and the task information, thereby avoiding manual operation and improving association efficiency. Furthermore, the test case is automatically associated with the task information, which is convenient for later query and operation, and improves the experience of the tester.

[0145] See also Fig.11 , Fig.11 A flowchart of another association method provided in an embodiment of the present application. Fig.11 As shown, this method is applied to Figure 1 The client 102 shown includes the following steps:

[0146] Step S1101: In response to a trigger operation performed by a recording control in a screen interface for a target task, an image generated by the operation performed for the target task is recorded, task information generated by the operation performed for the target task is obtained, and the image and task information are sent to a server.

[0147] Among them, the trigger operation includes but is not limited to click, select, slide, press, double-click and other operations.

[0148] The recording control is set on the screen interface of the target task, and the position of the recording control relative to the screen interface of the target task is not specifically limited, such as Fig.12 The recording control shown can be set in the upper left corner of the screen interface of the target task, wherein the icon of the recording control can be an icon in any form, such as a camera, lens, and other icons.

[0149] The tester opens Fig.12As shown in the game homepage, before executing the target task, you need to click the recording control on the game homepage. Then, during the execution of the target task, the entire process of the tester performing the purchase task will be recorded, including the operations performed by the tester for the purchase task and the images of each interface, etc. At the same time, the task information generated by the operations performed for the target task will also be uploaded.

[0150] For example, if the tester wants to perform a purchase task, Fig.12 Click the recording control on the game homepage shown, and then perform the purchase task to enter the Figure 3 In the store interface shown, click on the virtual attack item you want to buy, such as advanced experience potion.

[0151] After recording the entire process of the tester performing the purchase task, the screenshots of the store interface obtained during the recording and the screenshots of the operation area clicked by the tester will be recorded. Figure 4 The screenshot of the advanced experience potion area shown, as well as the task information of executing click to purchase advanced experience potions, such as operation time and operation location, screenshot of the store interface, screenshot of the advanced experience potion area, purchase task log, click button for purchase, and path associated with click button, are sent to server 104.

[0152] Step S1102: In response to a trigger operation executed on the test case, the test case is sent to the server.

[0153] When the tester clicks the recording tool, he will also click Fig.12 Click the add control “+” on the game homepage as shown to import test cases and execute the imported test cases simultaneously during the recording process.

[0154] The imported test cases are displayed in Fig.12 In the right area shown, each test case in the area is represented by a label and time, where the label refers to the label information of the test case, which is composed of the label keyword and address shown in Table 1, and the time refers to the operation time corresponding to the operation performed on the icon corresponding to the label keyword during the execution of the test case.

[0155] During the execution of any test case, any test case will be sent to the server 104 .

[0156] Step S1103: After the test case is executed, the correlation information of the test case and the task information generated by the server according to the correlation of the image, the task information and the test case is obtained.

[0157] When the test case is executed, the server 104 will feed back the correlation information of the test case and task information generated by associating the image, task information and test case to the client 102. The specific implementation process of the server 104 generating the correlation information can refer to the above steps S201 to S205, which will not be elaborated here.

[0158] Step S1104: Display a notification message based on the associated information.

[0159] When the client 102 receives the association information of the test case and the task information sent by the server 104, a notification message will be displayed, wherein the notification message is used to notify that the association between the test case and the task information is completed.

[0160] When there are multiple test cases to be executed, the trigger operation performed by the recording control in the screen interface of the target task, the image generated by the operation performed on the target task, and the task information generated by the operation performed on the target task need to be associated with multiple test cases. After the association is completed, the notification message will at least display the number of test cases successfully associated with the target task and the number of test cases unsuccessfully associated with the target task.

[0161] When there is only one test case to be executed, the trigger operation performed by the recording control in the screen interface of the target task, the image generated by the operation performed on the target task, and the task information generated by the operation performed on the target task need to be associated with this test case. After the association is completed, the notification message only shows whether this test case is successfully associated with the target task.

[0162] For example, when there are 48 test cases, click on each of the following Fig.12 The test cases in the right area shown in the figure are selected and executed. When all the test cases are executed, the client 102 receives the associated information of all the test cases and task information sent by the server 104, and then displays the generated information based on the associated information on the game homepage. Fig.13 The notification message shown shows that the total number of use cases is 48, the number of use case identifications (i.e., the number of test cases with successful association) is 27, the number of unidentified use cases (i.e., the number of test cases with unsuccessful association) is 21, and the total identification rate (i.e., the probability of successful association) is 62.79%.

[0163] In one embodiment, the method further includes: in response to a trigger operation performed on a control in an interface of the notification message; displaying task information corresponding to the test case.

[0164] For example, Fig.13The notification message also displays a "click to go" control, which is used by testers to view the specific situation of each test case. If the test case is a successfully associated test case, it at least includes the task information corresponding to the test case; if the test case is an unsuccessfully associated test case, it at least includes the label and time corresponding to this test case. By visually displaying the specific situation of the test case of the tested application, R&D personnel can iterate and modify the system and code of the application based on the specific situation of the displayed test case, thereby improving the efficiency of application development.

[0165] The embodiment of the present invention provides an association method, including: first responding to a trigger operation performed by a recording control in a screen interface for a target task, recording an image generated by the operation performed for the target task, obtaining task information generated by the operation performed for the target task, and sending the image and task information to a server, then responding to a trigger operation performed for a test case, sending the test case to the server, after the test case is executed, obtaining the association information of the test case and task information generated by the server according to the image, task information and test case through association, and displaying a notification message based on the association information. The present invention only needs to trigger the recording control and the test case in the interface to execute the target task, and a notification message can be displayed to indicate whether the test case is successfully associated with the task information generated by the operation performed for the target task, which not only realizes the automatic association of the test case and the task information, but also avoids manual operation and improves the association efficiency. Furthermore, the notification message can facilitate later inquiries and operations, thereby improving the experience of testers.

[0166] To better illustrate the association method provided in the embodiment of the present application, please refer to Fig.14 The interaction process of the association method provided in the embodiment of the present application is as follows:

[0167] Taking the target task as a game task as an example, the client loaded with the game task has a built-in SDK and recording tool. When the tester performs a button trigger operation on the game task, the SDK will report the button label, operation time and operation position of the tester's button trigger operation on the game task, and send the button label, operation time and operation position to the server. At the same time, for the button trigger operation of the game task, the recording tool will also send the image, operation position and operation time generated by each trigger operation to the server, where the image includes a full-screen screenshot of the screen where the button is located and a small picture of the operation area where the button is located.

[0168] After receiving the above information, the server matches the information obtained by the SDK and the information obtained by the recording tool based on the operation time and operation location to obtain the first associated information, namely, the button label, operation time, operation location, a full-screen screenshot of the screen where the button is located, and a small picture of the operation area where the button is located.

[0169] Furthermore, the server also performs OCR recognition on the full-screen screenshot of the screen where the button is located and the small picture of the operation area where the button is located, so as to obtain text information in the image.

[0170] In addition to the button triggering operation performed by the tester for the game task, the test case can be imported through the client and then executed on the client. During the execution of the test case, the name of the operation object corresponding to the operation step in the test case is identified through NLP, and the name of the operation object corresponding to the operation step in the test case is sent to the server.

[0171] The server matches the name of the operation object corresponding to the operation step in the test case with the text information in the image to obtain the second associated information, wherein the second associated information includes a full-screen screenshot of the screen where the name button of the operation object is located, a small picture of the operation area where the button is located, and the test case.

[0172] Finally, the server automatically associates the test case with the task information of the game task, namely, the button label, operation time, and operation position, based on the first association information and the second association information, and generates association information between the test case and the task information of the game task. This association information includes at least the full-screen screenshot of the screen where the button with the name of the operation object is located, a small picture of the operation area where the button is located, the text of the use case operation (namely, the name of the operation object corresponding to the operation step in the test case), button label, operation time, operation position, and OCR-recognized text (namely, the text information in the image).

[0173] In addition, the full-screen screenshot of the screen where the button is located and the small picture of the operation area where the button is located are subjected to OCR recognition. If no text information is obtained in the image, the tester needs to check whether there is text information matching the icon in the image in the sample library. If not, the operation steps performed on the image can be traced back, and then the icon and operation steps can be added through the client's add label information page. After adding, the icon can be recognized through NLP to store the operation steps as a new test case in the sample library, that is, the sample tagging of the test case is completed.

[0174] It should be understood that the order of execution of the steps in the above embodiment does not necessarily mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present invention.

[0175] The following is an embodiment of the device of the present invention. For details not described in detail therein, reference may be made to the corresponding method embodiment described above.

[0176] Fig.15 A schematic diagram of the structure of an association device provided by an embodiment of the present invention is shown. For the convenience of description, only the part related to the embodiment of the present invention is shown. An association device includes a first acquisition module 1501, a first association module 1502, a second acquisition module 1503, a second association module 1504 and an association information generation module 1505, which are specifically as follows:

[0177] The first acquisition module 1501 is used to acquire images and task information generated by the operation performed on the target task;

[0178] A first association module 1502, used to associate the image with the task information to generate first association information;

[0179] The second acquisition module 1503 is used to acquire the test cases generated by the operation performed on the target task;

[0180] The second association module 1504 is used to associate the test case with the image to generate second association information;

[0181] The association information generating module 1505 is used to generate association information between the test case and the task information based on the first association information and the second association information.

[0182] In a possible implementation, the first associating module 1502 is further used to: obtain operation information generated by the operation performed on the target task; and associate the image with the task information based on the operation information to generate first association information.

[0183] In a possible implementation, the first association module 1502 is also used to: obtain first matching information that matches the operation information from the image, and obtain second matching information that matches the operation information from the task information; and associate the first matching information, the second matching information, and the operation information to obtain first association information.

[0184] In a possible implementation manner, the operation information includes at least an operation time and an operation location.

[0185] In a possible implementation, the device further includes an operation time acquisition module, and the operation time acquisition module is used to acquire the operation time;

[0186] Get operation time, including:

[0187] Determine the time when the image is first acquired and the time when the mission information is first acquired;

[0188] Subtract the time when the image is first acquired from the time when the task information is first acquired to obtain the time difference;

[0189] Include the time difference in the operation time.

[0190] In one possible implementation, the second association module 1504 is also used to: use a preset recognition tool to perform text recognition on the image; if text information is recognized, use a preset language processing tool to perform semantic recognition on the operation steps in the test case to obtain the name of the operation object corresponding to the operation step; associate the text information with the name of the operation object corresponding to the operation step to obtain second association information.

[0191] In one possible implementation, the second association module 1504 is also used to: use a preset recognition tool to perform text recognition on the image; if no text information is recognized, query whether there is text information matching the image in the sample library; if so, use a preset language processing tool to perform semantic recognition on the operation steps in the test case to obtain the name of the operation object corresponding to the operation step; associate the text information with the name of the operation object corresponding to the operation step to obtain second association information.

[0192] In a possible implementation, the second association module 1504 is further used to: search for operation steps in the test case; and understand the subject-verb phrase in the operation step to obtain the name of the operation object corresponding to the operation step.

[0193] In a possible implementation, the image includes at least a screenshot of the screen interface on which the operation is performed and a screenshot of the operation area, where the operation area is an area in the screen interface;

[0194] The first acquisition module 1501 is also used to: use a preset recording tool to record the screen interface on which the operation is performed to obtain a screenshot of the screen interface; use a preset color algorithm to identify the screenshot of the screen interface to obtain a screenshot of the operation area on which the operation is performed.

[0195] In a possible implementation, the device also includes a storage module, which is used to: if the name of the operation object corresponding to the operation steps performed on the image does not exist, trace back; associate the image with the name of the operation object corresponding to the operation steps performed on the image, and store it in a sample library.

[0196] Fig.16A schematic diagram of the structure of an association device provided by an embodiment of the present invention is shown. For the convenience of description, only the part related to the embodiment of the present invention is shown. An association device includes a first operation module 1601, a second operation module 1602, an acquisition module 1603 and a display module 1604, which are as follows:

[0197] The first operation module 1601 is used to respond to the trigger operation performed by the recording control in the screen interface of the target task, record the image generated by the operation performed on the target task, obtain the task information generated by the operation performed on the target task, and send the image and the task information to the server;

[0198] The second operation module 1602 is used to send the test case to the server in response to the trigger operation performed on the test case;

[0199] The acquisition module 1603 is used to acquire the correlation information of the test case and the task information generated by the server according to the correlation of the image, the task information and the test case after the test case is executed;

[0200] The display module 1604 is used to display a notification message based on the associated information, wherein the notification message is used to notify that the association between the test case and the task information is completed.

[0201] In a possible implementation, the device further includes a query module, and the query module is used to: respond to a trigger operation performed on a control in an interface of a notification message; and display task information corresponding to the test case.

[0202] Fig.17 Schematic diagram of a computer device provided by an embodiment of the present invention. Fig.17 As shown, the computer device 17 of this embodiment includes: a processor 1701, a memory 1702, and a computer program 1703 stored in the memory 1702 and executable on the processor 1701. When the processor 1701 executes the computer program 1703, the steps in the above-mentioned various association method embodiments are implemented, for example Figure 2 Steps 201 to 205 shown in FIG. Fig.11 Alternatively, when the processor 1701 executes the computer program 1703, the functions of each module / unit in the above-mentioned association device embodiments are implemented, for example Fig.15 The functions of the modules / units 1501 to 1505 shown, or as Fig.16 Functionality of modules / units 1601 to 1604 shown.

[0203] The present invention also provides a readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, it is used to implement the association methods provided in the above-mentioned various implementation modes.

[0204] Among them, the readable storage medium can be a computer storage medium or a communication medium. The communication medium includes any medium that facilitates the transmission of a computer program from one place to another. The computer storage medium can be any available medium that can be accessed by a general or special-purpose computer. For example, a readable storage medium is coupled to a processor so that the processor can read information from the readable storage medium and write information to the readable storage medium. Of course, the readable storage medium can also be a component of the processor. The processor and the readable storage medium can be located in an application-specific integrated circuit (ASIC). In addition, the ASIC can be located in a user device. Of course, the processor and the readable storage medium can also exist in a communication device as discrete components. The readable storage medium can be a read-only memory (ROM), a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device, etc.

[0205] The present invention also provides a program product, which includes an execution instruction, which is stored in a readable storage medium. At least one processor of a device can read the execution instruction from the readable storage medium, and at least one processor executes the execution instruction so that the device implements the association method provided by the above various embodiments.

[0206] In the embodiments of the above-mentioned devices, it should be understood that the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), etc. The general-purpose processor may be a microprocessor or the processor may be any conventional processor, etc. The steps of the method disclosed in the present invention may be directly embodied as being executed by a hardware processor, or may be executed by a combination of hardware and software modules in the processor.

[0207] The above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method of association, characterized in that: Applied to the server, including: Obtaining images and task information generated by operations performed on a target task; Associating the image with the task information to generate first associated information; Obtaining test cases generated by operations performed on the target task; Associating the test case with the image to generate second association information; Based on the first association information and the second association information, association information between the test case and the task information is generated.

2. The association method according to claim 1, characterized in that: The step of associating the image with the task information to generate first associated information includes: Acquire operation information generated by the operation performed on the target task; The image and task information are associated with each other based on the operation information to generate first associated information.

3. The association method according to claim 2, characterized in that: The step of associating the image with the task information based on the operation information to generate first association information includes: Acquire first matching information that matches the operation information from the image, and acquire second matching information that matches the operation information from the task information; The first matching information, the second matching information, and the operation information are associated to obtain the first associated information.

4. The association method according to claim 2 or 3, characterized in that: The operation information at least includes operation time and operation location.

5. The association method according to claim 4, characterized in that: The method further comprises: Get operation time; The acquisition operation time includes: Determine the time when the image is first acquired and the time when the task information is first acquired; Subtract the time when the image is first acquired from the time when the task information is first acquired to obtain a time difference; The time difference is included in the operation time.

6. The association method according to claim 1, characterized in that: The step of associating the test case with the image to generate second association information includes: Performing text recognition on the image using a preset recognition tool; If text information is recognized, a preset language processing tool is used to perform semantic recognition on the operation steps in the test case to obtain the name of the operation object corresponding to the operation step; The text information is associated with the name of the operation object corresponding to the operation step to obtain the second association information.

7. The association method according to claim 1, characterized in that: The step of associating the test case with the image to generate second association information includes: Performing text recognition on the image using a preset recognition tool; If no text information is recognized, query whether there is text information matching the image in the sample library; If it exists, use the preset language processing tool to perform semantic recognition on the operation steps in the test case to obtain the name of the operation object corresponding to the operation step; The text information is associated with the name of the operation object corresponding to the operation step to obtain the second association information.

8. The association method according to claim 6 or 7, characterized in that: The using of a preset language processing tool to semantically identify the operation steps in the test case to obtain the name of the operation object corresponding to the operation step includes: Find the operation steps in the test case; The verb-object phrases in the operation steps are understood to obtain the names of the operation objects corresponding to the operation steps.

9. The association method according to any one of claims 1-3, 5-7, characterized in that: The image at least includes a screenshot of the screen interface on which the operation is performed and a screenshot of the operation area, wherein the operation area is an area in the screen interface; The step of acquiring an image generated by an operation performed on a target task includes: Using a preset recording tool to record the screen interface on which the operation is performed to obtain a screenshot of the screen interface; The screenshot of the screen interface is identified using a preset color algorithm to obtain a screenshot of the operation area where the operation is performed.

10. The association method according to claim 7, characterized in that: The method further comprises: If it does not exist, trace back the name of the operation object corresponding to the operation steps performed on the image; The image is associated with the name of the operation object corresponding to the operation step performed on the image, and the names are stored in the sample library.

11. A method of association, characterized in that: Applied to the client, including: In response to a trigger operation performed by a recording control in a screen interface for a target task, an image generated by the operation performed for the target task is recorded, task information generated by the operation performed for the target task is acquired, and the image and task information are sent to a server; In response to a trigger operation performed on a test case, sending the test case to a server; After the test case is executed, obtaining the correlation information of the test case and the task information generated by the server according to the correlation of the image, the task information and the test case; A notification message is displayed based on the association information, wherein the notification message is used to notify that the association between the test case and the task information is completed.

12. A correlation device, characterized in that: include: A first acquisition module is used to acquire images and task information generated by operations performed on a target task; A first association module, used to associate the image with the task information to generate first association information; A second acquisition module is used to acquire test cases generated by operations performed on the target task; A second association module, used to associate the test case with the image to generate second association information; The association information generating module is used to generate association information between the test case and task information based on the first association information and the second association information.

13. A correlation device, characterized in that: include: A first operation module is used to respond to a trigger operation performed by a recording control in a screen interface for a target task, record an image generated by the operation performed for the target task, obtain task information generated by the operation performed for the target task, and send the image and task information to a server; A second operation module, configured to send the test case to a server in response to a trigger operation performed on the test case; An acquisition module, configured to acquire, after the execution of the test case is completed, the association information of the test case and the task information generated by the server by associating the image, the task information and the test case; A display module is used to display a notification message based on the associated information, wherein the notification message is used to notify that the association between the test case and the task information is completed.

14. A computer device, characterized in that: comprising a memory, and one or more processors communicatively connected to the memory; The memory stores instructions that can be executed by the one or more processors. The instructions are executed by the one or more processors to enable the one or more processors to implement the association method according to claim 1 to 10 or 11.

15. A computer-readable storage medium, characterized in that: The invention comprises a program or an instruction, and when the program or the instruction is executed on a computer, the association method according to claim 1 to 10 or 11 is implemented.