Information processing method, apparatus, device, medium, and program product

Abstract

This disclosure provides an information processing method, apparatus, device, storage medium, and computer program product, relating to the field of computer technology. The method includes: obtaining exposure operations for the targeted information to be tested based on its placement location information; displaying a first object interface of the targeted information to be tested, wherein the targeted information to be tested is targeted information in a production environment; obtaining data of the targeted information to be tested, including type information of the targeted information to be tested; and performing multiple first test operations based on the type information of the targeted information to be tested, using the first object interface, to obtain the object interface test results of the targeted information to be tested. This method enables testing the display of targeted information in a production environment, and can detect abnormal ad display caused by production environment factors, thereby improving the efficiency of targeted information verification.

Description

Technical Field

[0001] This disclosure relates to the field of computer technology, and more specifically, to an information processing method, apparatus, electronic device, computer-readable storage medium, and computer program product. Background Technology

[0002] In related technologies, when verifying targeted information (such as advertisements), the materials that make up the advertisement are usually verified in a test environment according to predetermined rules. However, this cannot detect abnormal advertisement display caused by production environment factors, resulting in a high rate of advertisement exposure accidents in the production environment.

[0003] As mentioned above, improving the efficiency of targeted information verification to reduce the accident rate of targeted information exposure in the production environment has become an urgent problem to be solved.

[0004] The information disclosed in the background section is only intended to enhance the understanding of the background of this disclosure, and therefore may include information that does not constitute prior art known to those skilled in the art. Summary of the Invention

[0005] The purpose of this disclosure is to provide an information processing method, apparatus, device, readable storage medium, and computer program product that improves the verification efficiency of targeted information to at least a certain extent.

[0006] Other features and advantages of this disclosure will become apparent from the following detailed description, or may be learned in part from practice of this disclosure.

[0007] This disclosure provides an information processing method, comprising: obtaining the target orientation information to be tested based on the placement location information of the target orientation information to be tested; displaying a first object interface of the target orientation information to be tested, wherein the target orientation information to be tested is target orientation information in a production environment; obtaining data of the target orientation information to be tested, wherein the data of the target orientation information to be tested includes type information of the target orientation information to be tested; and performing a plurality of first test operations based on the first object interface according to the type information of the target orientation information to be tested, thereby obtaining an object interface test result of the target orientation information to be tested.

[0008] This disclosure provides an information processing apparatus, comprising: a targeted information exposure operation execution module, configured to acquire the targeted information to be tested based on the placement location information of the targeted information to be tested, and display a first object interface of the targeted information to be tested, wherein the targeted information to be tested is targeted information in a production environment; a targeted information data acquisition module, configured to acquire data of the targeted information to be tested, wherein the data of the targeted information to be tested includes type information of the targeted information to be tested; and an object interface testing module, configured to perform multiple first test operations based on the type information of the targeted information to be tested and on the first object interface to obtain the object interface test result of the targeted information to be tested.

[0009] According to an embodiment of this disclosure, the object interface testing module includes: a first interface element acquisition module, used to acquire a first interface element from the displayed first object interface; a first interface element verification module, used to compare the first interface element with its corresponding information in the data of the orientation information to be tested; and a first object interface test result acquisition module, used to obtain the object interface test result of the orientation information to be tested as passed if it is determined that the first interface element matches its corresponding information in the data of the orientation information to be tested.

[0010] According to an embodiment of this disclosure, the data of the orientation information to be tested includes the jump type information of the orientation information to be tested; the object interface testing module includes: a first automated operation execution module, used to perform a first automated operation on the displayed first object interface to display a second object interface of the orientation information to be tested; a target element existence determination module, used to determine whether there is a target element corresponding to the jump type information on the second object interface according to the jump type information of the orientation information to be tested; and a second object interface test result acquisition module, used to obtain the object interface test result of the orientation information to be tested as passed if it is determined that there is a target element corresponding to the jump type information on the second object interface.

[0011] According to an embodiment of this disclosure, the object interface testing module further includes: a second interface element acquisition module, used to acquire a second interface element from the displayed second object interface; a second interface element verification module, used to compare the second interface element with its corresponding information in the data of the orientation information to be tested; the second object interface test result acquisition module is further used to: if it is determined that there is a target element on the second object interface corresponding to the jump type information, and the second interface element matches its corresponding information in the data of the orientation information to be tested, obtain the object interface test result of the orientation information to be tested as passed.

[0012] According to an embodiment of this disclosure, the target element includes a return element; the object interface testing module further includes: a second automated operation execution module, used to perform a second automated operation on the return element on the displayed second object interface to obtain a second automated operation result interface; and a third object interface test result obtaining module, used to obtain the object interface test result of the test orientation information as passed when it is determined that there is a return element on the second object interface corresponding to the jump type information, and the second automated operation result interface is the first object interface.

[0013] According to one embodiment of this disclosure, the object interface testing module includes: a third interface element recognition module, used to recognize a third interface element in the first object interface; a third automated operation execution module, used to perform a third automated operation on the third interface element on the displayed first object interface to display a third automated operation result interface; a fourth automated operation execution module, used to perform a fourth automated operation on the displayed third automated operation result interface to obtain a fourth automated operation result; and a fourth object interface test result obtaining module, used to obtain a pass result for the object interface test of the target orientation information when the fourth automated operation result is determined to be canceling the display of the first object interface.

[0014] According to one embodiment of this disclosure, the apparatus further includes: a material data verification rule acquisition module, configured to acquire material data verification rules for the orientation information to be tested, the material data verification rules including multiple verification levels, the multiple verification levels being used to verify multiple fields in the data of the orientation information to be tested respectively; a material data verification module, configured to verify multiple fields of the data of the orientation information to be tested according to the material data verification rules of the orientation information to be tested, according to the corresponding verification levels, to obtain the material data verification result of the orientation information to be tested; and a configuration preview test result acquisition module, configured to obtain the configuration preview test result of the orientation information to be tested based on the material data verification result of the orientation information to be tested and the object interface test result of the orientation information to be tested.

[0015] According to an embodiment of this disclosure, the plurality of verification levels includes at least one of the following: a first verification level, a second verification level, a third verification level, a fourth verification level, and a fifth verification level; wherein, when verifying the first field in the data of the orientation information to be tested according to the first verification level, verification is deemed successful if the value of the first field is the same as a first preset content; or verification is deemed successful if the value of the first field is different from the first preset content; when verifying the second field in the data of the orientation information to be tested according to the second verification level, verification is deemed successful if the value of the second field is the same as one of a plurality of second preset contents; when verifying the third field in the data of the orientation information to be tested according to the third verification level, verification is deemed successful if the value of the third field contains a third preset content; when verifying the fourth field in the data of the orientation information to be tested according to the fourth verification level, verification is deemed successful if the value of the fourth field is empty; or verification is deemed successful if the value of the fourth field is not empty; when verifying the fifth field in the data of the orientation information to be tested according to the fifth verification level, the verification of the fifth field is skipped.

[0016] According to one embodiment of this disclosure, the type information of the orientation information to be tested includes the delivery location information of the orientation information to be tested; the device further includes: a first orientation information identifier acquisition module, used to acquire the identifier of the orientation information to be tested; the orientation information data acquisition module is further used to obtain the data of the orientation information to be tested based on the identifier of the orientation information to be tested.

[0017] According to an embodiment of this disclosure, the apparatus further includes: a targeted information backup data acquisition module, used to acquire targeted information backup data in a production environment; a candidate targeted information acquisition module, used to acquire source information, status information, deployment resource information, type information, initiator object identification information, test result information, and data change information of candidate targeted information from the targeted information backup data; a candidate targeted information filtering module, used to determine whether to identify the candidate targeted information as the targeted information to be tested based on the source information, status information, deployment resource information, type information, initiator object identification information, test result information, and data change information of the candidate targeted information; and a first targeted information to be tested identification acquisition module, further used to obtain an identifier of the candidate targeted information as the targeted information to be tested when the candidate targeted information is identified as the targeted information to be tested.

[0018] According to one embodiment of this disclosure, the apparatus further includes: a whitelist account acquisition module, used to acquire a target target identifier whitelist; a test target identifier acquisition module, used to acquire a test target identifier from the target target identifier whitelist; the targeted information exposure operation execution module is further used to perform an operation to retrieve targeted information at the location corresponding to the placement location information of the targeted information to be tested, based on the test target identifier; the apparatus further includes: a second targeted information identifier acquisition module, used to acquire the identifier of the targeted information to be tested from the reported display data of the first object interface; the targeted information data acquisition module is further used to acquire the data of the targeted information to be tested based on the identifier of the targeted information to be tested.

[0019] According to an embodiment of this disclosure, the object interface test result of the orientation information to be tested includes the data reporting verification result of the orientation information to be tested; the plurality of first test operations include target automated operations; the object interface test module includes: a data reporting success judgment module, used to determine whether the target operation data corresponding to the target automated operation has been successfully reported; a target operation data acquisition module, used to acquire the target operation data when it is determined that the target operation data has been successfully reported; and a reporting data verification module, used to verify multiple fields of the target operation data according to corresponding verification levels to obtain the data reporting verification result of the orientation information to be tested.

[0020] This disclosure provides an apparatus including: a memory, a processor, and executable instructions stored in the memory and executable in the processor, wherein the processor, when executing the executable instructions, implements any of the methods described above.

[0021] This disclosure provides a computer-readable storage medium having computer-executable instructions stored thereon, which, when executed by a processor, implement any of the methods described above.

[0022] This disclosure provides a computer program product or computer program including computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the methods provided in the various optional implementations described above.

[0023] The information processing method provided in the embodiments of this disclosure obtains the targeted information to be tested based on the placement location information of the targeted information in the production environment to be tested, displays the first object interface of the targeted information to be tested, and then obtains the data of the targeted information to be tested, including the type information of the targeted information to be tested. Based on the type information of the targeted information to be tested, multiple first test operations are performed on the displayed first object interface to obtain the object interface test results of the targeted information to be tested. By performing corresponding exposure operations according to the placement location of the targeted information and performing corresponding object interface tests according to the type of the targeted information, the display of targeted information in the production environment is tested. It can detect abnormal display of advertisements caused by production environment factors, thereby improving the efficiency of targeted information verification and reducing the exposure accident rate of targeted information in the production environment.

[0024] It should be understood that the above general description and the following detailed description are merely exemplary and do not limit this disclosure. Attached Figure Description

[0025] The above and other objects, features and advantages of this disclosure will become more apparent from a detailed description of exemplary embodiments thereof with reference to the accompanying drawings.

[0026] Figure 1 A schematic diagram of a system structure according to an embodiment of this disclosure is shown.

[0027] Figure 2 A flowchart of an information processing method according to an embodiment of this disclosure is shown.

[0028] Figure 3A An example illustration shows a type of ad placement in an application.

[0029] Figure 3B An example illustration shows another type of ad placement in an application.

[0030] Figure 3C An exemplary diagram illustrates an exposure incident of another type of ad placement in an application.

[0031] Figure 3D An exemplary illustration shows a successful exposure diagram of another type of ad placement in an application.

[0032] Figure 4 A flowchart illustrating another information processing method in an embodiment of this disclosure is shown.

[0033] Figure 5 This is a flowchart illustrating another information processing method according to an exemplary embodiment.

[0034] Figure 6 It shows Figure 5The step S502 shown is a schematic diagram of the processing procedure in one embodiment.

[0035] Figure 7 It is based on Figure 6 The diagram illustrates one implementation of data filtering.

[0036] Figure 8 It is based on Figure 6 The diagram illustrates one method for verifying advertising material data.

[0037] Figure 9 It is based on Figures 2 to 7 The diagram illustrates one implementation of data access.

[0038] Figure 10 It shows Figure 2 The step S206 shown is a schematic diagram of the processing procedure in one embodiment.

[0039] Figure 11 It shows Figure 2 The step S206 shown is a schematic diagram of the processing procedure in another embodiment.

[0040] Figure 12 It shows Figure 2 The diagram shows a processing procedure for step S206 in another embodiment.

[0041] Figure 13 It shows Figure 2 The step S206 shown is a schematic diagram of the processing procedure in another embodiment.

[0042] Figure 14 It shows Figure 2 The step S206 shown is a schematic diagram of the processing procedure in another embodiment.

[0043] Figure 15 It shows Figure 2 The step S206 shown is a schematic diagram of the processing procedure in another embodiment.

[0044] Figure 16 It is based on Figures 10 to 15 The diagram illustrates one implementation of UI automation testing.

[0045] Figure 17 It is based on Figures 2 to 16 The diagram illustrates one implementation of information processing.

[0046] Figure 18 It is based on Figures 2 to 17 The diagram shows an information processing system architecture.

[0047] Figure 19 A block diagram of an information processing apparatus according to an embodiment of the present disclosure is shown.

[0048] Figure 20 A block diagram of another information processing apparatus according to an embodiment of the present disclosure is shown.

[0049] Figure 21 A schematic diagram of the structure of an electronic device according to an embodiment of the present disclosure is shown. Detailed Implementation

[0050] Exemplary embodiments will now be described more fully with reference to the accompanying drawings. However, these exemplary embodiments can be implemented in many forms and should not be construed as limited to the examples set forth herein; rather, they are provided so that this disclosure will be more comprehensive and complete, and will fully convey the concept of the exemplary embodiments to those skilled in the art. The drawings are merely illustrative of this disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and therefore repeated descriptions of them will be omitted.

[0051] Furthermore, the described features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. Numerous specific details are provided in the following description to give a thorough understanding of embodiments of this disclosure. However, those skilled in the art will recognize that the technical solutions of this disclosure can be practiced with one or more of the specific details omitted, or other methods, apparatuses, steps, etc., can be employed. In other instances, well-known structures, methods, apparatuses, implementations, or operations are not shown or described in detail to avoid obscuring various aspects of this disclosure.

[0052] Furthermore, in the description of this disclosure, unless otherwise expressly specified and limited, terms such as "connection" should be interpreted broadly, for example, meaning an electrical connection or the ability to communicate with each other; it can mean a direct connection or an indirect connection through an intermediate medium. "A plurality of" means at least two, such as two, three, etc., unless otherwise expressly and specifically limited. Those skilled in the art can understand the specific meaning of the above terms in this disclosure according to the specific circumstances.

[0053] The terminology used in the embodiments of this disclosure is explained below.

[0054] Advertisement identification (Aid) is a unique identifier for an advertisement.

[0055] Advertiser Identifier: User identification, abbreviated as Uid, uniquely identifies an advertiser.

[0056] Advertisement key-value data: Advertisement information, abbreviated as Adinfo, is key-value data of advertisements stored in the database, containing commonly used data fields for specified advertisements.

[0057] The targeted information mentioned in this embodiment refers to information that is pushed to a target object, such as an advertisement. This embodiment will use an advertisement as an example for explanation.

[0058] Figure 1 An exemplary system architecture 10 is shown that the information processing methods and apparatus of this disclosure can be applied.

[0059] like Figure 1 As shown, system architecture 10 may include terminal device 102, network 104, server 106, and database 108. Terminal device 102 may be various electronic devices with a display screen and supporting input and output, including but not limited to smartphones, tablets, laptops, desktop computers, wearable devices, virtual reality devices, smart home devices, in-vehicle terminals, etc. Network 104 is used as a medium to provide a communication link between terminal device 102 and server 106. Network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, etc. Server 106 may be a server or server cluster providing various services. Database 108 may be large database software located on a server or small database software installed on a computer, used for storing data.

[0060] Users can use terminal device 102 to interact with server 106 and database 108 via network 104 to receive or send data. For example, terminal device 102 can be a testing device. Users can view advertisements through an application on terminal device 102, and the corresponding viewing data can be uploaded to server 106 for processing via network 104, or uploaded to database 108 for storage via network 104. As another example, users can use a testing program on terminal device 102 to transmit test commands to server 106 via network 104, enabling server 106 to perform automated testing on specified advertisements.

[0061] Server 106 can also receive data from or send data to database 108 via network 104. For example, server 106 can be a backend processing server used to run cloud devices and test the advertising user interface on them, using advertising data obtained from database 108 via network 104 for verification. Alternatively, server 106 can store the test results of the advertising user interface in database 108 for safekeeping.

[0062] It should be understood that Figure 1The number of terminal devices, networks, and servers shown is merely illustrative. Depending on implementation needs, any number of terminal devices, networks, and servers can be included.

[0063] As mentioned above, some related technologies use methods that verify the creative materials in a test environment to test or validate advertisements. However, these related technical solutions have the following drawbacks:

[0064] 1) Only the ad creative data is validated, and the user interface (UI) level of the ad is not validated. Therefore, it is impossible to detect abnormalities caused by third-party factors such as the client displaying the ad or the updated version.

[0065] 2) There is a lack of methodology for testing right shifts, and no process for inspecting advertisements in the production environment;

[0066] 3) The relevant advertising verification scheme is not suitable for business scenarios in the application where there are multiple ad slots and multiple ad styles.

[0067] Therefore, this disclosure provides an information processing method that, based on the location information of the targeted information in the production environment to be tested, obtains the targeted information to be tested, displays the first object interface of the targeted information to be tested, then obtains the data of the targeted information to be tested, including the type information of the targeted information to be tested, and performs multiple first test operations based on the displayed first object interface according to the type information of the targeted information to be tested, and obtains the object interface test results of the targeted information to be tested, so as to realize the testing of the display of targeted information in the production environment.

[0068] Figure 2 This is a flowchart illustrating an information processing method according to an exemplary embodiment. For example... Figure 2 The method shown can be applied, for example, to the server of the above system, or to the terminal device of the above system.

[0069] refer to Figure 2 The method 20 provided in this embodiment may include the following steps.

[0070] In step S202, the target orientation information is obtained based on the delivery location information of the target orientation information, and the first object interface of the target orientation information is displayed. The target orientation information is the orientation information in the production environment.

[0071] In some embodiments, taking targeted information as an example of advertising, the placement location can be an ad slot. For the same application undergoing ad testing, multiple different types of ad slots can be included; examples of different types of ad slots are as follows... Figures 3A to 3DAs shown. For different types of ad placements, a request can be made to the connected server to retrieve the ad to be tested, and then the ad can be displayed. The exposure operation performed on the ad display can be different, such as a refresh operation, a page opening operation, an output (query content) operation, etc. The first object interface of the ad to be tested is displayed, which can be a user interface (UI) for subsequent testing and verification.

[0072] In some embodiments, verifying advertisements in the production environment can be achieved by executing a random inspection process for production environment advertisements. This involves logging into the application with a test account, invoking the UI automation module, and simulating user actions to retrieve advertisements. This allows for automated testing of the rotation of advertisements across various ad slots within the application. For a detailed implementation of the random inspection process for production environment advertisements, please refer to [link / reference needed]. Figure 4 .

[0073] In other embodiments, advertisements in the production environment are validated, or a configuration preview advertisement validation process is executed to validate advertisements newly added or with data changes within a preset period. The advertisement creative data validation module and the UI automation module can be invoked separately to perform different dimensions of testing and validation on specific advertisements. For detailed implementation methods, please refer to... Figures 5 to 9 .

[0074] In step S204, data of the orientation information to be tested is obtained, including the type information of the orientation information to be tested.

[0075] In some embodiments, such as in a random inspection process for advertisements in a production environment, after retrieving the advertisement to be tested, the identifier of the advertisement to be tested can be obtained from the reported data, and then the identifier of the advertisement to be tested can be retrieved from the targeting information backup database (e.g., Figure 18 Retrieve the Adinfo of the ad to be tested from the ad backup database 1804 in the database, and write it back to the local database (e.g., ...). Figure 18 The local database (1806) is used in [the database]. For detailed implementation methods, please refer to [the relevant documentation]. Figure 4 , Figure 9 and Figure 18 .

[0076] In other embodiments, for example, during the configuration preview ad verification process, the Adinfo of the filtered ads to be tested is stored in a local database (e.g., Figure 18 The data can be retrieved from the local database (1806) for subsequent automated testing. For detailed implementation instructions, please refer to... Figures 5 to 9 as well as Figure 18 .

[0077] In some embodiments, for example, the type information of the targeting information to be tested may include ad placement information and ad style information. Ad placement information refers to the placement location information of the targeting information to be tested. Ad style information can be different ad formats, such as video, page, mini-program, etc.

[0078] In step S206, based on the type information of the orientation information to be tested, multiple first test operations are performed on the first object interface to obtain the object interface test results of the orientation information to be tested.

[0079] In some embodiments, for example, the type information of the targeting information to be tested can be one or more fields in the Adinfo, such as the two fields of ad placement information and ad style information. Each ad type, i.e., a set of ad type fields, can correspond to a unique UI automation test case. Therefore, the corresponding UI automation test case can be invoked to perform the test based on the type information of the targeting information to be tested.

[0080] In some embodiments, for example, a UI automation module can be invoked to perform multiple first test operations to conduct user interface testing on the advertisement to be tested. After determining the automated test case scheduling based on the advertisement type, the advertisement automation test operations are performed, which may include UI element verification operations, jump interface testing, etc. After the functional test is completed, the data report of the advertisement can also be verified. Finally, the automated test result data can also be stored in a local database (e.g., Figure 18 The UI automation testing implementation details can be found in the local database (1806). Figures 10 to 16 .

[0081] In some embodiments, after the advertisement under test has completed functional and data testing in UI automation testing, the UI automation module can store information such as test results, key page screenshots during the process, and test log links into a local database (e.g., Figure 18 The local database (1806) is used by the report dashboard module, such as... Figure 17 As shown. For a detailed implementation guide of the report dashboard module, please refer to... Figure 18 .

[0082] According to the information processing method provided in this disclosure, the targeting information to be tested is obtained based on the placement location information of the targeting information in the production environment to be tested. A first user interface of the targeting information to be tested is displayed. Then, the data of the targeting information to be tested, including the type information of the targeting information to be tested, is obtained. Based on the type information of the targeting information to be tested, multiple first test operations are performed on the displayed first user interface to obtain the user interface test result of the targeting information to be tested. By displaying the targeting information according to its placement location and performing corresponding user interface tests according to the type of targeting information, the display of targeting information in the production environment is tested. This method can detect abnormal display of advertisements caused by production environment factors, thereby improving the efficiency of targeting information verification and reducing the exposure accident rate of targeting information in the production environment.

[0083] Figures 3A to 3D An example illustration shows a diagram of various types of ad placements in an application.

[0084] Figure 3A An example illustration shows a type of ad placement in an application. Figure 3A As shown, this type of ad placement in the application is located on the "Moments" interface. "Moments" displays publicly available content from virtual "friends" logged into the application's account to achieve certain social functions. The user interface with the "Ad" label, bounded by a border, is the first user interface for the targeted information provided by the application to the corresponding account.

[0085] Figure 3B An example illustration shows another type of ad placement in an application. For example... Figure 3B As shown, this type of ad placement in the application is on the "Mini Program" redirect interface. A "Mini Program" is a subprogram that can perform specific commercial functions. This redirect interface has an "Ad" label. The redirect interface is the first user interface for the application to provide targeted information to the corresponding account. You can enter your mobile phone number on this redirect interface, and then that mobile phone number can obtain relevant information about the ad.

[0086] Figure 3C An exemplary illustration shows an exposure incident of another type of ad placement in an application. For example... Figure 3C As shown, this type of ad placement in the application is located on the content interface of the "Official Account," which is a subpage that can display updated content. The "Ad" label is displayed after the main text, serving as the application's primary user interface for targeted information provided to the corresponding account. The text direction on this interface is incorrect, indicating an ad exposure issue.

[0087] Figure 3D This example illustrates a successful exposure diagram of yet another type of ad placement in an application. For instance... Figure 3DAs shown, this type of ad placement in the application is in the title list interface of "Subscription Accounts". "Subscription Accounts" is a subpage that can display updated content to users who have subscribed to the "Account". The subscription account title interface with the "Ad" label and bordered by a box is the first user interface of the subscription account ads provided by the application for the corresponding account.

[0088] Figure 4 This is a flowchart illustrating another information processing method according to an exemplary embodiment. For example... Figure 4 As shown, the differences from the above embodiments are: Figure 4 This method, for example, can be applied to random inspections of advertising in production environments. Figure 4 The method shown can be applied, for example, to the server of the above system, or to the terminal device of the above system.

[0089] In step S402, the whitelist of target delivery object identifiers is obtained.

[0090] In some embodiments, a whitelist of target audience identifiers can be pre-configured. The target audience identifier can be a test account of the application used to display the advertisement to be tested. Accounts in the whitelist are not subject to the same restrictions as ordinary accounts, such as the number of advertisements displayed or the time, so that the required number of advertisements can be retrieved during testing.

[0091] In step S404, the test target identifier is obtained from the target target identifier whitelist.

[0092] In some embodiments, the configuration of a specified whitelist test account can be read to obtain the test account (i.e., the test deployment object identifier) ​​and trigger the inspection process.

[0093] In step S406, based on the test target identifier, the operation of retrieving targeting information is performed at the location corresponding to the targeting information to be tested.

[0094] In some embodiments, the UI automation module can be invoked during the production environment advertising inspection process (the implementation of the UI automation module can be found in [reference]). Figures 10 to 14 This simulates a user logging into the application's test account to perform ad-pushing operations.

[0095] In some embodiments, advertisements can be randomly and continuously pulled for testing at a preset frequency.

[0096] In some embodiments, ads from different types of ad slots in the application can be pulled in turn for testing; in other embodiments, ads from a particular type of ad slot with more ad exposure problems can be tested specifically according to actual needs.

[0097] In step S408, the identifier of the orientation information to be tested is obtained from the display data of the first object interface reported.

[0098] In some embodiments, display data related to ad impressions, clicks, and redirects in the production environment are reported to the data center platform, such as ad identifiers, time, and user identifiers, for subsequent statistical analysis of ad performance. The identifier of the ad to be tested can be obtained from the reported ad impression data.

[0099] In step S410, the data of the orientation information to be tested is obtained according to the identifier of the orientation information to be tested.

[0100] In some embodiments, the identifier (Aid) of the advertisement to be tested can be used to back up the targeting information database from the production environment (e.g., Figure 18 Retrieve detailed ad data (Adinfo) of the ad to be tested from the ad backup database 1804, and write the Adinfo of the ad to be tested back to the local database (e.g., Figure 18 The local database (1806) is used for data verification.

[0101] In step S412, based on the type information in the data of the orientation information to be tested, multiple first test operations are performed on the first object interface to obtain the object interface test results of the orientation information to be tested.

[0102] In some embodiments, the type of the ad to be tested can be determined in the Adinfo information according to the Aid of the ad to be tested, and subsequent automated testing and verification can be performed accordingly. For specific implementation, please refer to step S206.

[0103] In some embodiments, error (failure) data from the user interface test results can be fed back, the notification module can be invoked to notify the results, and the test data can be synchronized to the report dashboard module (e.g., Figure 18 The data dashboard module 1818 in the middle is used for visualization.

[0104] According to the information processing method provided in this disclosure, by simulating user exposure to advertisements in a production environment, the identifier of the exposed advertisement is obtained from the reported data, and the corresponding advertisement type is obtained according to the advertisement identifier. The UI automated testing process is then carried out according to the advertisement type, which can detect production environment advertisement problems as early as possible, effectively improve the production environment advertisement experience, and reduce the production environment advertisement accident rate.

[0105] Figure 5 This is a flowchart illustrating another information processing method according to an exemplary embodiment. For example... Figure 5 As shown, the differences from the above embodiments are: Figure 5This method, for example, is applied to the configuration preview verification of advertisements in a production environment. Figure 5 The method shown can be applied, for example, to the server of the above system, or to the terminal device of the above system.

[0106] In step S502, the identifier of the orientation information to be tested is obtained.

[0107] In some embodiments, when performing the configuration preview ad verification process, the ad to be tested can be specified via Aid. For example, the notification module (e.g.) can be monitored. Figure 18 The notification module 1808 in the middle) provides timed notifications from the targeted information backup database (e.g. Figure 18 The system retrieves newly added or modified advertisements within a preset period from the advertisement backup database (1804), calls the data filtering module to filter them, and then stores the filtered advertisement data into a local database (e.g., ...). Figure 18 The data is retrieved from the local database (1806) for data validation. For detailed implementation methods of data filtering, please refer to... Figure 6 and Figure 7 .

[0108] In step S504, the data of the orientation information to be tested is obtained according to the identifier of the orientation information to be tested.

[0109] In some embodiments, the filtered advertisements to be tested can be identified and the data access module (see reference) can be invoked. Figure 18 Data access module 902 in Figure 17 as well as Figure 9 From local database (e.g.) Figure 18 Retrieve the corresponding Adinfo data from the local database 1806.

[0110] In step S506, the material data verification rules for the orientation information to be tested are obtained. The material data verification rules include multiple verification levels, which are used to verify multiple fields in the data of the orientation information to be tested.

[0111] In some embodiments, the ad creative data verification module can be invoked (see reference). Figure 18 Data verification module 8002 in Figure 17 as well as Figure 8 The Adinfo data for the production environment is validated according to specified rules to ensure that the data content stored in the database meets the expected requirements.

[0112] In step S508, according to the material data verification rules of the orientation information to be tested, multiple fields of the data of the orientation information to be tested are verified according to the corresponding verification level to obtain the material data verification result of the orientation information to be tested.

[0113] In some embodiments, the plurality of verification levels include at least one of the following: a first verification level, a second verification level, a third verification level, a fourth verification level, and a fifth verification level.

[0114] Specifically, when validating the first field in the data of the orientation information to be tested according to the first verification level, if the value of the first field is the same as the first preset content, the verification is considered successful; otherwise, the verification is considered unsuccessful. Alternatively, if the value of the first field is different from the first preset content, the verification is considered successful; otherwise, the verification is considered unsuccessful.

[0115] When validating the second field of the data in the target information to be tested according to the second verification level, the verification is considered successful if the value of the second field is the same as one of the multiple second preset contents; otherwise, the verification is considered to have failed.

[0116] When validating the third field of the data in the target information to be tested according to the third verification level, the verification is considered successful if the value of the third field contains the third preset content; otherwise, the verification is considered to have failed.

[0117] When validating the fourth field of the data in the orientation information to be tested according to the fourth verification level, the verification is considered successful if the value of the fourth field is empty; or if the value of the fourth field is not empty; otherwise, the verification is considered to have failed.

[0118] When validating the fifth field in the data of the orientation information to be tested according to the fifth validation level, the validation of the fifth field is skipped.

[0119] For detailed implementation methods of advertising material data verification, please refer to Figure 8 .

[0120] In step S510, based on the type information in the data of the orientation information to be tested, the first object interface of the orientation information to be tested is displayed, and multiple first test operations are performed based on the first object interface to obtain the object interface test results of the orientation information to be tested.

[0121] In some embodiments, the type of the ad to be tested can be determined according to the Aid of the ad to be tested in the Adinfo information, and automated testing verification can be performed accordingly. For example, the ad to be tested can be previewed first according to the ad position, and then UI automated test cases corresponding to the ad position and ad style of the ad to be tested can be executed to perform UI automation practice. The specific implementation method of UI automation practice can be referred to step S206.

[0122] In step S512, the configuration preview test result of the orientation information to be tested is obtained based on the material data verification result of the orientation information to be tested and the object interface test result of the orientation information to be tested.

[0123] In some embodiments, the configuration preview test result can be considered passed when both the material data verification result and the user interface test result are passed; alternatively, error (failure) data in the material data verification result or the user interface test result can be fed back, the notification module can be invoked to notify the result, and the test data can be synchronized to the report dashboard module (e.g., Figure 18 The data dashboard module 1818 in the middle is used for visualization.

[0124] According to the information processing method provided in this disclosure, the monitoring and notification module periodically notifies users of newly added or changed advertisements within a certain period, consumes the data, and calls the data filtering module to filter the existing network advertisement data. Then, the advertisement data returned by the filter is stored in a local database. Next, the advertising material data verification module and the UI automation module are called to perform different dimensions of testing and verification on specific advertisements, taking into account both advertising material data verification and advertising UI layer checks, covering a wide range of scenarios. This enables verification of advertisements in various dimensions within the production environment, compensating for characteristics that cannot be verified in the testing environment. Most importantly, it allows for timely detection of problems with launched advertisements from the perspective of ad exposure, and provides immediate verification and feedback. By continuously verifying newly added data according to a preset period, not only can problems with the latest production environment of the advertisement format be detected in a timely manner, but also some related problems of the advertising carrier platform can be discovered.

[0125] Figure 6 It shows Figure 5 The step S502 shown is a schematic diagram of the processing procedure in one embodiment. (See attached diagram.) Figure 6 As shown in the present embodiment, step S502 may further include the following steps.

[0126] In step S602, targeted information backup data in the production environment is obtained.

[0127] In step S604, the source information, status information, deployment resource information, type information, initiating object identification information, test result information, and data change information of the candidate targeting information are obtained from the targeting information backup data.

[0128] In some embodiments, such as those described below, source information, status information, deployment resource information, type information, initiator object identification information, test result information, and data change information can be multiple dimensions for data filtering.

[0129] Ad Sources: Differentiate between different ad delivery platforms and conduct subsequent testing and data analysis for each type of website that generates ads.

[0130] Ad Status: Verify the current status of the ad and filter out ads with abnormal statuses such as paused or offline.

[0131] Advertising resources: Sort by the (virtual or real) resources (e.g., amount of money) required for advertising, and filter out the maximum number of ads that meet the resources (software / hardware) of automated testing.

[0132] Ad Type: Filtering ad styles ensures coverage of different ad placements (such as WeChat Moments, Official Accounts, Video Accounts, etc.) from various ad sources within each period. If some styles are not covered after filtering by other rules, the priority of the ad style rules is increased, and the type information for targeting ad styles not covered by the filter can be ad placement information. Ad placement information can be obtained through the ad server.

[0133] Ad Initiator Identification Information: The initiator identifier is the advertiser identifier Uid. There may be ads placed by special advertiser accounts, such as ads placed by test accounts used for other tests. These ads can be filtered out when conducting production environment testing.

[0134] Ad deduplication: By obtaining test results and data change information of ads, ad deduplication can be filtered out that have passed the test and verification and whose ad data has not changed.

[0135] In step S606, based on the source information, status information, deployment resource information, type information, initiator identification information, test result information, and data change information of the candidate targeting information, it is determined whether to identify the candidate targeting information as the targeting information to be tested.

[0136] In some embodiments, for example, while obtaining ad placement information through the ad server, test device information (such as device type being Android or iOS, user ID, etc.) can be obtained. After confirming that the user ID is in the test whitelist, during the filtering operation, the ad set for the ad placement and test device type is first obtained from the candidate ad set. Then, ads that have passed the test are filtered out based on the test results, thereby obtaining the ads to be tested. The ads to be tested are then displayed on the test device and tested. After obtaining the test results, the tested ads are marked for subsequent filtering. This filtering method can quickly complete test cases for various channels and devices.

[0137] In other embodiments, for example, after obtaining the test results of the targeting information, targeting information that failed to meet the test results can be selected as candidate targeting information. The type information and test device information of these candidate targeting information can be obtained, such as the ad style information and test device type. Then, during filtering, targeting information with a specific ad style is first selected from these candidate targeting information, and then targeting information with a different test device type than the current test device type is selected as the targeting information to be tested. Due to terminal environment factors, some test noise may occur. For example, if a test fails in a certain ad placement test scenario (such as an Android device application splash screen ad, video ad, etc.), the ad placement test scenario information can be reported to the server so that the server marks the test ad that failed in that ad placement test scenario. When using other terminals to test the ad placement test scenario, the previously marked failed ad is re-tested, or ads of the same type as the marked failed ad (e.g., also video ads) are preferentially selected. This filtering method can avoid test noise caused by the terminal environment.

[0138] In other embodiments, the ad status can include the ad delivery time, or it can be combined with the ad delivery time to formulate corresponding filtering rules. For example, after obtaining the first delivery time of candidate targeting information, the time interval between the first delivery time of the candidate targeting information and the current time can be calculated. This time interval is compared with a preset time interval threshold. If the time interval is less than the preset time interval threshold, it is determined as the targeting information to be tested. Ads for some products (such as fast-moving consumer goods, products with rapid product updates, etc.) have strong time sensitivity. Ads with a long time interval between their first delivery time and the current time may have fewer deliveries or be about to be discontinued. Therefore, it is possible to set a time interval between the first delivery time and the current time, such as one week, half a month, etc., to filter out previous ads and test recent ads, which can improve the efficiency of ad testing.

[0139] For example, during filtering, candidate targeting information within a set time period can be selected as the target targeting information to be tested, or candidate targeting information outside the set time period can be selected. Some products, due to targeting specific groups, have fixed daily advertising periods, such as 8 PM to 10 PM daily. It's possible to set up separate tests for ads during each advertising period and then statistically analyze the test results. For instance, if the statistical results show a higher failure rate for ads running between 8 PM and 10 PM, some ads can be run and tested at other times. If the test results are successful, this avoids testing noise caused by the network environment.

[0140] In step S608, if the candidate orientation information is determined to be the orientation information to be tested, the identifier of the candidate orientation information is obtained as the identifier of the orientation information to be tested.

[0141] In some embodiments, a filtered set of ads to be tested (Aid) can be obtained, and the ads to be tested in the set can be sorted according to requirements, such as by ad placement, ad delivery resources, etc., and tested sequentially from front to back.

[0142] According to the test ad filtering method provided in this disclosure, the test ad set can be obtained by filtering according to multi-dimensional rules, which can improve the effectiveness of the test results, ensure the correctness of UI display, redirection, material data and data reporting of various types of ads in the production environment to the greatest extent, prioritize the quality of top ads, and reduce the probability of large compensation caused by advertising accidents in the production environment. Figure 7 It is based on Figure 6 The diagram illustrates one implementation of data filtering. For example... Figure 7 As shown, a data filtering module 7002 can be set up in the system to process advertising data filtering. The relationship between the data filtering module 7002 and other modules in the system can be found in [reference needed]. Figure 18 The data filtering module 7002 can perform two functions. Firstly, it maintains the filtering configuration (S702), allowing for the addition, deletion, modification, and querying of ad filtering rules as needed. Secondly, it can be configured based on specific common scenarios, such as... Figures 3A to 3D For scenarios such as WeChat Moments ads (S7022), WeChat Official Account ads (S7024), WeChat Mini Program ads (S7026), and WeChat Subscription Account ads (S7028), maintain some fixed rule sets for ad filtering in the production environment. For example, the WeChat Moments ad scenario (S7022) can be configured with... Figure 6 The list includes multi-dimensional filtering rules, such as ad source (S70222), ad status (S70224), ad style (S70226), etc. Additionally, the rule set can be dynamically changed based on software / hardware resources.

[0143] On the other hand, the data filtering module 7002 can filter data according to preset rules, such as... Figure 6 The multi-dimensional filtering rules listed in the document call the data access module (see...). Figure 18 Data access module 902 in Figure 17 as well as Figure 9The relevant application programming interface (API) encapsulates structured query language (SQL) statements, filters and selects advertising data (S704), and returns (S706) an advertising set that meets the configuration requirements and test resource load, and can be sorted according to needs.

[0144] Figure 8 It is based on Figure 6 The diagram illustrates one method for verifying advertising material data. Figure 8 As shown, an advertising material data verification module 8002 can be set up in the system to handle advertising material data verification. The relationship between the advertising material data verification module 8002 and other modules in the system can be found in [reference needed]. Figure 18 When validating ad creative data, the ad creative data validation module 8002 first obtains the ad's Adinfo data based on Aid, then reads the validation rules and performs different levels of data rule validation on each field of the ad's Adinfo data (S802, S8022, S8024, S8026, S8028, S80210). The specific implementation methods for different levels of data validation in steps S8022 to S80210 can be found in step S508. Afterwards, the validation results are summarized and the conclusions are stored in the database (DB). Finally, the report dashboard module can be called (see...). Figure 18 The data dashboard module 1818 and Figure 17 The data verification results are displayed. The advertising material data verification module 8002 can also configure verification rules, allowing for the addition, deletion, and modification of verification levels as needed, as well as the addition of conditional linkage between rules.

[0145] Figure 9 It is based on Figures 2 to 7 The diagram illustrates one type of data access implementation. For example... Figure 9 As shown, a data access module 902 can be set up in the system to provide a data access interface. The relationship between the data access module 902 and other modules in the system can be referred to... Figure 18The data access module 902 can be used to access data from different storage media and database instances. According to the application scenario of this embodiment, a first relational database management system interface 9022 for production environment backup data access and a second relational database management system interface 9024 for local data access can be encapsulated. For example, the first relational database management system interface 9022 can be a data access operation API for PostgreSQL (a relational database management system), and the second relational database management system interface 9024 can be a data access operation API for MySQL (another relational database management system).

[0146] Among them, the first relational database management system interface 9022 may include the production environment advertising backup DB data query API 90222, which can be called when filtering advertising data to obtain advertising data that has been added or changed within a preset period.

[0147] The second relational database management system interface 9024 may include an ad information access API 90242, an ad creative validation data access API 90244, and an automated test data access API 90246. For example, the ad information access API 90242 can store the filtered Adinfo of the ads to be tested into a local database (e.g., ...). Figure 18 For example, the local database (1806) can be accessed; for another example, the ad creative verification data access API 90244 can be accessed when verifying an ad to be tested to obtain the adinfo of the ad to be tested; and the automated test data access API 90246 can be accessed when performing UI automated testing on an ad to be tested.

[0148] All of the above APIs can be made available to other modules within the system for invocation, and service calls can be implemented based on the Remote Procedure Call protocol framework.

[0149] Figure 10 It shows Figure 2 The step S206 shown is a schematic diagram of the processing procedure in one embodiment. (See attached diagram.) Figure 10 As shown in the present embodiment, step S206 may further include the following steps.

[0150] In step S1002, the first interface element is obtained from the first object interface that is displayed.

[0151] In step S1004, the first interface element is compared with its corresponding information in the data of the orientation information to be tested.

[0152] In some embodiments, for example, keyword checking, copywriting comparison, image comparison, optical character recognition (OCR) and other methods can be used to check the display of elements such as materials, titles, descriptions, watermarks, avatars, nicknames and other elements in the first user interface of the advertisement, i.e. the outer layer.

[0153] In step S1006, if it is determined that the first interface element matches its corresponding information in the data of the orientation information to be tested, the test result of the object interface of the orientation information to be tested is obtained as passed.

[0154] Figure 11 It shows Figure 2 The illustrated step S206 is a process diagram in another embodiment. (See diagram for example.) Figure 11 As shown in the present embodiment, step S206 may further include the following steps.

[0155] In step S1102, a first automated operation is performed on the first object interface to display a second object interface for the orientation information to be tested.

[0156] In some embodiments, such as in UI automation testing, a first automated operation, such as clicking, swiping, or inputting, can be automatically performed on the outer display interface of the ad to be tested. The type of operation can be configured in the UI automation test case, so that the operation corresponds to the ad type (ad placement, ad style, etc.).

[0157] In some embodiments, the second user interface is the redirection interface for interacting with the outer display interface, also known as the landing page. Clicking different advertisements can redirect to different types of landing pages, such as H5 pages, mini-program pages, or native application pages.

[0158] In step S1104, based on the jump type information of the orientation information to be tested, it is determined whether there is a target element on the second object interface that corresponds to the jump type information.

[0159] In some embodiments, the data of the orientation information to be tested includes jump type information of the orientation information to be tested, which can be obtained from a local database (e.g., Figure 18 The redirect type is obtained from the Adinfo data corresponding to the ad identifier to be tested in the local database 1806.

[0160] In some embodiments, for example, the target element on the second user interface may include a return element, that is, an element used to return to the first user interface. For example, the return element corresponding to a certain jump type may be an "×" in a box.

[0161] In step S1106, if it is determined that there is a target element on the second object interface that corresponds to the jump type information, the test result of the object interface for obtaining the orientation information to be tested is passed.

[0162] Figure 12 It shows Figure 2 The diagram illustrates step S206 in another embodiment. (See attached diagram.) Figure 12 As shown, Figure 12 and Figure 11 The difference is that step S206 above may further include the following steps.

[0163] In step S1202, the second interface element is obtained from the displayed second object interface.

[0164] In step S1204, the second interface element is compared with its corresponding information in the data of the orientation information to be tested.

[0165] In some embodiments, the display of second interface elements on special landing pages such as native pages can be checked by means of keyword checking, copywriting comparison, etc.

[0166] In step S1206, if it is determined that there is a target element on the second object interface that corresponds to the jump type information, and the second interface element matches its corresponding information in the data of the orientation information to be tested, the test result of the object interface of the orientation information to be tested is obtained as passed.

[0167] In some embodiments, when both the existence of the target element on the second user interface and the second interface element on the second user interface are checked, the user interface test result of the orientation information to be tested can be obtained by combining the inspection results.

[0168] Figure 13 It shows Figure 2 The step S206 shown is a schematic diagram of the processing procedure in another embodiment. Figure 13 and Figure 11 The difference is that, Figure 13 This verifies the functionality of returning the element. For example... Figure 13 As shown in the present embodiment, step S206 may further include the following steps.

[0169] In step S1302, a first automated operation is performed on the first object interface to display a second object interface for the orientation information to be tested.

[0170] For a specific implementation in some embodiments, please refer to step S1102.

[0171] In step S1304, based on the jump type information of the orientation information to be tested, it is determined whether there is a target element on the second object interface that corresponds to the jump type information.

[0172] For specific implementation details in some embodiments, please refer to step S1104.

[0173] In step S1306, a second automated operation is performed on the returned element on the displayed second object interface to obtain a second automated operation result interface.

[0174] In some embodiments, for example, if the return element corresponding to a certain jump type can be an "×" in a box, then the corresponding second automated operation can be a click operation.

[0175] In step S1308, if it is determined that there is a return element corresponding to the jump type information on the second object interface, and the second automated operation result interface is the first object interface, the test result of the object interface that obtained the orientation information to be tested is passed.

[0176] Figure 14 It shows Figure 2 The step S206 shown is a schematic diagram of the processing procedure in another embodiment. (See diagram below.) Figure 14 As shown in the present embodiment, step S206 may further include the following steps.

[0177] In step S1402, the third interface element in the first object interface is identified.

[0178] In some embodiments, the first object interface displayed may include a third interface element, which may be an element for receiving feedback, such as the word "advertisement".

[0179] In step S1404, a third automated operation is performed on the third interface element on the first user interface to display the result interface of the third automated operation.

[0180] In some embodiments, third interface elements can be manipulated. For example, the third automated operation can be a click, swipe, or other operation. For instance, clicking on the "advertisement" on the advertisement display page will then display a subpage, i.e., the result interface of the third automated operation.

[0181] In step S1406, the fourth automated operation is performed on the displayed third automated operation result interface to obtain the fourth automated operation result.

[0182] In some embodiments, the third automated operation result interface can be a page prompting you to close the advertisement, such as displaying the words "Close this advertisement?" and showing "Yes" and "No" buttons on the page, then the fourth automated operation is to click the "Yes" button.

[0183] In other embodiments, the third automated operation result interface may also be an advertisement evaluation page, which displays "Not bad" and "Not interested" buttons. In this case, the fourth automated operation may include recognizing and clicking the "Not interested" button, and then recognizing the "Close directly" button on the next pop-up page.

[0184] In step S1408, if the result of the fourth automated operation is to cancel the display of the first object interface, the test result of the object interface for obtaining the orientation information to be tested is passed.

[0185] In some embodiments, once it is determined that the advertisement has passed the feedback function verification test, the advertisement can be considered to have passed the feedback function verification test after it is determined that the page where the first user interface is located can be returned through the fourth automated operation and the display of the advertisement can be canceled.

[0186] Figure 15 It shows Figure 2 The diagram illustrates step S206 in another embodiment. During scenarios such as impressions, clicks, and redirects, advertisements report data according to a specific protocol to the data platform for subsequent statistical use. The data reporting of advertisements can also be validated during UI automation testing. For example... Figure 15 As shown in the present embodiment, step S206 may further include the following data reporting and verification steps.

[0187] In step S1502, the target automated operation is performed based on the first object interface.

[0188] In some embodiments, the multiple first test operations in UI testing may include a target automated operation, which may be an ad fetching or preview operation that displays the first user interface (the ad preview operation in step S406 or step S510), or it may be... Figures 10 to 14 The system automates the clicking, swiping, and input operations of the first user interface and its sub-pages.

[0189] In step S1504, it is determined whether the target operation data corresponding to the target automated operation has been successfully reported.

[0190] In step S1506, if it is determined that the target operation data has been successfully reported, the target operation data is obtained.

[0191] In step S1508, multiple fields of the target operation data are validated according to their corresponding validation levels to obtain the data reporting validation results of the orientation information to be tested.

[0192] In some embodiments, after the advertisement is processed, the data platform interface is called to check whether the advertisement has successfully reported the specified data. If it has been reported, basic data reporting field checks are performed. For details on the data reporting verification, please refer to step S508, "Verification of Ad Material Data." If no data is reported or the field check fails, an exception is thrown, and the test fails.

[0193] Figure 16 It is based on Figures 10 to 15 This diagram illustrates an implementation of UI automation testing. Figure 16 As shown, the UI automation module 16002 can be configured in the system for UI automation testing. The relationship between the UI automation module 16002 and other modules in the system can be found in [reference needed]. Figure 18 The UI automation module 16002 can perform functions such as machine resource scheduling, ad retrieval configuration, ad type identification, UI automation operation, ad data reporting and verification, and automated test result storage.

[0194] First, the UI automation module performs machine resource scheduling (S1602), determining the number of available automation resources and dynamically allocating them. Then, it determines the ad exposure method based on the triggered test process type (S1604). Next, it determines the ad type based on the ad information and decides on the automation test case scheduling (S1606). Following this, it performs automated ad testing (S1608), primarily targeting UI element operations. After the functional testing is completed, the ad data report is verified (S1610). Finally, the automated test results are stored in the database. The specific implementation methods for the above steps are described below.

[0195] Step S1602, Machine Resource Scheduling. After receiving the test request from the main process module, the UI automation module 16002 can check the current machine resources and allocate the number of machines based on the current machine resources and the scale of the test task advertisement. It can also provide an interface to return the number of currently available resources for other modules to use. Furthermore, it can set the priority of tests based on the urgency of the test tasks to allow for queue jumping.

[0196] Step S1604, Ad Retrieval Configuration. Main Processing Module (refer to...) Figure 17 , Figure 18 The main process processing module 17002 triggers different test types, resulting in different ad retrieval methods. If executed... Figure 4The random inspection process for production environment advertisements shown in the diagram does not require forced configuration of the UI automation module 16002; it only needs to allocate devices (such as...). Figure 18 The cloud device shown) logs in to the specified whitelisted account (refer to step S402) and performs an ad retrieval operation (step S406, such as a refresh operation). Then, it determines whether a new production environment ad has been retrieved based on the Aid field in the data report. If executed... Figure 5 The configuration preview ad verification process shown will allow the UI automation module to configure the ad preview based on the input information such as the Aid of the ad to be tested and the application test account (e.g., the uin field) (refer to the ad preview operation in step S510).

[0197] Step S1606, Ad type identification. Refer to step S206. Figure 9 The UI automation module can obtain information such as Adinfo of the advertisement based on the input Aid field, and determine the type of advertisement based on fields such as ad placement information and ad style information. Different UI automation test cases can be determined according to different ad types for subsequent verification.

[0198] Step S1608, UI automation practice. (Refer to...) Figures 10 to 14 The UI automation module 16002 can perform outer element verification, redirection verification, feedback verification, and other functions on the display interface and redirected pages of advertisements. The UI automation module 16002 can implement terminal element recognition, click operations, etc., based on the UIautomator framework (an Android system automation framework) and / or WDA (Web Driver Agent, an iOS automation framework). If the element recognition verification after the operation does not meet expectations, an exception test failure should be thrown.

[0199] Step S1610, advertising data reporting and verification. (Refer to...) Figure 15 During UI automation testing, the data reported by the advertisement can also be verified.

[0200] Step S1612: Automated test results are stored in the database. After the advertisement under test has completed the functional and data testing in the UI automated testing, the UI automation module can store the test results, key page screenshots during the process, test log links, and other information into the local database for use by the report dashboard module, such as... Figure 17 As shown. For a detailed implementation guide of the report dashboard module, please refer to... Figure 18 .

[0201] Figure 17 It is based on Figures 2 to 16 A schematic diagram illustrating an information processing implementation is shown. For example... Figure 17As shown, the main process processing module 17002 can be set up in the system for calling various modules of the entire production environment advertising verification process. The relationship between the main process processing module 17002 and other modules in the system can be found in [reference]. Figure 18 .

[0202] If the configuration preview ad verification process is executed (S17042), the timed notifications from the notification module will be monitored first (S17044). Ads newly added or with data changes within the period will be consumed, and the data filtering module will be called to filter the ad data in the production environment (S17046). Then, the ad data returned by the filter will be stored in the local DB (S17048). After that, the ad creative data verification module (S170410) and the UI automation module (S1706) will be called respectively to perform different dimensions of testing and verification on specific ads. Finally, the notification module will be called to notify the results (S1708) and the test data will be synchronized to the report dashboard module for visualization (S1710).

[0203] If the production environment ad random inspection process is executed (S17022), the configuration of the specified whitelist test account is first read (S17024) to trigger the inspection process; then the UI automation module is directly called (S1706) to simulate the user to perform ad retrieval operation. After that, the ad Aid is obtained based on the data of the retrieved ads. Then, the Aid is used to obtain more detailed ad data Adinfo and write it back to the local DB. Next, the ads are judged based on the Adinfo information and subsequent automated test verification work is performed; finally, the notification module is called to notify the results (S1708) and the test data is synchronized to the report dashboard module for visualization display (S1710).

[0204] According to the information processing method provided in this disclosure, advertisement exposure checks are performed by combining advertisement configuration preview and random inspection. This allows for the checking of advertisement sets according to defined rules and filters, verifying whether advertisement data in different scenarios conforms to expected rules. It can also fully simulate the process of users exposing advertisements in a production environment, thereby performing automated UI testing at the terminal level. This involves comprehensive verification of advertisements from dimensions such as external material display, copy matching, click redirection, landing page verification, and data reporting checks. Finally, the test results are statistically displayed, and timely alerts are issued for anomalies. This helps to detect external network issues caused by advertisement delivery platform program updates or requirement deployments as early as possible, ensuring the normal display and use of advertisement functions in the application. This improves the product quality of the entire advertisement format chain, enhances the robustness of the advertising system, and reduces the possibility of external network issues and compensation. Furthermore, based on the right-shift testing approach, the testing of the advertising system extends to steps before and even after advertisement deployment in the production environment, expanding the testing coverage scenarios and increasing the testing coverage rate.

[0205] Figure 18 It is based on Figures 2 to 17 A schematic diagram of an information processing system architecture is shown. Figure 18 As shown, cloud database 1802 is used for storing advertising data in the production environment, and advertising backup database 1804 is used to periodically back up newly added advertising data from the cloud database, such as a PostgreSQL database. Notification module 1808 can be used to periodically notify the main process processing module 17002 to obtain newly added advertising data to execute the configuration preview process. This periodic notification can be implemented using the publish-subscribe pattern of Redis. Multiple Redis notification channels can be included, for example, for parallel processing, notifying multiple main process processing modules. Data storage module 902 can be used to obtain advertising data from advertising backup database 1804 and may include multiple APIs called by the main process processing module 17002 (see reference). Figure 9The advertising data can also be written back to the local database 1806, which may be a MySQL database, for example. The data filtering module 7002 can be called by the main process processing module 17002 during the configuration preview process. The data filtering module 7002 can obtain data filtering rules from the rule center 1810 (e.g., Rainbow config). The data verification (DataDiff) module 8002 can be called by the main process processing module 17002 during the configuration preview process, and verifies the advertising data obtained through the data storage module 902. The terminal testing service 1812 may include a UI automation module 16002, a data reporting verification module 18122, and a computer vision verification module 18124. The main process processing module 17002 can call the terminal testing service 1812 to perform UI automation testing, data reporting verification, and computer vision verification. The computer vision verification can use image comparison, OCR recognition, and other methods to improve the accuracy of advertising user interface recognition. Terminal testing service 1812 can run on cloud testing terminal 1814, which may include Android system services, iOS services, HarmonyOS system services, etc. The main process processing module 17002 and terminal testing service 1812 can respectively send the material data verification results and UI automation test results to the report dashboard module. The report dashboard module may include test report module 1816 and data dashboard module 1818. Test report module 1816 can summarize and statistically analyze test reports based on the specified test ad Aid in local database 1806, covering dimensions such as each test, each period, and each day. Users can view the overall test data and screenshots and log information for each test process, facilitating quick problem identification. Data dashboard module 1818 can visualize historical test data based on historical data in local database 1806 and perform aggregated statistics on various data, such as the average pass rate for each ad placement, aggregating abnormal data, and average test time. Notification module 1808 can connect to various modules in the system. Figure 18 The connection method shown in the image is for illustrative purposes only. It is used for information notification throughout the system, including data update reminders (i.e., the Redis implementation scheme mentioned above), test report notifications, system error alarms, and abnormal data notifications from the data dashboard.

[0206] Figure 19 This is a block diagram illustrating an information processing apparatus according to an exemplary embodiment. Figure 19 The device shown can be applied, for example, to the server side of the above system, or to the terminal device of the above system.

[0207] refer to Figure 19The apparatus 190 provided in this embodiment may include a directional information exposure operation execution module 1902, a directional information data acquisition module 1904, and an object interface testing module 1906.

[0208] The targeted information exposure operation execution module 1902 can be used to obtain the targeted information to be tested based on the placement location information of the targeted information to be tested, and display the first object interface of the targeted information to be tested. The targeted information to be tested is the targeted information in the production environment.

[0209] The test orientation information data acquisition module 1904 can be used to acquire the test orientation information data, which includes the type information of the test orientation information.

[0210] The object interface testing module 1906 can be used to perform multiple first test operations based on the type information of the orientation information to be tested, and obtain the object interface test results of the orientation information to be tested.

[0211] Figure 20 This is a block diagram illustrating another information processing apparatus according to an exemplary embodiment. Figure 20 The device shown can be applied, for example, to the server side of the above system, or to the terminal device of the above system.

[0212] refer to Figure 20The apparatus 200 provided in this embodiment may include a targeted information exposure operation execution module 2002, a targeted information data acquisition module 2004, an object interface testing module 2006, a material data verification rule acquisition module 2008, a material data verification module 2010, a configuration preview test result acquisition module 2012, a first targeted information identifier acquisition module 2014, a targeted information backup data acquisition module 2016, a candidate targeted information acquisition module 2018, a candidate targeted information filtering module 2020, a whitelist account acquisition module 2022, a test delivery object identifier acquisition module 2024, and a second targeted information identifier acquisition module 2026. The object interface testing module 2006 may include a first interface element acquisition module 20062 and a first interface element verification module. 20064, First Object Interface Test Result Acquisition Module; 20066, First Automated Operation Execution Module; 20068, Target Element Existence Judgment Module; 200610, Second Object Interface Test Result Acquisition Module; 200612, Second Interface Element Acquisition Module; 200614, Second Interface Element Verification Module; 200616, Second Automated Operation Execution Module; 200618, Third Object Interface Test Result Acquisition Module; 200620, Third Interface Element Recognition Module; 200622, Third Automated Operation Execution Module; 200624, Fourth Automated Operation Execution Module; 200626, Fourth Object Interface Test Result Acquisition Module; 200628, Data Reporting Success Judgment Module; 200632, Target Operation Data Acquisition Module; and Reported Data Verification Module; 200636.

[0213] The Targeted Information Backup Data Acquisition Module 2016 can be used to acquire targeted information backup data in the production environment.

[0214] The Candidate Targeting Information Acquisition Module 2018 can be used to obtain source information, status information, deployment resource information, type information, initiator object identification information, test result information, and data change information of candidate targeting information from the targeting information backup data.

[0215] The candidate targeting information filtering module 2020 can be used to determine whether to identify candidate targeting information as targeting information to be tested based on the source information, status information, delivery resource information, type information, initiator identification information, test result information, and data change information of candidate targeting information.

[0216] The whitelist account acquisition module 2022 can be used to obtain the whitelist of target target identifiers.

[0217] The Test Target Identifier Acquisition Module 2024 can be used to obtain the Test Target Identifier from the Target Target Identifier Whitelist.

[0218] The first test orientation information identifier acquisition module 2014 can be used to acquire the identifier of the test orientation information.

[0219] The first test orientation information identifier acquisition module 2014 can also be used to obtain the identifier of the candidate orientation information as the test orientation information when the candidate orientation information is determined to be the test orientation information.

[0220] The second test orientation information identifier acquisition module 2026 can be used to obtain the identifier of the test orientation information from the display data of the first object interface.

[0221] The targeted information exposure operation execution module 2002 can be used to obtain the targeted information to be tested based on the placement location information of the targeted information to be tested, so as to display the first object interface of the targeted information to be tested. The targeted information to be tested can be the targeted information in the production environment.

[0222] The targeted information exposure operation execution module 2002 can also be used to retrieve targeted information at the location corresponding to the targeted information to be tested, based on the test target identifier.

[0223] The target targeting information data acquisition module 2004 can be used to acquire data on the target targeting information to be tested. This data may include the type information and redirection type information of the target targeting information. The type information may include the delivery location information of the target targeting information.

[0224] The test orientation information data acquisition module 2004 can also be used to obtain the test orientation information data based on the identifier of the test orientation information.

[0225] The test orientation information data acquisition module 2004 can also be used to obtain the test orientation information data based on the identifier of the test orientation information.

[0226] The object interface testing module 2006 can be used to execute multiple first test operations based on the type information of the orientation information to be tested, and obtain the object interface test results of the orientation information to be tested. The object interface test results of the orientation information to be tested may include the data reporting verification results of the orientation information to be tested. The multiple first test operations may include target automation operations.

[0227] The first interface element acquisition module 20062 can be used to acquire first interface elements from the displayed first object interface.

[0228] The first interface element verification module 20064 can be used to compare the first interface element with its corresponding information in the data of the orientation information to be tested.

[0229] The first object interface test result acquisition module 20066 can be used to obtain the object interface test result of the orientation information to be tested as passed when it is determined that the first interface element matches its corresponding information in the data of the orientation information to be tested.

[0230] The first automated operation execution module 20068 can be used to perform a first automated operation on the first object interface to display a second object interface displaying the orientation information to be tested.

[0231] The target element existence determination module 200610 can be used to determine whether a target element corresponding to the jump type information exists on the second object interface based on the jump type information of the orientation information to be tested. The target element may include a return element.

[0232] The second object interface test result acquisition module 200612 can be used to obtain the test result of the object interface with the orientation information to be tested as passed when it is determined that there is a target element on the second object interface that corresponds to the jump type information.

[0233] The second object interface test result acquisition module 200612 can also be used to obtain the object interface test result of the orientation information to be tested as passed when it is determined that there is a target element on the second object interface that corresponds to the jump type information, and the second interface element matches its corresponding information in the data of the orientation information to be tested.

[0234] The second interface element acquisition module 200614 can be used to acquire second interface elements from the displayed second object interface.

[0235] The second interface element verification module 200616 can be used to compare the second interface element with its corresponding information in the data of the orientation information to be tested.

[0236] The second automated operation execution module 200618 can be used to perform a second automated operation on the returned element on the displayed second object interface to obtain a second automated operation result interface.

[0237] The third object interface test result acquisition module 200620 can be used to obtain the object interface test result of the orientation information to be tested as passed when it is determined that there is a return element corresponding to the jump type information on the second object interface and the second automated operation result interface is the first object interface.

[0238] The third interface element recognition module 200622 can be used to recognize third interface elements in the first object interface.

[0239] The third automated operation execution module 200624 can be used to perform a third automated operation on the third interface elements on the first object interface to display the result interface of the third automated operation.

[0240] The fourth automated operation execution module 200626 can be used to execute the fourth automated operation on the displayed third automated operation result interface and obtain the fourth automated operation result.

[0241] The fourth object interface test result acquisition module 200628 can be used to obtain the test result of the object interface of the target orientation information as passed when it is determined that the result of the fourth automated operation is to cancel the display of the first object interface.

[0242] The Material Data Verification Rule Acquisition Module 2008 can be used to acquire the material data verification rules for the orientation information to be tested. The material data verification rules include multiple verification levels, which are used to verify multiple fields in the data of the orientation information to be tested.

[0243] Multiple verification levels include at least one of the following: a first verification level, a second verification level, a third verification level, a fourth verification level, and a fifth verification level; wherein, when verifying the first field of the data of the orientation information to be tested according to the first verification level, verification is considered successful if the value of the first field is the same as the first preset content; or verification is considered successful if the value of the first field is different from the first preset content; when verifying the second field of the data of the orientation information to be tested according to the second verification level, verification is considered successful if the value of the second field is the same as one of multiple second preset contents; when verifying the third field of the data of the orientation information to be tested according to the third verification level, verification is considered successful if the value of the third field contains the third preset content; when verifying the fourth field of the data of the orientation information to be tested according to the fourth verification level, verification is considered successful if the value of the fourth field is empty; or verification is considered successful if the value of the fourth field is not empty; when verifying the fifth field of the data of the orientation information to be tested according to the fifth verification level, the verification of the fifth field is skipped.

[0244] The Material Data Verification Module 2010 can be used to verify multiple fields of the data of the orientation information to be tested according to the material data verification rules and corresponding verification levels, and obtain the material data verification results of the orientation information to be tested.

[0245] The Configuration Preview Test Result Acquisition Module 2012 can be used to obtain the configuration preview test result of the orientation information to be tested based on the material data verification result and the object interface test result of the orientation information to be tested.

[0246] The data reporting success judgment module 200632 can be used to determine whether the target operation data corresponding to the target automated operation has been successfully reported.

[0247] The target operation data acquisition module 200634 can be used to acquire target operation data when it is determined that the target operation data has been successfully reported.

[0248] The data reporting verification module 200636 can be used to verify multiple fields of the target operation data according to the corresponding verification level, and obtain the data reporting verification results of the targeted information to be tested.

[0249] The specific implementation of each module in the device provided in this embodiment can be referred to the content of the above method, and will not be repeated here.

[0250] Figure 21 A schematic diagram of the structure of an electronic device according to an embodiment of this disclosure is shown. It should be noted that... Figure 21 The devices shown are merely examples of computer systems and should not be construed as limiting the functionality and scope of use of the embodiments disclosed herein.

[0251] like Figure 21 As shown, device 2100 includes a central processing unit (CPU) 2101, which can perform various appropriate actions and processes according to a program stored in read-only memory (ROM) 2102 or a program loaded from storage section 2108 into random access memory (RAM) 2103. The RAM 2103 also stores various programs and data required for the operation of device 2100. CPU 2101, ROM 2102, and RAM 2103 are interconnected via bus 2104. Input / output (I / O) interface 2105 is also connected to bus 2104.

[0252] The following components are connected to I / O interface 2105: an input section 2106 including a keyboard, mouse, etc.; an output section 2107 including a cathode ray tube (CRT), liquid crystal display (LCD), etc., and speakers, etc.; a storage section 2108 including a hard disk, etc.; and a communication section 2109 including a network interface card such as a LAN card, modem, etc. The communication section 2109 performs communication processing via a network such as the Internet. A drive 2110 is also connected to I / O interface 2105 as needed. Removable media 2111, such as a disk, optical disk, magneto-optical disk, semiconductor memory, etc., are installed on drive 2110 as needed so that computer programs read from them can be installed into storage section 2108 as needed.

[0253] In particular, according to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication section 2109, and / or installed from removable medium 2111. When the computer program is executed by central processing unit (CPU) 2101, it performs the functions defined above in the system of this disclosure.

[0254] It should be noted that the computer-readable medium disclosed herein may be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium may be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. Computer-readable signal media can also be any computer-readable medium other than computer-readable storage media, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wireless, wire, optical fiber, RF, etc., or any suitable combination thereof.

[0255] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram or flowchart, and combinations of blocks in a block diagram or flowchart, may be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0256] The modules described in the embodiments of this disclosure can be implemented in software or hardware. The described modules can also be housed in a processor; for example, a processor may be described as including a directional information exposure operation execution module, a directional information data acquisition module, and an object interface testing module. The names of these modules do not necessarily limit the module itself; for example, the directional information exposure operation execution module may also be described as a "module that performs exposure operations on directional information."

[0257] This disclosure also provides a computer-readable medium, which may be included in the device described in the above embodiments; or it may exist independently and not assembled into the device. The computer-readable medium carries one or more programs, which, when executed by the device, cause the device to include:

[0258] Based on the delivery location information of the targeting information to be tested, obtain the targeting information to be tested, and display the first object interface of the targeting information to be tested. The targeting information to be tested is the targeting information in the production environment. Obtain the data of the targeting information to be tested, which includes the type information of the targeting information to be tested. Based on the type information of the targeting information to be tested, perform multiple first test operations on the first object interface to obtain the object interface test results of the targeting information to be tested.

[0259] This disclosure provides a computer program product or computer program including computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the methods provided in the various optional implementations described above.

[0260] Exemplary embodiments of this disclosure have been specifically shown and described above. It should be understood that this disclosure is not limited to the detailed structures, arrangements, or implementations described herein; rather, this disclosure is intended to cover various modifications and equivalent arrangements contained within the spirit and scope of the appended claims.

Claims

1. An information processing method characterized by comprising: include: Based on the delivery location information of the target information to be tested, the target information to be tested is obtained, and the first object interface of the target information to be tested is displayed. The target information to be tested is the target information in the production environment. Acquire the data of the orientation information to be tested, wherein the data of the orientation information to be tested includes the type information of the orientation information to be tested; Based on the type information of the orientation information to be tested, multiple first test operations are performed on the first object interface to obtain the object interface test results of the orientation information to be tested, including: Determine whether the target operation data corresponding to the target automated operation has been successfully reported; If the target operation data is successfully reported, the target operation data is acquired. Multiple fields of the target operation data are validated according to their corresponding validation levels to obtain the data reporting validation results of the orientation information to be tested. The test results of the object interface of the orientation information to be tested include the data reporting verification results of the orientation information to be tested; the multiple first test operations include the target automated operation.

2. The method according to claim 1, characterized in that, The step of performing multiple first test operations based on the type information of the orientation information to be tested, and obtaining the test result of the object interface of the orientation information to be tested, includes: Obtain the first interface element from the first object interface that is displayed; The first interface element is compared with its corresponding information in the data of the orientation information to be tested; If it is determined that the first interface element matches its corresponding information in the data of the orientation information to be tested, the object interface test result of the orientation information to be tested is obtained as passed.

3. The method according to claim 1, characterized in that, The data of the orientation information to be tested includes the jump type information of the orientation information to be tested; The step of performing multiple first test operations based on the type information of the orientation information to be tested, and obtaining the test result of the object interface of the orientation information to be tested, includes: Perform a first automated operation on the first object interface to display a second object interface for the orientation information to be tested; Based on the jump type information of the orientation information to be tested, determine whether there is a target element on the second object interface that corresponds to the jump type information; If it is determined that there is a target element on the second object interface that corresponds to the jump type information, the test result of the object interface for obtaining the orientation information to be tested is passed.

4. The method according to claim 3, characterized in that, The step of performing multiple first test operations based on the first object interface according to the type information of the orientation information to be tested, and obtaining the object interface test result of the orientation information to be tested, further includes: Obtain the second interface element from the displayed second object interface; The second interface element is compared with its corresponding information in the data of the orientation information to be tested; The step of obtaining the test result of the target interface for the orientation information to be tested when it is determined that there is a target element on the second object interface corresponding to the jump type information includes: If it is determined that there is a target element on the second object interface that corresponds to the jump type information, and the second interface element matches the corresponding information in the data of the orientation information to be tested, the test result of the object interface of the orientation information to be tested is obtained as passed.

5. The method according to claim 3, characterized in that, The target element includes the returned element; The step of performing multiple first test operations based on the first object interface according to the type information of the orientation information to be tested, and obtaining the object interface test result of the orientation information to be tested, further includes: Perform a second automated operation on the returned element on the second object interface to obtain a second automated operation result interface; If it is determined that there is a return element on the second object interface that corresponds to the jump type information, and the second automated operation result interface is the first object interface, then the test result of the object interface for obtaining the orientation information to be tested is passed.

6. The method according to claim 1, characterized in that, The step of performing multiple first test operations based on the type information of the orientation information to be tested, and obtaining the test result of the object interface of the orientation information to be tested, includes: Identify the third interface element in the first object interface; Perform a third automated operation on the third interface element on the first object interface to display the result interface of the third automated operation; Perform a fourth automated operation on the displayed third automated operation result interface to obtain the fourth automated operation result; If the result of the fourth automated operation is to cancel the display of the first object interface, the test result of the object interface for obtaining the orientation information to be tested is passed.

7. The method according to claim 1, characterized in that, Also includes: Obtain the material data verification rules for the orientation information to be tested. The material data verification rules include multiple verification levels, and the multiple verification levels are used to verify multiple fields in the data of the orientation information to be tested. According to the material data verification rules of the target orientation information to be tested, multiple fields of the data of the target orientation information to be tested are verified according to the corresponding verification level to obtain the material data verification result of the target orientation information to be tested. The configuration preview test results of the target orientation information are obtained based on the material data verification results and the object interface test results of the target orientation information.

8. The method according to claim 7, characterized in that, The plurality of verification levels includes at least one of the following: a first verification level, a second verification level, a third verification level, a fourth verification level, and a fifth verification level; Specifically, when verifying the first field in the data of the orientation information to be tested according to the first verification level, the verification is deemed successful if the value of the first field is the same as the first preset content; or if the value of the first field is different from the first preset content. When verifying the second field in the data of the orientation information to be tested according to the second verification level, if the value of the second field is the same as one of the multiple second preset contents, the verification is determined to be successful. When the third field in the data of the orientation information to be tested is verified according to the third verification level, the verification is deemed successful if the value of the third field contains the third preset content. When verifying the fourth field in the data of the orientation information to be tested according to the fourth verification level, the verification is considered successful if the value of the fourth field is empty; or if the value of the fourth field is not empty. When validating the fifth field in the data of the orientation information to be tested according to the fifth verification level, the verification of the fifth field is skipped.

9. The method according to claim 1, characterized in that, The type information of the targeting information to be tested includes the delivery location information of the targeting information to be tested; The method further includes: Obtain the identifier of the orientation information to be tested; The data used to obtain the orientation information to be tested includes: Based on the identifier of the orientation information to be tested, the data of the orientation information to be tested is obtained.

10. The method according to claim 9, characterized in that, The identifier for obtaining the orientation information to be tested includes: Obtain targeted backup data from the production environment; The source information, status information, deployment resource information, type information, initiating object identification information, test result information, and data change information of the candidate targeting information are obtained from the backup data of the targeting information. Based on the source information, status information, deployment resource information, type information, initiator identification information, test result information, and data change information of the candidate targeting information, determine whether to identify the candidate targeting information as the targeting information to be tested; If the candidate orientation information is determined to be the orientation information to be tested, the identifier of the candidate orientation information is obtained as the identifier of the orientation information to be tested.

11. The method according to claim 1, characterized in that, Also includes: Obtain the whitelist of target audience identifiers; Obtain the test target identifier from the target target identifier whitelist; The step of obtaining the target targeting information based on the delivery location information of the target targeting information and displaying the first object interface of the target targeting information includes: Based on the test target identifier, perform the operation of retrieving targeting information at the location corresponding to the targeting information to be tested; The method further includes: Obtain the identifier of the orientation information to be tested from the data displayed on the first object interface reported; The data used to obtain the orientation information to be tested includes: Based on the identifier of the orientation information to be tested, the data of the orientation information to be tested is obtained.

12. An information processing device, characterized in that, include: The targeted information exposure operation execution module is used to obtain the targeted information to be tested based on the placement location information of the targeted information to be tested, and to display the first object interface of the targeted information to be tested, wherein the targeted information to be tested is the targeted information in the production environment; The target orientation information data acquisition module is used to acquire the data of the target orientation information, wherein the data of the target orientation information includes the type information of the target orientation information. The object interface testing module is used to perform multiple first test operations based on the type information of the orientation information to be tested, and obtain the object interface test result of the orientation information to be tested. The object interface testing module includes: The data reporting success judgment module is used to determine whether the target operation data corresponding to the target automated operation has been successfully reported; The target operation data acquisition module is used to acquire the target operation data when it is determined that the target operation data has been successfully reported. The data verification module is used to verify multiple fields of the target operation data according to the corresponding verification level, and obtain the data verification result of the orientation information to be tested; The test results of the object interface of the orientation information to be tested include the data reporting verification results of the orientation information to be tested; the multiple first test operations include the target automated operation.

13. An electronic device, comprising: A memory, a processor, and executable instructions stored in the memory and executable in the processor, characterized in that the processor, when executing the executable instructions, implements the method as described in any one of claims 1-11.

14. A computer-readable storage medium having computer-executable instructions stored thereon, characterized in that, When the executable instructions are executed by the processor, they implement the method as described in any one of claims 1-11.

15. A computer program product comprising a computer program / instructions, characterized in that, When the computer program / instructions are executed by the processor, they implement the method as described in any one of claims 1-11.

Images