Advertisement style testing method, device and equipment and computer readable storage medium

Abstract

The invention discloses an advertisement style test method, device and equipment and a computer readable storage medium, which can be applied to scenes such as cloud technology, intelligent traffic, auxiliary driving and maps. Specifically, after the to-be-published advertisement style passes the test in the test environment, the to-be-published advertisement style is subjected to a simulation drill test before publishing, specifically, the to-be-published advertisement style is merged into a trunk for rendering in the pre-publishing environment, so that the rendering condition of the to-be-published advertisement style after publishing is simulated and tested; and after the test of the to-be-published advertisement style in the pre-publishing environment is passed, performing a publishing test on the to-be-published advertisement style in the online operation environment to test the rendering condition of the to-be-published advertisement style in the real online environment. Therefore, before the to-be-published advertisement style is published, the regression test can be carried out before the new advertisement style is published in a simulation mode, so that whether the new advertisement style has a rendering failure problem or not when the new advertisement style is published actually is detected, and the user experience is guaranteed.

Description

Technical Field

[0001] The present application relates to the field of computer technologies, and particularly to a method, apparatus, device, and computer-readable storage medium for testing advertisement styles. Background Art

[0002] With the development of media information technologies, users can obtain various media information through multiple channels. Among them, advertisement information conveys effective information to users to a certain extent. To improve the conversion rate of users when viewing advertisement information, not only the timing of advertisement information delivery needs to be emphasized, but also the presentation style effect of the advertisement information itself is very important. Therefore, it is necessary to continuously update the rendering styles of advertisement information, and new advertisement styles need to be tested before they can be continuously used to ensure that the new advertisement styles can operate properly and do not affect other functions of the system.

[0003] When testing new advertisement styles in related technologies, mainly rendering tests are performed on the new styles of advertisements before release, and comprehensive system regression tests are performed on the new and old styles of advertisements after release to discover the impacts of the new styles of advertisements.

[0004] In the process of researching and practicing related technologies, the inventors of the present application found that when performing rendering tests on new advertisement styles in related technologies, although comprehensive system regression tests are performed on new and old advertisement styles after release, even if rendering failure problems are detected in the new or old advertisement styles after release, it is necessary to wait for a new version to be launched before version replacement can be performed, which affects the user experience. Summary of the Invention

[0005] Embodiments of the present application provide a method, apparatus, device, and computer-readable storage medium for testing advertisement styles, which can perform regression tests before a new advertisement style is released to detect whether there are rendering failure problems when the new advertisement style is actually released, and protect the user experience.

[0006] An embodiment of the present application provides a method for testing advertisement styles, including:

[0007] After the advertisement style to be released passes the test in the test environment, obtain an advertisement request from the online operating environment, where the advertisement request includes an advertisement position identifier;

[0008] Respond to the advertisement request in the pre-release environment, and obtain a target advertisement and the advertisement style to be released for presenting at the advertisement position indicated by the advertisement position identifier from the advertisement playback system in the online operating environment;

[0009] The target front-end code running in the pre-release environment renders the target advertisement according to the advertisement style to be released, and obtains the rendering result of the advertisement to be released; wherein, the pre-release environment is a running environment obtained by simulating the online running environment, and the target front-end code at least includes advertisement backbone rendering code and advertisement style code defining the advertisement style to be released;

[0010] If it is determined according to the rendering result of the advertisement to be released that the advertisement style to be released passes the test in the pre-release environment, a release test is performed on the advertisement style to be released in the online running environment.

[0011] Correspondingly, an embodiment of the present application provides a test device for an advertisement style, including:

[0012] A first acquisition unit, configured to, after the advertisement style to be released passes the test in the test environment, acquire an advertisement request from the online running environment, where the advertisement request includes an advertisement position identifier;

[0013] A second acquisition unit, configured to, in response to the advertisement request in the pre-release environment, acquire a target advertisement and an advertisement style to be released for presentation at the advertisement position indicated by the advertisement position identifier from an advertisement playback system in the online running environment;

[0014] A first test unit, configured to render the target advertisement according to the advertisement style to be released by the target front-end code running in the pre-release environment, and obtain the rendering result of the advertisement to be released; wherein, the pre-release environment is a running environment obtained by simulating the online running environment, and the target front-end code at least includes advertisement backbone rendering code and advertisement style code defining the advertisement style to be released;

[0015] A second test unit, configured to, if it is determined according to the rendering result of the advertisement to be released that the advertisement style to be released passes the test in the pre-release environment, perform a release test on the advertisement style to be released in the online running environment.

[0016] In some embodiments, the test device for the advertisement style further includes a merging unit, configured to:

[0017] Upload the target advertisement style code to the pre-release environment;

[0018] Merge the advertisement backbone rendering code in the pre-release environment with the advertisement style code to obtain the target front-end code.

[0019] In some embodiments, the target front-end code further includes first advertisement style code defining a historical advertisement style, and the first test unit is further configured to:

[0020] Obtain at least one historical test case for the historical advertisement style;

[0021] In the pre-release environment, the first advertisement style code in the target front-end code and the advertisement backbone rendering code perform automated rendering based on the historical test case to obtain the rendering result of the historical advertisement style; the rendering result of the historical advertisement style is used to combine with the rendering result of the advertisement to be released to determine the test result of the advertisement style to be released in the pre-release environment.

[0022] In some embodiments, the test device for the advertisement style further includes an environment conversion unit, which is further configured to:

[0023] Obtain the first targeting range of the advertisement style to be released in the pre-release environment, where the first targeting range includes object identifiers allowed to access the pre-release environment;

[0024] If it is determined that the initiator identifier of the advertisement request is within the first targeting range, based on the address information of the pre-release environment, perform reverse proxy on the advertisement request to forward the advertisement request to the pre-release environment.

[0025] In some embodiments, the environment conversion unit is further configured to:

[0026] Obtain a list of object information, where the list of object information includes multiple object identifiers and the client version numbers associated with each object identifier;

[0027] Determine the compatible version number compatible with the advertisement style to be released;

[0028] Filter the object identifiers in the list of object information according to the compatible version number to screen out the target object identifiers whose associated client version numbers are compatible with the advertisement style to be released;

[0029] Determine the first targeting range of the advertisement style to be released in the pre-release environment according to the target object identifiers.

[0030] In some embodiments, the second obtaining unit is further configured to:

[0031] In the pre-release environment, in response to the advertisement request, determine the advertisement style template supported by the initiator of the advertisement request;

[0032] According to the advertisement position identifier, obtain the advertisement style to be released that conforms to the advertisement style template in the advertisement playback system in the online operating environment, and determine the target advertisement; the advertisement playback system in the online operating environment sends the advertisement style to be released and the target advertisement to the pre-release environment.

[0033] In some embodiments, the second testing unit is further configured to:

[0034] Determine a second targeting range of the to-be-published advertisement style in the online operating environment;

[0035] If the initiator identifier of the first advertisement request from the online operating environment is located within the second targeting range, obtain the first advertisement and the to-be-published advertisement style from the advertisement playback system in the online operating environment;

[0036] Render and test the first advertisement according to the to-be-published advertisement style through the target front-end code running in the online operating environment.

[0037] In some embodiments, the second testing unit is further configured to:

[0038] Obtain historical test cases of candidate advertisement styles for each historical version of the to-be-published advertisement style;

[0039] Test based on the historical test cases of the candidate advertisement styles for each historical version of the to-be-published advertisement style by the target front-end code in the online operating environment.

[0040] In some embodiments, the second testing unit is further configured to:

[0041] Obtain historical test cases of a target historical advertisement style, where the target historical advertisement style is any advertisement style other than the to-be-published advertisement style and the advertisement styles of each historical version of the to-be-published advertisement style;

[0042] Test based on the historical test cases of the target historical advertisement style by the target front-end code in the online operating environment.

[0043] In some embodiments, the testing apparatus for advertisement styles further includes a publishing unit, configured to:

[0044] Obtain the publishing test result for the to-be-published advertisement style in the online operating environment;

[0045] If the publishing test result is a pass, determine the staged publishing quantity for the to-be-published advertisement style, and perform staged quantitative publishing on the to-be-published advertisement style according to the staged publishing quantity.

[0046] In addition, an embodiment of the present application further provides a computer device, including a processor and a memory, where the memory stores a computer program, and the processor is configured to run the computer program in the memory to implement the steps in any one of the advertisement style testing methods provided by the embodiments of the present application.

[0047] In addition, an embodiment of the present application further provides a computer-readable storage medium storing multiple instructions adapted to be loaded by a processor to execute the steps in any one of the test methods for advertisement styles provided by the embodiments of the present application.

[0048] In addition, an embodiment of the present application further provides a computer program product including computer instructions which, when executed, implement the steps in any one of the test methods for advertisement styles provided by the embodiments of the present application.

[0049] In an embodiment of the present application, for a newly developed advertisement style to be released, first, the advertisement style to be released is tested in a test environment. Then, after the advertisement style to be released passes the test in the test environment, a pre-release simulation test is performed on the advertisement style to be released. Specifically, the advertisement style to be released is incorporated into the main trunk for rendering in a pre-release environment to simulate and test the rendering situation of the advertisement style to be released after release. Finally, when the advertisement style to be released passes the test in the pre-release environment, a release test is performed on the advertisement style to be released in an online operating environment to test the rendering situation of the advertisement style to be released in a real online environment. In this way, before the advertisement style to be released is released, a regression test can be performed on the new advertisement style before release in a simulation manner to detect whether there is a rendering failure problem when the new advertisement style is actually released, thus ensuring the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required for description in the embodiments. Obviously, the following-described drawings are only some embodiments of the present application. For those skilled in the art, without creative efforts, other drawings can be obtained based on these drawings.

[0051] Figure 1 is a schematic diagram of the scenario of the test system for advertisement styles provided by an embodiment of the present application;

[0052] Figure 2 is a schematic diagram of the step flow of the test method for advertisement styles provided by an embodiment of the present application;

[0053] Figure 3 is another schematic diagram of the step flow of the test method for advertisement styles provided by an embodiment of the present application;

[0054] Figure 4 is a schematic diagram of the test task page of the advertisement style provided by an embodiment of the present application;

[0055] Figure 5 is a schematic diagram of the test list provided by an embodiment of the present application;

[0056] Figure 6 It is a schematic diagram of a test case provided by an embodiment of the present application;

[0057] Figure 7 It is a schematic diagram of the generation page of a test report provided by an embodiment of the present application;

[0058] Figure 8 It is a schematic diagram of the framework of a test system for an advertisement style provided by an embodiment of the present application;

[0059] Figure 9 It is a schematic diagram of a scenario for performing an advertisement style rendering test in three test phases provided by an embodiment of the present application;

[0060] Figure 10 It is a schematic diagram of a scenario for a reverse proxy service provided by an embodiment of the present application;

[0061] Figure 11 It is a schematic diagram of the structure of a test device for an advertisement style provided by an embodiment of the present application;

[0062] Figure 12 It is a schematic diagram of the structure of a computer device provided by an embodiment of the present application. Detailed implementation manners

[0063] The following details the implementation manners of the present application. Examples of the implementation manners are shown in the accompanying drawings, where the same or similar reference numerals denote the same or similar elements or elements with the same or similar functions throughout. The implementation manners described below with reference to the accompanying drawings are exemplary only for explaining the present application and should not be construed as a limitation of the present application.

[0064] In some processes described in the specification, the claims, and the above-mentioned drawings, a plurality of steps appear in a specific order. However, it should be clearly understood that these steps may not be executed in the order in which they appear herein or may be executed in parallel. The step numbers are only used to distinguish the different steps, and the numbers themselves do not represent any execution order. In addition, descriptions such as "first" and "second" in this article are used to distinguish similar objects and do not necessarily describe a specific order or sequence.

[0065] The following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative efforts belong to the scope of protection of the present application.

[0066] The embodiments of the present application provide a method, apparatus, device, and computer-readable storage medium for testing advertisement styles. Specifically, the embodiments of the present application will be described from the dimension of the advertisement style testing apparatus, which can be specifically integrated in a computer device. The computer device can be a server or a user terminal, etc. Among them, the server can be an independent physical server, a server cluster or a distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms. Among them, the user terminal can be a smart phone, a tablet computer, a notebook computer, a desktop computer, a smart speaker, a smart watch, a smart home appliance, a vehicle terminal, a smart voice interaction device, an aircraft, etc., but is not limited thereto.

[0067] It should be noted that in the specific implementation of the present application, when it comes to data related to user information, user usage records, user status, etc. (such as information related to the "test report" or "test data" in the following text), when the above embodiments of the present application are applied to specific products or technologies, user permission or consent needs to be obtained, and the collection, use, and processing of relevant data need to comply with relevant laws, regulations, and standards of relevant countries and regions.

[0068] It should be noted that the advertisement style testing method provided by the embodiments of the present application is applicable to resource recovery scenarios of cloud services, such as resource recovery scenarios for storage, computing power, etc. These scenarios are not limited to being implemented through cloud technology and other methods. The specific description is as follows through the following embodiments:

[0069] Cloud technology refers to a hosting technology that unifies a series of resources such as hardware, software, and networks within a wide area network or a local area network to achieve data computing, storage, processing, and sharing. Specifically, cloud technology is the general term for network technology, information technology, integration technology, management platform technology, application technology, etc. based on the cloud computing business model, which can form a resource pool and be used on demand, flexibly and conveniently. Cloud computing technology will become an important support. The background services of the technical network system require a large amount of computing and storage resources, such as video websites, picture websites, and more portal websites. With the high development and application of the Internet industry, in the future, each item may have its own identification mark and needs to be transmitted to the background system for logical processing. Data at different levels will be processed separately, and various industry data requires a powerful system support, which can only be achieved through cloud computing.

[0070] Cloud computing is a computing model that distributes computing tasks across a resource pool composed of a large number of computing devices, enabling various application systems to obtain computing power, storage space, and information services as needed. The network that provides resources is called the "cloud". The resources in the "cloud" seem to users to be infinitely scalable, and can be obtained at any time, used on demand, expanded at any time, and paid according to usage. As a basic capabilities provider of cloud computing, a cloud computing resource pool (referred to as a cloud platform, generally called an IaaS (Infrastructure as a Service) platform) will be established, and various types of virtual resources will be deployed in the resource pool for external customers to select and use. The cloud computing resource pool mainly includes: computing devices (virtual machines containing operating systems), storage devices, and network devices.

[0071] According to the logical function division, the PaaS (Platform as a Service) layer can be deployed on the IaaS (Infrastructure as a Service) layer, and the SaaS (Software as a Service) layer can be deployed on top of the PaaS layer. The SaaS layer can also be directly deployed on the IaaS. PaaS is a platform for software operation, such as databases, web containers, etc. SaaS is various business software, such as web portals, SMS mass senders, etc. Generally speaking, SaaS and PaaS are upper layers relative to IaaS.

[0072] Among them, the test method for the advertisement style involved in the embodiments of this application can be implemented through cloud computing. The test method for the advertisement style can be applied to the advertisement style rendering test in application programs or web pages involved in cloud technology, intelligent transportation, assisted driving, and map fields, and will be specifically described through the following embodiments:

[0073] For example, see Figure 1 , which is a schematic diagram of the scenario of the test system for the advertisement style provided by the embodiments of this application. The devices in this scenario system can include servers and terminals. The server can directly execute the test method for the advertisement style in the embodiments of this application to cooperate with the relevant application programs on the terminal for the advertisement style rendering test.

[0074] Among them, an application program capable of delivering advertisements is installed on the terminal in the system. The application program is not limited to application programs such as map type, instant messaging type, game type, shopping type, video type, and other categories. The application program can achieve data interaction with the corresponding backend (server) through the transmission mode of the traffic data of the communication operator. In the embodiment of the present application, the advertisement style is rendered and tested by using the application program of the traffic data of the communication operator, so that the test conditions are consistent with the usage environment of the external network users, so as to maximize the approximation to the real scenario of the advertisement style rendering of the external network during the test process and improve the accuracy of the rendering test.

[0075] Among them, the server in the system can obtain the advertisement styles developed by relevant personnel and the created test cases, and render and test the newly developed advertisement styles in different environments according to the test cases. For example, the newly developed advertisement styles are rendered and tested in the test environment, regression tested in the pre-release environment before the advertisement styles are released, and released and tested in the online environment for the newly developed advertisement styles. Specifically, the test process of the advertisement styles of the server is as follows: when the test of the advertisement style to be released passes in the test environment, obtain the advertisement request from the online operating environment. The advertisement request includes the advertisement position identifier; respond to the advertisement request in the pre-release environment, and obtain the target advertisement and the advertisement style to be released for presenting at the advertisement position indicated by the advertisement position identifier from the advertisement playback system in the online operating environment; the target front-end code running in the pre-release environment renders the target advertisement according to the advertisement style to be released to obtain the rendering result of the advertisement to be released; among them, the pre-release environment is an operating environment obtained by simulating the online operating environment, and the target front-end code at least includes the advertisement backbone rendering code and the target advertisement style code defining the advertisement style to be released; if it is determined that the advertisement style to be released passes the test in the pre-release environment according to the rendering result of the advertisement to be released, conduct a release test on the advertisement style to be released in the online operating environment.

[0076] Exemplarily, taking the rendering test of a shopping - type advertisement style as an example, assume that the platform has developed a new advertisement style for shopping (which can be understood as a product recommendation type), that is, the advertisement style to be released. Before releasing this new advertisement style, it is necessary to conduct a rendering test on it. This rendering test process is carried out through an application that uses the real traffic data of the operator, such as a video application (client), a game client, a shopping client, etc., to ensure that the rendering process of the new advertisement style can be close to the real usage environment and improve the authenticity of the rendering test of the new advertisement style. The test process includes three stages, specifically: The first stage is the test environment stage. Mainly, the new advertisement style is independently rendered through the application in the test environment to test whether the new advertisement style can be successfully rendered through the separate rendering method. When the new advertisement style is successfully rendered separately in the test environment, it means the test passes, and then it enters the second stage; The second stage is the test stage in the pre - release environment. This stage is mainly for the hybrid test before the release of the new advertisement style. Among them, the code of the historical advertisement style can be understood as the main code, and the code of the new advertisement style can be understood as the branch code. This stage is mainly to set the targeted release scope that can access the pre - release environment. This targeted release scope includes multiple applications that can access the pre - release environment. The rendering after incorporating the code of the new advertisement style into the main code is tested through the applications defined by the targeted release scope. It can be understood as a regression test to test whether the new advertisement style can be successfully rendered after integrating into the main code. In addition, it is also necessary to conduct a rendering regression test on all the original historical advertisement styles. When the above regression tests pass, it enters the third test stage; The third test stage is the comprehensive rendering test stage in the online environment (external network environment or production environment). This stage is mainly to conduct a rendering test on the new advertisement style through the applications defined by the targeted release scope, and conduct an automated test on all the historical advertisement styles. Thus, the release scope of the new advertisement style is limited, that is, the new advertisement style is only valid for the applications within the targeted release scope, to test whether the new advertisement style can be successfully rendered in the external network environment and whether all the historical advertisement styles can be successfully rendered, so as to subsequently decide the release strategy of the new advertisement style according to the test results of the test stage in the external network environment. For example, when the test fails, the new advertisement style is not released; when the test passes, the advertisement style is released. For example, the new advertisement style is released in a quantitative release method, that is, it is gradually released according to the percentage of the number of users to achieve the quantitative release of the new advertisement style.

[0077] Exemplarily, for the rendering test process of the shopping advertisement style in the previous example, the front-end page scenario on the application side is introduced. Specifically, taking the shopping advertisement style rendering test of the game application on the tester's terminal as an example, the operator's real traffic data is used. During the test, the game application can pop up a shopping advertisement page before, during, and after the game. The shopping advertisement page can display the rendering screen of the new shopping advertisement style, such as the content layout of a product introduction page, including but not limited to the product name, product appearance, dynamic background elements, "buy" or "learn more" interactive components, etc. When the tester clicks to trigger the interactive component, the page will jump to the detailed page of the product, such as the order purchase page, the product details introduction page, etc., depending on the actual situation. Alternatively, the tester triggers other elements in the advertisement page and responds accordingly, such as the presentation of emoticons, product explanation pop-ups, greetings, prompt information boxes, merchant dialog boxes, etc. The above are only examples of rendering results, and the rendering results are determined by the new advertisement style. The above is only an introduction to the rendering of a new ad style. The rendering test is to test the rendering process and rendering results of any ad style, such as determining the accuracy of the rendering results, or testing whether the ad style can be successfully rendered.

[0078] It should be noted that the above are only examples and can also be applied to test scenarios of other advertising styles, which will not be described in detail here.

[0079] For ease of understanding, each step of the advertising style testing method will be described in detail below. It should be noted that the order of the following embodiments is not intended to limit the preferred order of the embodiments.

[0080] In the embodiment of the present application, the test device of the advertisement style will be described from the dimension, and the test device of the advertisement style can be integrated into a computer device such as a server. The server can be a distributed system composed of multiple physical servers, each of which carries a server. Figure 2 , Figure 2 The following is a flow chart of the steps of the advertising style testing method provided in the embodiment of the present application. The embodiment of the present application takes the advertising style testing device as an example, in which the advertising style testing device is specifically integrated on the server. When the processor on the server executes the program instructions corresponding to the advertising style testing method, the specific process is as follows:

[0081] 101. When the advertisement style to be published passes the test in the test environment, an advertisement request from the online operation environment is obtained.

[0082] In the embodiments of the present application, it can be applicable to the test scenario of a new function to be released. The new function can be any product, such as an image product style, a business logic program, etc. Among them, the image product style can be a product style in any field, such as an advertisement style, a regional map screen style, a video style, etc., which is not limited here. Taking the advertisement style as an example, when a developer develops a new advertisement style (which can be understood as a new function), it is necessary to perform a rendering test on the developed advertisement style to ensure that the new advertisement style can be successfully rendered before the newly developed advertisement style can be released. Therefore, the server obtains the new advertisement style to be tested uploaded by the developer for subsequent execution of the rendering test process for this advertisement style.

[0083] Among them, the advertisement style to be released can be a newly developed advertisement style. The advertisement style can be understood as the rendering style of the advertisement content, and this rendering style is not limited to being reflected by the shape and arrangement method of advertisement elements. Exemplarily, taking image-based advertisements as an example, the advertisement content is not limited to including advertisement image elements, advertisement text elements, etc. The advertisement style can define the shape, position, etc. of the advertisement image elements and advertisement text elements in the final rendering result.

[0084] Exemplarily, taking the commodity advertisement style as an example, the commodity advertisement style can include multiple product information layout styles. Suppose it includes four product information items: car keychain, mobile phone, basketball, and lipstick. Each product information item is contained in a corresponding information box. Then the advertisement style can include the arrangement and layout styles of these four product information boxes. For example, the style can be that these four product information boxes are arranged in the same row, or arranged in the same column, or distributed in a "cross shape" from top to bottom, left to right, etc., which is not limited here.

[0085] Exemplarily, taking the commodity advertisement style as an example, the commodity advertisement style can be a layout style of a product information item. The product information includes materials such as product appearance, product name, and product introduction (abstract). Then the advertisement style can include the arrangement and layout relationships among the above product information items, which defines the distribution, position, etc. of each product information element when rendering this advertisement style. So that the advertisement of this product is more novel and improves the user's interest in the advertisement. The above is only an example, and other advertisement materials can also be included in the advertisement, which depends on the actual situation. It should be noted that the advertisement style can also be to define the distribution position / area of one or more elements and materials, and it does not limit which specific element or material is placed in each position or area.

[0086] It should be noted that after developers develop an advertisement style, they can publish the code of the new advertisement style (the advertisement style to be released) to the server of the test environment for rendering tests in the test environment, and also publish it to the server of the pre-release environment for rendering tests in the pre-release environment. In addition, it is also published to the server of the online environment for rendering tests in the online environment.

[0087] In the embodiment of the present application, the rendering test process of the advertisement style to be released may include rendering test stages in three different environments, such as including three stages: the test environment, the pre-release environment, and the external network environment. These three stages can all cooperate through an application that uses communication operator traffic data to complete the test. Corresponding test processes are respectively executed in different stages to ensure the sufficiency of the advertisement style rendering test. When the advertisement style to be released can be normally rendered in all stages, the advertisement style to be released is officially released, which is reliable. The test processes of these three stages are described separately below.

[0088] (A) Rendering test of the environment to be released in the test environment. The specific process is as follows:

[0089] In the embodiment of the present application, it is necessary to conduct a separate test on the rendering situation of the advertisement style to be released to ensure whether the advertisement style to be released can be rendered. This is the basic link for detecting whether there are vulnerabilities, errors, and other problems in the style to be released. Specifically, when conducting a separate rendering test on the advertisement style to be released, the advertisement style to be released is mainly rendered through the first target application in the test environment. This application uses a wireless network connection method to interact with the server deployed with the test environment to complete the rendering test of the advertisement style to be released in the test environment.

[0090] Among them, the first target application uses operator traffic data to connect to the server deployed as the test environment, so that the front end of the first target application is in the test environment, so that the front end completes the rendering of the advertisement style to be released in the test environment to obtain the first rendering result, and then determines the first test report according to the first rendering result. It should be noted that since the first application uses operator traffic data to support data interaction, that is, for matters such as style loading, rendering data acquisition, and rendering operation involved in the rendering process, the above matters can be supported by real traffic data.

[0091] Among them, the first test result for the advertisement style to be released in the test environment may include one or more rendering results for the advertisement style to be released, which are specifically determined according to the style items included in the advertisement style to be forwarded. Exemplarily, if the advertisement style to be released includes the style items of the advertisement page content and the advertisement interaction components on the advertisement page, the first test report may include the style rendering result of the advertisement page content and the style rendering result of the advertisement interaction components. Exemplarily, if the advertisement style to be forwarded may include the style items of the advertisement interaction components and the style items of the page after the advertisement interaction components jump, the first test report may include the style rendering result of the advertisement interaction components and the style rendering result of the style items of the page after triggering the advertisement interaction components to jump.

[0092] In the embodiments of the present application, it is mainly to test the independent rendering process of each advertisement style to be released in the test environment, such as testing whether the advertisement element rendering and / or the interaction component jump page are normal during the rendering process of the advertisement style to be released. Among them, the test environment is a dedicated environment for testing the advertisement style to be released, which can be understood as a closed test environment for a newly developed function. Since the test process is implemented by using the first target application with real traffic data, in order to enable the first target application to switch to the test environment, it is necessary to configure the test conditions for the first target application before the independent rendering test for the advertisement style to be released, so that the configured target application can switch to the test environment.

[0093] In some embodiments, the server may configure the application program (front-end) according to the device address. For example, before step 102, it may include: obtaining an optional application list, where the optional application list includes at least one application program that can display advertisements, and the application program is associated with the device address of the terminal device where it is located; configuring the test conditions for the corresponding application program according to the device address to obtain the configured target application, where the test conditions are test configuration conditions that can meet the test environment.

[0094] Among them, the optional application list may be an information list including the application programs used to cooperate in the test in the test environment. The optional application list includes the identification of each application program used for the test and the device address of each device where the application program is located. It should be noted that the application programs included in the optional application list can be used to display advertisements; Exemplarily, taking a game application as an example, the game application can run a game session and pop up an advertisement window or an advertisement page before, during, or after the game session. For the above application programs with advertisement display scenarios, some application programs and the device addresses of their terminal devices can be selected and added to the optional application list.

[0095] Among them, the device address can be the device address of the device where the corresponding application is located. Since the device address is generally unique, the device address can also be the unique address used to represent the corresponding application. The device address can be represented by an address code composed of multiple characters and can also be the device serial number, which is not limited here. It should be noted that the server can find the corresponding application through the device address.

[0096] Specifically, in order to enable the relevant applications to switch to the test environment during the test process, it is necessary to configure the test conditions for the application. Among them, the configuration process is as follows: The server obtains the pre-set list of optional applications. For each device address information in the list of optional applications, the corresponding terminal device is determined according to the device address information, and the test conditions for the application on the terminal device are configured. The test conditions can be to add some switch components designed during the test process. For example, the switch component can be understood as a component used to switch the front-end environment of the application to the test environment, and the target application after configuration is obtained.

[0097] Among them, the test environment can be an environment composed of configurations such as network, hardware, and software. It pre-stores the codes of the developed advertisement styles, that is, it includes the codes of the advertisement styles to be released and the historical advertisement styles. The test environment is used to perform independent rendering tests on any advertisement style. It should be noted that the test environment can be understood as a vacuum environment built in the intranet, that is, the test environment is isolated from the external network. A separate test environment needs to be deployed for each advertisement style to be released during development. By performing rendering tests and validations on the corresponding advertisement styles to be released in this test environment, it is possible to avoid affecting external network users before the advertisement styles to be released are fully validated, which has reliability.

[0098] In some embodiments, developers can deploy a test environment for each advertising style to be released. When testing one of the advertising styles to be released, it is necessary to switch the front end of the first target application for testing to the corresponding test environment, and enable the first target application in this test environment to perform a rendering test on the current advertising style to be released. For example, the test process is as follows: Determine the version number of the style template currently supported by the front end of the first target application; Obtain the first ad slot identifier sent by the first target application, and allocate ad data for the first target application according to the first ad slot identifier and the version number of the style template. The ad data may include the target style identifier of the advertising style to be released and ad attribute information; In response to the test environment switching request of the target application, switch the target application to the test environment pre-deployed for the advertising style to be released, so that the target application in the test environment pre-deployed for the advertising style to be released renders the advertising style to be released corresponding to the target style identifier according to the ad attribute information, so as to test the advertising style to be released in the test environment.

[0099] Among them, the style template may include the advertising style identifier supported by the corresponding first target application. Specifically, the first target application can obtain the style template according to its own conditions. For example, the first target application obtains a style template that matches the current conditions according to various factors such as its own client version and client configuration.

[0100] Among them, the ad attribute information may at least include an ad identifier and an ad slot identifier. The ad identifier may be the identifier of the corresponding ad material, which is used to define the specific content in the ad. The first target application can obtain the material corresponding to the ad content according to the ad identifier. The material is not limited to including the interactive components of the ad, elements of the ad page (such as specific images, icons, titles), etc. The ad slot identifier may be the identifier of the ad display position. For example, the front-end interface of the first target application is divided into multiple regions, each region has a corresponding identifier, and the ad slot identifier defines that the ad page is displayed in a specific region of the interface of the target application.

[0101] Specifically, the first target application determines the style templates it supports according to its own characteristics (such as client version, version parameters, etc.). The style template represents the ad styles that the target application can support, and the style template is associated with a version number. The independent rendering test process for the new ad style is as follows: First, the server for ad style testing determines the version number of the style template of the first target application. Through this version number, the ad styles supported by the first target application can be learned, such as which style of ad the first target application supports. Then, according to this version number and the ad position identifier of the front-end page for the first target application, ad data is distributed to the first target application. The ad data is not limited to including ad attribute information and ad style identifiers. For example, according to the style types supported by the first target application, the ad style identifier of the latest style of this style type is assigned to the first target application. It should be noted that the first target application will obtain the corresponding ad style to be released according to the ad style identifier and send a test environment switching request for pre-deploying the ad style to be released. Finally, the server will respond to the test environment switching request and connect the terminal device where the first target application is located to the test environment matching the current ad style to be released, so that the first target application can independently render the current ad style to be released according to the ad attribute information in this test environment to test the independent rendering of the ad style to be released. In this way, an independent rendering test can be performed on the ad style to be released to test whether the ad style to be released can be correctly rendered before release, ensuring that the ad style to be released is error-free and reliable.

[0102] It should be noted that the ad attribute information may also include an ad software development kit (SDK) identifier. The target application can obtain the corresponding ad software development kit according to the ad software development kit identifier. The ad software development kit provides ad capabilities for the target application, so that subsequently, based on the ad capabilities provided by the ad software development kit, the ad style to be released corresponding to the ad style identifier is rendered according to the ad attribute information.

[0103] (B) Regarding the rendering process of testing the ad style to be released in the pre-release environment, refer to steps 102-103 of the embodiment of the present application, and the specific description is as follows:

[0104] In the embodiment of the present application, when the ad style to be released can be normally rendered in the test environment, it means that the test of the ad style to be released in the test environment passes. At this time, the test stage of the pre-release environment can be entered. In the test stage of this pre-release environment, a rendering test for simulating the release of the new ad style is mainly performed. It can be understood that this test stage is not a real release test stage, but a simulation drill for the rendering when the new ad style is released.

[0105] It should be noted that during the testing phase of the pre-release environment, the code of the advertisement style to be released needs to be incorporated into the main trunk, and the advertisement style to be released is rendered through the front end of the second target application that uses the real traffic data of the communication operator, so as to test the rendering process of the advertisement style to be released in the pre-release environment. Among them, the target terminal and the server where the second target application is located are in the online environment (i.e., the external network environment or the production environment), and the front end of the second target application is switched to the pre-deployed pre-release environment through the reverse proxy service of the server. In this way, the simulation test in the pre-release environment is made as consistent as possible with the release test in the online environment in terms of environmental conditions, so as to maximize the real simulation of the actual external network scenario to perform the rendering test before the release of the advertisement style to be released and ensure that the advertisement style to be released is fully and effectively verified.

[0106] In some embodiments, the test condition configuration of the pre-release environment can be performed on the second target application so that the configured second target application can be switched to the pre-release environment. For example, after step 101 or before step 102, it may include: obtaining an optional application list, where the optional application list includes the device addresses of at least one application program that can display advertisements, and performing test condition configuration on the corresponding application program according to the device address to obtain the configured second target application. The test condition is the test configuration condition that can meet the pre-release environment, and for details, reference can be made to the description of the first target application program.

[0107] It should be noted that during all test phases, the target terminal that uses the real operator traffic data interacts with the server, and different environment switches are performed through the reverse proxy to implement the rendering of the advertisement style to be released by the application programs in different environments. Therefore, in each test phase, the target terminal where the front-end corresponding client is located is in the online environment. Therefore, all advertisement requests in the test phases come from the online environment. Among them, the advertisement request includes an advertisement position identifier. The advertisement position identifier can be the identifier of the display position of the advertisement on the front-end page of the relevant application.

[0108] In some embodiments, after the server receives the advertisement request from the online environment, it needs to first switch the environment connected to the front end of the second target application to the pre-release environment and forward the received advertisement request to the pre-release environment. For example, after step 101 or before step 102, it may include:

[0109] (B.1) Obtain the first targeting range of the advertisement style to be released in the pre-release environment;

[0110] (B.2) If it is determined that the initiator identifier of the advertisement request is within the first targeting range, based on the address information of the pre-release environment, perform reverse proxy on the advertisement request to forward the advertisement request to the pre-release environment.

[0111] Among them, the first targeting scope may include the target terminals covered by the to-be-published advertisement style during testing in the pre-published environment or the applications (such as the second target application) on the target terminals. Specifically, the first targeting scope may include one or more object identifiers, which may be target terminal identifiers or identifiers of the applications on the target terminals. Among them, the target terminal identifier may be the device address information or device serial number of the target terminal, and the identifier of the application may be the address information of the application. The first targeting scope is used to limit the target terminals or the second target applications on the target terminals that can access the to-be-published advertisement style in the pre-published environment, indicating that the to-be-published advertisement style is only valid for the target terminals corresponding to the target terminal identifiers or the applications (such as the second target application) on the target terminals. The application (such as the second target application) on the target terminal can be rendered after the to-be-published advertisement style is merged into the main trunk. It should be noted that the second target application may be an application on the target terminal involved in the first targeting scope that can display advertisements. It can be understood that the to-be-published advertisement style is published into the pre-published environment, and the second target application defined by the first targeting scope can access the pre-published environment, that is, the publication is only valid for the second target application.

[0112] Among them, the reverse proxy refers to obtaining information or requesting a response through a proxy service. Specifically, the reverse proxy means that the client request obtains information or a response item from the proxy service, and the proxy service forwards the request to the corresponding business server (such as the server side of the pre-published environment) for response. Among them, when the type of the request is an information acquisition request, the server returns the result to the proxy service, and the proxy service feeds back the result to the client; when the type of the request is a matter response request, after the proxy service forwards the matter response request to the server, the server will execute the relevant matters.

[0113] It should be noted that in the testing stage of the pre-published environment, mainly the second target application defined by the first targeting scope is used to render the to-be-published advertisement style after it is merged into the main trunk to test the rendering process. Therefore, it is necessary to forward the received advertisement request to the pre-published environment for processing. Specifically, first determine the first targeting scope of the to-be-published advertisement style in the pre-published environment, and this first targeting scope includes the object identifiers allowed to access the pre-published environment; furthermore, determine the initiator identifier of the advertisement request, and pair the initiator identifier with all the object identifiers in the first targeting scope. If a target object identifier consistent with the initiator identifier can be paired from the first targeting scope, it is considered that the initiator of the advertisement request (such as the target terminal or the second target application on the target terminal) can access the pre-published environment. At this time, the advertisement request can be forwarded to the corresponding server side of the pre-published environment through the proxy service on the server, so that the second target application switches to the pre-published environment.

[0114] Exemplarily, the first targeting range can be understood as a whitelist, which contains the target terminal identifiers of the target terminals that can access the pre-release environment. When the front-end corresponding to the target terminal (the interface layer on the candidate application) sends an advertisement request for the pre-release environment, it can be implemented through a reverse proxy service, which can be an Nginx service. The Nginx service has the forwarding ability and can forward the request to the server side of the pre-release environment. Specifically, after receiving the advertisement request, the Nginx service forwards the advertisement request to a specified web server, and the web server contains a whitelist of the target terminal identifiers of one or more target terminals that can access the pre-release environment. When the web server receives the advertisement request, it forwards the advertisement request to the pre-release environment, and at the same time, causes the front-end on the target terminal to switch to the pre-release environment.

[0115] In some embodiments, the targeted release range for the advertisement style to be released can be determined according to screening options such as the whitelist of the terminal device and the client version number. For example, step (B.1) may include: obtaining a list of object information, where the list of object information contains multiple object identifiers and the client version number associated with each object identifier; determining the compatible version number that is compatible with the advertisement style to be released; filtering the object identifiers in the list of object information according to the compatible version number to screen out the target object identifiers whose associated client version numbers are compatible with the advertisement style to be released; and determining the first targeting range of the advertisement style to be released in the pre-release environment according to the target object identifiers.

[0116] Specifically, taking the terminal device as an "object" as an example, the list of object information is the list of terminal information, and the object identifier is the terminal identifier. Specifically, the server can obtain the list of terminal information, which contains multiple terminal identifiers, and the client version number associated with each terminal identifier. It should be noted that an application program (i.e., the client) is installed on each terminal device corresponding to each terminal identifier, and each application program has a corresponding client version number. Therefore, each terminal identifier is associated with the client version number on the corresponding terminal device. Furthermore, the compatible version number of the client that is compatible with the advertisement style to be released can be determined. It can be understood that the advertisement style to be released is a newly developed advertisement style, which may have client version requirements. Only clients above a specific version can meet the rendering conditions for the advertisement style to be released. Therefore, according to the compatible version number, the client version numbers associated with each terminal identifier can be filtered to screen out at least one target terminal identifier from the list of terminal information. Thus, the one or more target terminal identifiers screened out are determined as the first targeting range of the advertisement style to be released in the pre-release environment.

[0117] 102. In response to an advertisement request in a pre-release environment, obtain a target advertisement and a to-be-released advertisement style for presentation at the advertisement position indicated by the advertisement position identifier from an advertisement playback system operating in a live environment.

[0118] In an embodiment of the present application, after receiving an advertisement request, the server in the pre-release environment responds to the advertisement request and obtains, from an advertisement playback system (advertisement playback server) operating in the live environment, the target advertisement and the to-be-released advertisement style allocated for the advertisement position identifier carried in the advertisement request, so as to satisfy the subsequent rendering of the to-be-released advertisement style by the front end of the second target application connected to the pre-release environment.

[0119] In some embodiments, the advertisement styles supported by the front end of the second target application on the target terminal sending the advertisement request may be determined first, and the to-be-released advertisement style and the target advertisement may be allocated to the front end in combination with the advertisement position identifier. For example, step 102 may include: in response to an advertisement request in a pre-release environment, determining an advertisement style template supported by the initiator of the advertisement request; according to the advertisement position identifier, obtaining, in an advertisement playback system operating in a live environment, the to-be-released advertisement style that conforms to the advertisement style template, and determining the target advertisement; and sending, by the advertisement playback system operating in a live environment, the to-be-released advertisement style and the target advertisement to the pre-release environment.

[0120] It should be noted that the server may include an advertisement style configuration server. The advertisement style configuration server may generate an advertisement style template according to the own characteristics of the second target application (such as the client version, version parameters, etc.). The advertisement style template includes the advertisement styles that the front end of the second target application can support for rendering, and the advertisement style template is associated with a target version number. Specifically, when allocating the to-be-released advertisement style to the front end of the second target application, first, the advertisement style configuration server can learn about the advertisement styles supported by the second target application through the target version number, such as which type of advertisement styles the second target application supports; then, according to the target version number and in combination with the advertisement position identifier, target advertisement data is allocated to the front end. The target advertisement data includes the target style identifier of the to-be-released advertisement style and the target advertisement identifier, and the target style identifier and the target advertisement identifier are sent to the advertisement playback system; finally, the advertisement playback system operating in the live environment forwards the target advertisement data. For example, on the one hand, the advertisement playback system operating in the live environment returns the target style identifier and the target advertisement identifier to the second target application to provide a basis for subsequent rendering by the second target application, and on the other hand, the advertisement playback system operating in the live environment sends the relevant content of the to-be-released advertisement style and the target advertisement to the server in the pre-release environment. It should be noted that all the to-be-released advertisement styles and target advertisements may also be pre-published in the server in the pre-release environment, which is not limited here.

[0121] In the above manner, the server in the pre-release environment responds to the advertisement request for the second target application, and obtains the target advertisement and the to-be-released advertisement style allocated for the advertisement space on the front-end page of the second target application, so as to meet the subsequent rendering of the to-be-released advertisement style by the front-end of the second target application connected to the pre-release environment.

[0122] 103. The target front-end code running in the pre-release environment renders the target advertisement according to the to-be-released advertisement style to obtain the rendering result of the to-be-released advertisement.

[0123] In the embodiment of the present application, the test phase of the pre-release environment is mainly a rendering test for simulating the release of the to-be-distributed advertisement style. Compared with the test of the online environment, the test in this phase can be understood as a simulated regression test before release to obtain the test result in the pre-release environment. Specifically, in the test phase of the pre-release environment, it is necessary to incorporate the code of the to-be-released advertisement style into the main trunk, and use the front-end of the second target application with the real traffic data of the communication operator to perform hybrid rendering on the to-be-released advertisement style after incorporating it into the main trunk, so as to test whether the front-end of the second target application in the pre-release environment can normally render the to-be-released advertisement style, so as to ensure a full test of the to-be-released advertisement style before release.

[0124] Among them, the pre-release environment is a running environment obtained by simulating the online running environment. The online running environment is an external network environment, a production environment or an online environment.

[0125] Among them, the target front-end code at least includes advertisement main-trunk rendering code and target advertisement style code defining the to-be-released advertisement style. It should be noted that the main trunk can include the code of all historical advertisement styles, which can be understood as the main trunk branch; the code of all historical advertisement styles of all advertisements constitutes a code library, and the main trunk is the main score in the code library, that is, the "master" branch. The latest version of the advertisement style can be obtained on this main trunk branch, which is the basis for other branches except the main trunk. Changing the main trunk branch will affect all other branches; among them, other branches can be understood as an independent code version separated from the main trunk branch. This branch can be changed and experimented independently of the main trunk, and development, testing and error fixing can be carried out on the branch. Subsequently, the updated branch can be merged back into the main trunk. Based on the above, the advertisement main-trunk rendering code can be the style code of all historical versions of the to-be-released advertisement style, which can be understood as a chained main-trunk code and can constitute a code database.

[0126] In some embodiments, for the regression testing of rendering the advertisement style to be released in the pre-release environment, mainly the code of the advertisement style to be released is incorporated into the main trunk and then simulated rendering testing is performed. For example, before step 103, it may further include: uploading the target advertisement style code to the pre-release environment; merging the advertisement main trunk rendering code in the pre-release environment with the advertisement style code to obtain the target front-end code.

[0127] Exemplarily, assume that the code version of the current advertisement style to be released is 1.5, then it usually includes historical versions of advertisement styles such as 1.0, 1.1, 1.2, 1.3, 1.4, etc. Each version of the advertisement style has corresponding code. The advertisement main trunk rendering code can be understood as a chained main trunk code, which is represented by the version number as "1.0 - 1.1 - 1.2 - 1.3 - 1.4". Further, the code of the advertisement style to be released is incorporated into the main trunk code to obtain the target front-end code, and the main trunk point is represented by the version of the code, specifically "1.0 - 1.1 - 1.2 - 1.3 - 1.4 - 1.5". The above is only an example and not a limiting embodiment.

[0128] In some embodiments, before the release of the advertisement style to be released, automated testing of rendering the historical advertisement style can also be performed, specifically, the automated testing can be performed on the historical style according to the historical test cases. For example, if the target front-end code further includes the first advertisement style code defining the historical advertisement style, the testing process in the pre-release environment may further include: obtaining at least one historical test case for the historical advertisement style; in the pre-release environment, performing automated rendering based on the historical test case by the first advertisement style code and the advertisement main trunk rendering code in the target front-end code to obtain the rendering result of the historical advertisement style; the rendering result of the historical advertisement style is used to determine the test result of the advertisement style to be released in the pre-release environment in combination with the rendering result of the advertisement to be released.

[0129] Among them, the historical test case can be a case for testing the compatibility between the advertisement style to be released and the historical advertisement style during the rendering process. Specifically, a use case is a description of a set of actions initiated by a participant, and the system will generate corresponding response results after responding to the set of actions. Exemplarily, taking a user logging in to an e-commerce platform as a use case, the participant in this use case is the user. The participant initiates and executes a series of operations. If the system responds to the user's actions, the response result is a successful login. It should be noted that the participant can specifically be a user terminal or a client on the terminal, which is not limited here. Further, the test case describes the test actions for the function (advertisement style) and the test results presented after responding to the test actions. It is easy to understand that the historical test case is the case when the historical advertisement style performs rendering testing at a historical time.

[0130] It should be noted that the test phase of the pre-release environment mainly conducts rendering tests on the to-be-released advertisement styles by simulating their release, which requires merging the to-be-released advertisement styles into the main trunk. Therefore, to ensure that the historical advertisement styles are not affected by the to-be-released advertisement styles during subsequent rendering, automated rendering tests can be performed on the historical advertisement styles according to the historical test cases. Specifically, when testing the historical advertisement styles, one or more historical test cases can be obtained for each historical advertisement style. Then, automated test instructions are generated according to each historical test case. The automated test instructions can be instructions for the logical sequence of test actions for the historical advertisement styles, which can represent the control logic of the test process for the historical advertisement styles. Further, the automated test instructions are sent to the target terminal to instruct the second target application in the pre-release environment on the target terminal to perform automated rendering processing on the historical advertisement styles to test the automated rendering process of each historical advertisement style, thereby realizing the rendering test of the historical advertisement styles in the pre-release environment. By following the above method, automated rendering tests are performed on each historical advertisement style, which improves the test efficiency and realizes regression testing on all historical advertisement styles to test whether the code of the to-be-released advertisement styles affects the rendering of the original historical advertisement styles after being merged into the main trunk, and has reliability.

[0131] In some embodiments, the test in the pre-release environment may include verifying the rendering results of each style and / or verifying the interactions involved in the rendering process. For example, taking the to-be-released advertisement style as an example, the rendering test content in the pre-release environment includes testing the view of the rendered advertisement page and the jump page when an interactive component on the advertisement page is triggered. Then, after step 103, there may also be a step of "obtaining the test results of the rendering results for the to-be-released advertisement style", which may specifically include: obtaining the first rendering result when rendering the to-be-released advertisement style, where the first rendering result at least includes the advertisement page corresponding to the to-be-released advertisement style; obtaining the second rendering result of the jump page when the interactive component on the advertisement page of the to-be-released advertisement style is triggered; and generating for the to-be-released advertisement style according to the first rendering result and the second rendering result.

[0132] By the above method, before the release of the to-be-released advertisement style, a rendering test after simulating the release of the to-be-released advertisement style is realized in the pre-release environment, so as to verify the rendering situation after release before the release of the advertisement style. In addition, regression testing is also performed on the historical advertisement styles to ensure that it can be verified whether the release of the to-be-released advertisement style affects the rendering of the historical advertisement styles before its release, and has reliability.

[0133] 104. If it is determined that the rendering result of the advertisement to be published passes the test in the pre-published environment, the advertisement style to be published is tested for release in the online operating environment.

[0134] In the embodiment of the present application, after obtaining the rendering result of the advertisement style to be published in the pre-published environment, a test result (report) can be generated based on the rendering result. Specifically, the test result can be generated according to whether the rendering result meets the expectation. Further, when the test result is that the advertisement style to be published passes the test in the pre-published environment, the third test stage can be entered. This stage mainly tests the advertisement style to be published in the online environment for release.

[0135] Among them, the release test in the online environment refers to the actual release of the advertisement style in the production environment, and the advertisement style is rendered through the application front-end on the target terminal in the online environment to test the rendering situation of the advertisement style in the online environment. Therefore, in the release test in the online environment, the front-end, the terminal, and the server are all in the online environment.

[0136] It should be noted that when generating the test result based on whether the rendering result meets the expectation, the expectation is not limited to including the expectations on both the front-end and the server sides. For example, the matters affecting the test result are not limited to including: whether the rendering effect of the front-end page meets the expectation, specifically, whether the front-end page renders a dynamic effect, and whether the position layout of the advertisement content elements on the front-end page is accurate; and whether there is an interaction on the server side during the rendering test, such as whether the expected data is returned between the front-end and the back-end, and whether the interaction frequency between the front-end and the back-end meets the expected frequency, and so on. Furthermore, the test result is generated based on the above matters. The above is only an example and is not a limiting implementation manner.

[0137] In some implementation manners, there may still be vulnerabilities in the advertisement style to be published. In order to avoid the impact on a large number of external network users caused by insufficient verification during the release test stage, the advertisement style to be published can be directionally released during the release test stage in the online environment for rendering test after release. For example, step 104 may include: determining the second directional range of the advertisement style to be published in the online operating environment; if the initiator identifier of the first advertisement request from the online operating environment is located within the second directional range, obtaining the first advertisement and the advertisement style to be published from the advertisement playback system in the online operating environment; and rendering and testing the first advertisement according to the advertisement style to be published through the target front-end code running in the online operating environment.

[0138] Among them, the second targeting range may include the target terminal or the third target application on the target terminal covered when the to-be-released advertisement style is tested in the online environment. The second targeting range may specifically include one or more object identifiers, and the object identifier may be a target terminal identifier. For example, the device address information or device serial number of the target terminal is used as the target terminal identifier. The second targeting range is used to define the target terminal or the application program (third target application) on the target terminal that can access the to-be-released advertisement style in the online environment, indicating that the to-be-released advertisement style in the online environment is only valid for the application program (such as the third target application) on the target terminal corresponding to the target terminal identifier. It should be noted that the device address information of the target terminal can also be used to represent the address of the application program on the target terminal. It should be noted that the determination method of the second targeting range can refer to the description of the "first targeting range" in the embodiments of the present application, which will not be elaborated here, and the second targeting range can also be the same as the first targeting range. By defining the target terminal or the application program (or front end) on the target terminal that can access the to-be-released advertisement style in the second targeting range, the effect of targeted gray release can be achieved. When there are vulnerabilities or errors in the to-be-released advertisement style, the impact on the majority of users during the release test phase can be reduced, which is reliable.

[0139] Exemplarily, assume that the second targeting range includes Application A on a certain terminal. When the server receives a first advertisement request for Application A, it forwards the first advertisement request to the server of the pre-deployed online environment through the reverse proxy service. The server of the online environment responds to the first advertisement request, and obtains the allocated to-be-released advertisement style and the first advertisement from the advertisement style configuration server through the advertisement playback system. The advertisement playback system will send the target style identifier of the to-be-released advertisement style and the first advertisement identifier of the first advertisement to Application A on the terminal, and at the same time, send the to-be-released advertisement style and the first advertisement to the server of the online environment. It should be noted that all the to-be-released advertisement styles and advertisements can also be pre-released in the server of the online environment, which is not limited here. It should be noted that releasing the to-be-released advertisement style into the server of the online environment belongs to merging the code of the to-be-released advertisement style into the main trunk, and the main trunk can be the code of the historical advertisement style. The description of "merging into the main trunk" can refer to the introduction of "merging the code of the to-be-released advertisement style into the main trunk" in the part about "pre-release environment" above, which will not be elaborated here. Thereafter, when rendering the first advertisement with the to-be-released advertisement style at the front end of Application A in the online environment according to the set test cases, the rendering effect of the to-be-released advertisement style by the front end of Application A is tested, as well as the interaction with the server of the online environment during rendering, such as which requests, response results, and relevant data Application A returns to the online server, which is specifically determined according to the expected effect of the actual situation.

[0140] In some embodiments, after the rendering test of the advertisement style to be released is completed in the online environment, regression testing needs to be performed on the candidate advertisement styles of the historical versions of the advertisement style to be released. For example, after step 104, it may further include: obtaining the historical test cases of the candidate advertisement styles for each historical version of the advertisement style to be released; testing by the target front-end code in the online running environment based on the historical test cases of the candidate advertisement styles for each historical version of the advertisement style to be released.

[0141] Among them, the target front-end code at least includes the advertisement backbone rendering code and the code defining the advertisement style to be released. It should be noted that the candidate advertisement style is a historical version of the advertisement style to be released, and the advertisement backbone rendering code at least includes the codes of multiple historical versions of the candidate advertisement styles. For the introduction of the target front-end code, reference can be made to the foregoing.

[0142] It should be noted that there may be multiple historical versions of candidate advertisement styles for the advertisement style to be released. For the rendering test of each candidate advertisement style, it can be tested according to the historical test case corresponding to the candidate advertisement style. Specifically, for the historical test case corresponding to each candidate advertisement style, an automated test instruction can be generated according to the historical test case, and the target application in the pre-release environment can be controlled according to the automated test instruction to perform automated rendering processing on the historical advertisement style, so as to implement automated rendering testing on the candidate advertisement styles of the historical versions of the advertisement style to be released in the online environment and improve the test efficiency. In this way, after a new advertisement style is released in the online environment, automated rendering testing can be performed on the candidate advertisement styles of the historical versions of the new advertisement style. The rendering test of the candidate advertisement style can be understood as regression testing to avoid the impact of the newly released advertisement style on the advertisement styles of its historical versions, which is reliable.

[0143] In some embodiments, automated rendering testing in the online environment can also be performed on the target historical advertisement styles of other historical versions of non-advertisement styles to be released, so as to test whether the advertisement style to be released has an impact on other historical advertisement styles after being released to the online environment. For example, after step 104, it may further include: obtaining the historical test cases of the target historical advertisement style, where the target historical advertisement style is any advertisement style other than the advertisement style to be released and the advertisement styles of each historical version of the advertisement style to be released; testing by the target front-end code in the online running environment based on the historical test cases of the target historical advertisement style.

[0144] Among them, the target front-end code includes the code of the target historical advertisement style.

[0145] Specifically, corresponding automated test instructions can be constructed according to each historical test case, and according to the automated test instructions, the target front-end code in the online environment can be controlled to perform automated rendering of corresponding advertisements according to the target historical advertisement styles, so as to test the automated rendering process and the rendering results. In this way, in the face of a large number of target historical advertisement styles, testing is carried out through the method of automated rendering testing, improving the testing efficiency.

[0146] In some embodiments, when performing automated rendering testing on the candidate advertisement styles of any historical advertisement style and the historical version of the advertisement style to be released, the rendering testing of each of the above historical advertisement styles can be performed according to the fallback testing method. Among them, the fallback testing refers to ensuring that the advertisement style of the lowest version (which can be understood as the basic version) of each historical advertisement style can be successfully rendered, and it can be regarded as the automated rendering testing of all historical advertisement styles passing. Specifically, the fallback testing process is as follows: obtain the version downgrade testing instruction, which can be generated by changing the network or any configuration parameters in the online environment, and by triggering the version downgrade testing instruction, according to the corresponding historical test case, the front-end in the online running environment is instructed to sequentially traverse each historical version of the target historical advertisement style in the version downgrade order for automated rendering, so as to test the rendering process of each historical version of the target historical advertisement style.

[0147] It should be noted that when performing automated rendering testing on the historical advertisement styles of each category, when it is tested that the historical advertisement style of any historical version of the target category fails to be rendered in the online environment, continue to perform rendering testing on the historical advertisement styles of lower versions of the target category through the version downgrade testing method. As long as it is ensured that the historical advertisement style of its lowest or basic version can pass the test, it can be regarded as the rendering testing of the historical advertisement styles of the target category passing.

[0148] Through the above method, after the rendering testing of the advertisement style to be released in the pre-release environment passes the simulation release, the advertisement style to be released is directionally released in the online environment within the locked range, and regression testing is performed on the advertisement style to be released and the historical advertisement styles through the front-end within the directional range, so as to make a decision on the large-scale release of the pre-release environment based on the test results of the online environment in the future.

[0149] In the embodiment of the present application, after the rendering testing of the advertisement style to be released in the online environment passes, and after the regression testing of the historical advertisement styles in the online environment passes, the advertisement style to be released in the online environment can be released according to the release strategy.

[0150] In some embodiments, the advertising styles to be released can be gradually released in a quantitative release manner. The process of gradual release can be understood as a phased release process. Specifically, after step 104, it may further include: obtaining the release test results of the advertising styles to be released in the online operating environment; if the release test results pass the test, determining the phased release quantity for the advertising styles to be released, and performing phased quantitative release on the advertising styles to be released according to the phased release quantity.

[0151] Among them, the release test results refer to the results when the advertising styles to be released are tested in the online environment. This result can include the test results of each advertising style to be released by the front-end within the second targeting range and the regression test results of all historical advertising styles. The release test results can be understood in the form of a list, which contains the test results of each advertising style after being released in the online environment.

[0152] Exemplarily, for the front-end defined within the second targeting range, when the release tests of the advertising styles to be released and the historical advertising styles are passed by the front-end in the online environment, it indicates that the advertising styles to be released have passed the independent rendering test in the test environment, the regression test for merging into the main trunk in the pre-release environment, and the targeted release test in the online environment. At this time, a decision can be made to officially release the advertising styles to be released. During the official release process of the advertising styles to be released, the advertising styles to be released can be released in a continuously increasing quantity manner, which can be understood as taking one unit of time as one stage, and each stage allows a target number of users (clients) to be able to access the new advertising style, with phased increases. For example, taking 1 hour, 10 hours, 12 hours, or 24 hours, etc. as the unit of time, each unit of time allows 10,000 users to be able to access the new advertising style, or, at intervals of the unit time, release in accordance with a percentage (10%) of the total number of users, so as to achieve the official quantitative release of the advertising styles to be released in the online environment; the above is only an example and not a limiting embodiment.

[0153] It should be noted that by testing the advertising styles to be released in different stages in the test environment, pre-release environment, and online environment, the sufficiency of the test can be ensured to a certain extent. And after the test passes, according to the quantitative release method, the release strategy of the advertising styles to be released can be adjusted in real time. If errors or vulnerabilities are found in the advertising styles to be released through user feedback or independent discovery by internal personnel during the quantitative release process, the continuous release of the advertising styles to be released can be intercepted in real time, so as to minimize the impact of the errors existing in the advertising styles to be released on external network users, which has reliability.

[0154] As can be seen from the above, in the embodiments of the present application, for a newly developed advertisement style to be released, first, the advertisement style to be released is tested in a test environment. Then, after the advertisement style to be released passes the test in the test environment, a pre-release simulation test is performed on the advertisement style to be released. Specifically, the advertisement style to be released is incorporated into the main trunk in a pre-release environment for rendering to simulate and test the rendering situation of the advertisement style to be released after release. Finally, when the advertisement style to be released passes the test in the pre-release environment, a release test is performed on the advertisement style to be released in an online operating environment to test the rendering situation of the advertisement style to be released in a real online environment. In this way, before the advertisement style to be released is released, a regression test can be performed on the new advertisement style before release in a simulated manner to detect whether there is a rendering failure problem when the new advertisement style is actually released, thus ensuring the user experience.

[0155] According to the method described in the above embodiments, the following will give further detailed descriptions by way of examples.

[0156] Taking the test of the advertisement style as an example, the embodiments of the present application further describe the test method for the advertisement style provided by the embodiments of the present application.

[0157] Figure 3 It is another step flow diagram of the test method for the advertisement style provided by the embodiments of the present application. For the sake of easy understanding, the embodiments of the present application are described in conjunction with Figure 3 for description.

[0158] In the embodiments of the present application, the description will be made from the perspective of the test device for the advertisement style. The test device for the advertisement style can be specifically integrated in a computer device such as a server. For example, when the processor on the computer device executes the program corresponding to the test method for the advertisement style, the specific process of the test method for the advertisement style is as follows:

[0159] 201. Independently perform a rendering test on the advertisement style to be released in a test environment to obtain a first test result.

[0160] In the embodiments of the present application, the rendering test process of the advertisement style to be released may include three different environment rendering test stages, such as including the test environment, the pre-release environment, and the external network environment. These three stages can all be coordinated through an application program using communication operator traffic data to complete the test. Corresponding test processes are respectively executed in different stages to ensure the sufficiency of the advertisement style rendering test. When the advertisement style to be released can be normally rendered in all stages, the advertisement style to be released is officially released, which is reliable.

[0161] Among them, the rendering situation of the to-be-published advertisement style is separately tested in the test environment to ensure whether the to-be-published advertisement style can be rendered. This is the basic link for detecting whether there are vulnerabilities, errors and other problems in the to-be-published style. Specifically, when separately rendering and testing the to-be-published advertisement style, the to-be-published advertisement style is mainly rendered through the front end of the target application in the test environment. The application uses a wireless network connection method to interact with the server deployed with the test environment to complete the rendering test for the to-be-published advertisement style in the test environment. The test process of the test environment is as follows: obtain the advertisement request to be processed from the online environment, forward the advertisement request to be processed to the test environment through reverse proxy, respond to the advertisement request to be processed in the test environment, allocate the to-be-published advertisement style and advertisement content according to the advertisement position identifier in the advertisement request to be processed, and render the advertisement content according to the to-be-published advertisement style through the target front-end code in the test environment to determine the first test result according to the test result of the to-be-published advertisement style in the test environment.

[0162] Among them, the to-be-published advertisement style can be a newly developed advertisement style. The advertisement style can be understood as the rendering style of the advertisement content, and this rendering style is not limited to being reflected by the shape and arrangement method of advertisement elements. Exemplarily, taking the advertisement style of commodity category as an example, the advertisement style of commodity category can include multiple styles of product information layout. Assuming that it includes four product information of car keychain, mobile phone, basketball, and lipstick, and each product information is included in a corresponding information box, then the advertisement style can include the arrangement and layout styles of these four product information boxes. For example, the style can also be that these four product information boxes are arranged in the same row, or arranged in the same column, or distributed in a "cross shape" from top to bottom, left to right, etc. There is no limitation here.

[0163] Among them, the test result can include one or more rendering results for the to-be-published advertisement style, which are specifically determined according to the style items included in the to-be-forwarded advertisement style. Exemplarily, if the to-be-published advertisement style includes the style items of the advertisement page content and the style items of the advertisement interaction components on the advertisement page, then the first test report can include the style rendering result for the advertisement page content and the style rendering result for the advertisement interaction components. Exemplarily, if the to-be-forwarded advertisement style can include the style items of the advertisement interaction components and the style items of the page after jumping triggered by the advertisement interaction components, then the first test report can include the style rendering result of the advertisement interaction components and the style rendering result of the style items of the page after jumping triggered by the advertisement interaction components.

[0164] 202. If the first test result is that the to-be-published advertisement style passes the test in the test environment, then obtain the advertisement request from the online operating environment.

[0165] In the embodiment of the present application, the first test result indicates that the to-be-released advertisement style passes the test in the test environment, which means that the to-be-released advertisement style can be normally rendered in the test environment. At this time, the test phase of the pre-release environment can be entered.

[0166] It should be noted that in all test phases, the target terminal using real operator traffic data interacts with the server, and different environments are switched through a reverse proxy to enable applications in different environments to render the to-be-released advertisement style. Therefore, in each test phase, the target terminal where the corresponding client of the front end is located is in the online environment. Therefore, all advertisement requests in the test phases come from the online environment. Therefore, when entering the test phase of the pre-release environment, an advertisement request of any target terminal (including the client) is also obtained from the online environment.

[0167] Among them, the advertisement request carries an advertisement position identifier, which can be an identifier of the advertisement display position. For example, the front-end page is divided into multiple areas, each area has a corresponding identifier, and the advertisement position identifier defines a specific area on the front-end page where the advertisement page is to be displayed. In some embodiments, the server may store the corresponding to-be-released advertisement style and target advertisement bound to each advertisement position identifier during testing in each environment, so as to render a specific target advertisement according to a specific to-be-released advertisement style at the advertisement position corresponding to the advertisement position identifier. This is not limited herein.

[0168] 203. Obtain the first targeting range of the to-be-released advertisement style in the pre-release environment, and when the initiator identifier of the advertisement request belongs to the first targeting range, perform reverse proxy on the advertisement request according to the address information of the pre-release environment to forward the advertisement request to the pre-release environment.

[0169] In the embodiment of the present application, after entering the test phase of the pre-release environment, a rendering test of the to-be-released advertisement style is performed in the pre-release environment through a targeted test method. Therefore, in the test phase of the pre-release environment, for the advertisement request obtained from the online environment, it is necessary to first determine whether the initiator of the advertisement request (i.e., the target terminal or the application on the terminal) is within the first targeting range corresponding to the targeted test. Only when it belongs to the first targeting range, the advertisement request of the initiator is forwarded to the pre-release environment through the reverse proxy method, so that the front end corresponding to the initiator can subsequently render the to-be-released advertisement style in the pre-release environment to complete the rendering test of the simulated release.

[0170] Among them, the first targeting range may include the target terminals covered by the to-be-published advertisement style during testing in the pre-published environment or the applications on the target terminals. For example, the first targeting range may include one or more object identifiers, which can be understood as target terminal identifiers. Specifically, the target terminal identifier can be represented by device address information, and the device address information can also represent the address of the client on the target terminal. Alternatively, the object identifier may be the identifier of the client on the target terminal, which is not limited herein.

[0171] Exemplarily, the first targeting range can be understood as a whitelist, which contains the target terminal identifiers of the target terminals that can access the pre-published environment. When the front end (the interface layer on the candidate application) corresponding to the target terminal sends an advertisement request for the pre-published environment, it can be implemented through a reverse proxy service, which can be an Nginx service. The Nginx service has the forwarding ability and can forward the request to the server side of the pre-published environment. Specifically, after receiving the advertisement request, the Nginx service forwards the advertisement request to a specified web server, and the web server contains a whitelist of the target terminal identifiers of one or more target terminals that can access the pre-published environment. When the web server receives the advertisement request, it forwards the advertisement request to the pre-published environment and at the same time causes the front end on the target terminal to switch to the pre-published environment.

[0172] 204. In the pre-published environment, in response to the advertisement request, obtain the target advertisement and the to-be-published advertisement style to be presented at the advertisement position indicated by the advertisement position identifier from the advertisement playback system in the online operating environment.

[0173] In the embodiment of the present application, after receiving the advertisement request, the server side of the pre-published environment will respond to the advertisement request and obtain the target advertisement and the to-be-published advertisement style allocated for the advertisement position identifier carried in the advertisement request from the advertisement playback system (advertisement playback server side) in the online environment, so as to satisfy the subsequent rendering of the to-be-published advertisement style by the front end of the second target application connected to the pre-published environment.

[0174] Among them, the target advertisement may be the advertisement content that the server designates the front end to render. For example, it may be shopping-related advertisement content, automobile-related advertisement content, tourist attraction advertisement content, etc. Further, the target advertisement may also be the advertisement content of specific things, such as the advertisement content of a certain product, the advertisement content of a certain automobile, etc., which is not limited herein. It should be noted that the target advertisement has a corresponding target advertisement identifier.

[0175] Specifically, the server may include an advertisement style configuration server. The advertisement style configuration server can generate an advertisement style template according to the own characteristics of the advertisement request initiator (such as the client version, version parameters, etc.). The advertisement style template includes the advertisement styles that the front end of the advertisement request initiator can support for rendering, and the advertisement style template is associated with a target version number. Specifically, when allocating the advertisement styles to be published to the front end of the advertisement request initiator, first, the advertisement style configuration server can learn about the advertisement styles supported by the second target application through the target version number, such as which type of advertisement styles the candidate application supports; then, according to the target version number and in combination with the advertisement position identifier, allocate the target advertisement data to the front end. The target advertisement data includes the target style identifier and the target advertisement identifier of the advertisement style to be published, and send the target style identifier and the target advertisement identifier to the advertisement playback system. Finally, the advertisement playback system in the online environment returns the target style identifier and the target advertisement identifier to the initiator of the advertisement request, and the server in the pre-release environment can extract and obtain all the advertisement styles to be published and the target advertisements. The advertisement playback system only needs to forward the target style identifier and the target advertisement identifier to the server in the pre-release environment.

[0176] 205. The target front-end code running in the pre-release environment renders the target advertisement according to the advertisement style to be published to obtain the rendering result of the advertisement to be published, and the target front-end code running in the pre-release environment renders the advertisement according to the historical advertisement style to obtain the rendering result of the historical advertisement style.

[0177] In the embodiment of the present application, the test phase of the pre-release environment is mainly a rendering test for simulating the release of the advertisement styles to be distributed. Compared with the test in the online environment, the test in this phase can be understood as a simulated regression test before the release to obtain the test results in the pre-release environment.

[0178] Among them, in the test phase of the pre-release environment, it is necessary to incorporate the code of the advertisement style to be published into the main trunk, and perform hybrid rendering on the advertisement style to be published after incorporation through the application front end on the target terminal using the real traffic data of the communication operator, so as to test whether the front end can render the advertisement style to be published normally in the pre-release environment to ensure sufficient testing of the advertisement style to be published before the release. Specifically, in the pre-release environment, a rendering test is performed on the advertisement style to be published after it is incorporated into the main trunk. The target front-end code at least includes the advertisement main trunk rendering code and the target advertisement style code defining the advertisement style to be published. Among them, the advertisement main trunk rendering code can be the style codes of all historical versions of the advertisement style to be published, which can be understood as a chained main trunk code and can form a code database.

[0179] Among them, before the release of the to-be-released advertisement style, automated tests for rendering the historical advertisement styles can be performed according to historical test cases. Specifically, when testing the historical advertisement styles, one or more historical test cases can be obtained for each historical advertisement style. Then, automated test instructions are generated according to each historical test case. The automated test instructions can be instructions for the logical sequence of test actions for the historical advertisement style, which can represent the control logic of the test process for the historical advertisement style. Further, the automated test instructions are sent to the target terminal to instruct the second target application in the pre-release environment on the target terminal to perform automated rendering processing on the historical advertisement style to test the automated rendering process of each historical advertisement style, so as to achieve the rendering test of the historical advertisement style in the pre-release environment. In this way, through efficient regression testing, the impact on the rendering of the original historical advertisement styles caused by the code of the to-be-released advertisement style after being incorporated into the main trunk can be avoided, which has reliability.

[0180] 206. Determine the second test result of the to-be-released advertisement style in the pre-release environment according to the rendering result of the to-be-released advertisement and the rendering result of the historical advertisement style.

[0181] In the embodiment of the present application, the test stage of the pre-release environment includes the rendering test after the to-be-released advertisement style is incorporated into the main trunk and the regression test of the original historical advertisement styles. Therefore, the second test result of the pre-release environment is determined by each test result of these two tests.

[0182] 207. If the second test result is that the to-be-released advertisement style passes the test in the pre-release environment, obtain the first advertisement request from the online running environment.

[0183] In the embodiment of the present application, when it is determined according to the second test result in the pre-release environment that the to-be-released advertisement style passes the test in the pre-release environment, the third test stage can be entered. The third test stage is mainly to perform the release test of the to-be-released advertisement style in the online environment.

[0184] Specifically, in the release test of this online environment, the server needs to obtain the advertisement request from the online environment, that is, the first advertisement request, for subsequent response to the advertisement request in the online environment.

[0185] 208. Determine the second targeting range of the to-be-released advertisement style in the online running environment, and when the initiator identifier of the first advertisement request belongs to the second targeting range, perform reverse proxy on the first advertisement request according to the address information in the pre-release environment to forward the first advertisement request to the online running environment.

[0186] It should be noted that, after the advertisement style to be released passes the test in the pre-release environment, due to various factors, there may still be undetected vulnerabilities. To avoid the impact on a large number of external network users during the release test phase caused by insufficient verification, the advertisement style to be released can be directed for release during the release test phase of the online environment, so as to conduct rendering tests after the release.

[0187] Among them, the second targeted scope may include the target terminals covered by the advertisement style to be released during the test in the pre-release environment or the applications on the target terminals. For example, the second targeted scope may include one or more object identifiers, which can be understood as target terminal identifiers. Specifically, the target terminal identifier can be represented by device address information, and the device address information can also represent the address of the client on the target terminal. Or, the object identifier may be the identifier of the client on the target terminal, which is not limited here.

[0188] It should be noted that after forwarding the first advertisement request to the online environment, the first advertisement request can be responded to in the online environment, so as to obtain the style identifier and advertisement identifier of the advertisement style to be released allocated for the front end through the advertisement playback system in the online environment, and return the advertisement identifier and the style identifier of the advertisement style to be released to the front end for subsequent rendering. When the front end performs advertisement rendering based on the style identifier and advertisement identifier of the advertisement style to be released, the online environment server in the server (distributed system) executes step 209.

[0189] 209. Conduct a release test on the advertisement style to be released and the historical advertisement style in the online running environment to obtain the third test result of the advertisement style to be released in the online running environment.

[0190] In the embodiment of the present application, the test phase of the online environment includes conducting a release test on the advertisement style to be released and the historical advertisement style.

[0191] Specifically, conduct a rendering test on the advertisement style to be released in the online environment. The test process is as follows: for the first advertisement request, obtain the first advertisement and the advertisement style to be released from the advertisement playback system in the online running environment, publish the advertisement style to be released to the server in the online environment to merge the code of the advertisement style to be released into the main trunk, and then conduct a rendering test on the first advertisement according to the advertisement style to be released through the target front-end code running in the online running environment.

[0192] Further, regression testing is performed on the candidate ad styles of the historical versions of the ad styles to be released in the online environment. Specifically, for the historical test cases corresponding to each candidate ad style, automated test instructions can be generated according to the historical test cases, and the target application in the pre-release environment is controlled according to the automated test instructions to perform automated rendering processing on the historical ad styles, so as to implement automated rendering testing on the candidate ad styles of the historical versions of the ad styles to be released in the online environment, improving the test efficiency.

[0193] Further, automated rendering testing in the online environment is performed on the target historical ad styles of the historical versions of the ad styles that are not to be released. Specifically, corresponding automated test instructions can be constructed according to each historical test case, and according to the automated test instructions, the target front-end code in the online environment is controlled to perform automated rendering on the corresponding ads according to the target historical ad styles, so as to test the automated rendering process and the rendering results. In this way, in the face of a large number of target historical ad styles, testing is performed through the method of automated rendering testing, improving the test efficiency.

[0194] In some embodiments, when performing automated rendering testing on any historical ad styles and the candidate ad styles of the historical versions of the ad styles to be released, the rendering testing of each of the above historical ad styles can be performed according to the fallback testing method. Among them, the fallback testing means that ensuring that the ad styles of the lowest version (which can be understood as the basic version) of each historical ad style can be successfully rendered can be regarded as passing the automated rendering testing of all historical ad styles.

[0195] Combining the test results of the above one or more test processes, a third test result of the ad styles to be released in the online environment is obtained.

[0196] 210. According to the third test result, determine the release strategy of the ad styles to be released.

[0197] In the embodiments of the present application, after the rendering testing of the ad styles to be released in the online environment passes and the regression testing of the historical ad styles in the online environment passes, the ad styles to be released in the online environment can be released according to the release strategy.

[0198] Among them, the third test result can include the test results of each ad style to be released by the front-end within the second targeting range and the regression test results of all historical ad styles. The release test result can be understood in the form of a list, which contains the test results after the release of each ad style in the online environment.

[0199] Exemplarily, for the front end defined within the second orientation range, when the release test of the to-be-released ad style and the historical ad style passes through the front end in the online environment, it indicates that the to-be-released ad style has passed the independent rendering test in the test environment, the regression test for merging into the main trunk in the pre-release environment, and the targeted release test in the online environment. At this time, a decision can be made to officially release the to-be-released ad style. During the official release of the to-be-released ad style, the to-be-released ad style can be released in a continuously increasing quantity manner, which can be understood as taking one unit of time as a stage, and each stage allows a target number of users (clients) to be able to access the new ad style, and the release is carried out in stages. For example, taking 1 hour, 10 hours, 12 hours, or 24 hours, etc. as the unit of time, each unit of time allows 10,000 users to be able to access the new ad style, or the release is carried out at intervals of the unit time according to a percentage (10%) of the total number of users, so as to achieve the official quantitative release of the to-be-released ad style in the online environment; the above is only an example and is not a limiting implementation manner.

[0200] For the convenience of understanding the embodiments of the present application, the embodiments of the present application will be described with specific application scenario examples. Specifically, by executing the above steps 201-210, the application scenario example is described.

[0201] It should be noted that the test method for this ad style is applicable to test examples of ad styles in application fronts involved in scenarios such as cloud technology, intelligent transportation, assisted driving, map fields, online shopping, and games. For example, the specific scenario example is as follows:

[0202] I. A brief introduction to the test scenario example of this ad style is as follows:

[0203] This scenario example involves the dynamic rendering of ad styles. The dynamic rendering of this ad style uses the dynamic solution of hippy. Hippy is a set of high-performance, cross-platform mobile terminal dynamic operation solutions similar to ReactNative. By optimizing the JS side and the native side, the performance of the framework is improved. With the support of react and vue on the front end, front-end development can write an app just like writing a web page, reducing the differences between mobile terminals of different operating systems. Thus, the efficient and fast-paced iterative release of ad incentive styles is realized, and continuously updating the rendering style of ads can improve the conversion effect of incentive ads. Based on this, for the continuously updated ad styles, it is necessary to test and verify them. The test and verification process needs to avoid the configuration and data from affecting the external network. The front-end environment for this test and verification includes a test environment, a pre-release environment, and an external network environment. Among them, the test mainly conducts new function verification, the pre-release environment conducts system regression tests, and the external network environment conducts release verification.

[0204] Specifically, the test plan for this advertisement style includes:

[0205] 1) Verify using a real-traffic app to ensure that the test conditions are the same as those of actual external network users.

[0206] 2) The test is divided into three stages. The test stage mainly conducts functional verification on the new functions of this iteration. In the pre-release environment test, in addition to regression testing on the new functions incorporated into the main trunk, comprehensive system testing is also carried out on the historical full-volume test cases. The pre-release environment test is a rehearsal for external network release. Except for the difference in the front-end environment deployment and the external network deployment environment, the test advertisement data and the background environment used are the same as those of the external network environment, ensuring that a real simulation of the actual external network scenario can be carried out for sufficient and effective verification before release. After the pre-release test passes, the front-end code will be released to the external network environment for regression verification on the external network.

[0207] 3) Both the pre-release test and the external network test adopt the whitelist targeting method to ensure no impact on external network users.

[0208] 4) Combine the three testing methods of manual testing, targeted testing, and automated testing. Among them, manual testing mainly verifies the new functions of the iteration; targeted testing mainly tests the targeting ability released in this iteration to ensure the release scope; automated testing verifies the regression of historical styles and the fallback styles.

[0209] 5) Conduct process control through the process online platform to ensure that the test / verification checklist to be verified can be accurately and effectively executed, integrating capabilities such as self-testing by developers, pre-dependency checking, automatic generation of test cases, bug management, test report generation, and division of labor between manual and automated testing, ensuring the accuracy and efficiency of the testing process.

[0210] II. Implementation process of online management of test scenario instances for this advertisement style:

[0211] In the test scenario instance of this advertisement style, testers can complete the test work of the advertisement style through the capabilities provided by the process online platform tool, such as process management, automatic generation of test cases, and integration of testing tools. The specific function items of this online platform include:

[0212] (1) Testers can create dynamic test tasks on the test task page. Specifically, Figure 4 is a schematic diagram of the test task page for the advertisement style provided by the embodiment of the present application. See Figure 4As shown, the test task page includes multiple options, such as task type, tapd link, task name, end, version number, product developer (owner), development matters, tester (owner), compatibility test, notes, etc. Testers can configure one or more options in the test task page to create a test task for a (new) advertising style.

[0213] Furthermore, after the test task is created, a test list is generated based on all the test tasks, and the platform will automatically create a group to allow each test contact person to confirm whether the items in the test list meet the prerequisite requirements. Figure 5 .

[0214] (2) According to each test task or project on the test list, an ad slot identifier can be set, and a test case corresponding to the new ad style can be automatically generated according to the ad slot identifier and the associated test task. Figure 6 shown.

[0215] (3) For each test case, three rounds of testing are performed according to the test environment, pre-release environment, and online environment. For example, the test environment, pre-release environment, and online environment are each regarded as a test round. After each round of testing, the test results (report) are displayed. Taking the test report of the test environment as an example, the display diagram of the test report is as follows: Figure 7 shown.

[0216] 3. Technical logic process of the test scenario example of this advertising style:

[0217] Combination Figure 8 As shown, it is a schematic diagram of the framework of the advertising style test system provided in the embodiment of the present application. Specifically, in the test system architecture, it includes a process online platform, a tool configuration platform, an advertising playback system, a terminal (including multiple applications such as browsers, music applications, singing applications, etc.), and an environment server. Among them, the environment server can be divided into a test environment server, a pre-release environment server, and an online environment server.

[0218] Among them, testers use the process online platform to create test tasks, confirm test checklists, generate / execute test cases, and generate / view test reports.

[0219] The tool configuration platform is mainly used for ad preview and ad style configuration. Specifically, testers use the tool configuration platform to complete ad binding after preview, ad style configuration, data reporting (i.e. test report) query, terminal execution automated testing and other functions.

[0220] Among them, the terminal uses the real traffic data of the network operator, and through different environments at the front end of the application range on the terminal, such as the access test environment, the pre-release environment, and the online environment, to obtain the front-end templates and / or code packages corresponding to different environments respectively, so as to obtain the rendering ability to support the advertisement style.

[0221] In addition, the front end on the terminal can send an advertisement request to the advertisement playback system to obtain advertisement data; and the playback system can read configuration information from the tool configuration platform, and the configuration information can include specified advertisements and advertisement style identifiers to generate advertisement data, and return the advertisement data to the front end of the target application on the terminal, so that the front end can perform rendering to complete the test of the advertisement style in the corresponding environment.

[0222] In this scenario example, combined with Figure 9 As shown, it is a schematic diagram of the scenario for performing advertisement style rendering tests in three test stages provided by the embodiments of the present application. Specifically, during the test process, the front-end environment is divided into a test environment, a pre-release environment, and an external network environment, and the main implementations are as follows:

[0223] (1) When the front end is in the test environment, the background and the terminal can select the test environment or the external network environment as needed. In this stage, mainly iterative function new functions (new advertisement styles) are tested. The code is tested by branch extraction, and different branches test different requirements. The test is mainly manual.

[0224] (2) When the front end is in the pre-release environment, the background and the terminal need to use the external network environment. This stage is the system test stage and also a pre-release rehearsal test before release. All conditions are the same as those of the external network to test bugs before actual release. Specifically, the code of the new advertisement style is merged into the main trunk for testing. A complete confluence test needs to be carried out, covering not only the requirements of the new functions (new advertisement styles) of this iteration, but also the regression tests of all historical styles. The regression tests are mainly automated to improve the test efficiency.

[0225] (3) When the front end, the terminal, and the background are in the external network environment, release tests are performed. First, use a script to ensure that the targeted scope of the release meets the requirements, that is, verify the targeted scope, so that the new advertisement style only takes effect for specified users (client front ends), and then test the new advertisement style, and at the same time perform regression tests on historical advertisement styles.

[0226] During the testing process, the switching among the above three front-end environments can be achieved through the reverse proxy method. Specifically, since the application front-end on the target terminal using operator traffic tests the advertisement styles, the target terminal is generally in the external network environment. To enable the front-end to switch between different environments, it can be achieved through the reverse proxy (nginx) service. The nginx service can obtain the device information in the request (i.e., the initiator identifier, such as the target terminal identifier or application identifier, etc.), and forward the advertisement request to the corresponding environment according to different device information, so that the front-end connects to the corresponding environment.

[0227] Figure 10 This is a schematic diagram of the scenario of the reverse proxy service provided by the embodiments of the present application. Exemplarily, as shown in Figure 10 the scenario of the reverse proxy service is described as follows: First, the environment configuration is performed through the automated adjustment interface (i.e., configure the front-end environment accessible to each device information), and a user configuration page is added to the front-end to store the above configuration, which can be specifically stored in a specified server; at the same time, the code package (the logic code with the relevant capabilities in the advertisement style testing process) requests to access the nginx service. The nginx service in this solution is different from the original logic (directly forwarding according to the domain name and path), and the actual operation is that the nginx service configures the reverse proxy to forward to the specified service (such as a web server), and the web server forwards the request to the corresponding environment according to the configured environment of the stored device information.

[0228] By executing the above test scenario examples of the advertisement styles, the following effects can be achieved: while ensuring rapid iteration, bugs can be discovered as early as possible to the greatest extent, reducing the exposure of external network problems; using the real traffic app for verification to be closest to the usage of actual external network users to the greatest extent; adding a pre-release environment on the basis of the original test environment and the external network environment, and adopting the method of three rounds of testing to increase the test sufficiency. The pre-release test is a pre-play of the experience verification before the external network release; adopting the method of automated testing to improve the test efficiency; realizing process control through the process online platform to ensure that the checklist to be verified can be accurately and effectively executed, integrating the capabilities of self-testing by developers, pre-dependency checking, automatic generation of test cases, bug management, test report generation, and division of labor between manual and automated testing, etc., to ensure the accuracy and efficiency of the testing process.

[0229] As can be seen from the above, in the embodiments of the present application, for a newly developed advertisement style to be released, first, the advertisement style to be released is tested in a test environment. Then, after the advertisement style to be released passes the test in the test environment, a pre-release simulation test is performed on the advertisement style to be released. Specifically, in a pre-release environment, the advertisement style to be released is incorporated into the main trunk for rendering to simulate and test the rendering situation of the advertisement style to be released after release. Finally, when the advertisement style to be released passes the test in the pre-release environment, a release test is performed on the advertisement style to be released in an online operating environment to test the rendering situation of the advertisement style to be released in a real online environment. In this way, before the advertisement style to be released is released, a regression test can be performed on the new advertisement style in a simulated manner before release to detect whether there is a rendering failure problem when the new advertisement style is actually released, thus ensuring the user experience.

[0230] To better implement the above method, the embodiments of the present application further provide a test device for advertisement styles. For example, as Figure 11 shown, the test device for advertisement styles may include a first acquisition unit 401, a second acquisition unit 402, a first test unit 403, and a second test unit 404.

[0231] The first acquisition unit 401 is configured to, after the advertisement style to be released passes the test in the test environment, acquire an advertisement request from an online operating environment, where the advertisement request includes an advertisement position identifier;

[0232] The second acquisition unit 402 is configured to, in a pre-release environment, respond to the advertisement request and acquire a target advertisement and an advertisement style to be released for presentation at the advertisement position indicated by the advertisement position identifier from an advertisement playback system in the online operating environment;

[0233] The first test unit 403 is configured to render the target advertisement according to the advertisement style to be released by the target front-end code running in the pre-release environment to obtain a rendering result of the advertisement to be released; where the pre-release environment is a running environment obtained by simulating the online operating environment, and the target front-end code at least includes advertisement main trunk rendering code and advertisement style code defining the advertisement style to be released;

[0234] The second test unit 404 is configured to, if it is determined that the advertisement style to be released passes the test in the pre-release environment according to the rendering result of the advertisement to be released, perform a release test on the advertisement style to be released in the online operating environment.

[0235] In some embodiments, the test device for advertisement styles further includes a merging unit, configured to: upload the target advertisement style code to the pre-release environment; merge the advertisement main trunk rendering code and the advertisement style code in the pre-release environment to obtain the target front-end code.

[0236] In some embodiments, the target front-end code further includes first advertisement style code that defines historical advertisement styles. The first test unit 403 is further configured to: obtain at least one historical test case for the historical advertisement styles; in a pre-release environment, perform automated rendering based on the historical test cases by the first advertisement style code and the advertisement backbone rendering code in the target front-end code to obtain a rendering result of the historical advertisement styles; and use the rendering result of the historical advertisement styles to determine a test result of the to-be-released advertisement style in the pre-release environment in combination with the rendering result of the to-be-released advertisement.

[0237] In some embodiments, the test device for advertisement styles further includes an environment conversion unit, which is further configured to: obtain a first targeting range of the to-be-released advertisement style in the pre-release environment, where the first targeting range includes object identifiers that are allowed to access the pre-release environment; if it is determined that the initiator identifier of the advertisement request is within the first targeting range, perform reverse proxy on the advertisement request based on the address information of the pre-release environment to forward the advertisement request to the pre-release environment.

[0238] In some embodiments, the environment conversion unit is further configured to: obtain a list of object information, where the list of object information includes multiple object identifiers and the client version numbers associated with each object identifier; determine a compatible version number that is compatible with the to-be-released advertisement style; filter the object identifiers in the list of object information according to the compatible version number to screen out target object identifiers whose associated client version numbers are compatible with the to-be-released advertisement style; and determine the first targeting range of the to-be-released advertisement style in the pre-release environment according to the target object identifiers.

[0239] In some embodiments, the second obtaining unit 402 is further configured to: in the pre-release environment, respond to an advertisement request to determine the advertisement style template supported by the initiator of the advertisement request; obtain the to-be-released advertisement style that conforms to the advertisement style template and determine the target advertisement in the advertisement playback system operating in the online environment according to the advertisement position identifier; and send the to-be-released advertisement style and the target advertisement to the pre-release environment by the advertisement playback system operating in the online environment.

[0240] In some embodiments, the second test unit 404 is further configured to: determine a second targeting range of the to-be-released advertisement style in the online environment; if the initiator identifier of the first advertisement request from the online environment is within the second targeting range, obtain the first advertisement and the to-be-released advertisement style from the advertisement playback system operating in the online environment; and perform a rendering test on the first advertisement according to the to-be-released advertisement style by running the target front-end code in the online environment.

[0241] In some embodiments, the second test unit 404 is further configured to: obtain historical test cases of candidate advertisement styles for each historical version of the advertisement style to be released; and perform tests based on the historical test cases of the candidate advertisement styles for each historical version of the advertisement style to be released by the target front-end code in the online operating environment.

[0242] In some embodiments, the second test unit 404 is further configured to: obtain historical test cases of a target historical advertisement style, where the target historical advertisement style is any advertisement style other than the advertisement style to be released and the advertisement styles of each historical version of the advertisement style to be released; and perform tests based on the historical test cases of the target historical advertisement style by the target front-end code in the online operating environment.

[0243] In some embodiments, the test apparatus for advertisement styles further includes a release unit, configured to: obtain the release test result for the advertisement style to be released in the online operating environment; if the release test result is a pass, determine the staged release quantity for the advertisement style to be released, and perform staged quantitative release of the advertisement style to be released according to the staged release quantity.

[0244] As can be seen from the above, in the embodiments of the present application, for a newly developed advertisement style to be released, first, the advertisement style to be released is tested in a test environment. Then, after the advertisement style to be released passes the test in the test environment, a pre-release simulation test is performed on the advertisement style to be released. Specifically, the advertisement style to be released is incorporated into the main trunk for rendering in a pre-release environment to simulate and test the rendering situation of the advertisement style to be released after release. Finally, when the advertisement style to be released passes the test in the pre-release environment, a release test is performed on the advertisement style to be released in the online operating environment to test the rendering situation of the advertisement style to be released in the real online environment. In this way, before the advertisement style to be released is released, a regression test can be performed on the new advertisement style before release in a simulated manner to detect whether there is a rendering failure problem when the new advertisement style is actually released, thereby ensuring the user experience.

[0245] The embodiments of the present application further provide a computer device, as Figure 12 shown, which shows a schematic structural diagram of the computer device involved in the embodiments of the present application. Specifically:

[0246] The computer device may include a processor 501 with one or more processing cores, a memory 502 with one or more computer-readable storage media, a power supply 503, an input unit 504, and other components. Those skilled in the art can understand that Figure 12 the structural diagram of the computer device shown in

[0247] The processor 501 is the control center of the computer device, connecting various parts of the entire computer device through various interfaces and circuits. By running or executing software programs and / or modules stored in the memory 502, and by invoking the data stored in the memory 502, it executes various functions of the computer device and processes data. Optionally, the processor 501 may include one or more processing cores; preferably, the processor 501 may integrate an application processor and a modem processor. Among them, the application processor mainly processes the operating system, user interface, application programs, etc., and the modem processor mainly processes wireless communication. It can be understood that the above-mentioned modem processor may not be integrated into the processor 501 either.

[0248] The memory 502 can be used to store software programs and modules. The processor 501 executes various functional applications and the test process of advertisement styles by running the software programs and modules stored in the memory 502. The memory 502 may mainly include a program storage area and a data storage area. Among them, the program storage area can store the operating system, application programs required for at least one function (such as sound playback function, image playback function, etc.), etc.; the data storage area can store data created according to the use of the computer device. In addition, the memory 502 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage devices. Correspondingly, the memory 502 may also include a memory controller to provide the processor 501 with access to the memory 502.

[0249] The computer device also includes a power supply 503 that powers each component. Preferably, the power supply 503 can be logically connected to the processor 501 through a power management system, so as to realize functions such as management of charging, discharging, and power consumption management through the power management system. The power supply 503 may also include any components such as one or more DC or AC power supplies, a recharge system, a power failure detection circuit, a power converter or inverter, and a power status indicator.

[0250] The computer device may also include an input unit 504, which can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function controls.

[0251] Although not shown, the computer device may further include a display unit and the like, which will not be elaborated here. Specifically, in the embodiments of the present application, the processor 501 in the computer device will load the executable files corresponding to the processes of one or more application programs into the memory 502 according to the following instructions, and the processor 501 will run the application programs stored in the memory 502 to implement various functions as follows:

[0252] After the test of the to-be-released advertisement style passes in the test environment, obtain an advertisement request from the online running environment, where the advertisement request includes an advertisement space identifier; respond to the advertisement request in the pre-release environment, and obtain a target advertisement and the to-be-released advertisement style for presentation at the advertisement space indicated by the advertisement space identifier from the advertisement playback system in the online running environment; render the target advertisement according to the to-be-released advertisement style by the target front-end code running in the pre-release environment to obtain a rendering result of the to-be-released advertisement; wherein, the pre-release environment is a running environment obtained by simulating the online running environment, and the target front-end code at least includes advertisement backbone rendering code and target advertisement style code defining the to-be-released advertisement style; if it is determined that the to-be-released advertisement style passes the test in the pre-release environment according to the rendering result of the to-be-released advertisement, conduct a release test on the to-be-released advertisement style in the online running environment.

[0253] For the specific implementation of each of the above operations, reference may be made to the previous embodiments and will not be elaborated here.

[0254] Therefore, the present solution can be directed to a newly developed to-be-released advertisement style. First, test the to-be-released advertisement style in the test environment. Then, after the to-be-released advertisement style passes the test in the test environment, conduct a simulation drill test before the release of the to-be-released advertisement style. Specifically, incorporate the to-be-released advertisement style into the backbone for rendering in the pre-release environment to simulate and test the rendering situation of the to-be-released advertisement style after release. Finally, when the to-be-released advertisement style passes the test in the pre-release environment, conduct a release test on the to-be-released advertisement style in the online running environment to test the rendering situation of the to-be-released advertisement style in the real online environment. In this way, before the to-be-released advertisement style is released, regression testing can be performed on the new advertisement style before release in a simulated manner to detect whether there is a rendering failure problem when the new advertisement style is actually released, thus ensuring the user experience.

[0255] Therefore, the embodiments of the present application provide a computer-readable storage medium, which stores multiple instructions that can be loaded by a processor to execute the steps in any of the advertisement style test methods provided by the embodiments of the present application. For example, the instructions can execute the following steps:

[0256] After the test of the advertisement style to be released passes in the test environment, obtain advertisement requests from the online operating environment. The advertisement requests include advertisement position identifiers; respond to the advertisement requests in the pre-release environment, and obtain the target advertisement and the advertisement style to be released for presentation at the advertisement position indicated by the advertisement position identifier from the advertisement playback system in the online operating environment; render the target advertisement according to the advertisement style to be released by the target front-end code running in the pre-release environment to obtain the rendering result of the advertisement to be released; wherein, the pre-release environment is an operating environment obtained by simulating the online operating environment, and the target front-end code at least includes advertisement backbone rendering code and target advertisement style code defining the advertisement style to be released; if it is determined that the advertisement style to be released passes the test in the pre-release environment according to the rendering result of the advertisement to be released, conduct a release test on the advertisement style to be released in the online operating environment.

[0257] For the specific implementation of each of the above operations, reference may be made to the foregoing embodiments, and details are not described herein again.

[0258] Among them, the computer-readable storage medium may include: read-only memory (ROM, Read Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or optical disc, etc.

[0259] Since the instructions stored in the computer-readable storage medium can execute the steps in any of the advertisement style test methods provided in the embodiments of the present application, the beneficial effects achievable by any of the advertisement style test methods provided in the embodiments of the present application can be realized. For details, reference may be made to the foregoing embodiments, and details are not described herein again.

[0260] According to one aspect of the present application, there is provided a computer program product or computer program. The computer program product or computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the methods provided in the various alternative implementation manners provided in the foregoing embodiments.

[0261] In the embodiments of the present application, the term "module" or "unit" refers to a computer program with a predetermined function or a part of a computer program, which works together with other related parts to achieve a predetermined goal, and can be fully or partially implemented by using software, hardware (such as a processing circuit or a memory), or a combination thereof. Similarly, one processor (or multiple processors or memories) can be used to implement one or more modules or units. In addition, each module or unit can be a part of the overall module or unit including the function of the module or unit.

[0262] The above has introduced in detail a method, apparatus, device, and computer-readable storage medium for testing an advertisement style provided by an embodiment of the present application. Specific examples are used in this article to elaborate on the principle and implementation manner of the present application. The description of the above embodiments is only used to help understand the method and its core idea of the present application; at the same time, for those skilled in the art, according to the idea of the present application, there will be changes in the specific implementation manner and application scope. In summary, the content of this specification should not be construed as a limitation on the present application.

Claims

1. A method for testing an advertisement style, characterized in that, it includes: After the advertisement style to be released passes the test in the test environment, obtain an advertisement request from the online operating environment, where the advertisement request includes an advertisement space identifier; Respond to the advertisement request in the pre-release environment, and obtain the target advertisement and the advertisement style to be released for presentation in the advertisement space indicated by the advertisement space identifier from the advertisement playback system in the online operating environment; Render the target advertisement according to the advertisement style to be released by the target front-end code running in the pre-release environment to obtain the rendering result of the advertisement to be released; wherein, the pre-release environment is an operating environment obtained by simulating the online operating environment, and the target front-end code at least includes advertisement backbone rendering code and advertisement style code defining the advertisement style to be released; If it is determined that the advertisement style to be released passes the test in the pre-release environment according to the rendering result of the advertisement to be released, conduct a release test on the advertisement style to be released in the online operating environment.

2. The method according to claim 1, characterized in that, Before the target front-end code running in the pre-release environment renders the target advertisement according to the advertisement style to be released to obtain the rendering result, the method further includes: Upload the target advertisement style code to the pre-release environment; Merge the advertisement backbone rendering code in the pre-release environment with the advertisement style code to obtain the target front-end code.

3. The method according to claim 2, characterized in that, The target front-end code further includes first advertisement style code defining a historical advertisement style; the method further includes: Obtain at least one historical test case for the historical advertisement style; In the pre-release environment, perform automated rendering on the historical advertisement style by the first advertisement style code and the advertisement backbone rendering code in the target front-end code based on the historical test case to obtain the rendering result of the historical advertisement style; the rendering result of the historical advertisement style is used to determine the test result of the advertisement style to be released in the pre-release environment in combination with the rendering result of the advertisement to be released.

4. The method according to claim 1, characterized in that, Before responding to the advertisement request in the pre-release environment, the method further includes: Obtain the first targeting range of the advertisement style to be released in the pre-release environment, where the first targeting range includes object identifiers allowed to access the pre-release environment; If it is determined that the initiator identifier of the advertisement request is within the first targeting range, perform reverse proxy on the advertisement request based on the address information of the pre-release environment to forward the advertisement request to the pre-release environment.

5. The method according to claim 4, characterized in that, The obtaining the first targeting range of the advertisement style to be released in the pre-release environment includes: Obtain a list of object information, where the list of object information contains multiple object identifiers and the client version numbers associated with each object identifier; Determine the compatible version number compatible with the advertisement style to be released; Filter the object identifiers in the object information list according to the compatible version number to screen out the target object identifiers whose associated client version numbers are compatible with the advertisement style to be released; Determine the first targeting range of the advertisement style to be released in the pre-release environment according to the target object identifiers.

6. The method according to claim 1, wherein, responding to the advertisement request in the pre-release environment and obtaining, from the advertisement playback system in the online operating environment, the target advertisement and the advertisement style to be released for presentation at the advertisement position indicated by the advertisement position identifier includes: responding to the advertisement request in the pre-release environment and determining the advertisement style template supported by the initiator of the advertisement request; According to the advertisement position identifier, obtain, in the advertisement playback system in the online operating environment, the advertisement style to be released that conforms to the advertisement style template, and determine the target advertisement; the advertisement playback system in the online operating environment sends the advertisement style to be released and the target advertisement to the pre-release environment.

7. The method according to claim 1, wherein, performing a release test on the advertisement style to be released in the online operating environment includes: determining the second targeting range of the advertisement style to be released in the online operating environment; if the initiator identifier of the first advertisement request from the online operating environment is located within the second targeting range, obtain the first advertisement and the advertisement style to be released from the advertisement playback system in the online operating environment; perform a rendering test on the first advertisement according to the advertisement style to be released through the target front-end code running in the online operating environment.

8. The method according to claim 7, wherein, after performing a rendering test on the first advertisement according to the advertisement style to be released through the target front-end code running in the online operating environment, the method further includes: obtaining the historical test cases of the candidate advertisement styles for each historical version of the advertisement style to be released; testing by the target front-end code in the online operating environment based on the historical test cases of the candidate advertisement styles for each historical version of the advertisement style to be released.

9. The method according to any one of claims 7 or 8, wherein, the method further includes: obtaining the historical test cases of the target historical advertisement style, where the target historical advertisement style is any advertisement style other than the advertisement style to be released and the advertisement styles of each historical version of the advertisement style to be released; testing by the target front-end code in the online operating environment based on the historical test cases of the target historical advertisement style.

10. The method according to claim 1, wherein, the method further includes: obtaining the release test result for the advertisement style to be released in the online operating environment; if the release test result is a pass, determine the staged release quantity for the advertisement style to be released, and perform staged quantitative release on the advertisement style to be released according to the staged release quantity.

11. A test device for an advertisement style, characterized in that, it comprises: A first acquisition unit, configured to acquire an advertisement request from an online operating environment after the test of the advertisement style to be published passes in the test environment, where the advertisement request includes an advertisement space identifier; A second acquisition unit, configured to respond to the advertisement request in a pre-published environment and acquire a target advertisement and the advertisement style to be published for presentation at the advertisement space indicated by the advertisement space identifier from an advertisement playback system in the online operating environment; A first test unit, configured to render the target advertisement according to the advertisement style to be published by target front-end code running in the pre-published environment to obtain a rendering result of the advertisement to be published; wherein, the pre-published environment is an operating environment obtained by simulating the online operating environment, and the target front-end code at least includes advertisement backbone rendering code and advertisement style code defining the advertisement style to be published; A second test unit, configured to perform a release test on the advertisement style to be published in the online operating environment if it is determined that the advertisement style to be published passes the test in the pre-published environment according to the rendering result of the advertisement to be published.

12. A computer device, characterized in that, it includes a processor and a memory, the memory stores a computer program, and the processor is configured to run the computer program in the memory to implement the steps in the test method for the advertisement style according to any one of claims 1 to 10.

13. A computer-readable storage medium, characterized in that, the computer-readable storage medium stores multiple instructions, and the instructions are suitable for being loaded by a processor to execute the steps in the test method for the advertisement style according to any one of claims 1 to 10.

14. A computer program product, characterized in that, it includes computer instructions, and when the computer instructions are executed, the steps in the test method for the advertisement style according to any one of claims 1 to 10 are implemented.

Images