Data processing method, electronic equipment and computer program product

Through data reflow and engine call, the verification of product selection capabilities and list reading capabilities during product selection engine upgrade and list service migration is achieved, solving the problems of manual sampling in the existing technology that are difficult and low reliability of results, and improving the consistency and reliability of service capabilities after service changes.

CN119599759APending Publication Date: 2025-03-11SHANGHAI HEMA ZHIYAN TECHNOLOGY CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411547701.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-31
Publication Date
2025-03-11

AI Technical Summary

Technical Problem

In the prior art, in the process of upgrading the product selection engine and migrating the list service, there is a lack of a simple and convenient method to objectively and accurately verify the product selection ability and list reading ability, resulting in the problems of manual sampling inspection being difficult, limited data volume, and low reliability of results.

Method used

Through data reflow, the identification information of the historical product selection collection and list is obtained, the old engine and the new engine are called respectively, the product information is recalled, and consistency judgment is made to ensure that the product selection ability and list transparency of the new engine are consistent with the old engine.

Benefits of technology

It has achieved simple, convenient, objective and accurate verification of product selection capabilities and list reading capabilities during product selection engine upgrade and list service migration, and improved the consistency and reliability of service capabilities after service changes.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119599759A_ABST
    Figure CN119599759A_ABST
Patent Text Reader

Abstract

The embodiment of the invention discloses a data processing method and device, a computer readable storage medium, electronic equipment and a computer program product. In the process of upgrading the first product selection engine to the second product selection engine, the product selection capability of the second product selection engine to be applied to the online environment of the commodity information service system is verified, and the first product selection engine is the product selection engine currently applied to the online environment. The method comprises the steps of obtaining identification information of a plurality of historical item selection sets through data backflow, calling a first item selection engine and a second item selection engine by taking the identification information as parameters, and obtaining commodity information of a first commodity and commodity information of a second commodity recalled by the first item selection engine and the second item selection engine from commodities provided by a system; and taking the commodity information of the first commodity as a reference, performing consistency judgment on the commodity information of the second commodity, and when the commodity information obtained according to the identification information of the plurality of historical commodity sets is correspondingly matched, determining that the commodity selection capability verification of the second commodity selection engine is passed. And many problems existing in manual sampling inspection are solved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of commodity information services, and in particular to a data processing method and apparatus, a computer-readable storage medium, an electronic device, and a computer program product. Background Art

[0002] When consumer users purchase goods through the product information service system, the product information service system can display the product objects to consumer users through product display pages in the form of applications, web pages or mini-programs for selection and purchase.

[0003] Typically, product exposure and display on a page are mostly based on services provided by the product information service system. For example, the product selection engine service enables different types of products to be exposed across different product display channels; the ranking service enables the display of related ranking information under the product card, and so on.

[0004] In actual applications, service changes are often required due to changes in shopping needs, functional iteration, and performance optimization. How to ensure the consistency of service capabilities before and after the service change is a key issue in the service change process.

[0005] Taking the service changes caused by the product selection engine upgrade as an example, it is necessary to verify the product selection ability of the product selection engine during the upgrade process to ensure the consistency of the product selection ability before and after the engine upgrade.

[0006] Specifically, a product display page is typically divided into multiple display areas, each of which can serve as an independent product display channel. Operators configure the product types displayed in each channel based on application requirements. For example, the "try new" channel displays new products to consumers; the "seasonal" channel, for example, displays products sold according to the current season or solar term.

[0007] In related technologies, the products displayed on a page are mostly based on data provided by a product selection engine. For example, the products displayed on a page under a new product channel can be used to select a set of products that meet the requirements of new products from the product information service system based on the selection rules associated with the new product channel. Then, based on the placement rules associated with the new product channel, the products in the selection set are placed in the slots under the new product channel, achieving product exposure and display.

[0008] In other words, the product selection engine's product selection capability, as the basis for product placement, will directly affect the exposure of products on the page. Based on accurate and reliable product selection capabilities, the products actually exposed on the page can meet the expected delivery effects of the operation.

[0009] In actual applications, the product selection engine may undergo upgrades such as functional improvements and performance optimizations. To prevent the engine upgrade from impacting the product placement results on the page, it is necessary to ensure the consistency of the product selection set selected by the engine before and after the upgrade based on the same selection rules. Currently, data verification personnel manually check products exposed by different channels to determine whether the products actually exposed on the page match the expected placement results. If they do, it is determined that the upgrade has not affected the engine's product selection capabilities.

[0010] This approach presents challenges such as difficulty in spot checks, limited data volume, and low reliability of the results. The challenge for those skilled in the art is to quickly and easily conduct an objective, comprehensive verification of the engine's selection capabilities during its upgrade.

[0011] Furthermore, taking the example of service changes caused by the migration of a ranking service, the ranking service's ability to display rankings needs to be verified during the migration process to ensure consistency of displayed ranking information before and after the migration. Currently, data verification personnel manually perform spot checks to determine the accuracy of rankings, but these checks are also subject to challenges such as difficulty, limited data volume, and low reliability. How to objectively and accurately verify ranking display capabilities during the ranking service migration process is a technical issue that requires technical expertise. Summary of the Invention

[0012] The present application provides a data processing method and device, a computer-readable storage medium, an electronic device, and a computer program product, which can solve many problems existing in manual sampling, and can simply and conveniently objectively and accurately verify the product selection capabilities of the second product selection engine and the list display capabilities of the second list service that need to be applied to the online environment of the commodity information service system after the service change.

[0013] This application provides the following solutions:

[0014] A data processing method for verifying the product selection capabilities of a second product selection engine to be applied to an online environment of a commodity information service system during an upgrade from a first product selection engine to a second product selection engine, wherein the first product selection engine is the product selection engine currently applied in the online environment, the method comprising:

[0015] Obtain identification information of multiple historical product selection sets through data backflow, where the historical product selection sets are generated by the first product selection engine and / or a historical version of a product selection engine previously released by the first product selection engine, and are verified during application in target channels of the product information service system;

[0016] Using the identification information of the historical product selection set as a parameter, respectively calling the first product selection engine and the second product selection engine;

[0017] Obtaining product information of a first product recalled by the first product selection engine from products provided by the product information service system based on identification information of the historical product selection set, and product information of a second product recalled by the second product selection engine from products provided by the product information service system based on identification information of the historical product selection set; the product information includes product quantity information and product identification information;

[0018] Based on the product information of the first product, the product information of the second product is judged for consistency, and when the product information obtained according to the identification information of the multiple historical product selection sets all correspond to each other, it is determined that the product selection capability verification of the second product selection engine has passed.

[0019] The method further comprises:

[0020] When a mismatched product is identified during the consistency determination process, recall path identification information of the mismatched product is obtained, where the recall path identification information is used to indicate a code execution path when the first product selection engine and / or the second product selection engine recalls the mismatched product;

[0021] Provide identification information of the historical product selection set used to recall the non-matching products and identification information of the recall path of the non-matching products to locate the fault of the execution code of the second product selection engine.

[0022] The commodity information service system integrates offline physical stores and online stores to provide commodity purchasing services, and the method further includes:

[0023] Obtain identification information of multiple physical stores through the data backflow, and use the identification information of the historical product selection set and the identification information of the physical stores as parameters to call the first product selection engine and the second product selection engine respectively;

[0024] Correspondingly, the first product is recalled from the products provided by the physical store by the first product selection engine based on the identification information of the historical product selection set; the second product is recalled from the products provided by the physical store by the second product selection engine based on the identification information of the historical product selection set.

[0025] Among them, the second product selection engine is applied to the pre-release environment of the product information service system and / or the safe production environment of the product information service system.

[0026] When obtaining the first product recalled in batches by the first product selection engine, the product information of the first product is obtained after performing paging analysis and deduplication processing; and / or,

[0027] When obtaining the second product recalled in batches by the second product selection engine, the product information of the second product is obtained after paging analysis and deduplication processing.

[0028] A data processing method for verifying the product selection capabilities of a second product selection engine to be applied to an online environment of a commodity information service system during an upgrade from a first product selection engine to a second product selection engine, wherein the first product selection engine is the product selection engine currently applied in the online environment, the method comprising:

[0029] Obtain identification information of multiple historical product selection sets through data backflow, where the historical product selection sets are generated by the first product selection engine and / or a historical version of a product selection engine previously released by the first product selection engine, and are verified during application in target channels of the product information service system;

[0030] When the second product selection engine is applied to the pre-release environment of the product information service system, product information obtained by the first product selection engine and the second product selection engine after product recall based on the identification information of the multiple historical product selection sets is obtained, and consistency judgment is performed; the product information includes product quantity information and product identification information;

[0031] When it is determined, based on the consistency judgment, that the second product selection engine has passed the product selection capability verification in the pre-release environment, the second product selection engine is applied to the secure production environment of the product information service system, and then the product information obtained by the first product selection engine and the second product selection engine after product recall based on the identification information of the multiple historical product selection sets is obtained, and the consistency judgment is performed;

[0032] When it is determined, based on the consistency judgment, that the product selection capability verification of the second product selection engine in the safe production environment has passed, the second product selection engine is applied to the online environment.

[0033] A data processing method for verifying the list transparency capability of a second list service deployed in a second application during a list service migration process, wherein the first list service deployed in the first application is the list service currently used in the online environment of a product information service system. The method comprises:

[0034] Obtaining identification information of multiple lists of different types through data backflow, wherein the lists are associated with multiple listed products, and verifying the information of the lists associated with the listed products when the product information service system exposes the list information, wherein the list information includes list type information;

[0035] After obtaining the target products associated with different lists according to the identification information of the list, the first list service deployed in the first application and the second list service deployed in the second application are respectively called with the identification information of the target products as parameters;

[0036] Obtaining first list information output by the first list service for the target product, and second list information output by the second list service for the target product;

[0037] Based on the first list information, the second list information is judged for consistency, and when the list type information output for the target product all corresponds to a match, it is determined that the list transparency capability verification of the second list service deployed in the second application has passed.

[0038] The target products are some of the listed products, and the method further includes:

[0039] When the list type information output for the target product all matches, adjusting the parameter value related to the quantity of the target product to increase the quantity of the target product;

[0040] Using the identification information of the newly added target product as a parameter, respectively calling the first list service deployed in the first application and the second list service deployed in the second application;

[0041] The consistency judgment is performed based on the first list information output by the first list service for the newly added target product and the second list information output by the second list service for the newly added target product. When the list type information output for the newly added target product corresponds to each other, it is determined that the list exposure capability verification of the second list service deployed in the second application has passed.

[0042] Among them, the second list service deployed in the second application is the list service of the current application in the online environment, and is used to provide list transparency service to part of the traffic of the commodity information service system.

[0043] The obtaining identification information of multiple different types of lists through data reflow includes: obtaining identification information of the list currently applied in the online environment through online data reflow;

[0044] The method of using the identification information of the target product as a parameter to call the first list service deployed in the first application and the second list service deployed in the second application respectively includes: when the part of the traffic accesses the product information service system, using the identification information of the target product as a parameter to call the first list service and the second list service respectively to realize online data inspection.

[0045] The commodity information service system integrates offline physical stores and online stores to provide commodity purchasing services, and the method further includes:

[0046] The identification information of multiple physical stores is obtained through the data backflow, and the target products associated with different lists under the corresponding physical stores are obtained according to the identification information of the list and the identification information of the physical stores.

[0047] A data processing device for verifying the product selection capability of a second product selection engine to be applied to an online environment of a commodity information service system during an upgrade from a first product selection engine to a second product selection engine, wherein the first product selection engine is the product selection engine currently applied in the online environment, and comprising:

[0048] a data reflow unit, configured to obtain identification information of a plurality of historical product selection sets through data reflow, wherein the historical product selection sets are generated by the first product selection engine and / or a historical version of a product selection engine previously released by the first product selection engine, and are verified during application in a target channel of the product information service system;

[0049] an engine calling unit, configured to call the first product selection engine and the second product selection engine respectively using the identification information of the historical product selection set as a parameter;

[0050] a product information obtaining unit, configured to obtain product information of a first product recalled by the first product selection engine from products provided by the product information service system based on identification information of the historical product selection set, and product information of a second product recalled by the second product selection engine from products provided by the product information service system based on identification information of the historical product selection set; the product information includes product quantity information and product identification information;

[0051] The matching judgment unit is used to make a consistency judgment on the product information of the second product based on the product information of the first product, and to determine that the product selection capability verification of the second product selection engine has passed when the product information obtained respectively according to the identification information of the multiple historical product selection sets all correspond to each other.

[0052] A data processing device for verifying the product selection capability of a second product selection engine to be applied to an online environment of a commodity information service system during an upgrade from a first product selection engine to a second product selection engine, wherein the first product selection engine is the product selection engine currently applied in the online environment, and comprising:

[0053] a data reflow unit, configured to obtain identification information of a plurality of historical product selection sets through data reflow, wherein the historical product selection sets are generated by the first product selection engine and / or a historical version of a product selection engine previously released by the first product selection engine, and are verified during application in a target channel of the product information service system;

[0054] a pre-launch environment verification unit, configured to obtain, when the second product selection engine is applied to the pre-launch environment of the product information service system, product information obtained by the first product selection engine and the second product selection engine after product recall based on the identification information of the multiple historical product selection sets, and perform consistency judgment; the product information includes product quantity information and product identification information;

[0055] A safe production environment verification unit is used to determine, based on the consistency judgment, that the second product selection engine has passed the product selection capability verification in the pre-release environment. After applying the second product selection engine to the safe production environment of the product information service system, the product information obtained by the first product selection engine and the second product selection engine after recalling the products according to the identification information of the multiple historical product selection sets is obtained respectively, and the consistency judgment is performed; based on the consistency judgment, when it is determined that the second product selection engine has passed the product selection capability verification in the safe production environment, the second product selection engine is applied to the online environment.

[0056] A data processing device is provided for verifying the list transparency capability of a second list service deployed in a second application during a list service migration process, wherein the first list service deployed in the first application is the list service currently used in the online environment of a product information service system. The device comprises:

[0057] a data return flow unit, configured to obtain identification information of multiple lists of different types through data return flow, wherein the lists are associated with multiple listed products, and verify the list information associated with the listed products when the product information service system exposes the list information, wherein the list information includes list type information;

[0058] a service calling unit configured to, after obtaining target products associated with different lists based on the identification information of the list, respectively call the first list service deployed on the first application and the second list service deployed on the second application using the identification information of the target products as a parameter;

[0059] a ranking information obtaining unit, configured to obtain first ranking information output by the first ranking service for the target product, and second ranking information output by the second ranking service for the target product;

[0060] The matching judgment unit is used to perform consistency judgment on the second list information based on the first list information, and when the list type information output for the target product corresponds to a match, determine that the list transparency capability verification of the second list service deployed in the second application has passed.

[0061] A computer-readable storage medium stores a computer program, which, when executed by a processor, implements the steps of any of the aforementioned methods.

[0062] An electronic device, comprising:

[0063] one or more processors; and

[0064] A memory associated with the one or more processors, the memory being used to store program instructions, wherein the program instructions, when read and executed by the one or more processors, execute the steps of any of the aforementioned methods.

[0065] A computer program product comprises a computer program / computer executable instructions, wherein the computer program / computer executable instructions are capable of implementing the steps of any of the aforementioned methods when executed by a processor in an electronic device.

[0066] According to the specific embodiments provided in this application, this application discloses the following technical effects:

[0067] As an application of an embodiment of the present application, the product selection capability of the second product selection engine to be applied to the online environment of the product information service system can be verified during the process of upgrading the product selection engine from the first product selection engine to the second product selection engine. Specifically, the real data generated by the online environment and verified in the actual application process, that is, the identification information of the historical product selection engine in this application, can be obtained through data backflow as the data source for product selection capability verification. Based on these data sources, the first product selection engine currently applied in the online environment and the second product selection engine that needs to be applied to the online environment after the engine upgrade can be called respectively to obtain the product information of the first product and the product information of the second product output by the two, and perform data consistency judgment. Because the product selection capability of the first product selection engine has been verified through actual use in the online environment, the product information of the first product output by it can be used as a benchmark. When it is determined through consistency judgment that the product information of the second product output by the second product selection engine is completely matched with it, it can be determined that the product selection capability verification of the second product selection engine has passed.

[0068] As another application of the present embodiment, during the migration of a ranking service, when changing from a first ranking service deployed in a first application to a second ranking service deployed in a second application, the ranking transparency capability of the second ranking service can be verified. Specifically, real data valid in the online environment, namely, the ranking identification information in this application, can be obtained through data backflow, and used as the data source for ranking transparency capability verification. Based on these data sources, the target product associated with the ranking can be first obtained. Then, using the target product identification information as a parameter, the first ranking service deployed in the first application and the second ranking service deployed in the second application are respectively called to obtain the first ranking information and the second ranking information output by the two correspondingly, and data consistency is determined. Because the ranking transparency capability of the first ranking service deployed in the first application has been verified through actual use in the online environment, the first ranking information output by the first ranking service for the target product can be used as a benchmark. After the consistency determination, if it is determined that the second ranking information output by the second ranking service deployed in the second application for the target product completely matches it, it can be determined that the ranking transparency capability verification of the second ranking service deployed in the second application has passed.

[0069] The above data verification solution, which is not affected by human factors, can simply and conveniently test whether the engine upgrade process affects the product selection ability of the second product selection engine, and whether the list service migration process affects the list transmission ability of the second list service deployed in the second application. If the data verification passes, it can be determined that the product selection ability of the second product selection engine and the list transmission ability of the second list service deployed in the second application are not affected by the service changes, which can effectively ensure the accuracy and reliability of the service capabilities, and solve the problems of difficult sampling, limited amount of sampling data, and low reliability of sampling results under manual sampling methods.

[0070] Of course, any product implementing the present application does not necessarily need to achieve all of the advantages described above at the same time. BRIEF DESCRIPTION OF THE DRAWINGS

[0071] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0072] Figure 1 This is a schematic diagram of a product display page provided in an embodiment of the present application;

[0073] Figure 2 This is a schematic diagram of the product placement effect provided by the embodiment of the present application;

[0074] Figure 3 This is a flow chart of a data processing method provided by an embodiment of the present application;

[0075] Figure 4 This is a schematic diagram of the list information provided in the embodiment of the present application;

[0076] Figure 5 is a flow chart of another data processing method provided in an embodiment of the present application;

[0077] Figures 6 to 8 is a schematic diagram of a data processing device provided in an embodiment of the present application;

[0078] Figure 9 Schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0079] The following will be combined with the accompanying drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field are within the scope of protection of this application.

[0080] When making service changes to services applied in the online environment of the commodity information service system, in order to ensure the consistency of the service capabilities provided before and after the service change, the embodiment of the present application can obtain data verified by the online environment through data backflow during the service change process, and verify the service capabilities before and after the service change based on this data, thereby solving many problems existing in manual sampling.

[0081] As the first application of the present application solution, the service change can be reflected as an upgrade of the product selection engine, and the corresponding service capability verification can be reflected as the verification of the accuracy and reliability of the engine's product selection capability during the upgrade from the first product selection engine to the second product selection engine.

[0082] In the embodiments of the present application, the product information service system can provide product purchase services solely through online stores under the traditional e-commerce model. Alternatively, the product information service system can provide product purchase services through a combination of offline physical stores and online stores under the new retail model. In other words, consumers can not only purchase products in offline physical stores, but also browse and purchase products offered by physical stores through the corresponding online stores in an online manner.

[0083] Below, we take the new retail model as an example to explain the application scenarios of the product selection engine.

[0084] In order to optimize the product display effect of online stores, the products provided by physical stores are usually classified in multiple ways, and corresponding product browsing entrances for different classification methods are provided through the product display page. A product browsing entrance is a corresponding product display channel. Consumer users can view different products exposed in different channels according to their own shopping needs.

[0085] like Figure 1In the product display page shown, products can be classified according to product categories, and browsing entrances corresponding to product display channels such as fruits and flowers, vegetables and soy products, meat, poultry and eggs are provided; products can also be classified according to the promotion activities they participate in, whether they are new products, whether they are currently sold in season, etc., and browsing entrances corresponding to product display channels such as Today's Purchase, Try New Boxes, and Seasonal Freshness are provided; in addition, when recommending products through scene cards, different scene cards can also be regarded as different product display channels. For example, some small-packaged baked goods, beverages, dairy products, etc. can be combined and exposed under the "Small Happiness of One Person's Meal" card, and some autumn fruits such as blueberries, grapes, and raspberries can be combined and exposed under the "Autumn Blueberry Purple" card.

[0086] In actual applications, operators can pre-determine the expected delivery effects corresponding to different product display channels based on application requirements. Specifically, this may include: identification information of the products delivered under the product display channel, and the delivery positions (also known as slots, display slots, resource slots, etc.) corresponding to these products under the product display channel. Taking the products exposed by physical store A under the trial channel as an example, the expected delivery effect is to expose products 3, 5, 6, 7, etc., and product 3 is delivered to slot 1, product 5 is delivered to slot 2, product 6 is delivered to slot 3, product 7 is delivered to slot 4, and so on. When a consumer user visits the online store corresponding to physical store A and clicks Figure 1 After browsing the "Try New Box" page, you can view Figure 2 The effect of product placement shown.

[0087] To achieve the aforementioned delivery effects, operators need to configure product selection rules associated with the new product channels and provide them to the product selection engine. The engine can then create a product set representing new products based on the selection rules. For example, the new product's product set is identified as 01. The engine then selects new products from the products offered by different physical stores to obtain product sets associated with each store. For example, product set 01 for physical store A includes all new products offered by physical store A, while product set 01 for physical store B includes all new products offered by physical store B.

[0088] After obtaining the product collection 01 for each store, operators can configure the placement rules associated with the new product trial channel. Based on these placement rules, they can then determine from the product collection 01 which products should be placed on the new product trial channel for exposure. Specifically, for the new product trial channel for the online store corresponding to physical store A, the placement rules can be used to determine the products to be exposed from physical store A's product collection 01; for the new product trial channel for the online store corresponding to physical store B, the placement rules can be used to determine the products to be exposed from physical store B's product collection 01.

[0089] As explained above, the products displayed across different channels are based on data provided by the product selection engine (i.e., the product selection set). The product selection set output by the product selection engine directly influences the actual placement of products across the channels they are displayed on. Therefore, the accurate and reliable product selection capabilities of the product selection engine are crucial to the effectiveness of product placement. Therefore, during the upgrade and transformation of the product selection engine, verifying the engine's product selection capabilities is a crucial step that must be verified.

[0090] The current method for verifying product selection capabilities involves data verification personnel using their mobile phones or other smart devices to access product display pages provided by the product information service system through applications, web pages, mini-programs, etc., and randomly browse the product display channels on the pages to determine whether the product exposure in these channels matches the expected delivery effect. This method is very time-consuming and has the following technical issues:

[0091] 1. Random inspection is difficult

[0092] The requirements for data verification personnel are very high, which makes it very difficult to implement random inspection and verification.

[0093] On the one hand, it is necessary to be familiar with all the display channels provided by the product display page and the corresponding access points for each display channel. Typically, there are many product display channels, and the corresponding access points may be located under multiple levels of pages, which increases the difficulty of random inspections. In addition, the product information service system may present the product display page in various formats such as applications, web pages, and mini-programs. The presentation, number, and access points of the product display channels in different formats may vary, further increasing the difficulty of random inspections for data verifiers.

[0094] On the other hand, familiarity with the expected delivery effects of each product display channel is crucial to determining whether actual product exposure matches these expectations. Typically, there are numerous product display channels, and corresponding expected delivery effects require familiarity. This is especially true in practice, as different physical stores offer varying products. Consequently, expected delivery effects for the same channel may vary across stores, further complicating data verification.

[0095] 2. Low reliability of sampling results

[0096] Manual sampling verification can only be done by data verification personnel based on their personal experience, randomly verifying the actual exposure of a limited number of product display channels. The amount of sampling data is very limited and is greatly affected by human factors, making it impossible to verify the entire data. This leads to low reliability of the sampling results. Even if the sampling results pass, the accuracy and reliability of the engine's product selection capabilities cannot be effectively guaranteed.

[0097] 3. Low availability of sampling results

[0098] If the actual exposure of the product display channel does not match the expected delivery effect, that is, if the random inspection results fail, it is impossible to locate the fault of the product selection engine. In other words, it is impossible to determine the problems in the engine implementation logic based on the random inspection results.

[0099] Correspondingly, an embodiment of the present application provides an automated data verification solution, which fully verifies the product selection ability of the product selection engine through full data verification, and ensures the consistency of the data selected under the same product selection rules before and after the engine upgrade.

[0100] As can be seen from the above introduction, the implementation process of the product selection engine outputting the product selection set according to the product selection rules can include at least the following two steps:

[0101] 1. Create a product set ID based on the product selection rules. For example, in the example above, the product set ID for the new product is 01.

[0102] 2. After creating the product set ID, you can execute the product recall logic code to circle the products associated with the created product set from the products provided by the physical store, that is, to determine the product IDs of different physical stores corresponding to the product set. Figure 2 Taking the example of physical store A, the product IDs corresponding to physical store A under product set 01 may include at least product 3, product 5, product 6, product 7, and so on.

[0103] During the research and development process, the inventors discovered that the stability and reliability of the product selection engine's selection capabilities primarily depend on whether Step 2 correctly selects products within the selected set ID. Therefore, they transformed the verification of the product selection engine's selection capabilities into a verification of its product recall capabilities. If the same products can be recalled for the same selection set IDs generated by the same selection rules before and after the engine upgrade, then the product recall capability of the product selection engine, and therefore its corresponding product selection capabilities, is normal.

[0104] The engine upgrade process of the embodiment of the present application may involve three operating environments related to the product information service system, namely the online environment, the pre-release environment, and the safe production environment. Among them, the online environment is also the production environment, which is the environment in which the system officially provides services to consumer users; the pre-release environment is also the test environment, which is used to simulate the online environment for pre-release testing and verification; the safe production environment (SPE environment) is also a test environment. Compared with the pre-release environment, the two have different environmental configuration factors. The SPE environment can provide a grayscale traffic production environment, which can also be called a quasi-online environment.

[0105] Correspondingly, the engine upgrade process can involve two product selection engines: the first product selection engine currently running in the online environment, that is, the old engine that will be optimized and replaced during the upgrade process; and the second product selection engine after functional and / or performance improvements, that is, the new engine that will be released to the online environment.

[0106] Typically, the product selection capabilities of the old engine running in an online environment are stable and reliable. Therefore, the embodiments of this application can refer to the output data of the old engine to verify whether the output data of the new engine is consistent with it. If the output data of the two are consistent after full data verification, the accuracy and reliability of the product selection capabilities of the new engine can be effectively verified.

[0107] The following is an explanation of the implementation process of the data processing method of the embodiment of the present application with reference to specific examples. Figure 3 The flowchart shown may include:

[0108] S301: Obtain identification information of multiple historical product selection sets through data backflow, where the historical product selection sets are generated by the first product selection engine and / or the historical version of the product selection engine released before the first product selection engine, and are verified during the application process of being put into the target channel of the product information service system.

[0109] In the embodiment of the present application, real data generated in the online environment and verified in the actual application process can be obtained by data backflow as a data source for product selection capability verification. That is to say, the historical product selection set is a product selection set previously generated by the product selection engine running in the online environment, and the product delivery processing of the product information service system is implemented based on the historical product selection set, that is, the products associated with the historical product selection set are delivered to the corresponding target channels according to the delivery rules. Because the historical product selection set is real data that has been run in the online environment and has high data reliability, the result of the product selection capability verification implemented with this as the data source is more accurate and reliable.

[0110] Among them, the historical product selection set can be generated by the first product selection engine currently applied in the online environment, and / or, it can be generated by the historical version of the product selection engine released before the first product selection engine. The specific details can be determined according to the usage requirements, and the embodiments of the present application do not limit this. In addition, for the historical product selection set generated by the first product selection engine, it can be a product selection set that has been applied to the online environment but is currently offline, that is, the products under this product selection set are no longer used for product placement; and / or, it can be a product selection set that is in an effective state and is still running online, that is, the product selection set that is currently still used for online product placement.

[0111] It is understandable that when the embodiment of the present application is applied to a product information service system under a traditional e-commerce model, when a historical product selection set that has been verified in an online environment is used as the data source for product selection capability verification, the reflux data may include the historical product selection set ID. When the embodiment of the present application is applied to a product information service system under a new retail model, considering that different physical stores offer different products, the corresponding products circled under the same product selection set ID will also be different. Therefore, the corresponding reflux data may include the historical product selection set ID and the physical store ID.

[0112] In actual applications, the data generated by the product information service system, such as the product set ID and physical store ID generated during the product set generation process, can be saved to the big data processing platform. This application solution can perform data reflux and obtain the required historical product set ID and physical store ID from the big data processing platform.

[0113] S302: Using the identification information of the historical product selection set as a parameter, respectively call the first product selection engine and the second product selection engine.

[0114] S303: Obtain the product information of the first product recalled by the first product selection engine from the products provided by the product information service system based on the identification information of the historical product selection set, and the product information of the second product recalled by the second product selection engine from the products provided by the product information service system based on the identification information of the historical product selection set; the product information includes product quantity information and product identification information.

[0115] The embodiment of the present application can call the old and new product selection engines by reflowing the historical product selection set ID, and use the data output by the old engine as a benchmark to perform full data verification on the data output by the new engine.

[0116] Specifically, in the traditional e-commerce model, the historical product selection set ID can be used as an input parameter to call the new engine and the old engine respectively, so that the two can run their respective code logic for product recall, and obtain the product information of the first product and the second product obtained by recalling products in the product information service system, for example, in the product pool provided by the system.

[0117] Under the new retail model, a parameter pair in the form of (historical product set id, physical store id) can be used as input to call the new engine and the old engine respectively, so that they can run their own code logic for product recall respectively, and realize the recall of products associated with the historical product set in the physical store, that is, obtain the product information of the first product and the product information of the second product obtained by the new and old engines through product recall among the products provided by the physical store.

[0118] As an example, a generalized HSF call (High-Speed ​​Front, a service call method that does not rely on second-party packages) can be used to obtain service responses from both the old and new engines. The product information returned by both the old and new engines may include the quantity and identification information of the recalled products.

[0119] In an embodiment of the present application, the products recalled by the old engine can be defined as the first product, and the products recalled by the new engine can be defined as the second product. When the quantity information of the first product is the same as the quantity information of the second product, and the product identification information of the first product is the same as the product identification information of the second product, it is determined that the outputs of the new engine and the old engine have data consistency.

[0120] It should be noted that the second product selection engine as a new engine can run in the pre-release environment of the product information service system, or can run in the SPE environment of the product information service system, or can first run in the pre-release environment and then run in the SPE environment after the pre-release environment verification is passed for double verification.

[0121] In real-world applications, a product set typically contains a large number of associated products. Therefore, both new and existing engines can return data in multiple batches. Accordingly, information about the first and second products can be obtained through paging parsing and deduplication.

[0122] Taking the data returned by the new engine as an example, when obtaining the second product returned in batches by the second product selection engine, you can first perform paging analysis to obtain all the product IDs of the second products returned in multiple batches, and then perform deduplication processing to eliminate the repeated product IDs to ensure the uniqueness of the product IDs of the obtained second products. In this way, the product quantity of the second product determined is more accurate.

[0123] Similarly, for the data returned by the old engine, when obtaining the first product returned in batches by the first product selection engine, paging analysis and deduplication processing can also be performed to obtain accurate product information of the first product.

[0124] S304: Based on the product information of the first product, the product information of the second product is judged for consistency, and when the product information obtained according to the identification information of the multiple historical product selection sets all correspond to each other, it is determined that the product selection capability verification of the second product selection engine has passed.

[0125] The consistency judgment in this example is based on the data returned by the old engine to determine whether the quantity information of the goods in the data returned by the new engine is the same, and whether the product IDs of the recalled goods are the same. When the quantity of goods and the product IDs are the same, that is, the quantity information of the goods and the product identification information mentioned in this application match, it can be determined that the data verification under the request parameters currently calling the new and old engines (that is, the parameters used to call the new and old engines (historical product selection set ID), or the parameter pairs used (historical product selection set ID, physical store ID)) has passed.

[0126] Similarly, you can traverse different request parameters and perform recursive loops to obtain the product information of the first product and the product information of the second product returned by the new and old engines for each request parameter, perform consistency judgment, and when the data verification under all request parameters passes, determine that the product selection capability verification of the second product selection engine has passed.

[0127] This full-data validation solution, unaffected by human factors, can better test whether the engine upgrade process has affected the new engine's product recall capabilities. If product recall is accurate and reliable, the new engine's ability to create new selection sets and implement product selection based on the new selection rules configured by operators is also accurate and reliable. In other words, the engine upgrade has not affected the new engine's product selection capabilities.

[0128] Optionally, if non-matching products are identified during the consistency judgment process, recall path identification information of the non-matching products can also be obtained. The recall path identification information is used to indicate the code execution path when the first product selection engine and / or the second product selection engine recalls the non-matching products; identification information of the historical product selection set used to recall the non-matching products and the recall path identification information of the non-matching products are provided to locate faults in the execution code of the second product selection engine.

[0129] In this example, when the new and old engines execute the code logic for product recall, they can create a traceid for each product. The traceid can record the code execution path during each product recall process. For mismatched products identified during the consistency judgment process, the traceid of the mismatched product and the historical product selection set ID in the request parameters used when recalling the mismatched product can be provided to relevant personnel, such as engine developers, who can then locate the fault in the execution code of the new engine and perform targeted troubleshooting on the problems in the code.

[0130] The following explains the implementation process of double verification based on the pre-launch environment and the SPE environment in the embodiment of the present application.

[0131] First, identification information of multiple historical product selection sets can be obtained through data backflow. The historical product selection sets are generated by the first product selection engine and / or historical versions of the product selection engine previously released by the first product selection engine, and are verified during application in the target channels of the product information service system.

[0132] Secondly, the second product selection engine, i.e. the new engine, is applied to the pre-launch environment of the product information service system, and data consistency judgment is performed with the first product selection engine, i.e. the old engine, currently applied in the online environment. Specifically, you can refer to the above introduction, use the identification information of multiple historical product selection sets as parameters to call the engine, and obtain the product information obtained by the first product selection engine and the second product selection engine after product recall based on the identification information of the multiple historical product selection sets, including: the product information of the first product provided by the first product selection engine running in the online environment, this part of the product information serves as the benchmark for data verification; and the product information of the second product provided by the second product selection engine running in the pre-launch environment, this part of the product information serves as the data to be judged. If, in the consistency judgment process, the product information of the first product completely matches the product information of the second product, it can be determined that the product selection ability verification of the second product selection engine in the pre-launch environment has passed; if there are mismatched products, it is determined that the product selection ability verification of the second product selection engine in the pre-launch environment has failed, and the execution code of the second product selection engine needs to be corrected.

[0133] Next, if, based on the consistency judgment, it is determined that the second product selection engine has passed the product selection capability verification in the pre-launch environment, the second product selection engine can be applied to the secure production environment of the product information service system. The SPE environment is closer to the actual online environment, and data verification in this environment produces verification results that are more consistent with online operations.

[0134] Finally, data consistency judgment is performed on the first product selection engine running in the online environment and the second product selection engine running in the SPE environment. Specifically, you can also refer to the above introduction and use the identification information of multiple historical product selection sets as parameters to call the engine, and obtain the product information obtained by the first product selection engine and the second product selection engine after the product recall based on the identification information of the multiple historical product selection sets. If the product information provided by the two is completely matched during the consistency judgment process, it can be determined that the product selection capability verification of the second product selection engine in the SPE environment has passed, indicating that there is no problem with the recall logic of the new engine, and the second product selection engine can be applied to the online environment; if there are unmatched products, it is determined that the product selection capability verification of the second product selection engine in the SPE environment has failed, and the execution code of the second product selection engine needs to be corrected.

[0135] As the second application of the present application solution, the service change can be reflected as the migration of the list service, and the corresponding service capability verification can be reflected in the process of migrating the list service and changing the first list service deployed in the first application to the second list service deployed in the second application, and verifying the accuracy and reliability of the list transparency capability.

[0136] Among them, the ability to reveal the list is the ability to reveal the list information through the product card. That is, for the products belonging to the list, the relevant information of the list can be associated under the product card exposed by the product information service system.

[0137] Similarly, the product information service system of the embodiment of the present application can provide product purchasing services only through online stores under the traditional e-commerce model; or, it can provide product purchasing services through a combination of offline physical stores and online stores under the new retail model.

[0138] The following uses the new retail model as an example to explain the application scenarios of the list service.

[0139] To solve the problem of product selection for consumers in scenarios with clear category requirements, different types of product lists can be configured based on the purchase situation of physical store products, such as the best-selling list, soaring list, new product list, well-received list, repurchase list, scenario-based repurchase list, etc. When consumers select products through online stores, they can refer to the list information to make purchasing decisions.

[0140] Typically, the entry points for rankings are mostly the main traffic entry points for online stores. For example, in the product information flow feeds displayed on the homepage, category, search, shopping cart, etc., the ranking products will reveal the ranking information of the rankings to which the products belong. Figure 4 As shown, it may include the type of list to which the product belongs, the ranking of the product within the list, the link address of the list's follow-up page, etc. It is understandable that when a user clicks the link, they can jump to the list's follow-up page (also called the landing page) and view all the products associated with the list.

[0141] Currently, online store homepages have a high RT (Response Time) problem, which causes the homepage to open unsmoothly. When analyzing the call link of the homepage, it was found that the RT of the homepage calling the ranking service accounted for a high proportion of the entire link, about 60 to 70ms. In order to reduce the overall response time of the homepage, the embodiment of the present application can migrate the ranking service and switch the ranking service to an application with better performance. In this way, when the homepage calls the ranking service of the better-performing application, it helps to reduce the response time of the ranking service call, thereby optimizing the overall response time of the homepage.

[0142] During the list switching process, it is necessary to ensure the consistency of the list service call, that is, to accurately and reliably display the list information of the listed products under the product card. Currently, data verification personnel verify the list disclosure through manual spot checks. However, due to the randomness of the list disclosure logic, data verification personnel do not know which products will be linked to the list information, which pages these products are exposed through (that is, the product exposure channels), which slots in the exposure page feeds flow, and other information are uncertain, which makes spot checks and verification very difficult. Of course, the manual spot check verification method also has problems such as strong dependence on the experience of data verification personnel, limited number of spot checks, and low reliability of spot check results.

[0143] In response to this, the present embodiment provides an automated data verification solution that can first obtain the products associated with the list, and then use the products to reversely check the consistency of service calls before and after the list service migration. The specific implementation process of this application solution is explained below.

[0144] First of all, it should be noted that the list service migration process of the embodiment of this application can also involve three operating environments related to the product information service system: pre-release environment, SPE environment, and online environment. For details, please refer to the above introduction and will not be described in detail here.

[0145] In addition, the list service migration process can also involve two services:

[0146] 1. The first ranking service deployed in the first application.

[0147] In this example, the first application, which is also the service provider in the service migration process, is currently running in the online environment of the product information service system. It can accept external calls and obtain the list information associated with the listed products through the first list service deployed therein. Then, when the product information service system exposes the listed product, the list information of the corresponding list is displayed under the product card for consumers to view.

[0148] 2. A second list service deployed in a second application.

[0149] In this example, the second application is also the service receiver during the service migration process. Based on usage requirements, the second application deployed with the second list service can be run in a test environment such as a pre-release environment and / or an SPE environment, and the list transparency capability can be verified in the test environment. Based on the verification results, it can be determined whether to publish the second application deployed with the second list service to the online environment of the product information service system. In addition, after publishing the second application deployed with the second list service to the online environment of the product information service system, the list transparency capability can also be verified in the online environment, that is, the second application deployed with the second list service can also run in the online environment to conduct inspections on the list information exposed online for consumers to view.

[0150] In the embodiment of the present application, the performance and resource allocation of the first application are worse than those of the second application, and there is no room for RT optimization on the first application side. Therefore, the list service is migrated and the second list service deployed in the second application returns the list information, thereby achieving the purpose of reducing the overall response time of the homepage.

[0151] Understandably, the first ranking service deployed in the first application running in the online environment is stable and reliable. Therefore, the present embodiment can refer to the output data of the first ranking service to verify whether the output data of the second ranking service is consistent with it. If the data verification shows that the output data of the two are consistent, the accuracy and reliability of the ranking service's ability to display rankings after migration can be effectively verified.

[0152] The following is an explanation of the implementation process of the data processing method of the embodiment of the present application with reference to specific examples. Figure 5 The flowchart shown may include:

[0153] S501: Obtain identification information of multiple lists of different types through data backflow, wherein the lists are associated with multiple listed products, and the information is verified when the product information service system exposes list information associated with the listed products, wherein the list information includes list type information.

[0154] In an embodiment of the present application, real data applied to the online environment can be obtained through data backflow, that is, the list that is verified when the product information service system exposes the list information associated with the listed products, as a data source for the list transparency capability verification.

[0155] In actual applications, the rankings used as data sources can be historical rankings that have been used in online environments. This means that ranking information was previously revealed through the products associated with the rankings. Alternatively, the rankings used as data sources can be current rankings in online environments. This means that ranking information can still be revealed through the products associated with the rankings.

[0156] Similarly, when the embodiments of the present application are applied to a product information service system under a traditional e-commerce model, and a list that has already been validated in an online environment is used as the data source for list transparency verification, the returned data may include the list ID. When the embodiments of the present application are applied to a product information service system under a new retail model, considering that different physical stores offer different products, and that the same product may be included in the list and its ranking after inclusion in different stores, the corresponding returned data may include the list ID and the physical store ID.

[0157] In addition, as mentioned above, the product information service system may provide multiple types of rankings. The present embodiment can perform data verification for each type of ranking, thereby obtaining identification information for multiple different types of rankings through data reflow. In other words, under the new retail model, the relationship between ranking type information, ranking identification information, and physical store identification information can be obtained.

[0158] S502: After obtaining target products associated with different lists according to the identification information of the list, the first list service deployed in the first application and the second list service deployed in the second application are respectively called with the identification information of the target products as parameters.

[0159] S503: Obtain first list information output by the first list service for the target product, and second list information output by the second list service for the target product.

[0160] In the embodiment of the present application, the target products associated with the list can be obtained by returning the list ID, and then the list information output for the same target product before and after the service migration can be checked through the target product to see whether it is consistent.

[0161] Specifically, the product ID of the target product can be used as an input parameter to call the first application and the second application respectively. The first list service running code deployed on the first application outputs the first list information associated with the target product, and uses this as a basis for data verification to perform consistency judgment on the second list information output by the second list service running code deployed on the second application for the target product.

[0162] As an example, you can use the following solution to obtain the target products associated with the list.

[0163] First, the product information service system can provide a backend service for obtaining products on the list. In the traditional e-commerce model, this backend service can be called with the list ID as an input parameter; in the new retail model, it can be called with a parameter pair of the form (list ID, physical store ID) as an input parameter.

[0164] Taking the implementation process under the new retail model as an example, the backend service receives a call and obtains the access address of the ranking page in the online store corresponding to the physical store. By constructing the request parameters of the H5 page and initiating a product retrieval request for the ranking page, the product IDs of the ranked products displayed on the page are obtained. These ranked products are the products associated with (ranking ID, physical store ID).

[0165] Secondly, you can identify target products from the associated products under the list. In one example, the target products can be all listed products displayed on the follow-up page. This means that the list transparency capability of the list service before and after migration can be fully verified based on all listed products. In another example, the target products can be a subset of the listed products displayed on the follow-up page. For example, when constructing the request parameters, you can set the parameter m to adjust the number of target products. Then, by initiating an mtop request on the list follow-up page, you can obtain the top m listed products on the list as target products and perform list transparency verification.

[0166] It can be understood that the data verification process in this application can be implemented in the testing phase of the list service migration process. Correspondingly, the second application deployed with the second list service can run in the pre-release environment of the product information service system, or can run in the SPE environment of the product information service system, or can first run in the pre-release environment and then run in the SPE environment after the pre-release environment verification is passed, for double verification.

[0167] S504: Based on the first list information, the second list information is judged for consistency, and when the list type information output for the target product all corresponds to a match, it is determined that the list transparency capability verification of the second list service deployed in the second application has passed.

[0168] In this example, consistency is determined based on the data returned by the first ranking service. The data returned by the second ranking service is then used to determine whether it includes ranking information, specifically ranking type information, and whether the returned ranking type information is identical. If ranking information is returned for the target product and the ranking type information matches, then the data verification for the request parameters of the current service call (i.e., the parameters (rank ID) or the parameter pair (rank ID, physical store ID) used to call the first and second ranking services) can be determined to have passed.

[0169] Similarly, different request parameters can be traversed recursively to obtain the first list information and second list information returned by the first list service deployed in the first application and the second list service deployed in the second application for each request parameter, and consistency judgment is performed. When the data verification under all request parameters passes, it is determined that the list transparency capability verification of the second list service deployed in the second application has passed.

[0170] For example, if 20 lists are retrieved under the Soaring List category, their IDs are Soaring List 01 to Soaring List 20, and their corresponding store IDs are Store 01 to Store 20. For example, if m = 30, calling the backend service with (Soaring List 01, Store 01) as the input parameter will retrieve the 30 target products associated with Store 01 under Soaring List 01.

[0171] By taking the product IDs of these target products as input parameters and calling the first list service deployed in the first application, you can obtain the first list information returned by the first list service for these 30 target products. The list type in the first list information is the soaring list, which serves as the basis for data verification.

[0172] Similarly, the product IDs of these target products can be used as input parameters to call the second list service deployed in the second application. After obtaining the second list information returned by the second list service for these 30 target products, the first list information can be used to perform consistency judgment on the second list information to complete the data verification process.

[0173] Specifically, if the second list information returned for a certain (certain) target product does not include list type information; and / or the list type in the second list information returned for a certain (certain) target product is not a soaring list, it can be determined that the list type information displayed by the first list service and the second list service under the target product does not match, and the data verification fails.

[0174] If the second ranking information returned for all 30 target products includes ranking type information and all are rising rankings, the data verification can be determined to have passed. This means that the ranking service's ranking transparency capabilities have not been affected by the service migration. The second application deployed with the second ranking service can be released to the online environment. This way, when consumers visit the online store, they can access ranking information from the second ranking service by calling the second application.

[0175] The above data verification solution, which is not affected by human factors, can better test whether the service migration process has an impact on the list transparency capability of the list service.

[0176] Optionally, for the implementation of a solution in which the target product is part of the listed products, the embodiment of the present application may also provide the following preferred solution:

[0177] When the list type information output for the target product all corresponds to a match, the parameter value related to the number of the target product, that is, the parameter m mentioned above, can be adjusted to increase the number of the target product. For example, in the above example, the value of m is adjusted to 40, and then the 10 newly added target products can continue to be used for data verification. Specifically, the identification information of the newly added target product can be used as a parameter, and the first list service deployed in the first application and the second list service deployed in the second application can be called respectively. The consistency judgment is performed based on the first list information output by the first list service for the newly added target product and the second list information output by the second list service for the newly added target product. When the list type information output for the newly added target product all corresponds to a match, it is determined that the list transparency capability verification of the second list service deployed in the second application has passed.

[0178] That is to say, when some target products pass the verification, the accuracy of the verification results can be further verified by increasing the number of target products. In this way, the verification speed can be improved and the accuracy of the verification results can be ensured, avoiding the failure to discover mismatches in time due to the small amount of data used for verification.

[0179] In addition, it should be noted that the data verification process of this application can be implemented not only in the testing phase of service migration, but also in the use phase after service migration. In other words, the second list service deployed in the second application in this application is the list service of the current application in the online environment.

[0180] Specifically, after the second application deployed with the second list service is released to the online environment, part of the traffic of the product information service system can be switched to the second list service through user traffic settings. Other traffic still uses the first list service deployed in the first application to provide list transparency services.

[0181] Under this implementation, the identification information of the list currently applied in the online environment, that is, the identification information of the list currently in effect, can be obtained through online data reflow. Based on the list data of the still effective list, the backend service is called to obtain the target products associated with each list. Then, when some traffic accesses the product information service system, the target products associated with these effective lists can be triggered to perform data verification on the online data. In other words, the product ID of the target product associated with the effective list can be used as an input parameter to call the first application and the second application running in the online environment respectively, triggering the first list service deployed in the first application to output the first list information for the target product, and the second list service deployed in the second application to output the second list information for the target product, so as to perform data verification based on the output of the two and realize online data inspection.

[0182] It is understandable that if an unmatched target product is found during the online data inspection process, an alarm can be issued for the unmatched target product to correct the list information that needs to be displayed under the unmatched target product in the online environment.

[0183] This example is to release the second application deployed with the second list service to the online environment, and then re-verify the real list transmission capability of the second list service in the online environment by setting a small amount of user traffic. It can be understood that when the set user traffic accesses the product information service system, the second list service can provide the list transmission service to these users; at the same time, the set user traffic accessing the product information service system can also serve as a trigger for the online environment to actively call the first list service, realize the dual call of the two list services, and then make a consistency judgment based on the data output by the two. It can not only realize the verification of the online list transmission capability, but also timely discover the mismatched target products and make information corrections, thereby realizing data inspection of this part of online data.

[0184] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0185] Corresponding to the aforementioned method embodiment, the embodiment of the present application further provides a data processing device for verifying the product selection capability of the second product selection engine to be applied to the online environment of the commodity information service system during the process of upgrading from the first product selection engine to the second product selection engine, wherein the first product selection engine is the product selection engine currently applied in the online environment. Figure 6 , the apparatus may include:

[0186] The data reflow unit 601 is configured to obtain identification information of multiple historical product selection sets through data reflow, wherein the historical product selection sets are generated by the first product selection engine and / or a historical version of the product selection engine previously released by the first product selection engine, and are verified during application in a target channel of the product information service system;

[0187] An engine calling unit 602 is configured to call the first product selection engine and the second product selection engine respectively using the identification information of the historical product selection set as a parameter;

[0188] The product information obtaining unit 603 is configured to obtain product information of a first product recalled by the first product selection engine from the products provided by the product information service system based on the identification information of the historical product selection set, and product information of a second product recalled by the second product selection engine from the products provided by the product information service system based on the identification information of the historical product selection set; the product information includes product quantity information and product identification information;

[0189] The matching judgment unit 604 is used to make a consistency judgment on the product information of the second product based on the product information of the first product, and to determine that the product selection capability verification of the second product selection engine has passed when the product information obtained respectively according to the identification information of the multiple historical product selection sets all correspond to each other.

[0190] Wherein, the device further includes:

[0191] a path identification obtaining unit, configured to obtain recall path identification information of a non-matching product when a non-matching product is identified during the consistency determination process, wherein the recall path identification information is used to indicate a code execution path when the first product selection engine and / or the second product selection engine recalls the non-matching product;

[0192] An information providing unit is used to provide identification information of the historical product selection set used to recall the non-matching products and identification information of the recall path of the non-matching products, so as to locate the fault of the execution code of the second product selection engine.

[0193] Among them, the commodity information service system integrates offline physical stores and online stores to provide commodity purchasing services.

[0194] The data backflow unit is further configured to obtain identification information of multiple physical stores through the data backflow;

[0195] The engine calling unit is specifically configured to call the first product selection engine and the second product selection engine respectively using the identification information of the historical product selection set and the identification information of the physical store as parameters;

[0196] Correspondingly, the first product is recalled from the products provided by the physical store by the first product selection engine based on the identification information of the historical product selection set; the second product is recalled from the products provided by the physical store by the second product selection engine based on the identification information of the historical product selection set.

[0197] Among them, the second product selection engine is applied to the pre-release environment of the product information service system and / or the safe production environment of the product information service system.

[0198] The commodity information obtaining unit may be used to:

[0199] When obtaining the first product recalled in batches by the first product selection engine, performing paging parsing and deduplication processing to obtain product information of the first product; and / or,

[0200] When obtaining the second product recalled in batches by the second product selection engine, the product information of the second product is obtained after paging analysis and deduplication processing.

[0201] Corresponding to the aforementioned method embodiment, the embodiment of the present application further provides a data processing device for verifying the product selection capability of the second product selection engine to be applied to the online environment of the commodity information service system during the process of upgrading from the first product selection engine to the second product selection engine, wherein the first product selection engine is the product selection engine currently applied in the online environment. Figure 7 , the apparatus may include:

[0202] The data reflow unit 701 is configured to obtain identification information of multiple historical product selection sets through data reflow, wherein the historical product selection sets are generated by the first product selection engine and / or a historical version of the product selection engine previously released by the first product selection engine, and are verified during application in a target channel of the product information service system;

[0203] A pre-launch environment verification unit 702 is configured to obtain, when applying the second product selection engine to the pre-launch environment of the product information service system, product information obtained by the first product selection engine and the second product selection engine after recalling products based on the identification information of the multiple historical product selection sets, and perform consistency judgment; the product information includes product quantity information and product identification information;

[0204] The safe production environment verification unit 703 is used to determine, based on the consistency judgment, that the second product selection engine has passed the product selection ability verification in the pre-release environment, apply the second product selection engine to the safe production environment of the product information service system, and then obtain the product information obtained by the first product selection engine and the second product selection engine after recalling the products according to the identification information of the multiple historical product selection sets, and perform the consistency judgment; based on the consistency judgment, when it is determined that the second product selection engine has passed the product selection ability verification in the safe production environment, apply the second product selection engine to the online environment.

[0205] Corresponding to the aforementioned method embodiment, the embodiment of the present application further provides a data processing device for verifying the list transparency capability of a second list service deployed in a second application during list service migration, wherein the first list service deployed in the first application is the list service currently applied in the online environment of the commodity information service system. Figure 8 , the apparatus may include:

[0206] The data return flow unit 801 is configured to obtain identification information of multiple lists of different types through data return flow, wherein the lists are associated with multiple listed products, and verify the list information associated with the listed products when the product information service system exposes the list information, wherein the list information includes list type information;

[0207] The service calling unit 802 is configured to, after obtaining target products associated with different lists based on the identification information of the list, respectively call the first list service deployed in the first application and the second list service deployed in the second application using the identification information of the target products as a parameter;

[0208] A ranking information obtaining unit 803 is configured to obtain first ranking information output by the first ranking service for the target product, and second ranking information output by the second ranking service for the target product;

[0209] The matching judgment unit 804 is used to perform consistency judgment on the second list information based on the first list information, and when the list type information output for the target product corresponds to a match, determine that the list transparency capability verification of the second list service deployed in the second application has passed.

[0210] The target products are some of the listed products, and the device further includes:

[0211] a parameter adjustment unit, configured to adjust a parameter value related to the quantity of the target product to increase the quantity of the target product when all list type information outputted for the target product corresponds to a match;

[0212] The service calling unit is further configured to respectively call the first list service deployed in the first application and the second list service deployed in the second application using the identification information of the newly added target product as a parameter;

[0213] The matching judgment unit is further configured to perform the consistency judgment based on the first list information output by the first list service for the newly added target product and the second list information output by the second list service for the newly added target product, and determine that the list transparency capability verification of the second list service deployed in the second application has passed when the list type information output for the newly added target product corresponds to a match.

[0214] Among them, the second list service deployed in the second application is the list service of the current application in the online environment, and is used to provide list transparency service to part of the traffic of the commodity information service system.

[0215] The data reflow unit may be specifically configured to: obtain identification information of a list of current applications in the online environment through online data reflow;

[0216] The service calling unit can be specifically configured to: when the partial traffic accesses the product information service system, use the identification information of the target product as a parameter to respectively call the first list service and the second list service to implement online data inspection.

[0217] Among them, the commodity information service system integrates offline physical stores and online stores to provide commodity purchasing services.

[0218] The data reflux unit is further configured to obtain identification information of multiple physical stores through the data reflux, and then obtain target products associated with different lists under corresponding physical stores based on the identification information of the list and the identification information of the physical stores.

[0219] In addition, an embodiment of the present application further provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the steps of any one of the methods in the aforementioned method embodiments are implemented.

[0220] And an electronic device comprising:

[0221] one or more processors; and

[0222] A memory associated with the one or more processors, the memory being used to store program instructions, wherein the program instructions, when read and executed by the one or more processors, execute the steps of any one of the method embodiments described above.

[0223] In addition, an embodiment of the present application also provides a computer program product, including a computer program / computer executable instructions, which, when executed by a processor in an electronic device, implements the steps of any of the methods described in the aforementioned method embodiments.

[0224] in, Figure 9 The architecture of an electronic device is exemplarily shown. For example, the device 900 can be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, an aircraft, etc.

[0225] Reference Figure 9 , device 900 may include one or more of the following components: a processing component 902 , a memory 904 , a power component 906 , a multimedia component 908 , an audio component 910 , an input / output (I / O) interface 912 , a sensor component 914 , and a communication component 916 .

[0226] The processing component 902 generally controls the overall operation of the device 900, such as operations associated with display, phone calls, data communications, camera operation, and recording operations. The processing component 902 may include one or more processors 920 to execute instructions to complete all or part of the steps of the method provided by the technical solution of the present disclosure. In addition, the processing component 902 may include one or more modules to facilitate interaction between the processing component 902 and other components. For example, the processing component 902 may include a multimedia module to facilitate interaction between the multimedia component 908 and the processing component 902.

[0227] The memory 904 is configured to store various types of data to support operations on the device 900. Examples of such data include instructions for any application or method operating on the device 900, contact data, phone book data, messages, pictures, videos, etc. The memory 904 can be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.

[0228] The power supply component 906 provides power to the various components of the device 900. The power supply component 906 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the device 900.

[0229] The multimedia component 908 includes a screen that provides an output interface between the device 900 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, slides, and gestures on the touch panel. The touch sensor can not only sense the boundaries of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 908 includes a front camera and / or a rear camera. When the device 900 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have a focal length and optical zoom capability.

[0230] The audio component 910 is configured to output and / or input audio signals. For example, the audio component 910 includes a microphone (MIC), which is configured to receive external audio signals when the device 900 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal can be further stored in the memory 904 or transmitted via the communication component 916. In some embodiments, the audio component 910 also includes a speaker for outputting audio signals.

[0231] The input / output (I / O) interface 912 provides an interface between the processing component 902 and peripheral interface modules, such as a keyboard, a click wheel, buttons, etc. These buttons may include, but are not limited to, a home button, a volume button, a start button, and a lock button.

[0232] The sensor assembly 914 includes one or more sensors for providing various aspects of status assessment for the device 900. For example, the sensor assembly 914 can detect the open / closed state of the device 900, the relative positioning of components, such as the display and keypad of the device 900. The sensor assembly 914 can also detect changes in the position of the device 900 or a component of the device 900, the presence or absence of user contact with the device 900, the orientation or acceleration / deceleration of the device 900, and temperature changes of the device 900. The sensor assembly 914 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 914 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 914 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0233] The communication component 916 is configured to facilitate wired or wireless communication between the device 900 and other devices. The device 900 can access a wireless network based on a communication standard, such as WiFi, or a mobile communication network such as 2G, 3G, 4G / LTE, 5G, etc. In an exemplary embodiment, the communication component 916 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 916 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0234] In an exemplary embodiment, the device 900 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above-described methods.

[0235] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 904 including instructions. The instructions can be executed by the processor 920 of the device 900 to perform the method provided by the technical solution of the present disclosure. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0236] Through the description of the above embodiments, it can be seen that those skilled in the art can clearly understand that the present application can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which can be stored in a storage medium such as ROM / RAM, a magnetic disk, an optical disk, etc., and includes a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in various embodiments of the present application or certain parts of the embodiments.

[0237] Each embodiment in this specification is described in a progressive manner. The same or similar parts between the embodiments can be referred to each other. Each embodiment focuses on the differences from other embodiments. In particular, for system or system embodiments, since they are basically similar to method embodiments, the description is relatively simple. For relevant parts, refer to the partial description of the method embodiment. The system and system embodiments described above are merely schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. A person of ordinary skill in the art can understand and implement it without expending creative work.

[0238] The above is a detailed introduction to the solution provided by this application. Specific examples are used herein to illustrate the principles and implementation methods of this application. The description of the above embodiments is only intended to help understand the method and core concept of this application. At the same time, for those skilled in the art, based on the concept of this application, there may be changes in the specific implementation methods and application scope. In summary, the contents of this specification should not be understood as limiting this application.

Claims

1. A data processing method, characterized in that: Used to verify the product selection capability of the second product selection engine to be applied to the online environment of the commodity information service system during the process of upgrading from the first product selection engine to the second product selection engine, wherein the first product selection engine is the product selection engine currently applied in the online environment, the method comprising: Obtain identification information of multiple historical product selection sets through data backflow, where the historical product selection sets are generated by the first product selection engine and / or a historical version of the product selection engine released before the first product selection engine, and are verified during the application process of being placed in the target channel of the product information service system; Using the identification information of the historical product selection set as a parameter, respectively calling the first product selection engine and the second product selection engine; Obtaining product information of a first product recalled by the first product selection engine from products provided by the product information service system according to identification information of the historical product selection set, and product information of a second product recalled by the second product selection engine from products provided by the product information service system according to identification information of the historical product selection set; the product information includes product quantity information and product identification information; Based on the product information of the first product, the consistency of the product information of the second product is judged, and when the product information obtained according to the identification information of the multiple historical product selection sets all correspond to each other, it is determined that the product selection capability verification of the second product selection engine has passed.

2. The method according to claim 1, characterized in that The method further comprises: When a mismatched product is identified during the consistency judgment process, recall path identification information of the mismatched product is obtained, where the recall path identification information is used to indicate a code execution path when the first product selection engine and / or the second product selection engine recalls the mismatched product; Provide identification information of the historical product selection set used to recall the non-matching products and identification information of the recall path of the non-matching products to locate the fault of the execution code of the second product selection engine.

3. The method according to claim 1 or 2, characterized in that: The commodity information service system integrates offline physical stores and online stores to provide commodity purchase services, and the method further includes: Obtain identification information of multiple physical stores through the data backflow, and use the identification information of the historical product selection set and the identification information of the physical store as parameters to respectively call the first product selection engine and the second product selection engine; Correspondingly, the first product is recalled by the first product selection engine from the products provided by the physical store based on the identification information of the historical product selection set; the second product is recalled by the second product selection engine from the products provided by the physical store based on the identification information of the historical product selection set.

4. The method according to claim 1 or 2, characterized in that: The second product selection engine is applied to the pre-release environment of the product information service system and / or the safe production environment of the product information service system.

5. The method according to claim 1 or 2, characterized in that: When obtaining the first product recalled in batches by the first product selection engine, performing paging analysis and deduplication processing to obtain product information of the first product; and / or, When the second product recalled in batches by the second product selection engine is obtained, the product information of the second product is obtained after paging analysis and deduplication processing.

6. A data processing method, characterized in that: Used to verify the product selection capability of the second product selection engine to be applied to the online environment of the commodity information service system during the process of upgrading from the first product selection engine to the second product selection engine, wherein the first product selection engine is the product selection engine currently applied in the online environment, the method comprising: Obtain identification information of multiple historical product selection sets through data backflow, where the historical product selection sets are generated by the first product selection engine and / or a historical version of the product selection engine released before the first product selection engine, and are verified during the application process of being placed in the target channel of the product information service system; When the second product selection engine is applied to the pre-release environment of the product information service system, the product information obtained by the first product selection engine and the second product selection engine after product recall according to the identification information of the multiple historical product selection sets is respectively obtained, and consistency judgment is performed; the product information includes product quantity information and product identification information; When it is determined according to the consistency judgment that the product selection capability verification of the second product selection engine in the pre-release environment has passed, the second product selection engine is applied to the safe production environment of the product information service system, and then the product information obtained by the first product selection engine and the second product selection engine after product recall according to the identification information of the multiple historical product selection sets is obtained respectively, and the consistency judgment is performed; When it is determined, based on the consistency judgment, that the product selection capability verification of the second product selection engine in the safe production environment has passed, the second product selection engine is applied to the online environment.

7. A data processing method, characterized in that: The method is used to verify the list exposure capability of the second list service during list service migration, in which a first list service deployed in a first application is changed to a second list service deployed in a second application, wherein the first list service deployed in the first application is a list service currently applied in an online environment of a commodity information service system, and the method includes: Obtain identification information of multiple lists of different types through data reflux, wherein the list is associated with multiple listed products, and is verified when the product information service system exposes list information associated with the listed products, wherein the list information includes list type information; After obtaining the target products associated with different lists according to the identification information of the list, the first list service deployed in the first application and the second list service deployed in the second application are respectively called with the identification information of the target products as parameters; Obtaining first list information output by the first list service for the target product, and second list information output by the second list service for the target product; Based on the first list information, the second list information is judged for consistency, and when the list type information output for the target product all corresponds to a match, it is determined that the list transparency capability verification of the second list service deployed in the second application has passed.

8. The method according to claim 7, characterized in that The target products are some of the listed products, and the method further includes: When all list type information output for the target product is matched, adjusting a parameter value related to the quantity of the target product to increase the quantity of the target product; Using the identification information of the newly added target product as a parameter, respectively calling the first list service deployed in the first application and the second list service deployed in the second application; The consistency judgment is performed based on the first list information output by the first list service for the newly added target product and the second list information output by the second list service for the newly added target product, and when the list type information output for the newly added target product corresponds to a match, it is determined that the list transmission capability verification of the second list service deployed in the second application has passed.

9. The method according to claim 7 or 8, characterized in that: The second list service deployed in the second application is the list service of the current application in the online environment, and is used to provide a list transmission service to part of the traffic of the commodity information service system. The obtaining identification information of multiple different types of lists through data reflow includes: obtaining identification information of the list currently applied in the online environment through online data reflow; The method of using the identification information of the target product as a parameter to respectively call the first list service deployed in the first application and the second list service deployed in the second application includes: when the part of the traffic accesses the product information service system, using the identification information of the target product as a parameter to respectively call the first list service and the second list service to realize online data inspection.

10. The method according to claim 7 or 8, characterized in that: The commodity information service system integrates offline physical stores and online stores to provide commodity purchase services, and the method further includes: The identification information of multiple physical stores is obtained through the data backflow, and the target commodities associated with different lists under the corresponding physical stores are obtained according to the identification information of the list and the identification information of the physical store.

11. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the method described in any one of claims 1 to 10 are implemented.

12. An electronic device, characterized in that: include: one or more processors; as well as A memory associated with the one or more processors, the memory being used to store program instructions, wherein when the program instructions are read and executed by the one or more processors, the steps of the method according to any one of claims 1 to 10 are executed.

13. A computer program product comprising a computer program / computer executable instructions, characterized in that: When the computer program / computer executable instructions are executed by a processor in an electronic device, the steps of the method according to any one of claims 1 to 10 are implemented.