CPI network price collection method and device based on webpage automation and medium

Abstract

The invention discloses a CPI network price collection method and device based on webpage automation and a medium, and relates to the technical field of CPI network price collection. The method comprises the steps of determining a to-be-online-collected commodity category and a corresponding to-be-collected network platform based on a preset online collection investigation demand, and constructing a network collection price table based on the to-be-online-collected commodity category and the to-be-collected network platform; developing an automation program based on a webpage automation tool, and accessing a to-be-collected network platform based on the automation program so as to identify and record to-be-collected commodity data; and processing and calculating the to-be-online-collected commodity data based on a preset data category in the network price collection table, and filling the processed and calculated standard data in the network price collection table to form an automatic network collection ledger.

Description

Technical Field

[0001] The present application relates to the technical field of CPI network pricing, and in particular to a CPI network pricing method, device and medium based on web page automation. Background Art

[0002] CPI (Consumer Price Index) is a macroeconomic indicator that measures the price level changes of consumer goods and services purchased by households. It is an important basis for policymakers, economists and the general public to observe inflation levels, assess economic health and formulate monetary policies. Traditional CPI data collection methods often rely on manual operations, manually accessing e-commerce platforms, physical stores and other channels to record and organize commodity price information. However, this method is not only inefficient and costly, but also easily affected by human factors, making it difficult to ensure data accuracy.

[0003] With the popularization of the Internet and the rapid development of e-commerce, more and more commodity transactions have shifted to online platforms, and e-commerce platforms have become an important channel for consumers to purchase daily necessities. Therefore, how to efficiently obtain commodity price information on these platforms has become a new challenge facing CPI data collection.

[0004] Web page automation technology uses programming languages ​​and specific tool libraries to simulate manual operation of browsers and realize functions such as automatic access to web pages and data crawling. The DrissionPage library based on Python is such a web page automation tool. It has a rich set of built-in functions and can efficiently and accurately parse web page content and extract the required data information. Therefore, how to realize the automatic collection of CPI network prices based on web page automation technology has become a technical problem that needs to be solved urgently. Summary of the invention

[0005] The embodiments of the present application provide a CPI network price collection method, device and medium based on web page automation, which are used to solve the following technical problem: how to realize the automatic collection of CPI network prices based on web page automation technology.

[0006] In the first aspect, an embodiment of the present application provides a CPI network pricing method based on web page automation, characterized in that the method includes: determining the categories of goods to be purchased online and the corresponding network platforms to be purchased based on preset network procurement survey requirements, and constructing a network pricing table based on the categories of goods to be purchased online and the network platforms to be purchased; developing an automation program based on a web page automation tool, and based on the automation program, accessing the network platforms to be purchased to identify and record the data of goods to be purchased online; based on the data categories preset in the network pricing table, processing and calculating the data of goods to be purchased online, and filling the processed and calculated standard data into the network pricing table to form an automated network procurement ledger.

[0007] In one implementation of the present application, based on preset online procurement survey requirements, the categories of goods to be purchased online and the corresponding online platforms to be purchased are determined, specifically including: based on the preset online procurement survey requirements, determining the characteristic information on the basis of online procurement; wherein the characteristic information on the basis of online procurement at least includes residents' consumption habits, consumption volume, and commodity price characteristics; based on the characteristic information on the basis of online procurement, determining the categories of goods to be purchased online in a preset commodity category library; based on the sales volume statistics of each commodity to be purchased online on all online platforms, determining the top several online platforms whose sum reaches a preset ratio as the online platforms to be purchased; wherein the online platforms to be purchased include: e-commerce platforms, brand official websites, and government announcement websites.

[0008] In one implementation of the present application, an online price table is constructed based on the categories of goods to be purchased online and the network platforms to be purchased, specifically including: designing the structure of the online price table based on the categories of goods to be purchased online and the network platform information of the network platforms to be purchased; wherein the structure includes a product name column, a product code column, a link column of the network platform to be purchased, a price field column, and a price selection time column; and initializing the online price table to create a corresponding record row in the online price table for each product to be purchased online.

[0009] In one implementation of the present application, an automation program based on a web automation tool is developed, specifically including: writing automation logic for automatically accessing, browsing and crawling web page data for the web page structure of each network platform to be purchased; integrating a product identification module and a data identification module in the automation logic so that the automation program can identify and extract the data of the products to be purchased online; configuring the automation script so that the automation script can automatically log in to the network platform to be purchased and navigate to the details page of the product to be purchased online.

[0010] In one implementation of the present application, based on an automated program, a network platform is accessed to identify and record data of commodities to be purchased online, specifically including: running an automated program to automatically access each network platform to be purchased through the automated program; identifying commodities to be purchased online in the pages of each network platform to be purchased through a commodity identification module; extracting commodity data to be purchased online through a data identification module for the identified commodities to be purchased online; storing the extracted commodity data to be purchased online in a preset database to complete the recording of the commodity data to be purchased online.

[0011] In one implementation of the present application, based on the data categories preset in the online price procurement table, the data of commodities to be purchased online are processed and calculated, specifically including: reading the data of commodities to be purchased online from a preset database; for each data of commodities to be purchased online, based on the data categories preset in the online price procurement table, cleaning, converting and normalizing the data to obtain standardized data of commodities to be purchased online; based on preset calculation rules, calculating and processing the standardized data of commodities to be purchased online to obtain standard data after processing and calculation; wherein the calculation and processing includes the actual payment price, discount details, and price increase and decrease range calculation; filling the processed and calculated standard data according to the structure of the online price procurement table to form an automated online procurement ledger.

[0012] In one implementation of the present application, the method also includes: monitoring and analyzing the data in the automated online procurement ledger, and automatically triggering an alarm mechanism when abnormal price fluctuations are detected or a preset warning threshold is reached; wherein the alarm mechanism includes but is not limited to sending emails, text message notifications, or in-system notifications to relevant managers.

[0013] In one implementation of the present application, the method also includes: generating various charts based on the data in the automated online procurement ledger, including but not limited to price trend charts, price comparison charts, and price increase and decrease charts; providing a user interaction interface, allowing users to query and browse various charts and data through the interaction interface.

[0014] In the second aspect, the embodiment of the present application also provides a CPI network price procurement device based on web page automation, characterized in that the device includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can: determine the categories of goods to be procured online and the corresponding network platforms to be procured based on preset network procurement survey requirements, and construct a network price procurement table based on the categories of goods to be procured online and the network platforms to be procured; develop an automation program based on a web page automation tool, and based on the automation program, access the network platforms to be procured to identify and record the data of goods to be procured online; based on the preset data categories in the network price procurement table, process and calculate the data of goods to be procured online, and fill the processed and calculated standard data into the network price procurement table to form an automated network procurement ledger.

[0015] On the third aspect, the embodiment of the present application also provides a non-volatile computer storage medium for CPI network price procurement based on web page automation, storing computer executable instructions, characterized in that the computer executable instructions are set to: based on preset online procurement survey requirements, determine the categories of goods to be procured online and the corresponding network platforms to be procured, and build a network price procurement table based on the categories of goods to be procured online and the network platforms to be procured; develop an automation program based on a web page automation tool, and based on the automation program, access the network platforms to be procured to identify and record the data of goods to be procured online; based on the preset data categories in the network price procurement table, process and calculate the data of goods to be procured online, and fill the processed and calculated standard data into the network price procurement table to form an automated online procurement ledger.

[0016] The CPI network pricing method, device and medium based on web page automation provided in the embodiments of the present application have the following beneficial effects:

[0017] 1. Improved the efficiency of CPI network price collection: Through web automation technology, it is possible to automatically access the network platform to be purchased, identify and record the data of the goods to be purchased online, avoiding the tedious manual operations in the traditional manual collection method, and greatly improving the efficiency of data collection.

[0018] 2. Reduced CPI network pricing costs: The operation of automated programs can significantly reduce manual participation, thereby reducing labor costs and time costs, making CPI network pricing more economical and efficient.

[0019] 3. Enhanced data accuracy and consistency: By structuring the online price list through preset data categories and performing standardized processing and calculation on online commodity data, it can ensure that the collected data has a unified format and quality standards, thereby improving the accuracy and consistency of the data.

[0020] 4. Real-time monitoring and early warning are achieved: By monitoring the data in the automated online procurement ledger and setting warning thresholds to trigger the alarm mechanism, abnormal price fluctuations can be discovered in a timely manner, providing timely market feedback to policymakers.

[0021] 5. Improved data visualization and interactivity: Generates various charts and provides a user interaction interface, allowing users to query and browse data intuitively, enhancing the readability and ease of use of data. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0023] Figure 1A flow chart of a CPI network pricing method based on web page automation provided in an embodiment of the present application;

[0024] Figure 2 A schematic diagram of the internal structure of a CPI network price collection device based on web page automation provided in an embodiment of the present application. DETAILED DESCRIPTION

[0025] In order to make the purpose, technical solution and advantages of the present application clearer, the technical solution of the present application will be clearly and completely described below in combination with the specific embodiments of the present application and the corresponding drawings. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present application.

[0026] The embodiments of the present application provide a CPI network price collection method, device and medium based on web page automation, which are used to solve the following technical problem: how to realize the automatic collection of CPI network prices based on web page automation technology.

[0027] The technical solution proposed in the embodiments of the present application is described in detail below with reference to the accompanying drawings.

[0028] Figure 1 A flow chart of a CPI network pricing method based on web page automation provided in the embodiment of the present application. Figure 1 As shown, the embodiment of the present application provides a CPI network pricing method based on web page automation, which specifically includes the following steps:

[0029] Step 101: Based on the preset online procurement survey requirements, determine the categories of goods to be purchased online and the corresponding online platforms to be purchased, and build an online procurement price list based on the categories of goods to be purchased online and the online platforms to be purchased.

[0030] In one embodiment of the present application, in order to realize CPI network price procurement based on web page automation, it is first necessary to determine the category of goods to be procured online and the corresponding network platform to be procured based on the preset online procurement survey requirements.

[0031] Specifically, based on the preset online procurement survey needs, determine the characteristic information on the basis of online procurement; wherein, the characteristic information on the basis of online procurement at least includes residents' consumption habits, consumption volume, and commodity price characteristics; based on the characteristic information on the basis of online procurement, determine the category of commodities to be purchased online in a preset commodity category library; based on the sales volume statistics of each commodity to be purchased online on all network platforms, determine the top several network platforms whose sum reaches a preset ratio as the network platforms to be purchased; wherein, the network platforms to be purchased include: e-commerce platforms, brand official websites, and government announcement websites.

[0032] In one embodiment, the "Operational Methods for Collecting Online Transaction Prices" issued by the National Bureau of Statistics can be referred to, and the shopping preferences, purchase frequencies, and channel choices of different consumer groups (such as age, gender, income level, etc.) can be collected through questionnaires, social media analysis, and other means to determine residents' consumption habits; by referring to historical sales data, industry reports, and government statistical data, the consumption share of various types of goods in the market is evaluated, especially those commodity categories that have a greater impact on CPI, to determine the consumption volume; by analyzing factors such as commodity price volatility, seasonal changes, and brand differences, the sensitive points and key points of price collection are determined to determine the price characteristics of commodities.

[0033] Furthermore, according to the characteristic information of online procurement, select the commodity categories that meet the current survey needs from the preset commodity category library (such as subcategories under major categories such as food, clothing, housing, transportation and communication). Taking into account the representativeness of CPI, priority is given to commodity categories with large consumption, frequent price fluctuations, and significant impact on residents' lives as key collection objects. Use crawler technology or third-party data services to collect sales data of each category of commodities to be collected on various online platforms (including e-commerce platforms, brand official websites, government announcement websites, etc.). Perform statistical analysis on the collected data, calculate the proportion of each online platform in the total sales volume, and add up the top several online platforms that reach the preset proportion (such as 80% or higher) as the online platforms to be collected. Ensure that the selected online platforms are widely representative and can cover different consumer groups and price ranges, while considering the availability and update frequency of data.

[0034] In one embodiment of the present application, after determining the categories of goods to be purchased online and the corresponding network platforms to be purchased, an online purchase price table is constructed based on the categories of goods to be purchased online and the network platforms to be purchased.

[0035] Specifically, based on the categories of goods to be purchased online and the network platform information of the network platform to be purchased, the structure of the network price table is designed; wherein the structure includes a product name column, a product code column, a network platform link column to be purchased, a price field column, and a price selection time column; the network price table is initialized to create a corresponding record row in the network price table for each product to be purchased online.

[0036] In one embodiment, the core information columns need to be determined first. Among them, the commodity name column is used to record the specific name of each commodity to be purchased online, ensuring the accuracy and standardization of the name, and facilitating subsequent data analysis and comparison; the commodity code column assigns a unique code to each commodity, facilitating the rapid location of specific commodities during data management and query; the network platform link column to be purchased stores the specific link of each commodity on the corresponding network platform to be purchased, ensuring the validity and stability of the link, so that the automated script can accurately access the commodity page; the price field column is used to record the commodity price information collected from the network platform, which is one of the core data of CPI network price collection; the price collection time column records the specific time of each price collection, including date and hour, minute and second, so as to facilitate the subsequent analysis of price fluctuations and time trends.

[0037] Furthermore, based on the above core information columns, design the header of the online price table, and clarify the name and data type of each column. Determine the storage format of the data, such as text, numbers, links, etc., to ensure the standardization and consistency of the data. Create a new blank table in the database or spreadsheet software, and set the column properties according to the designed header and data format. According to the number of products to be purchased online, reserve corresponding record rows for each product in the online price table.

[0038] Furthermore, fill the names of the products to be purchased online into the product name column one by one to ensure that each product name is accurate. Assign a unique code to each product and fill it into the product code column. Based on the information of the online platform to be purchased determined in the early stage, fill the link of each product on the corresponding platform into the link column of the online platform to be purchased.

[0039] Step 102: Develop an automation program based on a web automation tool, and based on the automation program, access the online platform to be purchased to identify and record the data of the products to be purchased online.

[0040] In one embodiment of the present application, after determining the categories of goods to be purchased online and the corresponding network platforms to be purchased, it is also necessary to develop an automation program based on web automation tools.

[0041] Specifically, according to the web page structure of each network platform to be purchased, write automated logic for automatically accessing, browsing and crawling web page data; integrate product identification module and data identification module into the automated logic so that the automated program can identify and extract product data to be purchased online; configure automated scripts so that the automated scripts can automatically log in to the network platform to be purchased and navigate to the details page of the product to be purchased online.

[0042] In one embodiment, for the web page structure of each network platform to be adopted, it is first necessary to analyze the page layout, element positioning and data loading method of each platform. Based on this information, write automation logic to realize the functions of automatic access, browsing and crawling web page data. Specifically, web page automation tools such as Selenium and Puppeteer can be used in combination with the API interface provided by the platform to realize operations such as automatic opening of pages, element positioning, and data crawling.

[0043] Furthermore, integrating the product identification module and the data identification module into the automation logic is a key step. The product identification module is responsible for identifying the products to be purchased online from the page, which is usually achieved by matching information such as product name, code or picture. The data identification module is responsible for extracting the required price data from the identified product details page. These two modules may need to combine regular expressions, XPath, CSS selectors and other technologies to accurately locate and extract data.

[0044] Furthermore, an automated script is configured to automatically log in to the online platform to be purchased and navigate to the details page of the product to be purchased. This usually involves simulating user login operations, including entering a username and password and handling redirection after login. Once the login is successful, the script will automatically navigate to the details page of the product to be purchased for subsequent data collection.

[0045] In one embodiment of the present application, after developing an automation program based on a web automation tool, the network platform to be purchased is accessed based on the automation program to identify and record the data of the goods to be purchased online.

[0046] Specifically, an automated program is run to automatically access each network platform to be purchased; the commodities to be purchased are identified in the pages of each network platform to be purchased through a commodity identification module; for the identified commodities to be purchased, the data of the commodities to be purchased are extracted through a data identification module; the extracted data of the commodities to be purchased are stored in a preset database to complete the recording of the data of the commodities to be purchased.

[0047] In one embodiment, after the automation program is started, the browser will be automatically opened according to the preset logic, and the website of each network platform to be purchased will be visited one by one. During the access process, the program will simulate the user's browsing behavior, such as scrolling pages, clicking links, etc., to ensure that the complete product information can be loaded and displayed. Then, the product identification module comes into play. The module scans the content of the current page and identifies the products to be purchased online by matching the product name, code or other feature information. Once the target product is identified, the program will record the location information of the product for subsequent operations. Then, the data identification module further processes the identified products to be purchased online. The module will locate the price information part in the product details page and extract the specific price value. At the same time, in order to ensure the integrity and accuracy of the data, the program will also extract other relevant information of the product, such as promotion information, inventory status, etc. Finally, the extracted data of the products to be purchased online is stored in a preset database. During the storage process, the program will organize the data into a standardized format according to the structure of the network price table, and ensure that each record contains complete product information and price timestamp. In this way, these data can be easily queried, analyzed and compared later to support the calculation and release of CPI.

[0048] Step 103: Based on the data categories preset in the online price table, the commodity data to be purchased online is processed and calculated, and the processed and calculated standard data is filled into the online price table to form an automated online purchase ledger.

[0049] In one embodiment of the present application, after constructing an online price list and accessing the online platform for procurement based on an automated program to identify and record the data of the goods to be procured online, the data of the goods to be procured online are processed and calculated based on the data categories preset in the online price list.

[0050] Specifically, the data of commodities to be purchased online are read from a preset database; for each data of commodities to be purchased online, based on the data categories preset in the online price table, the data are cleaned, converted and normalized to obtain standardized data of commodities to be purchased online; based on preset calculation rules, the standardized data of commodities to be purchased online are calculated to obtain standard data after processing and calculation; wherein the calculation processing includes the actual payment price, discount details, and price increase and decrease calculation; the standard data after processing and calculation are filled in according to the structure of the online price table to form an automated online purchase ledger.

[0051] In one embodiment, first, the previously stored data of goods to be purchased online is read from a preset database. These data may include the original price, promotional price, coupon information, purchase quantity, etc. of the goods. Next, for each piece of data of goods to be purchased online, data cleaning is performed according to the data categories preset in the network price table (such as price, discount, quantity, etc.). During the cleaning process, duplicate, invalid or erroneous data will be removed to ensure the accuracy and validity of the data. At the same time, necessary conversions are performed on the data, such as converting price data into the same currency unit and converting date data into a unified format. In addition, the data will be normalized to eliminate the impact of different data sources or different dimensions on data analysis and comparison. After completing data cleaning, conversion and normalization, standardized data of goods to be purchased online will be obtained. At this time, based on the preset calculation rules, these standardized data are further calculated and processed. The specific contents of the calculation and processing may include the calculation of the actual payment price (the actual payment price after considering various discounts and discounts), the arrangement of discount details (such as the specific amount and proportion of coupons, discounts, discounts and other preferential activities) and the calculation of price fluctuations (the increase or decrease ratio of commodity prices compared with the last price collection). Finally, the processed and calculated standard data is filled in according to the structure of the network price collection table. Specifically, the calculation results such as the actual payment price, discount details, price increase and decrease range are filled in the corresponding columns of the network price collection table, while retaining the basic information such as the name, code, network platform link and price collection time of the product. In this way, a complete and standardized automated network procurement ledger is formed, which provides accurate and efficient data support for subsequent data analysis, price monitoring and CPI calculation.

[0052] In one embodiment of the present application, after filling the processed and calculated standard data into the network price table to form an automated network procurement ledger, the method also includes: monitoring and analyzing the data in the automated network procurement ledger, and automatically triggering an alarm mechanism when abnormal price fluctuations are detected or when a preset warning threshold is reached; wherein the alarm mechanism includes but is not limited to sending emails, text message notifications, or in-system notifications to relevant managers.

[0053] In one embodiment of the present application, the method also includes: generating various charts based on the data in the automated online procurement ledger, including but not limited to price trend charts, price comparison charts, and price increase and decrease charts; providing a user interaction interface to allow users to query and browse various charts and data through the interaction interface.

[0054] The above is an embodiment of the method proposed in this application. Based on the same inventive concept, this application embodiment also provides a CPI network price collection device based on web page automation, and its structure is as follows: Figure 2 shown.

[0055] Figure 2The internal structure diagram of a CPI network price collection device based on web page automation provided in the embodiment of the present application is as follows. Figure 2 As shown, the device includes:

[0056] at least one processor 201;

[0057] and, a memory 202 communicatively connected to the at least one processor;

[0058] The memory 202 stores instructions that can be executed by at least one processor, and the instructions are executed by at least one processor 201 to enable at least one processor 201 to:

[0059] Based on the preset online procurement survey needs, determine the categories of goods to be purchased online and the corresponding online platforms to be purchased, and build an online procurement price list based on the categories of goods to be purchased online and the online platforms to be purchased;

[0060] Develop an automated program based on web automation tools, and based on the automated program, access the online platform to be purchased to identify and record the data of the products to be purchased online;

[0061] Based on the preset data categories in the online price table, the data of the online purchased commodities are processed and calculated, and the processed and calculated standard data are filled into the online price table to form an automated online purchase ledger.

[0062] Some embodiments of the present application provide corresponding Figure 1 A non-volatile computer storage medium for CPI network price collection based on web page automation, storing computer executable instructions, wherein the computer executable instructions are set as follows:

[0063] Based on the preset online procurement survey needs, determine the categories of goods to be purchased online and the corresponding online platforms to be purchased, and build an online procurement price list based on the categories of goods to be purchased online and the online platforms to be purchased;

[0064] Develop an automated program based on web automation tools, and based on the automated program, access the online platform to be purchased to identify and record the data of the products to be purchased online;

[0065] Based on the preset data categories in the online price table, the data of the online purchased commodities are processed and calculated, and the processed and calculated standard data are filled into the online price table to form an automated online purchase ledger.

[0066] Each embodiment in this application is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the IoT device and medium embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiments.

[0067] The system and medium provided in the embodiments of the present application correspond one-to-one to the method. Therefore, the system and medium also have similar beneficial technical effects to the corresponding methods. Since the beneficial technical effects of the methods have been described in detail above, the beneficial technical effects of the system and medium will not be repeated here.

[0068] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0069] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0070] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0071] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable device. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0072] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0073] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.

[0074] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.

[0075] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0076] The above is only an embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. A CPI network pricing method based on web page automation, characterized in that: The method comprises: Based on the preset online procurement survey requirements, determine the categories of goods to be purchased online and the corresponding online platforms to be purchased, and build an online procurement price list based on the categories of goods to be purchased online and the online platforms to be purchased; Developing an automated program based on a web automation tool, and based on the automated program, accessing the online platform to be purchased to identify and record the data of the commodities to be purchased online; Based on the data categories preset in the online price procurement table, the data of the commodities to be procured online are processed and calculated, and the processed and calculated standard data are filled into the online price procurement table to form an automated online procurement ledger.

2. According to claim 1, a CPI network pricing method based on web page automation is characterized in that: Based on the preset online procurement survey requirements, determine the categories of goods to be purchased online and the corresponding online platforms to be purchased, including: Based on the preset online purchase survey requirements, determine the online purchase basis characteristic information; wherein the online purchase basis characteristic information at least includes residents' consumption habits, consumption volume, and commodity price characteristics; Based on the online purchase basis characteristic information, determining the category of the commodity to be purchased online in a preset commodity category library; Based on the sales volume statistics of each commodity to be purchased online on all online platforms, the first several online platforms whose sum reaches a preset ratio are determined as the online platforms to be purchased; wherein, the online platforms to be purchased include: e-commerce platforms, brand official websites, and government announcement websites.

3. The CPI network pricing method based on web page automation according to claim 1 is characterized in that: Based on the categories of commodities to be purchased online and the network platforms to be purchased, a network purchase price table is constructed, which specifically includes: Based on the categories of the commodities to be purchased online and the network platform information of the network platform to be purchased, the structure of the network price table is designed; wherein the structure includes a commodity name column, a commodity code column, a link column of the network platform to be purchased, a price field column, and a price purchase time column; Initialize the network price table to create a corresponding record row in the network price table for each commodity to be purchased online.

4. The CPI network pricing method based on web page automation according to claim 1 is characterized in that: Develop automated programs based on web automation tools, including: According to the web page structure of each network platform to be collected, write the automation logic of automatic access, browsing and crawling web page data; Integrate a commodity identification module and a data identification module into the automation logic so that the automation program can identify and extract the commodity data to be purchased online; The automation script is configured so that the automation script can automatically log in to the network platform to be purchased and navigate to the details page of the product to be purchased online.

5. The CPI network pricing method based on web page automation according to claim 4 is characterized in that: Based on the automated program, access the network platform to identify and record the data of the products to be purchased online, including: Running the automation program to automatically access each network platform to be purchased through the automation program; Identify the commodities to be purchased online on the pages of each network platform to be purchased through the commodity identification module; For the identified products to be purchased online, extract the data of the products to be purchased online through the data recognition module; The extracted data of commodities to be purchased online are stored in a preset database to complete the recording of the data of commodities to be purchased online.

6. The CPI network pricing method based on web page automation according to claim 5 is characterized in that: Based on the data categories preset in the online price table, the data of the commodities to be purchased online are processed and calculated, specifically including: Read the data of the products to be purchased online from the preset database; For each commodity data to be purchased online, based on the data categories preset in the online price table, the data is cleaned, converted and normalized to obtain standardized commodity data to be purchased online; Based on the preset calculation rules, the standardized data of the commodities to be purchased online are calculated and processed to obtain the standard data after the processing and calculation; wherein the calculation and processing includes the calculation of the actual payment price, the discount details, and the price increase and decrease range; The processed and calculated standard data is filled in according to the structure of the network price table to form an automated network purchase ledger.

7. The CPI network pricing method based on web page automation according to claim 1 is characterized in that: The method further comprises: Monitor and analyze the data in the automated online procurement ledger, and automatically trigger an alarm mechanism when abnormal price fluctuations or reaching a preset warning threshold are detected; The alarm mechanism includes but is not limited to sending emails, text messages or in-system notifications to relevant managers.

8. The CPI network pricing method based on web page automation according to claim 1 is characterized in that: The method further comprises: Generate various charts based on the data in the automated online ledger, including but not limited to price trend charts, price comparison charts, and price increase and decrease charts; Provide a user interaction interface, allowing users to query and browse various charts and data through the interaction interface.

9. A CPI network price collection device based on web page automation, characterized in that: The device comprises: at least one processor; and, a memory communicatively coupled to the at least one processor; The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to: Based on the preset online procurement survey requirements, determine the categories of goods to be purchased online and the corresponding online platforms to be purchased, and build an online procurement price list based on the categories of goods to be purchased online and the online platforms to be purchased; Developing an automated program based on a web automation tool, and based on the automated program, accessing the online platform to be purchased to identify and record the data of the commodities to be purchased online; Based on the data categories preset in the online price procurement table, the data of the commodities to be procured online are processed and calculated, and the processed and calculated standard data are filled into the online price procurement table to form an automated online procurement ledger.

10. A non-volatile computer storage medium for CPI network price collection based on web page automation, storing computer executable instructions, characterized in that: The computer executable instructions are configured to: Based on the preset online procurement survey requirements, determine the categories of goods to be purchased online and the corresponding online platforms to be purchased, and build an online procurement price list based on the categories of goods to be purchased online and the online platforms to be purchased; Developing an automated program based on a web automation tool, and based on the automated program, accessing the online platform to be purchased to identify and record the data of the commodities to be purchased online; Based on the data categories preset in the online price procurement table, the data of the commodities to be procured online are processed and calculated, and the processed and calculated standard data are filled into the online price procurement table to form an automated online procurement ledger.

Images