Internet online sales data intelligent screening and management system

Abstract

The present invention discloses an intelligent screening and management system for Internet online sales data, and specifically relates to the technical field of data management. By comprehensively analyzing the volatility of data transmission rate under different collection modes of the intelligent screening and management system for Internet online sales data and the difference of sales data from different data sources, a data screening timeliness impact index is used to reflect the impact of the volatility of transmission rate and the difference of sales data from different data sources on the timeliness of data screening of the intelligent screening and management system for Internet online sales data, and the degree of impact is perceived in time. When the impact continues to expand, a pre-regulation signal is generated in time, and the established data screening strategy is adjusted to ensure that the data screening of the intelligent screening and management system for Internet online sales data can adapt to the ever-changing data environment and identify abnormal sales behavior.

Description

Technical Field

[0001] The present invention relates to the technical field of data management, and more specifically, to an intelligent screening and management system for online sales data on the Internet. Background Art

[0002] With the rapid development of Internet technology, online sales have become an important part of the retail industry. The Internet online sales data intelligent screening and management system collects, cleans and analyzes sales data from data sources such as e-commerce platforms, payment systems, and CRM systems through API interfaces and log files. It also uses artificial intelligence technology to screen data and identify abnormal sales behaviors, providing companies with more critical sales information, improving sales efficiency, and optimizing operations.

[0003] Since the Internet online sales data intelligent screening and management system needs to collect sales data from different data sources using different methods, and due to the different implementation complexities of different collection methods and inconsistent data transmission efficiency, there may be large differences in sales data samples collected by different collection methods. If the established data screening strategy is adopted, the real-time performance of data screening may be reduced, and abnormal sales behavior may not be identified in a timely manner, causing the company to miss the best time to adjust.

[0004] In order to solve the above defects, a technical solution is now provided. Summary of the invention

[0005] In order to overcome the above-mentioned defects of the prior art, an embodiment of the present invention provides an Internet online sales data intelligent screening and management system to solve the problems raised in the above-mentioned background technology.

[0006] To achieve the above object, the present invention provides the following technical solutions:

[0007] The intelligent screening and management system for online sales data on the Internet includes a data collection module, a data processing module, a verification and analysis module, and an early warning module, and each module is connected through signals;

[0008] The data collection module collects the transmission efficiency information and sales data sample difference information when the Internet online sales data intelligent screening management system collects sales data from different data sources, and after the collection, transmits the transmission efficiency information and sales data sample difference information to the data processing module;

[0009] The data processing module normalizes the acquired multi-source transmission rate abnormal fluctuation coefficient and sales data sample difference dispersion coefficient, builds a data processing model, and generates a data screening timeliness impact index;

[0010] The verification and analysis module compares the data screening timeliness impact index with the preset data screening timeliness impact index threshold to determine whether a risk signal is generated;

[0011] The early warning module is used to monitor the risk signal generation information of the verification analysis module in real time. When a risk signal is generated, it obtains the data screening timeliness impact index at the corresponding moment, establishes a data screening timeliness impact index analysis set, and performs a secondary analysis on the data screening timeliness impact index in the set to determine whether to generate a data screening strategy pre-control signal.

[0012] In a preferred embodiment, the transmission efficiency information includes the multi-source transmission rate abnormal fluctuation coefficient, and the sales data sample difference information includes the sales data sample difference degree dispersion coefficient;

[0013] The multi-source transmission rate abnormal fluctuation coefficient and the sales data sample difference dispersion coefficient are marked as .

[0014] In a preferred embodiment, the logic for obtaining the abnormal fluctuation coefficient of multi-source transmission rate is as follows:

[0015] Obtain the data transmission rate of the Internet online sales data intelligent screening management system during data collection within the T period and mark it , i represents the sequence number of multiple monitoring points preset in the T period, i={1,2,...,n}, n represents a positive integer;

[0016] The data transmission rates of the intelligent screening management system for online sales data obtained in the T period are screened out as those that exceed the optimal data transmission rate range, and are marked as abnormal data transmission rates. , j represents the order number of the abnormal data transmission rate within the T period, j={1,2,...,m}, where ;

[0017] The abnormal fluctuation coefficient of multi-source transmission rate is calculated based on the abnormal data transmission rate. The expression is as follows .

[0018] In a preferred embodiment, the logic for obtaining the sales data sample difference dispersion coefficient is as follows:

[0019] Get the sales data samples collected by the intelligent screening management system for online Internet sales data from different data sources within the T period, perform ratio calculations on the sales volume at different time points and the total sales volume within the T period, calculate the probability of sales data at different time points, use the KL divergence method to calculate the difference between sales data samples from different data sources, and obtain the sales data sample difference set, which is marked as , and calculate the average sales data sample difference based on the difference between sales data samples from different data sources in the set. The expression is as follows , the sales data sample difference dispersion coefficient is calculated according to the sales data sample difference average value, and its expression is as follows .

[0020] In a preferred embodiment, the data screening timeliness impact index is calculated based on the weighted sum of the abnormal fluctuation coefficient of the multi-source transmission rate and the dispersion coefficient of the sales data sample difference.

[0021] In a preferred embodiment, the data screening timeliness impact index is compared with a preset data screening timeliness impact index threshold to determine whether to generate a risk signal. If the data screening timeliness impact index is greater than or equal to the data screening timeliness impact index threshold, a risk signal is generated; if the data screening timeliness impact index is less than the data screening timeliness impact index threshold, a stable signal is generated.

[0022] In a preferred embodiment, when a risk signal is generated, the data screening timeliness impact index at the corresponding moment is obtained, and a data screening timeliness impact index analysis set is established and marked as , x represents the order number of different data screening timeliness impact indexes, x={1,2,...,s}, s is a positive integer; calculate the outlier value of the data screening timeliness impact index numbered s, and its expression is as follows ,in It represents the average value of the existing data screening timeliness impact index in the data screening timeliness impact index analysis set. Represents the standard deviation of the existing data screening timeliness impact index in the data screening timeliness impact index analysis set.

[0023] In a preferred embodiment, the outlier value of the data screening timeliness impact index is compared with a preset outlier threshold. If the outlier value of the data screening timeliness impact index is greater than or equal to the outlier threshold, a pre-regulation signal is generated; if the outlier value of the data screening timeliness impact index is less than the outlier threshold, no pre-regulation signal is generated.

[0024] Technical effects and advantages of the present invention:

[0025] 1. The present invention conducts a comprehensive analysis on the volatility of data transmission rate under different collection modes of the Internet online sales data intelligent screening management system and the differences in sales data from different data sources, and uses the data screening timeliness impact index to reflect the impact of the volatility of transmission rate and the differences in sales data from different data sources on the timeliness of data screening of the Internet online sales data intelligent screening management system, so as to timely perceive the degree of impact, and when the impact continues to expand, timely generate pre-control signals, adjust the established data screening strategies, and ensure that the data screening of the Internet online sales data intelligent screening management system can adapt to the ever-changing data environment and identify abnormal sales behaviors. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to facilitate understanding by those skilled in the art, the present invention is further described below in conjunction with the accompanying drawings;

[0027] Figure 1 Schematic diagram of the structure of the system of the embodiment of the present invention. DETAILED DESCRIPTION

[0028] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0029] Example

[0030] The present invention provides Figure 1 The Internet online sales data intelligent screening and management system shown includes a data collection module, a data processing module, a verification and analysis module, and an early warning module, and each module is connected through signals;

[0031] The data collection module collects the transmission efficiency information and sales data sample difference information when the Internet online sales data intelligent screening management system collects sales data from different data sources, and after the collection, transmits the transmission efficiency information and sales data sample difference information to the data processing module;

[0032] The transmission efficiency information includes the multi-source transmission rate abnormal fluctuation coefficient, and the sales data sample difference information includes the sales data sample difference dispersion coefficient. After collection, the data collection module marks the multi-source transmission rate abnormal fluctuation coefficient and the sales data sample difference dispersion coefficient as ;

[0033] Abnormal fluctuations in the transmission rate when collecting sales data under different data collection methods may have the following impacts on the sales data analysis of the Internet online sales data intelligent screening management system:

[0034] Reduced real-time performance: Abnormal fluctuations in transmission rate may lead to instability in data transmission, which in turn affects the real-time analysis of sales data by the Internet online sales data intelligent screening management system. Real-time performance is critical for rapid decision-making and market response, so the instability of transmission rate may lead to delays in analysis results;

[0035] Decreased data consistency: Abnormal fluctuations in transmission rate may lead to data packet loss or out-of-order transmission, which in turn affects data consistency. If problems occur during data transmission, some sales data may be missing or incorrect, affecting the accurate analysis of the overall sales situation by the Internet online sales data intelligent screening management system;

[0036] Data quality issues: Abnormal fluctuations in transmission rate may cause data to be truncated or damaged during transmission, thereby reducing the quality of the data. For the Internet online sales data intelligent screening and management system, accurate sales data is the key, so abnormal transmission rate may have a negative impact on the integrity and accuracy of the data.

[0037] Degraded performance of the screening algorithm: Abnormal fluctuations in transmission rates may make it difficult for the Internet online sales data intelligent screening management system to cope with changes in transmission rates of different data sources, affecting the performance of the intelligent screening algorithm. The Internet online sales data intelligent screening management system may need to adjust algorithm parameters or adopt more flexible strategies based on fluctuations in transmission rates to maintain efficient data screening capabilities.

[0038] The logic for obtaining the abnormal fluctuation coefficient of multi-source transmission rate is as follows:

[0039] Obtain the data transmission rate of the Internet online sales data intelligent screening management system during data collection within the T period and mark it , i represents the sequence number of multiple monitoring points preset in the T period, i={1,2,...,n}, n represents a positive integer;

[0040] It should be noted that the data transmission rate of the Internet online sales data intelligent screening management system during data collection can be obtained in real time by using professional performance monitoring tools such as top, Prometheus, Grafana, etc. These tools can provide detailed information about the data transmission rate;

[0041] The data transmission rates of the intelligent screening management system for online sales data obtained in the T period are screened out as those that exceed the optimal data transmission rate range, and are marked as abnormal data transmission rates. , j represents the order number of the abnormal data transmission rate within the T period, j={1,2,...,m}, ;

[0042] The abnormal fluctuation coefficient of multi-source transmission rate is calculated based on the abnormal data transmission rate. The expression is as follows ;

[0043] From the above calculation, it can be known that the higher the abnormal fluctuation coefficient of the multi-source transmission rate is, the greater the influence of the abnormal fluctuation of the transmission rate when collecting sales data under different data collection methods on the sales data analysis of the Internet online sales data intelligent screening management system is, and the worse the timeliness of data screening of the Internet online sales data intelligent screening management system is; conversely, it indicates that the smaller the influence of the abnormal fluctuation of the transmission rate when collecting sales data under different data collection methods on the sales data analysis of the Internet online sales data intelligent screening management system is, the better the timeliness of data screening of the Internet online sales data intelligent screening management system is;

[0044] The differences in sales data samples collected from different data sources may have the following impacts on the sales data analysis of the Internet online sales data intelligent screening management system:

[0045] Bias in analysis results: Differences in sales data samples collected from different data sources may cause the Internet online sales data intelligent screening and management system to have bias in its analysis results for certain specific markets, products or user groups. The Internet online sales data intelligent screening and management system may be more inclined to reflect the situation of a certain data source and ignore changes in other data sources.

[0046] Misleading decision-making: If the sales data sample of a certain data source is significantly different from that of other data sources, the decision of the Internet online sales data intelligent screening and management system may be affected by the data source, resulting in inaccurate decisions, which may have a negative impact on decisions in inventory management, marketing promotion, etc.

[0047] Inconsistent sales trends: Different data sources may show different sales trends, causing the Internet online sales data intelligent screening and management system to misjudge market trends, which may lead to companies formulating unreasonable sales strategies and affect performance and competitiveness.

[0048] Data consistency issues: Differences in sales data samples from different data sources may lead to difficulties in data integration, affecting the Internet online sales data intelligent screening management system's accurate grasp of the overall sales situation, which may cause problems for integrated analysis and report generation.

[0049] The logic for obtaining the dispersion coefficient of sales data sample difference is as follows:

[0050] Get the sales data samples collected by the intelligent screening management system for online Internet sales data from different data sources within the T period, perform ratio calculations on the sales volume at different time points and the total sales volume within the T period, calculate the probability of sales data at different time points, use the KL divergence method to calculate the difference between sales data samples from different data sources, and obtain the sales data sample difference set, which is marked as , and calculate the average sales data sample difference based on the difference between sales data samples from different data sources in the set. The expression is as follows , the sales data sample difference dispersion coefficient is calculated according to the sales data sample difference average value, and its expression is as follows ;

[0051] In an optional example, the KL divergence method is used to calculate the difference between sales data samples from different data sources. Assume that there are two data sources A and B, and the probability sets of sales data collected by A and B are expressed as and ,in and They represent the sales data probabilities of the two data sources at the uth time point, u={1,2,...,v}, v is a positive integer; the KL divergence method is used to calculate the difference between the sales data samples of data sources A and B, and its expression is as follows ;

[0052] From the above calculation, it can be known that the higher the dispersion coefficient of the sales data sample difference, the greater the impact of the difference of sales data samples collected by different data sources on the sales data analysis of the Internet online sales data intelligent screening management system, and the worse the timeliness of data screening of the Internet online sales data intelligent screening management system; conversely, it indicates that the abnormal fluctuation of the transmission rate when collecting sales data under different data collection methods has a smaller impact on the sales data analysis of the Internet online sales data intelligent screening management system, and the better the timeliness of data screening of the Internet online sales data intelligent screening management system;

[0053] The data processing module normalizes the acquired multi-source transmission rate abnormal fluctuation coefficient and sales data sample difference dispersion coefficient, builds a data processing model, generates a data screening timeliness impact index, and marks it as , which is expressed as follows , where are the preset proportional coefficients of the abnormal fluctuation coefficient of multi-source transmission rate and the dispersion coefficient of sales data sample difference, respectively, and ;

[0054] The data processing module transmits the generated data screening timeliness impact index to the verification and analysis module;

[0055] The verification and analysis module compares the data screening timeliness impact index with the preset data screening timeliness impact index threshold to determine whether to generate a risk signal. If the data screening timeliness impact index is greater than or equal to the data screening timeliness impact index threshold, it indicates that the abnormal fluctuation of the transmission rate and the difference of the sales data samples have a greater impact on the timeliness of data screening of the Internet online sales data intelligent screening management system, and a risk signal is generated; if the data screening timeliness impact index is less than the data screening timeliness impact index threshold, it indicates that the abnormal fluctuation of the transmission rate and the difference of the sales data samples have a smaller impact on the timeliness of data screening of the Internet online sales data intelligent screening management system, and a stable signal is generated;

[0056] The early warning module is used to monitor the risk signal generation information of the verification analysis module in real time. When a risk signal is generated, the data screening timeliness impact index at the corresponding moment is obtained, and a data screening timeliness impact index analysis set is established and marked as , x represents the order number of different data screening timeliness impact indexes, x={1,2,...,s}, s is a positive integer; calculate the outlier value of the data screening timeliness impact index numbered s, and its expression is as follows ,in It represents the average value of the existing data screening timeliness impact index in the data screening timeliness impact index analysis set. Indicates the standard deviation of the existing data screening timeliness impact index in the data screening timeliness impact index analysis set;

[0057] The outlier value of the data screening timeliness impact index is compared with the preset outlier threshold value. If the outlier value of the data screening timeliness impact index is greater than or equal to the outlier threshold value, a pre-regulation signal is generated, indicating that the influence of abnormal fluctuations in the transmission rate and the differences in sales data samples on the timeliness of data screening of the Internet online sales data intelligent screening management system is continuously increasing, and the established data screening strategy needs to be adjusted in time; if the outlier value of the data screening timeliness impact index is less than the outlier threshold value, no pre-regulation signal is generated, indicating that the current risk signal is accidental, that is, the influence of abnormal fluctuations in the transmission rate and the differences in sales data samples on the timeliness of data screening of the Internet online sales data intelligent screening management system is accidental;

[0058] The present invention conducts a comprehensive analysis on the volatility of data transmission rate under different collection modes of the Internet online sales data intelligent screening management system and the difference of sales data from different data sources, and uses the data screening timeliness impact index to reflect the impact of the volatility of transmission rate and the difference of sales data from different data sources on the timeliness of data screening of the Internet online sales data intelligent screening management system, timely perceives the degree of its impact, and when its impact continues to expand, timely generates a pre-control signal to adjust the established data screening strategy, so as to ensure that the data screening of the Internet online sales data intelligent screening management system can adapt to the ever-changing data environment and identify abnormal sales behavior.

[0059] The above formulas are all dimensionless and numerical calculations. The formula is a formula for the most recent real situation obtained by collecting a large amount of data and performing software simulation. The preset parameters in the formula are set by technicians in this field according to actual conditions.

[0060] The above embodiments can be implemented in whole or in part by software, hardware, firmware or any other combination. When implemented by software, the above embodiments can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions or computer programs. When the computer instructions or computer programs are loaded or executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website site, computer, server or data center to another website site, computer, server or data center by wired or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that contains one or more available media sets. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium. The semiconductor medium can be a solid-state hard disk.

[0061] It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0062] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0063] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0064] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage media include: various media that can store program codes, such as USB flash drives, mobile hard disks, read-only memories (ROM), random access memories (RAM), magnetic disks or optical disks.

[0065] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. Internet online sales data intelligent screening and management system, characterized by: It includes data acquisition module, data processing module, verification and analysis module and early warning module, and each module is connected by signals; The data collection module collects the transmission efficiency information and sales data sample difference information when the Internet online sales data intelligent screening management system collects sales data from different data sources, and after the collection, transmits the transmission efficiency information and sales data sample difference information to the data processing module; The transmission efficiency information includes the abnormal fluctuation coefficient of multi-source transmission rate, and the sales data sample difference information includes the sales data sample difference dispersion coefficient; The multi-source transmission rate abnormal fluctuation coefficient and the sales data sample difference dispersion coefficient are marked as ; The logic for obtaining the abnormal fluctuation coefficient of multi-source transmission rate is as follows: Obtain the data transmission rate of the Internet online sales data intelligent screening management system during data collection within the T period and mark it , i represents the sequence number of multiple monitoring points preset in the T period, i={1,2,...,n}, n represents a positive integer; The data transmission rates of the intelligent screening management system for online sales data obtained in the T period are screened out as those that exceed the optimal data transmission rate range, and are marked as abnormal data transmission rates. , j represents the order number of the abnormal data transmission rate within the T period, j={1,2,...,m}, where ; The abnormal fluctuation coefficient of multi-source transmission rate is calculated based on the abnormal data transmission rate. The expression is as follows ; The logic for obtaining the dispersion coefficient of sales data sample difference is as follows: Get the sales data samples collected by the intelligent screening management system for online Internet sales data from different data sources within the T period, perform ratio calculations on the sales volume at different time points and the total sales volume within the T period, calculate the probability of sales data at different time points, use the KL divergence method to calculate the difference between sales data samples from different data sources, and obtain the sales data sample difference set, which is marked as , and calculate the average sales data sample difference based on the difference between sales data samples from different data sources in the set. The expression is as follows , the sales data sample difference dispersion coefficient is calculated according to the sales data sample difference average value, and its expression is as follows ; The data processing module normalizes the acquired multi-source transmission rate abnormal fluctuation coefficient and sales data sample difference dispersion coefficient, builds a data processing model, and generates a data screening timeliness impact index; The verification and analysis module compares the data screening timeliness impact index with the preset data screening timeliness impact index threshold to determine whether a risk signal is generated; The early warning module is used to monitor the risk signal generation information of the verification analysis module in real time. When a risk signal is generated, it obtains the data screening timeliness impact index at the corresponding moment, establishes a data screening timeliness impact index analysis set, and performs a secondary analysis on the data screening timeliness impact index in the set to determine whether to generate a data screening strategy pre-control signal.

2. The intelligent screening and management system for online sales data on the Internet according to claim 1, characterized in that: The data screening timeliness impact index is calculated based on the weighted sum of the abnormal fluctuation coefficient of multi-source transmission rate and the dispersion coefficient of sales data sample differences.

3. The intelligent screening and management system for online sales data on the Internet according to claim 2, characterized in that: The data screening timeliness impact index is compared with the preset data screening timeliness impact index threshold to determine whether to generate a risk signal. If the data screening timeliness impact index is greater than or equal to the data screening timeliness impact index threshold, a risk signal is generated; if the data screening timeliness impact index is less than the data screening timeliness impact index threshold, a stable signal is generated.

4. The intelligent screening and management system for online sales data on the Internet according to claim 3 is characterized by: When a risk signal is generated, obtain the data screening timeliness impact index at the corresponding moment, establish a data screening timeliness impact index analysis set, and mark it as , x represents the order number of different data screening timeliness impact indexes, x={1,2,...,s}, s is a positive integer; calculate the outlier value of the data screening timeliness impact index numbered s, and its expression is as follows ,in It represents the average value of the existing data screening timeliness impact index in the data screening timeliness impact index analysis set. Represents the standard deviation of the existing data screening timeliness impact index in the data screening timeliness impact index analysis set.

5. The intelligent screening and management system for online sales data on the Internet according to claim 4, characterized in that: The outlier value of the data screening timeliness impact index is compared with the preset outlier threshold. If the outlier value of the data screening timeliness impact index is greater than or equal to the outlier threshold, a pre-control signal is generated; if the outlier value of the data screening timeliness impact index is less than the outlier threshold, no pre-control signal is generated.

Images