List data processing method and system and storage medium
By using multiple preset name intercepting logic in list data processing to intercept the to-process list and uniformly read the associated data at the core logic, the problems of resource waste and efficiency reduction in the existing technology are solved, and efficient list data processing and marketing effects are maximized.
Patent Information
- Application Number
- CN202411656371.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-19
- Publication Date
- 2025-03-11
AI Technical Summary
The existing marketing list processing architecture requires repeated reading of data in batches during processing, resulting in waste of resources and reduced efficiency.
The to bet list is intercepted through multiple preset list intercept logic, and the associated data is read uniformly at the core logic to avoid reading data in batches.
It effectively avoids resource waste and efficiency reduction, significantly improves the timeliness and efficiency of list data processing, and ensures the effective utilization of marketing resources and maximizes marketing effects.
Smart Images

Figure CN119597807A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of data processing technology, and in particular to a list data processing method, system and storage medium. Background Art
[0002] In today's large-scale retail customer marketing, companies are facing unprecedented challenges. Limited by limited channel costs and opportunity costs, companies must ensure that the resources and timeliness required for marketing activities are met while keeping up with the increasingly rich and differentiated marketing trends in the market. This background places extremely high demands on the core marketing optimization algorithms of current marketing platforms, and data processing of marketing lists has become a key link in this process.
[0003] Conventional marketing list processing architectures usually adopt a decentralized processing approach, which is to break down complex business logic into multiple independent intermediate computing units and deploy these units to execute at different stages of data flow. This design was originally intended to improve the flexibility and scalability of the system. However, in actual operation, each computing unit needs to repeatedly read data in batches during the processing process, resulting in a large amount of resource waste.
[0004] The above contents are only used to assist in understanding the technical solution of the present application and do not constitute an admission that the above contents are prior art. Summary of the invention
[0005] The main purpose of this application is to provide a list data processing method, system and storage medium, aiming to avoid waste of resources in the list data processing process and improve processing efficiency.
[0006] To achieve the above purpose, the present application embodiment proposes a method for processing list data, the method comprising:
[0007] According to a plurality of preset list interception logics, the list to be processed is intercepted and processed, wherein the associated data not included in the list to be processed and used for interception processing by each list interception logic is read when the list to be processed is intercepted and processed by the core logic in each list interception logic;
[0008] Generate a distribution list based on the interception processing results;
[0009] Send preset marketing content to the target customers included in the distribution list.
[0010] In one embodiment, before the step of intercepting the list to be processed according to a plurality of preset list interception logics, the step further includes:
[0011] Determine the date of issuance of the newly added list received;
[0012] According to the issuance date of each newly added list, the issuance of each newly added list is scheduled;
[0013] Determine the list to be processed based on the scheduling results.
[0014] In one embodiment, the step of intercepting the list to be processed according to a plurality of preset list interception logics includes:
[0015] According to the interception processing results generated under each of the list interception logics, an interception mark is added to the list data in the to-be-processed list, wherein the interception marks matched by each of the list interception logics are different.
[0016] In one embodiment, the step of intercepting the list to be processed according to a plurality of preset list interception logics includes:
[0017] According to the interception order between the list interception logics, the list data in the to-be-processed list is intercepted and processed, wherein the list data that does not pass the current list interception logic does not participate in the interception processing under the next list interception logic.
[0018] In one embodiment, the step of sending the preset marketing content to the target customers included in the distribution list includes:
[0019] Determine the target marketing channels designated by each target customer included in the distribution list;
[0020] The marketing content is sent to the target customers through the target marketing channel.
[0021] In one embodiment, after the step of sending the preset marketing content to the target customers included in the sending list, the method further includes:
[0022] Receive feedback from each of the target customers;
[0023] Determine a failure list according to the feedback result, wherein the failure list includes target customers for whom the feedback result is that the marketing content delivery fails;
[0024] The available resources are recovered for each client included in the failure list, wherein the available resources are used for interception processing.
[0025] In one embodiment, after the step of determining a failure list according to the feedback result, the method further includes:
[0026] In the event that the marketing content does not exceed the preset validity period, the failure list will be rescheduled for distribution.
[0027] In one embodiment, the associated data is stored in a preset data storage area, and the data storage area includes: a hot data area and a cold data area, and the partition granularity of the cold data area is greater than the partition granularity of the hot data area.
[0028] In addition, to achieve the above-mentioned purpose, the embodiment of the present application further proposes a list data processing device, which is applied to a list data processing system, and the device includes:
[0029] The interception module is configured to intercept the list to be processed according to a plurality of preset list interception logics, wherein the associated data not included in the list to be processed and used for interception processing by each of the list interception logics is read when the list to be processed is intercepted by the core logic in each of the list interception logics;
[0030] The generation module is configured to generate a distribution list according to the interception processing result;
[0031] The sending module is configured to send preset marketing content to target customers included in the sending list.
[0032] In addition, to achieve the above-mentioned purpose, an embodiment of the present application also proposes a list data processing system, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the list data processing method described above are implemented.
[0033] In addition, to achieve the above-mentioned purpose, an embodiment of the present application also proposes an electronic device, which includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the list data processing method as described above.
[0034] In addition, to achieve the above-mentioned purpose, an embodiment of the present application also proposes a storage medium, which is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by the processor, the steps of the list data processing method described above are implemented.
[0035] In addition, to achieve the above-mentioned purpose, an embodiment of the present application also proposes a computer program product, which includes a computer program, and when the computer program is executed by a processor, the steps of the list data processing method described above are implemented.
[0036] One or more technical solutions proposed in the embodiments of the present application have at least the following technical effects: according to multiple preset list interception logics, the list to be processed is intercepted and processed, thereby screening out potential unqualified or low-quality customers; and in the process of interception processing, if the list to be processed does not contain the associated data required for the interception logic to intercept, it is recorded in advance without reading the data, and when the interception processing of the core logic is executed, the data is read uniformly; this delayed association effectively avoids the waste of resources and reduced efficiency caused by reading data in batches during the interception process, and significantly improves the timeliness and efficiency of list data processing; and then generates a list to be issued according to the interception processing results, and sends the preset marketing content to the target customers included in the issued list, so as to ensure the effective use of marketing resources and maximize the marketing effect. The embodiments of the present application effectively avoid multiple reading and integration of data in the process of issuing the list through the delayed association of the list data, thereby shortening the link of the list output, avoiding waste of resources, and improving processing efficiency. BRIEF DESCRIPTION OF THE DRAWINGS
[0037] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.
[0038] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the conventional technology, the drawings required for use in the embodiments or the conventional technology descriptions are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.
[0039] Figure 1 A flowchart diagram of the first embodiment of the method for processing application list data is provided;
[0040] Figure 2 A schematic diagram of a scenario provided for Embodiment 2 of the method for processing application list data;
[0041] Figure 3 Scenario diagram provided for the third embodiment of the application list data processing method Figure 1 ;
[0042] Figure 4 Scenario diagram provided for the third embodiment of the application list data processing method Figure 2 ;
[0043] Figure 5 This is a schematic diagram of the structure of the application list data processing system;
[0044] Figure 6 This is a schematic diagram of the framework structure of the list data processing device in the embodiment of the present application;
[0045] Figure 7 It is a schematic diagram of the device structure of the hardware operating environment of the electronic device involved in the list data processing method in the embodiment of the present application.
[0046] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION
[0047] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.
[0048] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.
[0049] In conventional technologies, the marketing list processing architecture usually adopts a decentralized processing method, that is, the complex business logic is disassembled into multiple independent intermediate computing units, and these units are deployed and executed at different stages of data flow. This leads to complex relationships between jobs, which not only increases computing redundancy and storage redundancy, but also affects the overall processing efficiency. At the same time, the existence of multiple application markets (i.e., platforms and systems for storing, processing and analyzing marketing-related data) increases the cost of data exchange, and the use of virtual machines to deploy complex business logic alone further increases management costs, making system maintenance and optimization more difficult. In addition, the scalability of the optimization path is also seriously insufficient, the algorithm logic lacks unified planning, and is randomly distributed on various processing nodes, which not only increases the workload and difficulty in production operation and maintenance and attribution troubleshooting, but also requires comprehensive consideration of the combination of multiple intermediate computing units when facing new marketing optimization needs, and the logic complexity is significantly increased. However, due to the large number of intermediate tables and long data links, as the amount of data continues to grow, the read and write performance of the system gradually decreases, and it cannot meet the needs of fast response and high throughput.
[0050] The embodiment of the present application provides a solution, which intercepts and processes the list to be processed according to multiple preset list interception logics, thereby screening out potential unqualified or low-quality customers; and in the process of interception processing, if the list to be processed does not contain the associated data required for the interception logic to perform interception processing, it is recorded in advance without reading the data, and when the interception processing of the core logic is executed, the data is read uniformly; this delayed association effectively avoids the waste of resources and reduced efficiency caused by reading data in batches during the interception processing process, and significantly improves the timeliness and efficiency of list data processing; and then generates a distribution list based on the interception processing results, and sends the preset marketing content to the target customers included in the distribution list, so as to ensure the effective use of marketing resources and maximize the marketing effect. The embodiment of the present application effectively avoids multiple reading and integration of data in the process of issuing the list through delayed association of the list data, thereby shortening the link of list output, avoiding waste of resources, and improving processing efficiency.
[0051] Reference Figure 1 , Figure 1 This is a flow chart of the first embodiment of the application list data processing method.
[0052] It should be noted that the execution subject of the list data processing method may be an electronic device, and the electronic device may be a local device or a network device. The execution subject of the list data processing method may also be a list data processing system. This embodiment does not limit this. For the sake of convenience, the following description of each embodiment is omitted. The list data processing method includes:
[0053] Step S10, intercepting the list to be processed according to a plurality of preset list interception logics, wherein the associated data not included in the list to be processed and used for interception processing by each list interception logic is read when the list to be processed is intercepted by the core logic in each list interception logic;
[0054] In a feasible embodiment, the business logic is disassembled into multiple list interception logics according to the principle of independence of different dimensions in advance according to the marketing optimization requirements, and each list data in the list to be processed is intercepted and processed in turn, wherein the list data can represent a customer list and related information, for example, customer A and related information, customer B and related information, customer C and related information, etc. Before the list to be processed is intercepted, the relevant data that may be required for the interception processing of each customer included in the list to be processed can be pre-loaded; through early redundancy, when these data are needed, the system can quickly access them without real-time calculation or query, thereby greatly shortening the processing time. Further, in the process of interception processing of each list interception logic, it is determined whether each list data in the list to be processed meets the current interception logic; if the list data meets the current interception logic, it is determined that the list data passes the current interception logic; if the list data does not meet the current interception logic, it is determined that the list data does not pass the current interception logic. If the list to be processed does not contain some of the associated data required for interception processing, it can be recorded in advance without data reading, and when the core logic in the list interception logic is executed, the data is read uniformly. This delayed association effectively avoids the waste of resources and reduced efficiency caused by reading data in batches during the interception process, and significantly improves the timeliness and efficiency of list data processing.
[0055] The main function of the interception logic is to quickly screen and filter data that does not meet the conditions to improve processing efficiency; while the main function of the core logic is to make the final decision based on in-depth data analysis.
[0056] In large-scale retail customer marketing, the list to be processed usually contains a large amount of potential customer data. This data can come from the activity execution engine, the company's internal customer database, third-party data sources, or public information collected through various channels, providing a data basis for subsequent list optimization and screening.
[0057] In the marketing optimization process, business logic usually refers to a series of rules and processes to achieve marketing goals. These rules and processes may involve multiple aspects, such as customer screening, product recommendations, pricing strategies, etc. In order to optimize marketing more effectively, these complex business logics can be disassembled into multiple more specific list interception logics in advance according to their specific marketing optimization needs.
[0058] List interception logic is used to filter or screen list data that does not meet specific conditions.
[0059] For example, the business logic includes: a customer is not marketed more than once a day, and the number of marketed customers under the same organization is not more than 1,000. The list interception logic can be broken down into a contact frequency interception upper limit of 1 and an organization quota interception upper limit of 1,000.
[0060] Exemplarily, in the process of intercepting the list to be processed through interception logic 1, the data can be preliminarily screened and filtered according to the rules and conditions preset in interception logic 1, where interception logic 1 includes "today's used quota"; if the list to be processed does not contain data related to "today's used quota", the data is preliminarily screened according to other conditions (such as user ID, region, etc.), and the data type of "today's used quota" is recorded and associated with the list to be processed. In the case of interception processing through the core logic, the pre-recorded associated data is read, including the relevant data of "today's used quota", and is screened through interception logic 1.
[0061] It should be understood that in the conventional list data processing process, multiple optimization links (for example, interception processing) are usually distributed in different modules and each link includes the repeated work of loading background data such as the list to be processed, resulting in storage redundancy and computational redundancy. However, the embodiment of the present application compresses the intermediate links, only loads the background data once, and performs interception processing in sequence through multiple list interception logics, effectively avoiding the occurrence of storage redundancy and computational redundancy.
[0062] Step S20, generating a list to be sent based on the interception processing result;
[0063] In a feasible embodiment, a distribution list is generated according to the interception processing result, wherein the distribution list may be a marketing list, which contains information of potential customers or target customers, that is, list data that is not intercepted by the list interception logic.
[0064] Step S30, sending the preset marketing content to the target customers included in the distribution list.
[0065] In a feasible embodiment, the preset marketing content is sent to each target customer included in the distribution list to ensure the effective use of marketing resources and maximize the marketing effect.
[0066] Exemplarily, the list data processing method is applied to a list data processing system, and the list data processing system includes: a list interception module; the list data processing method includes: intercepting the list to be processed according to multiple preset list interception logics through the list interception module, wherein the associated data not included in the list to be processed and used for interception processing by each list interception logic is read when the list to be processed is intercepted by the core logic in each list interception logic; generating a distribution list according to the interception processing results through the list interception module; sending the preset marketing content to the target customers included in the distribution list through the list interception module.
[0067] In this embodiment, the list to be processed is intercepted and processed according to multiple preset list interception logics, so as to screen out potential unqualified or low-quality customers; and in the process of interception processing, if the list to be processed does not contain the associated data required for the interception logic to perform interception processing, it is recorded in advance without data reading, and when the interception processing of the core logic is executed, the data is read uniformly; this delayed association effectively avoids the waste of resources and reduced efficiency caused by reading data in batches during the interception processing, and significantly improves the timeliness and efficiency of list data processing; and then generates a distribution list according to the interception processing results, and sends the preset marketing content to the target customers included in the distribution list, so as to ensure the effective use of marketing resources and maximize the marketing effect. The embodiment of the present application effectively avoids multiple reading and integration of data in the process of issuing the list through the delayed association of the list data, thereby shortening the link of the list output, avoiding resource waste, and improving processing efficiency.
[0068] Based on the above first embodiment, a second embodiment of the list data processing method of the present application is proposed. In this embodiment, in step S10, before the step of intercepting the list to be processed according to multiple preset list interception logics, the method further includes:
[0069] Step A10, determining the date of issuance of the received newly added list;
[0070] Step A20, scheduling the issuance of each newly added list according to the issuance date of each newly added list;
[0071] Step A30, determine the list to be processed based on the scheduling results.
[0072] In a feasible embodiment, the asynchronous incremental receiving of lists (i.e., newly added lists) from various data sources and the issuance date of each newly added list is determined, wherein the issuance date may be the issuance date of the marketing content associated with the newly added list. According to the issuance date of the newly added list, the issuance of each newly added list is scheduled to obtain the issuance scheduling result; and then according to the issuance scheduling result, the list issued on that day is determined as the list to be processed.
[0073] Exemplarily, the list data processing method is applied to a list data processing system, and the list data processing system includes: a list division module and a list interception module; the list data processing method includes: receiving the newly added lists sent by each data source through the list division module, and determining the issuance date of each newly added list. The list division module schedules the issuance of each newly added list according to the issuance date of each newly added list. The list division module determines the list to be processed according to the issuance scheduling result. The list interception module intercepts the list to be processed according to multiple preset list interception logics.
[0074] In this embodiment, by scheduling the distribution of each list, time and resources are allocated more effectively, ensuring that each marketing activity receives adequate attention and execution, thereby improving processing efficiency.
[0075] In a feasible implementation manner, before the step of intercepting the list to be processed according to a plurality of preset list interception logics in step S10, the method further includes:
[0076] Step A40, determining the skewed associated fields with data skew in the to-be-processed list;
[0077] In a feasible embodiment, since there may be some associated fields in the list to be processed, a large number of values are the same in this field (that is, there is data skew); therefore, the sub-lists split based on this field are easily assigned to the same processing node, resulting in a long time and easy failure in sending the list. Based on this, the embodiment of the present application first determines that there are associated fields with data skew (that is, skewed associated fields) in the list to be processed.
[0078] The associated field refers to the field belonging to the associated condition and the splitting condition, which can be used to split the list to be processed; and the sub-lists obtained after the split can be assigned to different nodes for subsequent interception processing.
[0079] Step A50, combining the tilted associated field and the randomly generated random number to obtain a combined associated field;
[0080] Step A60, based on the combined associated fields, updating the tilted associated fields in the to-be-processed list to obtain an updated list;
[0081] Step A70, splitting the updated list according to the associated fields in the updated list to obtain multiple sub-lists, and performing interception processing on each sub-list.
[0082] In a feasible embodiment, in order to overcome the above-mentioned defects, the embodiment of the present application randomly generates a random number, and combines the random number with a tilted associated field to obtain a combined associated field; then based on the combined associated field, the tilted associated field in the list to be processed is updated to obtain an updated list; then according to the associated fields in the updated list, the updated list is split to achieve the effect of virtualizing a large list into multiple small lists, and multiple sub-lists are obtained, and each sub-list can be assigned to multiple nodes, and then the steps of intercepting and processing each list data in the sub-list according to multiple preset list interception logics, as well as subsequent steps, are executed.
[0083] For example, refer to Figure 2, determine the skewed associated fields with data skew in the list to be processed, and combine the skewed associated fields and random numbers to form a new field (i.e., combined associated fields) as an association condition, and split the list to be processed to obtain multiple sub-lists 1-4.
[0084] In this embodiment, a large list (list to be processed) is virtualized into multiple small lists (sub-lists) to achieve the purpose of distributed processing, thereby effectively solving the data skew problem and effectively improving the list throughput in the asynchronous incremental form.
[0085] Based on the above first and / or second embodiments, a third embodiment of the list data processing method of the present application is proposed. In this embodiment, step S10, according to multiple preset list interception logics, the step of intercepting the list to be processed includes:
[0086] Step S11, adding an interception mark to the list data in the list to be processed according to the interception processing results generated under each list interception logic, wherein the interception marks matched by each list interception logic are different.
[0087] In a feasible embodiment, after any list data is intercepted based on any list interception logic, a matching interception mark can be added to the list data according to the interception result generated by the list interception logic, so as to perform the interception process under the next list interception logic. Since each list data in the list to be processed is added with an interception mark after the interception process, the list data that is not intercepted by the list interception logic can be screened according to the interception mark, and a list to be sent can be generated.
[0088] Exemplarily, the list after interception processing can be a complete list, and some of the data in the list are added with corresponding interception identifiers. Through the interception identifiers, it can be determined which list data is intercepted in which list interception logic, and which list data successfully passes the interception processing, and the available resources for the customers corresponding to the list data are updated (for example, the contact frequency is accumulated).
[0089] Exemplarily, the interception mark may be any letter, character, number, etc., which is used to identify under which list interception logic each list data is intercepted.
[0090] Exemplarily, the interception mark may be a specific mark value, for example, 1, 2, 3, 4, 5, etc.
[0091] Exemplarily, an interception mark may be added to the list data that does not pass the list interception logic (ie, is intercepted), while no mark is added to the list data that passes the list interception logic (ie, is not intercepted).
[0092] Exemplarily, the list data processing method is applied to a list data processing system, and the list data processing system includes: a list interception module; the list data processing method includes: adding an interception mark to the list data in the list to be processed according to the interception processing results generated under each list interception logic through the list interception module, wherein the interception marks matched by each list interception logic are different.
[0093] In this embodiment, corresponding interception marks are added to each list data after interception processing, so the marketing optimization path can be easily traced back and restored, which helps the company better understand the actual effect of the marketing activities and make adjustments and optimizations as needed.
[0094] In a feasible implementation manner, step S10, the step of intercepting the list to be processed according to a plurality of preset list interception logics includes:
[0095] Step S12, intercepting and processing the list data in the list to be processed according to the interception order between the list interception logics, wherein the list data that does not pass the current list interception logic will not participate in the interception processing under the next list interception logic.
[0096] In a feasible embodiment, an interception order is set between each list interception logic, so it is necessary to determine the current list interception logic according to the interception order, and intercept the list data through the current list interception logic. The list data that passes the current list interception logic will be further intercepted by the next list interception logic; and the list data that does not pass the current list interception logic will not participate in the interception processing under the next list interception logic.
[0097] Exemplarily, the list to be processed includes 5 list data (A, B, C, D and E); these 5 interception list data are intercepted and processed by the current list interception logic, among which A, B and C pass the current list interception logic, and D and E do not pass the current list interception logic; then A, B and C are intercepted and processed by the next list interception logic.
[0098] In this embodiment, subsequent interception processing is performed only on the list data that passes the current list interception logic, thereby continuously shrinking the iterative calculation scale and improving the list data processing efficiency.
[0099] In one feasible implementation, step S10, the step of intercepting the list to be processed according to a plurality of preset list interception logics includes:
[0100] Sort the list data according to the sorting conditions of the current list interception logic;
[0101] According to the current list interception logic, the sorted list data is intercepted and processed.
[0102] In a feasible embodiment, some list interception logic may be set with sorting conditions for the list data. Therefore, before interception processing, each list data is sorted based on the sorting conditions to obtain the sorted list data; and then the sorted list data is intercepted according to the current list interception logic.
[0103] Exemplarily, the current list interception logic is: the upper limit of contact frequency interception is 1, and the upper limit of the number of passes is 3 (that is, the customer is marketed no more than once a day, and no more than 5 list data can pass the list interception logic); at the same time, the list interception logic is pre-set with a sorting condition: females have higher priority than males. The 5 list data (including: 3 females A, B, C, and 2 males D, E) included in the list to be processed are sorted to obtain the sorted list data; then, according to the current list interception logic, the sorted list data is intercepted and processed, among which 4 list data (A, B, C, D) meet the condition of the contact frequency interception upper limit 1, but according to the sorting, it is determined that: A, B and C pass the current list interception logic.
[0104] It should be understood that the sorting condition may be determined by the set priority.
[0105] For example, refer to Figure 3 , the list to be processed includes list data 1-6, which are intercepted and processed based on interception conditions A to C in sequence according to the interception order, where the gray area represents the intercepted list data. When the current interception condition is interception condition A, only list data 6 does not pass the current interception condition, then an interception mark "A" is added to list data 6, and the remaining list data 1-5 are further intercepted and processed through interception condition B. When the current interception condition is interception condition B, list data 5 does not pass the current interception condition, then an interception mark "B" is added to list data 5, and the remaining list data 1-4 are further intercepted and processed through interception condition C. When the current interception condition is interception condition C, list data 3 and 4 do not pass the current interception condition, then an interception mark "C" is added to list data 3 and 4, and the final list to be issued is obtained, including: list data 1 and 2. Through the interception marks in each list data, it is easy to trace back and restore the marketing optimization path, which helps companies better understand the actual effect of marketing activities and make adjustments and optimizations as needed.
[0106] In a feasible implementation, the associated data is stored in a preset data storage area, and the data storage area includes: a hot data area and a cold data area, and the partition granularity of the cold data area is greater than the partition granularity of the hot data area.
[0107] In a feasible embodiment, a data storage area for storing customer data is pre-set, and the data storage area includes: a hot data area and a cold data area, which store hot data and cold data respectively; and the partition granularity of the cold data area is larger than that of the hot data area, that is, the unit size, range or detail level of the cold data area is wider than that of the hot data area.
[0108] Hot data may be data that is frequently read and written in the recent period, while cold data may be data that is less frequently read and written.
[0109] In a feasible implementation manner, a migration time is set for the data in the hot data area, wherein the data in the hot data area will be migrated to the cold data area when the set migration time is reached.
[0110] For example, refer to Figure 4 , the data storage area includes: hot data area and cold data area, and the hot data area includes partitions: T to T-7, and the cold data area includes partitions: T-3 to T-9, where T represents the current date. The data in the hot data area is set with a migration time TN, N is a set number of days, and TN days means a time point N days ago from the current time. When N is 3, it means that the data 3 days ago is migrated; then at the time of T on the same day, the T-3 hot data 3 days ago needs to be migrated to the T-3 partition of the cold data. In order to prevent the problem of missing data caused by abnormalities and the problem of untimely data migration, an overlapping fault-tolerant area (i.e., redundant area) can also be set, and the data corresponding to the overlapping fault-tolerant area is stored in the hot data area and the cold data area at the same time to achieve data storage redundancy. For example, the hot data in the T-3 area in the hot data area is migrated, and the overlapping fault-tolerant areas T-3 and T-4 are set, that is, the hot data area and the cold data area both store the data in T-3 and T-4, thereby effectively avoiding the occurrence of missing data.
[0111] For example, the view area is organized with TNM days as the dividing line, where M is the redundant time, to avoid abnormal reading of partitions when archiving or missing data. Figure 3 , when N is 3 and M is 2, T-5 is used as the dividing line component view area, and the view area includes: T to T-4 in the hot data area, and T-5 to T-9 in the cold data area and subsequent partitions.
[0112] In this embodiment, by setting cold and hot data partitions, the number of partitions that need to be scanned in data reading scenarios can be reduced, thereby improving processing efficiency; and by setting the migration time, the number of existing partitions in the data storage area is kept within a healthy range.
[0113] Based on the first, second and / or third embodiments above, a fourth embodiment of the method for processing list data of the present application is proposed. In this embodiment, step S30, the step of sending preset marketing content to target customers included in the distribution list includes:
[0114] Step S31, determining the target marketing channel designated by each target customer included in the sent list;
[0115] Step S32, sending marketing content to target customers through target marketing channels.
[0116] In a feasible embodiment, the target marketing channels pre-specified by each target customer included in the distribution list are determined, such as email, text message, social media advertising, etc.; and then the marketing content is sent to the target customer through the target marketing channel.
[0117] For example, each customer can specify multiple marketing channels and set the priority of each marketing channel, and then send marketing content to the customer through the target marketing channel with the highest priority. If the target marketing channel with the highest priority fails to send the marketing content, the marketing content can be sent to the customer again through the target marketing channel with the second highest priority.
[0118] In a feasible implementation manner, after the step of sending the preset marketing content to the target customers included in the sending list in step S30, the method further includes:
[0119] Step S40, receiving feedback results from each target customer;
[0120] In a feasible embodiment, after sending the marketing content to the target customers, feedback results from each target customer are received, wherein the feedback results may include: failure to send the marketing content or success in sending the marketing content.
[0121] Step S50, determining a failure list according to the feedback result, wherein the failure list includes target customers for whom the feedback result is that the marketing content delivery fails;
[0122] Step S60, recovering available resources for each client included in the failure list, wherein the available resources are used for interception processing.
[0123] In a feasible embodiment, a failure list is determined for target customers to whom marketing content delivery failed based on feedback results, and available resources for interception processing are restored for each customer included in the failure list.
[0124] Available resources can be resource data required for interception processing such as quota, capacity, contact frequency, etc. When some customers in the list fail to successfully receive information due to various reasons, it means that the customer did not successfully occupy the resource during the sending of this marketing content, so these limited resources need to be recovered or reallocated.
[0125] In a feasible implementation manner, after the step of determining the failure list according to the feedback result in step S50, the following steps are further included:
[0126] Step S51, when the marketing content has not exceeded the preset validity period, the failed list is rescheduled for distribution.
[0127] In a feasible embodiment, when the marketing content has not exceeded the preset validity period, the failed list is rescheduled for distribution.
[0128] Exemplarily, the list data processing method is applied to a list data processing system, and the list data processing system includes: a list feedback module; receiving feedback results of each target customer through the list feedback module. The list feedback module determines a failure list according to the feedback results, wherein the failure list includes target customers whose feedback results are that the marketing content is failed to be sent. The list feedback module recovers available resources for each customer included in the failure list, wherein the available resources are used for interception processing.
[0129] In order to assist in understanding the above technical solution, a relatively complete embodiment of the present application is provided for illustration. Figure 5The list data processing method is applied to a list data processing system, and the list data processing system includes: a list division module 101, a list interception module 102 and a list feedback module 103. The list division module 101 receives the newly added list generated by the external data source (for example, the activity execution engine), and determines the issuance date of the received newly added list. The list division module 101 schedules the issuance of each newly added list according to the issuance date of each newly added list, and determines the list scheduled on the day (i.e., the list to be processed) and the list scheduled in the future. The list interception module 102 intercepts the lists to be processed one by one according to multiple preset list interception logics, and in the case of interception processing by the core logic, reads the associated data uniformly to obtain the interception processing result. The list interception module 102 determines the intercepted list according to the interception processing result, wherein each list data in the intercepted list is added with different interception marks according to the interception processing result generated by the list interception logic. The list interception module 102 generates the issued list, and sends the marketing content through the target marketing channel specified by each target customer included in the issued list. The list feedback module 103 receives the feedback results of each target customer, and determines the failed list based on the feedback results. The list feedback module 103 recovers the available resources for each customer included in the failed list. If the marketing content has not exceeded the preset validity period, the list feedback module 103 reschedules the failed list. The list feedback module 103 includes the lists associated with the marketing content that has exceeded the preset validity period in the final execution result, and generates a historical successful list.
[0130] The embodiment of the present application, by establishing a set of macro-intensive and micro-decoupled architecture, splits the marketing optimization mechanism into core logic and data flow, compresses the data flow link, and facilitates the embedding of complex marketing optimization logic, shortens the development cycle and reduces manual operation and maintenance costs. The various modules of the transformed list data processing system have independent functions and clear processes, which reduces the synchronization procedures and control operations brought by multiple markets, lowers the technical threshold and shortens the development cycle. Subsequent development can be carried out according to small organizations, light processes, low development, low operation and maintenance, and low skill requirements.
[0131] The present application embodiment provides a list data processing device, referring to Figure 6 , the device is applied to the list data processing system, and the device comprises:
[0132] The interception module 10 is configured to intercept the list to be processed according to a plurality of preset list interception logics, wherein the associated data not included in the list to be processed and used for interception processing by each list interception logic is read when the list to be processed is intercepted by the core logic in each list interception logic;
[0133] The generating module 20 is configured to generate a sending list according to the interception processing result;
[0134] The sending module 30 is configured to send preset marketing content to target customers included in the sending list.
[0135] The list data processing device provided in the embodiment of the present application adopts the list data processing method in the above embodiment, which can avoid the waste of resources in the list data processing process and improve the processing efficiency. Compared with conventional technology, the beneficial effects of the list data processing device provided in the embodiment of the present application are the same as the beneficial effects of the list data processing method provided in the above embodiment, and other technical features in the list data processing device are the same as the features disclosed in the above embodiment method, which will not be repeated here.
[0136] An embodiment of the present application provides an electronic device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the list data processing method in the above-mentioned embodiment one.
[0137] Reference below Figure 7 , respectively show the structural schematic diagrams of electronic devices suitable for implementing the embodiments of the present application. The electronic devices in the embodiments of the present application may include but are not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions), PMPs (Portable Media Players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 7 The electronic device shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.
[0138] like Figure 7As shown, the electronic device may include a processing device 1001 (e.g., a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM: Read Only Memory) 1002 or a program loaded from a storage device 1003 to a random access memory (RAM: Random Access Memory) 1004. In RAM1004, various programs and data required for the operation of the electronic device are also stored. The processing device 1001, ROM1002, and RAM1004 are connected to each other through a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Generally, the following systems can be connected to the I / O interface 1006: an input device 1007 including, for example, a touch screen, a touch pad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; an output device 1008 including, for example, a liquid crystal display (LCD: Liquid Crystal Display), a speaker, a vibrator, etc.; a storage device 1003 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 1009. The communication device 1009 can allow the electronic device to communicate with other devices wirelessly or by wire to exchange data. Although the figure shows an electronic device with various systems, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems can be implemented or have alternatively.
[0139] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.
[0140] The electronic device provided in the embodiment of the present application adopts the list data processing method in the above embodiment, which can avoid the waste of resources in the list data processing process and improve the processing efficiency. Compared with conventional technology, the beneficial effects of the electronic device provided in the embodiment of the present application are the same as the beneficial effects of the list data processing method provided in the above embodiment, and other technical features in the electronic device are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.
[0141] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.
[0142] The above are only specific implementations of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
[0143] An embodiment of the present application provides a computer-readable storage medium having computer-readable program instructions (ie, computer programs) stored thereon, and the computer-readable program instructions are used to execute the list data processing method in the above-mentioned embodiment.
[0144] The computer-readable storage medium provided in the embodiment of the present application may be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM: Random Access Memory), a read-only memory (ROM: Read Only Memory), an erasable programmable read-only memory (EPROM: Erasable Programmable Read Only Memory or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM: CD-Read Only Memory), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium may be any tangible medium that includes or stores a program that can be used by or in combination with an instruction execution system, system or device. The program code included on the computer-readable storage medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency: Radio Frequency), etc., or any suitable combination of the above.
[0145] The computer-readable storage medium may be included in the electronic device, or may exist independently without being installed in the electronic device.
[0146] The above-mentioned computer-readable storage medium carries one or more programs. When the above-mentioned one or more programs are executed by an electronic device, the electronic device: intercepts the list to be processed according to multiple preset list interception logics, wherein the associated data not included in the list to be processed and used for interception processing by each list interception logic is read when the list to be processed is intercepted by the core logic in each list interception logic; generates a distribution list according to the interception processing results; and sends preset marketing content to the target customers included in the distribution list.
[0147] Computer program code for performing the operations of the present application may be written in one or more programming languages or a combination thereof, including object-oriented programming languages such as Java, Smalltalk, C++, and conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).
[0148] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code includes one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0149] The modules involved in the embodiments described in this application may be implemented by software or hardware, wherein the name of the module does not constitute a limitation on the unit itself in some cases.
[0150] The readable storage medium provided in the embodiment of the present application is a computer-readable storage medium, which stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned list data processing method, which can avoid waste of resources in the list data processing process and improve processing efficiency. Compared with conventional technologies, the beneficial effects of the computer-readable storage medium provided in the embodiment of the present application are the same as the beneficial effects of the list data processing method provided in the above-mentioned embodiment, and will not be repeated here.
[0151] The above are only some embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structural changes made using the contents of the present application specification and drawings under the technical concept of the present application, or directly / indirectly applied in other related technical fields are included in the patent protection scope of the present application.
Claims
1. A method for processing list data, characterized in that: The method comprises: According to a plurality of preset list interception logics, the list to be processed is intercepted and processed, wherein the associated data not included in the list to be processed and used for interception processing by each list interception logic is read when the list to be processed is intercepted and processed by the core logic in each list interception logic; Generate a distribution list based on the interception processing results; Sending preset marketing content to target customers included in the distribution list.
2. The method according to claim 1, characterized in that Before the step of intercepting the list to be processed according to a plurality of preset list interception logics, the process further includes: Determine the date of issuance of the newly added list received; According to the issuance date of each newly added list, the issuance of each newly added list is scheduled; Determine the list to be processed based on the scheduling results.
3. The method according to claim 1, characterized in that The step of intercepting the list to be processed according to multiple preset list interception logics includes: According to the interception processing results generated under each of the list interception logics, an interception mark is added to the list data in the to-be-processed list, wherein the interception marks matched by each of the list interception logics are different.
4. The method according to claim 1, characterized in that The step of intercepting the list to be processed according to multiple preset list interception logics includes: According to the interception order between the list interception logics, the list data in the to-be-processed list is intercepted and processed, wherein the list data that does not pass the current list interception logic does not participate in the interception processing under the next list interception logic.
5. The method according to claim 1, characterized in that The step of sending the preset marketing content to the target customers included in the sending list includes: Determine the target marketing channels designated by each target customer included in the distribution list; The marketing content is sent to the target customers through the target marketing channel.
6. The method according to claim 1, characterized in that After the step of sending the preset marketing content to the target customers included in the sending list, the method further includes: Receive feedback from each of the target customers; Determine a failure list according to the feedback result, wherein the failure list includes target customers for whom the feedback result is that the marketing content delivery fails; The available resources are recovered for each client included in the failure list, wherein the available resources are used for interception processing.
7. The method according to claim 6, characterized in that After the step of determining a failure list according to the feedback result, the method further includes: In the event that the marketing content does not exceed the preset validity period, the failure list will be rescheduled for distribution.
8. The method according to claim 1, characterized in that The associated data is stored in a preset data storage area, which includes a hot data area and a cold data area, and the partition granularity of the cold data area is greater than the partition granularity of the hot data area.
9. A list data processing system, characterized in that: The list data processing system stores a computer program, and when the computer program is executed by a processor, the steps of the list data processing method according to any one of claims 1 to 8 are implemented.
10. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the list data processing method according to any one of claims 1 to 8 are implemented.