A marketing census method based on data center

Abstract

The present invention discloses a marketing census method based on a data middle platform, including census task management, file modification, data governance, census content management and census rules. The marketing business application collaborates with the marketing business management platform to generate a census work order based on the marketing data range and the user range to be censused. The marketing business application pushes the census work order to the census tool. After receiving the census work order, the on-site staff conducts on-site verification of the marketing information. After verification, the census work order is fed back to the marketing business application, and the data is archived after review. The census dashboard is generated according to the census results through the dashboard function of the marketing business management and control platform. The present invention carries out the construction of a marketing census project, promotes the marketing census work from the traditional post-verification to in-process monitoring, realizes the real-time management and control requirements of business specification execution, reduces the workload of post-audit, and other business problems caused by inadequate quality.

Description

Technical Field

[0001] The present invention belongs to the technical field of power grid electricity management, and specifically relates to a marketing census method based on a data center. Background Art

[0002] In order to implement the requirements of the marketing census and support the smooth implementation of the marketing census, since this work involves many points and wide areas, a long time period and high difficulty in management and control, in order to reduce duplication of work, it is necessary to build a marketing census method based on the data middle platform to realize the intelligence, automation and visualization of the marketing census. Summary of the invention

[0003] The purpose of the present invention is to provide a marketing census method based on a data center to solve the problems raised in the above-mentioned background technology.

[0004] To achieve the above purpose, the present invention provides the following technical solutions: a marketing census method based on a data middle platform, including census task management, file modification, data governance, census content management and census rules, and the marketing business application and the marketing business management platform collaborate to generate a census work order based on the marketing data range and the user range to be censused. The marketing business application pushes the census work order to the census tool. After receiving the census work order, the field staff conducts on-site verification of the marketing information, and after verification, the census work order is fed back to the marketing business application, and the data is archived after review;

[0005] The census task management includes census work order processing, census work order review and census situation statistics;

[0006] The file modification includes file modification application and file modification review;

[0007] The data governance includes abnormal data extraction and abnormal data judgment;

[0008] The census content management includes census theme management and census item management;

[0009] The census rules include census rule management and census rule configuration.

[0010] Preferably, the overall architecture of the marketing census method based on the data middle platform includes a data source, a data middle platform, an application layer, and census abnormal data extraction;

[0011] The data source refers to the production environment database of each original business method, which provides a data source for the data center. It is extracted to the source layer of the data center through the access component of the data center to provide data support for downstream businesses and services.

[0012] The data middle platform refers to the data of each original business method, which is transferred through the data middle platform through the source layer, sharing layer and analysis layer. The source layer is positioned close to the source business method, storing the stock and incremental data of the source business method, and its table structure is basically consistent with the table structure of the source business system; the sharing layer is positioned as the model layer, which is used to store the model table integrated and converted according to the SG-CIM model; the analysis layer is used to store the result table after processing according to the business logic;

[0013] The application layer refers to the data and service APIs based on the data center platform, which customize specific functions and applications for various business methods;

[0014] The census abnormal data extraction is an application that filters and screens out abnormal data based on the original data of the data center through the configured census inspection rules, stores it in the data center analysis layer and synchronizes it to the basic data platform.

[0015] Preferably, the technical architecture of the marketing census method based on the data middle platform includes a presentation layer, a computing layer, data storage and infrastructure;

[0016] The presentation layer refers to the census indicators of abnormal data. Through the EP5 framework, it provides model-level metadata management and indicator formula configuration interface, dynamically adjusts indicator formula parameters through the interface, identifies business model boundaries, adjusts task technical parameters, and optimizes computing performance. Query detailed data under each business model through HUE;

[0017] The computing layer uses Huawei Cloud's task operation and resource scheduling platform Yarn and the memory computing framework Spark to extract raw data and use the RDD memory data structure provided by Spark to perform distributed computing of census indicators to ensure the computing efficiency of hundreds of indicators at a daily granularity.

[0018] The data storage refers to the raw data of the census, which is obtained from the source layer Hive of the data center. The data structure and marketing label settings are highly consistent. After the data is extracted, it is stored in the analysis layer component GaussDB of the data center after data analysis, and is also written back to the basic data platform Oracle. During the analysis and calculation process, some temporary tables will be processed and generated and cached in the hdfs directory of the data center. The configuration data of the application is stored in the postgresql database;

[0019] The infrastructure refers to the storage and computing of applications, which are executed and scheduled under the HUAWEI CLOUD engine. The deployment and configuration of applications, as well as the application rule base, are deployed on the HUAWEI CLOUD client host.

[0020] Preferably, the data architecture of the marketing census method of the data center includes basic data and application data;

[0021] The basic data includes marketing user basic profile information;

[0022] The application data includes newly installed data, exception rules, work order data, work order message data, work order data, method configuration data, and log data.

[0023] The beneficial effects of the present invention are: carrying out the construction of marketing census projects, advancing the marketing census work from traditional post-verification to in-process monitoring, realizing the real-time control requirements of business norm execution, reducing the workload of post-audit, and other business problems caused by inadequate quality. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 It is a general framework diagram of the present invention;

[0025] Figure 2 It is a technical architecture diagram of the present invention;

[0026] Figure 3 It is a data architecture diagram of the present invention;

[0027] Figure 4 It is a business process diagram of the present invention. DETAILED DESCRIPTION

[0028] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0029] The present invention provides Figure 1-4 The marketing census method based on the data middle platform shown in the figure includes census task management, file modification, data governance, census content management and census rules. The marketing business application and the marketing business management platform work together to generate a census work order based on the marketing data scope and the user scope to be census. The marketing business application pushes the census work order to the census tool. After receiving the census work order, the field staff conducts on-site verification of marketing information such as customer information and basic distribution files. After verification, the census work order is fed back to the marketing business application, and the data is archived after review;

[0030] The census task management includes census work order processing, census work order review and census situation statistics;

[0031] Specifically, the file modification includes file modification application and file modification review;

[0032] Specifically, the data governance includes abnormal data extraction and abnormal data judgment;

[0033] Specifically, the census content management includes census theme management and census item management;

[0034] Specifically, the census rules include census rule management and census rule configuration.

[0035] like Figure 1 As shown, the overall architecture of a marketing census method based on a data middle platform includes a data source, a data middle platform, an application layer, and census abnormal data extraction;

[0036] Specifically, the data source refers to the production environment database of each original business method, which provides a data source for the data center. It is extracted to the source layer of the data center through the access component of the data center to provide data support for downstream businesses and services, mainly marketing, PMS and other methods;

[0037] Specifically, the data middle platform refers to the data of each original business method, which is transferred through the data middle platform mainly through the source layer, sharing layer and analysis layer. The source layer is positioned close to the source business method, mainly storing the stock and incremental data of the source business method, and its table structure is basically consistent with the table structure of the source business system; the sharing layer is positioned as the model layer, which is used to store the model table integrated and converted according to the SG-CIM model; the analysis layer is used to store the result table after processing according to the business logic;

[0038] Specifically, the application layer refers to the data and service API based on the data middle platform, which can customize specific functions and applications for various business methods;

[0039] Specifically, the census abnormal data extraction: based on the original data of the data middle platform, through the configured census inspection rules, filter and screen out abnormal data, store it in the data middle platform analysis layer and synchronize it to an application of the basic data platform.

[0040] like Figure 2 As shown, the technical architecture of a marketing census method based on a data middle platform includes a presentation layer, a computing layer, data storage and infrastructure;

[0041] Specifically, the presentation layer refers to the census indicators of abnormal data. Through the EP5 framework provided by Neusoft Energy, it provides a model-level metadata management and indicator formula configuration interface. Through the interface, the indicator formula parameters can be dynamically adjusted, the business model boundaries can be identified, and the task technical parameters can be adjusted to optimize the computing performance. HUE is a data visualization component provided by Huawei MRS components. Through HUE, detailed data under each business model can be queried, providing a visual confirmation method for the accuracy and completeness of data calculation;

[0042] Specifically, the computing layer refers to the use of Huawei Cloud's task operation and resource scheduling platform Yarn and the memory computing framework Spark, which can quickly and seamlessly extract raw data, and use the unique RDD memory data structure provided by Spark to perform efficient distributed computing of census indicators, ensuring the computing efficiency of hundreds of indicators at a daily granularity;

[0043] Specifically, the data storage refers to the raw data of the census, which is obtained from the source layer Hive of the data center. The data structure and marketing label settings are highly consistent. After the data is extracted, it is analyzed and stored in the analysis layer component GaussDB of the data center, and is also written back to the basic data platform Oracle. During the analysis and calculation process, some temporary tables will be processed and generated and cached in the hdfs directory of the data center. The configuration data of the application is stored in the postgresql database;

[0044] Specifically, the infrastructure refers to the storage and computing of applications, which are mainly executed and scheduled under the Huawei Cloud engine. The deployment and configuration of applications, as well as the application rule base, are deployed on the client host of Huawei Cloud.

[0045] like Figure 3 As shown, the data architecture of one of the marketing census methods based on the data middle platform includes basic data and application data;

[0046] Specifically, the basic data mainly includes marketing user basic profile information;

[0047] Specifically, the application data mainly includes structured data such as new installation data, exception rules, work order data, work order message data, work order data, method configuration data, log data, etc.

[0048] The construction content of one of the marketing census methods based on the data center includes:

[0049] 5.1 Marketing Census Support Methods

[0050] 5.1.1 Marketing Census Audit Rules

[0051] In accordance with the annotated design requirements of marketing business applications, we collect, organize and maintain audit rules for customer files, energy census, distributed photovoltaics and other businesses to form a unified standard marketing census audit rule library. The marketing census audit library is maintained according to different business types, including basic file information, business expansion and registration process entry verification, power supply and use contract inspection and other related business audit rule management, and provides specific verification methods and calculation standards for the rules.

[0052] 5.1.2 Online Census of Marketing Business

[0053] In accordance with the audit rules, we provide a marketing census, and provide a unified service calling interface and standards. The business methods will call and use them according to the actual situation and provide feedback on the results.

[0054] 5.1.2.1 Basic file information

[0055] 1. Basic user information. Focus on checking whether the user's name, address, legal contact person, electrical contact person, accounting contact person and other information are standardized and consistent with the actual situation.

[0056] 2. Real-name authentication information. Focus on verifying whether the identity document information of resident users, the social unified credit code of industrial and commercial users, business license and other valid document information are complete.

[0057] 3. Classification of electricity consumption industries. Focus on verifying the consistency between the user industry classification and the nature of on-site electricity consumption, and whether the high-energy-consuming industry users are accurate.

[0058] 4. Capacity information: Whether the contract capacity and actual operating capacity are consistent with the actual situation.

[0059] 5. VAT invoice information. Focus on checking whether the VAT invoice information is accurate and standardized, and whether there is any inconsistency between the invoice information and the electricity user name.

[0060] 6. Fee control user information: Whether the contact person of the fee control user is valid, whether the fee control user has not signed the fee control agreement, etc.

[0061] 7. Payment information: Focus on checking whether the payment method is consistent with the actual situation.

[0062] 8. Market-based transaction relationships: Focus on checking the market-based transaction type identification.

[0063] 9. Online State Grid channel logo. Focus on checking whether the online State Grid promotion binding is completed.

[0064] 10. User tag information: Focus on checking whether the tag information such as points and credit is accurate.

[0065] 5.1.2.2 Business expansion registration

[0066] When carrying out business expansion registration business, it is necessary to verify the filling basis and requirements during the application acceptance and business process execution to ensure that the data quality after the business expansion registration is complete and accurate.

[0067] 1. Application stage: focus on checking whether the application acceptance information is complete and whether the filled content complies with the requirements of the basic file rules, including the reason for application, certificate information, contact information, account information, etc.

[0068] 2. On-site investigation: focus on verifying whether the on-site investigation and the various plans compiled meet the regulatory requirements, and restrict and prompt any missing or erroneous information.

[0069] 3. Project acceptance phase: focus on checking the project progress, review information, attachment integrity, etc., and restrict and prompt any missing or erroneous information.

[0070] 4. Meter replacement stage: focus on checking whether the meter readings, meter replacement date and other information are accurate, whether the meter is effectively linked to the metering point, etc.

[0071] 5. Power supply stage: focus on checking whether the power supply date and account establishment date are complete and accurate.

[0072] 6. Information archiving stage: Verify according to basic archival information to ensure there are no errors or omissions. If there are errors or omissions, correct them according to the archival information rectification process.

[0073] 5.1.2.3 Electricity supply and use contract

[0074] 1. Contract version. Focus on checking whether the contract uses the latest version, whether the contract version policy is implemented in accordance with the actual situation, and whether there are multiple valid contracts for the same user.

[0075] 2. Basic elements of the contract. Focus on checking basic information such as account name, address, and contract capacity.

[0076] 3. Contract signing date. Focus on checking whether the contract signing date is greater than the expiration date or the interval between the signing date and the expiration date is inconsistent with the contract validity period.

[0077] 5.1.2.4 Low-income and five-guarantee users

[0078] 1. Information on users of the minimum living allowance and five guarantees: Focus on checking the list of users of the minimum living allowance and five guarantees to see if it meets the requirements of the national and provincial governments. Check whether the basic information of the minimum living allowance and five guarantees is repeated, missing or inconsistent with the regulations.

[0079] 2. Information on the implementation of the minimum living allowance and five guarantees preferential policies: whether the electricity bills issued to users marked as minimum living allowance and five guarantees are subject to preferential policies, and whether the preferential implementation results are accurate.

[0080] 3. Information on electricity consumption of low-income and five-guarantee users: Screen low-income and five-guarantee users with abnormal electricity consumption and submit them to government agencies for verification.

[0081] 5.1.2.5 Anti-theft and other violations

[0082] 1. Check whether electricity usage inspections have been carried out for users with suspected electricity theft tags.

[0083] 2. The handling and response of anti-theft and violation reporting work orders.

[0084] 3. Temporary electricity management. Focus on checking situations such as temporary electricity exceeding the expiration date or changing the nature of on-site electricity use, temporary electricity account cancellation without formalities and new installation to circumvent the temporary electricity expiration date, and illegal use of temporary electricity without a meter.

[0085] 5.1.2.6 Metrology file verification

[0086] (1) Whether the measurement method corresponds to the wiring method.

[0087] (2) Whether the measurement method corresponds to the user classification.

[0088] (3) Whether the loss allocation mark at the metering point is complete.

[0089] (4) Whether the classification of the measurement point corresponds to the nature of the measurement point.

[0090] (5) Whether the metering point classification corresponds to the main use type; whether there is a situation where the metering point classification is a gateway and the main use type is settlement on the electricity sales side.

[0091] (6) Whether the main purpose type of the metering point corresponds to the nature of the metering point; whether there is a phenomenon that the main purpose type is settlement on the electricity sales side and the nature of the metering point is assessment.

[0092] (7) Whether the metering method corresponds to the voltage level; whether there is a phenomenon that the voltage level is high voltage but the metering method at the metering point is low supply and low metering.

[0093] (8) Whether there is a phenomenon of no metering point information at the parent metering point in the billing relationship.

[0094] (9) Whether the total of the lower-level fixed ratios at the same measurement point is greater than 1.

[0095] (10) Is there a lack of correlation between the metering point and the user’s electricity price?

[0096] (11) Is there a phenomenon that the commissioning date of the metering point is greater than the current date?

[0097] (12) Whether the variable loss algorithm mark at the metering point is accurate, and whether there is a mismatch between the variable loss billing mark and the metering method.

[0098] (13) Is there a phenomenon that the operating electricity meter has no associated metering point?

[0099] (14) Whether the comprehensive multiplier of the operating electric energy meter is accurate.

[0100] (15) Whether the type of operating power indication is accurate.

[0101] (16) Check whether the asset number of the operating transformer is complete.

[0102] (17) Check whether the current transformation ratio of the operating instrument transformer is accurate.

[0103] (18) Check whether the voltage transformation ratio of the operating instrument transformer is accurate.

[0104] (19) Check whether there is a mismatch between the electricity consumption capacity and the transformer transformation ratio.

[0105] 5.1.3 Marketing Census Task Management

[0106] Based on the abnormal data detected and analyzed, formulate special census tasks.

[0107] Formulate the details of the census data for actual implementation, perform data preparation. The census execution personnel obtain the census data through the APP application. After completing the on-site data census, submit the census data to the census method. The census data reviewers review the census data. After passing the review, synchronously check the data for census rectification. After the check is completed, perform the archiving of the census data.

[0108] Among them, after the review stage, special census tasks for abnormal users can be formulated.

[0109] 5.1.3.1 Census Task Compilation

[0110] Through the abnormal merging and combination in the online census business, generate census rectification tasks, and achieve the dispatching, processing, and review of census tasks.

[0111] 5.1.3.2 Census Task Dispatching

[0112] Dispatch the generated census task work orders, assign rectification personnel, and formulate the rectification work content.

[0113] 5.1.3.3 Census Task Obtaining

[0114] Obtain the census tasks and detailed information.

[0115] 5.1.3.4 Census Task Processing

[0116] Conduct investigation and verification according to the census work orders, fill in the verification results, and initiate rectification work orders. The rectification work orders are as follows according to different types:

[0117] 1. Non-billing File Rectification

[0118] For error information related to non-billing, initiate the file rectification process for modification. The modified file information is directly updated. The census work order can be archived only after the file rectification process is archived.

[0119] 2. Billing File Rectification

[0120] For error information related to billing, select the relevant business expansion process to modify it, proceed according to the business expansion registration process, and the census work order can only be archived after the business expansion registration process is archived.

[0121] 3. Marketing business rectification

[0122] For exceptions submitted by other marketing business processes, edit and submit the rectification status.

[0123] 5.1.3.5 Submitting census tasks

[0124] Submit the census tasks and processing results.

[0125] 5.1.3.6 Review of census results

[0126] The census result information will be verified and reviewed, and automatically archived after the review is completed.

[0127] 5.1.3.7 Census results archiving (automatic)

[0128] Archive the completed census results.

[0129] 5.1.4 File Rectification Process

[0130] 5.1.4.1 File Rectification Application

[0131] Initiate the archive rectification process and complete the archive information modification. Upon completion, call the archive census service for verification.

[0132] 5.1.4.2 File Rectification Review

[0133] The results of the archive rectification will be reviewed and archived after the review is completed.

[0134] 5.1.4.3 Archives rectification and archiving

[0135] Archive the files that have been rectified.

[0136] 5.1.5 Random inspection of survey results

[0137] 5.1.5.1 Random inspection task formulation

[0138] From the completed census tasks, select the users to be spot-checked and generate a census spot-check task.

[0139] 5.1.5.2 The census auditors shall complete the data verification and enter the verified data results into the associated spot check tasks.

[0140] 5.1.6 Marketing Census Service Open

[0141] The online census business function developed in accordance with the audit rules is provided to the business method as a microservice interface for calling.

[0142] 1. Basic file information

[0143] 2. Business expansion registration

[0144] 3. Electricity supply contract

[0145] 4. Check the measurement files

[0146] 5.2 Marketing Survey Support Method (APP)

[0147] 5.2.1APP Login

[0148] Select the login account from the drop-down box. Confirm the login account. Enter the password and log in.

[0149] When logging into the census method APP, the information entered by the census executors is verified to prevent other unrelated personnel from modifying the census information.

[0150] 5.2.2 Marketing Census Tasks

[0151] When the census executors arrive at the census user site, they complete the data census through the following functions:

[0152] 1. Select the census task that needs to be executed currently through the [Census Task Selection] function.

[0153] 2. After selecting the census task, conduct the census step by step according to the corresponding process based on the type of census task.

[0154] 3. Determine whether to initiate census rectification work based on the census results, start corresponding rectification work orders according to different types for processing, and initiate business expansion work order applications for those that need to advance business expansion processes.

[0155] 5.2.2.1 Census task preparation

[0156] By merging and combining the anomalies that occur in the online census business, census rectification tasks are generated to achieve the dispatching, processing and review of census tasks.

[0157] 5.2.2.2 Census Task Assignment

[0158] Assign tasks for the generated census task work orders, designate rectification personnel, and compile rectification work contents.

[0159] 5.2.2.3 Obtaining census tasks

[0160] Get census tasks and detailed information.

[0161] 5.2.2.4 Census task processing

[0162] Conduct investigation and verification according to the census work order, fill in the verification results and initiate the rectification work order. The rectification work orders are as follows according to different types:

[0163] 1. Rectification of non-fee-charging files

[0164] For error information that is not related to billing, the file rectification process will be initiated to make modifications. The modified file information will be directly updated. The census work order can only be archived after the file rectification process is archived.

[0165] 2. Rectification of fee calculation files

[0166] For error information related to billing, select the relevant business expansion process to modify it, proceed according to the business expansion registration process, and the census work order can only be archived after the business expansion registration process is archived.

[0167] 3. Marketing business rectification

[0168] For exceptions submitted by other marketing business processes, edit and submit the rectification status.

[0169] 5.2.2.5 Submitting census tasks

[0170] Submit the census tasks and processing results.

[0171] 5.2.2.6 Review of census results

[0172] The census result information will be verified and reviewed, and automatically archived after the review is completed.

[0173] 5.2.2.7 Census results archiving (automatic)

[0174] Archive the completed census results.

[0175] 5.2.3 File Rectification Process

[0176] 5.2.3.1 File Rectification Application

[0177] Initiate the archive rectification process and complete the archive information modification. Upon completion, call the archive census service for verification.

[0178] 5.2.3.2 File Rectification Review

[0179] The results of the archive rectification will be reviewed and archived after the review is completed.

[0180] 5.2.3.3 Archives Rectification and Archiving

[0181] Archive the files that have been rectified and submit the results to the marketing method update.

[0182] 5.2.4 Random inspection of survey results

[0183] 5.2.4.1 Setting of inspection tasks

[0184] From the completed census tasks, select the users to be spot-checked and generate a census spot-check task.

[0185] 5.2.4.2 Input of sampling results

[0186] The census auditor completes the data verification and enters the verified data results into the associated spot check tasks.

[0187] 5.2.5 Support functions

[0188] 5.2.5.1 Personnel Management

[0189] Maintain your login account and password.

[0190] 5.2.5.2 Version Management

[0191] 1. Version information

[0192] The business operator checks the software version information of the current APP.

[0193] 2. Version Upgrade

[0194] When logging into the APP, the census executor will perform the version upgrade operation according to the prompted version upgrade information.

[0195] 5.2.5.3GPS positioning

[0196] The access point address and access device address are both located using the GPS on the terminal. Click the "Locate" button on the corresponding page to output the positioning results to the page, and save them after revision.

[0197] 5.2.5.4 Take photos and upload

[0198] Provide photo taking function, after verifying the on-site situation, take photos and submit them to the background.

[0199] 5.3 Marketing Business Application Transformation

[0200] 5.3.1 Business expansion registration

[0201] During the business expansion registration process, call the online census service to verify the data filled in.

[0202] 5.3.2 User Profile Survey

[0203] Conduct a user file census by user, and call the file rectification process to make corrections if there are any abnormal census results.

[0204] 5.3.3 Account Manager Census

[0205] Conduct a census of user information within the account manager’s service scope, conduct on-site census confirmation for any abnormal census results, and make corrections based on the census results.

[0206] 5.3.4 File update service

[0207] For non-billed file information modifications, update the user file information after completing the file rectification process and record the operation.

[0208] like Figure 4 As shown in the figure, a marketing census method based on a data center is shown, and the business process includes the following steps:

[0209] S1. Generate a census work order;

[0210] S2, push to the census tool;

[0211] S3. On-site inspection;

[0212] S4, work order feedback;

[0213] S5. Data archiving.

[0214] Finally, it should be noted that the above is only a preferred embodiment of the present invention and is not intended to limit the present invention. Although the present invention has been described in detail with reference to the aforementioned embodiments, it is still possible for those skilled in the art to modify the technical solutions described in the aforementioned embodiments or to make equivalent substitutions for some of the technical features therein. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A marketing census method based on data center. Features: Including census task management, file modification, data governance, census content management and census rules. The marketing business application works with the marketing business management platform to generate census work orders based on the marketing data scope and the user scope to be census. The marketing business application pushes the census work order to the census tool. After receiving the census work order, the field staff conducts on-site verification of the marketing information. After verification, the census work order is fed back to the marketing business application, and the data is archived after review. The census task management includes census work order processing, census work order review and census situation statistics; The file modification mentioned herein includes file modification application and file modification review; The data governance includes abnormal data extraction and abnormal data judgment; The census content management includes census theme management and census item management; The census rules include census rule management and census rule configuration; The overall architecture of the marketing census method based on the data center includes: 2.1 Data source: The production environment database of each original business method provides data source for the data center. It is extracted to the source layer of the data center through the access component of the data center to provide data support for downstream businesses and services. 2.2 Data middle platform: After accessing the data of each original business method, it flows through the data middle platform through the three layers of source layer, sharing layer and analysis layer; the source layer is positioned close to the source business method, storing the stock and incremental data of the source business method, and its table structure is basically consistent with the table structure of the source business system; the sharing layer is positioned as the model layer, which is used to store the model table integrated and converted according to the SG-CIM model; the analysis layer is used to store the result table processed according to the business logic; 2.3 Application layer: Relying on the data and service APIs of the data center, customize specific functions and applications for various business methods; 2.4 Extraction of abnormal census data: Based on the original data of the data platform, the abnormal data is filtered and selected through the configured census inspection rules, and stored in the analysis layer of the data platform and synchronized to an application of the basic data platform; The technical architecture of the marketing census method based on the data center includes: 3.1 Presentation layer: Census indicators of abnormal data, through the EP5 framework provided by Neusoft Energy, provide model-level metadata management and indicator formula configuration interface, dynamically adjust indicator formula parameters through the interface, identify business model boundaries, adjust task technical parameters, and optimize computing performance; query detailed data under each business model through HUE; 3.2 Computing layer: Huawei Cloud's task operation and resource scheduling platform Yarn and memory computing framework Spark are used to extract raw data. The RDD memory data structure provided by Spark is used to perform distributed computing of census indicators to ensure the computing efficiency of hundreds of indicators at a daily granularity. 3.3 Data storage: The original data of the census is obtained from the source layer Hive of the data center. The data structure is highly consistent with the standard design of marketing. After the data is extracted, it is analyzed and stored in the analysis layer component GaussDB of the data center. It is also written back to the basic data platform Oracle. During the analysis and calculation process, some temporary tables will be processed and generated and cached in the hdfs directory of the data center. The configuration data of the application is stored in the postgresql database. 3.4 Infrastructure: The storage and computing of applications are executed and scheduled under the HUAWEI CLOUD engine; while the deployment and configuration of applications, and the application rule base are deployed on the HUAWEI CLOUD client host.

2. According to the marketing census method based on the data middle platform according to claim 1, Features: The data architecture of the marketing census method based on the data center includes: 4.1 Basic data: including basic profile information of marketing users; 4.2 Application data: includes new installation data, exception rules, work order data, work order message data, method configuration data, and log data.

Images