Data processing and service system
By introducing data processing and service systems into the data service platform, and using big data computing and AI technology to automatically identify news clues and generate news texts, the problem of low production efficiency of manual content under massive data on traditional platforms is solved, and efficient content generation and operation is achieved.
Patent Information
- Application Number
- CN202411736747.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-29
- Publication Date
- 2025-03-25
AI Technical Summary
In the face of massive data, the content production process of manual participation by traditional data is less efficient.
A data processing and service system is designed, including a data collection module, a data analysis module, an intelligent text generation module and a task process module. It uses big data computing and AI technology to automatically identify news clues, generate news texts, and automatically generate workflows.
Through automated processes, the efficiency of content generation is greatly improved, the steps of manual participation are reduced, and the operational efficiency of the data service platform is improved.
Smart Images

Figure CN119692313A_ABST
Abstract
Description
Technical Field
[0001] The present invention specifically relates to a data processing and service system. Background Art
[0002] Traditional data service platforms still have many deficiencies in content supply, operation development, and service capabilities. The amount of data on the platform is huge, and most steps in content production require manual participation. Faced with massive amounts of data, the efficiency of the content production process with manual participation is relatively low. Summary of the invention
[0003] The present invention provides a data processing and service system to solve the above-mentioned technical problems, and specifically adopts the following technical solutions:
[0004] A data processing and service system, comprising:
[0005] Data collection module, used to collect and integrate data from telephone systems, website servers, client applications and public account platforms;
[0006] A data analysis module, used to analyze the data collected by the data integration module and identify news clues;
[0007] An intelligent text generation module, used to generate news text based on the news clues analyzed by the data analysis module;
[0008] The task flow module is used to establish a corresponding workflow based on the news text generated by the intelligent text generation module.
[0009] Further, the news clues identified by the data analysis module are marked with importance and urgency;
[0010] The task flow module generates corresponding different workflows based on the importance and urgency of the news clues corresponding to the news text.
[0011] Furthermore, the data processing and service system also includes:
[0012] A news data statistics module, used to count relevant data in the intelligent text generation module and the task flow module;
[0013] A data display module, used to display the statistical results of the news data statistics module;
[0014] Feedback module, used for users to submit feedback.
[0015] Furthermore, the intelligent text generation module includes:
[0016] A topic selection submodule, used to generate topics based on the news clues analyzed by the data analysis module;
[0017] An intelligent writing submodule, used for automatically writing news text based on the topic generated by the topic selection submodule;
[0018] The intelligent quality inspection submodule is used to check the quality of the news text written by the intelligent writing submodule.
[0019] Furthermore, the intelligent text generation module also includes:
[0020] The originality verification submodule is used to verify the originality of news texts that have passed quality inspection.
[0021] Furthermore, the intelligent text generation module also includes:
[0022] The manual quality inspection submodule is used for the inspectors to manually inspect the quality inspection results of the intelligent quality inspection submodule.
[0023] Furthermore, the data processing and service system also includes:
[0024] The data collection module is used to collect user behavior data, content production data and business operation data from various application system databases;
[0025] A data preprocessing module, used to perform preprocessing operations on the data collected by the data collection module;
[0026] A data labeling module is used to label the processed data according to a preset labeling strategy;
[0027] The data storage module is used to store the processed data.
[0028] Furthermore, the preset labeling strategy includes a user labeling system, a content labeling system and a service labeling system.
[0029] Furthermore, the data processing and service system also includes:
[0030] The data acquisition module is used to collect data from the website server, weather station, fire alarm system, and fire protection system in real time;
[0031] A data identification module, used to analyze the data collected by the data collection module and identify at least one of hot news, disaster events, road condition information and public opinion information;
[0032] The event processing module is used to send at least one hot news, disaster event, road condition information and public opinion information identified by the data identification module to the corresponding contact person.
[0033] Furthermore, the data processing and service system also includes:
[0034] The cross-departmental consultation module is used to receive consultation information published by users and establish a closed-loop management process of acceptance, distribution and feedback based on the departments corresponding to the consultation information.
[0035] The benefit of the present invention lies in that the data processing and service system provided can automatically identify news clues, intelligently generate news texts, and automatically generate corresponding workflows, and finally conduct media publishing. The whole process combines big data computing and AI technology, greatly improving the efficiency of content generation. BRIEF DESCRIPTION OF THE DRAWINGS
[0036] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.
[0037] Figure 1 It is a schematic diagram of a data processing and service system of the present invention. DETAILED DESCRIPTION
[0038] The embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present application, and should not be construed as limiting the present application.
[0039] like Figure 1 The data processing and service system of the present application is shown, which includes: a data collection module, a data analysis module, an intelligent text generation module and a task flow module.
[0040] The data collection module is used to collect and integrate data from the telephone system, website server, client application and public account platform. Specifically, the data collection module automatically collects relevant data from the telephone system, website server, client application and public account platform using API interface and SDK.
[0041] The data analysis module is used to analyze the data collected by the data integration module and identify news clues. In the implementation of the present application, the news clues identified by the data analysis module are marked with importance and urgency. Specifically, the data analysis module processes the data through big data analysis technology, identifies the importance and urgency of the news clues, and automatically classifies them into graded warnings to provide guidance for subsequent news production.
[0042] The intelligent text generation module is used to generate news text based on the news clues analyzed by the data analysis module.
[0043] In the implementation of the present application, the intelligent text generation module includes: a topic selection submodule, an intelligent manuscript writing submodule, an intelligent quality inspection submodule and an originality verification submodule. The topic selection submodule, the intelligent manuscript writing submodule, the intelligent quality inspection submodule and the originality verification submodule automatically perform corresponding operations based on artificial intelligence technology.
[0044] Specifically, the topic selection submodule is used to generate topics based on the news clues analyzed by the data analysis module. The intelligent writing submodule is used to automatically write news texts based on the topics generated by the topic selection submodule. The intelligent quality inspection submodule is used to check the quality of the news texts written by the intelligent writing submodule. The originality verification submodule is used to verify the originality of the news texts after quality inspection. The originality verification is mainly determined by checking for duplicates, and the threshold is set according to the actual situation, and then compared and determined.
[0045] In an implementation manner of the present application, the intelligent text generation module further includes: a manual quality inspection submodule.
[0046] The manual quality inspection submodule is used for the auditor to manually check the quality inspection results of the intelligent quality inspection submodule. It is understandable that there is a certain degree of inaccuracy in intelligent quality inspection. Through the manual quality inspection submodule, the auditor can manually check the quality inspection results for a second time. Manual verification can be considered as selective sampling.
[0047] The task flow module is used to establish a corresponding workflow based on the news text generated by the intelligent text generation module. Specifically, the task flow module generates different corresponding workflows based on the importance and urgency of the news clues corresponding to the news text. The aforementioned generated news text will eventually be released after going through the corresponding workflow (automatically performing process operations such as allocation and approval).
[0048] In the implementation manner of the present application, the data processing and service system further includes: a news data statistics module, a data display module and a feedback module.
[0049] The news data statistics module is used to count the relevant data in the intelligent text generation module and the task flow module. The data display module is used to display the statistical results of the news data statistics module. Using big data visualization technology, the key data and status information in the news production process are displayed in real time, and an interactive interface is provided to support management to make quick decisions and command and dispatch. The feedback module is used for users to submit feedback. Through the feedback mechanism, the user experience and opinions and suggestions of journalists and editors are collected to continuously optimize the system functions and performance. At the same time, user training and support services can also be provided to ensure the smooth operation and efficient use of the system.
[0050] In an embodiment of the present application, the data processing and service system further includes: a data collection module, a data preprocessing module, a data labeling module and a data storage module.
[0051] The data collection module is used to collect user behavior data, content production data and business operation data from various application system databases. The data preprocessing module is used to perform preprocessing operations on the data collected by the data collection module. The data labeling module is used to label the processed data according to the preset labeling strategy. The data storage module is used to store the processed data.
[0052] Specifically, through Alibaba's big data Dataworks platform, user behavior data, content production data, and business operation data are collected from the databases of various application systems. Data cleaning, conversion, integration and other technologies are used to pre-process the collected data, including removing duplicate data, filling missing values, and format conversion, to ensure data quality and consistency. The pre-processed data is stored in the data warehouse to achieve efficient storage and management of massive data. The Maxcomputer big data computing framework is used to perform real-time calculations on the stored data to support real-time data analysis and business monitoring. According to business needs and data characteristics, three sets of label systems for users, content and services are designed, including label definitions, classifications, and weights. The label annotation algorithm and rule engine are used to finely classify and annotate various types of data. Real-time and accurate matching of users and content, and users and services is achieved, fully supporting various operational scenarios such as accurate information access, intelligent content recommendation, and accurate advertising delivery.
[0053] In the implementation manner of the present application, the data processing and service system further includes: a data acquisition module, a data identification module and an event processing module.
[0054] The data collection module is used to collect data from website servers, weather stations, fire alarm systems, and fire protection systems in real time. The data identification module is used to analyze the data collected by the data collection module and identify at least one of hot news, disaster events, road conditions, and public opinion information. Machine learning algorithms and artificial intelligence technologies are used to perform real-time intelligent analysis of data.
[0055] Identify potential risks or events such as online public opinion, public revelations, emergencies, natural disasters, etc. Automatically generate warning signals based on the analysis results and determine the type and urgency of the event. The event processing module is used to send at least one hot news, disaster event, road condition information and public opinion information identified by the data identification module to the corresponding contact person.
[0056] Specifically, by collecting data from websites, weather, fire alarms, etc., it provides intelligent analysis and early warning functions in terms of online public opinion, public revelations, emergencies, natural disasters, etc., and the early warning events automatically generate media tasks and distribute them. For example, news clues can be distributed to reporters for follow-up interviews with one click; disaster warnings and road conditions information can generate early warning information with one click and be released through the omnimedia communication matrix; after monitoring negative public opinion, the responsible persons of relevant departments can be reminded in time to respond and deal with it. Through the omnimedia communication matrix, early warning information, news content, etc. are released to multiple media channels. Relevant departments or personnel respond and deal with them quickly according to the tasks. By real-time monitoring of the system operation status and task execution, the stability and efficient operation of the system are ensured. Feedback data is collected to optimize system performance and response capabilities, and continuously improve the level of agile response.
[0057] In the implementation manner of the present application, the data processing and service system further includes: a cross-departmental consultation module.
[0058] The cross-departmental consultation module is used to receive consultation information published by users, and establish a closed-loop management process of acceptance, distribution and feedback based on the departments corresponding to the consultation information.
[0059] The data processing and service system not only empowers internally, but also has the ability to provide external services. The data processing and service system integrates internal business systems to achieve data interoperability and resource sharing. Provide data analysis and visualization tools internally to help internal teams better understand user needs and market trends. Provide content creation and task management tools to improve the work efficiency of internal teams. ) Design unified API interfaces and data exchange standards externally to ensure seamless connection with external systems. Provide cross-regional, cross-departmental and cross-industry service scenario access, and support the establishment of diversified cooperation models. Through the interactive platform, coordinate several departments to establish online consulting channels and provide one-stop consulting services. Realize closed-loop management of consulting acceptance, distribution and feedback, and improve cross-departmental service efficiency. Optionally, it can also establish connections with external industry partners such as financial institutions to explore the application of financial service functions in the media field. Form cross-industry applications such as local mobile payments to provide users with a more convenient service experience.
[0060] The above shows and describes the basic principles, main features and advantages of the present invention. Those skilled in the art should understand that the above embodiments do not limit the present invention in any form, and any technical solution obtained by equivalent replacement or equivalent transformation falls within the protection scope of the present invention.
Claims
1. A data processing and service system, characterized in that: Include: Data collection module, used to collect and integrate data from telephone systems, website servers, client applications and public account platforms; A data analysis module, used to analyze the data collected by the data integration module and identify news clues; An intelligent text generation module, used to generate news text based on the news clues analyzed by the data analysis module; The task flow module is used to establish a corresponding workflow based on the news text generated by the intelligent text generation module.
2. The data processing and service system according to claim 1, characterized in that: The news clues identified by the data analysis module are marked with importance and urgency; The task flow module generates corresponding different workflows based on the importance and urgency of the news clues corresponding to the news text.
3. The data processing and service system according to claim 2, characterized in that: The data processing and service system also includes: A news data statistics module, used to count relevant data in the intelligent text generation module and the task flow module; A data display module, used to display the statistical results of the news data statistics module; Feedback module, used for users to submit feedback.
4. The data processing and service system according to claim 1, characterized in that: The intelligent text generation module comprises: A topic selection submodule, used to generate topics based on the news clues analyzed by the data analysis module; An intelligent writing submodule, used for automatically writing news text based on the topic generated by the topic selection submodule; The intelligent quality inspection submodule is used to check the quality of the news text written by the intelligent writing submodule.
5. The data processing and service system according to claim 4, characterized in that: The intelligent text generation module also includes: The originality verification submodule is used to verify the originality of news texts that have passed quality inspection.
6. The data processing and service system according to claim 4, characterized in that: The intelligent text generation module also includes: The manual quality inspection submodule is used for the inspectors to manually inspect the quality inspection results of the intelligent quality inspection submodule.
7. The data processing and service system according to claim 1, characterized in that: The data processing and service system also includes: The data collection module is used to collect user behavior data, content production data and business operation data from various application system databases; A data preprocessing module, used to perform preprocessing operations on the data collected by the data collection module; A data labeling module is used to label the processed data according to a preset labeling strategy; The data storage module is used to store the processed data.
8. The data processing and service system according to claim 7, characterized in that: The preset labeling strategies include user labeling system, content labeling system and service labeling system.
9. The data processing and service system according to claim 1, characterized in that: The data processing and service system also includes: The data acquisition module is used to collect data from the website server, weather station, fire alarm system, and fire protection system in real time; A data identification module, used to analyze the data collected by the data collection module and identify at least one of hot news, disaster events, road condition information and public opinion information; The event processing module is used to send at least one hot news, disaster event, road condition information and public opinion information identified by the data identification module to the corresponding contact person.
10. The data processing and service system according to claim 1, characterized in that: The data processing and service system also includes: The cross-departmental consultation module is used to receive consultation information published by users and establish a closed-loop management process of acceptance, distribution and feedback based on the departments corresponding to the consultation information.