Data management platform of AI ecological big model intelligent service system

Abstract

The invention relates to the technical field of intelligent management platforms, discloses an AI ecological large model intelligent service system data management platform, and solves the problem that in the use process of an existing intelligent service platform management system, only the function of processing and querying data can be achieved, and data in the system cannot be updated and changed. The effect of further analyzing and processing related data is achieved, and meanwhile, the data of the system can be updated.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent management platforms, and specifically to a data management platform for an AI ecological large-scale model intelligent service system. Background Art

[0002] The data management platform is a one-stop data management platform that supports the entire life cycle of data. It aims to help enterprises efficiently and safely mine data value and promote digital transformation. DMS provides functions such as global data asset management, data governance, database design and development, data integration, data development and data consumption to ensure that enterprises can "find" and "use" data well. The main functions include the following: Global data asset management: support metadata management across cloud environments to ensure clear data lineage and facilitate quality standards and security governance; data governance: provide data quality management and security governance to ensure data accuracy and security; database design and development: support database design, development and integration, and simplify the complexity of data processing; data integration: achieve real-time synchronization of different data sources to ensure data accuracy and consistency; intelligent data development: use artificial intelligence technologies such as NL2SQL and SQL continuation to improve development efficiency.

[0003] Data management platforms are widely used in enterprise data management, helping enterprises to efficiently manage internal data and improve data utilization. In addition, it is also suitable for scenarios that require large amounts of data processing and analysis, such as scientific research, big data analysis, etc.

[0004] For example, the application number CN202010487578.X discloses an artificial intelligence service platform management system based on big data, which involves the technical field of intelligent service platform. It includes an intelligent service management platform, a property management unit, an inquiry service center, a financial payment unit and an information sharing unit. An intelligent controller is arranged inside the intelligent service management platform, and the output end of the intelligent controller is bidirectionally electrically connected to the input end of the property management unit, the inquiry service center and the financial payment unit. It has the characteristics of achieving the purpose of big data management, intelligent management and improving work efficiency. The existing intelligent service platform management system can only process and query data during use. When the user needs to store data, it cannot discover potential risks in time.

[0005] In view of the above problems, a data management platform for AI ecological large model intelligent service system is proposed. Summary of the invention

[0006] The purpose of the present invention is to provide an AI ecological large-scale model intelligent service system data management platform, which adopts this device to work, thereby solving the problem that the existing intelligent service platform management system can only process and query data during use, and when the user needs to store data, it cannot discover potential risks in time.

[0007] To achieve the above objectives, the present invention provides the following technical solutions: an AI ecological large-model intelligent service system data management platform, including a microservice architecture module, a real-time data update module, a security and privacy protection module, and a system optimization module. The microservice architecture module is used to modularize data collection, processing, storage, and analysis to ensure the independence and synergy of each part, so as to improve the stability of the overall system operation;

[0008] The microservice architecture module includes a data collection module, a data processing and analysis module, and a display module. The data collection module can collect external information, and the data analysis and processing module can analyze and process the data, including removing distortion and other interference factors in the data to avoid unnecessary errors.

[0009] The real-time data update module can collect and analyze the external big data and then update the relevant data within the system to ensure that the overall system can learn the latest data in a timely manner and maintain the timeliness and accuracy of decision-making;

[0010] The security and privacy protection module can protect the user's personal information, prevent malicious users from stealing other users' personal information, and ensure the security of data during transmission and storage. The security and privacy protection module also includes a data monitoring module, which can monitor the data of the entire system.

[0011] The system optimization module can automatically adjust computing resources according to actual load through dynamic resource allocation technology, improve the system's processing power and response speed, and thus enhance the user experience.

[0012] Preferably, the data collection module can integrate the data analysis and processing module to improve the overall data analysis and processing efficiency, which can help staff to process big data and save staff workload.

[0013] Preferably, the display module can display the collected data so that the user can compare the data and perform relevant operations, which greatly facilitates the staff to process and observe the relevant data.

[0014] Preferably, the real-time data update module can be connected to the microservice architecture module, and can update the relevant data of the microservice architecture module according to the actual external situation to avoid user operation errors caused by outdated data.

[0015] Preferably, the data analysis and processing module uses an adaptive machine learning algorithm to pre-process, classify and analyze the data, and can automatically adjust the processing flow and parameters according to data changes, effectively improving the working efficiency of the overall system.

[0016] Preferably, the security and privacy protection module is connected to the microservice architecture module and adopts advanced encryption technology access control strategy to ensure the security of data during transmission and storage. Among them, the security and privacy protection module uses differential privacy technology to process personal sensitive information, protect user privacy, and greatly improve the security of the overall device.

[0017] Preferably, the system optimization module can be connected to the microservice architecture module. During use, the modules that are no longer in use can be closed to improve the overall system work efficiency and avoid system freezes that cause poor user experience.

[0018] Preferably, the data monitoring module can be connected to the microservice architecture module, and can monitor the data in cooperation with the security and privacy protection module to prevent data anomalies from causing system disorders, thereby further strengthening the anti-theft function of the security and privacy protection module.

[0019] Compared with the prior art, the present invention has the following beneficial effects:

[0020] 1. The present application proposes an AI ecological large-model intelligent service system data management platform, which solves the problem that the existing intelligent service platform management system can only process and query data during use, but cannot update and change the data within the system. The data collection module of the microservice architecture module can collect external data and display the data in the display module so that users can learn about relevant data more quickly and make corresponding adjustments. The data collection module can also clean, filter, normalize and process the collected raw data to improve data quality, and pass the overall data to the data processing and analysis module for analysis and processing. When the data in the microservice architecture module needs to be updated according to actual conditions over time, the real-time data update module can operate through triggers, set triggers in the database, and automatically execute operations when specific events occur, capture and save data changes in the database, and apply these changes to the target database or data warehouse to achieve real-time updates, so that subsequent users can still use the system, realizing the ability to further analyze and process related data, and at the same time being able to update its own data.

[0021] 2. The present application proposes a data management platform for an AI ecological large-scale intelligent service system, which solves the problem that most existing intelligent service platform management systems lack protective measures and cannot protect data. When users need to store data, they cannot promptly discover potential risks and are prone to data leakage. After the data processing and analysis module analyzes and processes the input data, the data can be processed by the security and privacy protection module, wherein the security and privacy protection module is implemented using differential privacy technology, and differential privacy protects user privacy by adding random noise to the data. This noise can be Laplace noise, Gaussian noise, etc. In this way, even if the attacker obtains all record information except a specified record, it is impossible to determine the privacy data contained in this record, ensuring the security of the data during transmission and storage, preventing malicious users or programs from stealing data, and protecting user privacy. The system performance optimization achieves the effect of improving the security of user data and avoiding data leakage or theft.

[0022] 3. The AI ​​ecological large-model intelligent service system data management platform proposed in this application solves the problem that the existing intelligent service platform management system often does not have the function of optimizing itself. After long-term use, the processing power and response speed will decrease, which is not conducive to user use. The system optimization module can be connected to the microservice architecture module to enable the load to automatically adjust the calculation by monitoring and analyzing the system load, such as CPU usage, memory usage, etc., and automatically adjust resource allocation to optimize system performance and response speed, so that users will not encounter system freezes when using the system, thereby improving the response rate of the overall system, realizing the ability to optimize the system itself during use, and improving the use effect of the system. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 It is a schematic diagram of the overall system flow of the present invention;

[0024] Figure 2 This is a structural diagram of the placement groove and the sliding block of the present invention;

[0025] Figure 3 It is a structural diagram of the mobile mechanism of the present invention. DETAILED DESCRIPTION

[0026] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0027] In order to further understand the content of the present invention, the present invention is described in detail in conjunction with the accompanying drawings.

[0028] Combination Figure 1 - Figure 3 , an AI ecological large-model intelligent service system data management platform, including a microservice architecture module, a real-time data update module, a security and privacy protection module, and a system optimization module. The microservice architecture module is used to modularize data collection, processing, storage, and analysis to ensure the independence and coordination of each part, so as to improve the stability of the overall system;

[0029] The microservice architecture module includes a data collection module, a data processing and analysis module, and a display module. The data collection module can collect external information, and the data analysis and processing module can analyze and process the data, including removing distortion and other interference factors in the data to avoid unnecessary mistakes.

[0030] The real-time data update module can collect, analyze and process external big data, and then update the relevant data within the system to ensure that the entire system can learn the latest data in a timely manner and maintain the timeliness and accuracy of decision-making;

[0031] The security and privacy protection module can protect the user's personal information, prevent malicious users from stealing other users' personal information, and ensure the security of data during transmission and storage. The security and privacy protection module also includes a data monitoring module, which can monitor the data of the entire system.

[0032] The system optimization module can automatically adjust computing resources according to actual load through dynamic resource allocation technology, improve the system's processing power and response speed, and thus enhance the user experience.

[0033] The data collection module can integrate the data analysis and processing modules to improve the overall data analysis and processing efficiency, which can help staff process big data and save staff workload.

[0034] The display module can display the collected data so that users can compare the data and make relevant operations, which greatly facilitates the staff to process and observe the relevant data.

[0035] The real-time data update module can be connected to the microservice architecture module, and can update the relevant data of the microservice architecture module according to the actual external situation to avoid user operation errors caused by outdated data.

[0036] The data analysis and processing module uses an adaptive machine learning algorithm to pre-process, classify and analyze data. It can automatically adjust the processing flow and parameters according to data changes, effectively improving the overall system efficiency.

[0037] The security and privacy protection module is connected to the microservice architecture module and adopts advanced encryption technology access control strategies to ensure the security of data during transmission and storage. Among them, the security and privacy protection module uses differential privacy technology to process personal sensitive information, protect user privacy, and greatly improve the security of the overall device.

[0038] The system optimization module can be connected to the microservice architecture module. During use, the modules that are no longer in use can be closed to improve the overall system efficiency and avoid system freezes that cause poor user experience.

[0039] The data monitoring module can be connected to the microservice architecture module, and can monitor the data in coordination with the security and privacy protection module to prevent data anomalies from causing system disorders, and further strengthen the anti-theft function of the security and privacy protection module.

[0040] The present invention will be further described below in conjunction with the embodiments.

[0041] Embodiment 1:

[0042] In order to solve the problem that the existing intelligent service platform management system can only process and query data during use, but cannot update and change the data inside the system, this embodiment discloses the following technical solutions, specifically: Figure 1 - Figure 3 As shown, the data collection module of the microservice architecture module can collect external data and display the data in the display module so that users can learn about relevant data more quickly and make corresponding adjustments. The data collection module can also clean, filter, normalize and process the collected raw data to improve data quality, and pass the overall data to the data processing and analysis module for analysis and processing. As time goes by, the data in the microservice architecture module needs to be updated according to actual conditions. The real-time data update module can operate through triggers, set triggers in the database, and automatically execute operations when specific events occur, capture and save data changes in the database, and apply these changes to the target database or data warehouse to achieve real-time updates, so that subsequent users can still use the system, realizing the role of further analysis and processing of related data, and at the same time being able to update its own data.

[0043] At the same time, in order to solve the problem that most of the existing intelligent service platform management systems lack protective measures and cannot protect data, when users need to store data, they cannot discover potential risks in time, and data leakage is prone to occur, this embodiment also discloses the following scheme: after the data processing and analysis module analyzes and processes the input data, the data can be processed by the security and privacy protection module, wherein the security and privacy protection module is implemented by differential privacy technology, and differential privacy protects user privacy by adding random noise to the data. This noise can be Laplace noise, Gaussian noise, etc. In this way, even if the attacker obtains all record information except a specified record, it is impossible to determine the privacy data contained in this record, ensuring the security of the data during transmission and storage, avoiding external malicious users or programs from stealing data, and protecting user privacy. The system performance optimization achieves the effect of improving the security of user data and avoiding data leakage or theft.

[0044] At the same time, in order to solve the problem that the existing intelligent service platform management system often does not have the function of optimizing itself, and after long-term use, the processing power and response speed will decrease, which is not conducive to user use, the present embodiment also discloses the following solution: through the setting that the system optimization module can be connected with the microservice architecture module, the load automatic adjustment calculation is made by monitoring and analyzing the system load, such as CPU usage, memory usage, etc., and automatically adjusting resource allocation to optimize system performance and response speed, so that users will not encounter system freezes when using the system, thereby improving the reaction rate of the overall system, realizing the optimization effect of the system itself during use, and improving the use effect of the system.

[0045] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.

[0046] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. An AI ecological large-scale model intelligent service system data management platform, including a microservice architecture module, a real-time data update module, a security and privacy protection module, and a system optimization module, characterized by: The microservice architecture module is used to modularize data collection, processing, storage and analysis to ensure the independence and coordination of each part, so as to improve the stability of the overall system operation; The microservice architecture module includes a data collection module, a data processing and analysis module, and a display module. The data collection module can collect external information, and the data analysis and processing module can analyze and process the data, including removing distortion and other interference factors in the data to avoid unnecessary errors. The real-time data update module can collect and analyze the external big data and then update the relevant data within the system to ensure that the overall system can learn the latest data in a timely manner and maintain the timeliness and accuracy of decision-making; The security and privacy protection module can protect the user's personal information, prevent malicious users from stealing other users' personal information, and ensure the security of data during transmission and storage. The security and privacy protection module also includes a data monitoring module, which can monitor the data of the entire system. The system optimization module can automatically adjust computing resources according to actual load through dynamic resource allocation technology, improve the system's processing capability and response speed, and thus enhance the user experience.

2. According to claim 1, an AI ecological large model intelligent service system data management platform is characterized by: The data collection module can integrate the data analysis and processing modules to improve the analysis and processing efficiency of the overall data, which can help staff to process big data and save staff workload.

3. According to claim 1, an AI ecological large model intelligent service system data management platform is characterized by: The display module can display the collected data so that users can compare the data and perform related operations, which greatly facilitates the staff to process and observe the relevant data.

4. According to claim 1, the AI ​​ecological large model intelligent service system data management platform is characterized by: The real-time data update module can be connected to the microservice architecture module, and can update the relevant data of the microservice architecture module according to the actual external situation to avoid user operation errors caused by outdated data.

5. According to claim 1, the AI ​​ecological large model intelligent service system data management platform is characterized by: The data analysis and processing module uses an adaptive machine learning algorithm to pre-process, classify and analyze data, and can automatically adjust processing procedures and parameters according to data changes, effectively improving the work efficiency of the overall system.

6. According to claim 1, an AI ecological large model intelligent service system data management platform is characterized by: The security and privacy protection module is connected to the microservice architecture module and adopts advanced encryption technology access control strategy to ensure the security of data during transmission and storage. Among them, the security and privacy protection module uses differential privacy technology to process personal sensitive information, protect user privacy, and greatly improve the security of the overall device.

7. The AI ​​ecological large model intelligent service system data management platform according to claim 1 is characterized by: The system optimization module can be connected to the microservice architecture module. During use, the modules that are no longer in use can be closed to improve the overall system work efficiency and avoid system freezes that cause poor user experience.

8. According to claim 1, the AI ​​ecological large model intelligent service system data management platform is characterized by: The data monitoring module can be connected to the microservice architecture module, and can monitor the data in cooperation with the security and privacy protection module to prevent data anomalies from causing system disorders, thereby further strengthening the anti-theft function of the security and privacy protection module.

Images