Intelligent data intercommunication modeling system and method

Abstract

The invention belongs to the technical field of data modeling, and discloses an intelligent data intercommunication modeling system. The data intelligent intercommunication modeling system is composed of a data acquisition module, a data structure, a data transmission module, a data storage module, a data query module, a data application module, a data presentation module, a data analysis module, a data calculation module and a data credit module. A complete data processing closed loop is formed through a plurality of links of data acquisition, storage, transmission, query, analysis, calculation, credit evaluation and the like, the modeling system can efficiently process large-scale, complex and diversified data through the comprehensive data processing and definition, intelligent cognition is achieved, diversified modeling requirements are met, and the modeling efficiency is improved. Through data credit evaluation, credit evaluation is carried out on the data and the source thereof, an important selection basis is provided for data application, and improvement of the reliability and credibility of the data is facilitated.

Description

Technical Field

[0001] The present invention belongs to the technical field of data modeling, and specifically relates to a data intelligent intercommunication modeling system and method. Background Art

[0002] The big language model is a data modeling solution in the field of natural language. It can handle a variety of natural language tasks, such as text classification, question and answer, dialogue, etc. It is an important path to artificial intelligence. With the rise of ChatGPT, domestic companies such as Baidu, Alibaba, Tencent, etc. have relied on their own data platforms to quickly develop large language models with independent intellectual property rights (such as Wenxin Yiyan, Tongyi Qianwen, Hunyuan, etc.), and accelerate market applications, significantly promoting the development of my country's Internet big model field.

[0003] However, the public's understanding of big language models is still shallow, and there is a phenomenon of reliance on foreign products. It is difficult to define data modeling in Chinese. In other fields, various industries need to develop various specialized data models and systems based on their own business needs and data characteristics. However, due to the lack of clarity on how to carry out similar data model construction in various industries, these models are not as open, universal and highly intelligent as big language models.

[0004] At present, facing the current situation of lack of cognition and limited application of large language models, the proposal of data modeling scheme is particularly important, so a data intelligent interoperable modeling system and method is needed. Summary of the invention

[0005] The purpose of the present invention is to provide a data intelligent intercommunication modeling system and method to solve the problems raised in the above-mentioned background technology.

[0006] In order to achieve the above-mentioned objectives, the present invention provides the following technical solutions: a data intelligent intercommunication modeling system, which is composed of a data acquisition module, a data structure, a data transmission module, a data storage module, a data query module, a data application module, a data presentation module, a data analysis module, a data calculation module and a data credit module.

[0007] Preferably, the data acquisition module records Internet data through acquisition devices and services, and parses it into an agreed data structure. The data acquisition module collects data from other homologous data centers through the API of the data query module.

[0008] Preferably, a commonly used database is set up in the data storage module, which can classify and store data collection information and establish indexes. The data transmission module is responsible for transferring the standard data structure collected and sorted by the data collection module to the database, and the data presentation module is responsible for presenting the data in the database in the form of a UI.

[0009] Preferably, the data query module provides an API for data access and management, and the data application module builds a dedicated intelligent data center and application through the API of the data query module and provides core implementation.

[0010] Preferably, the data analysis module analyzes, identifies and supplements the records of the stored data, and the data calculation module performs complex mathematical calculations on the measurable data and supports the configuration and use of multiple calculation plug-ins.

[0011] Preferably, the data credit module performs credit assessment on the data and its source based on the results of the data analysis module and the data calculation module, provides a selection basis for the data application module stage, and affects the frequency and deployment scale of data collection.

[0012] Preferably, the data structure is a set of standard data structures for systematically describing and representing specific things and their related behaviors.

[0013] Preferably, the data intelligent intercommunication modeling method includes data processing and data application, and the specific process of the data processing is:

[0014] A1, the data collection module first collects a wide range of diverse data on the Internet through collection devices and services, and records the key information of the data;

[0015] A2, these data will be parsed into a unified agreed data structure to ensure the standardization and processability of the data;

[0016] A3, then, the data transmission module is responsible for safely and efficiently transmitting these standardized data structures to the data storage module for centralized management;

[0017] A4, during the data storage stage, these data are not only stored securely, but also provide external access and management interfaces through the data query module API, laying the foundation for subsequent data applications.

[0018] Preferably, the specific process of the data application is:

[0019] B1, the data application module takes the data query module API as the core, builds a dedicated intelligent data center and application, and realizes the registration and discovery of the same source data center;

[0020] B2, through the data presentation module, it uses the UI interface to present the complex data in the data storage module in an intuitive and easy-to-understand way;

[0021] B3,At the same time, the data analysis module and the data calculation module conduct in-depth mining and processing of the stored data to further explore the potential value of the data;

[0022] B4,Finally, the data credit module evaluates the credit of the data and its source based on the analysis results and calculated data;

[0023] B5, the evaluation results provide an important selection basis for the data application module, and indirectly affect the execution frequency and deployment scale of the data acquisition module, forming a closed-loop data application and feedback mechanism.

[0024] The beneficial effects of the present invention are as follows:

[0025] 1. The present invention forms a complete data processing closed loop through multiple links such as data collection, storage, transmission, query, analysis, calculation and credit evaluation. This comprehensive data processing and definition enables the modeling system to efficiently process large-scale, complex and diverse data, realize intelligent cognition, and meet diverse modeling needs. Through data credit evaluation, the data and its source are credit-rated, which provides an important selection basis for data application, helps to improve the reliability and credibility of data, and reduce the risk and uncertainty of data application.

[0026] 2. The present invention introduces a data presentation link so that data can be presented to users in an intuitive and easy-to-understand manner, thereby improving the readability and usability of the data, helping users to better understand the information behind the data, and promoting the widespread dissemination and application of data. At the same time, by supporting the registration and discovery of homologous data centers, the present invention promotes the sharing and interoperability of data resources, helps to break down data silos, and achieves optimal allocation and efficient utilization of data resources. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 This is a network architecture diagram of the present invention;

[0028] Figure 2 This is a scene description diagram of the present invention.

[0029] In the figure: 101, data acquisition module; 102, data structure; 103, data transmission module; 104, data storage module; 105, data query module; 106, data application module; 107, data presentation module; 108, data analysis module; 109, data calculation module; 110, data credit module. DETAILED DESCRIPTION

[0030] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0031] like Figure 1 to Figure 2 As shown, an embodiment of the present invention provides a data intelligent intercommunication modeling system, which is composed of a data acquisition module 101, a data structure 102, a data transmission module 103, a data storage module 104, a data query module 105, a data application module 106, a data presentation module 107, a data analysis module 108, a data calculation module 109 and a data credit module 110.

[0032] The data intelligent interoperability modeling system forms a closed loop from data collection to data application and then to data credit assessment, ensuring the accuracy, validity and credibility of the data and providing a solid foundation for data-driven decision-making.

[0033] Through multiple links such as data collection, storage, transmission, query, analysis, calculation and credit evaluation, a complete data processing closed loop is formed. This comprehensive data processing and definition enables the modeling system to efficiently process large-scale, complex and diverse data, realize intelligent cognition, and meet diverse modeling needs. Through data credit evaluation, the data and its source are rated for credit, which provides an important selection basis for data application, helps to improve the reliability and credibility of data, and reduce the risk and uncertainty of data application.

[0034] By introducing the data display link, the data can be presented to users in an intuitive and easy-to-understand way, which improves the readability and usability of the data, helps users better understand the information behind the data, and promotes the widespread dissemination and application of data. At the same time, by supporting the registration and discovery of homologous data centers, it promotes the sharing and interoperability of data resources, helps break down data silos, and achieves optimal allocation and efficient utilization of data resources.

[0035] Among them, the data collection module 101 records Internet data text, voice, video, picture, source, location, time, dimension, measurement, emotion, feeling, action and character information through collection equipment and services, and parses it into the agreed data structure 102. The data collection module 101 collects data from other data application systems built based on this solution from other homologous data centers through the API of the data query module 105.

[0036] Among them, the data storage module 104 is equipped with a commonly used database, which can classify and store data collection information and establish an index. The data transmission module 103 is responsible for passing the standard data structure 102 collected and sorted by the data collection module 101 to the database. The data presentation module 107 is responsible for presenting the data in the database in the form of a UI.

[0037] The databases provided in the data storage module 104 include, but are not limited to, relational databases, time series databases, image databases, file databases, and NoSQL databases;

[0038] The data presentation module 107 provides the most basic query interface for the data in the data storage module 104 and supports common services such as statistical alarms.

[0039] Among them, the data query module 105 provides an API for data access and management, and the data application module 106 builds a dedicated intelligent data center and application through the API of the data query module 105, and provides core implementation to support homologous data center registration and discovery.

[0040] Among them, the data analysis module 108 analyzes and identifies the stored data and supplements the records of facts, behaviors, events, emotions, feelings, actions, characters, etc., and supports custom data analysis plug-ins. The data calculation module 109 performs complex mathematical calculations on measurable data and supports the configuration and use of multiple calculation plug-ins.

[0041] The data credit module 110 performs credit assessment on the data and its source based on the results of the data analysis module 108 and the data calculation module 109, provides a selection basis for the data application module 106 stage, and affects the frequency and deployment scale of data collection.

[0042] The data credit module 110 performs credit assessment on the data that has been analyzed and calculated, and calculates credit points based on user feedback. Data with insufficient credit will be marked, and credit warnings will be issued to users when the data is displayed in the data application module 106.

[0043] The data structure 102 is a set of standard data structures used to systematically describe and represent specific things and their related behaviors, including but not limited to keywords, words, videos, pictures, data sources, locations, time, dimensions, metrics, emotions, feelings, actions, data objects, whether the data can be used for analysis and calculation, and other customized business fields.

[0044] Among them, the data intelligent intercommunication modeling method includes data processing and data application. The specific process of data processing is:

[0045] A1, the data collection module 101 first collects a wide range of data on the Internet including text, voice, video, pictures, etc. through collection devices and services, and records key information of the data including source, location, time, dimension, measurement, emotion, feeling, action and person;

[0046] A2, these data will be parsed into a uniformly agreed data structure 102 to ensure the standardization and processability of the data;

[0047] A3, then, the data transmission module 103 is responsible for safely and efficiently transmitting these standardized data structures 102 to the data storage module 104 for centralized management;

[0048] A4, during the data storage stage, these data are not only stored securely, but also provide external access and management interfaces through the data query module 105 API, laying the foundation for subsequent data applications.

[0049] The specific process of data application is as follows:

[0050] B1, the data application module 106 takes the data query module 105 API as the core, builds a dedicated intelligent data center and application, realizes the registration and discovery of the same source data center, and promotes the sharing and utilization of data resources;

[0051] Users access the data center data query API through data applications to obtain data. The data center provides a data query API to the outside world and supports registration and discovery of other data centers. The data center's data collection service obtains data from the Internet and other data centers.

[0052] B2, through the data presentation module 107, it uses the UI interface to present the complex data in the data storage module 104 in an intuitive and easy-to-understand manner;

[0053] Improve the readability and usability of data;

[0054] B3, at the same time, the data analysis module 108 and the data calculation module 109 conduct in-depth mining and processing of the stored data. By configuring a variety of analysis plug-ins and calculation algorithms, they conduct comprehensive analysis and calculation of facts, behaviors, events, emotions, feelings, actions, characters, etc., and further explore the potential value of the data;

[0055] B4, finally, the data credit module 110 performs credit assessment on the data and its source based on the analysis results and calculated data;

[0056] B5, the evaluation results provide an important selection basis for the data application module 106, and indirectly affect the execution frequency and deployment scale of the data acquisition module 101, forming a closed-loop data application and feedback mechanism.

[0057] Data credit rating, as a reference for data quality and usage value.

[0058] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.

[0059] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. Data intelligent intercommunication modeling system, characterized by: The data intelligent intercommunication modeling system is composed of a data acquisition module (101), a data structure (102), a data transmission module (103), a data storage module (104), a data query module (105), a data application module (106), a data presentation module (107), a data analysis module (108), a data calculation module (109) and a data credit module (110).

2. The data intelligent intercommunication modeling system according to claim 1, characterized in that: The data collection module (101) records Internet data through collection equipment and services, and parses it into a predetermined data structure (102). The data collection module (101) collects data from other homologous data centers through the API of the data query module (105).

3. The data intelligent intercommunication modeling system according to claim 1, characterized in that: The data storage module (104) is provided with a commonly used database, which can classify and store data collection information and create an index. The data transmission module (103) is responsible for transmitting the standard data structure (102) collected and sorted by the data collection module (101) to the database. The data presentation module (107) is responsible for presenting the data in the database in the form of a UI.

4. The data intelligent intercommunication modeling system according to claim 1, characterized in that: The data query module (105) provides an API for data access and management, and the data application module (106) builds a dedicated intelligent data center and application through the API of the data query module (105) and provides core implementation.

5. The data intelligent intercommunication modeling system according to claim 1, characterized in that: The data analysis module (108) analyzes, identifies and supplements the records of the stored data, and the data calculation module (109) performs complex mathematical calculations on the measurable data and supports the configuration and use of multiple calculation plug-ins.

6. The data intelligent intercommunication modeling system according to claim 1, characterized in that: The data credit module (110) performs credit assessment on the data and its source based on the results of the data analysis module (108) and the data calculation module (109), provides a selection basis for the data application module (106) stage, and affects the frequency and deployment scale of data collection.

7. The data intelligent intercommunication modeling system according to claim 1, characterized in that: The data structure (102) is a set of standard data structures used to systematically describe and represent specific things and their related behaviors.

8. A data intelligent intercommunication modeling method, characterized by: The data intelligent intercommunication modeling method includes data processing and data application. The specific process of the data processing is as follows: A1, the data collection module (101) first collects a wide range of diverse data on the Internet through collection devices and services, and records key information of the data; A2, these data will be parsed into a uniformly agreed data structure (102) to ensure the standardization and processability of the data; A3, then, the data transmission module (103) is responsible for safely and efficiently transmitting these standardized data structures (102) to the data storage module (104) for centralized management; A4, during the data storage stage, these data are not only stored securely, but also provide an interface for external access and management through the data query module (105) API, laying the foundation for subsequent data applications.

9. The data intelligent intercommunication modeling method according to claim 8, characterized in that: The specific process of the data application is as follows: B1, the data application module (106) takes the data query module (105) API as the core, builds a dedicated intelligent data center and application, and realizes the registration and discovery of the same source data center; B2, through the data presentation module (107), the complex data in the data storage module (104) is presented in an intuitive and easy-to-understand manner using a UI interface; B3, at the same time, the data analysis module (108) and the data calculation module (109) conduct in-depth mining and processing of the stored data to further explore the potential value of the data; B4, finally, the data credit module (110) performs credit assessment on the data and its source based on the analysis results and calculated data; B5, the evaluation results provide an important basis for the selection of the data application module (106), and indirectly affect the execution frequency and deployment scale of the data acquisition module (101), forming a closed-loop data application and feedback mechanism.

Images