Data warehouse system and data processing system for nuclear fusion data standardization

By designing a standardized data warehouse architecture in the field of nuclear fusion, the problems of data management and sharing are solved, the standardized management and sharing of data are realized, and the efficiency of nuclear fusion research is improved.

CN117743476BActive Publication Date: 2024-11-26ZHEJIANG LAB
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
CN202311554759.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-11-21
Publication Date
2024-11-26
Estimated Expiration
2043-11-21

AI Technical Summary

Technical Problem

There is a lack of unified standards for data in the field of nuclear fusion, uneven data quality, and difficulty in traceability, which has led to scientific researchers spending a lot of time on data understanding, screening, conversion and verification, affecting work efficiency.

Method used

A data warehouse architecture for nuclear fusion data standardization is designed, including loosely coupled operational data layer, data standard layer, semantic standard layer, analysis standard layer and data application layer, through these levels, the nuclear fusion data is cleaned and standardized. , analytical and classification, and provide a standardized data management and sharing system.

Benefits of technology

The standardized management of nuclear fusion data has been realized, the barriers to understanding and cognitive ambiguity have been eliminated, data sharing and reliability have been improved, data interpretation and analysis have been simplified, and scientific research efficiency has been improved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117743476B_ABST
    Figure CN117743476B_ABST
Patent Text Reader

Abstract

The invention discloses a data warehouse architecture and a data processing system for nuclear fusion data standardization, comprising: an operational data layer, used for extracting and transferring nuclear fusion business data, the nuclear fusion business data comprising: nuclear fusion data business operation data, nuclear fusion physics / business entity data, and fusion experiment data; a data standard layer, used for cleaning and standardizing the nuclear fusion business data through a data tool set; a semantic standard layer, used for obtaining fact tables and data dimension tables based on the nuclear fusion business data; establishing a snowflake model according to the nuclear fusion data business to maintain the fact table and the data dimension table; and establishing a relationship between the fusion experiment data and the fact table and the data dimension table to obtain a data wide table; an analysis standard layer, used for subject-classifying the data wide table provided by the semantic standard layer to obtain the data wide table under each subject; and a data application layer, used for aggregating or converting the data wide surface under each subject to a target dimension.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention belongs to the field of nuclear fusion data processing and discloses a data warehouse system and a data processing system oriented to nuclear fusion data standardization. Background Art

[0002] Nuclear fusion refers to the process in which small atoms (such as deuterium and tritium, isotopes of hydrogen) are attracted to each other and collide with each other under extremely high temperatures and pressures, causing the nuclei to fuse together and generate new heavier nuclei (such as helium) and other particles. In the process of nuclear fusion, a large number of electrons and neutrons are released in the nuclear fusion reaction, which manifests as a huge release of energy. Nuclear fusion has been widely regarded as the main way to provide sustainable and clean energy for mankind in the future. Uncontrolled nuclear fusion technology has been achieved (such as the explosion of a hydrogen bomb). Current research focuses on controlled nuclear fusion technology, which aims to achieve controlled and continuous fusion reactions through artificial means and apply them to future energy production.

[0003] The core issue of controlled nuclear fusion technology is how to constrain atoms within a certain range to produce more atomic aggregation. The current main research direction is magnetic confinement fusion. Globally, there are many tokamak scientific devices used for magnetic confinement fusion experiments, such as China's East Fausto Nuclear Fusion Device (EAST), China's Tokamak 2M Device (HL-2M), and the National Ignition Facility (NIF) of the United States. Since the physical mechanism involved in magnetic confinement fusion is still under continuous exploration, the system structure of the tokamak device is also relatively complex, including many subsystems and measurement windows. The amount of data directly generated by each fusion experiment conducted on the tokamak device is in the order of tens of GB. The data scale for simulation or comprehensive diagnosis based on the original experimental data is even larger, and contains a large number of data of different categories and structures.

[0004] In general, data in the field of nuclear fusion have the following obvious characteristics:

[0005] (1) There are many data models and specifications, and no unified standard;

[0006] (2) Data quality is uneven and value density is low;

[0007] (3) Data traceability is difficult and lacks credibility verification;

[0008] (4) There are many roles and requirements, and there are barriers to understanding data. Due to the above problems, when conducting data analysis, researchers and engineers in the fusion field need to spend about 70% of their time on understanding, screening, converting, and verifying data, which affects overall work efficiency.

[0009] For the data management problem in the field of nuclear fusion, building a nuclear fusion data warehouse is a more appropriate solution. Data warehouses have been relatively maturely applied in the fields of finance, Internet, telecommunications and medical care, and have greatly optimized the analysis and management of large-scale, multi-source heterogeneous data.

[0010] However, there are significant differences in data between the fusion field and the fields where data warehouse technology has been successfully applied. The differences are mainly as follows:

[0011] (1) Data in the field of nuclear fusion are often numerical data with high numerical precision, high dimension, large scale, and strong correlation with experiments. The data are directly or indirectly derived from the input data or diagnostic data of a certain experiment;

[0012] (2) Data in the field of nuclear fusion is highly specialized and has barriers to understanding. Semantic interpretation requires the use of metadata such as source, unit, meaning description, and format description. The lack of any information may lead to ambiguity in understanding.

[0013] (3) Data in the field of nuclear fusion often reflect the complex nuclear physics principles or mechanisms behind fusion. Actual data analysis requires complex physical deductions or AI algorithms, and it is difficult to interpret data patterns using traditional data analysis methods.

[0014] Based on the above differences, it is urgent to propose a data warehouse architecture for nuclear fusion data standardization, establish a standardized nuclear fusion data management and sharing system, meet the needs of data sharing in the fusion field, avoid data island problems, and improve scientific research efficiency in the fusion field. Summary of the invention

[0015] In view of this, the present invention provides a data warehouse architecture and a data processing system for nuclear fusion data standardization.

[0016] In a first aspect, an embodiment of the present invention provides a data warehouse architecture for nuclear fusion data standardization, wherein the data warehouse architecture includes a loosely coupled operational data layer, a data standard layer, a semantic standard layer, an analysis standard layer, a data application layer, and a data tool set;

[0017] The operational data layer is used to extract and transfer nuclear fusion business data from the SQL database of the nuclear fusion data business system; the nuclear fusion business data includes: nuclear fusion data business operation data, nuclear fusion physics / business entity data, and fusion experiment data;

[0018] The data standard layer is used to clean and standardize nuclear fusion business data through a data tool set;

[0019] The semantic standard layer is used to parse the cleaned nuclear fusion data business operation data to obtain the fact table; parse the cleaned nuclear fusion physics / business entity data to obtain the data dimension table; establish a snowflake model to maintain the fact table and data dimension table according to the nuclear fusion data business; and establish a relationship between the fusion experiment data and the fact table and data dimension table according to the experiment ID to obtain the data wide table;

[0020] The analysis standard layer is used to classify the data wide table provided by the semantic standard layer into topics and obtain the data wide table under each topic;

[0021] The data application layer is used to aggregate or transform the data wide tables under each topic provided by the analysis standard layer towards the target dimension according to external data application requirements.

[0022] In a second aspect, an embodiment of the present invention provides a data processing system for nuclear fusion data standardization, including the above-mentioned data warehouse architecture for nuclear fusion data standardization, fusion data service system, and fusion data business system;

[0023] The fusion data service system is used for data storage, data query, data reading, data tool use, data maintenance, and fusion data category information query; the fusion data service system is coupled with the data warehouse architecture for nuclear fusion data standardization through the fusion data warehouse interface, and is coupled with the fusion data business system through the fusion data business interface;

[0024] The fusion data business system is used to maintain a number of storage modules, and the data stored in the storage modules include data storage records, data tool usage records, data access and reading records, magnetic confinement fusion experimental device information, magnetic confinement fusion experimental device subsystem information, fusion experiment records, fusion experiment data, etc.;

[0025] The data warehouse architecture for nuclear fusion data standardization is used to provide standardized nuclear fusion business data.

[0026] In a third aspect, an embodiment of the present invention provides an electronic device, comprising a memory and a processor, wherein the memory is coupled to the processor; wherein the memory is used to store program data, and the processor is used to execute the program data to implement the above-mentioned data warehouse architecture for nuclear fusion data standardization.

[0027] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the above-mentioned data warehouse architecture for nuclear fusion data standardization.

[0028] Compared with the prior art, the beneficial effects of the present invention are as follows: the present invention provides a data warehouse architecture for nuclear fusion data standardization, including a loosely coupled operational data layer, a data standard layer, a semantic standard layer, an analysis standard layer, a data application layer, and a data tool set; all relevant nuclear fusion physics / business entity data are connected through the semantic standard layer to provide a standardized semantic environment for fusion data interpretation, which enables different users to interpret fusion data based on the same environment and semantics, thereby eliminating barriers to understanding and cognitive ambiguity; and standardized management of nuclear fusion business data to meet external data application needs. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some focus scope descriptions and embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative labor.

[0030] Figure 1 A schematic diagram of a data warehouse architecture for nuclear fusion data standardization provided by an embodiment of the present invention;

[0031] Figure 2 A schematic diagram of an operational data layer provided by an embodiment of the present invention;

[0032] Figure 3 A schematic diagram of a data standard layer provided by an embodiment of the present invention;

[0033] Figure 4 A schematic diagram of a semantic standard layer provided by an embodiment of the present invention;

[0034] Figure 5 A schematic diagram of an analysis standard layer provided by an embodiment of the present invention;

[0035] Figure 6 A schematic diagram of a data application layer provided by an embodiment of the present invention;

[0036] Figure 7 A schematic diagram of a data tool set provided by an embodiment of the present invention;

[0037] Figure 8 A schematic diagram of a data processing system for nuclear fusion data standardization provided by an embodiment of the present invention;

[0038] Fig. 9 A schematic diagram of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0039] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0040] It should be noted that, in the absence of conflict, the features in the following embodiments and implementations may be combined with each other.

[0041] The embodiment of the present invention provides a data warehouse architecture for nuclear fusion data standardization. The data warehouse architecture solves the problem of data sharing in the fusion field, and at the same time realizes the standardization of data in the nuclear fusion field, improves the consistency, sharing, and reliability of data in the nuclear fusion field, and eliminates the understanding barriers and cognitive ambiguity of nuclear fusion data among different users; and the data warehouse architecture contributes to the centralized and standardized management of fusion data, and can provide efficient data reading and query services for external data applications.

[0042] like Figure 1 As shown, the data warehouse architecture for nuclear fusion data standardization provided by the present invention includes a loosely coupled operational data layer (ODS), a data standard layer (DSL), a semantic standard layer (SSL), an analysis standard layer (ASL), a data access layer (DAL), and a data toolset (DT).

[0043] like Figure 2 As shown, the operational data layer (ODS) is used to extract and transfer nuclear fusion business data from the SQL database of the nuclear fusion data business system.

[0044] The nuclear fusion business data includes: nuclear fusion data business operation data, nuclear fusion physics / business entity data, and fusion experiment data.

[0045] Furthermore, nuclear fusion data business operation data includes: data tool usage records, user query and reading records of data stored in the data warehouse, and data entry records; nuclear fusion physics / business entity data includes: physical data categories (including descriptions of the physical meaning of the data), magnetic confinement fusion experimental device information, magnetic confinement fusion experimental device subsystem information, experimental information, data tool information, etc.; fusion experiment data includes: magnetic probe collection data in the fusion field, soft radiation data, poloidal cross-section magnetic flux, electron density data, magnetic axis coordinates, etc.

[0046] Exemplarily, when the physical data category is coil control signal, the magnetic confinement fusion device is a large domestic tokamak device, the subsystem information of the magnetic confinement fusion device is the discharge control subsystem, and the experimental information includes: current experimental gun number, current experimental target, experiment, etc.

[0047] Specifically, in the process of extracting and transferring nuclear fusion business data, the operational data layer includes: transferring and copying the nuclear fusion data business operation data and nuclear fusion physics / business entity data in the operational data layer; transferring and copying the file storage path and internal Dataset path of the fusion experiment data in the operational data layer, and only saving the access path of the fusion experiment data in the operational data layer to prevent space waste. Among them, the fusion experiment data can adopt a tree structure based on HDF5 (Hierarchy Data Format version 5), and the fusion experiment data can reuse the data in the storage module as needed.

[0048] Furthermore, the operational data layer also includes: initiating a scheduled task to synchronize the latest nuclear fusion business data to the operational data layer in real time.

[0049] It should be noted that by introducing nuclear fusion business data through the operational data layer (ODS), partial decoupling between the data in the data warehouse for nuclear fusion data standardization and the data in the SQL database of the nuclear fusion data business system is achieved, which facilitates the subsequent processing of fusion business data.

[0050] like Figure 3 As shown, the data standard layer (DSL) is used to clean and standardize nuclear fusion business data through a data tool set.

[0051] Specifically, the data standard layer performs operations such as supplementing missing values, removing outliers, and deduplicating data on the nuclear fusion data business operation data and nuclear fusion physics / business entity data by extracting (Extra), transforming (Transfer), loading (Load) and calling the data tool set; the fusion experiment data is cleaned, screened, sampled, aligned, and converted in units in accordance with the predefined file standard structure (such as the predefined HDF5 structure) and / or the data standard format corresponding to the nuclear fusion physical quantity; at the same time, the cleaned nuclear fusion data business operation data, nuclear fusion physics / business entity data and fusion experiment data are maintained.

[0052] like Figure 4 As shown, the semantic standard layer (SSL) is used to parse the cleaned nuclear fusion data business operation data provided by the data standard layer to obtain a fact table; parse the cleaned nuclear fusion physics / business entity data to obtain a data dimension table; establish a snowflake model to maintain the fact table and the data dimension table according to the nuclear fusion data business; and establish a relationship between the fusion experiment data and the fact table and the data dimension table to obtain a data wide table.

[0053] Furthermore, the semantic standard layer is designed with data dimension tables and fact tables. A snowflake model is established based on the nuclear fusion data business to maintain the relationship between the fact table and the dimension table, and the fusion experiment data and the fusion business entity data are established in a corresponding relationship through information such as the experiment ID, physical quantity name, and data processing tool ID. Finally, the fusion experiment data, fact table, and data dimension table are summarized to form a data wide table. Among them, the data dimension table is used to store physical data categories, magnetic confinement fusion experiment fusion devices, magnetic confinement fusion experiment fusion device subsystems, etc.; the fact table is used to store fusion experiments, fusion data processing tool calls, etc.

[0054] Specifically, in this example, the semantic standard layer converts and parses the cleaned nuclear fusion data business operation data provided by the data standard layer to fill the fact table; converts the cleaned nuclear fusion physics / business entity data provided by the data standard layer to obtain a data dimension table. At the same time, the experiment and the magnetic confinement fusion experimental device are connected according to the experiment ID, and the data category dimension and the magnetic confinement fusion experimental fusion device subsystem dimension are connected according to the physical quantity name to form a complete record containing the physical meaning of the data and the data generation environment. The records of all data together constitute the fusion data wide table. Therefore, the data maintained by the semantic standard layer allows users to query and access the corresponding physical data by viewing the data category, data physical meaning description, data unit, experiment of the data source, data generation device, data processing tool that generates the data, etc., so that different users can interpret and communicate about the fusion data based on the same environment and semantics, without generating barriers to understanding and cognitive ambiguity.

[0055] It should be noted that the semantic standard layer connects all relevant entity data information on top of the standardized data provided by the data standard layer, and provides a standardized semantic environment for interpreting fusion data. This allows different users to interpret and communicate fusion data based on the same environment and semantics, thereby eliminating barriers to understanding and cognitive ambiguity.

[0056] like Figure 5 As shown, the Analysis Standard Layer (ASL) is used to classify the wide data table provided by the semantic standard layer by subject, and obtain wide data tables under several subjects.

[0057] Specifically, the analysis standard layer (ASL layer) summarizes the research directions in the fusion field and the analysis dimensions that support the operation and development of data business in the fusion field, and forms seven standardized subject wide tables according to the general requirements of data application and the standard paradigm in the fusion field. Based on the data provided by the semantic standard layer (SSL layer), the analysis standard layer (ASL layer) combines the three standard dimensions commonly used in nuclear fusion data analysis: experimental control, comprehensive diagnosis, and simulation, and the four analysis dimensions required for nuclear fusion data management: users, data tools, physical data categories, and fusion devices, and integrates the data into seven major themes: experimental control theme, comprehensive diagnosis theme, simulation theme, user theme, data tool theme, physical data category theme, and fusion device theme. At the same time, it maintains standard fields and related paradigms for fusion data analysis needs, forms data wide tables under seven standard themes, and provides data support for fusion data analysis at the data application layer.

[0058] It should be noted that the analysis standard layer (ASL layer) maintains the data aggregation and summary module, which slices, splits, connects, redundancies, and integrates the data from the semantic standard layer (SSL layer) according to different topics, and fills the corresponding field data according to the predefined topic wide table format.

[0059] like Figure 6 As shown, the Data Access Layer (DAL) is used to aggregate or transform the sub-physical data wide surface under each theme provided by the analysis standard layer to the target dimension according to the external data application requirements.

[0060] Specifically, the data application layer (DAL layer) aggregates data from different subject wide tables of the analysis standard layer (ASL layer), or performs adaptive conversion according to external data application requirements to meet the data requirements of external data applications. Based on the data provided by the analysis standard layer (ASL layer), according to external application requirements, for example, data tool usage frequency, data conversion time, fusion experiment time, fusion experiment target configuration magnetic axis coordinates and other indicators, or fusion source device, fusion generation subsystem, physical data category and other dimensions, according to data visualization, data lineage tracing, fusion data report, fusion AI training algorithm, twin rendering and other different external data application requirements, form application-oriented, directly available data, and provide efficient data access and query performance to support the data requirements of external applications. Therefore, the data application layer (DAL layer) provides the above-mentioned function of data aggregation or adaptive conversion of the subject wide tables of the analysis standard layer (ASL layer).

[0061] like Figure 7 As shown in the figure, Data Toolset (DT) is a tool for standardizing and converting fusion experiment data. As an independently deployed data service, Data Toolset provides a service call interface to the outside world. It is called by the data standard layer in the fusion data warehouse to provide automatic data conversion, and can also be used as an external public service to meet the independent use needs of users. The Data Toolset encapsulates the data standardization conversion script as a service, providing functions such as fusion data cleaning, slicing, interpolation, sampling rate alignment, coordinate conversion, and unit conversion, supporting the conversion of fusion science data from the operational data layer to the data standard layer.

[0062] like Figure 8 As shown, an embodiment of the present invention further provides a data processing system for nuclear fusion data standardization, including: a fusion data service system, a fusion data business system, and the above-mentioned fusion data warehouse.

[0063] The fusion data service system is used to provide Web-side interactive operations such as data warehousing, data query, data reading, data tool use, data maintenance, and fusion data category information query; the fusion data service system is provided with a fusion data warehouse interface and a fusion data business interface, and is coupled with the fusion data warehouse through the fusion data warehouse interface, and is coupled with the fusion data business system through the fusion data business interface.

[0064] The fusion data business system is used to schedule and implement the business at the bottom level, and to maintain several storage modules. The data stored in the storage modules include data entry records, data tool usage records, data access and reading records, magnetic confinement fusion experimental device information, magnetic confinement fusion experimental device subsystem information, fusion experiment records, and fusion experiment data, providing raw data for the data warehouse. The fusion data business system provides business functions by exposing business function interfaces to the outside.

[0065] The fusion data warehouse is used to provide fusion standardized data of different aggregation levels for external data applications, and also provides data tool calling services for user data processing needs. The data warehouse provides corresponding services by exposing the fusion data warehouse interface to the outside.

[0066] like Fig. 9 As shown, an embodiment of the present application provides an electronic device, which includes a memory 101 for storing one or more programs and a processor 102. When the one or more programs are executed by the processor 102, any method in the first aspect described above is implemented.

[0067] The memory 101, the processor 102 and the communication interface 103 are directly or indirectly electrically connected to each other to achieve data transmission or interaction. For example, these elements can be electrically connected to each other through one or more communication buses or signal lines. The memory 101 can be used to store software programs and modules, and the processor 102 executes various functional applications and data processing by executing the software programs and modules stored in the memory 101. The communication interface 103 can be used to communicate signaling or data with other node devices.

[0068] Among them, the memory 101 can be, but is not limited to, a random access memory 101 (Random Access Memory, RAM), a read only memory 101 (Read Only Memory, ROM), a programmable read-only memory 101 (Programmable Read-Only Memory, PROM), an erasable programmable read-only memory 101 (Erasable Programmable Read-Only Memory, EPROM), an electrically erasable read-only memory 101 (Electric Erasable Programmable Read-Only Memory, EEPROM), etc.

[0069] The processor 102 may be an integrated circuit chip with signal processing capability. The processor 102 may be a general-purpose processor 102, including a central processing unit 102 (CPU), a network processor 102 (NP), etc.; it may also be a digital signal processor 102 (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components.

[0070] In the embodiments provided in the present application, it should be understood that the disclosed method and system can also be implemented in other ways. The method and system embodiments described above are merely schematic. For example, the flowcharts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the method and system, method and computer program product according to multiple embodiments of the present application. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of a code, and the module, a program segment or a part of a code contains one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or the flowchart, and the combination of boxes in the block diagram and / or the flowchart can be implemented with a dedicated hardware-based system that performs a specified function or action, or can be implemented with a combination of dedicated hardware and computer instructions.

[0071] In addition, the functional modules in the various embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.

[0072] On the other hand, an embodiment of the present application provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by the processor 102, the method as described in any one of the first aspects above is implemented. If the function is implemented in the form of a software function module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory 101 (ROM, Read-Only Memory), random access memory 101 (RAM, RandomAccess Memory), disk or optical disk and other media that can store program codes.

[0073] Those skilled in the art will readily appreciate other embodiments of the present application after considering the description and practicing the contents disclosed herein. The present application is intended to cover any variations, uses or adaptations of the present application, which follow the general principles of the present application and include common knowledge or customary technical means in the art that are not disclosed in the present application. The description and examples are intended to be exemplary only.

[0074] It should be understood that the present application is not limited to the exact construction that has been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof.

Claims

1. A data warehouse system for nuclear fusion data standardization, characterized in that: The data warehouse system includes a loosely coupled operational data layer, a data standard layer, a semantic standard layer, an analytical standard layer, a data application layer, and a data tool set; The operational data layer is used to extract and transfer nuclear fusion business data from the SQL database of the nuclear fusion data business system; the nuclear fusion business data includes: nuclear fusion data business operation data, nuclear fusion physical entity data, nuclear fusion business entity data, and fusion experiment data; The data standard layer is used to clean and standardize nuclear fusion business data through a data tool set; The data standard layer performs missing value supplement, outlier removal, and data deduplication operations on the nuclear fusion data business operation data, nuclear fusion physical entity data, and nuclear fusion business entity data by extracting, converting, loading, and calling the data tool set; the fusion experiment data is cleaned, screened, sampled, and converted according to the predefined file standard structure and / or the data standard format corresponding to the nuclear fusion physical quantity; at the same time, the cleaned nuclear fusion data business operation data, nuclear fusion physical entity data, nuclear fusion business entity data, and fusion experiment data are maintained; The semantic standard layer is used to parse the cleaned nuclear fusion data business operation data to obtain the fact table; parse the cleaned nuclear fusion physical entity data and nuclear fusion business entity data to obtain the data dimension table; establish a snowflake model to maintain the fact table and data dimension table according to the nuclear fusion data business; and establish a relationship between the fusion experiment data and the fact table and data dimension table according to the experiment ID to obtain the data wide table; The process of establishing a relationship between the fusion experiment data and the fact table and the data dimension table according to the experiment ID includes: connecting the experiment, magnetic confinement fusion experiment device and magnetic confinement fusion experiment fusion device subsystem dimensions according to the experiment ID, and connecting the data category dimension according to the physical quantity name, so that when querying and accessing the fusion experiment data, the data category, data physical meaning description, data unit, data source experiment, data generation device, and data processing tool that generates the data are indexed to the fusion experiment data; The analysis standard layer is used to classify the data wide table provided by the semantic standard layer into topics and obtain the data wide table under each topic; The data application layer is used to aggregate or transform the data wide tables under each topic provided by the analysis standard layer towards the target dimension according to external data application requirements.

2. A data warehouse system for nuclear fusion data standardization according to claim 1, characterized in that: The operational data layer extracts and transfers nuclear fusion business data, including: Transfer and copy the nuclear fusion data business operation data, nuclear fusion physical entity data, and nuclear fusion business entity data in the operational data layer; The file storage path and internal Dataset path of the fusion experiment data are transferred and copied in the operational data layer, and only the access path of the fusion experiment data is saved.

3. A data warehouse system for nuclear fusion data standardization according to claim 2, characterized in that: Nuclear fusion data business operation data includes: data tool usage records, query and read records of data stored in the data warehouse, and data entry records; Nuclear fusion physical entity data and nuclear fusion business entity data include: physical data categories, magnetic confinement fusion experimental device information, magnetic confinement fusion experimental device subsystem information, experimental information, and data tool information; The fusion experiment data include: magnetic probe collection data in the fusion field, soft radiation data, poloidal cross-section magnetic flux, electron density data, and magnetic axis coordinates.

4. A data warehouse system for nuclear fusion data standardization according to claim 1, characterized in that: The topics include: experimental control topic, comprehensive diagnosis topic, simulation topic, user topic, data tool topic, physical data category topic, and fusion device topic.

5. A data warehouse system for nuclear fusion data standardization according to claim 1, characterized in that: The external data application requirements include: data visualization, data lineage tracing, fusion data reports, fusion AI training algorithms and / or twin rendering.

6. A data warehouse system for nuclear fusion data standardization according to claim 1, characterized in that: The data toolset is used to handle fusion data cleaning, slicing, coordinate conversion, unit conversion, sampling rate alignment, normalization, interpolation and / or visualization.

7. A data processing system for nuclear fusion data standardization, characterized in that: A data warehouse system, a fusion data service system, and a fusion data business system for nuclear fusion data standardization as described in any one of claims 1 to 6; The fusion data service system is used for data storage, data query, data reading, data tool use, data maintenance, and fusion data category information query; the fusion data service system is coupled with the data warehouse system for nuclear fusion data standardization through the fusion data warehouse interface, and is coupled with the fusion data business system through the fusion data business interface; The fusion data business system is used to maintain a number of storage modules, and the data stored in the storage modules include data storage records, data tool usage records, data access and reading records, magnetic confinement fusion experimental device information, magnetic confinement fusion experimental device subsystem information, fusion experiment records, and fusion experiment data; The data warehouse system for nuclear fusion data standardization is used to provide standardized nuclear fusion business data.

8. An electronic device, comprising a memory and a processor, characterized in that: The memory is coupled to the processor; wherein the memory is used to store program data, and the processor is used to execute the program data to implement the data warehouse system for nuclear fusion data standardization as described in any one of claims 1-6 above.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, a data warehouse system for nuclear fusion data standardization as described in any one of claims 1 to 6 is implemented.

Citation Information

Patent Citations

  • Multi-physically coupled system and method for reactor simulation

    CN109063235A

  • Nuclear reactor digital experiment platform

    CN109522356A

  • Knowledge use method for nuclear reactor digital experiment platform

    CN109545285A

  • Nuclear power industrial data warehouse system

    CN114357088A

  • New energy multi-type data allocation method and system based on domestic structure

    CN115757569A