Processing method, device and storage medium for scientific data genome

Abstract

The present application relates to a method, device and storage medium for processing scientific data genomes. The method establishes a connection relationship with multiple data sources, obtains data fields corresponding to the multiple data sources respectively, and obtains a data hierarchy relationship for displaying data provided by the multiple data sources, thereby establishing a mapping relationship between data fields in the multiple data sources and corresponding display fields in the display node according to the data hierarchy relationship, and based on the mapping relationship and the connection relationship with the multiple data sources, obtains and displays data matching the corresponding display fields in the display node from the multiple data sources, thereby realizing the display of data according to the relationship between the data that the user wants to view, and avoiding the problem of the complicated process of obtaining data by manually associating different data sources in the traditional technology.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a method, device and storage medium for processing scientific data genome. Background Art

[0002] With the rapid development of science and technology, various production data or R&D data are generated in each step of the production process or the drug research and development process. In some highly complex production or R&D processes, hundreds or thousands of massive data are often collected at different times.

[0003] Due to the diversity of these data sources, they are distributed in different data sources, such as the R&D software used in the R&D process, the production equipment used in the production process, or various monitoring devices. For example, the database used to store data at the bottom of the R&D software may also be distributed on different servers, or the storage devices associated with the production equipment storing data, and may even be located in different cities or countries. Therefore, it is usually difficult for users to access data stored in multiple and various data sources at the same time.

[0004] Currently, users manually locate, extract, and format the required data from different sources. For example, if a user wants to track the temperature of a mixture and the final viscosity of the mixture, the user usually needs to manually associate these two pieces of data. So every time the user needs to analyze the data, he must repeat this manual association process based on his understanding of the relationship between various data sets and the format required for data analysis. Obtaining data through manual association is not only a complex process, but also prone to errors. Summary of the invention

[0005] Based on this, it is necessary to provide a scientific data genome processing method, device, computer equipment and storage medium to address the above-mentioned problem of complex data acquisition process by manually associating different data sources.

[0006] A method for processing a scientific data genome, the method comprising:

[0007] Establish connection relationships with multiple data sources and obtain data fields corresponding to the multiple data sources;

[0008] Acquire a data hierarchical relationship for displaying the data provided by the multiple data sources, wherein the data hierarchical relationship includes a subordinate relationship between different display nodes and a subordinate relationship between a display field and the display node;

[0009] Establishing a mapping relationship between the data fields in the plurality of data sources and the corresponding display fields in the display node according to the data hierarchical relationship;

[0010] Based on the mapping relationship and the connection relationship with multiple data sources, data matching the corresponding display fields in the display node are obtained from the multiple data sources, and the data are displayed according to the data hierarchical relationship.

[0011] In one embodiment, the multiple data sources include but are not limited to databases for providing relational data or non-relational data, and data sources for providing file-type data; establishing a connection relationship with the multiple data sources and obtaining data fields corresponding to the multiple data sources respectively includes: if the data source is a database for providing relational data or non-relational data, obtaining first address information and account login information of the database, accessing the database according to the first address information and account login information of the database, and obtaining data fields in the database; or, if the data source is a data source for providing file-type data, obtaining second address information of the data source, accessing the data source according to the second address information of the data source, and obtaining data fields in the data source.

[0012] In one of the embodiments, the acquiring data matching the corresponding display fields in the display nodes from the multiple data sources includes: acquiring original data matching the corresponding display fields in the display nodes from the multiple data sources; and filtering the original data according to a set data filtering condition to obtain data meeting the data filtering condition.

[0013] In one of the embodiments, after obtaining the original data matching the corresponding display field in the display node from the multiple data sources, the method further includes: verifying the original data according to a set data anomaly verification condition, and if it is determined that abnormal data exists in the original data, processing the abnormal data in the original data using a preset exception processing method to obtain processed data.

[0014] In one of the embodiments, the obtaining of the data hierarchical relationship for displaying the data provided by the multiple data sources includes: obtaining display nodes and display fields for displaying the data provided by the multiple data sources; and obtaining, based on the display nodes and display fields, subordinate relationships between different display nodes and subordinate relationships between display fields and the display nodes to obtain corresponding data hierarchical relationships.

[0015] In one of the embodiments, establishing a mapping relationship between data fields in the multiple data sources and corresponding display fields in the display node according to the data hierarchical relationship includes: displaying the data hierarchical relationship in a tree directory and displaying the multiple data sources in a list; obtaining a selection instruction for the data source and displaying the data field corresponding to the data source; obtaining an association relationship between a data field selected from the data source and a display node selected from the display node; mapping the selected data field to the corresponding display field in the selected display node according to the association relationship, and establishing a mapping relationship between the selected data field and the corresponding display field.

[0016] In one of the embodiments, displaying the data according to the data hierarchical relationship includes: determining the data source of the data corresponding to the display field according to the mapping relationship between the data fields in the multiple data sources and the corresponding display fields in the display node; determining the node type to which the display node corresponding to the display field belongs according to the subordinate relationship between different display nodes and the subordinate relationship between the display field and the display node; rendering the data in a preset data rendering method according to the data source of the data corresponding to the display field and the node type to which the display node corresponding to the display field belongs, and generating a corresponding data gene map; and displaying the data gene map.

[0017] A scientific data genome processing device, the device comprising:

[0018] A data field acquisition module is used to establish a connection relationship with multiple data sources and obtain data fields corresponding to the multiple data sources;

[0019] A data hierarchical relationship acquisition module, used to acquire a data hierarchical relationship for displaying the data provided by the multiple data sources, wherein the data hierarchical relationship includes a subordinate relationship between different display nodes and a subordinate relationship between a display field and the display node;

[0020] A mapping relationship establishing module, used to establish a mapping relationship between the data fields in the multiple data sources and the corresponding display fields in the display node according to the data hierarchical relationship;

[0021] A data acquisition module, configured to acquire data matching the corresponding display field in the display node from the multiple data sources based on the mapping relationship and the connection relationship between the multiple data sources;

[0022] A display module is used to display the data according to the data hierarchical relationship.

[0023] A computer device comprises a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of the above method when executing the computer program.

[0024] A computer-readable storage medium stores a computer program, which implements the steps of the above method when executed by a processor.

[0025] The above-mentioned scientific data genome processing method, device, computer equipment and storage medium establish connection relationships with multiple data sources, obtain data fields corresponding to multiple data sources respectively, and obtain a data hierarchy relationship for displaying data provided by multiple data sources, thereby establishing a mapping relationship between data fields in multiple data sources and corresponding display fields in display nodes according to the data hierarchy relationship. Based on the mapping relationship and the connection relationship with multiple data sources, data matching the corresponding display fields in the display node are obtained from multiple data sources and displayed, thereby realizing the display of data according to the relationship between data that users want to view, and avoiding the problem of complex data acquisition process by manually associating different data sources in traditional technology. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 A diagram of an application environment of a method for processing a scientific data genome in one embodiment;

[0027] Figure 2 A schematic diagram of a process of processing a scientific data genome in one embodiment;

[0028] Figure 3 A schematic diagram of a process for obtaining data from a data source in one embodiment;

[0029] Figure 4 A schematic diagram of a flow chart of steps for obtaining a data hierarchical relationship in one embodiment;

[0030] Figure 5 A schematic diagram of a data hierarchy relationship shown in an embodiment;

[0031] Figure 6 A schematic diagram of a process for establishing a mapping relationship in an embodiment;

[0032] Figure 7 A schematic diagram of a mapping relationship shown in an embodiment;

[0033] Figure 8 A flowchart showing data steps in one embodiment;

[0034] Fig. 9 A schematic diagram of a data gene map shown in one embodiment;

[0035] Fig.10 is a structural block diagram of a processing device for scientific data genome in one embodiment;

[0036] Fig.11 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0037] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0038] The scientific data genome processing method provided in this application can be applied to Figure 1 In the application environment shown in FIG. 1 , a computer device 102 is connected to multiple data sources 104 (such as Figure 5 Specifically, the computer device 102 may be, but is not limited to, various personal computers, laptops, smart phones, tablet computers, portable wearable devices, and other terminals, or may also be a server. The multiple data sources 104 may be, but are not limited to, various relational databases, non-relational databases, and file-based data sources.

[0039] In one embodiment, Figure 2 As shown, a method for processing scientific data genome is provided, and the method is applied to Figure 1 Specifically, the computer device is taken as a terminal as an example, and the following steps are included:

[0040] Step 202: Establish connection relationships with multiple data sources, and obtain data fields corresponding to the multiple data sources.

[0041] The multiple data sources include, but are not limited to, a relational database for providing relational data, a non-relational database for providing non-relational data, and a file-type data source for providing file-type data. The connection relationship may specifically refer to a network connection relationship. The data field represents the data attribute of the stored data, each data field describes a certain feature of the data, and has a unique field identifier for computer recognition. In this embodiment, by establishing a connection relationship between the terminal and the multiple data sources, the terminal can access the multiple data sources and obtain corresponding data fields from the multiple data sources respectively.

[0042] Step 204: Obtain a data hierarchy relationship for displaying data provided by multiple data sources.

[0043] The data hierarchical relationship provides the relationship between the data that the user wants to view. Specifically, the data hierarchical relationship includes the subordinate relationship between different display nodes and the subordinate relationship between display fields and display nodes. The subordinate relationship between different display nodes refers to the dependency and affiliation between different display nodes, and the subordinate relationship between display fields and display nodes refers to which display node the display field belongs to. In this embodiment, based on the relationship between the data that the user wants to view, the data hierarchical relationship for displaying the data provided by multiple data sources can be obtained and defined as the corresponding data model.

[0044] Step 206: Establish a mapping relationship between data fields in the plurality of data sources and corresponding display fields in the display node according to the data hierarchical relationship.

[0045] The mapping relationship refers to the association relationship between the data fields in the data source and the display fields in the display node. In this embodiment, since the data hierarchical relationship is only an object at the relationship level and no data is stored therein, in order to display the data that the user wants to view through the data hierarchical relationship, an association relationship between the data fields in multiple data sources and the corresponding display fields in the display node can be established, so that the corresponding display fields in the display node can obtain corresponding data based on the association relationship.

[0046] Step 208: based on the mapping relationship and the connection relationship between the multiple data sources, data matching the corresponding display fields in the display node are obtained from the multiple data sources and displayed.

[0047] The data matching the corresponding display field in the display node refers to the data corresponding to the data field in the data source that has an association relationship with the corresponding display field in the display node. In this embodiment, based on the mapping relationship established above and the connection relationship between multiple data sources, the data matching the corresponding display field in the display node is obtained from multiple data sources and displayed, thereby realizing the display of data according to the relationship between the data that the user wants to view.

[0048] The above-mentioned method for processing scientific data genome establishes a connection relationship with multiple data sources, obtains data fields corresponding to the multiple data sources respectively, and obtains a data hierarchy relationship for displaying the data provided by the multiple data sources, thereby establishing a mapping relationship between the data fields in the multiple data sources and the corresponding display fields in the display nodes according to the data hierarchy relationship. Based on the mapping relationship and the connection relationship with the multiple data sources, data matching the corresponding display fields in the display nodes are obtained from the multiple data sources and displayed, thereby realizing the display of data according to the relationship between the data that the user wants to view, and avoiding the problem of the complicated process of obtaining data by manually associating different data sources in traditional technology.

[0049] In one embodiment, the plurality of data sources include, but are not limited to, relational databases for providing relational data, non-relational databases for providing non-relational data, and data sources for providing file-type data. Specifically, relational databases include, but are not limited to, Oracle (a database for Internet computing environments), MySQL (a relational database management system), SQLServer (abbreviation of Structured Query Language, meaning structured query language) and PostgreSQL (a very powerful, open-source client / server relational database management system), etc.; non-relational databases include, but are not limited to, NoSql (Not Only SQL, a general term for non-relational databases) databases, such as MongoDB (a database based on distributed file storage), etc.; file-type data sources include devices or media that provide files in the following formats: Excel (Microsoft Office Excel, a spreadsheet software), CSV (Comma-Separated Values, comma-separated value file format), XML (Extensible Markup Language, a markup language used to mark electronic files to make them structural), TXT (a text format) and SDF (Standard Delay Format, standard delay format file).

[0050] In step 202, a connection relationship is established with multiple data sources, and data fields corresponding to the multiple data sources are obtained. Specifically, it may include: if the data source is a database for providing relational data or non-relational data, the first address information and account login information of the database are obtained, and the database is accessed according to the first address information and account login information of the database to obtain the data fields in the database. Among them, the first address information refers to the server name or IP address where the database (relational database or non-relational database) is located and the corresponding port information. The account login information refers to information such as the user name and password required to access the database. That is, when the data source is a database (including relational databases and non-relational databases), the first address information and account login information of the database are obtained, and the database is accessed based on the first address information and account login information of the database, so as to obtain the data fields in the database.

[0051] If the data source is a data source for providing file-type data, the second address information of the data source is obtained, and the data source is accessed according to the second address information of the data source to obtain the data field in the data source. The second address information refers to the address information for storing the file-type data, such as a link address. In this embodiment, if the data source is a data source for providing file-type data, the second address information of the data source is obtained, and the data source is accessed based on the second address information of the data source to obtain the data field in the data source.

[0052] Furthermore, in order to facilitate subsequent data acquisition, the connection information for accessing the data source (including the first address information of the database and the account login information, or the second address information of the data source storing file-type data) can be set by configuration, and the acquired data fields can be named and saved based on the corresponding data source. When the user wants to acquire related data later, he can directly acquire data from different data sources through the saved information without having to set the connection relationship with different data sources each time.

[0053] In one embodiment, Figure 3 As shown, obtaining data matching corresponding display fields in display nodes from multiple data sources specifically includes the following steps:

[0054] Step 302: Acquire original data matching corresponding display fields in the display node from multiple data sources.

[0055] The original data refers to the unprocessed data stored in the data source, for example, the data directly collected by the instrument or software stored in the data source. In this embodiment, based on the mapping relationship established above and the connection relationship with the multiple data sources, the original data corresponding to the data field associated with the corresponding display field in the display node is obtained from the multiple data sources.

[0056] Step 304, filtering the original data according to the set data filtering conditions to obtain data that meets the data filtering conditions.

[0057] The set data screening conditions refer to the pre-set rules for screening the original data, which can be set according to the needs of the actual application. Specifically, the screening conditions can be screening rules set based on the consideration of data quality, for example, only screening data that meets the data quality requirements from the original data, such as non-abnormal data, non-missing data, etc.; the screening conditions can also be screening rules set based on the consideration of the data itself, for example, screening numerical data from the original data, or screening data within a certain set size range; and for time type data, the screening rules can be set based on the time range, that is, only filtering data within the set time range.

[0058] The above embodiment obtains original data matching corresponding display fields in display nodes from multiple data sources, and filters the original data according to set data filtering conditions, thereby obtaining data that meets the data filtering conditions, so that the obtained data can meet the needs of users and can be directly used for data analysis without further data processing.

[0059] Furthermore, due to the data coming from different data sources, the data types may also be diverse, such as numerical data such as temperature and mass, time type data for recording time, structural data for recording compound structural information, and protein sequence data for recording organisms. Due to instrument recording errors or other reasons, there may also be some "dirty" data in these data, such as data missing problems and data abnormal value problems, so it is difficult for users to directly use these data for data analysis. Based on this, in this embodiment, after obtaining the original data matching the corresponding display field in the display node from multiple data sources, the above method also includes: verifying the original data according to the set data abnormality verification conditions, if it is determined that there is abnormal data in the original data, then using a pre-set abnormality processing method to process the abnormal data in the original data to obtain the processed data. Among them, the set data abnormality verification conditions refer to the pre-set rules and methods for verifying whether the data is abnormal, for example, whether there is a missing data in the specified data field, whether the data type stored in the specified data field matches, etc. The pre-set exception handling method refers to the handling method for data verified as abnormal. For example, the specific handling of missing data is to discard the data or assign a value to it, and the assignment includes assigning a null value, assigning an average value, and assigning a value by an interpolation function, etc. In this embodiment, after obtaining the original data matching the corresponding display field in the display node from multiple data sources, the obtained original data can be verified according to the set data abnormality verification conditions, that is, to verify whether there is abnormal data in the original data. If it is determined that there is abnormal data in the original data, the abnormal data in the original data is processed accordingly based on the pre-set exception handling method, thereby obtaining processed data, so that the data finally presented to the user are all regular data.

[0060] It is understandable that the above steps of screening data and verifying and processing abnormal data can be selected or used in conjunction with each other based on actual needs. The purpose is to provide users with data that meets their needs without requiring users to master complex data processing techniques.

[0061] In one embodiment, Figure 4 As shown, obtaining the data hierarchy relationship for displaying data provided by multiple data sources specifically includes the following steps:

[0062] Step 402: Acquire display nodes and display fields for displaying data provided by multiple data sources.

[0063] Among them, display nodes and display fields are members that constitute the data hierarchy, and display nodes include root nodes and child nodes. Specifically, Figure 5 As shown, based on different data hierarchical relationships, each has a unique root node. A child node can be established under the root node based on data display requirements, and a child node can continue to be established under the child node, and a display field can be established under all nodes (including the root node and the child node). In this embodiment, the display field is compatible with various data types. For example, the display field is compatible with various data types such as numerical type, time type, text type, structural type, and biological protein type. In this embodiment, display nodes and display fields for displaying data provided by multiple data sources are obtained, and the corresponding data hierarchical relationship is obtained through subsequent steps.

[0064] Step 404: Based on the display nodes and display fields, the subordinate relationships between different display nodes and the subordinate relationships between display fields and display nodes are acquired to obtain corresponding data hierarchical relationships.

[0065] The subordinate relationship between different display nodes refers to the dependency and affiliation between different display nodes, that is, the hierarchical relationship, and the subordinate relationship between the display field and the display node refers to which display node the display field belongs to. In this embodiment, based on the relationship between the data that the user wants to view, the subordinate relationship and the affiliation between the root node, the child node and the display field are obtained, so as to obtain the corresponding data hierarchical relationship, and obtain the corresponding data model based on the visualized data hierarchical relationship.

[0066] In one embodiment, Figure 6 As shown, according to the data hierarchical relationship, a mapping relationship between data fields in multiple data sources and corresponding display fields in the display node is established, which specifically includes the following steps:

[0067] Step 602: Display the data hierarchy relationship in a tree directory format and display multiple data sources in a list format.

[0068] A tree directory refers to a directory with a series of structures such as top, bottom, left, and right distributed in a tree structure. Specifically, the tree directory displays the hierarchical relationship of data, which can be as follows: Figure 5 The display method shown. Multiple data sources are displayed in a list format, that is, multiple data sources are displayed in a list format.

[0069] Step 604: obtain a selection instruction for a data source, and display data fields corresponding to the data source.

[0070] The selection instruction refers to an instruction or command for selecting a data source. For each data source, its corresponding data fields can be arranged in a certain linear order. In this embodiment, by obtaining the selection instruction for the data source, the data fields corresponding to the data source are displayed.

[0071] Step 606: Acquire the association relationship between the data field selected from the data source and the presentation node selected from the presentation nodes.

[0072] Since each display field belongs to a display node in the data hierarchy, in this embodiment, the association relationship between the data field selected from the data source and the display node selected from the display node is obtained, that is, the affiliation between the field and the node is obtained based on user needs.

[0073] Step 608: Map the selected data field to the corresponding display field in the selected display node according to the association relationship, and establish a mapping relationship between the selected data field and the corresponding display field.

[0074] Since a display field in a data hierarchy may correspond to multiple data fields in one data source, or multiple data fields in multiple data sources, when these different data fields are extracted into the same data hierarchy, an association relationship also needs to be established between these fields. Therefore, after setting the association relationship between the data fields in the data source and the display nodes in the data hierarchy, a mapping relationship between the fields also needs to be established.

[0075] For example, in this embodiment, a mapping relationship between data fields in multiple data sources and corresponding display fields in display nodes can be established based on a visual method. Specifically, in the display interface of the terminal, the data hierarchy relationship (that is, the data model) can be displayed in a tree directory on one side of the display interface, and multiple data sources can be displayed in a list on the other side of the display interface. Based on the selection of a data source name, the data field corresponding to the data source is displayed, and then the association relationship between the data field and the display field in the data hierarchy relationship can be established by visual dragging (specifically, Figure 7 For example, you can click and drag the data field in the data source and drop it on the display field in the data hierarchy to establish a mapping relationship between the data field in the data source and the display field in the data hierarchy, thereby realizing the mapping of the data in the data field in the data source to the display field in the data hierarchy.

[0076] In one embodiment, Figure 8 As shown, displaying data according to the data hierarchy relationship includes the following steps:

[0077] Step 802: Determine the data source of the data corresponding to the display field according to the mapping relationship between the data fields in the plurality of data sources and the corresponding display fields in the display node.

[0078] Since the data corresponding to each display field in the display node is obtained from the corresponding data source, based on the mapping relationship between the data field in the data source and the corresponding display field in the display node, the data source of the data corresponding to each display field can be determined, that is, the data source of the data corresponding to the display field can be determined.

[0079] Step 804: Determine the node type to which the display node corresponding to the display field belongs according to the subordinate relationship between different display nodes and the subordinate relationship between the display field and the display node.

[0080] The node type is determined based on the data hierarchy. Since different display nodes have certain subordinate relationships, the node type can be determined based on the subordinate relationships between the nodes. Specifically, Figure 5 As shown, for the first-level child nodes under the root node (the child nodes in the dotted box in the figure), each first-level child node has a corresponding node type, and for the child nodes under the first-level child nodes, since they belong to different first-level child nodes respectively, the node type of the child node can be determined according to the node type of the first-level child node to which it belongs.

[0081] Step 806, according to the data source of the data corresponding to the display field and the node type to which the display node corresponding to the display field belongs, the data is rendered using a preset data rendering method to generate a corresponding data gene map.

[0082] Among them, the preset data rendering method refers to a pre-set data rendering method. For example, for each display field, if the data source of the corresponding data is different, different shapes can be used for identification, and if the data source of the corresponding data is the same, the same shape can be used for identification; for each display field, if the node type of the corresponding display node is different, different colors can be used for identification, and if the node type of the corresponding display node is the same, the same color can be used for identification. In this embodiment, according to the data source of the data corresponding to the display field and the node type to which the display node corresponding to the display field belongs, the data is rendered using a preset data rendering method to generate a corresponding data gene map. The data gene map refers to displaying data in the form of a map, and the specific source of the data and the relationship between the data can be known at a glance through the display content in the map.

[0083] Step 808, display the data gene map.

[0084] By displaying the data gene map obtained based on the above rendering, it is convenient for users to view or further analyze.

[0085] Specifically, the data gene map can be as follows Fig. 9 The form shown, where Fig. 9 This is an example diagram of gene family analysis based on a lubricant formula. As can be seen from the figure, for this lubricant formula, it includes five types of data: main ingredients, performance tests, evaluation data, projects, and preparation processes. Each type of data includes multiple display nodes and corresponding display fields, and the data corresponding to the display fields may come from different data sources. Therefore, for each type of data, it can be distinguished by different colors when displayed, such as the main ingredients can be displayed in purple, the performance test part can be displayed in blue, the evaluation data part can be displayed in red, the project part can be displayed in green, and the preparation process part can be displayed in yellow. As for the data source of the data corresponding to each display field, the corresponding shape can be used to identify it during the display. For example, the data field shown as a solid triangle in the figure indicates that its corresponding data comes from the reagent material management system, the data field shown as a solid circle in the figure indicates that its corresponding data comes from the ERP (Enterprise Resource Planning) system, the data field shown as a regular "cross" in the figure indicates that its corresponding data comes from the computing simulation platform, the data field shown as a solid prism in the figure indicates that its corresponding data comes from the ELN (Electronic Lab Notebook) system, the data field shown as an inclined "cross" in the figure indicates that its corresponding data comes from the LIMS (Laboratory Information Management System) system, and the data field shown as a hollow three-character shape in the figure indicates that its corresponding data comes from an Excel data file.

[0086] It can be understood that the data gene map is obtained by rendering the acquired data based on the preset data rendering method and the above data hierarchical relationship. For example, the "lubricant formula" in the above data gene map is equivalent to the root node in the corresponding data hierarchical relationship, and the five types of data in the above data gene map are equivalent to the first-level child nodes under the root node. For the first-level child node of the preparation process, it includes the child node of unit operation A, and the data fields unit operation B and unit operation C, and for the child node of unit operation A, it includes the display fields of working temperature, working pressure, and operation time. Based on the mapping relationship between the display fields and the data fields in the corresponding data source, the specific data content of the corresponding data field can be obtained from the data source. As can be seen from the figure, for example, for the display fields of working temperature, working pressure, and operation time, they are associated with the data of the corresponding data fields in the ELN system "28 degrees Celsius, 1 atmosphere, 3 hours". And from the rendering mark of the image, it can be seen that for the data fields of unit operation B and unit operation C, the corresponding data comes from the Excel data file, and for the data fields of working temperature, working pressure and operation time, the corresponding data comes from the ELN system. This embodiment displays data in the form of a data gene map, so that users can clearly know the source information of each displayed field through the displayed content, thereby facilitating users to trace the source of the data, providing assistance for users to analyze data, and being able to intuitively and quickly find out the main factors affecting the R&D and production processes from a large amount of data, thereby improving the efficiency and quality of R&D and production.

[0087] It should be understood that although Figure 1-8 The steps in the flowchart are shown in sequence as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, Figure 1-8 At least part of the steps may include multiple steps or multiple stages. These steps or stages are not necessarily performed at the same time, but can be performed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed in turn or alternately with other steps or at least part of the steps or stages in other steps.

[0088] In one embodiment, Fig.10 As shown, a scientific data genome processing device is provided, including: a data field acquisition module 1001, a data hierarchical relationship acquisition module 1002, a mapping relationship establishment module 1003, a data acquisition module 1004 and a display module 1005, wherein:

[0089] The data field acquisition module 1001 is used to establish a connection relationship with multiple data sources and acquire data fields corresponding to the multiple data sources respectively;

[0090] A data hierarchical relationship acquisition module 1002 is used to acquire a data hierarchical relationship for displaying the data provided by the multiple data sources, wherein the data hierarchical relationship includes a subordinate relationship between different display nodes and a subordinate relationship between a display field and the display node;

[0091] A mapping relationship establishing module 1003, used to establish a mapping relationship between the data fields in the multiple data sources and the corresponding display fields in the display node according to the data hierarchical relationship;

[0092] A data acquisition module 1004 is used to acquire data matching the corresponding display field in the display node from the multiple data sources based on the mapping relationship and the connection relationship between the multiple data sources;

[0093] The display module 1005 is used to display the data according to the data hierarchical relationship.

[0094] In one embodiment, the multiple data sources include but are not limited to databases for providing relational data or non-relational data, and data sources for providing file-type data; the data field acquisition module 1001 is specifically used to: if the data source is a database for providing relational data or non-relational data, obtain the first address information and account login information of the database, access the database according to the first address information and account login information of the database, and obtain the data fields in the database; or, if the data source is a data source for providing file-type data, obtain the second address information of the data source, access the data source according to the second address information of the data source, and obtain the data fields in the data source.

[0095] In one embodiment, the data acquisition module 1004 is specifically used to: acquire original data matching the corresponding display field in the display node from the multiple data sources; and filter the original data according to a set data filtering condition to obtain data meeting the data filtering condition.

[0096] In one embodiment, the data acquisition module 1004 is further used to: after acquiring the original data matching the corresponding display field in the display node from the multiple data sources, verify the original data according to the set data exception verification condition; if it is determined that abnormal data exists in the original data, process the abnormal data in the original data using a preset exception processing method to obtain processed data.

[0097] In one embodiment, the data hierarchical relationship acquisition module 1002 is specifically used to: acquire display nodes and display fields for displaying the data provided by the multiple data sources; based on the display nodes and display fields, acquire the subordinate relationships between different display nodes and the subordinate relationships between display fields and the display nodes to obtain corresponding data hierarchical relationships.

[0098] In one embodiment, the mapping relationship establishment module 1003 is specifically used to: display the data hierarchical relationship in a tree directory manner, and display the multiple data sources in a list manner; obtain a selection instruction for the data source, and display the data field corresponding to the data source; obtain an association relationship between a data field selected from the data source and a display node selected from the display node; map the selected data field to a corresponding display field in the selected display node according to the association relationship, and establish a mapping relationship between the selected data field and the corresponding display field.

[0099] In one embodiment, the display module 1005 is specifically used to: determine the data source of the data corresponding to the display field according to the mapping relationship between the data fields in the multiple data sources and the corresponding display fields in the display node; determine the node type to which the display node corresponding to the display field belongs according to the subordinate relationship between different display nodes and the subordinate relationship between the display field and the display node; render the data in a preset data rendering method according to the data source of the data corresponding to the display field and the node type to which the display node corresponding to the display field belongs, and generate a corresponding data gene map; and display the data gene map.

[0100] For the specific definition of the processing device of the scientific data genome, please refer to the definition of the processing method of the scientific data genome above, which will not be repeated here. Each module in the above-mentioned processing device of the scientific data genome can be implemented in whole or in part by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.

[0101] In one embodiment, a computer device is provided. The computer device may be a terminal, and its internal structure diagram may be as follows: Fig.11As shown. The computer device includes a processor, a memory, a communication interface, a display screen and an input device connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be achieved through WIFI, an operator network, NFC (near field communication) or other technologies. When the computer program is executed by the processor, a method for processing a scientific data genome is implemented. The display screen of the computer device can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covered on the display screen, or a button, trackball or touchpad set on the computer device housing, or an external keyboard, touchpad or mouse, etc.

[0102] Those skilled in the art will understand that Fig.11 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0103] In one embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the following steps are implemented:

[0104] Establish connection relationships with multiple data sources and obtain data fields corresponding to the multiple data sources;

[0105] Acquire a data hierarchical relationship for displaying the data provided by the multiple data sources, wherein the data hierarchical relationship includes a subordinate relationship between different display nodes and a subordinate relationship between a display field and the display node;

[0106] Establishing a mapping relationship between the data fields in the plurality of data sources and the corresponding display fields in the display node according to the data hierarchical relationship;

[0107] Based on the mapping relationship and the connection relationship with multiple data sources, data matching the corresponding display fields in the display node are obtained from the multiple data sources, and the data are displayed according to the data hierarchical relationship.

[0108] In one embodiment, the multiple data sources include but are not limited to databases for providing relational data or non-relational data, and data sources for providing file-type data; then the processor also implements the following steps when executing the computer program: if the data source is a database for providing relational data or non-relational data, then obtain the first address information and account login information of the database, access the database according to the first address information and account login information of the database, and obtain the data fields in the database; or, if the data source is a data source for providing file-type data, then obtain the second address information of the data source, access the data source according to the second address information of the data source, and obtain the data fields in the data source.

[0109] In one embodiment, when the processor executes the computer program, the following steps are further implemented: acquiring original data matching the corresponding display fields in the display nodes from the multiple data sources; and filtering the original data according to set data filtering conditions to obtain data meeting the data filtering conditions.

[0110] In one embodiment, when the processor executes the computer program, the following steps are also implemented: the original data is verified according to the set data anomaly verification conditions; if it is determined that abnormal data exists in the original data, the abnormal data in the original data is processed using a pre-set exception processing method to obtain processed data.

[0111] In one embodiment, when the processor executes the computer program, the following steps are also implemented: obtaining display nodes and display fields for displaying the data provided by the multiple data sources; based on the display nodes and display fields, obtaining the subordinate relationships between different display nodes and the subordinate relationships between display fields and the display nodes to obtain corresponding data hierarchical relationships.

[0112] In one embodiment, when the processor executes the computer program, the following steps are further implemented: displaying the data hierarchy relationship in a tree directory manner, and displaying the multiple data sources in a list manner; obtaining a selection instruction for the data source, and displaying a data field corresponding to the data source; obtaining an association relationship between a data field selected from the data source and a display node selected from the display nodes; mapping the selected data field to a corresponding display field in the selected display node according to the association relationship, and establishing a mapping relationship between the selected data field and the corresponding display field.

[0113] In one embodiment, when the processor executes the computer program, the following steps are also implemented: according to the mapping relationship between the data fields in the multiple data sources and the corresponding display fields in the display nodes, the data source of the data corresponding to the display fields is determined; according to the subordinate relationship between different display nodes and the subordinate relationship between the display fields and the display nodes, the node type to which the display node corresponding to the display field belongs is determined; according to the data source of the data corresponding to the display field and the node type to which the display node corresponding to the display field belongs, the data is rendered in a preset data rendering method to generate a corresponding data gene map; and the data gene map is displayed.

[0114] In one embodiment, a computer readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:

[0115] Establish connection relationships with multiple data sources and obtain data fields corresponding to the multiple data sources;

[0116] Acquire a data hierarchical relationship for displaying the data provided by the multiple data sources, wherein the data hierarchical relationship includes a subordinate relationship between different display nodes and a subordinate relationship between a display field and the display node;

[0117] Establishing a mapping relationship between the data fields in the plurality of data sources and the corresponding display fields in the display node according to the data hierarchical relationship;

[0118] Based on the mapping relationship and the connection relationship with multiple data sources, data matching the corresponding display fields in the display node are obtained from the multiple data sources, and the data are displayed according to the data hierarchical relationship.

[0119] In one embodiment, the multiple data sources include but are not limited to databases for providing relational data or non-relational data, and data sources for providing file-type data; then the computer program, when executed by the processor, also implements the following steps: if the data source is a database for providing relational data or non-relational data, obtain first address information and account login information of the database, access the database according to the first address information and account login information of the database, and obtain data fields in the database; or, if the data source is a data source for providing file-type data, obtain second address information of the data source, access the data source according to the second address information of the data source, and obtain data fields in the data source.

[0120] In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: acquiring original data matching the corresponding display fields in the display nodes from the multiple data sources; and filtering the original data according to the set data filtering conditions to obtain data meeting the data filtering conditions.

[0121] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: the original data is verified according to the set data anomaly verification conditions; if it is determined that abnormal data exists in the original data, the abnormal data in the original data is processed using a pre-set exception processing method to obtain processed data.

[0122] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: obtaining display nodes and display fields for displaying the data provided by the multiple data sources; based on the display nodes and display fields, obtaining the subordinate relationships between different display nodes and the subordinate relationships between display fields and the display nodes, and obtaining corresponding data hierarchical relationships.

[0123] In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: displaying the data hierarchy relationship in a tree directory manner, and displaying the multiple data sources in a list manner; obtaining a selection instruction for the data source, and displaying a data field corresponding to the data source; obtaining an association relationship between a data field selected from the data source and a display node selected from the display nodes; mapping the selected data field to a corresponding display field in the selected display node according to the association relationship, and establishing a mapping relationship between the selected data field and the corresponding display field.

[0124] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: according to the mapping relationship between the data fields in the multiple data sources and the corresponding display fields in the display nodes, the data source of the data corresponding to the display fields is determined; according to the subordinate relationship between different display nodes and the subordinate relationship between the display fields and the display nodes, the node type to which the display node corresponding to the display field belongs is determined; according to the data source of the data corresponding to the display field and the node type to which the display node corresponding to the display field belongs, the data is rendered in a preset data rendering method to generate a corresponding data gene map; and the data gene map is displayed.

[0125] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory or optical memory, etc. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM).

[0126] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0127] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.

Claims

1. A method for processing scientific data genome, characterized in that: The method comprises: Establish connection relationships with multiple data sources and obtain data fields corresponding to the multiple data sources; Acquire a data hierarchical relationship for displaying the data provided by the multiple data sources, wherein the data hierarchical relationship includes a subordinate relationship between different display nodes and a subordinate relationship between a display field and the display node; According to the data hierarchical relationship, a mapping relationship is established between the data fields in the multiple data sources and the corresponding display fields in the display node; Based on the mapping relationship and the connection relationship with the multiple data sources, data matching the corresponding display fields in the display node are obtained from the multiple data sources, and the data is displayed according to the data hierarchical relationship; The step of establishing a mapping relationship between the data fields in the multiple data sources and the corresponding display fields in the display node according to the data hierarchical relationship includes: displaying the data hierarchical relationship in a tree directory manner and displaying the multiple data sources in a list manner; obtaining a selection instruction for the data source and displaying the data fields corresponding to the data source; obtaining an association relationship between a data field selected from the data source and a display node selected from the display node; mapping the selected data field to the corresponding display field in the selected display node according to the association relationship and establishing a mapping relationship between the selected data field and the corresponding display field; The displaying of the data according to the data hierarchical relationship includes: Determine the data source of the data corresponding to the display field according to the mapping relationship between the data fields in the multiple data sources and the corresponding display fields in the display node, and use different shapes for identification based on the difference of the data sources; Determine the node type to which the display node corresponding to the display field belongs according to the subordinate relationship between different display nodes and the subordinate relationship between the display field and the display node, and mark the node with different colors based on the different node types; According to the data source of the data corresponding to the display field and the shape identifier of the data source, as well as the node type to which the display node corresponding to the display field belongs and the color identifier of the node type, the data is rendered using a preset data rendering method to generate a corresponding data gene map; The data gene map is displayed, wherein the same node type in the data gene map includes multiple display nodes and corresponding display fields, and the data sources of the data corresponding to the display fields are the same or different; when the node types corresponding to the display nodes of the display fields are different, different colors are used for display, and when the data sources of the data corresponding to the display fields are different, different shape identifiers are displayed.

2. The method according to claim 1, characterized in that The multiple data sources include but are not limited to databases for providing relational data or non-relational data, and data sources for providing file-type data; establishing connection relationships with the multiple data sources and obtaining data fields corresponding to the multiple data sources respectively includes: If the data source is a database for providing relational data or non-relational data, first address information and account login information of the database are obtained, and the database is accessed according to the first address information and account login information of the database to obtain data fields in the database.

3. The method according to claim 2, characterized in that The method further comprises: If the data source is a data source for providing file-type data, the second address information of the data source is obtained, the data source is accessed according to the second address information of the data source, and the data field in the data source is obtained.

4. The method according to claim 1, characterized in that: The acquiring data matching the corresponding display fields in the display nodes from the multiple data sources includes: Acquire original data matching corresponding display fields in the display node from the multiple data sources; The original data is screened according to the set data screening conditions to obtain data that meets the data screening conditions.

5. The method according to claim 4, characterized in that After acquiring the original data matching the corresponding display fields in the display nodes from the multiple data sources, the method further includes: The original data is verified according to the set data anomaly verification conditions. If it is determined that there is abnormal data in the original data, the abnormal data in the original data is processed using a preset abnormal processing method to obtain processed data.

6. The method according to claim 1, characterized in that The obtaining of a data hierarchical relationship for displaying the data provided by the multiple data sources includes: Acquire display nodes and display fields for displaying the data provided by the multiple data sources; Based on the display nodes and display fields, the subordinate relationships between different display nodes and the subordinate relationships between display fields and the display nodes are acquired to obtain corresponding data hierarchical relationships.

7. A scientific data genome processing device, characterized in that: The device comprises: A data field acquisition module is used to establish a connection relationship with multiple data sources and obtain data fields corresponding to the multiple data sources; A data hierarchical relationship acquisition module, used to acquire a data hierarchical relationship for displaying the data provided by the multiple data sources, wherein the data hierarchical relationship includes a subordinate relationship between different display nodes and a subordinate relationship between a display field and the display node; A mapping relationship establishment module is used to establish a mapping relationship between the data fields in the multiple data sources and the corresponding display fields in the display node according to the data hierarchical relationship; specifically, it is used to display the data hierarchical relationship in a tree directory and display the multiple data sources in a list; obtain a selection instruction for the data source and display the data field corresponding to the data source; obtain an association relationship between the data field selected from the data source and the display node selected from the display node; map the selected data field to the corresponding display field in the selected display node according to the association relationship, and establish a mapping relationship between the selected data field and the corresponding display field; A data acquisition module, configured to acquire data matching the corresponding display field in the display node from the multiple data sources based on the mapping relationship and the connection relationship between the multiple data sources; A display module, configured to determine the data source of the data corresponding to the display field according to the mapping relationship between the data fields in the multiple data sources and the corresponding display fields in the display node, and to identify the data source using different shapes based on the difference of the data source; Determine the node type to which the display node corresponding to the display field belongs according to the subordinate relationship between different display nodes and the subordinate relationship between the display field and the display node, and mark the node with different colors based on the different node types; According to the data source of the data corresponding to the display field and the shape identifier of the data source, as well as the node type to which the display node corresponding to the display field belongs and the color identifier of the node type, the data is rendered using a preset data rendering method to generate a corresponding data gene map; The data gene map is displayed, wherein the same node type in the data gene map includes multiple display nodes and corresponding display fields, and the data sources of the data corresponding to the display fields are the same or different; when the node types corresponding to the display nodes of the display fields are different, different colors are used for display, and when the data sources of the data corresponding to the display fields are different, different shape identifiers are displayed.

8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

Images