Lipid data processing method and system, storage medium and electronic equipment
By obtaining data from lipid standard databases and building a knowledge map, the problem of data integration complexity in lipidomics is solved, seamless query and update across databases is achieved, and the efficiency and accuracy of data analysis are improved.
Patent Information
- Application Number
- CN202411482198.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-23
- Publication Date
- 2024-11-22
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
In the field of lipidomics, it is difficult for the existing technology to effectively integrate and analyze lipid data from multiple sources, resulting in complex data integration, difficulty in cross-platform association, outdated data and outdated functions, affecting the accuracy and reliability of research results. sex.
By obtaining data from lipid standard databases, performing data cleaning and preprocessing, and using ETL pipelines to import data into Neo4j and PostgreSQL, building a lipid-centric knowledge graph, supporting flexible query and inference, and achieving seamless query and queries across databases and Data update.
The data integration process is simplified and seamless query capabilities are provided across databases, allowing researchers to easily obtain and analyze comprehensive information from multiple sources, improving data reliability and research efficiency.
Smart Images

Figure CN119003641A_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the technical field of lipidomics, and relates to a lipid data processing method, and in particular to a lipid data processing method, system, storage medium and electronic device. Background Art
[0002] In the field of lipidomics, high-throughput mass spectrometry can be used to detect and characterize lipids in biological samples in detail. Through in-depth studies of the chemical and physical properties of lipids, researchers can reveal the complexity and diversity of lipid metabolism in biological systems. For example, using high-throughput mass spectrometry, researchers can accurately measure the changes in lipid molecules under specific biological states and infer their roles in cell signaling, energy metabolism, and membrane structure maintenance.
[0003] In recent years, with the continuous development of high-throughput mass spectrometry analysis technology and the accumulation of related knowledge bases, lipidomics is gradually transitioning from a disease phenotype verification tool to a hypothesis generation tool. This shift provides researchers with new perspectives and insights to help them explore the complexity of biological systems more deeply. At present, relevant researchers have recognized the importance of collecting and organizing relevant data, and the LIPID MAPS platform therefore provides a continuously updated tool guide to guide each stage of lipidomics analysis. However, with the rapid growth of data volume, the field still faces some challenges. Summary of the invention
[0004] The embodiments of the present application provide a lipid data processing method, system, storage medium and electronic device for constructing a lipid-centric knowledge graph.
[0005] In a first aspect, an embodiment of the present application provides a lipid data processing method, the lipid data processing method comprising: obtaining lipid-related data from a lipid standard database, the lipid-related data comprising entity nodes and relationship edges and lipid attribute information, wherein the relationship edges are used to represent the relationship between the entity nodes, the entity nodes comprising genes, proteins, lipids, diseases, phenotypes, drugs, foods, cell compartments, molecular functions, biological functions and / or pathways, and the relationship between the entity nodes comprises encoding, causing or affecting, interacting, being in, functioning, participating, existing, existing phenotype and / or treating; performing data cleaning and preprocessing on the lipid-related data, including: performing quality assessment on the lipid-related data to check the integrity, consistency and accuracy of the lipid-related data; using a cleaning script to clean the lipid The method comprises the following steps: filling missing values, processing duplicates and correcting outliers for lipid-related data; using an ETL pipeline to batch import the lipid-related data into Neo4j and PostgreSQL; creating a lipid-centric knowledge graph based on the lipid-related data in Neo4j and PostgreSQL, including: for Neo4j, using a py2neo or neo4j-python-driver library to connect to a Neo4j database, converting the entity nodes into Cypher query statements, and batch creating nodes; converting the relationship edges into Cypher query statements, and batch creating relationships; for PostgreSQL, using a psycopg2 library to connect to a PostgreSQL database, and using an executemany method to batch insert the lipid attribute information.
[0006] In an implementation of the first aspect, the entity nodes and relationship edges are stored in Neo4j, and the lipid attribute information is stored in PostgreSQL.
[0007] In an implementation of the first aspect, the lipid data processing method further includes: evaluating the knowledge graph according to a node type diversity index and a relationship type diversity index.
[0008] In an implementation of the first aspect, the lipid data processing method further includes: obtaining an alternative database; and selecting the lipid standard database from the alternative database based on the database's data integrity, data quality, update frequency, access convenience, citation frequency, integration with other databases, and / or data licensing terms.
[0009] In an implementation of the first aspect, the lipid data processing method further includes: analyzing the relationship network of lipids, proteins and diseases based on the knowledge graph; and / or obtaining the association between abnormal lipid metabolism and the occurrence of diseases based on the knowledge graph; and / or providing personalized diagnosis and treatment plans for patients based on the knowledge graph and in combination with the patient's lipidomics data.
[0010] In a second aspect, an embodiment of the present application provides a lipid data processing system, the lipid data processing system comprising: a data acquisition module, used to acquire lipid-related data from a lipid standard database, the lipid-related data comprising entity nodes and relationship edges and lipid attribute information, wherein the relationship edges are used to represent the relationship between the entity nodes, the entity nodes comprising genes, proteins, lipids, diseases, phenotypes, drugs, foods, cell compartments, molecular functions, biological functions and / or pathways, and the relationship between the entity nodes comprises encoding, causing or affecting, interacting, being in, function, participating, existing, existence phenotype and / or treating; a data processing module, used to clean and preprocess the lipid-related data; a data import module, used to import the lipid-related data into Neo4j and PostgreSQL in batches using an ETL pipeline; a graph construction module, used to create a graph based on the lipid-related data in Neo4j and PostgreSQL; A lipid-centric knowledge graph is constructed; wherein, data cleaning and preprocessing of the lipid-related data include: performing quality assessment on the lipid-related data, checking the integrity, consistency and accuracy of the lipid-related data; using a cleaning script to fill missing values, process duplicates and correct outliers for the lipid-related data; creating a lipid-centric knowledge graph based on the lipid-related data in Neo4j and PostgreSQL includes: for Neo4j, using py2neo or neo4j-python-driver library to connect to the Neo4j database, converting the entity nodes into Cypher query statements, and creating nodes in batches; converting the relationship edges into Cypher query statements, and creating relationships in batches; for PostgreSQL, using the psycopg2 library to connect to the PostgreSQL database, and using the executemany method to batch insert the lipid attribute information.
[0011] In a third aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the lipid data processing method described in any one of the first aspects of the embodiment of the present application is implemented.
[0012] In a fourth aspect, an embodiment of the present application provides an electronic device, comprising: a memory storing a computer program; a processor communicatively connected to the memory, and executing the lipid data processing method described in any one of the first aspects of the embodiment of the present application when the computer program is called.
[0013] As described above, the lipid data processing method, system, storage medium and electronic device provided in the embodiments of the present application have the following beneficial effects: The embodiment of the present application can construct a lipid-centric knowledge graph. The knowledge graph can naturally represent and store complex multidimensional relationships, support flexible queries and reasoning to facilitate the discovery of hidden connections, and can easily integrate and update data from different sources. This approach not only simplifies the data integration process, but also provides seamless query capabilities across databases, allowing researchers to easily obtain and analyze comprehensive information from multiple sources. BRIEF DESCRIPTION OF THE DRAWINGS
[0014] Figure 1A A flow chart of a lipid data processing method provided in an embodiment of the present application is shown.
[0015] Figure 1B Shown is an example diagram of a lipid-centered knowledge picture in the embodiments of the present application.
[0016] Figure 2 Shown is a flow chart for obtaining a lipid standard database in an embodiment of the present application.
[0017] Figure 3 Shown is a flowchart of analysis based on the knowledge graph in an embodiment of the present application.
[0018] Figure 4 Shown is a flow chart of data cleaning and preprocessing of lipid-related data in an embodiment of the present application.
[0019] Figure 5 Shown is a schematic diagram of the structure of the lipid data processing system provided in an embodiment of the present application.
[0020] Figure 6 Shown is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Component number description 500 Lipid Data Processing System 501 Data acquisition module 502 Data processing module 503 Data import module 504 Graph building blocks 600 Electronic devices 601 processor 602 Memory 6021 operating system 6022 app 603 Network Interface 604 Bus system 605 User Interface DETAILED DESCRIPTION
[0021] The following describes the embodiments of the present application through specific examples, and those skilled in the art can easily understand other advantages and effects of the present application from the contents disclosed in this specification. The present application can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present application. It should be noted that the following embodiments and features in the embodiments can be combined with each other without conflict.
[0022] It should be noted that the illustrations provided in the following embodiments are only used to illustrate the basic concept of the present application in a schematic manner, and therefore the illustrations only show components related to the present application rather than being drawn according to the number, shape and size of components in actual implementation. In actual implementation, the type, quantity and proportion of each component may be changed arbitrarily, and the component layout may also be more complicated.
[0023] In the embodiments of the present application, the words "exemplary" or "for example" represent examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.
[0024] In the embodiments of the present application, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: the existence of A alone, the existence of A and B at the same time, and the existence of B alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can represent: a, b, c, ab, ac, bc or abc, where a, b, c can be single or multiple.
[0025] Before further explaining the present application in detail, the nouns and terms involved in the embodiments of the present application are explained. The nouns and terms involved in the embodiments of the present application are subject to the following interpretations: <1> Lipids. Lipids are a class of biological molecules that are mainly used to store energy, form cell membranes, act as signaling molecules, and play a role in the metabolic process of organisms. The chemical structure of lipids usually contains long-chain fatty acids, which can be saturated or unsaturated. The main types of lipids include triglycerides, phospholipids, cholesterol, fatty acids, sterols, etc.
[0026] <2> Lipid database. Lipid database is an online resource dedicated to storing, managing and analyzing lipid-related information. The data in lipid database usually contains the chemical structure, biosynthesis pathway, physicochemical properties, etc. Lipid databases include LIPID MAPS, LipidIMMS Analyzer, PRIMe, LipidBank, MS DIAL, etc.
[0027] Lipid molecular tools include analytical software and databases. Although these software and databases provide powerful support in specific fields, there are still some key limitations and challenges that affect the comprehensive utilization and interpretation of lipidomics data.
[0028] On the one hand, the heterogeneity between databases and tools makes the data integration process too complicated. The above heterogeneity includes the diversity of data formats, inconsistent naming conventions and identifiers, differences in ontologies and classification systems, imbalanced data granularity and depth, and lack of metadata standardization. These factors make cross-platform data integration extremely difficult, especially when associating mass spectrometry data with biological pathways or genomic information. In addition, differences in the quality and credibility of data from different sources also increase the complexity of integration. This complexity not only increases the workload of researchers, but may also cause data misunderstandings and analytical biases, affecting the accuracy and reliability of research results.
[0029] On the other hand, the update frequency of different databases and analysis tools is often inconsistent, which leads to problems such as data obsolescence and outdated functions. In addition, lax version control will affect the reproducibility of research, and the imbalance of resource allocation will cause some important but niche lipid data to be updated late, and long-term lack of maintenance may lead to the accumulation of errors.
[0030] At least to address the above problems, the present application provides a lipid data processing method. The technical solution in the present application will be described in detail below in conjunction with the accompanying drawings in the present application.
[0031] Figure 1A The flow chart of the lipid data processing method provided by the embodiment of the present application is shown. Figure 1AAs shown, the lipid data processing method provided in the embodiment of the present application includes the following steps S11 to S14.
[0032] S11, obtain lipid-related data from the lipid standard database. The lipid-related data includes entity nodes, relationship edges, and lipid attribute information. Lipid standard databases, such as LIPID MAPS, ChEBI, HMDB, and SwissLipids, collect and integrate a large amount of detailed information about lipids, including the chemical structure, classification, function, and relationship of lipids with other molecules. According to the lipid standard database, lipid-related data including entity nodes, relationship edges, and lipid attribute information can be obtained.
[0033] S12, data cleaning and preprocessing of lipid related data.
[0034] S13, use the ETL (Extract, Transform, Load) pipeline to batch import lipid-related data into Neo4j and PostgreSQL. The ETL pipeline can integrate data from different sources and manage them in a unified manner to facilitate the subsequent construction of the knowledge graph. In addition, the ETL pipeline supports the simultaneous import of lipid-related data into a graph database (Neo4j) and a relational database (PostgreSQL) to meet different analysis needs.
[0035] S14, create a lipid-centric knowledge graph based on lipid-related data in Neo4j and PostgreSQL. An example of the knowledge graph is shown in Figure 1B shown.
[0036] As described above, the embodiments of the present application can construct a lipid-centric knowledge graph. The knowledge graph can naturally represent and store complex multidimensional relationships, support flexible queries and reasoning to facilitate the discovery of hidden connections, and can easily integrate and update data from different sources. This approach not only simplifies the data integration process, but also provides seamless query capabilities across databases, allowing researchers to easily obtain and analyze comprehensive information from multiple sources.
[0037] In some implementations, entity nodes and relationship edges are stored in Neo4j, and lipid attribute information is stored in PostgreSQL. By using the Neo4j graph database to store entity nodes and relationship edges, lipid-related graph structure queries can be performed efficiently. By using the PostgreSQL relational database to store detailed attribute information of entities, complex lipid attribute filtering and aggregation analysis can be supported.
[0038] In some implementations, the lipid data processing method may further include: evaluating the knowledge graph according to a node type diversity index and a relationship type diversity index. Among them, node type diversity is used to represent the number and distribution of different types of nodes, and relationship type diversity is used to represent the number and distribution of different types of relationships. By analyzing the node type diversity of the knowledge graph, researchers can understand whether the knowledge graph contains a sufficiently diverse range of biological entities, such as lipid molecules, enzymes, metabolic pathways, tissues, etc., which helps to ensure the comprehensiveness and representativeness of the knowledge graph in the research objectives. The more diverse the relationship types of the knowledge graph, the more comprehensive the network picture it can provide, and the more it can reflect the complex interactions in biological systems.
[0039] In some implementations, the lipid data processing method may also include the process of selecting a database and an ontology. The database contains structured information or knowledge storage, such as UniProt (protein database), GenBank (nucleic acid sequence database), LIPID MAPS (lipid database). Ontology is a formalized and clear specification of concepts, attributes and relationships in a specific field. In the biomedical field, ontology provides standardized vocabulary and relationship definitions between concepts, which helps to organize and share knowledge. For example, Gene Ontology (GO), Chemical Entities of Biological Interest (ChEBI), Lipid Ontology.
[0040] See also Figure 2 In the embodiment of the present application, the lipid data processing method may include the following steps S21 to S22.
[0041] S21, obtaining an alternative database.
[0042] S22, selecting a lipid standard database from the candidate databases based on the database's data completeness, data quality, update frequency, access convenience, citation frequency, integration with other databases, and / or data licensing terms.
[0043] Among them, data completeness is used to indicate the coverage of alternative databases for different entities. Data quality is used to evaluate the accuracy and reliability of data in the alternative databases. Update frequency is used to check the maintenance status and update cycle of the alternative databases. Accessibility is used to evaluate the API, download options, etc. in the alternative databases. Citation frequency is used to analyze the citations of alternative databases in scientific literature. The degree of integration with other databases is used to evaluate the cross-references of the alternative databases with other databases. Data licenses and terms of use are used to evaluate the openness and usage restrictions of the alternative databases to ensure that the data can be legally integrated and used.
[0044] Exemplarily, the lipid data processing method may further include: selecting an ontology based on its concept coverage, community adoption, maintenance status, mapping status with other ontologies, and / or data licensing and usage terms.
[0045] Among them, concept coverage is used to evaluate the coverage of corresponding concepts by the ontology. Community adoption is used to analyze the use of the ontology in relevant tools and databases. Maintenance status is used to check the version control and update frequency of the ontology. The mapping relationship with other ontologies is used to evaluate the interoperability of the ontology with other biomedical ontologies. Data licensing and terms of use are used to evaluate the openness and usage restrictions of the data to ensure that the data can be legally integrated and used.
[0046] Exemplarily, the entity nodes in the embodiments of the present application include: genes, proteins, lipids, diseases, phenotypes, drugs, foods, cell compartments, molecular functions, biological functions, pathways, etc. Table 1 shows an example table of descriptions of entity nodes and their source databases.
[0047] Table 1. Entity node description and its source database example table entity describe database Gene DNA sequence that encodes a protein Gene Ontology (GO) protein Functional molecules encoded by genes Protein Ontology (PRO) Lipids Fatty acids and their derivatives in organisms Chemical Entities of Biological Interest (ChEBI) disease Pathological conditions that affect the function of an organism Disease Ontology (DO) Phenotype Observable characteristics of organisms Human Phenotype Ontology (HPO) drug Substances used to treat, prevent or diagnose disease Drug Ontology (DrON) food Nutrients available for intake FoodOn Cell compartment Specific functional areas within cells Cell Ontology (CL) Molecular function Biological activities at the molecular level Gene Ontology-Molecular Function (GO-MF) Biological Function Function at the biological system level Gene Ontology - Biological Process (GO-BP) path Biochemical reaction sequence Pathway Ontology (PW) Exemplarily, the relationships in the embodiments of the present application include: coding relationships, such as gene->protein; cause-or-affect relationships, such as gene->phenotype, gene->disease, lipid->disease, pathway->disease; interaction relationships, such as protein<->lipid, protein<->protein; in relationships, such as protein->cell compartment; functional relationships, such as protein->molecular function; participation relationships, such as protein->biological function, protein->pathway, gene->pathway; existence relationships, such as food->lipid; cause-or-affect relationships, such as food->disease, lipid->disease; existence phenotypic relationships, such as disease->phenotype; therapeutic relationships, such as drug->disease. Table 2 shows an example table of descriptions of relationships and their source databases.
[0048] Table 2. Relationship description and its source database example table relation describe database Gene-coding-protein Gene-to-protein transcription Ensembl, NCBI Gene Genes - Cause or Influence - Phenotype The influence of genes on phenotype OMIM Genes that cause or influence disease The influence of genes on disease OMIM Protein-Interaction-Protein Protein-protein interactions IntAct, STRING Protein-Lipid Interactions Protein-lipid interactions STITCH Protein-in-cell compartment Protein localization in cells Gene Ontology–Cellular Compartment (GO-CC) Protein-Function-Molecular Function Functional properties of proteins Gene Ontology–Molecular Function (GO-MF) Protein-involvement-biological function The role of proteins in biological processes Gene Ontology-Biological Process (GO-BP) Protein-Involved-Pathway The role of proteins in biochemical reactions Reactome, KEGG Protein-Causes_or_Affects_Disease The impact of protein on disease DisGeNET Lipids cause or affect disease The impact of lipids on disease DisGeNET Lipid-involved-pathways The role of lipids in biochemical reactions Reactome, KEGG, LipidMap Disease-Presence-Phenotype Phenotypic characteristics of the disease HPO Database Drugs-Treatments-Diseases The therapeutic effect of drugs on diseases DrugBank Food-Presence-Lipids Lipid components of food FooDB See also Figure 3 In some implementations, the lipid data processing method may further include the following steps S31 to S33.
[0049] S31, based on the knowledge graph, analyzes the relationship network of lipids, proteins and diseases to deeply understand the complex role of lipids, proteins, etc. in the development of diseases. This involves lipid nodes, protein nodes and disease nodes in the knowledge graph, as well as lipid-protein interactions, protein-disease relationships and lipid-disease relationships.
[0050] S32, based on the knowledge graph, obtain the association between abnormal lipid metabolism and disease occurrence to reveal how lipid metabolism disorders affect the occurrence and development of diseases.
[0051] S33, provides personalized diagnosis and treatment plans for patients based on knowledge graph and combined with patients' lipidomics data.
[0052] See also Figure 4 In some implementations, data cleaning and preprocessing of lipid-related data includes the following steps S41 and S42.
[0053] S41, perform quality assessment on the acquired lipid-related data to check the completeness, consistency, and accuracy of the data.
[0054] For example, when checking data integrity, the proportion of non-null values in each field may be calculated to ensure that the integrity of key fields (such as ID, name) reaches a predetermined threshold (such as 95%).
[0055] For example, when performing a consistency check, it is possible to verify whether the data format is as expected (such as a date format, an ID format), implement regular expression verification, and ensure that the data format complies with a predefined pattern.
[0056] For example, when performing an accuracy check, lipid-related data may be randomly sampled and compared with the original data source to ensure that the data accuracy reaches a predetermined threshold (eg, 99%).
[0057] S42, use cleaning scripts to handle relevant data issues, such as missing value filling, duplicate processing, outlier correction, etc.
[0058] For example, when filling missing values, missing values such as nan and non_specified can be unified as NULL, and an additional field can be created to mark the reason for missing data.
[0059] Exemplarily, when performing duplicate item processing, a hash table may be used to quickly detect duplicate items and merge information.
[0060] Exemplarily, when performing outlier correction, correction can be performed by using anomaly detection based on statistical methods (e.g., characters that are too long) combined with field-specific rules, such as garbled protein names.
[0061] In some implementations, the lipid data processing method may further include: constructing and maintaining a central terminology mapping table, stored in a relational database; and regularly updating the mapping table through an automated script to ensure consistency with the latest standards. In this way, data consistency can be ensured and confusion or errors caused by inconsistent terminology can be reduced. In addition, this method is also conducive to ensuring that the terminology mapping table is consistent with the latest standards, so that the system always uses the latest terminology standards.
[0062] In some implementations, creating a lipid-centric knowledge graph based on lipid-related data in Neo4j and PostgreSQL includes the following steps S51 and S52.
[0063] S51, for Neo4j, use py2neo or neo4j-python-driver library to connect to Neo4j database. Convert entity nodes into Cypher query statements and create nodes in batches. Convert relationship edges into Cypher query statements and create relationships in batches.
[0064] S52, for PostgreSQL, use the psycopg2 library to connect to the PostgreSQL database and use the executemany() method to batch insert lipid attribute information.
[0065] The protection scope of the lipid data processing method provided in the embodiment of the present application is not limited to the execution order of the steps listed in this embodiment. All solutions implemented by adding, reducing or replacing steps in the prior art based on the principles of the present application are included in the protection scope of the present application.
[0066] An embodiment of the present application also provides a lipid data processing system, which can implement the lipid data processing method described in the present application. However, the implementation device of the lipid data processing method described in the present application includes but is not limited to the structure of the lipid data processing system listed in this embodiment. All structural deformations and replacements of the prior art made according to the principles of the present application are included in the protection scope of the present application.
[0067] Figure 5 Schematic diagram of the lipid data processing system provided in the embodiment of the present application. Figure 5As shown, the lipid data processing system 500 includes a data acquisition module 501, a data processing module 502, a data import module 503 and a graph construction module 504. The data acquisition module 501 is used to obtain lipid-related data from a lipid standard database, and the lipid-related data includes entity nodes and relationship edges and lipid attribute information. The data processing module 502 is used to clean and preprocess the lipid-related data. The data import module 503 is used to import lipid-related data into Neo4j and PostgreSQL in batches using an ETL pipeline. The graph construction module 504 is used to create a lipid-centric knowledge graph based on the lipid-related data in Neo4j and PostgreSQL.
[0068] It should be understood that the specific process of each module executing the above corresponding steps has been described in detail in the above method embodiment, and for the sake of brevity, it will not be repeated here.
[0069] The present application also provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by the processor, the lipid data processing method provided by the present application is implemented. A person of ordinary skill in the art can understand that all or part of the steps in the method for implementing the above embodiment can be completed by instructing the processor through a program, and the program can be stored in a computer-readable storage medium, and the storage medium is a non-transitory medium, such as a random access memory, a read-only memory, a flash memory, a hard disk, a solid-state hard disk, a magnetic tape, a floppy disk, an optical disc, and any combination thereof. The above storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or a data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a digital video disc (DVD)), or a semiconductor medium (e.g., a solid-state disk (SSD)), etc.
[0070] An embodiment of the present application also provides an electronic device. Figure 6 is a schematic block diagram of an electronic device provided in an embodiment of the present application. Figure 6 As shown, the electronic device 600 includes: at least one processor 601, a memory 602, at least one network interface 603 and a user interface 605. The various components in the electronic device 600 are coupled together through a bus system 604. It can be understood that the bus system 604 is used to realize the connection and communication between these components. In addition to the data bus, the bus system 604 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, the bus system 604 is not shown in FIG. Figure 6 In the specification, various buses are labeled as bus systems.
[0071] The user interface 605 may include a display, a keyboard, a mouse, a trackball, a click gun, keys, buttons, a touch pad or a touch screen.
[0072] It is understood that the memory 602 can be a volatile memory or a non-volatile memory, and can also include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static random access memory (SRAM), synchronous static random access memory (SSRAM). The memory described in the embodiments of the present application is intended to include but is not limited to these and any other suitable categories of memory.
[0073] The memory 602 in the embodiment of the present application is used to store various categories of data to support the operation of the electronic device 600. Examples of these data include: any executable program for operating on the electronic device 600, such as an operating system 6021 and an application 6022; the operating system 6021 includes various system programs, such as a framework layer, a core library layer, a driver layer, etc., for implementing various basic services and processing hardware-based tasks. The application 6022 may include various applications, such as a media player (Media Player), a browser (Browser), etc., for implementing various application services. The lipid data processing method provided in the embodiment of the present application may be included in the application 6022.
[0074] The method disclosed in the above embodiment of the present application can be applied to the processor 601, or implemented by the processor 601. The processor 601 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by an integrated logic circuit of hardware in the processor 601 or an instruction in the form of software. The above processor 601 may be a general-purpose processor, a digital signal processor (DSP, Digital Signal Processor), or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The processor 601 can implement or execute the various methods, steps and logic block diagrams disclosed in the embodiments of the present application. The general processor 601 may be a microprocessor or any conventional processor, etc. In combination with the steps of the accessory optimization method provided in the embodiment of the present application, it can be directly embodied as a hardware decoding processor to execute, or it can be executed by a combination of hardware and software modules in the decoding processor. The software module can be located in a storage medium, which is located in a memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.
[0075] In an exemplary embodiment, the electronic device 600 may be implemented by one or more application specific integrated circuits (ASIC), DSP, programmable logic device (PLD), complex programmable logic device (CPLD) to execute the aforementioned method.
[0076] The embodiment of the present application may also provide a computer program product, which includes one or more computer instructions. When the computer instructions are loaded and executed on a computing device, the process or function described in the embodiment of the present application is generated in whole or in part. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from one website, computer or data center to another website, computer or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means.
[0077] When the computer program product is executed by a computer, the computer executes the method described in the above method embodiment. The computer program product may be a software installation package, and when the above method is required, the computer program product may be downloaded and executed on a computer.
[0078] The terms "component", "module", "system", etc. used in this specification are used to represent computer-related entities, hardware, firmware, a combination of hardware and software, software, or software in execution. For example, a component can be, but is not limited to, a process, a processor, an object, an executable file, an execution thread, a program and / or a computer running on a processor. By way of illustration, both applications and computing devices running on a computing device can be components. One or more components may reside in a process and / or an execution thread, and a component may be located on a computer and / or distributed between two or more computers. In addition, these components may be executed from various computer-readable media having various data structures stored thereon. Components may, for example, communicate through local and / or remote processes according to signals having one or more data packets (e.g., data from two components interacting with another component between a local system, a distributed system and / or a network, such as the Internet interacting with other systems through signals).
[0079] Those of ordinary skill in the art will appreciate that the various illustrative logical blocks and steps described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel may use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.
[0080] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0081] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0082] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
[0083] In the above embodiments, the functions of each functional unit can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions (programs). When the computer program instructions (programs) are loaded and executed on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. Computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, computer instructions can be transmitted from one website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode.
[0084] If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory, random access memory, disk or optical disk, etc., various media that can store program codes.
[0085] In summary, the present application embodiment provides lipid data processing method, system, storage medium and electronic device. The present application embodiment can construct a knowledge map centered on lipids. The knowledge map can naturally represent and store complex multidimensional relationships, and can support flexible queries and reasoning to facilitate the discovery of hidden connections, and can easily integrate and update data from different sources. This approach not only simplifies the data integration process, but also provides seamless query capabilities across databases, allowing researchers to easily obtain and analyze comprehensive information from multiple sources. Therefore, the present application effectively overcomes various shortcomings in the prior art and has a high industrial utilization value.
[0086] The above embodiments are merely illustrative of the principles and effects of the present application and are not intended to limit the present application. Anyone familiar with the technology may modify or change the above embodiments without violating the spirit and scope of the present application. Therefore, all equivalent modifications or changes made by a person of ordinary skill in the art without departing from the spirit and technical ideas disclosed in the present application shall still be covered by the claims of the present application.
Claims
1. A lipid data processing method, characterized in that: The lipid data processing method comprises: Obtain lipid-related data from a lipid standard database, wherein the lipid-related data includes entity nodes and relationship edges and lipid attribute information, wherein the relationship edges are used to represent the relationship between the entity nodes, the entity nodes include genes, proteins, lipids, diseases, phenotypes, drugs, foods, cell compartments, molecular functions, biological functions and / or pathways, and the relationship between the entity nodes includes encoding, causing or affecting, interacting, being in, functioning, participating, existing, existing phenotype and / or treating; Performing data cleaning and preprocessing on the lipid-related data, including: performing quality assessment on the lipid-related data, checking the integrity, consistency and accuracy of the lipid-related data; using a cleaning script to fill missing values, process duplicates and correct outliers on the lipid-related data; Importing the lipid-related data into Neo4j and PostgreSQL in batches using an ETL pipeline; Create a lipid-centric knowledge graph based on lipid-related data in Neo4j and PostgreSQL, including: For Neo4j, use py2neo or neo4j-python-driver library to connect to the Neo4j database, convert the entity nodes into Cypher query statements, and create nodes in batches; convert the relationship edges into Cypher query statements, and create relationships in batches; For PostgreSQL, the psycopg2 library was used to connect to the PostgreSQL database, and the executemany method was used to batch insert the lipid property information.
2. The lipid data processing method according to claim 1, characterized in that, The entity nodes and relationship edges are stored in Neo4j, and the lipid attribute information is stored in PostgreSQL.
3. The lipid data processing method according to claim 1, characterized in that, The lipid data processing method also includes: The knowledge graph is evaluated according to a node type diversity index and a relationship type diversity index.
4. The lipid data processing method according to claim 1, characterized in that, The lipid data processing method also includes: Obtain alternative databases; The lipid standard database is selected from the alternative databases based on the data integrity, data quality, update frequency, access convenience, citation frequency, integration with other databases and / or data licensing terms of the database.
5. The lipid data processing method according to claim 1, characterized in that, The lipid data processing method also includes: Analyze the relationship network of lipids, proteins and diseases based on the knowledge graph; and / or Obtaining the association between abnormal lipid metabolism and the occurrence of diseases based on the knowledge graph; and / or Based on the knowledge graph and combined with the patient's lipidomics data, a personalized diagnosis and treatment plan is provided to the patient.
6. A lipid data processing system, characterized in that: The lipid data processing system comprises: A data acquisition module, used for acquiring lipid-related data from a lipid standard database, wherein the lipid-related data includes entity nodes and relationship edges and lipid attribute information, wherein the relationship edges are used to represent the relationship between the entity nodes, the entity nodes include genes, proteins, lipids, diseases, phenotypes, drugs, foods, cell compartments, molecular functions, biological functions and / or pathways, and the relationship between the entity nodes includes encoding, causing or affecting, interacting, being in, functioning, participating, existing, existing phenotype and / or treating; A data processing module, used for cleaning and preprocessing the lipid-related data; A data import module, used for batch importing the lipid-related data into Neo4j and PostgreSQL using an ETL pipeline; A graph building module for creating lipid-centric knowledge graphs based on lipid-related data in Neo4j and PostgreSQL; Wherein, data cleaning and preprocessing of the lipid-related data include: performing quality assessment on the lipid-related data to check the integrity, consistency and accuracy of the lipid-related data; using a cleaning script to fill missing values, process duplicates and correct outliers on the lipid-related data; Creating a lipid-centric knowledge graph from lipid-related data in Neo4j and PostgreSQL includes: For Neo4j, use py2neo or neo4j-python-driver library to connect to the Neo4j database, convert the entity nodes into Cypher query statements, and create nodes in batches; convert the relationship edges into Cypher query statements, and create relationships in batches; For PostgreSQL, the psycopg2 library was used to connect to the PostgreSQL database, and the executemany method was used to batch insert the lipid property information.
7. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the lipid data processing method according to any one of claims 1 to 5 is implemented.
8. An electronic device, characterized in that: The electronic device comprises: A memory storing a computer program; A processor is communicatively connected to the memory and executes the lipid data processing method according to any one of claims 1 to 5 when calling the computer program.
Citation Information
Patent Citations
Drug map construction and drug knowledge mining method based on drug knowledge data
CN115188419A
Multi-dimensional knowledge graph construction method, device, equipment and product
CN116992037A
Molecular interaction prediction method based on knowledge graph and multi-task learning
CN117037898A
Knowledge lens for multidimensional domains
WO2024182207A1
