2098 results about "Unstructured data" patented technology

The invention relates to a dynamic data pipeline construction method based on artificial intelligence and multi-modal data processing, and belongs to the technical field of data fusion treatment and artificial intelligence. According to the method, a multi-modal deep learning model is adopted, semantic analysis is performed on business documents, user requirements and function specification instructions, and key indexes, data requirements and logic constraints are extracted; constructing a multi-modal knowledge graph, performing unified representation and feature extraction on structured and unstructured data resources, and performing embedded learning by using a graph neural network; based on a deep semantic matching model and a hybrid recommendation system, realizing accurate matching of business requirements and data resources; modeling generation of a data processing flow into a Markov decision process by adopting a reinforcement learning strategy, and automatically generating an optimized data processing workflow; the adaptability of the model to new business requirements is improved by utilizing a meta-learning algorithm; and dynamic scheduling and execution of tasks are realized through a workflow engine. According to the invention, the data processing efficiency can be improved.

The present invention provides a system and method for causality-augmented generative intelligence capable of autonomously discovering non-obvious actionable insights from heterogeneous and multimodal data sources. The system integrates a data ingestion unit for semantic and temporal harmonization of structured and unstructured datasets, a causal inference processor for constructing a dynamically evolving directed causal knowledge representation using perturbation-based validation, a latent representation processor that combines multimodal semantic embeddings with causal parameters to generate fused latent vectors, and a generative insight processor utilizing causally constrained generative reasoning to synthesize hypotheses anchored to verified cause-effect dependencies. A validation processor performs counterfactual assessment and observational verification to ensure retention of only those insights that remain consistent with causal ground truth.

The invention discloses a power plant operation and maintenance knowledge intelligent query method based on a large language model and an RAG technology. The method comprises the following steps: constructing a power plant operation and maintenance knowledge vector library covering structured, semi-structured and unstructured data; receiving a natural language question of a user, inputting an improved instruction to align a preprocessor, and generating a question semantic vector and an intention tag; relevant knowledge fragments are retrieved and sorted through a semantic matching retriever in combination with the intention labels; constructing a large language model cue word structure based on the retrieval result and the original question, generating candidate answers and recording a reference path; and finally, performing term specification and consistency verification according to the expert rule base, and outputting a structured and traceable final answer. According to the invention, the improved RAG technology is fused to realize intelligent query of the operation and maintenance knowledge of the power plant.

The invention discloses a power plant intelligent maintenance method and system based on multi-modal dynamic graph learning. The method comprises the following steps: acquiring structured sensor data, unstructured data and equipment physical topology data of equipment operation in real time through a multi-source sensor cluster and an industrial terminal; the method comprises the following steps: preprocessing multi-modal data, and fusing multi-modal features by using a double-flow Transform architecture and a gated attention mechanism to generate a joint embedded representation; constructing a dynamic causal graph based on equipment physical topology data and sensor time sequence characteristics, updating an edge weight through a GraphSAGE algorithm, fusing domain rule constraints, and outputting equipment state information; generating a maintenance strategy through an improved near-end strategy optimization algorithm according to the state and the equipment health index; and finally, the maintenance strategy triggers third-level early warning of the DCS through an OPC UA protocol, and a maintenance instruction is accurately issued. According to the method, the defects of a traditional method in the aspects of data fusion, fault modeling and decision making are overcome, and the safety, the economical efficiency and the operation and maintenance intelligent level of power plant equipment are remarkably improved.

The invention discloses an informatization project management system based on big data analysis, which belongs to the field of big data and comprises a data acquisition module, a time sequence modeling module, a task coupling analysis module, a risk clustering identification module, a resource allocation prediction module and the like. The data acquisition module asynchronously and parallelly acquires structured and unstructured data and uniformly encodes the structured and unstructured data; the time sequence modeling module constructs a multi-dimensional time sequence based on an autoregressive residual network; the task coupling analysis module fuses the task trajectory and the dependency relationship to generate a task influence directed graph; the risk clustering identification module identifies risks through variational graph auto-encoder mapping; the resource allocation prediction module constructs a dynamic resource priority based on a graph attention mechanism; a progress deviation traceability module identifies a deviation causal chain; the knowledge graph decision-making module corrects resource priorities and path strategies in a cross-graph manner; and the project global control module dynamically adjusts key paths and resource configuration and performs closed-loop self-correction. The beneficial effect is that the intelligent level and the risk response capability of project management are improved.

A generative AI-supported system (100) for real-time demand forecasting and inventory optimization in supply chain management, which includes the following: a data collection and integration module configured to aggregate and preprocess structured and unstructured data from multiple sources, including historical sales records, IoT sensors, external market trends, and environmental factors; a generative AI-based forecasting module configured to process input data, recognize complex patterns, and generate highly accurate real-time demand forecasts using deep learning techniques; an inventory optimization module configured to dynamically calculate and adjust inventory levels based on demand forecasts, replenishment plans, lead times, and safety stock requirements; a decision support and analysis module configured to generate actionable insights, provide simulations of multiple scenarios, and recommend cost-effective strategies for supply chain operations; a real-time warning and notification module configured to monitor supply chain activities and inform stakeholders of potential disruptions, anomalies, or demand spikes; a user interface and integration module configured to provide outputs via a user-friendly dashboard and seamlessly integrate with existing enterprise resource planning (ERP), warehouse management systems (WMS), and logistics platforms.

The present application relates to the technical field of drug screening, and in particular to a method and system for enhancing the ability of a large language model to answer questions of a specific field. The method comprises the following steps: using a large language model to extract a relation triple from a data set, wherein the data set comprises structured data and unstructured data; on the basis of the relation triple, constructing a knowledge graph of G protein coupled receptors (GPCRs), and storing the knowledge graph in a form of a graph database, wherein the knowledge graph comprises a GPCR entity and a relation thereof; using a pre-trained large language model to search the graph database for related information of a specific field to obtain prompt information, wherein the specific field is the field of GPCRs; and on the basis of the prompt information and the pre-trained large language model, obtaining an answer result, wherein the answer result is returned to a user by the pre-trained large language model. In the present application, by constructing a knowledge graph, the large language model is endowed with accurate and real-time field knowledge of GPCRs, and the ability of the large language model to answer questions of the field of GPCRs is enhanced.

The invention discloses an AI-based automatic financial information processing method, and relates to the field of financial automation, and the method comprises the steps: achieving the automatic collection and storage of structured and unstructured data through the access of enterprise multi-source financial data; systematic preprocessing is carried out on the collected multi-source heterogeneous financial data, and a unified and high-quality financial data set is constructed; based on natural language processing and a knowledge graph technology, performing text semantic understanding, transaction automatic classification, field standardization and label generation on the cleaned and integrated financial data; comprehensively quantifying enterprise operation and financial performance based on the structured transaction data and the semantic annotation result; based on historical financial indexes, establishing a multi-model architecture to predict key financial variables; and based on the structured data, the prediction result and the historical rule, identifying potential financial abnormity and risk behaviors, and realizing intelligent early warning. According to the method, the intelligence, the real-time performance and the accuracy of financial information processing can be remarkably improved.

The invention discloses a human resource management method and system based on data security. The method comprises the steps that multi-source human resource data are collected through a standardized interface, and sensitive levels are marked in a classified mode; calling a dynamic encryption engine based on the sensitive level and the data type, performing asymmetric encryption on the structured data, and performing hybrid encryption on the unstructured data; a dynamic hierarchical access control strategy is generated in combination with user roles and service scenes, and the permission range is adjusted in real time; laws and regulations such as GDPR and CCPA are analyzed through a compliance rule base, data operation legality is automatically verified, and illegal behaviors are blocked; k-anonymity and differential privacy technologies are adopted to desensitize sensitive data, and privacy protection and data availability balance are ensured; and recording a full-process operation log based on the block chain and generating a non-tampering audit report. The system comprises a data classification acquisition module, a dynamic encryption engine module, an access control engine module and the like. According to the method, the problems of data protection rigidness, compliance response lag and privacy-utility imbalance of a traditional HR system are solved.

The invention relates to the technical field of risk management and early warning, and discloses a risk early warning method comprising the following steps: collecting multi-source data including structured data, unstructured data and time series data; the invention provides a risk early warning system, which is used for performing cleaning, standardization processing and fusion on multi-source data to generate a unified data set for analysis, and comprises a data acquisition module used for acquiring the multi-source data including structured data, unstructured data and time sequence data; the data processing module is used for carrying out cleaning, standardization processing and fusion on the multi-source data and generating a unified data set, the electronic equipment comprises a memory, a processor and a communication module, and the processor implements the risk early warning method during execution. Through multi-source data fusion, a dynamic threshold model and deep learning analysis, the risk is accurately identified, the method adapts to the dynamic environment in real time, false alarms and missing alarms are reduced, and the long-term monitoring adaptability is improved.

A system and method for structuring and analyzing multimodal, unstructured data, as well as an article of manufacture and processor-readable storage medium implementing the same, may be used to provide a content creator with a tool to understand what actionable steps they could take to make a video perform well or go viral. Embodiments include a user interface simultaneously including a region for accepting a user query and a region that displays insight cards. The insight cards are generated based on retrieving a plurality of streaming contents, sorting the plurality of streaming contents into a viral set using one or more virality metrics, generating at least one token from the viral set, and performing a search of the viral set as a function of the at least one token to produce one or more results. The results are presented through the one or more insight cards in the user interface.

The invention discloses an intelligent financial risk early warning method and system based on a management decision, and relates to the technical field of data intelligence, and the method comprises a multi-source heterogeneous data collection module which obtains enterprise financial data, supply chain data, market public opinion data and industry reference data in real time through an API interface, risk keywords are extracted from news, social media and policy documents through a natural language processing technology according to the market public opinion data; the streaming data processing engine is constructed based on an Apache Flink framework, performs windowing processing on the real-time data stream, calculates the dynamic fluctuation ratio of financial indexes by sliding a time window, and compares the dynamic fluctuation ratio with a preset industry risk threshold value; and a risk decision fusion model, a dynamic threshold adaptive module and a man-machine collaborative early warning terminal. According to the method, millisecond-level financial index fluctuation monitoring is realized through a streaming computing framework, a knowledge graph and a natural language processing technology are fused, a risk entity and a causal chain are extracted from unstructured data, and a multi-dimensional risk portrait is constructed.

The invention provides an unstructured database federated learning collaboration method and system based on swarm intelligence, and relates to the technical field of structured data, and the method comprises the steps: training a query pattern recognition sub-model, a path planning sub-model and a resource allocation sub-model through federated learning, and constructing a swarm intelligence collaboration network. After a user query request is analyzed by the query mode recognition sub-model, candidate query paths are generated and optimized by fusing an ant colony algorithm and a particle swarm algorithm, and a query execution scheme is generated. And the resource allocation sub-model performs resource scheduling accordingly. And generating a performance optimization target for updating local model parameters of each node, and fusing the updated parameters through a security aggregation algorithm to guide the next query optimization. According to the method, the query efficiency of the unstructured database is improved, and the resource consumption is reduced.

The invention relates to the technical field of construction engineering cost management, and discloses an intelligent engineering cost calculation system based on multi-source heterogeneous data fusion, and the system comprises a multi-source data collection module which is used for collecting structured data and unstructured data from a design file, a market database, a construction monitoring system, a contract document, and a historical project library; and the heterogeneous data fusion module is connected with the multi-source data acquisition module and analyzes the risk terms in the contract text by adopting a natural language processing technology. According to the invention, the multi-source data acquisition module is used for widely collecting data in multiple aspects of design, market, construction, contract and the like, the problems of data splitting and information isolated island in traditional cost management are solved, integration of multi-source heterogeneous data is realized, and the heterogeneous data fusion module utilizes advanced technologies of natural language processing, image recognition and the like, so that the cost management efficiency is improved. Contract texts and design drawings can be efficiently analyzed, the processing capacity of unstructured data is improved, and the error rate and omission rate of manual interpretation are reduced.

This disclosure includes a process for merging legacy databases having different data schema into a principal data store. A computing device retrieves a legacy database from each of a plurality of domains of an organization to form a plurality of legacy databases, where at least two legacy databases in the plurality of legacy databases have a different data schema. For each of the plurality of legacy databases, the computing device retrieves data from the respective legacy database, places the data from the respective legacy database into a respective unstructured database, and merges the respective unstructured database into a principal data store designed to hold data for every domain of the plurality of domains.

The invention provides an intelligent data production method and system based on a graph neural network and adaptive learning, and the method comprises the steps: collecting a text, a time sequence, an image and sensor data in real time, and converting unstructured data into a structured JSON format through a format analysis tool; extracting text entity features based on a large language model, modeling a cross-modal entity association relationship in combination with a graph neural network, and fusing multi-source heterogeneous data through a dynamic knowledge graph; the detection threshold is dynamically optimized by adopting a reinforcement learning algorithm, and the false alarm rate is reduced in combination with a double-track verification mechanism; and predicting a data trend by using the space-time diagram convolutional network, and outputting an interpretability analysis report through the generative large model. According to the invention, a multi-protocol adaptation engine and a distributed stream processing architecture are adopted, and a protocol analysis layer automatically identifies a plurality of industrial protocols, so that the manual adaptation time is reduced; and real-time synchronization of production line-level data is realized through edge node parallel acquisition and compression transmission.

The invention discloses an image-text content auditing method and system based on a multi-modal large model, and the method achieves the deep semantic understanding and cross-modal integration of unstructured data through the cooperative work of all modules. A semantic association graph is generated through a multi-modal large model, the association recognition precision of the system on situations and information of images, texts, audios and videos is improved, and the problem that an existing system is inaccurate in semantic understanding is solved; the multi-modal data integration module realizes unified alignment of cross-modal data and layered mapping of information density, situation correlation and semantic consistency, and constructs an image-text association vector space, so that data splitting in an auditing process is eliminated; the content abnormity quantification module is combined with the intelligent control module, multi-level auditing decision is carried out through quantitative calculation and comparison of an auditing weight value Hqwz and a content abnormity index Cxzs, manual rechecking is automatically triggered, automatic issuing is directly carried out, the auditing efficiency is effectively improved, and the manual auditing burden is reduced.

The invention relates to an enterprise-level simulation knowledge graph construction method based on multi-modal data integration, and belongs to the technical field of knowledge graphs. The method comprises the following steps: integrating structured data, semi-structured data and unstructured data through a multi-modal data warehouse; performing knowledge extraction on the semi-structured data and the non-structured data to obtain entities and relationships, and performing knowledge fusion; storing the fused entities and relationships by using a graph database, and constructing a simulation knowledge graph; a vector database is embedded in combination with a simulation knowledge graph, semantic extension search is realized through multi-modal joint search, similar cases are searched through a simulation result graph, and a simulation scheme comparison matrix is automatically generated. The multi-modal data is effectively integrated, the comprehensiveness and accuracy of knowledge graph construction are improved, more powerful, efficient and intelligent support is provided for simulation analysis of enterprises, and the enterprises can be assisted in rapidly making scientific decisions in complex and changeable business scenes.

An Artificial Intelligence (AI) & Generative AI-driven cross-domain document analysis system enables accurate and consistent narratives across a longitudinal timeline for an entity regarding communications in different operational aspects. The document analysis and insight system includes an Artificial Intelligence (AI) powered Search Interface (AIPS) and an Advanced Intelligent Knowledge Engine (AIKE). The AIPS is configured to pre-process documents from structured and unstructured data sources to generate data taxonomies and custom synonym files. The AIKE generates a preliminary evaluation of the various Large Language Models (LLMs) and uses the data taxonomies and custom synonym files to generate prompts that are configured to address limitations of the various LLMs to obtain accurate replies to user requirements.

The embodiment of the invention discloses a database multi-source heterogeneous data synchronization method and device.The method comprises the steps that a data change event is monitored through an RPA robot deployed in a server where a source database is located, and when change operation of structured data or unstructured data is detected, an initial data set is generated; performing fragmentation processing on the initial data set to generate a plurality of data fragmentation tasks, and allocating the data fragmentation tasks to distributed computing nodes to execute parallel format conversion operation so as to generate a target data set; detecting a task execution state of the distributed computing node, and when a generation completion event of a target data set is detected, activating a data synchronization channel and transmitting the target data set to a target database; and performing conflict detection and identification based on an RPA conflict processing strategy configured in the target database, when a primary key conflict or a uniqueness constraint conflict is identified, updating the target database based on preset conflict merging indication information, and generating a data synchronization log.

The invention provides an unstructured data automatic processing method and system based on deep learning, and relates to the technical field of data processing, and the method comprises the steps: obtaining unstructured data through an intelligent data collector, building a data feature fingerprint database, constructing a data quality evaluation model through an incremental learning algorithm, and carrying out the data standardization processing; extracting dominant features and recessive features by using a multi-layer cascade network structure and a self-attention mechanism, and constructing a feature association graph and a bidirectional reasoning channel; and performing rule matching and causal reasoning based on the domain knowledge base, and finally realizing automatic structuring of the unstructured data. According to the method, the automation degree and the accuracy of data processing are improved, the manual intervention cost is reduced, and the method has relatively high universality and expandability.

An unstructured data query-response pair generation system (generation system) populates a knowledge base of query-response pairs for queries of natural language content in unstructured data by prompting a first large language model (LLM) text extracted from the unstructured data. An unstructured data chatbot (chatbot) leverages the knowledge base by augmenting prompts to a second LLM responding to user queries for natural language content in the unstructured data with query-response pairs having queries that are semantically similar to the user queries. The knowledge base and LLMs are updated based on user feedback correcting responses, continually improving quality of the generation system and chatbot.

The invention relates to the technical field of artificial intelligence, can be applied to business scenes of financial science and technology, medical health and the like, and discloses a data processing method and device based on factor weight optimization, equipment and a medium. Comprising the following steps: receiving structured data and unstructured data, and extracting a basic key factor set and monitoring object information in the data to generate a data feature set; executing multi-dimensional analysis and identification value determination based on the data feature set, and generating an analysis level and an identification value parameter; and performing weight correction processing on the basic key factor set, generating an optimized factor coefficient matrix, fusing the optimized factor coefficient matrix with associated equipment source data, and outputting a processing result. According to the method, structured and unstructured data are processed in a unified manner, so that the data integration capability is enhanced; multi-dimensional elements are extracted in combination with a pre-training model, and the key factor recognition effect is improved; and the analysis level and the identification value parameter are combined to drive weight correction and fuse the optimization matrix and the equipment source data to generate a processing result, so that the processing efficiency and the result accuracy are improved.

The invention relates to the technical field of project risk management, in particular to a project risk monitoring method and system based on a large language model, and aims to guide a language model to complete risk identification in a professional context by analyzing a natural language supervision request of a user, identifying a task field, matching a corresponding knowledge graph and a rule base, generating a reasoning configuration set and guiding the language model to complete risk identification in a professional context. Through a multi-modal fusion mechanism, unstructured data such as contract texts, drawing images and progress logs are coded in a unified mode, context modeling and rule reasoning of cross-modal information are achieved in combination with a large language model guided by a strategy, hidden risks needing image-text linkage judgment are effectively recognized, the analysis capacity for complex semantic association is improved, and the method is suitable for large-scale popularization and application. And furthermore, through a reinforcement learning mechanism, a supervision sample is constructed according to user feedback, a reward signal is generated, language model strategy parameters are optimized in real time, and continuous evolution and self-adaptive updating of a risk monitoring model are realized.

The invention discloses a cloud data anomaly detection and safety response system based on artificial intelligence, relates to the technical field of data processing, and solves the problems that firstly, an incremental compression algorithm is difficult to store and preprocess multi-source heterogeneous data; secondly, it is difficult to fuse statistical analysis and a deep learning model, locate outliers and analyze abnormal semantics in unstructured data, and then it is difficult to effectively predict a potential attack path; then, on the premise that data security and traceability are guaranteed, correlation analysis of cross-node anomalies is difficult to achieve so as to identify distributed attacks; and finally, an attack and defense confrontation model is difficult to construct for safety response, and the safety response effect is difficult to evaluate. According to the method, cloud environment data are processed through an adaptive probe cluster and the like, multiple models are fused to generate anomaly detection features and predict attack paths, and response and evaluation are carried out through reinforcement learning and digital twinning by means of cooperative detection such as federated learning and the like.

The invention discloses an urban safety risk assessment method and system based on big data, and relates to the technical field of big data, and the method comprises the steps: constructing a multi-source data collection network, and obtaining data from a government department database, Internet of Things equipment, a social media platform and a traffic monitoring system in real time; preprocessing the collected multi-source data, wherein the preprocessing comprises data cleaning, format standardization, unstructured data semantic analysis and sentiment analysis; a cross-department data security sharing mechanism is established, and the traceability and security of data exchange are ensured through a block chain technology; constructing a dynamic risk assessment model, analyzing multi-source data relevance based on a deep learning algorithm, and dynamically adjusting the weight of each risk factor; and generating a visual risk assessment report, and pushing the visual risk assessment report to related departments in real time through an early warning system. According to the invention, through multi-technology fusion and a dynamic optimization mechanism, the accuracy, real-time performance and cooperation efficiency of urban safety risk assessment are significantly improved.

The invention discloses a talent matching method and system based on artificial intelligence, and aims to improve human resource configuration efficiency and decision intelligence. The method comprises the following steps: collecting talent and demand data in multiple channels, especially unstructured communication data including interview records and work communication records; processing data through technologies such as multi-mode resume analysis, extracting features and fusing the features; an enterprise talent knowledge base which is used for continuous learning and dynamic maintenance based on a system operation result and multi-source feedback and integrates structured and unstructured data is constructed; based on the natural language query of the user, providing intelligent question answering and decision support by using a retrieval enhancement generation model connected with the specific enterprise talent knowledge base; an advanced deep learning algorithm is adopted, a knowledge base is combined to carry out man-post matching and generate recommendation of context perception, and self-optimization of a matching strategy is realized through mechanisms such as reinforcement learning and the like. According to the invention, accurate and dynamic talent matching and intelligent decision making can be realized.

A method for product fault root cause analysis based on knowledge graphs includes (i) acquiring product-associated design data, wherein the design data comprises semi-structured data and / or unstructured data, (ii) acquiring product-associated production data, wherein the production data comprises structured data, (iii) performing information extraction on the design data to acquire structured design data, (iv) performing a knowledge fusion of knowledge generated separately based on the production data and the structured design data to construct a target knowledge graph, and (v) and performing product fault root cause analysis tasks based on the target knowledge graph.

Provided in the present invention are a method for training a natural language processing model, and a method for generating subsequent text of a dialogue. The method for training a natural language processing model comprises: acquiring multiple types of heterogeneous sample data and a pre-constructed natural language processing model, wherein the heterogeneous sample data includes structured data, unstructured data, a knowledge graph and expert experience data; performing data encoding fusion on the structured data, the unstructured data and the knowledge graph, so as to obtain encoding fused data; and on the basis of the encoding fused data and the expert experience data, training the pre-constructed natural language processing model, so as to obtain a trained natural language processing model. The present invention enables a knowledge graph to be placed in a model, not as an independent retrieval corpus, but as a method for knowledge enhancement, thereby improving the efficiency of a natural language processing model.

A system is adapted to automatically report the trustworthiness of an entity. The system includes a processor and a computer readable medium carrying instructions. The instructions include receiving unstructured data pertaining to an entity from public sources, and receiving structured data pertaining to the entity from at least two databases. The instructions also include merging the structured data and the unstructured data into a single document; splitting the single document into chunks; creating embeddings corresponding to the chunks; and storing the embeddings in a vector store. The instructions also include receiving a natural language user query regarding trustworthiness of the entity; converting the query to a query embedding; based on the query embedding and a similarity calculation, fetching a relevant embedding from the vector store; with a large language model (LLM), generating a query response regarding the trustworthiness of the entity; and communicating the query response to the user.