1458 results about "Data retrieval" patented technology

The invention relates to an intelligent question-answering system optimization method and device based on a knowledge graph, and the method comprises the steps: obtaining original knowledge data of a target knowledge domain, and constructing a knowledge graph structure model; extracting term information of entity nodes in the knowledge graph structure model, and constructing an entity term set; receiving a natural language question input by a user, executing a semantic understanding operation based on the standardized expression set to obtain a structured question semantic representation, and matching the question semantic representation with the case training set to obtain context semantic features; constructing a cue word template, and executing a query instruction generation operation to obtain a target query statement of the graph database; submitting the target query statement to a graph database to execute data retrieval operation, and obtaining query result data corresponding to the question semantic representation; and performing personalized rendering processing on the query result data based on the user portrait information to generate final question and answer return content. The method has the effect of improving the query accuracy.

The present invention discloses an artificial intelligence-based adaptive big data storage and retrieval optimization system and method designed to intelligently manage and optimize large-scale distributed data environments. The system integrates data acquisition, distributed storage, metadata processing, adaptive learning, and retrieval optimization units configured to work collaboratively for continuous self-optimization. The invention employs deep reinforcement learning and predictive neural network techniques to dynamically analyze system telemetry, workload behavior, and data access patterns in real time, enabling proactive adjustment of data placement, caching, replication, and compression parameters across distributed nodes. The metadata processing framework utilizes graph-based dependency modeling to maintain semantic and contextual relationships among datasets, facilitating intelligent and context-aware data retrieval. The retrieval optimization unit interprets user queries semantically and computes the optimal retrieval route using latency prediction models and dynamic routing techniques.

The invention discloses a multi-modal data retrieval method and device, a storage medium and computer equipment. The method comprises the following steps: collecting multi-modal original data; on the basis of description information of metadata of original data, all metadata belonging to the same associated items and logic relations among all the metadata are obtained, a metadata chain is constructed, a distributed graph database is constructed on the basis of the metadata chain, the metadata chain is expressed in the distributed graph database in the form of a graph, the graph comprises nodes and edges, the nodes represent the metadata, and the edges represent the metadata. The edge represents a logical relationship between the metadata; and when a data retrieval instruction is received, traversing each node in the metadata chain along the logical relationship of the metadata chain in the distributed graph database, obtaining a target node matched with a data retrieval requirement corresponding to the data retrieval instruction, and returning original data corresponding to metadata represented by the target node. Multi-modal data dynamic association retrieval can be realized, and cross-modal information mining efficiency and accuracy are improved.

The invention discloses a structured data retrieval system and method based on semantic matching and hierarchical indexing, and the related retrieval system comprises a first construction module which is used for extracting slice data in a preset vector library and meta-information corresponding to the slice data, and constructing a text node object containing an id; the second construction module is used for traversing a text node object to obtain meta-information subjected to hierarchical structure processing, and constructing a nested index tree; the directory decomposition module is used for receiving an input text, performing decomposition based on a hierarchical structure and generating a corresponding query vector; the retrieval module is used for performing semantic retrieval and hierarchical retrieval on the text in sequence to obtain a retrieval result; the grouping and sorting module is used for grouping the retrieval results according to the hit hierarchy, sorting the retrieval results in each group according to a descending order, and combining all groups to obtain a final retrieval result list; and the data backtracking module is used for acquiring an original text field from the vector database according to the id corresponding to the retrieval result.

The invention discloses a file retrieval method, device and equipment based on multi-modal AI and a storage medium, relates to the technical field of data retrieval, and aims to solve the problem that traditional file retrieval is low in efficiency and precision. The method comprises the following steps: performing content analysis on a multi-modal file including a picture file, a video file and a document file of text and / or visual information, and extracting a text semantic feature, a picture visual feature and a video time sequence feature; mapping the text semantic feature, the picture visual feature and the video time sequence feature to a cross-modal semantic space used for representing a high-dimensional vector associated with different modal features, and generating a cross-modal association vector; according to the modal type of the retrieval information, a corresponding retrieval module in a mixed retrieval engine is called to conduct retrieval in a cross-modal semantic space, an initial retrieval result is obtained, and the mixed retrieval engine comprises a text retrieval module, a visual retrieval module and a cross-modal fusion module; and performing dynamic weight distribution sorting on the initial retrieval result, and outputting a target matching result.

A Retrieval-Augmented Generation (“RAG”) framework may include an RAG vector data store with information about vector embeddings. An RAG pre-processing platform may access unstructured data and perform vector embedding to generate a vector embedding for unstructured data to be stored in the RAG vector data store. The RAG pre-processing platform may also access structured data from the knowledge base and create a summary and metadata about the structured data to be stored in the RAG vector data store. An RAG retriever platform may receive a user prompt from a user, perform vector embedding, and retrieve context-relevant information for unstructured and structured data by searching for similar embeddings in the RAG vector data store. An RAG reader platform may combine the context-relevant information with the user prompt and an RAG prompt to create a LLM prompt. A context-aware response is then output to the user.

A generative artificial intelligence system includes a retrieval augmented generation (RAG) assistant that utilizes function calling to facilitate multi-source data retrieval to enhance user queries transmitted to a large language model (LLM). The RAG assistant Transmits, to the LLM, a function selection instruction prompt that includes conversation history data, a function list including function definitions that each correspond to a data source, and instructions directing the LLM to return a function call to at least one function defined on the function list identified as relevant to the conversation history data based on a corresponding function descriptor. In response to receiving a function selection response from the LLM that includes the function call, the RAG assistant selects and executes a conditional operation based on a name of the at least one function.

The invention provides a knowledge base and business system collaboration method under an AI platform, and belongs to the technical field of AI platform digital data processing.The method includes the steps that triple semantic analysis is conducted on query by constructing a multi-level semantic vector representation module, a parallel data retrieval engine is started, vector retrieval, graph reasoning and real-time data pulling are executed at the same time, and the query efficiency is improved; establishing a dynamic confidence evaluation mechanism to evaluate the quality of the data source, executing a weight distribution algorithm based on reinforcement learning, dynamically calculating the weight of the data source according to a query type by adopting a graph convolutional network intelligent routing decision model, and implementing multi-source data fusion and consistency verification to solve data conflicts through a weighted voting mechanism. An intelligent result sorting and filtering system is established, a multi-dimensional evaluation strategy is adopted to output high-quality answers, a continuous learning and feedback optimization loop is constructed, system performance is continuously optimized through active learning and a graph shortest path algorithm, and the technical problem that knowledge base data and a service system cannot effectively and uniformly make decisions is solved.

The invention discloses a relational database-oriented data retrieval enhancement generation method and system, and relates to the technical field of internet data retrieval services. The relational database-oriented data retrieval enhancement generation method comprises the following steps: S1, collecting original structure data, meta-information data and semantic interference data, and constructing a standardized multi-granularity expression set after preprocessing; s2, analyzing a semantic structure queried by a user, and dynamically adjusting an information extraction range according to the semantic structure; s3, comprehensively evaluating field matching strength and time coverage suitability, and switching a context construction strategy; s4, evaluating the semantic integrating degree and the information coverage degree of the candidate segments, and constructing a multi-level prompt context structure; and S5, tracking the semantic granularity and the context adaptation degree, and performing response quality diagnosis and dynamic correction. The problems that in a relational database, natural language query semantic granularity is difficult to switch in a self-adaptive mode, structure fragment matching is not accurate, and context prompt construction is redundant and scattered are solved.

The invention provides a data intelligent question and answer ChatBI method and device based on a large model. The method comprises the following steps of 1, constructing a database knowledge vector library; and step 2, question semantic transliteration and retrieval. According to problem transcription and data retrieval supplementation, a large language model is utilized to generate a corresponding visual chart according to the characteristics and problems of data, automatic visualization of any data is achieved, meanwhile, a more detailed and clearer expression mode is provided in a dialogue mode, and the method has the advantages of being high in practicability and easy to popularize. The flexible, intelligent and automatic process is realized, and the trend and relationship of the data are more intuitively displayed for customers. By combining a big language model and a data visualization technology, a proper visual chart is automatically generated according to natural language cue words and data, so that the data analysis and presentation efficiency is greatly improved, the learning cost of a user is reduced, and a personalized data display solution is provided for users in different fields.

The invention relates to the technical field of data recording, in particular to a data recording system for an automatic driving vehicle, and the system comprises a multi-source signal synchronization module, a behavior stage recognition module, a track abnormity elimination module, a dynamic compression adjustment module and a segmented index marking module. According to the method, a unified time alignment mechanism is constructed in a signal synchronization processing link, a strict corresponding relation between acquisition sequences is ensured, key time sequence characteristics of driving behavior switching are extracted by adopting a multi-behavior parameter comprehensive judgment method, segmented expression of a complex driving process is realized, and the accuracy of driving behavior switching is improved. According to track anomaly identification, through collaborative screening of inertial data and a positioning track, abnormal fragments which do not conform to physical rules are effectively eliminated, data compression dynamically sets interval length according to a parameter combined fluctuation trend, the fidelity of a key period is remarkably improved, non-key data redundancy is inhibited, and after a segmented index structure is established, the data compression efficiency is improved. And the data retrieval process is clearer.

A multimodal metadata retrieval-augmented generation method and system, relating to the technical field of artificial intelligence. In the present invention, the method comprises: determining data modalities of query content, performing feature extraction on data of each modality on the basis of the determined data modalities, converting extracted features into feature vectors, and fusing the feature vectors of the modalities to generate a multimodal feature vector; extracting, from data of each modality in the query content, key metadata of the data of each modality, converting the key metadata into a key metadata vector and connecting same to the multimodal feature vector, and constructing an augmented vector; and performing retrieval by means of the augmented vector. The method helps improve knowledge coverage and information utilization efficiency, and enhances the accuracy, relevance, and credibility of generated content.

A metadata access method, apparatus, and computer-readable storage medium for efficient metadata retrieval through cache management. The method receives metadata query requests including target index information from processes and performs matching operations on a global cache file containing records with index information and slot identifiers. Each cache description array corresponds to memory blocks caching metadata. Upon successful matching, the target cache description array is accessed using the target slot identifier. The data state of target metadata is determined from the cache description array, and target address information indicating the location of the target memory block in shared memory is obtained and returned to the requesting process, enabling efficient shared memory-based metadata access.

The invention discloses an automatic report generation method based on cross-modal agent collaboration, and relates to the technical field of automatic document generation, and the method comprises the steps that a central scheduling engine coordinates an outline generation agent, a data query agent, a chart drawing agent and a data analysis agent; the central scheduling engine drives the outline generation agent to generate a structured framework of a report based on a user demand, and dynamically schedules each agent according to a task dependency relationship; the data query agent realizes data retrieval by fusing retrieval enhancement generation and a thinking chain technology; the chart drawing agent adaptively generates a chart according to the data type; the data analysis agent is combined with an expert system and a knowledge base to generate an analysis conclusion; wherein the outline generation agent, the data query agent, the chart drawing agent and the data analysis agent are coordinated in parallel under the coordination of the central scheduling engine, and exception handling and dynamic adjustment are realized through a cross-agent coordination mechanism.

The invention discloses a data analysis method and system based on a large model. The method comprises the steps that natural language query of a user is received; performing semantic coding and intention analysis on the natural language query based on a pre-trained large language model; based on metadata retrieval of vector similarity, obtaining metadata related to natural language query semantics from a vector database; generating corresponding structured query parameters through the large language model in combination with the obtained metadata and the natural language query; according to the structured query parameter, generating an executable structured query language statement; and executing the structured query language statement to obtain a data query result. According to the method, the problems of insufficient semantic comprehension ability, low metadata retrieval precision and poor query generation controllability in the prior art are solved.

The embodiment of the invention provides a multi-modal low-altitude grid data dynamic indexing method and device for improving a cache mechanism. The method comprises the following steps: mapping multi-modal low-altitude grid data to a unified vector space, and constructing a cross-modal semantic association hybrid index for the mapped low-altitude grid data; dividing the mapped low-altitude grid data into a plurality of dynamic sub-regions according to data distribution density and data access popularity, and managing a mixed index corresponding to each dynamic sub-region by combining a Loki log index fragmentation mechanism and tagged metadata; the mapped low-altitude grid data is cached by adopting an EHCD hierarchical multi-level cache architecture; and carrying out cross-modal low-altitude grid data retrieval by combining SIMD instruction set parallelization vector similarity calculation and GPU acceleration complex space relation operation. In this way, the real-time retrieval efficiency, the system expansibility and the energy efficiency ratio of the low-altitude grid data can be remarkably improved.

Systems and methods are provided to improve data retrieval from a cache memory by using semantic matching to retrieve data from the cache memory. The system includes a two-tiered cache system, with a first tier implementing “key-value” pairs, and a second tier that includes a table that is configured as an artificial intelligence (AI) search indexed source. When a new input does not have a matching “key” at the first tier, the system performs a semantic search at the second tier of the cache to determine if relevant data is stored in the cache. The current systems and methods increase the likelihood of obtaining data for queries from the cache memory, reduce the response time to the queries, improve search consistency, reduce computing resource utilization, improve system performance, and reduce costs.

Disclosed are a data query method and system, and a related device, relating to the field of artificial intelligence. The method comprises the following steps: a data query system acquires input data; obtains, on the basis of the input data, metrics to be queried as requested by a user; uses, on the basis of said metrics, a multi-agent collaborative processing strategy to confirm a data query result, the multi-agent collaborative processing strategy being used for indicating a manner of implementing data retrieval on the basis of at least one of a graph model and a vector database; and presents the data query result, wherein the graph model expresses, in a graph-based form, correspondences between the metrics and between the metrics and database table data, and the vector database expresses, in a vector-based form, descriptive texts and computational formulas of the metrics. In this way, even if the expression of input data differs from the expression of fields in the database, or if metrics to be read are not present in the database, corresponding SQL statements can still be obtained by means of the graph model or the vector database, thereby reducing the error rate of natural language query, and meeting the query requirements of users.

The invention discloses an electric power multi-modal corpus construction query method and system based on a sliding window, which is applied to the field of electric power data query, and comprises the following steps: obtaining a structured document according to electric power multi-modal data, segmenting the structured document to obtain a plurality of segmented text blocks, and storing the segmented text blocks into a database; inputting each segmented text block into a large language model to generate a to-be-stored text vector and construct an electric power multi-mode corpus, when a user query request is received, generating a plurality of query variants according to query data, performing nearest neighbor search on each query variant in the electric power multi-mode corpus to obtain a corresponding nearest neighbor search result, and storing the nearest neighbor search result in the electric power multi-mode corpus. And fusing each nearest neighbor search result to generate an electric power related document set comprising a multi-modal association mark. According to the method, the semantic units can be accurately captured, semantic breakage is avoided, the retrieval continuity and coverage rate are improved, the comprehensiveness and context adaptability of retrieval results are improved, and the data retrieval requirement under the complex scene of the power industry is met.

The disclosure provides systems and methods for identifying salient test runs involving an autonomous vehicle system. A processor receives sets of run data, each set representative of a driving scenario. For each set, an output set is generated, the output set comprising time-indexed events generated in response to a detected behaviour of at least one challenger agent, and a sequence of decision indicators indicating whether a driving action by an ego agent would be permissible. A data retrieval component is coupled to a results database and retrieves output sets based on the time-indexed events and the sequence of decision indicators. The processor generates the sequence of decision indicators by generating a planned trajectory of the ego agent, and determining whether the predefined driving action by the ego agent would be permissible.

The invention relates to the technical field of geographic information data, in particular to an ecological remote sensing data processing system which comprises a remote sensing layer acquisition module, a boundary position checking module, a region coding integration module, a spatial change splicing module and an ecological trend drawing module. According to the method, by accurately matching the geographic identification information and the spatial boundary value, the coverage range and the positioning precision of the ground feature pattern spots are remarkably improved, the time information and the spatial information are effectively integrated, the continuity and the accuracy of the data are enhanced, the boundary resetting technology effectively reduces the errors of the geographic information, and the time-space continuity of the data is improved; the processing efficiency is greatly improved by constructing a continuous layer structure and optimizing a data retrieval process, the fine boundary splicing technology also allows fine tracking of ecological changes, more detailed data support is provided for ecological monitoring, the ability of ecological trend analysis is enhanced, and thus the overall effect and application value of ecological monitoring are improved.

The Asynchronous Crypto Asset Transfer and Social Aggregating, Fractionally Efficient Transfer Guidance, Conditional Triggered Transaction, Datastructures, Apparatuses, Methods and Systems (“SOCOACT”) transforms transfer of assets (TOA) initiation request inputs via SOCOACT components into TOA confirmation outputs. A crypto asset transfer notification is sent to a first entity from a second entity. Account verification data generated by the second entity is determined. A set of account data stored by the first entity is retrieved and used to generate a hash. It is verified that the determined account verification data matches the generated hash. A requested asset is determined. An API call to generate a crypto token asset for the requested asset in a socially aggregated blockchain datastructure is made. An address of an aggregated crypto transaction trigger entry is determined. Oracle data that satisfies the crypto smart rule is provided.

The invention relates to the field of data retrieval, and particularly provides a dynamic retrieval enhancement generation method and system based on a knowledge graph, a terminal and a medium, and the method comprises the following steps: extracting a structured triple from multi-source heterogeneous data through a large language model, and constructing a global knowledge graph by means of an entity linking technology; integrating a real-time data stream interface, and dynamically updating graph nodes and attributes based on an event-driven mechanism; adopting a RotatE model to respectively encode the entity and the relationship to a complex number space, and fusing to generate a mixed vector to construct an efficient index; after user query is received, topic nodes are positioned through semantic analysis, related entities are retrieved through mixed indexes, and multi-hop reasoning is executed along a relation path to generate reasoning sub-graphs and extended contexts; and finally, generating structured text answers by using a large language model, and adaptively outputting multi-modal results such as texts, charts and the like according to user requirements. According to the method, the knowledge updating timeliness, the complex query reasoning capability and the retrieval precision are effectively improved.

The invention provides a data retrieval method, system and device, and relates to the technical field of big data processing, the method comprises the following steps: obtaining a search text of a user; performing data permission assembly according to the search text to obtain a user permission set of the user; according to the user permission set, generating a retrieval filtering condition of the search text; according to the retrieval filtering condition, performing multi-source data search in combination with the search text to obtain an initial retrieval result corresponding to the search text; and performing unauthorized rejection operation on the initial retrieval result to obtain a final retrieval result of the search text. According to the method, the range is defined through permission assembly, the condition focusing target is filtered, the efficiency is improved through pre-matching, and the precision is guaranteed through post-removing, so that the retrieval data volume is compressed to improve the efficiency, and the matching pertinence is enhanced to improve the precision.

The invention relates to the cross technical field of artificial intelligence and data retrieval, and particularly provides an RAG question and answer optimization method and device.Firstly, original knowledge documents of various formats and natural language query of a user are received on an input layer, then a knowledge base construction module and a knowledge retrieval module are arranged on a processing layer, and a knowledge retrieval module is arranged on the processing layer; the middleware layer is provided with an MCP Server module and a vector database, the MCP Server module is a standard interface agent, and the vector database is a distributed storage engine for efficient approximate nearest neighbor search and mixed retrieval; and finally, deploying an LLM generation module at an output layer for generating a final answer based on the retrieved enhanced context. Compared with the prior art, the method has the advantages that irrelevant or low-signal-to-noise-ratio knowledge contacted by a large language model (LLM) can be effectively reduced, and the accuracy, the reliability and the practicability of knowledge base questions and answers are comprehensively improved.

The embodiment of the invention discloses a data space-oriented multi-source private domain data retrieval system, relates to the technical field of computers, and can realize cross-domain retrieval for multi-source private domain data on the premise of meeting data right and interest guarantee requirements. According to the system, a decentralized data index and discovery normal form is adopted, the local retrieval capability of a private domain data source is utilized, cross-domain retrieval is achieved on the premise that scattered private domain data cannot go out of the local private domain data source, the thought of retrieval and access decoupling is adopted, the retrieval process and the access process are designed to be completed through two independent modules respectively, and therefore the retrieval efficiency is greatly improved. In this way, the global retrieval agent cannot make contact with private domain data in the retrieval stage, and therefore the privacy and rights of a data owner are protected.

The invention discloses a communication data intelligent retrieval method and platform based on semantic analysis, and relates to the technical field of natural language processing, and the method comprises the following steps: after receiving an original query text of a user, binding an association retrieval permission strategy based on a user ID, loading a user portrait to complement semantics to obtain a plurality of semantic equivalence complement statements, and storing the semantic equivalence complement statements in a database; the method comprises the following steps: extracting feature words of communication data, constructing a plurality of hierarchical retrieval feature trees in combination with a domain knowledge graph, then matching a distributed retrieval unit, carrying out dynamic superposition retrieval by taking a retrieval permission strategy as a constraint to obtain a plurality of refined result sets, carrying out descending order arrangement and integration on the refined result sets according to metadata timestamps, and outputting a communication data time series retrieval sequence. According to the method and the device, the technical problems of low retrieval efficiency and difficulty in accurately positioning the communication data caused by single semantic understanding in traditional communication data retrieval are solved, and the technical effects of accurate semantic understanding of the communication data, orderly and efficient retrieval and accurate positioning of the communication data meeting the intention of the user are achieved.

The invention discloses a multi-modal data retrieval method and device under dynamic collaboration and a medium, belongs to the technical field of information retrieval and natural language processing, and is used for solving the problems that unstructured data is difficult to process efficiently in traditional data retrieval, an information island phenomenon exists, and the data retrieval efficiency is low. And an effective connection and integration mechanism is lacked between data from different sources. The method comprises the following steps: performing task allocation processing on a corresponding Agent cluster on a question type to be queried to obtain an Agent task list; performing data query processing on the Agent task list under different data sources, and obtaining query result data; performing data primary processing on the query result data to determine initial retrieval data; performing multi-modal consistency check on the initial retrieval data, and integrating verified integrated retrieval data; and performing information strategy generation processing based on a fact verification mode and an explanation enhancement mode on the integrated retrieval data to obtain final answer information.

The invention provides an efficient data retrieval method and system oriented to a large language model. The method comprises the following steps: determining an intention vector set matched with a user intention; determining a specified number of candidate text fragments with the highest correlation with the user intention in an index database; obtaining multi-dimensional feature evaluation data of each candidate text fragment, and constructing a multi-dimensional feature numerical matrix of each candidate text fragment according to the multi-dimensional feature evaluation data; according to the multi-dimensional feature numerical value matrix, selecting selected text fragments from the candidate text fragments; sorting the selected text fragments, and sequentially performing scene matching on the selected text fragments and a pre-cached high-frequency query scene according to the sorting, so as to extract cache content matched with the target high-frequency query scene from the cache as a query result when a matching result represents that the current query scene accords with the target high-frequency query scene. The invention provides an efficient data retrieval method, and the quality and precision of data retrieval are improved.

The present invention discloses an eloquence training method, device, and medium based on data retrieval and fusion. The method comprises: sorting the resources by calculating the matching degree between the query word and the resource to obtain a first resource; obtaining the user's eloquence ability evaluation result, and sorting the first resource according to the result to obtain knowledge feedback suggestions; filtering the resources according to learning habits to generate personalized feedback suggestions; evaluating eloquence information according to eloquence indicators, and generating evaluation feedback suggestions according to the evaluation results; and generating an eloquence training method based on the above feedback suggestions to train the user. The present invention proposes an eloquence training method, device, and medium based on data retrieval and fusion. By considering multiple different dimensions, corresponding feedback suggestions are generated, and a comprehensive eloquence training method is constructed to train the user. This can solve the problem of difficulty in generating personalized and comprehensive eloquence training programs based on the user's actual usage needs.