Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

22773results about "Database indexing" patented technology

Convergent Intelligence Fabric for Multi-Domain Orchestration of Distributed Agents with Hierarchical Memory Architecture and Quantum-Resistant Trust Mechanisms

A system and method for implementing a convergent intelligence fabric (CIF) for distributed artificial intelligence operations. The CIF architecture integrates tensor-theoretic foundations, probabilistic cache management, precision-aware memory operations, quantum-resistant security, and neural-based optimization within a unified framework. The system orchestrates asynchronous, multi-hop data flow among computational resources while maintaining data security through per-block encryption and identity-based access control. Key components include a universal multi-model KV cache subsystem, agent-parallel disaggregation pipelines, reinforcement learning-based orchestration, and neuromorphic memory integration. Advanced implementations incorporate graphon-enhanced memory for sparse graph sequences, multi-modal cognitive persistent memory, and quantum-resistant asynchronous multi-domain trust protocols. The system enables efficient cross-agent collaboration, sophisticated knowledge sharing, and secure cross-domain operations while optimizing computational resources and maintaining strict privacy guarantees across distributed AI deployments.
Owner:QOMPLX INC

Intelligent document retrieval and generation system based on metadata driving

The invention relates to the technical field of data processing, in particular to an intelligent document retrieval and generation system based on metadata driving, which comprises a metadata extraction module, a dynamic index construction module, an intelligent routing module, a distributed retrieval module and a result generation module. The metadata extraction module extracts organization names, timestamps and technical classification tags from an input document, maps the organization names, the timestamps and the technical classification tags into structured key value pairs, and transmits the structured key value pairs to the dynamic index construction module through a streaming pipeline; and the dynamic index construction module constructs a skip list index based on discrete fields to realize rapid matching, fuses metadata features and document semantics by adopting a multi-head attention mechanism, and outputs a structured response through topic clustering. According to the method, through a metadata pre-filtering, path optimization and semantic analysis cooperation mechanism, the multi-dimensional composite query efficiency in a distributed environment is improved, and noise interference is suppressed.
Owner:TAIJI COMPUTER CORPORATION LIMITED

Archive data security integration management system

The invention discloses an archive data security integration management system, which relates to the technical field of knowledge maps and comprises an archive data acquisition module, a knowledge intelligent analysis module, a knowledge map dynamic construction module, a security situation evaluation module and a security communication center module. The data acquisition module structurally acquires metadata and operation behaviors, the intelligent analysis module dynamically governs data quality, the map construction module constructs a three-dimensional security model, the situation evaluation module quantifies security influence and generates a strategy, and the communication center module realizes dynamic identity authentication and bandwidth allocation. Through the knowledge graph technology, comprehensive integration and safety management of the archive data are achieved, the data quality and utilization efficiency are improved, dynamic evaluation and coping with safety threats are achieved, and the safety and integrity of the archive data are ensured. Meanwhile, through dynamic identity authentication and bandwidth allocation, the safety and efficiency of cross-domain communication are improved.
Owner:CHINA SHENHUA ENERGY CO LTD SHENDONG COAL BRANCH

Dynamic knowledge retrieval enhancement method based on large language model

The invention discloses a method for enhancing dynamic knowledge retrieval based on a large language model, belongs to the field of knowledge retrieval, and aims to solve the problems of knowledge solidification, insufficient timeliness and illusion of a traditional LLM (Logistics Language Model). A multi-granularity knowledge base is dynamically constructed, and a rule and semantic partitioning technology is combined, so that a text is converted into a normalized vector, and a hybrid index is established; a two-channel retrieval triggering mechanism is adopted, keyword matching scores and BERT semantic probability analysis are fused, and retrieval requirements are intelligently judged; vectorization retrieval is realized through a BGE-M3 model, and candidate results are reordered in combination with a cross encoder to improve the precision. The system supports multi-language adaptive processing, dynamic switching of word segmentation strategies and cross-language retrieval, and introduces real-time knowledge updating and version control. According to the method, the answer timeliness and accuracy are remarkably improved, the context coherence of multiple rounds of dialogues is optimized, the method can be widely applied to the fields of intelligent customer service, professional questions and answers and the like, the LLM illusion risk is effectively reduced, and the knowledge traceability is enhanced.
Owner:SICHUAN ZHONGTIAN YINGYAN INFORMATION TECH CO LTD +1

Block chain data management method and system

The invention provides a block chain data management method and system, and relates to the technical field of block chains, and the method comprises the steps: receiving and preprocessing an electronic file; encrypting the archive by using a public key and calculating a hash value; packaging the encrypted file and the hash value into a block chain transaction and broadcasting the block chain transaction; acquiring block information and safely storing the private key; verifying the integrity of the electronic file; recording a full life cycle operation log; the log is stored in an on-chain and off-chain combined mode; auditing the electronic file; and realizing access authority automatic management based on the intelligent contract. According to the method, the security, traceability and management efficiency of the electronic archives are improved.
Owner:JIANGSU YUEOUHONG TECHNOLOGY CO LTD

Multi-source heterogeneous data knowledge base system construction method, equipment and medium

The invention discloses a knowledge base system construction method and device for multi-source heterogeneous data and a medium, and relates to the technical field of artificial intelligence and natural language processing. The method comprises the following steps: integrating a dynamic graph convolutional network and a hierarchical attention mechanism to construct a multi-modal document analysis engine; performing semantic structure analysis on the original heterogeneous document on the basis of a multi-modal document analysis engine to extract document structure features and content semantic features, and constructing an original document relationship model on the basis of the document structure features and the content semantic features; based on the original document relationship model, performing classification fusion on heterogeneous data in the original heterogeneous document to obtain a to-be-stored heterogeneous data corpus, and processing the to-be-stored heterogeneous data corpus by using a graph neural network to establish a cross-modal semantic association index; and based on the cross-modal semantic association index, performing classified storage on the to-be-stored heterogeneous data corpora by utilizing a preset heterogeneous database so as to complete knowledge base system construction of the multi-source heterogeneous data.
Owner:INSPUR GENERSOFT CO LTD

Intelligent visualization and text association method for multi-modal knowledge graph

The invention discloses an intelligent visualization and text association method for a multi-modal knowledge graph, and relates to the technical field of information processing. According to the intelligent visualization and text association method for the multi-modal knowledge graph, multi-modal data in an internal database of an enterprise is obtained, and a multi-modal feature vector is generated by using a data preprocessing and feature extraction technology; the feature vectors are mapped to a unified vector space through a cross-modal embedding algorithm, semantic alignment, association and fusion among multi-modal data are realized, and a complete multi-modal knowledge graph is constructed. Through bidirectional association and multi-modal joint query, the information acquisition efficiency is improved, and visual display of the knowledge graph is realized by using the graph neural network. Meanwhile, the knowledge graph is dynamically updated through a graph reasoning algorithm, and the timeliness and accuracy of the knowledge graph are ensured. A more efficient solution is provided for an enterprise in the aspects of management and application of multi-modal data, and the intelligent process of knowledge management is promoted.
Owner:LIAONING DANDELION EDUCATION CONSULTING CO LTD

Knowledge graph-based semantic association and logic rule reasoning method

The invention relates to the technical field of knowledge maps, and discloses a semantic association and logic rule inference method based on a knowledge map, and the method comprises the steps: obtaining a cross-functional department first data set, and constructing a cross-department knowledge map; extracting index nodes from the cross-department knowledge graph, identifying semantic conflict indexes, generating an index semantic conflict list, and constructing the cross-department knowledge graph after semantic mapping based on the index semantic conflict list; obtaining a second data set of a cross-functional department, and obtaining a fused cross-department knowledge graph and a semantic association degree matrix based on the second data set and the cross-department knowledge graph after semantic mapping; dynamically adjusting the weight of each node and edge of the fused cross-department knowledge graph according to the semantic association degree matrix, and generating a cross-department collaborative knowledge graph; generating a cross-department collaborative decision suggestion based on the cross-department collaborative knowledge graph; according to the invention, the efficiency and quality of cross-department collaborative decision-making are significantly improved.
Owner:LISHUI RES INST OF HANGZHOU UNIV OF ELECTRONIC SCI & TECH +2

Method and system for interpreting inputted information

Methods and systems for interpreting inputted information are described herein. In some embodiments, a method comprises processing inputted information wherein processing inputted information uses one or more intelligence modules using one or more intelligence models to process the inputted information; making, by the one or more intelligence modules, one or more decisions about inputted information based on the one or more intelligence models; learning, by the one or more intelligence modules, to update the one or more intelligence models; and interpreting inputted information based on the one or more decisions.
Owner:QUATRO CONSULTING LLC

Block chain double-chain cold chain traceability management system for meat quality fluctuation

A block chain double-chain cold chain traceability management system for meat quality fluctuation belongs to the technical field of traceability management systems and comprises a data acquisition and preprocessing module, a composite index module, a security verification module, a federated learning and AI resource management module, a fragmentation and verification architecture module and an automatic error correction module. According to the method, data chain storage environment data hash and transaction chain record operation logs are innovatively separated through a block chain double-chain architecture, hash fingerprints are synchronized in combination with an anchoring technology, cross-chain consistency is ensured, long-term non-tampering of data is realized through an anti-quantum hash algorithm, resource allocation is optimized through hierarchical storage design, and the method is suitable for large-scale popularization and application. The composite index technology is fused with hypergraph dynamic index to trace production batches, vehicles, warehouses and space-time quadtree dynamic subdivision areas, complex query response time is remarkably compressed, path deviation real-time alarm is achieved, the edge node cache hit rate is increased, and full-link data safety and query efficiency are remarkably improved.
Owner:GONGGUANG SHENZHEN MEAT INTELLIGENT TRADING MARKET CO LTD

Multi-source heterogeneous fund data processing method and system

The invention relates to the technical field of financial data processing, in particular to a multi-source heterogeneous fund data processing method and system, and the method comprises the steps: recording source information through building a data source registry, and marking a unique identifier for data; performing differential analysis on the fund data in different formats to generate standardized column type storage data; traversing column type storage data to extract statistical characteristics, performing field classification through metadata analysis and financial dictionary matching, analyzing business connotations of fields difficult to classify in combination with a localized large language model, and mapping the business connotations to a header fusion knowledge graph; generating a mapping rule from the source field to the enterprise-level data model by applying a rule engine template on the basis of field classification and semantic recognition results; converting the data structure according to the mapping rule and executing standardization processing; the quality is further optimized through data cleaning; and finally, the data are verified, standardized fund data supporting data traceability are output, and the strict requirements of financial supervision application are met.
Owner:DALIAN DINGYU ZHIXIN INFORMATION TECHNOLOGY CO LTD

Key-value engine

A data storage system can implement a key-value engine configured for tunable read, write, and space amplification. The key-value engine can support multi-versioning, synchronous and asynchronous key updates, and read snapshots. The key-value engine is highly scalable and can support generalized parallel, in-memory computation. Experimental results demonstrate that a key-value engine consistent with disclosed embodiments can outperform a state-of-the-art production LSM-based key-value store in a wide range of metrics.
Owner:MATHWORKS INC

Industrial time series data learning fusion and anomaly detection method

The invention belongs to the technical field of equipment health monitoring and anomaly detection, and discloses an industrial time series data learning fusion and anomaly detection method, which comprises the steps of constructing an IP-PLC mapping relation table, collecting multi-modal data, constructing a physical constraint parameter list, and generating structured data and a storage index. Time domain features and frequency domain features are extracted, a spatial topological graph is constructed, node spatial feature vectors and edge association strength are extracted, spatial association feature vectors are generated, a constraint rule base is constructed, and an enhanced feature set is formed; aggregating the enhanced feature set and the constraint rule base, generating a multi-dimensional feature matrix and a global reference parameter table, further constructing a global reference system, obtaining an equipment-level anomaly probability matrix, and generating a working condition-level anomaly probability matrix; hierarchical optimization is carried out through hierarchical modeling, and an optimization parameter set is generated; constructing an alarm response mechanism, and performing reverse updating to form closed-loop iteration; and an interpretable and extensible solution is provided for equipment health management in a complex industrial scene.
Owner:南京迅集科技有限公司

Auditing data distributed storage method based on multi-layer encryption strategy and related product

The invention relates to the technical field of audit data storage, in particular to an audit data distributed storage method based on a multi-layer encryption strategy and a related product, and the method comprises the following steps: dividing audit data into a plurality of grades, and adopting different encryption strategies for the audit data according to different grades to obtain encrypted audit data; dynamically fragmenting the encrypted audit data based on a fragmentation rule to generate a plurality of data fragments; the data fragments are distributed and stored in a plurality of distributed storage nodes; carrying out integrity verification on the stored data through Hash calculation, Merkle tree verification and a verification information storage mechanism; according to the method, a multi-layer encryption strategy is combined, flexible encryption protection aiming at data with different sensitivities is realized, meanwhile, the encryption efficiency of common data is considered, and the fault-tolerant capability and the dynamic monitoring and migration mechanism of distributed storage nodes are improved through the combination of fragmentation and redundancy coding technologies; and stable operation of the system under the condition of node failure or overhigh load is ensured.
Owner:CHENGDU BIG DATA GRP CO LTD

Artificial intelligence platform and method for AI-enabled search and dynamic knowledge base management

An intelligent search agent that can accept search request input in various ways to initiate a search of databases, websites, documents, PDF files, photos, and other digital data. Search requests can be initiated manually, through automated scheduling, and other ways and can be initiated in multiple ways including voice input, text input, form filling, large language model (LLM) processes, AI agents, selecting from dashboard menus, computer instructions and other methods. Applications of machine learning (ML) and natural language processing (NLP) and others are used to enhance the search agent's capabilities while minimizing user effort requirements. The Search Agent works in conjunction with a knowledge base function to dynamically form and manage one or more knowledge bases using search results and to automatically integrate search results into workflow processes.
Owner:ARTI ANALYTICS INC

Medical equipment monitoring analysis system and method based on full life cycle

The invention discloses a full-life-cycle-based medical equipment monitoring analysis system and method, and relates to the technical field of medical equipment monitoring, and the method comprises the steps: collecting medical equipment data in real time, and dynamically constructing a full-life-cycle digital twin model of medical equipment; constructing a medical equipment knowledge graph based on the equipment type, the function association and the spatial distribution; when the medical equipment node detects abnormal data, an early warning signal is sent to a full-life-cycle digital twin model associated with the medical equipment in the medical equipment knowledge graph in combination with the medical equipment knowledge graph; preliminarily judging fault causes and fault location, and generating an analysis report; performing multi-dimensional verification on the diagnosis result in the digital twin environment, comprehensively evaluating the risk coefficient of the scheme, and outputting an optimal maintenance strategy; in the maintenance process, the maintenance process is recorded in real time, and maintenance data and equipment state updating are synchronously fed back to the equipment full-life-cycle digital twin model.
Owner:TUOZHUANG MEDICAL TECH CO LTD

Method convenient for data blood relationship collection and analysis

The invention relates to a method convenient for data consanguinity collection and analysis, which comprises the following steps of: obtaining original consanguinity data comprising a task execution log, application metadata and a cross-system dependency relationship, and carrying out standardization processing on the original consanguinity data to generate structured consanguinity information comprising an asset unique identifier, an upstream and downstream association relationship and a data operation type; structured consanguinity information is synchronously written into a graph database and a distributed data warehouse, the graph database stores real-time association topology, the distributed data warehouse stores full-amount historical versions, and a transaction consistency algorithm is adopted to ensure the atomicity of double-write operation, so that the data storage efficiency is improved. Single-asset-level consanguinity tracking is performed based on real-time topology of a graph database, global consanguinity analysis is performed based on batch computing power of a distributed data warehouse, a direct dependence path, a deep association network and a closed-loop link detection result are generated, and a closed-loop management mechanism from data acquisition, analysis to optimization is formed. And the problem that an analysis result is disjointed from an acquisition end in a traditional scheme is solved.
Owner:FUJIAN PUPU INFORMATION TECH CO LTD

Report verification batch parallel execution optimization method based on pluggable rule engine framework

The invention discloses a report verification batch parallel execution optimization method based on a pluggable rule engine framework, and relates to the technical field of report verification, and the method comprises the following steps: receiving compliance rules, converting the compliance rules into a uniform data structure model, analyzing to generate metadata indexes, and supporting business rule set configuration; loading the matched business rule set based on the meta-information of the to-be-verified report, and registering the matched business rule set to an execution container; s3, receiving a to-be-verified report, analyzing a report structure, and generating a report field index table; performing field dependency analysis based on the report field index and the loaded business rule set, and constructing a rule field dependency graph; graph partition optimization and topological sorting are executed according to the dependency graph, and rule batches capable of being executed in parallel are generated; and uniformly collecting and outputting all rule execution results, hit states, abnormal records and performance indexes, and generating a structured verification report and an audit chain log. The financial statement compliance check execution efficiency can be improved.
Owner:INSPUR TIANYUAN COMM INFORMATION SYST CO LTD

Rare disease knowledge graph construction method based on modal injection and multi-modal fusion

The invention relates to the technical field of medical artificial intelligence and knowledge graph construction, in particular to a rare disease knowledge graph construction method based on modal injection and multi-modal fusion. Comprising the following steps: S1, collecting multi-modal medical information including texts, images and genes; s2, standardization processing is carried out, and a three-layer metadata structure is constructed; s3, complementing missing modal data, and performing feature extraction and unified dimension conversion on the modal data to realize representation alignment in a shared semantic space; s4, performing multi-level semantic fusion to obtain a unified fusion semantic vector; and S5, constructing a double-layer structure system rare disease knowledge graph comprising an ontology layer and an instance layer. According to the method, multi-modal medical information of texts, images and genes is selected to construct the knowledge graph of the rare disease, the application range, coverage and accuracy of the knowledge graph are improved, correspondence adaptation of rare cases during clinical diagnosis and treatment of the rare disease can be achieved, and the method has high recognition capacity.
Owner:湖南工商大学

Time sequence database data compression method, system and device and storage medium

The invention relates to the technical field of wind power generation equipment data processing. The invention provides a time sequence database data compression method, system and device and a storage medium. The method comprises the steps of dynamically partitioning time sequence data based on a preset time window; hybrid coding compression is performed on each data block, and a composite strategy of difference coding and run length coding is adopted for numerical data; a metadata index of the compression blocks is established, the time range, the data feature statistics and the compression parameters of each data block are recorded, and the metadata index comprises extreme value distribution, variance features and data fluctuation frequency indexes; and dynamically adjusting a compression strategy according to a historical data feature analysis result, predicting data fluctuation modes of different equipment sensors through a machine learning model, and automatically selecting an optimal coding combination and compression granularity for subsequent data blocks. The problems that when wind power plant time sequence data are processed through an existing method, time sequence characteristics are difficult to adapt, the storage cost is high and the query efficiency is low are solved.
Owner:HUANENG DINGBIAN NEW ENERGY POWER GENERATION CO LTD +1

Supply chain tracing method and system based on block chain

The invention relates to the technical field of block chains, and discloses a supply chain tracing method and system based on a block chain, and the method comprises the steps: carrying out the collection and feature learning of the product identification information and transaction records of a supply chain node, and obtaining a supply chain transaction feature vector; based on the supply chain transaction feature vector, executing intelligent contract verification strategy confirmation and weighted voting verification on a transaction group to obtain a consensus confirmation block; extracting transaction data from the consensus confirmation block, constructing a double-Hash Merkle tree structure and generating supply chain traceability features; and executing a commodity tracing contract, a quality verification contract and a responsibility judgment contract according to the supply chain tracing characteristics, and generating an execution log and a visual tracing report, thereby reducing the number of verification nodes and network communication overhead while ensuring the block verification reliability, improving the consensus efficiency, and improving the objectivity and efficiency of the tracing process.
Owner:CHENGTIAN INT SUPPLY CHAIN (SHENZHEN) CO LTD

Low-altitude integrated management system based on grid digital twinborn model and intelligent algorithm

The invention discloses a low-altitude integrated management system based on a grid digital twin model and an intelligent algorithm, and relates to the technical field of low-altitude aircrafts. The method comprises the following steps: multi-source sensing data fusion and grid coding are carried out, and an airspace environment space-time database is constructed; constructing an airspace environment space-time database to carry out three-dimensional subdivision on the airspace; generating a multi-scale grid twinborn body, and associating a corresponding attribute for each level of grid according to a management requirement; generating an airspace risk thermodynamic diagram in the future 5-30 minutes; establishing a grid state change triggering rule; and generating a multi-target optimal path set by taking the grid navigation cost as a weight. According to the invention, by combining the real-time operation data of the low-altitude aircraft, the meteorological environment and other data with the artificial intelligence algorithm and the navigation rule base, the airspace traffic flow is analyzed, the flight plan is optimized, the flight route is intelligently distributed, the automatic route setting of any two points is realized, and the response speed of the low-altitude flight service system and the processing capability of various flight data are improved.
Owner:SHANDONG RUIHANG GEOGRAPHIC INFORMATION ENG CO LTD

Unified rdbms framework for hybrid vector search on different data types via SQL and nosql

Techniques for a unified relational database framework for hybrid vector search are provided. In one technique, multiple documents are accessed and a vector table and a text table are generated. For each accessed document, data within the document is converted to plaintext, multiple chunks are generated based on the plaintext, an embedding model generates a vector for each of the chunks, the vectors are stored in the vector table along with a document identifier that identifies the accessed document, tokens are generated based on the plaintext, the tokens are stored in the text table along with the document identifier. Such processing may be performed in a database system in response to a single database statement to create a hybrid index. In response to receiving a hybrid query, a vector query and a text query are generated and executed and the respective results may be combined.
Owner:ORACLE INT CORP

Database migration method and device, equipment and medium

The invention relates to the technical field of data processing, can be applied to business scenes of financial science and technology, medical health and the like, and discloses a database migration method, device, equipment and medium. And deploying a double-write control module of the application program layer to write the source database and the target database in parallel, and completing consistency verification through a data verification comparison task. And controlling a target database write-in channel according to a difference analysis result, closing a source database write-in channel in combination with a service takeover state, and completing a migration process from the source database to the target database. According to the method, full migration, application layer double writing, differential data verification and dynamic write-in channel control are combined, data consistency of the source database and the target database in the migration process is guaranteed, the source database and the target database are safely switched to after the service takeover capacity is verified, and the migration safety and continuity are improved.
Owner:CHINA PING AN LIFE INSURANCE CO LTD

Task allocation method for flexible employment

The invention relates to the technical field of task allocation, in particular to a task allocation method for flexible employment. According to the technical scheme, the method comprises the following steps that a database of related information of tasks and employees is constructed, wherein the database comprises detailed information of the tasks and comprehensive information of the employees; respectively constructing a task model and an employee portrait based on the information in the database; and matching the task with the employee through an intelligent matching algorithm, wherein the intelligent matching algorithm comprises matching algorithm selection and optimization, real-time matching and dynamic adjustment, and multi-objective optimization and tradeoff. According to the method, multiple matching algorithms are combined for optimization, weights are selected and adjusted according to tasks and employee characteristics, accurate matching is achieved, a task model and employee portrait multi-dimension consideration adaptability is achieved, adaptive changes are matched in real time, tasks and multiple aspects of employees are optimized and balanced in a multi-objective mode, the development of rights and interests of the employees is considered, and the matching quality, the working enthusiasm and the stability are improved; flexible employment resources are managed more effectively, and the task allocation effect is improved.
Owner:SUZHOU BUMU NETWORK TECHNOLOGY CO LTD

Systems and methods for jailbreaking black-box large language models

A computer-implemented method for jailbreaking Large Language Models (LLMs) requiring only black-box access-Branch-and-Prune. LLMs are powerful tools displaying many capabilities. However, despite safety training, LLMs can generate harmful, biased, and toxic content-demonstrated by the prevalence of human-designed “jailbreaks” that override LLM's safety “guardrails.” At the core, the method engages an “attacker” LLM into conversations where it generates variations of the original prompt that may jailbreak the target LLM. Compared to prior methods, the disclosed Branch-and-Prune adaptively decides which conversations to engage in (pursuing conversations with a high-likelihood of success while abandoning less-promising ones), and “mixes” the different conversations (increasing the success rate of the method). This enables jailbreaks for state-of-the-art LLMs for over 80% of the existing harmful prompts while requiring fewer queries to the target LLM.
Owner:CISCO TECHNOLOGY INC

Distributed storage and indexing method

The invention relates to the technical field of information retrieval, and discloses a distributed storage and indexing method, which comprises the following steps of: dynamically fragmenting an original file through an improved consistent Hash algorithm to generate a plurality of data blocks with timestamps; constructing a three-dimensional Bloom filter index matrix containing timestamps, data types and content features for the data blocks with the timestamps, associating a B + tree local index with an inverted global index through a hierarchical index structure, and establishing an index update priority queue by adopting a two-channel synchronization mechanism, performing real-time increment synchronization on the hotspot index through a heartbeat mechanism, performing batch synchronization on the cold data layer index according to a cold data synchronization period, predicting a data distribution probability through a distributed query statistics probability table during query, and initiating multi-path query in parallel based on probability weight, and the query path is dynamically optimized according to the node group storage medium type and the inter-node network transmission delay, so that rapid distribution adjustment and access of distributed storage are realized.
Owner:SHENYANG LIUFANG INFORMATION TECHNOLOGY CO LTD

Cloud backup platform data deduplication method based on distributed storage

The invention relates to the technical field of data processing, in particular to a cloud backup platform data deduplication method based on distributed storage. Comprising the following steps of: performing self-adaptive blocking on data by utilizing a dynamic blocking algorithm, generating a unique identification code and extracting multi-dimensional feature information; establishing a global index through a distributed hash table, mapping a data position and maintaining index consistency; performing redundancy analysis and similarity matching based on a deep learning algorithm, and executing a duplicate removal strategy; according to the access frequency and the load condition, distributed storage of data blocks is realized by adopting a hierarchical graph division algorithm; and a partitioning strategy, index frequency and storage layout are dynamically optimized by using a reinforcement learning algorithm, and global optimization of performance and resources is realized. According to the invention, high efficiency, accuracy and dynamic optimization of data deduplication are realized, and the data storage and management efficiency of the cloud backup platform is improved.
Owner:GUANGZHOU SHANGZHIJIE NETWORK SAFETY TECH CO LTD

Task scheduling method, device and storage medium for spatiotemporal big data

The present invention relates to the field of big data technology, and discloses a task scheduling method, device and storage medium for spatiotemporal big data, wherein the method comprises: performing ETL cleaning and standardization processing on the original spatiotemporal data to obtain spatiotemporal data in a unified format that complies with the OGC specification; performing spatial dimension reduction operations on the spatiotemporal data in the unified format and constructing a spatiotemporal index to obtain a spatiotemporal index data set; distributively storing and compressing the spatiotemporal data in the unified format according to spatiotemporal characteristics to obtain partitioned compressed data; establishing a multi-dimensional query index for the partitioned compressed data to obtain a task allocation scheme; performing distributed data retrieval based on the task allocation scheme to obtain the original query result; performing data integrity verification and spatial relationship reconstruction on the original query result to obtain the target query data. The method realizes the reasonable allocation of computing resources, effectively reduces the performance pressure of each node, and improves the availability and interoperability of data.
Owner:GUANGDONG SOUTH DIGITAL TECH

Deploying a vector index on multiple nodes of a cluster

Techniques for deploying a vector index on multiple nodes of a cluster are provided. In one technique, an instruction is received to create a vector index on a set of vectors that is stored in a vector database that is connected to the multiple nodes. In response, an HNSW index is created based on the set of vectors and the HNSW index is stored on each node. In response to receiving a vector query, a node processes the vector query against its copy of the HNSW index. In another technique, each node retrieves, from a vector database, a respective subset of a set of vectors and generates, based on the respective subset, a respective HNSW index. A vector query is transmitted to each node, which traverses its HNSW index to generate results of the vector query. The results from each node are combined to generate final results.
Owner:ORACLE INT CORP