188 results about "Distributed data store" patented technology

The invention provides a thermal power plant environment monitoring and early warning method and system based on the Internet of Things, and relates to the technical field of the Internet of Things, and the method comprises the steps: forming a preprocessing data stream for collected environment monitoring data through an edge calculation node; and carrying out real-time data stream processing by utilizing a distributed message queue, constructing a hierarchical distributed data storage structure, and carrying out homomorphic encryption and desensitization processing on data to form an encrypted data set. Based on an encrypted data set, a long-short term memory network, a random forest algorithm and a limit gradient boosting tree are adopted to construct a layered anomaly detection engine, environmental parameter spatial-temporal characteristics are extracted through a multi-head attention mechanism and residual connection, an early warning threshold value is iteratively calculated based on a Bayesian optimization algorithm, and an early warning level judgment standard is dynamically adjusted. And generating early warning information. And finally, through a three-dimensional visualization module and a knowledge inference engine based on a graph neural network and a deep reinforcement learning algorithm, visualization of early warning information and generation of a self-adaptive emergency processing strategy are realized respectively.

The invention relates to the technical field of distributed data storage, and discloses a data index construction method for distributed data storage, comprising the following steps: constructing a hypergraph model of a distributed storage system through a high-order graph theory, the hypergraph model comprising a plurality of storage nodes, a plurality of data blocks and a plurality of query requests, the method comprises the following steps: performing load balancing optimization on storage nodes and a query request on the basis of a minimum cut theorem in a high-order graph model, mapping data blocks and the storage nodes to a consistent hash ring according to a consistent hash algorithm, reducing data migration through a virtual node mechanism, storing the data blocks on a plurality of storage nodes in a redundant manner by adopting a redundant coding method, and storing the data blocks on the storage nodes in a redundant manner. And a load distribution strategy of the storage nodes is adjusted through a game theory model, and load adjustment is optimized by adopting an optimal control method. The method can ensure high availability, expansibility and reliability of the system while improving the efficiency of the data storage system, and is suitable for a large-scale distributed data storage system.

The invention discloses a logistics transfer field digital twin distributed data storage and calculation platform, which comprises a distributed data storage module, a distributed data storage module, a distributed data storage module, a distributed data storage module and a distributed data storage module, real-time preprocessing and short-time caching are carried out, and long-term persistence is realized; the real-time calculation module is used for constructing a parallel calculation framework to process batch and streaming data; designing a global state updating model; the co-simulation module is used for constructing a high-precision digital twinborn model of a physical transfer field; and the cloud generates a scheduling decision and a correction amount according to a global simulation result, the scheduling decision and the correction amount are fed back to the edge node through secure communication, and the edge immediately responds and adjusts local data processing and equipment regulation and control parameters, so that closed-loop consistency of a real scene and a digital twin model is realized. According to the invention, a logistics sorting digital twin system scheduling architecture based on distributed data storage, edge-cloud collaboration, real-time calculation and collaborative simulation support is constructed.

The invention relates to the technical field of project management, in particular to an enterprise project management system and method oriented to multi-project collaboration. A resource scheduling module; a progress control module; a cost quantification management module; and a risk management module. According to the scheme, through a micro-service architecture and a distributed data storage technology, multi-project full-period collaborative management is realized. And each module can operate and expand independently, so that the flexibility and expandability of the system are remarkably improved. The distributed data storage can ensure the real-time synchronization and quick access of the data even under the condition that a plurality of projects run in parallel. By constructing the incidence relation matrix, the system can clearly present the relation between each task and the resource of the project, and solid data support is provided for subsequent resource allocation and task management. The optimal configuration of resources and the smooth promotion of projects are realized, and the management efficiency of enterprises and the project success rate are remarkably improved.

The invention relates to a data management method and a data management system based on OpenHarmony. The method comprises the following steps: constructing a cross-device data storage layer by utilizing a distributed soft bus technology, and carrying out fragmentation storage and redundant backup on target data to obtain a distributed data storage architecture; performing feature extraction to obtain a data classification result and a fine-grained data mark; comprehensively analyzing the network condition, the equipment performance and the user behavior to obtain a data synchronization strategy; executing two-stage protocol submission and vector clock concurrency control on the cross-device operation to obtain a distributed transaction processing result; performing structural feature and repetitive mode analysis to obtain a compression algorithm selection result and a compression parameter; and carrying out compression processing, and carrying out adaptive routing selection and load balancing on the compressed data transmission path to obtain a multi-device data flow management scheme. According to the method, data integrity and availability are guaranteed, data are effectively compressed, and storage space and transmission bandwidth are saved.

The invention relates to the technical field of distributed data storage, and discloses a database cluster partition operation method and device under a network partition scene and a medium, and the method comprises the steps that a multi-master distributed database cluster is constructed, and each node continuously captures a database native transaction log; obtaining change event data, and performing unified data storage; analyzing the original log into structured data, and executing uniform fragmentation and parallelization processing; processing the block log change record, and arranging change events of the primary key according to a rule; executing conflict processing and data synchronization, and synchronizing all nodes after the conflict is solved; through exception handling and fault tolerance, self-healing is realized and data consistency is maintained. According to the method, millisecond conflict identification and data consistency convergence after network disconnection can be realized, continuous and stable operation of a cluster in a partition state is ensured, and self-healing and continuous availability of a system are realized.

The invention relates to the technical field of building design, and discloses an Internet-based building design dynamic process management system, which comprises a multi-factor identity verification module, a distributed data storage module, a process dynamic optimization engine, a behavior evaluation and intervention module and an intelligent audit tracking system. According to the building design dynamic process management system based on the Internet, through cooperative work of the process dynamic optimization engine and the behavior evaluation and intervention module, the problem that task optimization of a traditional process management system depends on a preset rule is solved; the flow dynamic optimization engine dynamically adjusts the task priority and resource allocation by using an improved ant colony algorithm based on the real-time task progress and the executor behavior data; meanwhile, the behavior evaluation and intervention module quantitatively evaluates the behavior of the executor according to a weighted scoring model, triggers an automatic intervention process when necessary, and can quickly adapt to sudden changes, so that the resource allocation efficiency is improved, and human errors are reduced.

A robotic surgical system network includes a plurality of robotic surgical systems. Each system includes robotic arms, sensors, a surgeon console, and a control system with an integrated AI module. A network interface is associated with robotic surgical system and provides secure data communication. A central or distributed data repository securely stores surgical data aggregated from the robotic surgical systems. The surgical data includes at least one of procedural data, sensor readings, imaging data, AI decision logs, surgical outcomes, or user interaction data. A training module utilizes aggregated surgical data to train or update AI models for the robotic surgical systems using unsupervised learning, transfer learning, or federated learning techniques. A cybersecurity module implements security measures for data transmission and system access, the measures comprising at least one of encryption, multi-factor authentication, or real-time threat detection.

The invention discloses an intellectual property risk early warning system based on multi-source heterogeneous data fusion, which relates to the field of intellectual property management and comprises a multi-source data acquisition module, a data preprocessing and standardization module, a distributed data storage module, a risk analysis engine module, a risk early warning and visualization module and a data communication module. According to the system, heterogeneous data of a patent database, an enterprise bidding and tendering system and a judicial public platform are collected, a natural language processing technology is utilized to extract patent technology feature entities, trademark image similarity is analyzed in combination with a convolutional neural network, and a dynamic knowledge graph related patent technology, competitor layout and infringement litigation cases are constructed; a deep learning model is adopted to fuse multi-dimensional features, risk scores are generated through weighting of a risk rule base, and graded early warning signals are triggered. According to the method, the problems of low multi-source data integration efficiency and risk response lag are solved, the infringement response time is shortened, and enterprises are guided to accurately arrange high-value patents.

The invention relates to the technical field of intelligent remote control, and discloses a multi-machine collaborative management and control method for coal mine fully-mechanized excavation, fully-mechanized mining, main transportation, auxiliary transportation, production assistance, power supply and distribution and other fixed scenes, and the method comprises the following steps: S1, system architecture design: constructing a multi-machine collaborative management and control system, by means of a special multi-element sensing and control module configured for each equipment unit in a fixed scene, a central control system serves as a coordination center, and autonomous operation is achieved by means of an edge computing center control module of the central control system under the condition of communication interruption or delay; s2, real-time sensing and data fusion: integrating deployed sensors in existing equipment, and collecting equipment operation condition states and environment information; a self-learning function and a distributed data storage mechanism are introduced into the edge computing device, so that self-adjustment and optimization of each device in a complex coal mine environment are realized, local data sharing and self-adaptive control can still be realized even under the condition of communication interruption or delay, and continuity and safety of operation are ensured.

The invention relates to the technical field of data storage, in particular to a distributed data storage and access processing method. The method comprises the following steps: presetting a guide configuration file in a distributed storage cluster to carry out identity authentication and communication link establishment on each storage node and a cluster management center so as to generate a security data interaction channel; the data sending end equipment sends a data storage request to the cluster management center through the secure data interaction channel and issues data fragments to proper storage nodes; the data receiving end equipment sends a data access request to the cluster management center through the security data interaction channel, generates an access path and feeds back the access path to the data receiving end equipment; the corresponding resource use condition in each storage node is monitored in real time, and when a preset threshold value is reached, the resource is reallocated to other storage nodes according to a preset data migration strategy and a load balancing algorithm based on a resource use insufficiency result. According to the invention, efficient storage and rapid access of data in a distributed environment can be realized.

The invention relates to the technical field of fire alarm, and discloses a self-adaptive threshold fire-fighting buzzer alarm method and system based on fuzzy logic, and the method comprises the following steps: S1, environment data collection; s2, data preprocessing; s3, performing fuzzy processing; s4, performing fuzzy reasoning and alarm threshold calculation; s5, optimizing an alarm threshold value; s6, real-time feedback and dynamic adjustment: according to the real-time fire suppression result and the environment change data, adjusting an alarm threshold to form a dynamic feedback mechanism; s7, applying a fire propagation model; and S8, alarm execution. By adopting distributed data storage, redundant backup, encryption technology and automatic data management, efficient and safe data processing, reliable data recovery and accurate alarm decision are realized, and the response speed and stability of the system are improved.

The invention provides a distributed data storage and access software development method based on cloud computing, and aims to construct an efficient, safe and extensible data storage system. The method comprises seven key steps of demand analysis and system design, cloud resource configuration and initialization, distributed data storage algorithm development, data processing layer construction, access control layer development, user interface and interaction design and system test and optimization. By accurately calculating storage resource requirements, optimizing cloud resource configuration and designing a consistent Hash data fragmentation algorithm and a data redundancy strategy, high availability and fault tolerance of data are ensured. Meanwhile, the AES-256 encryption technology and the LZ4 compression technology are adopted to guarantee the data security and the transmission efficiency. According to the method disclosed by the invention, a high-performance, extensible, safe and reliable distributed data storage and access system can be constructed, so that the increasing data storage and access requirements are met, and the user experience is improved.

The invention relates to the technical field of radio transmission systems, in particular to a dual-module redundant satellite communication and internet-of-things terminal system, which comprises a data processing module, a management module, a frequency band allocation module, a self-adaptive switching decision module, a scheduling module and an optimization module. The data processing module collects satellite signal parameters and terminal state data, and generates dynamic decision context information including conflict frequency band feature vectors, terminal dynamic position tags and channel load indexes; the system iteratively optimizes a frequency band allocation strategy through a closed-loop data stream, constructs a conflict spatio-temporal topology network by adopting a graph database to realize competitive traceability, manages historical parameters in combination with a distributed data storage module, finally reduces channel competition conflict and data retransmission rate, optimizes terminal energy consumption and communication reliability, and improves the system performance. The method is suitable for Internet of Things terminal communication in complex environments such as satellite signal shielding and electromagnetic interference.

A method and system for updating a topology on router nodes in a distributed storage system are described. The method can include obtaining, by a first service of a control plane service, topology information from an inventory data store by querying a second service of the control plane service that manages the inventory data store for the topology information. The method can further include generating, by the first service of the control plane service, a topology payload based on the obtained topology information. The method can also include sending, by the first service of the control plane service, a request comprising the topology payload to a router node.

The invention discloses a data consistency processing method, a distributed storage system and electronic equipment, and belongs to the field of distributed data storage systems, and the data consistency processing method comprises the following steps: when any storage node in the distributed storage system receives to-be-updated data sent by a client, obtaining a corresponding data updating path by taking the storage node as a first storage node; according to the data updating path, each storage node carries out data persistence on itself after receiving the data to be updated, if persistence succeeds, the data to be updated is transmitted to the next storage node, if persistence fails, data rollback is carried out, and feedback information of path updating failure is sent to the upstream of the data updating path; and after receiving the information, each upstream storage node carries out data rollback on the current updated data. According to the scheme, even if the update message processing flow fails, the consistency of the data between the survival copies / fragments can be ensured in real time.

A distributed data storage includes data stored in different data shards on nodes of the distributed data storage. A memory stores a dynamic heatmap indicative of a number of data requests for data stored on each of the nodes. A processor receives a request for retrieving the data stored in the distributed data storage. The request includes data ranges and index criteria of the data and location of the nodes in the distributed data storage. In response, the processor determines the nodes of the distributed data storage that include the data using the dynamic heatmap, retrieves the data as determined from the dynamic heatmap; and routes the data to a user associated with the request. When a data retrieval performance is below a desired threshold value, the processor performs dynamic data sharding to reallocate the data shards across the nodes of the distributed data storage.

Record-level transaction conflicts may be detected at storage nodes of a database back-end storage service. When a prepare statement is received, a storage node can determine whether another prepare statement acting on at least one of the same records has succeeded. If so, then the storage node can indicate to the database access application that there is a conflict, allowing the database access application to wait to try again or abort the transaction.

The invention is suitable for the technical field of intelligent property management, and provides an intelligent property management system based on multi-technology fusion, which comprises an infrastructure module, a user access module, a data fusion module, a data support module, an intelligent property module and an intelligent decision module. The infrastructure module collects data through equipment such as a sensor and performs edge calculation preprocessing; the user access module provides a multi-port entrance and adopts unified identity authentication and authorization; the data fusion module integrates multi-source heterogeneous data and constructs a user portrait; the data support module realizes distributed data storage and standardized management; the intelligent property management module integrates multiple management functions and realizes automation of a business process; and the intelligent decision-making module performs fault prediction, demand analysis and the like by using data analysis and machine learning. According to the invention, information islands are broken, the equipment monitoring capability and the service individuation level are improved, data sharing and business collaboration are realized, the management efficiency is improved, the cost is reduced, and intelligent decision support is provided for property management.

Storage-side filtering may be implemented for performing hash join operations with respect to data stored in distributed data storage. When a query to a database stored in a distributed data store is received, a hash join operation may be identified for performing the query. As part of performing the hash join operation, a query engine may cause storage nodes in the distributed data storing data for the database to filter data before sending the data to the query engine according to a join predicate for the hash join operation. A result of the query may then be provided to a user, using the filtered data provided from the storage nodes.

The invention provides an emergency command rescue data distributed storage method and system based on artificial intelligence, and the method comprises the steps: carrying out the feature identification processing through obtaining a rescue scene perception data set collected by multiple types of emergency terminal equipment in real time, and generating an emergency data feature set containing scene context features and storage demand features; and calling a pre-constructed distributed storage strategy model to carry out storage node adaptation analysis processing on the emergency data feature set, generating a distributed storage mapping scheme, distributing data in the rescue scene sensing data set to corresponding target storage nodes according to the distributed storage mapping scheme, obtaining a distributed data storage cluster, and sending the distributed data storage cluster to the rescue scene sensing data set. And collecting real-time operation state information of the distributed data storage cluster, and carrying out dynamic optimization adjustment processing on the distributed storage mapping scheme to generate an updated distributed storage mapping scheme. According to the invention, the adaptability, reliability and dynamic response capability of emergency command rescue data storage can be effectively improved.

The invention discloses a disease and pest control information management system based on big data, and the system comprises a multi-source data collection module which is used for obtaining multi-source data, carrying out the anomaly detection of all data, and processing the abnormal data; the distributed data storage module is used for constructing a plurality of databases and respectively storing the detected and processed data by utilizing the plurality of databases; the big data analysis and scheme generation module is used for generating a prevention and treatment scheme and outputting the prevention and treatment scheme; and the business application module is used for managing user information and presenting a prevention and treatment scheme. According to the method, data sources are increased, data comprehensiveness and accuracy are improved, multi-class databases are constructed, data are classified and managed, management efficiency is improved, during retrieval, the databases are positioned through keywords requested by a user firstly, then the positioned databases are retrieved, retrieval complexity and information processing amount are reduced, and retrieval efficiency is improved. The retrieval efficiency is improved, so that the prevention and treatment scheme generation efficiency is improved.

Access control data stored in the storage servers of a distributed data storage system is modified according to received access control commands and accessed to process host I / O requests without requiring the use of locks. Processing of certain access control commands includes allocating a new volume descriptor to store the updated access control data for a corresponding storage volume, and remapping the storage volume to the new volume descriptor with a single write operation. Each volume descriptor stores both reservation type and reservation holder data for the corresponding storage volume within a single memory register, allowing host I / O request processing logic to read both reservation type and reservation holder using a single read operation, and access control command processing logic to modify both reservation type and reservation holder using a single write operation. A registrants bitmap in the volume descriptor represents hosts registered for the corresponding storage volume.

The present disclosure relates to a distributed data storage control method and apparatus, a readable medium, and an electronic device. The method includes: after receiving a write lock and modifying a file size according to the write lock, caching, by a worker node, the modified file size in the worker node until a write lock request sent by a distributed lock management and control node for taking back the write lock is responded to, and then transmitting the modified file size to the distributed lock management and control node, so that the distributed lock management and control node updates the file size.

The invention relates to the field of enterprise application integration, in particular to a supply chain finance-oriented multi-protocol conversion and semantic verification system and method, which comprises a protocol adaptation layer, a core processing layer, a management support layer and a distributed data storage layer, the protocol adaptation layer adopts a plug-in and metadata driving design, and a protocol plug-in is an independent JAR packet and supports multi-protocol encoding and decoding and hot updating; the core processing layer realizes data standardization and financial-level semantic verification through a general message model, a dynamic routing engine, a visual data conversion module and a rule engine; and the management support layer provides a low-code portal and supports rule configuration, simulation testing and full-link monitoring. According to the technical scheme, through the seven steps of configuration, decoding, routing, conversion, verification, coding and auditing, the method adapts to a multi-specification heterogeneous system, data intercommunication accuracy and compliance are improved, docking cost is reduced, and supply chain financial service requirements are met.

The invention discloses a distributed data storage and access control method based on a block chain, and relates to the technical field of data security. The method comprises the following steps: fragmenting user data, encrypting the fragmented user data by using an encryption algorithm, and storing the encrypted user data in a plurality of distributed nodes; taking the hash value and the storage position of the data fragment as metadata to be recorded in a block chain, and performing integrity verification through a smart contract; when a user accesses, user attributes are verified based on an attribute-based encryption technology, and an access control strategy is dynamically executed through an intelligent contract; and an erasure code technology is adopted to carry out redundancy storage so as to realize data recovery and fault tolerance. The method effectively solves the problems of single-point failure, privacy disclosure and inflexible access control in traditional centralized storage, has the beneficial effects of improving data security, guaranteeing integrity, realizing fine-grained dynamic access control and enhancing system reliability, and is suitable for data security management in cloud computing, Internet of Things and big data environments.

For database high availability and for accelerated recovery of a failed replica of a database, a storage computer is dynamically allocated and temporarily persists database content modifications until the database replica is ready to receive the modifications. The storage computer is not allocated storage that stores the database. The storage computer persists a recent portion of the database and later receives a request to synchronize the recovering replica. During recovery, the storage computer responsively sends the portion of the database to the recovering replica. For acceleration, recovery herein does not entail content interpretation such as replay of a redo log. For horizontally scaled acceleration involving two distinct storage computers per recovering replica, multiple replicas are concurrently recovered by respective storage computers that each receives recovered database content only from a respective distinct other storage computer.

The invention discloses a configurable building system and method for an energy management system. The system comprises an infrastructure layer, a configuration management layer, an atomic function library layer, an atomic function combination layer and an application scene layer. The infrastructure layer provides a containerization facility and a distributed data storage facility of the atomic function model; the configuration management layer is used for visualized interaction, gateway and protocol configuration and atomic function model instantiation; the atomic function library layer is used for creating and storing an atomic function model; the atomic function combination layer is used for polymerizing atomic function model examples to obtain atomic function combinations; and the application scene layer is used for calling the atomic function combination and finally forming an energy management system suitable for a corresponding scene. The invention provides a highly flexible, configurable and extensible energy management system development solution.

In some implementations, the device may include initiating a stream producer that sends formatted data to a topic. In addition, the device may include ingesting, by a sink connector, the formatted data into an object storage service. The device may include implementing an event-driven serverless compute, where the event-driven serverless compute is triggered automatically when any new data is ingested to the object storage service, and where the event-driven serverless compute reads the JSON data, converts it to transformed data, and writes the transformed data to a distributed data store. Moreover, the device may include creating an ETL job, where the ETL job reads the data, further transforms the data, and writes it back into the distributed data store as ETL transformed data. Also, the device may include sending the ETL transformed data to an LLM API in batches to create inference results, where the batches are queued to manage the rate limits. Further, the device may include storing the inference results in cache storage. In addition, the device may include implementing an API gateway for secure access to inference results.

The invention relates to the technical field of data management, and particularly discloses an efficient management method and system for a data directory in a data space, and the method comprises the steps: carrying out the incremental updating of metadata information, data product registration information and cross-node data directory information related to the data directory to a distributed data storage system; constructing a full-text index and a vector index of metadata in the distributed data storage system, and matching a vector generated based on the request content with the full-text index or the vector index to obtain a retrieval response result; marking a semantic equivalence data set based on the semantic vectors of all the data sets, constructing a data set node graph based on all the semantic entity lists, and outputting a semantic equivalence field list based on the semantic equivalence data set and the data set node graph; determining an associated recommendation result of the retrieval response result based on the semantic equivalence field list, and synchronously returning the retrieval response result and the associated recommendation result; data directory management and efficient utilization in a distributed heterogeneous cross-domain data space are supported.