3322results about "File system types" patented technology

The invention discloses a geographic information big data-oriented multi-source data processing system, and relates to the technical field of data acquisition and sensors, and the system comprises a data acquisition module which accesses a remote sensing satellite, an unmanned aerial vehicle, an Internet of Things sensor and social media in real time through a multi-source heterogeneous interface, and carries out the adaptive analysis of a data format and metadata marking; the distributed storage module is used for performing partition storage on the geographic information data based on a space-time database and an object storage architecture, and establishing dynamic space-time index and version control; the data fusion module is used for realizing coordinate system conversion, time sequence calibration and semantic knowledge graph matching based on a multi-source data alignment method of dynamic weight distribution; and an intelligent analysis module and a security control module. According to the method, core pain points such as data splitting, low storage efficiency, extensive analysis and compliance risks in the geographic information field are systematically solved, and a full-stack type technical base is provided for scenes such as smart cities, emergency disaster relief and environment monitoring.

The invention relates to the technical field of data analysis, and discloses a business data analysis method, device and equipment based on big data and a storage medium, the method comprises the following steps: collecting and preprocessing original log data to obtain standardized log data, and performing adaptive multi-modal feature extraction to obtain comprehensive feature representation; inputting a heterogeneous graph neural network to carry out anomaly detection and multi-level root cause analysis to obtain a hierarchical anomaly event; executing task scheduling and resource allocation of reinforcement learning to obtain a task allocation scheme; performing deep learning enhanced root cause reasoning and knowledge graph construction on the task allocation scheme to obtain a system state diagram and a causal relationship; and generating a multi-dimensional task data analysis report. According to the method, comprehensive analysis, anomaly detection, root cause reasoning and intelligent scheduling of log data are realized. The reliability and performance of the system can be improved, and more intuitive and accurate decision support can be provided for operation and maintenance personnel.

Techniques are described for partitioning B-tree keys of file systems into key ranges for parallel processing in delta generation during file storage replications between file systems in different cloud infrastructure regions. In certain embodiments, a delta generation processing for cross-region replication may utilize a key-range splitting mechanism involving a recursive algorithm that partitions B-tree keys of a source file system into roughly equal-size key ranges. All the partitioned key ranges may be processed in parallel and concurrently by different processing threads, one thread per key range, to improve the performance of the delta generation and achieve scalability.

The invention relates to the technical field of information management, and comprises a distribution automation operation and maintenance work log intelligent recording platform based on a CS architecture, and the platform comprises a log field analysis module, a task chain construction module, a task logic verification module, and a log storage tracing module. According to the method, missing and abnormal fields are effectively marked and corrected through meticulous analysis and comparison of uploaded log records, the accuracy and integrity of data are improved, task scheduling is optimized and the operation and maintenance management efficiency is improved through association of device numbers and task types and adjustment of execution time in sorting and grouping of task sequences, and the task scheduling efficiency is improved. Task chains are recombined to solve conflicts and adjust priorities, smooth execution of operation and maintenance tasks is guaranteed, delay is reduced, logic verification enhances task reliability through rule verification and error marking, unassociated tasks are deduced, analyzed and corrected, the exception processing capacity is enhanced, the data tracing and storage efficiency is improved, and the tracing capacity of data management is enhanced.

The invention provides an intelligent agent tool calling knowledge optimization method based on empirical path graph evolution, which comprises the following steps: when an intelligent agent successfully completes a task for the first time, recording an intelligent agent tool calling sequence, input and output parameters and an execution result, generating a structured calling log, the calling log is converted into a standardized calling path knowledge unit; performing structured representation and semantic representation on the calling path knowledge unit, storing the structured representation in a graph database, and storing the semantic representation in a vector database; task intentions, tool entities and calling paths are used as heterogeneous nodes, an experience path knowledge graph is constructed, the experience path knowledge graph is used for recording the multi-dimensional relation among tasks, paths and tools, execution performance attributes and feedback attributes are added to path nodes in the graph, and agent tool calling knowledge optimization is completed. And the purpose of improving the tool calling efficiency and robustness of the intelligent agent in the multi-task environment is achieved.

The invention discloses a retrieval enhancement generated document screening system and method fusing a verification mechanism, and relates to the technical field of document screening, the system comprises a user input and query analysis module for extracting key information through natural language processing, and converting the key information into a high-dimensional semantic vector, a meta-tag and a keyword set; the multi-source document retrieval module is used for obtaining documents from multiple data sources through mixed retrieval and generating a candidate set through preliminary screening and sorting; the credibility evaluation and security verification module is used for generating scores and labels after multi-dimensional evaluation and screening qualified documents; the document consistency detection module is used for detecting document conflicts, processing and sequencing, and ensuring logic consistency; the document acquisition and generation module is used for inputting qualified documents into a generation model and generating answers with references; and the result output and tracing module is used for outputting answers and recording whole-process data to ensure traceability. The invention aims to ensure the accuracy and credibility of the generated content through a multi-dimensional verification mechanism.

The invention relates to the technical field of digital information processing, and provides a photovoltaic power station data operation and maintenance management system, and a data exchange network service management system comprises a server, a cloud management module, an edge calculation module, a data exchange module, a performance evaluation module, an intelligent routing module and a self-adaptive data synchronization module. The performance evaluation module is used for monitoring key performance indexes of the network state of the whole system, evaluating the current running states of the cloud, the edge nodes and the network state through the key performance indexes to form an evaluation result, and feeding back the result to the cloud management module, the edge calculation module, the self-adaptive data synchronization module and the intelligent routing module; and the data exchange module is responsible for data synchronization and exchange between the cloud and the edge nodes, so that the data consistency of the edge nodes in the system is ensured.

The invention discloses a multi-NDP (Near-Data Processing) system read-write acceleration method based on a key value separation technology, and the method comprises the steps: when data is written, splitting a data key value pair written into a batch processing region of a multi-NDP system, determining target equipment, then carrying out key processing and value processing, carrying out key storage on keys, and carrying out data storage on the target equipment; a value corresponding to the key is added to a value log file of the target equipment; during data query, hash operation is carried out on a query key, target device position information of a corresponding value is obtained, then the master-slave multi-level hot cache is queried, and query retrieval of the corresponding value is carried out according to the obtained value position index. According to the method, the key value separation technology is introduced into the multi-NDP system, when the Compaction is executed, the execution time of the Compaction is shortened, the influence of the Compaction on the writing operation of the user is reduced, and the writing performance is greatly improved.

The invention discloses an intelligent nuclear radiation dose real-time monitoring system based on deep learning, and the system comprises the steps: S1, a multi-mode sensing module which is used for outputting radiation intensity data with timestamps, environment image data and geographic space position information; s2, a preprocessing module used for outputting a structured feature sequence; s3, a fusion modeling module which is used for generating a unified fusion feature vector; s4, an end-edge reasoning module which is used for processing the fusion feature vector in stages and generating a nuclear radiation dose prediction result; s5, the task scheduling module is used for dynamically determining whether the reasoning task is executed on the end side or the edge node; s6, an anomaly detection module which is used for determining whether there is an abnormal change of the nuclear radiation dose; and S7, the system control module is used for coordinating the modules. The method has the advantages of being high in environmental adaptability, fast in reasoning response and high in anomaly recognition precision.

The invention discloses a log quality detection method and system, electronic equipment and a storage medium. The method comprises the following steps: acquiring a multi-modal input source; performing reverse anchoring operation in a dynamic analysis stage of the running log to establish direct mapping between the running log and the source code; compiling the abstract syntax tree based on the source code, establishing a grammar dependence graph according to the abstract syntax tree, and traversing the abstract syntax tree to construct a structured data set; based on the running log, obtaining a quality detection result through structured analysis, and generating a semantic detection result by using a large language model; performing cooperative operation on the structured data set and the grammar dependency graph to generate a code log coverage score, and performing arrangement according to a quality detection result and a semantic detection result to obtain an abnormal mode feature; and performing feedback adjustment based on the code log coverage score and the abnormal mode feature in combination with a preset correction rule. The method can efficiently and accurately realize log quality detection, and can be widely applied to the technical field of data processing.

The invention discloses an intelligent log retrieval and analysis system based on a model context protocol MCP, and relates to the technical field of log analysis. The system comprises an MCP log semantic conversion and retrieval engine, a log format irrelevant feature extraction and indexer, a dynamic log format recognition and context enhancement system, a real-time retrieval analysis and aggregation controller and a multi-level semantic retrieval and visualization engine. According to the context enhancement system, unknown formats can be identified, semantic tags can be complemented, and semantic consistency and behavior tracking capability can be improved. The retrieval analysis controller supports semantic expression analysis, strategy generation and feedback closed loop, and strategy scheduling and multi-dimensional aggregation analysis are achieved. And finally, outputting a structured semantic result by the system, and visually displaying the structured semantic result through components such as a semantic composition device and a context expander. All the modules are managed in a unified mode through a capability registration mechanism, dynamic arrangement and upstream and downstream closed-loop linkage are supported, and a log intelligent analysis framework with high semantic driving and a clear structure is formed.

The invention discloses a log anomaly detection method, system and device and a medium, and relates to the field of security technology early warning, and the method comprises the steps: obtaining to-be-detected log sequence data of an electric power mobile micro-service system, inputting the to-be-detected log data into a trained anomaly detection model, and obtaining an anomaly detection result; the anomaly detection model is constructed based on a log data set and comprises a data processing module and a local attention processing module; the data processing module is used for converting input log sequence data into semantic feature vectors; and the local attention processing module is used for performing semantic feature representation according to the semantic feature vector, performing anomaly detection on each semantic feature to obtain an anomaly detection result, and the method can accurately detect the log anomaly condition of the micro-service system.

The invention belongs to the technical field of data synchronization, and particularly relates to a real-time data synchronization method for cloud computing heterogeneous resources. In order to solve the problem of data synchronization among heterogeneous resources, the method comprises the following steps: aggregating a plurality of files in batches to generate a packaged file; performing metadata compression processing on the generated packaged file, and eliminating repeated data through a deduplication algorithm; dynamically selecting a lightweight data transmission protocol; establishing a multi-dimensional index structure; only retaining the file of the latest version through a version control mechanism; dynamically adjusting the allocation of synchronization tasks based on the load condition of available resources in the cloud computing environment; and rescheduling the uncompleted synchronization task. Through a multi-dimensional index structure, version control, self-adaptive transmission scheduling and a dynamic resource allocation mechanism, efficient and stable file synchronization among heterogeneous resources is realized, repeated transmission and storage waste are reduced, and real-time performance, reliability and resource utilization efficiency of synchronization are improved.

Techniques are described for efficient replication and maintaining snapshot data consistency during file storage replication between file systems in different cloud infrastructure regions. In certain embodiments, provenance IDs are used to efficiently identify a starting point (e.g., a base snapshot) for a cross-region replication process, conserve cloud resources while reducing network and IO traffic.

The invention provides a business arrangement scheduling method based on event driving, which comprises the following steps of: constructing a unified business arrangement framework, describing a business process by using a unified process definition language, and defining a process metadata standard; adding a general process engine with a plug-in mechanism in the business arrangement framework; establishing a real-time event processing architecture by taking an event as a core, and adding an event-driven business process engine; constructing a monitoring platform on the basis of the real-time event processing architecture, performing real-time monitoring on an event stream and event processing, and performing visual display; a unified retry mechanism is introduced, and a retry strategy and retry management are defined; according to the method, a unified, efficient and easy-to-monitor and easy-to-maintain business arrangement framework is established, so that the scheduling process is conveniently arranged through event-driven business, the endpoint retry and business flow monitoring capability is provided, the realization difficulty of monitorable and retry in the business is simplified, and the robustness of the business is improved.

The invention relates to the technical field of big data and the field of financial science and technology, and discloses a database table synchronization method based on log data, which comprises the following steps: recording operation information of a business database table to log data, writing the log data into a message queue, obtaining the log data through a streaming data processing framework, and deserializing the log data into structured data; and extracting operation records, classifying the operation records according to operation type fields, distributing the operation records to processing channels corresponding to the table names, and updating or adjusting the table structure of the target table according to classification, or executing data change operation. Through the log data-based synchronization method, quasi-real-time synchronization from the business database table to the operation data storage module is realized, and the table structure is adaptively adjusted when the business table structure is changed, so that the data consistency problem and the system interruption risk are reduced, the data synchronization efficiency and stability are effectively improved, and the user experience is improved. And the efficient and stable data synchronization requirements of the service are met.

The system described herein provides the ability to efficiently back up and restore files within a service, such as a network-based file hosting service or a collaboration service. The system is configured to improve file restoration (may also be referred to as recovery) that occurs in response to an event (may also be referred to as an incident) that compromises a tenant device on which the files reside, thereby preventing access to the files or corrupting the files that are available to the tenant. An example of an event includes a ransomware attack. The described system utilizes a set of defined resources within a boundary to back up tenant files and restore the files. The resources include a metadata database and a blob store. The system combines mutable metadata with immutable content objects within the service to provide faster restoration than the conventional approach.

The invention relates to the technical field of distributed system transaction management, and discloses an inventory consistency management method and device based on distributed transactions, and the method comprises the following steps: pre-occupying an inventory, and recording the state information of the inventory to a Redis hash structure; after the inventory is pre-occupied successfully, generating a pre-deducted snapshot, generating a compensation identifier, and writing the pre-deducted snapshot and the compensation identifier into a MySQL transaction log together; verifying the uniqueness of the compensation identifier, and submitting the current database transaction after the uniqueness of the compensation identifier is confirmed; when the submission of the current database transaction fails, executing a compensation operation on the current database transaction; and after the compensation operation is executed, performing data consistency verification on the MySQL transaction log and the Redis hash structure. According to the method and the system, the consistency of inventory management during distributed transaction processing is highly guaranteed.

Embodiments are described herein for document authentication certification using information stored on a distributed ledger such as a blockchain. A distributed ledger may securely store document data describing the document. Use of a distributed ledger may provide an immutable, readily auditable record of the history of the document. Each user participating in the system may be assigned a unique identifier to be used for conducting transactions on the distributed ledger network. A user may also be provided with a digital security token such as a cryptographic key that is useable to authenticate the user and enable access to the document data stored on the distributed ledger(s).

The invention relates to an ADS-B (Automatic Dependent Surveillance-Broadcast)-based civil aviation flight pre-arrival data calculation method, which integrates ADS-B data, meteorological satellite data, airport runway state monitoring data and air traffic control real-time instruction data through multi-source data fusion, and dynamically adjusts the weight of each data source according to the flight stage of a flight. A dynamic adjustment time synchronization interval mechanism is adopted, a short synchronization interval is set in the take-off stage and the landing stage so as to capture rapidly-changed data, and the synchronization interval is prolonged in the cruise stage so as to optimize computing resources. Meanwhile, the deep learning model based on the Transform architecture utilizes a multi-head self-attention mechanism and position coding to enhance the feature capture capability, and reduces the calculation burden through a sparse activation strategy. The system is provided with a real-time monitoring layer, log records and visual analysis tools are integrated, and interpretability and traceability of the model are ensured. An efficient aviation management decision is supported, and the efficiency and safety of overall aviation traffic management are improved.

The invention relates to the technical field of digital twinning, in particular to a steel structure building construction whole process mechanical property evaluation method based on digital twinning, which comprises the following steps of: acquiring multi-source heterogeneous steel structure state data from a stress sensor, BIM model component information and a displacement monitoring point, comparing timestamps from all data sources, and determining the state of the multi-source heterogeneous steel structure according to the comparison result; and calculating a transmission delay value of each data source relative to the unified reference time, correcting the original data timestamps one by one, and establishing a steel structure state data stream with aligned time sequences. According to the method, the timestamps of the multi-source heterogeneous data are subjected to transmission delay correction through unified reference time, the timestamps of the original data are corrected one by one, the steel structure state data streams with the aligned time sequences are generated, the time deviation among the sensors, the BIM model and the monitoring points is eliminated, and the synchronism and coherence of dynamic changes of mechanical parameters are guaranteed.

The present disclosure is related to systems and methods for hashing-based assessment of electronic clinical trial outcomes. Such systems and methods may advantageously enable secure, rapid, efficient, and cost-effective reuse of pre-built eCOA assessments for clinical trials. In an aspect, the present disclosure provides a computer-implemented method for validation of an electronic clinical trial outcome assessment (eCOA), comprising: (a) obtaining an assessment of an eCOA, the assessment comprising a plurality of files generated by performing a first validation of the eCOA; (b) obtaining a first hash value associated with the assessment of the eCOA, the first hash value generated by hashing the plurality of files of the assessment of the eCOA; (c) hashing the plurality of files of the assessment of the eCOA to generate a second hash value; and (d) validating the eCOA when the second hash value is equal to the first hash value.

Described is a system for cloud-based processing of backup data for storage onto various types of object storage systems. A specialized cloud-based component (e.g. proxy server) may act as an intermediary when backing up data from a client system to an object storage. For example, the cloud-based component may be provided as part of backup service that operates in conjunction with a client system. Accordingly, the system may allow different clients of a backup service to efficiently and seamlessly interact with the different third-party object storage providers via a single cloud-based component. To provide such object-storage-agnostic functionality, the cloud-based component may include a function library that includes object-storage-specific functions. For example, the cloud-based component may invoke a specific set of operations that interact with a storage API provided by a particular object storage provider.

The invention provides a professional online collaborative editing method and system for hydropower project cost schemes. The professional online collaborative editing method comprises a standard management process, an intelligent collaborative editing process and a release state synchronous updating process. The standard management process comprises the steps of performing automatic analysis and data standardization conversion on an industrial standard file based on a deep learning model, generating a system rule set and storing the system rule set in a database; and based on the system rule set, automatically generating a standardized filling template of each specialty. According to the micro-service architecture-based intelligent online collaborative editing method and system for the hydropower engineering, a natural language processing NLP technology, a deep learning algorithm and a transaction management mechanism are combined, and the system has the functions of real-time grammar and spelling inspection of filled content, intelligent recommendation, semantic understanding, real-time difference detection, multi-user conflict processing and version control; the problems that communication cost is high, version control is difficult, data verification is not strict and multi-user cooperation is not smooth in water-power engineering cost scheme compiling are solved.

A snapshot of metadata of a file system on a source storage system is stored in one or more of storage devices of a target storage system. A request to access data stored in the file system is received. A portion of the metadata including identification information of the data is identified. The data stored in the file system is retrieved by providing the source storage system with the identification information of the data.

The invention relates to the technical field of computer data processing, and discloses an automatic format conversion and incremental synchronization method for cross-platform heterogeneous document data. The method comprises the following steps: capturing an atomic data change event from a source system transaction log; aggregating into logic transaction units according to the transaction identifiers; converting into a unified intermediate normal form; generating a target system operation instruction set based on the metadata mapping rule; the synchronization sites are executed and persisted in a transactional manner. According to the method, through log-level capture and transactional synchronization, data integrity, sequence and high consistency are ensured, and efficient and reliable data synchronization between heterogeneous systems is supported.

Systems and methods are described for performing an instant recovery of data associated with a locked snapshot. In various examples, the amount of time for performing a recovery of data associated with a locked snapshot is significantly reduced by making use of enhanced volume cloning functionality instead of making an actual copy of the data to be recovered. In one embodiment, the resulting volume clone representing the recovery volume is cleared of all data protection information (e.g., WORM flags and / or lock metafiles) that was previously used to protect the content from being changed when stored on the data protection volume so as allow the recovery volume to be used in read-write mode.

The invention discloses a data recovery method and a related device, the method can be applied to a server running a database system, and the method comprises the steps that in response to modification of a first data page, a first log is generated, modification of the first data page is recorded in the first log, and a first identifier indicates the version of the first data page; under the condition that the database system fails, the version of a second data page is determined, the second data page is the data page of the data to be recovered, and the page identifier of the second data page is the same as the page identifier of the first data page; and under the condition that the version of the first log is greater than that of the second data page and the version indicated by the first identifier is the same as that of the second data page, performing data recovery on the second data page by using the first log. Through the first identifier, data recovery on the second data page by using a log with a wrong version is avoided, and the accuracy of data recovery is ensured.

The invention discloses an information processing method, and the method comprises the steps: inputting query information for a target object into an intention recognition model for intention recognition, and obtaining an information retrieval type corresponding to the query information; wherein the query information is used for querying all related log information or part of related log information of the target object; retrieving the query information through a retrieval strategy corresponding to the information retrieval type by utilizing a pre-constructed index database to obtain a retrieval result meeting an information length condition corresponding to an input requirement of a second large language model; wherein different information retrieval types correspond to different retrieval strategies; performing fusion processing on the query information and the retrieval result to generate context reference information meeting the input requirement of the second large language model; and reasoning the context reference information by using the second large language model to generate reply content corresponding to the query information.

The invention discloses a dynamic log collection method and system and a server. According to the method, a flexible strategy configuration management system is introduced, user-defined configuration is supported, a plurality of target servers, different log files and different collection frequencies can be configured in one log collection strategy, and flexible collection strategies can be configured for different collection objects; in addition, in the method, strategies are automatically distributed, and the complexity of deployment and management is simplified; after the change of the file is monitored, the log file in the appointed path with the change is automatically collected, the automatic log collection and storage process reduces the requirement of manual operation, reduces the possibility of error occurrence, and improves the integrity and reliability of log data; in addition, the method supports the simultaneous storage of the logs in a plurality of target storage systems, such as a local file system, a cloud storage, a database and the like, so that the flexible configuration of log storage is realized.