2290results about "File system administration" patented technology

The invention relates to an engineering document index consistency proofreading method and system based on a multi-modal large model, and the method comprises the steps: Q1. OCR detection and recognition: carrying out the optical character recognition and format analysis of a source document, converting an uploaded PDF document into a processable text message in a Markdown format, and carrying out the format discrimination of a table, a formula and a plain text; and Q2, table and formula processing: adopting a hierarchical processing strategy, intelligently selecting an optimal processing mode according to the complexity of the table, and converting table information into a descriptive long text through a language large model and cue words. According to the method, accurate, reliable and efficient document index checking service can be provided for a user, the quality and efficiency of professional document processing are remarkably improved, the efficiency and quality of knowledge graph construction are remarkably improved, a knowledge verification system capable of being evolved continuously is established, and the method is suitable for popularization and application. And a reliable technical support is provided for knowledge management and professional decision-making in a complex field.

The invention discloses a human resource archive filing management system, and relates to the technical field of data management, the system comprises an acquisition module, a processing module and a management module, the acquisition module acquires original archive data of employees, transmits the data to the processing module, classifies the original archive data according to a preset first rule, and stores the classified data to the management module; the first archive data is obtained, controlled and managed, a calling permission and a distribution strategy are generated, the first archive data is recognized through a preset second rule, second archive data is generated, corresponding processing is conducted according to the processing priority, a processing log is reserved, third archive data are obtained and transmitted to the management module, and the management module is used for managing the first archive data. A distributed cloud storage cluster and a local storage node are constructed, an overall storage architecture and a retrieval path of third archive data are optimized, archive management is refined through three-dimensional classification, data integrity is guaranteed through field-level verification and automatic completion, scene-based dynamic authority control safety is achieved, compliance risks are intelligently cleared and avoided, and efficiency is improved through mixed storage. And active management of archive management is promoted.

The invention discloses a BIM model-based digital twinning and panoramic camera mapping method and system, and relates to the technical field of BIM and digital twinning, and the system is mainly composed of a data acquisition module, a data preprocessing module, a feature extraction and analysis module, a coordinate conversion and matching module, a digital twinning model module and a display module. Real-time and efficient integration of the video data and the BIM model is realized, and then the digital twin model capable of accurately reflecting the current state of the building is constructed. The model is of great significance to comprehensive monitoring and management of the building environment, and the intelligent level and the operation and maintenance efficiency of the building are remarkably improved.

The invention belongs to the field of data storage, and discloses a frequency access data storage migration method and device for big data, and the method comprises the steps: obtaining a data access log, carrying out the preprocessing of the data access log, and obtaining a time window statistical matrix; carrying out timeliness attenuation weighting calculation on a plurality of data access times in the time window statistical matrix to obtain a weighted access frequency vector; obtaining a multi-dimensional feature matrix based on the weighted access frequency vector; clustering the feature vector of each time window slice in the multi-dimensional feature matrix through a Gaussian mixture model to obtain a clustering tag vector; inputting the clustering label vector into an access frequency prediction model to obtain an access frequency prediction value of the data in a future preset time step; the migration decision matrix is determined based on the access frequency predicted value and the data storage cost parameter, data migration is carried out based on the migration decision matrix, the data migration complexity can be reduced, and the access speed and the storage cost are balanced.

The invention relates to the technical field of distributed system transaction management, and discloses an inventory consistency management method and device based on distributed transactions, and the method comprises the following steps: pre-occupying an inventory, and recording the state information of the inventory to a Redis hash structure; after the inventory is pre-occupied successfully, generating a pre-deducted snapshot, generating a compensation identifier, and writing the pre-deducted snapshot and the compensation identifier into a MySQL transaction log together; verifying the uniqueness of the compensation identifier, and submitting the current database transaction after the uniqueness of the compensation identifier is confirmed; when the submission of the current database transaction fails, executing a compensation operation on the current database transaction; and after the compensation operation is executed, performing data consistency verification on the MySQL transaction log and the Redis hash structure. According to the method and the system, the consistency of inventory management during distributed transaction processing is highly guaranteed.

The invention relates to the technical field of data processing, can be applied to business scenes of financial science and technology, medical health and the like, and discloses a data migration method, device, equipment and medium based on task offload, which comprises the following steps: scanning a source end directory hierarchy and a target end directory hierarchy, and generating source end file metadata and target end file metadata; files are classified into source-end unique files, target-end unique files and two-end shared files based on file paths, and the files are transmitted to a comparison processing module; generating a source end newly-added migration task, a difference coverage migration task and a target end deletion migration task; and transmitting the migration task to a migration processing module and executing the migration task to generate a migration result. According to the method, source-end unique files, difference files and target-end redundant files are processed in a classified mode, full-amount migration is disassembled into incremental tasks to be executed in a split mode, and the invalid data transmission amount is reduced; a difference coverage task is generated based on double comparison of metadata and content, repeated coverage of homonymous files is avoided, and redundant data is automatically cleaned.

Systems and methods for dynamically evaluating metadata consistency and data reliability in a data management system are disclosed herein. The system may retrieve first metadata and second metadata. The system may retrieve a metadata ruleset. Based on the metadata ruleset, the system may generate a first metadata consistency metric indicating a first measure of consistency. The system may determine to process each record of the first metadata as a batch. The system may generate a second metadata consistency metric indicating a second measure of consistency. The system may determine to process each record of the second metadata independently.

The invention relates to the technical field of electric digital data processing, and provides a secondary development code cross-product transplantation method and device, computer equipment and a medium. The method comprises the steps of loading a source project, screening a to-be-transplanted source code file, identifying an original API type, determining a mapping relation between the original API type and a target API type, and generating an adaptation layer code framework according to the mapping relation; copying the to-be-transplanted source code file into the target project; on the premise of keeping the project hierarchical structure of the source project, replacing the calling node of the original API type with the calling node of the adapter type, and replacing the namespace reference with the corresponding namespace in the target project to obtain a migrated source code file; and obtaining a secondary development project of the target project based on the second product API according to the adaptation layer code framework and the migrated source code file. According to the method and the device, the transplantation efficiency and accuracy of the transplantation of the cross-product secondary development codes are improved.

A snapshot of metadata of a file system on a source storage system is stored in one or more of storage devices of a target storage system. A request to access data stored in the file system is received. A portion of the metadata including identification information of the data is identified. The data stored in the file system is retrieved by providing the source storage system with the identification information of the data.

The disclosure is directed to various ways of improving the functioning of computer systems, information networks, data stores, search engine systems and methods, and other advantages. Among other things, provided herein are methods, systems, components, processes, modules, blocks, circuits, sub-systems, articles, and other elements (collectively referred to in some cases as the “platform” or the “system”) that collectively enable, in one or more datastores (e.g., where each datastore may include one or more databases) and systems, the creation, development, maintenance, and use of a set of custom objects (and core objects) for use in a wide range of activities, including sales activities, marketing activities, service activities, content development activities, and others, as well as improved methods and systems for sales, marketing and services that make use of such entity resolution systems and methods as well as custom objects.

The embodiment of the invention discloses a method and a system for realizing enterprise collaborative decision-making based on an AI algorithm and a government-enterprise API (Application Program Interface). The method comprises the following steps: receiving input data interacted by using a natural language; converting the input data into standard format data; determining a service type related to the input data by using an AI model; the service type comprises public service and enterprise application service; the public service and the enterprise application service are both associated with one or more subtasks; determining a thinking chain providing the service; the sub-tasks contained in different thinking chains are different, or the execution sequences of the sub-tasks of different thinking chains are different, or the execution proportions of the sub-tasks contained in the thinking chains are different; planning an optimal thinking chain; the optimal thinking chain corresponds to an optimal execution path; the optimal execution path comprises one or more execution nodes which are arranged in order; and calling the API according to the optimal execution path, so that the called API provides the service required by the user based on the standard format data.

Techniques are described for performing different types of restart operations for a file storage replication between a source file system and a target file system in different cloud infrastructure regions. In certain embodiments, the disclosed techniques perform a restart operation to terminate a current cross-region replication by synchronizing resource cleanup operations in the source file system and the target file system, respectively. In other embodiments, disclosed techniques perform a restart operation to allow a customer to reuse the source file system by identifying a restartable base snapshot in the source file system without dependency on the target file system.

Various aspects of the subject technology relate to systems, methods, and machine-readable media for automating the recording of an evidentiary history (e.g., versions audit trail) of a graphical user interface with an embedded clickwrap agreement. The snapshot server captures and outputs snapshot records of a graphical user interface displaying the click-wrap agreement on an end user computing platform. The snapshot records are created using a virtual machine that emulates an end user computing platform for navigation of an application rendered on the platform. Aspects may also include generating a snapshot record of metadata associated with the captured snapshot image.

The invention relates to a digital archive intelligent processing method, a storage medium and a system, which are suitable for multi-source heterogeneous archive management scenes such as colleges and universities. The method comprises the following steps of: classifying structured and unstructured data such as paper archive scanning pieces and database views, and extracting metadata and entity information by adopting a scanning and OCR (Optical Character Recognition) technology; a complex table and document content are analyzed through a model, semantic analysis (entity recognition, relation extraction and event abstract) is achieved in combination with a language model of a Transform architecture, and a structured report containing a data abstract, an entity relation graph and abnormal annotations is generated. The system is internally provided with a parameter template automatic generation module, supports cross-page content continuous restoration and sensitive data encryption desensitization, and realizes safe sharing through an API interface. The method solves the problems of low efficiency, difficulty in multi-source data fusion and the like of traditional archive processing, improves the automation level and data value mining capability of archive management, and is suitable for intelligent upgrading of complex archive scenes.

The invention discloses an alloy field-oriented text and table double-track collaborative data extraction method and system. The method comprises the following steps of: obtaining an alloy related document DOI; taking the DOI as an index to obtain a full-text literature and storing the full-text literature in a JSON format; performing document screening based on an LDA topic distribution model and establishing a target topic document library; preprocessing the unstructured table, and obtaining structured table data by using a large language model; performing automatic text segment division on the JSON format text through rule matching analysis; and sorting the text segments by using a large language model to generate semi-structured text data, fusing and normalizing the text and table data, and outputting a component-process-organization-performance-strengthening mechanism alloy data chain. According to the method, through a double-track collaborative data extraction mechanism, the problems of multi-source heterogeneity, format fragments, information islands, semantic layering and the like of material subject data are effectively solved, structured treatment of literature data in the alloy field is achieved, and a unified technical path is provided for constructing a high-quality alloy database.

Techniques relate to managing a document throughout its lifecycle according to configurable metadata associated with the document. A processor may receive the document in association with an operation and may determine suitable metadata, which may be configurable, to associate with the document. After the operation is closed, the processor may suitably handle the document based on the metadata. Handling the document may include moving the document to an associated profile and / or purging the document. Further, with the configurable metadata, the processor may control the document with increased granularity.

Embodiments are directed to a file system that include object stores. An object store for write requests may be provided. Write ahead log (WAL) entries that include data blocks may be generated. A WAL object may be generated based on the WAL entries and stored in the object store. An in-memory overlay may be updated to associate the data blocks with the WAL object. A checkpoint operation may be executed to: generate an index object that includes index entries that associate other data blocks with data objects stored in the object store; update the index object to include index entries that associate the data blocks with the WAL object; store the updated index object in the object store; update the in-memory overlay to remove the association of the data blocks and the WAL object and update the in memory WAL to remove records of successfully checkpointed WAL objects.

The invention belongs to the technical field of nuclear power station file management, and particularly relates to an intelligent nuclear power station file classification and retrieval system based on artificial intelligence. The file acquisition module is responsible for uniformly acquiring and accessing multi-modal files in the nuclear power station; the preprocessing and natural language processing module is used for carrying out deep processing and semantic analysis on the collected multi-modal document; the dynamic classification module is used for carrying out multi-dimensional automatic classification on the multi-modal document based on a deep learning model and a nuclear power industry knowledge graph; the dynamic knowledge updating module is used for continuously monitoring new documents and user feedback and keeping adaptability to industry changes; the intelligent retrieval module is used for providing a query function for a user through semantic vectorization and a large-scale rapid retrieval technology; and the intelligent recommendation module is used for providing targeted document recommendation for the user through association analysis and collaborative filtering. According to the method, the problems of low classification efficiency, insufficient retrieval accuracy, weak dynamic adaptive capacity and limited multi-modal data processing capacity are solved.

The invention discloses a data tracing method and device based on a runtime snapshot. Comprising the steps of generating a runtime memory snapshot file based on report traceability information; analyzing the runtime memory snapshot file, extracting all keys in the first mapping relation to construct a header character set, and querying N metadata identifiers corresponding to N header characters according to the first mapping relation; accessing a report data result storage area based on the N metadata identifiers to obtain a data value list, and rendering to generate a visual report snapshot; for each metadata identifier, extracting the metadata identifier of each metadata which directly depends on and indirectly depends on the metadata identifier from the task detail information associated with the metadata identifier, and obtaining a single metadata tree based on the hierarchical dependency relationship among the metadata; rendering and generating N metadata tree snapshots based on the N metadata trees; and displaying the metadata circulation process corresponding to the abnormal data value by skipping to display the metadata tree snapshot of the metadata identifier corresponding to the report data column where the abnormal data value is located.

Methods, apparatuses, and computer readable media are configured to perform operations comprising: obtaining, by a data management system (DMS), a first snapshot of a computing system, wherein the first snapshot comprises data associated with a set of files; determining, by the DMS, from among the set of files, a first subset of files or portions of files that comprise sensitive information; generating, by the DMS, one or more vectors based at least in part on data associated with a second subset of files or portions of files from among the set of files, the second subset of files or portions of files exclusive of files from the first subset of files or portions of files; and adding, by the DMS, the one or more vectors to a vector database along with metadata or a pointer to the metadata.

The invention discloses a file metadata multi-version storage management method and device, computer equipment and a storage medium. The method comprises the steps of obtaining file metadata; in response to the received generation instruction, generating a snapshot version for the file metadata to obtain a snapshot version set; extracting a first snapshot version and a second snapshot version from the snapshot version set, updating the snapshot version set, and storing the snapshot version set in a memory area; packaging the file metadata, the first snapshot version and the second snapshot version to obtain a coded data structure, and storing the coded data structure in a memory area; storing the updated snapshot version set and the coded data structure in a storage device; querying the memory area according to the query instruction, querying the storage device if the query fails, and returning a query result; by means of the method, decoupling storage of multiple versions of file metadata can be achieved, and the system memory utilization rate and the snapshot version management efficiency can be improved.

The invention relates to the technical field of building information, and provides a knowledge base construction and retrieval method and system based on a multi-source text in the building field, and the method comprises the following steps: a knowledge base construction stage: constructing a multi-dimensional metadata feature vector for a multivariate text based on a standard classification index table; the method comprises the following steps of: converting and segmenting a document, splicing an end clause with all superior title texts by utilizing a context inheritance algorithm to form a text unit with complete semantics, and performing dynamic filtering based on an analyzed query intention and a metadata vector at a user retrieval stage; then, in the screening set, performing fusion calculation on semantic vector similarity, keyword matching degree and authority offset weight based on effectiveness attribute and implementation time, and performing mixed retrieval and reordering on the text units; and finally selecting a text unit according to a sorting result and inputting the text unit into the large language model to generate answers. According to the method, high-precision and high-compliance intelligent retrieval and question answering of building domain knowledge are realized.

The invention relates to the technical field of information security, discloses a realization method of an electronic signature of a customs business scene and a seal management system, and aims to solve the problems of trust centralization, easy data tampering, difficult traceability, poor business adaptation and insufficient interoperability of an existing electronic signature. According to the method and the system, a distributed account book technology is introduced, decentralized creation and registration, signature generation and verification, life cycle management and on-chain recording of auditing and tracing of the electronic seal are realized, a dynamic and configurable business scene strategy engine is constructed, a customs business process is flexibly adapted, and high safety, high efficiency and high adaptability are ensured. According to the method, a decentralized trust basis is established, the tamper-proofing capability and efficiency are improved, full-chain auditing traceability and cross-mechanism interoperation are realized, and data security is guaranteed.

The invention discloses a method for archiving, restoring and reading a DLF file generated by a record file and a video. The method comprises the following steps: acquiring original data of the record file and the video; generating a mapping relation table between the record file and the video time axis; carrying out structured processing on the record file to generate a record metadata file in an XML (Extensible Markup Language) format; creating a DLF file container; segmenting the video file into a key frame sequence, and generating a dynamic video OFD component; embedding the structured record file into an expansion layer of a dynamic video OFD component, and establishing a space-time association index of a record text and a video key frame; registering a dynamic interaction event in the guide file, and constructing a multi-layer nested structure; generating an interactive directory tree, automatically creating a navigable bookmark identifier based on a record paragraph keyword, and performing dynamic retrieval; and performing digital signature verification and archiving on the combined DLF file, thereby realizing associated reading in an archive system.

Techniques are described for maintaining data consistency when failure events occur during file storage replications between file systems in different cloud infrastructure regions. In certain embodiments, two generation numbers (or different identifications) are assigned to two groups of processed B-tree key-value pairs, one before and one after a failure event, within a key range. In some embodiments, the two generation numbers are assigned to a group of B-tree key-value pairs processed by a failed thread and another group of B-tree key-value pairs processed by a substitute thread taking over the failed thread to avoid potential data corruption.

The invention relates to the technical field of data processing and storage, in particular to an asynchronous verification and batch storage system and method for high-concurrency voucher data. Certificate verification is executed based on the memory snapshot, and verification time consumption is improved from the millisecond level of database IO to the microsecond level of memory calculation; a batch persistence mechanism enables the throughput of the system to be improved by dozens of times, and a concurrent storage scene of ten thousand-level TPS can be easily supported; the voucher storage response time is reduced from a hundred millisecond level to a millisecond level; the response is immediately returned to the user after the verification is passed, the user almost does not need to wait, and the operation experience is smooth; the introduction of the message queue enables the system to have peak clipping and valley filling capabilities, and can deal with burst traffic leisurely; the multi-node cluster deployment supports horizontal capacity expansion, the fault of a single node does not influence the overall service availability, and the system reliability is improved.

Particular embodiments relate to personalized document field prediction based on user behavior and feature generation. Specifically, various embodiments have the technical effect of improved accuracy with respect to field / entity value prediction (e.g., predicting that the amount due is X via a Gradient Boosting Model) relative to document processing technologies by learning through user behavior data or feedback (e.g., through continuous reinforcement learning from human feedback (RLHF)). This is at least partially because of the technical solution of accessing or generating unique features from one or more documents previously used by a user.

The invention belongs to the technical field of geographic information technology and remote sensing image processing and service, and discloses a slice-free image service system and method based on dynamic projection and real-time mosaic, which abandons the traditional pre-slicing mode, directly provides online service based on original image data, and improves the service efficiency. The problem of redundant storage caused by pre-generation and storage of massive tiles is fundamentally eliminated, and storage space is saved by up to 90%. Meanwhile, when the original data is updated, the system does not need to carry out a time-consuming re-slicing process, real-time updating and publishing of services can be realized, and the core pain points of long data updating period and high delay in the traditional technology are thoroughly solved. Through the integrated dynamic projection engine and the real-time mosaic module, the on-demand service request of the client for any coordinate system, any spatial range and any resolution can be responded.

The invention discloses an enterprise data analysis system based on natural language interaction, and relates to the field of enterprise data analysis, the system comprises seven core function modules: a dialogue management module supports a user to create a new dialogue and automatically jumps to an initial page; the report interaction module realizes query support and switching functions of a real-time report and a T + 1 report through a floating button; the file import module allows uploading of Word, PDF and JPG format files to supplement question and answer contexts; the model configuration module supports dynamic switching of different AI service interfaces; the interaction auxiliary module provides a quick question button and a dialogue interruption function; the report preview module integrates Excel and PDF plug-ins to realize detail data preview; the session sharing module generates a sharing link and sets an access permission rule; dynamic model configuration optimizes response speed and accuracy; the operation process is simplified by a suspension button and a quick questioning function; the session sharing mechanism supports cross-team cooperation; and the real-time collaborative design with the T + 1 report meets the multi-dimensional data analysis requirement.

The invention relates to the technical field of cloud storage, can be applied to business system platforms of financial science and technology, medical treatment and health and the like, and discloses a hierarchical storage method, device and equipment for data files and a medium, and the method comprises the following steps: acquiring the data files in a storage unit, and extracting data characteristic parameters in the data files; performing multi-dimensional quantitative analysis on the data feature parameters to obtain a dimensional feature analysis value; identifying a dynamic weight of the data feature parameter, and performing weighted calculation on the data feature parameter according to the dimension feature analysis value and the dynamic weight to obtain a dynamic storage analysis value; identifying a data storage type label according to the dynamic storage analysis value; matching the data storage type label with strategies in a storage strategy library to obtain a target storage strategy; determining a storage hierarchy according to the target storage strategy; a storage address of the data file in the storage hierarchy is identified and the data file is stored in the storage address. The accuracy of hierarchical storage of the data files can be improved.