17 results about "Metadata record" patented technology

The embodiment of the application discloses a kind of dynamic data management method, system, equipment, medium and product, comprising: receiving the creation request of dynamic structure table, corresponding metadata record is created based on the creation request;In response to receiving data write request, a data write batch identification is allocated and returned for the client, and the batch state corresponding to the data write batch identification is marked as unqueryable state;In response to receiving the data to be written sent by the client, the field information in the data to be written is identified, and the field information is compared with the initial field information, and the metadata record is updated according to the comparison result;In response to determining that the data to be written is completed after writing, the batch state is marked as queryable state;In response to data query request, based on the data write batch identification and the metadata record, retrieve and return the target data corresponding to the data query request.

This application relates to a data anomaly handling method, apparatus, and electronic device, comprising: when an anomaly is detected in a target file system, determining the execution stage of a currently executing data update operation; wherein the data update operation includes the following multiple execution stages: determining the target file corresponding to the data update operation; writing multiple metadata of the target file to a log area; writing the update steps corresponding to the data update operation to the log area; updating the data of the target file in the data area according to the update steps recorded in the log area; updating the metadata of the target file in the data area according to the metadata recorded in the log area; and updating the data in the data area and the storage status of the storage space according to at least one metadata and / or update step recorded in the log area corresponding to the execution stage. This enables timely recovery of data in the data area of ​​the target file system, ensuring the normal operation of the target file system and improving the user experience.

This invention discloses a method for processing multimodal data acquisition in intelligent manufacturing systems, relating to the field of industrial data governance technology. The method includes: acquiring multimodal data streams; segmenting raw data blocks and standardizing and encapsulating them to generate metadata records; establishing time indexes, batch indexes, and process indexes; hashing the metadata records to generate content addresses and writing them to object storage; recalculating the hash and comparing the content addresses to complete consistency verification and writing the results to a commit log table; generating operator records for successfully committed data blocks and hashing them to obtain operator addresses; registering lineage edges to form directed acyclic lineage relationships; generating leaf lists according to a preset range and aggregating them to obtain root digests; verifying content addresses object by object based on the leaf lists and root digests; replaying and recalculating to generate replay-derived data blocks; comparing them to generate audit records and storing them. This invention ensures continuous monitoring of data quality during big data acquisition through the replay and recalculation processing of directed acyclic lineage relationships.

Techniques are disclosed for ensuring consistent metadata across computing devices. In one example, a user device of a plurality of user devices receives a manifest that includes first metadata associated with a file system update of a file system of the user device. The user device generates second metadata of the file system based on performing the file system update. The user device then generates a dictionary based on comparing metadata records of the first metadata with metadata records of the second metadata. The dictionary may indicate a difference between at least one metadata record of the first metadata and at least one metadata record of the second metadata. The user device then updates the second metadata of the file system to match the first metadata based at least in part on the difference indicated by the dictionary.

Device comprising: logic, part of which is implemented in hardware, the logic comprising: a content recording device (1523), wherein the content recording device (1523) receives a first signal from a capture device (120), the first signal including an indication of captured content; a metadata recording device (1524) receiving a second signal from one or more sensors, the second signal including an indication of content metadata (156), the content metadata (156) indicating a relationship between the captured content (154) and a cooperating capture device; and a content sender (1525), wherein the content sender (1525) causes an information element (158) to be sent to a content sink device, the information element (158) including an indication of the captured content (154) and the content metadata (156).

This invention proposes a method, system, and storage medium for constructing a Rorschach corpus for depression screening. It collects multimodal raw data related to the Rorschach test, and performs editing and preprocessing. A core data model is constructed to store the multimodal data and their relationships. Through a data entry and import module, the multimodal data is stored in the core data model. Through a data association and retrieval module, cross-modal relational queries and a unified view are provided. Through a data export and sharing module, the data is exported in a specified structured format. Through a deep learning model integration module, the multimodal data is used for predictive analysis and stored in the core data model. The method, system, and storage medium for constructing a Rorschach corpus for depression screening provided by this invention avoid the problems existing in current Rorschach test research data management, such as poor multimodal data correlation, difficult version management, low collaboration efficiency, non-standard metadata recording, and difficulty in supporting deep learning model training.

The application discloses an intelligent extraction and automatic metadata management system based on multi-source heterogeneous data, and relates to the technical field of data processing.The system comprises a structure analysis module, a format conversion module, a semantic mining module, a metadata generation module and a verification and registration module.The structure analysis module identifies the encoding and logical structure of the original data file and generates an original structure characteristic descriptor.The format conversion module uniformly converts the heterogeneous data into an intermediate representation data block with a preset tree node structure according to the original data.The semantic mining module extracts the name label, numerical distribution and context dependency relationship of the key field from the intermediate representation to form a semantic feature vector set.The metadata generation module inputs the set into a template matching engine, automatically selects and fills the most matched metadata description template, and generates an initial metadata record.The verification and registration module performs logical consistency and integrity verification and revision on the record, and registers the record to a unified metadata registry.

Embodiments of the present application provide a knowledge base file processing method, system, electronic device, medium and product, the method comprising: determining a target network disk file to be associated to a target knowledge base, wherein the target network disk file is a network disk file uploaded into a network disk file system; obtaining network disk file metadata of the target network disk file in the network disk file system; generating a first knowledge base file in the target knowledge base according to the network disk file metadata of the target network disk file, wherein the first knowledge base file records the network disk file metadata of the target network disk file, and is used to enable a knowledge base server to respond to an operation request for the first knowledge base file, request the network disk file system to operate the target network disk file according to the network disk file metadata recorded in the first knowledge base file. The technical solution of the embodiments of the present application can access the knowledge base and associate the existing network disk file in the network disk file system, without the need for repeated uploading.

A system and method for generating a unified multimedia composition from a plurality of multimedia content items received from heterogeneous, independently operating devices is disclosed. For each item, a composite contextual metadata record including at least spatial and temporal data is generated. An automated curation process applies at least one programmatic selection rule based on the metadata to identify a target subset of the content items. The system then algorithmically aligns and compiles the target subset into the unified multimedia output. The invention further provides a method for generating a digital asset from the collaborative composition by minting a non-fungible token (NFT) cryptographically linked to the composite video and programmatically distributing ownership shares of the NFT to the digital wallets of users who contributed content. In some embodiments, ownership shares are also programmatically allocated to individuals depicted in the video, identified via facial recognition. The methods are applicable across various fields including security monitoring, insurance claim verification, and collaborative media production.

The application relates to a method and device for detecting data change between nodes and a computer device, and relates to the technical field of computers. The method comprises the following steps: obtaining a first metadata difference record stored by a local node; the first metadata difference record is used for recording metadata information of difference metadata between the local node and a peer node; the metadata information at least comprises a metadata identifier; determining a data change detection result of the peer node according to a peer metadata change attribute of the first metadata difference record; the peer metadata change attribute is used for representing whether there is difference metadata of the corresponding metadata information in the peer node, which is not synchronized to the difference metadata record of the local node; the peer node is used for notifying the local node to update the peer metadata change attribute of the first metadata difference record in the case that data change occurs in the peer node. The method can reduce the required computing resources for perceiving data change between nodes.

The application provides a cross-cloud storage platform data migration method and device based on a distributed cluster, the method comprising: through a single distributed file collection cluster, performing concurrent data scanning on a source end cloud storage platform, and writing scanned metadata records into an intermediate database subtable; according to a preset routing rule, encapsulating file information of the metadata records in the intermediate database subtable into a to-be-migrated task message through a plurality of distributed file migration clusters, and placing the to-be-migrated task message into a preset Redis task pool, comparing metadata features according to the file information, matching a corresponding target migration mode, and performing data migration to a target end cloud storage platform according to the target migration mode, thereby greatly saving bandwidth resources and guaranteeing data consistency; and adopting an asymmetric cluster architecture of 'one collection and multiple migration' to realize decoupling of collection and migration, supporting independent horizontal expansion of migration capacity, and efficiently supporting concurrent processing of massive files.

The application discloses a risk early warning method and system for an information system, and relates to the technical field of risk early warning. A tracking unit is arranged at a business request processing entrance of the information system, so that a tracking identifier of the business request is obtained; memory allocation call sampling is performed in a processing process of the business request, so that memory allocation call information is obtained; metadata records of the business request are generated; the metadata records are stored, so that a sampling metadata table of the information system is obtained; when it is identified that the business request ends, asynchronous release state checking processing is performed on the sampling metadata table, so that a leakage point set is obtained; the leakage point set is analyzed and processed, so that a leakage index value corresponding to a call stack characteristic hash is obtained; then, abnormality judgment processing is performed, so that a risk result corresponding to the call stack characteristic hash is obtained; and finally, the information system is subjected to risk early warning, so that the effectiveness of memory risk early warning management of the information system is improved.

This application relates to the field of solid-state drive technology, and in particular to a verification method, verification device, and storage medium for a flash memory conversion layer algorithm. In this method, a processor can configure different flash memory characteristic parameters for a flash memory simulation platform to simulate different virtual flash memory chips. This method does not require consuming real flash memory chips, which helps reduce verification costs. The processor drives the flash memory conversion layer algorithm to run in the test scenario corresponding to the test script by executing a test script. During the execution of the test script, the processor can monitor flash memory operation instructions, obtain the real flash memory operation data generated by the flash memory simulation platform, and obtain the flash memory operation metadata recorded by the flash memory conversion layer algorithm that corresponds to the real flash memory operation data. Based on this data, the flash memory conversion layer algorithm can be more thoroughly verified, which helps improve the reliability of the verification results.

The application provides a micro-service-based data authority control method and system, which comprises the following steps: based on a link identifier and an identity credential carried in a data access request to be processed, a privacy environment context of current data access is constructed, and based on the privacy environment context and metadata records of a target data resource, a dynamic sensitivity label of the target data resource is determined; based on the dynamic sensitivity label and a preset privacy protection strategy rule library, mapping is performed to obtain an encryption strength parameter and a desensitization instruction of the current data access; based on the encryption strength parameter and the desensitization instruction and public key information in the identity credential, a dynamic access token for the target data resource is determined; and based on the desensitization instruction in the dynamic access token, original data flow intercepted at a micro-service gateway is subjected to authority compliance deformation to obtain initial compliance data flow. Under the premise of protecting data privacy and security, the application realizes flexible and safe data cooperation between micro-services.

This invention belongs to the field of data protection technology, specifically referring to a continuous data protection method based on a multi-cloud architecture. The technical solution is a continuous data protection method based on a multi-cloud architecture, comprising the following steps: constructing a distributed continuous data protection system across multiple cloud nodes, each cloud node including a data capture module, a log storage module, a metadata management module, and a cross-cloud synchronization module; when the virtual machine disk is in continuous data protection mode, the data capture module intercepts write I / O operations of the virtual machine disk at the virtualization layer, extracts the modified disk data to generate a data change block, and simultaneously generates corresponding metadata records; improving system reliability by synchronizing data logs across multiple cloud nodes, so that data can still be recovered from other cloud nodes when a single cloud node fails.

The application discloses a kind of dynamic management method, device and storage medium of power secondary equipment recording wave file, belong to the secondary equipment operation and maintenance technical field of power system.The method comprises: the structured metadata of recording wave file is stored in embedded database;According to the comprehensive value score of structured metadata calculation recording wave file;Wherein, the comprehensive value score is based on the basic weight corresponding to the recording wave type and the influence weight corresponding to each type of recording wave value influence factor Assignment obtains, and according to recording wave file generation time length carries out dynamic attenuation;The number of recording wave file in structured metadata is checked for compliance, if it is not in compliance, according to comprehensive value score obtains the list of recording wave file to be deleted;According to the list of recording wave file to be deleted, according to the preset deletion transaction mechanism, delete low-value recording wave file, and update the recording wave file metadata record in embedded database, realize the efficient dynamic fine management of the whole life cycle of recording wave file.

This invention relates to the field of data processing technology, providing a log processing method and system. The method includes: recording the location information of sub-variables that need to be compressed in a log block as key positions and corresponding metadata of the encoded stream into a preset data structure based on a preset template; compressing the log block into different storage units based on the preset data structure; locating the storage unit corresponding to the search keyword based on the distribution of the location vectors corresponding to each log block on the location matrix, and completing the retrieval of log entries based on the matching result of the search keyword and the storage unit, where the location vector is the matching result of the search keyword and the decompressed preset template. This invention efficiently extracts dynamic patterns from logs through preset templates and stores log data as fine-grained units, thereby improving log compression bandwidth; it uses vectorization technology to achieve low-latency retrieval of fine-grained units, thus providing effective support for log analysis and system modeling.