50 results about "Metadata description" patented technology

The invention discloses a Direct3D memory model compatible method based on adaptive placeholder resources, which comprises the following steps: establishing resource metadata, accessing a scene library, checking an instruction template and double sandboxes when a DXVK is started, describing related resources by the DXVK through the metadata after a D3D application is started, completing resource mapping and metadata dynamic updating, and allocating the resources to the corresponding sandboxes; the DXVK compiles an application shader code, identifies a resource access instruction, matches an access scene and a check template by combining a pipeline stage and binding slot query metadata, instantiates the check instruction and adds the check instruction to the front of a target instruction; according to the unbound resources, adaptive generation of corresponding occupied resources is carried out, the authority and the state are configured, the unbound resources are bound to a Vulkan descriptor set to replace VKNULLHANDLE, and adaptation of the shader interface and the pipeline state parameters is completed to create PSO (Particle Swarm Optimization); and intercepting an application rendering instruction analysis parameter to construct a command buffer area, submitting the command buffer area to a Vulkan queue to trigger a GPU (Graphic Processing Unit) to execute rendering, and finally completing complete conversion and adaptation from the D3D rendering logic to the Vulkan.

The invention provides a method and a device for generating a customized report of an SAAS (Software as a Service) system based on dynamic template configuration. The method comprises the following steps: acquiring a customized visual report template for realizing business data decoupling; editing the report template based on a preset editor, and generating a template configuration file; analyzing a structured marker in the template configuration file to generate a metadata description file; querying a business database through a unified data interface according to a data requirement defined by the metadata description file, and obtaining and assembling customized business data corresponding to the tenant ID; and at least based on the customized business data, controlling a rendering process through a dynamic position calculation algorithm, and dynamically filling the data to a corresponding position of the report template to generate a customized report. According to the method, the problems of code redundancy and difficulty in maintenance of the SAAS multi-tenant report are solved, zero code configuration is realized, and report generation efficiency and tenant personalized adaptation capability are improved.

The invention provides a data acquisition and integration method, system and device and a medium, and belongs to the technical field of information. The method comprises the following steps: packaging multi-source heterogeneous data into an original data packet in a standard format through a unified packaging protocol; cleaning, converting and standardizing the original data packet by using a rule engine to generate a standardized data object; based on the metadata description information and the field mapping relation, intelligent fusion of the multi-source data is achieved, and a fusion data record with complete business semantics is generated; a full-link quality monitoring system is established, a quality report is generated through multi-dimensional quality index evaluation, and an alarm is triggered; displaying the operation state through a visual interface and receiving configuration parameters; and realizing dynamic scheduling and resource optimization of the distributed tasks based on the task dependency graph. According to the invention, standardization, automation and intellectualization of the whole data acquisition and integration process are realized, and the data processing efficiency and the quality reliability are effectively improved.

A method, apparatus, non-transitory computer readable medium, and system for data processing include obtaining a query relating to a document and identifying metadata for the document based on the query, where the metadata describes a structure including a plurality of portions of the document. Some embodiments including generating, using a machine learning model, a retrieval command based on the query and the metadata, selectively retrieving at least one of the plurality of portions of the document based on the retrieval command, and generating, using the machine learning model, a response to the query based on the at least one of the plurality of portions of the document.

The invention provides a clinical test data table collaborative auditing method and system based on file state driving, and relates to the technical field of clinical test data processing.The method comprises the steps that firstly, an initial file set of clinical test data table files is obtained, and the initial file set comprises a to-be-audited table file unit and a metadata description information set; analyzing the data unit structure to generate a table data unit topological graph; generating an auditing operation event in response to the auditing operation; inputting the auditing operation event into a constraint propagation analysis model to determine an affected associated data unit node set; and finally, generating a file state driving instruction based on the associated data unit node set, and triggering the cooperative auditing terminal to auditing the associated data field. According to the invention, data can be accurately positioned, the structure can be visually presented, the influence range can be rapidly determined, automatic coordination auditing is realized, and the clinical test data auditing efficiency and accuracy are improved.

This invention discloses a method for constructing logical associations and generating privacy-compliant code for heterogeneous databases in intelligent programming assistance. It introduces a custom metadata description file independent of the database's physical schema, defining cross-domain logical association attributes and data security attributes, including the target database identifier. The description file is parsed, comparing the associated target with the database identifier of the current context, and automatically selecting either an intra-database join strategy or an application-layer aggregation strategy based on the comparison result. An enhanced context hint containing architectural constraints and security rules is constructed, and the target code is generated by inputting a large language model. De-identification processing logic is automatically embedded based on the data security attributes. This invention effectively solves the problems of AI programming context breakage, cross-database association code generation errors, and data privacy compliance risks caused by missing physical foreign keys in microservice architectures, achieving automatic code generation and source-level data privacy protection for complex cross-service business logic.

The application provides a double-knowledge base-based MCP tool calling system, comprising: a user request module; a tool description knowledge base module, used for storing metadata description information of all registered MCP tools; a tool calling sequence template knowledge base module, used for storing tool calling sequence templates, the tool calling sequence templates containing function descriptions, user question examples, tool calling processing logic and answer examples; a dynamic retrieval and matching module, used for simultaneously retrieving in the tool description knowledge base module and the tool calling sequence template knowledge base module according to a natural language request proposed by a user; a prompt word dynamic construction module; a tool service module; and an intelligent decision and answer generation module. The application effectively solves the token consumption bottleneck problem in MCP tool calling through the double-knowledge base architecture and the dynamic retrieval mechanism.

The application discloses a kind of based on deep learning multi-modal data quality evaluation method, comprising obtaining database in first modality record data and second modality record data labeled as alignment;First modality record data and second modality record data are respectively carried out semantic feature extraction to obtain text structured data semantic encoding feature tensor and metadata description semantic encoding feature vector;Text structured data semantic encoding feature tensor and metadata description semantic encoding feature vector cross-modal joint coding to obtain structured-metadata cross-modal quality evaluation joint coding feature tensor;Based on structured-metadata cross-modal quality evaluation joint coding feature tensor, reconstruct record data is generated, and the offset feature of reconstruct record data is calculated;Offset feature is evaluated by quality by first deep learning model;The application improves the accuracy of data quality evaluation by semantic encoding feature extraction, fine-grained hash cross-modal coding and bidirectional reconstruction offset evaluation.

This application discloses a metadata management method, apparatus, device, and storage medium based on lineage analysis, belonging to the field of artificial intelligence technology. This application obtains the metadata description corresponding to the data to be processed, performs lineage analysis based on the metadata description to obtain the lineage information of the data to be processed, divides the data according to the lineage information to obtain a lineage dataset, inputs the lineage dataset into a pre-trained data classification model to obtain data classification results, wherein the data classification results record the mapping relationship between each data to be processed, constructs a data map of the data to be processed based on the mapping relationship and the metadata description, and manages the data to be processed based on the data map. Furthermore, this application also relates to blockchain technology, and the data to be processed can be stored in the blockchain. This application combines the lineage information and metadata description of the data to classify and manage the data to be processed, improving the reliability of data management and thus enhancing the value of data utilization.

A storage system includes a storage device including a nonvolatile memory device and a host device including a file system to generate and update a file system metadata to manage data stored in the nonvolatile memory device. The file system of the host device determines a relocation of a plurality of data blocks and transfers, to the storage device, a synchronous move request including a move data descriptor indicating information on a storage location of the plurality of data blocks and a metadata descriptor indicating information on a change in the file system metadata according to the relocation. The storage device performs a data move operation to change the storage location of the plurality of data blocks based on the move data descriptor, and a metadata update operation to write a new file system metadata according to the relocation in the nonvolatile memory device based on the metadata descriptor.

Automatically investigating security incidents and generating security incident reports using a Large Language Model (LLM). A computerized system receives an incoming Security Alert Message pertaining to a possible security-related incident. The system automatically feeds into the LLM at least: the content of the Security Alert Message; the metadata of the Security Alert Message; context information describing a security domain; and organization context information pertaining to users and machines of that organization. The system automatically prompts the LLM to automatically investigate the Security Alert Message and to automatically generate a detailed Incident Report pertaining to the Security Alert Message.

The application discloses a kind of seismic remote sensing data management method and system, it is related to earth science information technology field, including, access multi-source seismic remote sensing data, define the standardized metadata description format to each type of multi-source seismic remote sensing data, store multi-source seismic remote sensing data and corresponding standardized metadata description into data resource library;Real-time monitoring of earthquake event information, when target earthquake event is captured, the epicenter of target earthquake event is generated as dynamic space-time range, according to dynamic space-time range, aggregate multi-source seismic remote sensing data from data resource library, and construct dynamic data cube for target earthquake event;Based on dynamic data cube, generate data product through data processing workflow, record the complete processing process log of data product.The application forms integrated management scheme from data intelligent aggregation, product quality controllable to problem accurate traceability and closed-loop correction.

A method is disclosed herein. The method includes receiving (200) a three-dimensional medical image (122) and presenting (202) a cross-sectional view (126) of the three-dimensional medical image on a user interface (124). The user interface includes a split input tool (128); the method further includes repeatedly: receiving (204) split edit data (132) from the split input tool, where the split input tool includes tool configuration parameters (130) configured to control how the split input tool generates the split edit data; collecting (206) tool use metadata (134), the tool use metadata description inputting the split edit data using the split input tool; modifying (208) the tool configuration parameters using the tool usage metadata; and construct (210) a segmentation (136) of the three-dimensional medical image using the segmentation editing data.

The invention discloses a relational data importing method and device suitable for a retrieval enhancement generation system, equipment and a medium, and relates to the technical field of data processing and artificial intelligence crossing. The method comprises the following steps: analyzing metadata in a relational database to obtain table structure information, field attribute information and inter-table association relationship information; constructing a knowledge set for describing data semantics, wherein the knowledge set comprises metadata description knowledge generated on the basis of table structure information and field attribute information, association rule knowledge generated on the basis of association relationship information between tables, and instance semantization knowledge generated on the basis of field attribute information and business data content; and converting the knowledge set into an unstructured knowledge unit which can be retrieved by the RAG system, and updating the unstructured knowledge unit based on an incremental synchronization mechanism. By means of the technical scheme, the problems that the adaptability of relational data and an RAG system is poor, and knowledge extraction is insufficient can be solved.

This document discloses a medical system (100, 300, 400). Execution of machine-executable instructions (120) causes a computing system (110) to repeatedly perform the following operations: receive (204) segmentation editing data (130) from a segmentation entry tool (128); collect (206) location-specific segmentation tool usage metadata (134) describing the use of the segmentation entry tool to enter segmentation editing data at the editing location; determine (208) an anatomical location by using the editing location; retrieve (210) expected segmentation tool usage metadata from a segmentation tool usage database (122) by using the anatomical location; determine (212) the presence of anomalous segmentation editing data (806) by comparing the location-specific segmentation tool usage metadata with the expected segmentation tool usage metadata; provide (214) signals (142, 404, 808) if anomalous segmentation editing data is determined to exist; and construct (216) a segmentation result of a medical image (144) by using the segmentation editing data.

The application discloses a component self-defining configuration method and system based on a low-code platform, belongs to the technical field of low-code development, and comprises the following steps: a reusable dynamic structure unit library is constructed by decomposing component functions into atomized dynamic structure units and defining metadata and context contracts of the dynamic structure units, component functions are atomized and decomposed into template segments, logic controllers and metadata descriptors, standardized metadata and context contracts are defined, a reusable dynamic structure unit library with high cohesion and low coupling is constructed, and the reusable dynamic structure unit library supports function category tagging retrieval, a version control mechanism guarantees historical version backtracking and automatic upgrading, resources are packaged into standardized modules to simplify integration processes, and the application significantly reduces the cost of repeated development, thereby providing an efficient and extensible unit basis for dynamic configuration.

The invention relates to the technical field of object relation mapping, in particular to a dynamic object relation mapping method. The method comprises the following steps: S1, defining entities and relationships according to a domain model, and converting the entities and relationships into metadata; s2, the dynamic ORM framework analyzes the metadata to generate DDL statements and executes the DDL statements; s3, the transmission value is converted into memory and database type values, and the dynamic ORM maps the operation command of the domain object into an SQL statement and executes the SQL statement; s4, constructing a query expression tree, mapping the query expression tree into an SQL expression model by the dynamic ORM, and generating an SQL statement; and S5, executing the SQL statement to obtain a result set, and converting the result set back to the domain entity. According to the dynamic ORM technology, through metadata description, dynamic analysis and cache storage, real-time updating of the domain model, automatic generation and execution of DDL statements and synchronization and automatic management of a database structure are achieved, low-code direct definition and management of the domain model are supported, complex codes do not need to be written, and the demand response speed and development efficiency are improved.

Techniques for log storage in distributed data streaming systems are described. A cluster of brokers receive log records from publishers and send log records to subscribers. The log is represented as a group of segments, each segment subdivided into chunks. Metadata describes the log structure. Log records are stored in chunks at least in a remote storage location shared amongst the brokers in the cluster.

The invention relates to the field of electronic archive storage, and provides an electronic archive long-term storage method and device, electronic equipment and a readable storage medium, and the method comprises the steps: obtaining an electronic archive to be stored for a long time, and taking a single archive as a minimum storage unit of the electronic archive; extracting a metadata description file and an electronic file attachment corresponding to the electronic file; respectively carrying out Hash calculation on the metadata description file and the electronic file attachment, and compressing and packaging to obtain a target data packet corresponding to the electronic file; and storing the target data packets in different storage media in a distributed manner, and regularly verifying the integrity of the target data packets. According to the method, the metadata description file and the electronic file attachment are subjected to hash calculation and compressed and packaged for distributed storage, so that format self-description and content self-containing characteristics of the electronic file are realized, dependence on specific software and hardware environments is eliminated, the tampering risk caused by file dispersion in traditional storage is avoided, and the storage efficiency is improved. And data integrity and traceability in long-term storage are ensured.

A method for transacting data with a data repository via a virtual database system includes receiving a query comprising user metadata and a request for transacting data with one or more data repositories and parsing the query to create a command graph comprising one or more nodes and node-associated metadata, wherein each of the one or more nodes represents a command action for processing or transacting the data, and the node-associated metadata describes a behavior of the command action. Further, the method includes retrieving one or more policy rules based on the user metadata, applying security policies to the one or more nodes by updating the node-associated metadata, updating the command graph based on the updating of the node-associated metadata, and executing each of the command actions corresponding to the one or more nodes of the updated command graph.

This application discloses a method and related apparatus for cross-platform transmission of cultural relic data, relating to the field of data transmission. The method includes: performing cross-platform alignment mapping on the metadata items described by each platform in a platform set to obtain a metadata alignment mapping table; generating a data transmission rule set for future operating indicators based on a first operating indicator under each platform and the metadata alignment mapping table; transmitting the cultural relic data across platforms according to the data transmission rule set; and monitoring a second operating indicator in real time during transmission. If the change in the second operating indicator compared to the future operating indicator exceeds a change threshold, the second operating indicator is used as the first operating indicator, and a new data transmission rule set is generated. This application improves the transmission efficiency of cultural relic data and reduces the risk of packet loss by monitoring platform operating indicators in real time and adaptively adjusting the data transmission rule set.

The application discloses a database virtual physical structure optimization method, device and medium, and belongs to the technical field of databases. The method comprises the following steps: acquiring workload data of a database runtime and aggregating the workload data into sample sequences, performing normalization and structured analysis on SQL to generate a workload graph; inputting the workload graph into an artificial intelligence prediction model to generate a multi-dimensional prediction feature vector within a future time window; generating a candidate virtual physical structure set in the memory according to a prediction result, defining only metadata descriptors without actually creating physical entities; injecting the virtual structure into an optimizer candidate path through a database planner Hook to generate a hypothetical execution plan and a corresponding cost; calculating a multi-objective global score; and outputting an optimal physical structure adjustment scheme according to the global score and system constraints. The application realizes low-risk and forward-looking adaptive optimization of a database without creating real indexes and other physical structures, and in combination with AI load prediction and multi-objective evaluation.

Techniques are provided for monitoring the integrity of a table in a dataset. The table may include one or more columns and one or more rows, in which data elements in the table are associated with a specific row and a specific column. A coverage rule set may be generated based on metadata of the table, which describes attributes of the table and the columns associated with the table. The coverage rule set includes table rules and column rules. A table fault value is generated for each table rule in the coverage rule set and a column fault value is generated for each column rule in the coverage rule set. An error is detected when a table fault value or a column fault value exceeds at least one of a corresponding table rule threshold or a corresponding column rule threshold. A notification is transmitted for error detected.

The invention provides a multi-dimensional index scoring method and system based on a rule engine. The method comprises the following steps: constructing an index set according to user configuration operation; defining a metadata parent class corresponding to the index set and a handler subclass corresponding to each index; traversing each handler subclass by adopting a calculation engine, and executing the grasp logic of each handler subclass in batches to obtain index set metadata; performing metadata data structure analysis on the index set metadata to generate a metadata description file associated with each index; writing a scoring calculation rule of each index according to each metadata description file and a preset calculation structure, and calling the scoring calculation rule of each index by adopting a rule engine to obtain scoring data; and carrying out multi-dimensional index aggregation processing on the scoring data to obtain a target scoring report, and carrying out visual display on the target scoring report in an index billboard. According to the solution, the access period of the newly added indexes can be effectively reduced, and the expansion capability of the system is improved.

The embodiment of the invention relates to a data processing method, electronic equipment, a storage medium and a program product. The method comprises the following steps: receiving a first instruction for writing target data in an on-chip memory of a computing unit into an off-chip memory; generating metadata for the target data through a metadata generation component, and storing the metadata in an on-chip memory, the metadata describing one or more statistical values corresponding to at least part of data in the target data; writing the target data into an off-chip memory through a direct memory access component; obtaining metadata from the on-chip memory in response to receiving a second instruction to perform a target process for the target data using the computing unit, the target process being related to a target statistical value of the one or more statistical values; and executing target processing for the target data based on the target statistical value in the metadata by using the calculation unit. In this way, the data processing efficiency can be improved.

A computer implemented method of privacy masking video surveillance data is provided, wherein the video surveillance data includes metadata associated with video data, the metadata describing objects or activity in the video data. A location of each item of metadata within its respective frame is compared with privacy mask data defining a position of a privacy mask in the frame; and based on the comparison, it is determined if the metadata is to be masked. The item of metadata is masked if it is determined that the item of metadata is to be masked.

The invention discloses a data query method and device, a storage medium and a program product, and relates to the technical field of data processing.The method comprises the steps that a data query request of a current user is received; based on the data query request, the data entities and the access authority of the current user, a target data entity is screened out from the multiple data entities, and the data entities are a data set used for responding to the data query request; constructing a first prompt word based on the data query request, the metadata description information of the target data entity and preset query information related to the data query request; inputting the first cue word into a large language model to generate a data query template in a natural language expression form; and generating query parameters according to the data query template, and obtaining a data query result based on the query parameters. According to the method, the permission bypassing risk possibly introduced due to the fact that the large language model directly outputs the executable statements is fundamentally eradicated, and safe and reliable data query is achieved.

Embodiments of the present disclosure relate to a method, an electronic device, a storage medium and a program product for data processing. The method comprises: receiving a first instruction of writing target data in an on-chip memory of a computing unit to an off-chip memory; generating, via a metadata generation component, metadata for the target data and storing the metadata in the on-chip memory, the metadata describing one or more statistical values corresponding to at least part of the target data; writing, via a direct memory access component, the target data to the off-chip memory; in response to receiving a second instruction of performing a target processing on the target data using the computing unit, obtaining the metadata from the on-chip memory, the target processing being related to a target statistical value in the one or more statistical values; and performing, using the computing unit, the target processing on the target data based on the target statistical value in the metadata. In this way, embodiments of the present disclosure can improve the efficiency of data processing.

The invention discloses a cultural relic data cross-platform transmission method and a related device, and relates to the field of data transmission, and the method comprises the steps: carrying out the cross-platform alignment mapping of metadata items described by metadata description information according to the metadata description information under each platform in a platform set, and obtaining a metadata alignment mapping table, generating a data transmission rule set under a future operation index according to the first operation index under each platform and the metadata alignment mapping table, performing cross-platform transmission on the cultural relic data according to the data transmission rule set, and monitoring a second operation index in real time in the transmission process, and if the change amplitude of the second operation index compared with the future operation index is greater than the change amplitude threshold, taking the second operation index as the first operation index, and regenerating the data transmission rule set. According to the method, the platform operation index is monitored in real time and the data transmission rule set is adaptively adjusted, so that the transmission efficiency of the cultural relic data is improved and the packet loss risk is reduced.

The application discloses an intelligent extraction and automatic metadata management system based on multi-source heterogeneous data, and relates to the technical field of data processing.The system comprises a structure analysis module, a format conversion module, a semantic mining module, a metadata generation module and a verification and registration module.The structure analysis module identifies the encoding and logical structure of the original data file and generates an original structure characteristic descriptor.The format conversion module uniformly converts the heterogeneous data into an intermediate representation data block with a preset tree node structure according to the original data.The semantic mining module extracts the name label, numerical distribution and context dependency relationship of the key field from the intermediate representation to form a semantic feature vector set.The metadata generation module inputs the set into a template matching engine, automatically selects and fills the most matched metadata description template, and generates an initial metadata record.The verification and registration module performs logical consistency and integrity verification and revision on the record, and registers the record to a unified metadata registry.