41 results about "Schema mapping" patented technology

The invention discloses a data integration and fusion method and system based on a large model, and the method comprises the steps: taking the metadata information of initial multi-source data and representative sample data as the input context of a pre-trained LLM large language model, and carrying out the training through a Prompt prompt project guide model, thereby obtaining a plurality of enhanced data source mode descriptions; inputting a plurality of enhanced data source mode descriptions into an LLM large-scale language model, enabling the model to be a data integration engine through a Prompt prompt project, guiding the model to recognize semantic equivalence fields among different data source modes, and outputting a dynamic mode mapping scheme; analyzing a conflict reason and reasoning a conflict resolution strategy, and outputting a data cleaning suggestion and a data analysis result; and loading the fused data into the target data storage. The method can adapt to complex and changeable data structures, and the flexibility and efficiency of data integration are improved.

A system (100) for adaptive data blending across heterogeneous BI platforms for real-time decision making, comprising: (a) a data source abstraction module configured to establish standardised and secure connections with several different Business Intelligence (BI) platforms and convert their native data structures into a unified intermediate schema; (b) a real-time data ingestion and synchronisation module operable to continuously monitor and retrieve data updates from the BI platforms using event-driven mechanisms and configurable synchronisation policies; c) an adaptive data mapping and transformation module designed to intelligently harmonize, adapt, and semantically translate disparate data formats using rule-based logic and AI-assisted schema mapping; (d) a semantic context and metadata management module configured to maintain a unified data dictionary, track data sequence and maintain semantic consistency across platforms; (e) a cross-platform query orchestration engine designed to decompose common user queries, translate them into platform-specific query languages, execute them across the relevant BI platforms, and aggregate the results into a coherent output; (f) a decision intelligence and recommendation module that analyses the mixed data to generate real-time insights, alerts and contextual recommendations for decision support; and (g) a security, governance and compliance module configured to enforce access controls, maintain audit trails and ensure compliance with data protection regulations; h) the system provides seamless, real-time and secure data blending to enable consistent analytics and decision-making across heterogeneous BI environments.

Systems, computer program products, and methods are described herein for generating and mapping unicode for cross-distributed network data transmissions. The present disclosure is configured to identify a cross-distributed network data transmission comprising source ledger code; generate a core schema for a destination ledger, wherein the destination ledger is based on data of the cross-distributed network data transmission; generate, by a ledger transformation module, a data dictionary, wherein the ledger transformation module receives ledger code from a large language model (LLM); generate code mapping instructions for the cross-distributed network data transmission based on the core schema for the destination ledger; convert the source ledger code to a unicode; receive, by a receiver schema mapping module, the unicode and the code mapping instructions; and generate, by the receiver schema mapping module, an intermediary ledger comprising the unicode and based on the code mapping instructions.

A computer-aided design metadata extraction system for automated uploads to a document management system, wherein the system includes the following: a central processing unit configured to control all metadata extraction operations and coordinate the interaction between multiple hardware subsystems; a metadata interpretation controller connected to the central processing unit, which includes a dedicated analysis circuit configured to read file headers, attribute tables, revision identifiers and embedded descriptors from a CAD file; a structured data formatter coupled with the metadata interpretation controller, wherein the structured data formatter is configured to convert the extracted metadata into a normalized schema compatible with predefined fields of a document management system; a volatile memory module and a non-volatile memory module, each coupled to the central processing unit, wherein the volatile memory module is configured to store runtime processing states and the non-volatile memory module is configured to retain persistent logs of extracted metadata and completed upload transactions; a secure communication module comprising an encryption controller and an authentication controller, wherein the secure communication module is configured to transmit the structured metadata and the associated CAD file to the document management system via an authenticated and encrypted connection; and an operator interface comprising a graphical display unit and physical input controls, wherein the operator interface is configured to allow an operator to preview the extracted metadata, configure schema mapping rules, and initiate or approve metadata upload operations.

This invention provides a high-end scientific instrument reliability analysis and design method based on SysML, belonging to the field of instrument reliability analysis technology. The method includes: constructing a system model of the target instrument using SysML, the system model including a requirements diagram, internal block diagram, and attribute library; extracting all failure modes from all failure mode libraries and assigning them global numbers to establish a failure mode mapping matrix; performing failure mode and impact analysis (FMEA) for the target instrument based on the system model to obtain a failure mode and impact analysis table; establishing a parameterized reliability model for each functional path; calculating the reliability constraints of each functional path based on the system model and the impact analysis table; and performing reliability analysis based on the measured attributes and reliability constraints of sub-components to generate an optimization scheme. The advantages of this invention are improved accuracy, consistency, and automation of reliability analysis.

A system and method of use resolves the frustration of repeated manual work during schema mapping. The system utilizes a transformation graph—a collection of nodes (unified attributes) and edges (transformations) in which source attributes are mapped and transformed. The system further leverages existing mappings and transformations for the purpose of suggesting to a user the optimal paths (i.e., the lowest cost paths) for mapping new sources, which is particularly useful when new sources share similarity with previously mapped sources and require the same transformations. As such, the system also promotes an evolving schema by allowing users to select which unified attributes they want to include in a target schema at any time. The system addresses the technical challenge of finding optimal transformation paths and how to present these to the user for evaluation.

A system and method for evicting a resource from a unified network topology (UNT) of a computing environment, is disclosed. The method includes: generating a representation of a UNT for a network topology of a computing environment, the representation based on a unified data schema, wherein the unified data schema is mapped to a plurality of data schemas, each corresponding to a unique data source; receiving an event record at a first time, the event record including a resource identifier; updating in the UNT a representation corresponding to the resource based on extracted data from the event record at the first time; determining that a time period has lapsed from the first time which is greater than a threshold; detecting that a number of event records which include the resource identifier is less than a threshold value; and removing the representation of the resource from the unified network topology.

Embodiments of systems and methods for defining data ingest pipelines for processing data received from data sources to obtain and store that extracted data according to a schema mapped to concepts defined in a semantic model are disclosed. Raw data can be received from these data sources and semantically contextualized by processing the determined raw data associated with each of the multiple data sources to represent the determined raw data from each data source according to the schema generated for that data source such that the determined raw data associated with that data source is mapped to the one or more concepts of the semantic model. This semantically contextualized data can be made available for uses for various systems or applications.

The invention provides a log management method and device based on an ORC format of Logstash, equipment and a medium. The method comprises the steps that a Logstash service is started, and an ORC conversion Ruby script and multi-pipeline configuration are loaded; real-time data receiving and Schema dynamic mapping are carried out; according to the method, the problems of long link, poor real-time performance, large resource consumption and the like of traditional log processing are fundamentally solved, the architecture is simplified, the delay is reduced, the resource utilization efficiency is improved, and the real-time data processing capability is enhanced.

An adaptive answer-generating agent implemented on a computer system, communicatively connected to a user device, and configured to: receive a user query from the user device; map the user query to one of a plurality of reconfigurable answer-generation schemas stored in first data storage, each of the answer-generation schema specify a sequence of steps to generate an answer output to the query, said agent including an answer generation engine configured to: receive the answer-generation schema mapped to the user query; implement the sequence of steps to generate an answer output, and communicate the answer output to the user device, wherein the agent further includes a schema modification function configured to: receive schema modification data from a further computing device relating to one or more of the answer-generation schemas, and modify the sequence of steps of the one or more of the answer-generation schemas in accordance with the schema modification data.

The invention discloses an intelligent memory scheduling method and device, electronic equipment and a storage medium, and relates to the technical field of memory scheduling and task management. The method comprises the following steps: acquiring data information of a current task, constructing an access mode database, and mapping an access mode into a preset task semantic category by adopting a task semantic classifier; according to the state information of the candidate memory channel, calculating an affinity score of the task semantic category and the candidate memory channel; calculating the priority of the current task through the multi-dimensional features according to the task semantic category of the current task and the user configuration information; according to the load conditions of the candidate memory channels, the target memory channel is allocated for the current task, and memory scheduling of the current task is completed. The method achieves precision and differentiation of memory scheduling, can adapt to service characteristics and resource requirements of different tasks, flexibly adjusts a scheduling strategy according to the system state, and improves the scheduling efficiency. And the utilization efficiency of memory resources is effectively improved.

The invention provides a voucher processing method which can be applied to the technical field of big data and artificial intelligence. The method comprises the following steps: based on a field mapping rule, carrying out mode mapping on preprocessed historical certificates from different service systems according to a standard field unified mode; performing multi-dimensional association processing on the historical vouchers after mode mapping and the multi-source real-time information associated with the historical vouchers to obtain a unified voucher data model; in response to the service request, preprocessing target service associated information associated with the service request, and generating a target service voucher by using the preprocessed target service associated information and the unified voucher data model; and carrying out anomaly detection on the service request by using the preprocessed feature clustering result of the historical voucher, and carrying out compliance check on the generation process of the target service voucher by using a compliance rule determined by the unified voucher data model. The invention further provides a voucher processing system, voucher processing equipment, a storage medium and a program product.

An adaptive answer-generating agent implemented on a computer system, communicatively connected to a user device, and configured to: receive a user query from the user device; map the user query to one of a plurality of reconfigurable answer-generation schemas stored in first data storage, each of the answer-generation schema specify a sequence of steps to generate an answer output to the query, said agent comprising an answer generation engine configured to: receive the answer-generation schema mapped to the user query; implement the sequence of steps to generate an answer output, and communicate the answer output to the user device, wherein the agent further comprises a schema modification function configured to: receive schema modification data from a further computing device relating to one or more of the answer-generation schemas, and modify the sequence of steps of the one or more of the answer-generation schemas in accordance with the schema modification data.

Various embodiments provide methods, apparatus, systems, computing entities, and / or the like, for recommending and / or defining cross-schema mappings, or a mapping from a data element type of a first schema to one of a second schema. In one example embodiment, a method is provided. The method includes identifying a plurality of canonical data element types belonging to a canonical schema and an external data element type belonging to an external schema. The method includes obtaining a multi-dimensional representation for each data element type and determining a predicted similarity score for each canonical data element type using comparison results from a mapper machine learning model. The method further includes generating a recommendation data object indicating one or more mappings between the external data element type and a selected subset of the plurality of canonical data element types, the subset selected according to predicted similarity score.

A system and method of tax regulatory change management is provided, comprising: receiving tax filing instructions and e-file schemas of tax forms; converting the filing instructions into output filing instructions and the e-file schemas into output e- file schemas; executing a mapping operation to generate an instruction-to-schema mapping; executing a tax form descriptions operation that generates form descriptions and per-line descriptions of each of the tax forms from the instruction-to-schema mapping using a first generative model; receiving a tax article identifying a tax regulation change; executing an impacted forms operation that uses the form descriptions and the identified tax regulation change as inputs to a second generative model that identifies an impacted tax form; executing an impacted lines operation that uses a third generative model to identify an impacted line from the impacted form; and generating a notification including the impacted line in the impacted form.

A system and method of tax regulatory change management is provided, comprising: receiving tax filing instructions and e-file schemas of tax forms; converting the filing instructions into output filing instructions and the e-file schemas into output e-file schemas; executing a mapping operation to generate an instruction-to-schema mapping; executing a tax form descriptions operation that generates form descriptions and per-line descriptions of each of the tax forms from the instruction-to-schema mapping using a first generative model; receiving a tax article identifying a tax regulation change; executing an impacted forms operation that uses the form descriptions and the identified tax regulation change as inputs to a second generative model that identifies an impacted tax form; executing an impacted lines operation that uses a third generative model to identify an impacted line from the impacted form; and generating a notification including the impacted line in the impacted form.

A system for monitoring data representative of a user's general wellbeing and for delivering digital content to the user, the system comprising a pre-defined module comprising a plurality of reference patterns mapped to digital content for delivery to the user, the system further comprising at least a processing means, wherein the processing means is configured to: identify user activity and select a user based on the identified user activity; for the selected user, interrogate user data representative of the user's general wellbeing and identify a pattern in said user data; and compare the identified pattern to the reference patterns in the pre-defined module to identify digital content mapped with the identified pattern.

The invention discloses a Flume-based time sequence database dynamic adaptation method and device and a medium, belongs to the technical field of databases, and aims to solve the technical problems of how to realize dynamic adaptation of a time sequence database and how to improve the access efficiency of the time sequence database. Comprising the following steps: dynamically loading a driving module of a target time sequence database through a dynamic pluggable protocol plug-in pool; the method comprises the following steps: sampling an input data stream, automatically deducing a timestamp field, an index field and a tag field based on a predefined rule set, and generating a Schema mapping relation of a target time sequence database; dynamically adjusting data batch processing parameters through a reinforcement learning model according to a real-time load index of the time sequence database; and when the time sequence data fails to be written in, a hierarchical retry mechanism is triggered, and the hierarchical retry mechanism comprises local caching, exponential backoff and standby cluster switching.

Systems, computer program products, and methods are described herein for generating and mapping unicode for cross-distributed network data transmissions. The present disclosure is configured to identify a cross-distributed network data transmission comprising source ledger code; generate a core schema for a destination ledger, wherein the destination ledger is based on data of the cross-distributed network data transmission; generate, by a ledger transformation module, a data dictionary, wherein the ledger transformation module receives ledger code from a large language model (LLM); generate code mapping instructions for the cross-distributed network data transmission based on the core schema for the destination ledger; convert the source ledger code to a unicode; receive, by a receiver schema mapping module, the unicode and the code mapping instructions; and generate, by the receiver schema mapping module, an intermediary ledger comprising the unicode and based on the code mapping instructions.

Embodiments of the present application provide a data migration method and device across heterogeneous databases, a storage medium and a program product, relating to the technical field of databases. The method comprises: in response to a migration task, obtaining source data information from at least one source database through a source connector; mapping the source data information into standardized data according to a preset unified data model; inputting the standardized data into a schema mapping engine, and generating target mapping configuration information corresponding to a target database according to a preset mapping rule by the schema mapping engine; converting the standardized data into data in the format of the target database based on the target mapping configuration information to obtain target-ready data; and writing the target-ready data into the target database through a target connector. The method of the present application increases the compatibility of heterogeneous databases and improves the automation degree and processing efficiency of data migration.

A method, system, and computer-readable medium are disclosed for processing and comparing documents in varying formats, incorporating advanced data extraction, normalization, and comparison techniques. The method includes receiving documents containing structured and unstructured data, processing them with optical character recognition and layout analysis to identify structural elements, and extracting key data fields using natural language processing, including named entity recognition and contextual analysis. Extracted data is normalized through schema mapping and synonym resolution, ensuring consistency in terminology and structure. The system employs fuzzy matching algorithms to identify discrepancies between documents and provides an interactive user interface with graphical visualizations, such as heatmaps and comparison charts, for reviewing and resolving differences. Machine learning techniques refine the system over time by integrating user feedback to improve data extraction, synonym resolution, and comparison accuracy.

A method for implementing policy-based compliance enforcement in a federated graph data environment including receiving a query from a query caller for data stored in a graph data storage system, the query including one or more components that are mapped to data entities of the graph data storage system using a schema. The schema expresses connections between data entities of the graph data storage system and includes data classification labels for the data entities of the graph data storage system. Each of the components of the query is examined to identify components to which a policy applies, the identification being done based on the data classification labels. Upon identifying the components, selecting between multiple policy enforcement modes that include reporting violation of the policy, denying query plans in violation of the policy and generating a transformed query plan that complies with the policy. Depending upon the selection, generating the query plan and generating a report that details violation of the policy, preventing execution of the query plan and generating the report that details violation of the policy or generating a transformed query plan.

A process and system for facilitating natural language interrogation of system engineering models is described. The process and system utilize multiple formatting translations of the original SysML model into a graph schema which can be queried by a user using LLM-backed Retrieval Augmented Generation (RAG).

The invention discloses a multi-source data integration management system based on a knowledge graph and a large model, and the system comprises an infrastructure layer which is used for providing hardware support and an operation environment; the data resource layer is used for integrating the structured data and the unstructured data and constructing a knowledge base; the data access layer is used for designing a connection mechanism and completing automatic acquisition and circulation of multi-source data; the data processing layer is used for executing data cleaning, mode mapping, knowledge extraction, knowledge normalization fusion and vector database generation; the knowledge graph layer is used for constructing a knowledge graph including mode definition, graph reasoning, entity management and graph retrieval; and the application management layer is used for designing a double-database collaborative retrieval mechanism based on the vector database and the knowledge graph and realizing business checking and intelligent response. According to the invention, multi-source heterogeneous data can be integrated, knowledge values can be deeply mined, and business intelligent decisions can be endowed.

Artificial Intelligence-assisted building / execution of federated data layer for enterprise engineering: A system trains at least one machine-learning model to identify information about industrial assets from training data, then map the information to a federated data model. The system retrieves information about data from an application in an industrial asset. The at least one machine-learning model identifies types of the data, relationships between the data, and patterns of the data, from the information and based on data types, data relationships, and data patterns in the federated data model. The at least one machine-learning model maps the types of the data, the relationships between the data, and the patterns of the data to the federated data model. The system identifies knowledge about the types of the data, the relationships between the data, and / or the patterns of the data in the federated data model, in response to a query about data.

The invention discloses a data query method and a related device, and the method comprises the steps: receiving a query natural statement sent by a query user, and carrying out the intention recognition of the query natural statement, and obtaining the type of the queried data and the query condition of the to-be-queried data; processing the type of the to-be-queried data and the query condition of the to-be-queried data by adopting a Schema mapping operation to obtain a query type and a query condition suitable for database operation; a query mode is selected based on the query type, a database adapter is selected, the query condition is sent to the selected database adapter, and a query result obtained by the database adapter through query in a corresponding database according to the query condition suitable for database operation is obtained; and inputting the query result into a data management layer for data integration to obtain a data integration result, and outputting the data integration result. According to the method, unified management and output of the data are realized on the basis of adopting corresponding data query modes for different types of data.

An input and processed content associated with a tree data structure is received. It is determined that a correctness associated with a derived pattern mapping associated with a webpage or application is greater than a confidence threshold. The derived pattern mapping that is based on a large language model response is obtained. The derived pattern mapping is utilized to generate a response for the input.

Artificial Intelligence-assisted building / execution of federated data layer for enterprise engineering: A system trains at least one machine-learning model to identify information about industrial assets from training data, then map the information to a federated data model. The system retrieves information about data from an application in an industrial asset. The at least one machine-learning model identifies types of the data, relationships between the data, and patterns of the data, from the information and based on data types, data relationships, and data patterns in the federated data model. The at least one machine-learning model maps the types of the data, the relationships between the data, and the patterns of the data to the federated data model. The system identifies knowledge about the types of the data, the relationships between the data, and / or the patterns of the data in the federated data model, in response to a query about data.

The invention discloses a multi-cloud data analysis method and system based on a cloud platform, and relates to the technical field of data processing. According to the method, cross-cloud security connection is configured, an acquisition agent is deployed, and heterogeneous storage is scanned to generate a structured metadata list and a mode mapping table; constructing a unified metadata directory based on a semantic similarity algorithm, and labeling compliance tags and generating an interactive topological graph in combination with geographic positioning; after a multi-modal request is received, the blood relationship is analyzed, a standardized task descriptor is output, an optimal node is dynamically selected by adopting a four-dimensional evaluation matrix, sensitive tasks pass back an encryption gradient through federated learning fragmentation, and non-sensitive tasks execute homomorphic encryption aggregation; and finally fusing an intermediate result, injecting Laplacian noise to realize differential privacy protection, generating a traceable audit report and automatically recycling resources. According to the method, the problem of multi-cloud metadata splitting is solved, the task cost is reduced, and the over-budget risk is reduced; and the compliance coverage rate and the recovery and utilization rate are improved.