4254 results about "Datasheet" patented technology

In some examples, computer-implemented systems and processes deploy securely de-risked elements of confidential data within a distributed computing environment. For example, an apparatus may obtain configuration data associated with a source data table. The configuration data may specify an identifier of a column of the source data table that includes elements of confidential data, and based on the configuration data, the apparatus perform operations that anonymize the elements of confidential data within the column of the source data table and generate an anonymized column within the source data table. The apparatus may also perform operations that provision an anonymized data table that includes the anonymized column to at least one computing system, which may process the anonymized data table and generate an output data table that includes the anonymized column and maintains a referential integrity between the source data table and the output data table.

The invention provides a supply chain collaborative material management system and method, and relates to the technical field of material management, and the method comprises the steps: receiving a multi-enterprise heterogeneous material data flow, and constructing an industry knowledge graph based on the field-level semantic mapping of a dynamic ontology library; a standardized data table is generated; standardized data is injected into a distributed message queue for parallel processing, dynamic cache partitions are created according to material object labels, timestamp indexes are built in the dynamic cache partitions, a sliding window mechanism is adopted to scan data, and multi-strategy resolution is performed on conflict data in a window; performing conjoint analysis on the cleaned data to generate an enhanced analysis report, and activating a case transfer learning mechanism to update a model when the similarity between new data and historical cases exceeds a threshold value; constructing a material state transfer matrix for the abnormal data, simulating a correction operation in a digital twin environment, and triggering automatic correction; the problems of multi-enterprise heterogeneous data integration, dynamic data processing, intelligent analysis and the like are solved, and the collaboration efficiency and the management level of a supply chain are improved.

The embodiment of the invention discloses an intelligent contract auditing method and device based on a multi-modal large model and a medium, and relates to the technical field of contract auditing, the method comprises the steps that a to-be-audited target contract document is acquired, multi-modal data in the target contract document is analyzed, and the multi-modal data comprises text data, table data and image data; performing feature extraction on the multi-modal data to obtain multi-modal feature data, mapping the multi-modal feature data to a unified dimension space so as to calculate an association weight between each modality through a cross-modal attention mechanism, establishing cross-modal bidirectional link data, and obtaining multi-modal data; the multi-modal feature data comprises any one or more of text semantic features, table relation maps and image visual features; and based on the multi-modal feature data and the cross-modal bidirectional link data, performing single-modal self-consistency verification and cross-modal contradiction detection on the target contract document to generate auditing information of the target contract document.

The invention relates to the technical field of intelligent manufacturing, discloses a papermaking equipment fault tracing method and system based on a process knowledge graph, and discloses the papermaking equipment fault tracing method and system based on the process knowledge graph. The method and the system comprise data acquisition and preprocessing, papermaking process knowledge graph construction, fault event detection and matching, fault tracing and propagation path reasoning, and maintenance scheme recommendation and optimization. The method overcomes the limitation that the traditional method is difficult to capture the cross-equipment, cross-process and cross-time sequence deep causal association and fault propagation path of the papermaking equipment. By constructing a comprehensive papermaking process knowledge graph, equipment operation state data, process parameter data, production quality data, equipment structure principle, process flow knowledge, fault mode knowledge, maintenance experience and other heterogeneous knowledge are subjected to deep fusion and semantic association, so that the system can exceed the correlation of the data surface; and an internal mechanism and a propagation chain of the fault are deeply excavated.

The invention provides a method for generating an SQL (Structured Query Language) by a natural language based on bidirectional mapping and semantic parsing, which relates to the technical field of database query and comprises the following steps of: extracting natural language query elements and packaging the natural language query elements into structured data, and establishing a mapping relationship from a query field to a service attribute and a physical data table by adopting a bidirectional Hash index technology; and automatically identifying multi-table association keys, performing semantic extension and compliance verification, generating an abstract syntax tree, performing processing according to user permission, and finally converting the abstract syntax tree into an SQL statement conforming to a target database syntax specification. According to the method, the accuracy and the efficiency of converting the natural language into the SQL are improved, and the flexibility and the safety of the system are enhanced.

The invention relates to the technical field of data information processing, in particular to an artificial intelligence-based index layer model construction analysis method and system, and the method comprises the following steps: 1, multi-source data synchronization and quality evaluation; 2, service context analysis and subject domain intelligent division are carried out, and service document and data table field semantics are analyzed; 3, index demand intelligent analysis and calculation logic generation: analyzing index demands input by a user through a natural language processing technology, matching service entities in the knowledge graph, generating initial calculation logic and optimizing execution efficiency; and 4, dynamically updating the index data and verifying the consistency, executing the optimized computational logic to generate the index data, tracking the blood relationship of the data, triggering dynamic updating, and setting a threshold value according to a historical fluctuation range to carry out abnormal alarm. Through automatic and intelligent processing, the probability of human intervention and human errors is reduced, and the efficiency and accuracy of data processing are improved.

The invention discloses a multi-table combined natural language query SQL (structured query language) generation method, which comprises the following steps of: 1, constructing a database meta-knowledge graph, and establishing a triple storage comprising a table structure, a primary and foreign key relationship and business description for each data table; 2, receiving a natural language query request, and calculating the topic relevancy between query semantics and each database table through a pre-trained topic matching model; 3, dynamically constructing a view, and logically associating the database tables of which the theme relevancy exceeds a threshold value to form a temporary view; 4, generating a context enhancement prompt, and combining the temporary view structure, the field semantic description of the view and the view content sample to form a structured prompt; 5, inputting the natural language query and the structured prompt into the large language model to generate candidate SQL statements; and step 6, executing verification and iterative optimization on the candidate SQL statements, verifying logic correctness through SQL execution plan analysis and result sampling, and triggering and prompting a reconstruction mechanism when detection is abnormal.

The invention discloses a method and a device for adaptively generating a structural query statement by using a natural language. The method comprises the following steps: acquiring a natural language query statement input by a user; vectorizing the natural language query statement to obtain a first query statement and a data table and an SQL statement corresponding to the first query statement; rewriting the natural language query statement to obtain a second query statement; recalling a candidate data table and a candidate table field based on the second query statement and a preset to-be-queried data table; the first input data and the first sample data are input into the preset large language model, the query statement and the reasoning chain are structured, the natural language query statement input by the user is corrected, the difference between the natural language query statement and the database table structure is reduced, and the accuracy of data table recall is improved; by recalling the candidate data table, the reasoning difficulty is reduced, so that the accuracy of generating the structured query statement according to the natural language query statement is improved.

The invention discloses a hyper-converged server resource pooling method and system, and belongs to the technical field of resource scheduling, and the method comprises the steps: collecting spatial information, generating a multi-dimensional resource topological graph, abstracting edge node and core node resources into virtual units with position labels, constructing a virtual resource pool, and generating a three-dimensional metadata table; constructing an independent double-queue architecture, configuring a token bucket, triggering a queue clearing mechanism based on a control period, and performing micro-batch merging on edge node short transactions; binding adjacent virtual units by taking the physical position of the equipment as a fragmentation primary key, monitoring cross-virtual unit access traffic, migrating a high-frequency data copy and redirecting a write request, and adjusting fragmentation granularity according to data relevance; the virtual unit closest to the equipment group is selected as a main node in the data fragments, write operations are combined, low-delay paths are selected for synchronization, an asynchronous confirmation mechanism is adopted to respond to edge nodes, the local resource hit rate and the task processing efficiency are improved, and the real-time performance and reliability of industrial control are guaranteed.

The invention relates to the technical field of vibration monitoring, in particular to a slurry pump motion monitoring management system based on data analysis, which comprises a multi-source acquisition module, a period judgment module, a trend focusing module and a dynamic management and control module. According to the method, vibration data are collected through a three-axis acceleration sensor, a fundamental frequency amplitude is extracted through FFT, time-frequency characteristics and periodic distribution are fused in combination with an extreme value interval sequence, the data representation dimension is enhanced, the rising slope is processed through moving average, the periodic variation is calculated, random noise is restrained, and trend continuity is enhanced. Monotonicity test is combined with dynamic threshold judgment to improve anomaly recognition sensitivity; a sliding window is used for segmenting multi-cycle data; a sudden change interval is positioned based on a pressure amplification rate second derivative; the limitation of a frequency domain on transient feature recognition is broken through, a pressure amplification rate three-dimensional vector is constructed, cosine similarity is calculated, and a working condition difference degree is quantified to dynamically bind a maintenance instruction; and closed-loop feedback is formed to improve the early warning and decision matching degree.

The invention provides an industrial data online migration method, medium and system of a productivity middle platform, and belongs to the technical field of electrical digital data processing.The method comprises the steps that firstly, historical access records of an industrial data source are collected, and a deep neural network model comprising a multi-head attention layer, a time sequence feature extraction layer and a residual connection layer is constructed; and the prediction of the data change rate is realized. And based on a prediction result, dynamically calculating a data change rate demarcation point by utilizing an optimization equation set, and dividing a data table into different change frequency categories. And then constructing a data dependency relationship matrix, and determining a migration sequence by adopting an improved topological sorting algorithm. Batch migration, incremental migration and real-time synchronization mechanisms are adopted for different types of data, and model updating is triggered through real-time monitoring, so that dynamic optimization of a migration strategy is ensured. Finally, data consistency verification is carried out, migration accuracy is guaranteed, and the technical problem that the online migration efficiency of industrial data is low due to real-time dynamic change of the data change rate is solved.

A method for AI-driven natural language search includes receiving a user query for one or more items from a user, processing the user query by searching against at least one relational database associated with the query, where the relational database is generated by extracting features from electronic documents of a plurality of items associated with the one or more items and by identifying specifications or respective values corresponding to the extracted features of the plurality of items, generating one or more query results based on the processing of the user query, where the one or more results include at least one item identified from the plurality of items and a justification for explaining an irrelevance of the at least one item, and transmitting the one or more query results to a user device for presentation to the user.

Methods and systems are provided for using a fine-tuned language model to reduce representations of structured data. In embodiments described herein, training data is accessed that includes structured data, a set of queries for the structured data, and each portion of the structured data that is relevant to each query of the set of queries. A language model is fine-tuned to maximize a cumulative reward based on the training data. The cumulative reward includes a reward for determining a correct portion of the structured data, a first penalty for failing to determine the correct portion of the structured data, and a second penalty for determining an incorrect portion of the structured data. The fine-tuned language model is then output.

The invention discloses an SQL (Structured Query Language) statement generation method and equipment based on a natural language and a medium, and the method comprises the following steps: constructing an RAG knowledge base and a data table knowledge graph of a project, then obtaining a to-be-converted natural language of the project, and performing keyword retrieval on the natural language through the RAG knowledge base to obtain an association table set; performing graph traversal on the natural language through the data table knowledge graph to obtain an associated node set; packaging the screening condition of the natural language to be converted, the association table set and the association node set to generate a context knowledge base of the natural language; and finally, according to the context knowledge base and the semantic conversion model, obtaining an SQL statement of a natural language. The problem of low efficiency of multi-table association path discovery is solved by constructing a dynamic extensible database relationship graph; a unified retrieval enhancement mechanism for the RAG knowledge base, the extensible knowledge graph and the historical query features is established, and the problem that target context retrieval is low in efficiency is solved.

A computer system uses a machine-learned language model to generate an SQL query for a user query. The system receives a user query comprising a task for performing a database query. The system identifies an embedding for the user query to represent the user query. The system generates a prompt for input to a machine-learned language model, and the prompt specifies the user query, metadata associated with the identified data table and a request to generate one or more SQL statements for performing the database query on the data table. The system provides the prompt to a model serving system and receives an output generated that includes the requested SQL statements for performing the database query. The system presents a response to the user query using the received SQL statements.

The invention relates to the technical field of network security, in particular to a computer system risk monitoring method and system based on digital twinning, and the method comprises the following steps: collecting the real-time operation data of a computer system, constructing a digital twinning model according to the real-time operation data, classifying and grouping the operation data in the digital twinning model, and determining the risk of the computer system. And recording the real-time value of each type of data according to the time sequence, and forming a classified real-time operation data table by referring to the real-time value of each type of data. According to the invention, real-time operation data is collected and a digital twinborn model is constructed, and the difference value and the change trend of the operation data are combined. According to the method, the trend sequence is divided according to the fixed time, the abnormal data intervals are screened, and the multi-dimensional parameters are counted, so that the key features of the abnormal data can be identified from the finer dimension, and the accuracy of data analysis is improved. And the associated features of the abnormal parameters are extracted based on the state transition record, and the transition probability is calculated, so that the future trend can be predicted with higher accuracy.

The invention relates to the technical field of machine learning, and discloses a decision tree data model establishment method, which comprises the following steps of: acquiring heterogeneous data sources such as a structured data table, a time sequence data stream and graph structure data through distributed nodes, sampling the time sequence data stream by using a dynamic sliding window, and vectorizing the graph structure data through a graph embedding algorithm; a multi-stage feature selection model is constructed to screen features, and a dynamic decision tree generation framework adopting an adaptive splitting criterion is established based on the features. A tree structure is adjusted by applying a multi-objective optimization algorithm, and the performance is improved by introducing an incremental pruning mechanism. And the online model updating module monitors data distribution change, reconstructs a local sub-tree in good time, and injects noise to protect data privacy in combination with a differential privacy protection mechanism. According to the method, heterogeneous data is effectively processed, the model classification precision is improved, the complexity is reduced, the generalization ability is enhanced, the model can be updated online, and the data privacy is protected. The electronic equipment calls related instructions to execute the method, and efficient data processing and analysis can be achieved.

The invention discloses a contract auditing method and device based on a large model, equipment and a storage medium, and relates to the technical field of artificial intelligence, and the method comprises the steps: analyzing a target contract file based on an optical character recognition technology and a natural language processing technology, and generating a target structured analysis fragment corresponding to the target contract file; constructing a contract relation knowledge graph based on the target structured analysis fragment by using the target large model, and generating a target structured data table; verifying each contract term in the target structured data table based on a dynamic rule engine, and generating an early warning report based on a verification result; performing risk assessment on contract terms in the target structured data table based on the target domain knowledge base, the target large model and the contract relation knowledge graph to generate risk data; and generating a revision suggestion based on the early warning report and the risk data by using the target large model, and revising the target contract file based on the revision suggestion. According to the invention, the automation level and accuracy of contract auditing can be improved.

A structured query language statement generation method, executed by an electronic device, and comprising: determining a natural language text representing a query task, and determining a preset database, the preset database comprising at least one data table, and each data table comprising at least one field (101); on the basis of the natural language text, determining, from the preset database, at least one task-associated field and at least one task-associated data table which are associated with the natural language text (102); rewriting the natural language text on the basis of the task-associated field to obtain a rewritten natural language text (103); acquiring prompt information for the rewritten natural language text, the prompt information being used for guiding a query statement generation model in generating a structured query language statement (104); performing question classification on the rewritten natural language text to obtain question type information of the rewritten natural language text (105); and generating the structured query language statement of the rewritten natural language text by means of the query statement generation model on the basis of the task-associated field, the task-associated data table, the prompt information, and the question type information (106).

The invention relates to a power system scheduling method and device based on multi-modal data fusion. The method comprises the following steps: acquiring multi-modal data of a power system, wherein the multi-modal data comprises power grid topology data, meter information, wind and light energy output prediction data, maintenance plan text data and energy comprehensive data; performing feature extraction, space-time alignment processing and hierarchical attention learning on each modal data to obtain a fusion feature vector; training the scheduling model by using the fusion feature vector until a total loss function meets a preset condition, the total loss function comprising a power flow equation constraint term; the method comprises the following steps: acquiring real-time multi-modal data of a power system, and obtaining a real-time fusion feature vector through feature extraction, space-time alignment processing and hierarchical attention learning; and inputting the real-time fusion feature vector into the trained scheduling model to obtain a real-time scheduling decision, and scheduling the power system according to the real-time scheduling decision. The method can improve the dispatching precision of the power system.

The invention provides an intelligent number asking method for large model index query, and belongs to the field of natural language processing and database query. An auxiliary information base is constructed to store a database structure and historical question and answer examples, and key entities and fields are extracted by conducting structured format processing on natural language questions; a large language model guided by a small number of examples is utilized to generate an intermediate expression close to an SQL grammar and a plurality of SQL query candidates, and a consistency alignment mechanism is designed to verify candidate SQL in the aspects of field matching, aggregation functions, data tables and the like so as to screen out an optimal SQL query. Finally, the generated correct SQL and the corresponding question and answer pairs are fed back to the auxiliary information base, and self-learning enhancement is achieved. According to the method, under the condition that only a small number of training examples are needed, the accuracy and expandability of large language model text generation SQL query are improved.

Latency, response times, and efficiency improvements for data querying are provided herein, particularly in the context of querying large database systems and data tables from disparate data sources. There are provided systems and methods for automatic query and data retrieval optimization through procedural generation of data tables from query patterns. A service provider may utilize different computing services for query processing and data retrieval for different applications and services used by internal and / or external users. Instead of querying large database systems and numerous data tables, pre-aggregated data tables may instead be used and searched by procedurally generating such tables based on precomputation rules and query patterns. Once patterns have been identified in queries, corresponding data may be aggregated from data sources in a pre-aggregated data table. Query optimization rules may then be used to have these data tables queried in place of their original sources.

An apparatus includes at least one processing device including a processor coupled to a memory, wherein the at least one processing device is configured to modify first data obtained from one or more sources, wherein the modifying includes adding user context data to the first data to generate second data, the second data representing the first data supplemented with a per-user context and, in response to receipt of a query, generate a response to the query using at least one generative language model supplemented by a retrieval augmented generation process based on at least a portion of the second data.

A data processing method, an electronic device, and a storage medium. The method comprises: receiving a query request, wherein the query request comprises a target data table participating in a join operation; on the basis of the query request, executing a logical plan, wherein the execution of the logical plan comprises: constructing a data filtering condition corresponding to column statistical information, the column statistical information being information obtained by means of compiling statistics in advance on a column value range of columns included in the target data table; and executing a physical plan corresponding to the logical plan, wherein the execution of the physical plan comprises: performing partition pruning and / or dynamic filtering on the target data table on the basis of the data filtering condition, so as to generate a processed target data table, and executing the join operation on the processed target data table, so as to obtain an execution result.

The invention discloses a data quality monitoring method and system, electronic equipment and a storage medium, and relates to the technical field of data processing. The method comprises the following steps: acquiring a data flow fluctuation curve of a target data table, and constructing a data quality baseline library according to the data flow fluctuation curve; extracting abnormal data features based on the data quality baseline library, and generating a feature defect matrix corresponding to the abnormal data features; screening rule atoms from a preset rule pool according to the characteristic defect matrix, and constructing a rule atom link corresponding to the rule atoms; performing service scene adaptation on the rule atomic link to obtain a corresponding quality monitoring rule set; and performing data scanning on the target data table based on the quality monitoring rule set to obtain an abnormal data scanning result, and sending the abnormal data scanning result to a corresponding associated person. By implementing the technical scheme provided by the invention, the effect of improving the accuracy of data quality monitoring is achieved.

The invention discloses a statistical analysis-based engineering cost dynamic adjustment method and system, and aims to solve the problems of many errors and poor accuracy and reliability when the engineering cost is changed due to factors such as material price fluctuation, the method comprises the steps of obtaining a price change message and extracting related data, matching an engineering material data table by using a preset template, and obtaining an engineering material data table; the system queries and processes price data according to a change material identifier, carries out source diversification processing on the change price data, and also relates to initial construction and dynamic updating of an engineering cost template, the system is composed of a price change module, an engineering material data table module, a to-be-changed module, a to-be-replaced module and other modules, and all the modules work cooperatively to realize corresponding functions. The method has the following advantages that on the aspect of data processing, multi-channel data are automatically integrated, prices are fused, and the operation risk is reduced; in the aspect of template construction and updating, historical data and algorithms are utilized, and the material matching accuracy is improved; during price adjustment, the confidence interval is calculated based on statistical analysis, and the accuracy and reliability of the project cost are effectively guaranteed.

The invention provides an information display method and device based on a large model, equipment, a medium and a product, and relates to the technical field of data processing, in particular to the technical field of artificial intelligence such as large models, natural language processing and deep learning. The information display method based on the large model comprises the steps that in response to a received query problem, matching is conducted on a field value set of a target data table corresponding to the query problem according to the query problem, at least one target field value set is obtained, the target field value set comprises multiple target field values related in semantics, and the target field value set comprises multiple target field values related in semantics; the plurality of target field values are used for reducing the semantic deviation of understanding the query problem by the large model; according to prompt information obtained based on the query problem, the at least one target field value group and the description information of the target data table, calling the large model to generate a target query statement; and displaying a query result obtained by executing the target query statement.

In an embodiment, a computer generates a lexical prompt for a large language model (LLM) that accepts the prompt as input, which causes the LLM to generatively infer a hybrid table schema that contains natural language that describes a data table. The prompt may contain linguistic exemplar(s) that are generated from statically or dynamically selected predefined data tables. As discussed herein, task accuracy of computer inferencing is increased by novel static exemplar(s), and semantic accuracy of computer inferencing is increased by novel dynamic selection of most semantically similar dynamic exemplar(s). Dynamic selection of exemplars is accelerated by indexing of learned semantic vector encodings of predefined and new data tables.

The invention discloses a financial data query method and device, electronic equipment and a storage medium, and relates to the technical field of artificial intelligence or other related fields, the method comprises the following steps: receiving a data query demand, and retrieving a knowledge document according to the data query demand to obtain index information of a target data table indicated by the data query demand; based on the data query requirement, N reasoning tasks associated in sequence are generated, the N reasoning tasks are executed in sequence to obtain N reasoning results, and N is a positive integer; generating a prompt text based on the data query demand, the retrieval result and the N reasoning results, inputting the prompt text into the target large language model, and outputting a database query statement; and executing the database query statement to obtain a financial data query result. Through the method and the device, the technical problem of low financial data query accuracy caused by difficulty in accurately understanding user query requirements under the condition of complex financial system database environment in related technologies is solved.

The invention provides a data classification and grading method and device based on an artificial intelligence large model technology, and relates to the field of data security. The method comprises the following steps: constructing a data classification and grading catalog according to a preset classification rule, and storing each row of the classification and grading catalog as a document record in a target vector database; respectively carrying out first retrieval operation, second retrieval operation and third retrieval operation on the data classification and grading catalog by taking the business system name, the data table name and the field name as first query conditions so as to obtain a first matching document, a second matching document and a third matching document in the target vector database; sorting the first matching document, the second matching document and the third matching document according to a preset sorting mode, and obtaining a sorting result; and inputting a sorting result into the large language model, and performing data security early warning through the large language model. According to the method and the device, the security problems that corresponding security measures cannot be taken, sensitive data is leaked and the like when a data governance engineer identifies the metadata according to the data classification and classification catalog and judges the classification and security level of the metadata are solved.