136 results about "Data dictionary" patented technology

In one aspect, a computerized method for document extraction workflow for unstructured documents includes the steps of implementing a text mining operation on a set of digital documents the incoming documents. This is done by defining a document type of each digital document. Based on the document type, the method defines a set of data dictionaries to extract any data from each digital document. The method uses the defined set of data dictionaries to extract any data from each digital document.

Disclosed in the present invention is an intelligent energy efficiency management system for an LNG dual-fuel powered trailing suction hopper dredger, comprising: an online intelligent LNG energy efficiency monitoring module, configured to collect energy efficiency key factor parameters of a main energy consumption device of the LNG dual-fuel powered trailing suction hopper dredger to form a unified LNG powered trailing suction hopper dredger energy efficiency data dictionary; an intelligent energy efficiency analysis and evaluation module, configured to construct, on the basis of the LNG powered trailing suction hopper dredger energy efficiency data dictionary, an operating condition identification model, an energy efficiency indicator calculation model, a carbon emission calculation model, an energy efficiency level model and a periodic energy efficiency analysis model to form an energy efficiency analysis and evaluation system; and a dredging operation energy efficiency auxiliary decision-making module, configured to construct an energy consumption prediction model for ten-thousand cubic meters of soil on the basis of soil type, design dredging depth, construction parameters and historical fuel consumption data, and recommending a dredging construction operation parameter combination by means of an optimization algorithm. Also disclosed is an intelligent energy efficiency management method for an LNG dual-fuel powered trailing suction hopper dredger. The present invention increases the energy efficiency.

A system incorporates a platform for analysis of electronic files relating to an old insurance policy using computer protocols such as visual analytics tools to identify attributes of the insurance policy. A policy migration process automates typically complex custom migrations in a methodical workflow employing a simplified metrics-driven process. Layers of a data migration and policy transformation workflow include source policies layer, normalization layer, and target policies layer. The normalization layer includes an extraction, transformation, and loading (ETL) engine. The ETL engine inputs configuration files that incorporate mapping rules for mapping source policies to normalized values within a data dictionary. Systems of the disclosure incorporate built-in personas that cater migration features to a specific set of migration execution team roles such as policy edit and QA. A cloud-based policy migration model includes a UI for inputs by migration team members, and back end components including the ETL engine.

The invention discloses a structured data-oriented multi-source feature modeling and multi-granularity intelligent grading and classifying method, and belongs to the technical field of computers. The method comprises the following steps: inputting standardized data to be graded and classified into a currently trained coarse-grained classification model for classification; determining whether the to-be-graded and classified data is subjected to manual auditing or is not subjected to manual auditing; based on a predefined sensitive data dictionary and the final rough classification result, determining a classification result of the data to be graded and classified, and taking the classification result as a fine classification result; using the updated training sample set to perform enhancement training on the currently trained coarseness classification model, and updating the currently trained coarseness classification model based on an enhancement training result; and performing attribution analysis on the fine classification result. According to the method, a set of complete and efficient structured data multi-granularity intelligent grading classification is formed.

The invention relates to the technical field of gastrointestinal tumor chemotherapy risk assessment, and particularly discloses a gastrointestinal tumor chemotherapy risk scoring model and a construction method thereof, and the method comprises the steps: obtaining the individualized feature data and basic physiological data of a historical patient, and constructing an individualized difference library with a unique ID, and a core influence library; the method comprises the following steps: standardizing and coding double-library data, synchronizing clinical data containing treatment effect codes, forming a data dictionary, acquiring and coding current gastrointestinal tumor patient data, and matching the data dictionary to judge individual difference abnormity; when the first data set is abnormal, constructing a first data set, screening core independent variables through Logistic regression, and constructing a scoring model by using an LSTM (Long Short Term Memory) model; when no abnormity exists, redundant codes are removed to obtain a second data set, and modeling is conducted through the same method. Through double-library linkage and scene-divided modeling, the three-level toxicity risk prediction precision is improved, data support is provided for clinical chemotherapy dose adjustment and toxicity prevention, and the risk of excessive treatment or insufficient treatment is reduced.

The invention provides a database log analysis and recovery method and device, equipment, a medium and a program product, and relates to the field of data processing. Periodically generating a snapshot file of cache record data involved in a database log analysis process, and recording a snapshot identifier corresponding to the snapshot file; updating version information of a data dictionary, and binding the snapshot identifier with the version information of the data dictionary; when database log analysis is interrupted, matching corresponding target version information from the data dictionary according to a target snapshot identifier; recovering the state of the cache record data based on the target version information, and determining the initial position of database log analysis; according to the method, the snapshot file of the cache record data is periodically generated, and the snapshot identifier and the data dictionary version information are bound, so that the cache data state and the analysis starting position are quickly recovered based on the latest snapshot after the database log analysis is interrupted, and the fault tolerance and the recovery efficiency of log analysis are improved.

The invention relates to an enterprise data analysis method and device, and relates to the technical field of data governance, and the method comprises the steps: carrying out the Text2SQL task fine tuning of a large language model through a low-rank adaptation technology, constructing a structured knowledge base containing an enterprise data dictionary, a field calling relation and a national standard, converting the unstructured industry specification into a structured data standard knowledge base, and realizing knowledge vectorization storage by using an M3E-base vector model; sampling representative samples based on to-be-sorted data fields and retrieving related rules, integrating the representative samples into thinking chain cues, inputting the thinking chain cues into a fine tuning model to generate a labeling classification result, and outputting a data sorting result after multi-model evaluation and verification; generating a regular expression through a retrieval data standard to screen non-standard data, sampling to generate an SQL conversion code, iteratively cleaning until the standard is reached, and outputting standardized data; and finally, executing index optimization and anomaly detection based on the fine tuning model, and receiving natural language query to generate an SQL and a visual report.

The invention discloses a discrete manufacturing multi-view BOM dynamic derivation method and system based on a tree-shaped network structure, and belongs to the technical field of intelligent manufacturing and product data management. The method comprises the following steps: constructing a tree body as a single product data source, and storing a hierarchical relationship, attribute definition and engineering semantics of a product in a tree structure; based on the tree body, dynamically matching derivation rules through a mesh mapping relation library; executing rule matching, semantic verification, structure reconstruction and dictionary verification by utilizing a dynamic view derivation engine to generate a target BOM view; semantic constraint and verification are carried out on the derivation process through a BOM data dictionary module; and realizing access control and audit based on role, scene and data sensitivity through the security and authority control module. According to the method, a new generation of xBOM dynamic derivation architecture which takes a tree form as an ontology, takes a net form as mapping, is configurable in rule and is strong in data specification is constructed; the fundamental problem of discrete manufacturing multi-view BOM management is solved, and engineering rationality and service flexibility are both achieved.

The invention provides a model-based software development method and device, electronic equipment and a storage medium, and the method comprises the steps: determining whether a data dictionary cache file which corresponds to a target vehicle-mounted software model and is in a native storage format exists under a first cache address in response to an import instruction for the vehicle-mounted software model; if the target vehicle-mounted software model exists, mapping the data dictionary cache file in the native storage format to operate the target vehicle-mounted software model; and if the target vehicle-mounted software model does not exist, acquiring a data dictionary file which is in a general storage format and corresponds to the target vehicle-mounted software model under the second cache address, decompressing the data dictionary file, and performing data analysis and format conversion on a decompression result to operate the target vehicle-mounted software model. By generating the data dictionary cache file in the native storage format in the hard disk in advance and importing the data dictionary cache file into the working space, the data importing speed can be remarkably increased, the simulation running time of the vehicle-mounted software model is shortened, and the development efficiency of the vehicle-mounted software is improved.

The application discloses a kind of based on knowledge base data standard domain automatic generation method and system, it is related to data standard domain generation technical field, method includes: obtaining data dictionary field, retrieve matching candidate standard item from knowledge base and build standard item evidence package containing semantic matching score and evidence source type;Candidate standard item is mapped to standard domain, domain support is calculated and is eliminated by evidence unit exclusion allocation to eliminate shared evidence, and the initial domain distribution of revised domain support is obtained, according to which the initial mode of single domain or multi-domain mode is judged;Calibration is carried out based on domain constraint image, domain change cost coefficient and uncertainty penalty coefficient are generated adaptively according to determination score and conflict score, score function is constructed, refined candidate domain set is filtered out according to initial mode and distribution is reorganized, post-calibration and backflow determination are carried out, and finally single-domain or multi-domain standard domain result is output;The application improves the accuracy and automation degree of data standard domain generation.

The application discloses a host system security emergency response method and device, equipment and medium, and relates to the technical field of network security. The method comprises the following steps: receiving attack trace encrypted data packets; the attack trace encrypted data packets are obtained by performing format conversion and encryption compression on target collected data through a local portable collection program of a target host; the target collected data are obtained by performing attack trace extraction in an offline or online manner based on a preset attack trace collection knowledge graph through the portable collection program; after the attack trace encrypted data packets are decrypted, data cleaning and formatting are performed to obtain attack trace data dictionaries; a preset data analysis model is used to identify security abnormal behaviors according to the attack trace data dictionaries, and an attack behavior relationship graph is obtained by reconstructing an attack chain timeline; the preset data analysis model comprises a preset rule engine and a preset large language model reasoning engine; and a security analysis report is generated based on the attack behavior relationship graph, so that security emergency response operations can be performed.

The application relates to the technical field of databases and digital medical treatment, and provides a metadata-based database DDL updating method, device, equipment and medium. The method comprises the following steps: generating a metadata dictionary in response to a metadata configuration instruction, the metadata dictionary being used for indicating the corresponding relationship between a source end and each database; generating a routing file of a target database based on the metadata dictionary in response to an updating request for the target database; acquiring the table structure of the target database and the table structure of the source end according to the routing file; comparing the difference between the table structure of the target database and the table structure of the source end; and updating the DDL statement of the target database according to the difference. The method provided by the application can quickly and automatically locate the corresponding database, reduces human intervention, and thus improves the DDL updating efficiency of each database.

This disclosure provides a hot data push system and method. The hot data push system includes: a data acquisition module configured to acquire data generated by an external device; a data identification module configured to receive the acquired data and identify the acquired data according to a hot data dictionary; a hot data push module configured to receive the identified hot data and push it; and a data reading node configured to cache the pushed hot data and update the pushed hot data to the data cache dictionary.

The application discloses a marine product inspection digital application system and method based on a lightweight database and a configurable interface, an electronic device and a medium. The method can include: an enterprise user runs a client, initiates enterprise authentication to a CA authentication; after the client is authenticated, the enterprise's product basic data, inspection item list and corresponding data dictionary configuration are automatically obtained from the server end; the enterprise user applies for product inspection on the client; the client automatically assembles the locally stored structured data into a message conforming to the interface specification according to the data dictionary configuration, and submits it to the server through the CA authentication channel; after the inspection is completed on the server, the product certificate is sent to the client of the enterprise and stored locally. The application integrates a lightweight database, a configurable interface and a secure authentication mechanism, realizes seamless connection of enterprise and classification society data, guarantees data quality and safety, and implements marine product inspection digital specification.

This application discloses an automatic code generation method and system for SOME / IP data types, relating to the field of vehicle system development. The method includes: S1, data dictionary reading: obtaining the data dictionary for SOME / IP protocol communication; S2, data type classification, identification, and processing: opening the Excel file from step S1, classifying each row of data in the worksheet, and performing specific parsing processing for different types; S3, multi-round iterative dependency resolution: using a multi-round scanning strategy to resolve nested dependencies between various data types; S4, naming standardization processing: standardizing the names of each parsed data type according to preset naming rules; S5, standard code generation and output: converting all data types that have undergone naming standardization processing into type definition code conforming to C language specifications; simultaneously converting the value range, precision, unit, and Chinese description metadata in the data dictionary of the Excel file into code comments, generating a C language header file that can be included in the compilation project.

The invention discloses a data dictionary name intelligent standardization method based on natural language generation, which relates to the technical field of natural language processing, combines a deep reinforcement learning technology, analyzes input context information through a generation model, generates candidate terms, and compares the candidate terms with predefined standardized terms to obtain a data dictionary name intelligent standardization result. Three reward mechanisms including precision reward, recall reward and context consistency reward are adopted, and through the comprehensive action of the three mechanisms, the generation model continuously optimizes the strategy and adjusts the generation process, so that more accurate term generation is realized. The method can flexibly adapt to terms in the emerging field, the standardization of the terms is ensured by automatically adjusting the generation strategy, and particularly, the efficiency and accuracy of term generation can be effectively improved in the technical field of constantly changing and updating of the terms, so that the requirement of rapid change is met.

The invention discloses an information management net value mail cleaning and analyzing method and system based on a large model, and the method comprises the steps: obtaining a mail of a user mailbox, and extracting and storing the metadata of the mail; performing multiple identification on the mails based on a large model, confirming net value mails, and excluding non-net value mails; aiming at net value mail contents in different formats, adopting a corresponding extraction mode and carrying out data verification; standardizing the extracted net value data according to a preset term mapping table and a standardized data dictionary; performing automatic analysis based on the net value data after standardization processing; and carrying out visual display on the analysis result. According to the method, automatic identification and acquisition of net value mails are realized, net value data in mails in different formats can be extracted and automatically analyzed, and analysis results such as income trend and risk assessment are generated in real time. The method solves the problems that in the prior art, the efficiency of obtaining and analyzing the net value data in the asset management mail is low, errors are prone to occurring, format adaptation is difficult, and a dynamic analysis result is difficult to generate in time.

The invention discloses a quantum computing experiment remote control method and device, and a related system and equipment. The method comprises the following steps: establishing communication connection with quantum experimental equipment based on connection parameters provided by a user; loading a corresponding experiment code template according to the experiment type, loading a code block related to the experiment type into the experiment code template, and instantiating a parameter class and an experiment class in the template; obtaining experiment parameters configured by a user based on the experiment instance and the parameter instance, and generating an experiment scheme; based on the execution instruction, extracting experiment parameters from the experiment scheme, generating a structured parameter dictionary, adding connection parameters, packaging into a specified message format, and sending the message format to the quantum experiment equipment; and analyzing the experimental result data dictionary returned by the quantum experimental equipment and then displaying the analyzed experimental result data dictionary to a user. Unified management and control of quantum experiments can be achieved, the method is suitable for various types of quantum experiments, independent development is not needed, various types of experiment schemes can be conveniently generated, expansion is convenient, and applicability is high.

The invention relates to an automatic driving perception data processing method, device and system and a vehicle, and the method comprises the steps: obtaining a data file of at least one automatic driving task, and recording perception annotation data and perception image data in the data file; based on the data file of the at least one automatic driving task, dictionary data of the at least one automatic driving task is established, and the dictionary data indicates summarized data feature values of the corresponding automatic driving tasks; based on the dictionary data and the data file, a report file is generated, the report file comprises at least one task record, and the task records are in one-to-one correspondence with the automatic driving tasks. The dictionary data is established for the data file, the summarized data type of each automatic driving task can be quickly obtained, the report file is generated by utilizing the dictionary data and the data file, the data of different files can be summarized into the report file in a unified format according to the automatic driving tasks, the data summarizing efficiency can be improved, and the data summarizing efficiency is improved. And the report error rate is reduced.

The application relates to the technical field of medical image database, and discloses a standardized cervical cancer pathological image database construction method, which comprises the following steps: step 1, specimen number is hashed to obtain pseudo-anonymous specimen number, unique slice identification and cell-level unique identification are generated; step 2, a unified reference system is established, the reference layer pixel spacing, the down-sampling multiple and the coordinate mapping are determined; step 3, the image is converted into an optical density space and normalized according to a target staining base to obtain a standardized image; step 4, cross-modal anchor point lists are established by manually comparing cytological and histological images; step 5, a hierarchical label set is generated by synthesizing multi-level unique labels according to the severity full sequence; step 6, the intersection-over-union index and the kappa consistency value are calculated according to the combination key, and a review to-do list is generated; step 7, point review and rule revision are carried out, and a data dictionary, a consistency report and an anchor point snapshot are output. The application realizes the standardized database construction and traceable quality control of cervical cancer cytological and histological pathological images.

The application relates to a low-code visual optimization method and system for power signal creation development, which comprises the following steps: S1: acquiring data in a signal creation environment, identifying interface differences and performance bottleneck points among various components through a compatibility test matrix, and establishing a standardized adaptive interface specification; S2: acquiring a standardized business object model based on the standardized adaptive interface specification; defining the attributes, relationships and constraint rules of various business entities based on the business object model, forming a data dictionary and an interface specification special for the power field; S3: constructing a power visual field-specific language DSL based on the data dictionary and the interface specification special for the power field; S4: converting the visual operation into a DSL configuration file by adopting a drag-and-drop interactive design; and S5: automatically converting the DSL configuration into a React or Vue component code by a code generation engine, and performing compatibility optimization on a signal creation browser kernel. The application effectively improves the power signal creation development efficiency.

The application discloses a table space moving method, device and equipment and a storage medium. The method comprises the following steps: obtaining a table space moving statement input by a user, wherein the table space moving statement is a database statement for moving a target table to a target table space; constructing an intermediate table according to the target table in the target table space, wherein the intermediate table has the same definition as a dependent object of the target table, and the intermediate table has the same structure as the target table; performing data dictionary exchange on the target table and the intermediate table; and migrating data in the intermediate table after the data dictionary exchange to the target table after the data dictionary exchange. Through the technical scheme, the efficiency of table space moving can be improved, and the complexity of table space moving can be reduced.

This application discloses a data classification and grading method, apparatus, device, and storage medium based on knowledge accumulation, relating to the field of data security governance. The method includes: acquiring data to be classified and graded; classifying and grading the data using a dictionary matching method based on a historical data dictionary and a manual method to obtain a first classification and grading result and a second classification and grading result, and merging them to obtain a third classification and grading result; processing the second classification and grading result and the data to be classified and graded based on a preset classification and grading rule generation specification to obtain a first classification and grading rule; updating the historical data dictionary based on preset data dictionary maintenance rules and the first classification and grading rule to obtain the current output data dictionary, and constructing a conflict data dictionary; updating the third classification and grading result based on the conflict data dictionary to obtain the final classification and grading result. In this way, this application can reuse and update the data dictionary manually, avoiding the waste of manpower.

The application discloses a parallel migration method and device based on data management and readable medium, obtains a source table according to a source database, the source table includes table information and field information; constructs a knowledge base, the knowledge base includes a dictionary and basic data, the dictionary includes source fields in the source table and corresponding source code values and standard fields and corresponding standard code values which are mapped therewith; a plurality of source tables are summarized to the same standard table through data matching, the standard table is subjected to table-level processing and field-level processing, and a processed standard table is obtained; data in the plurality of processed standard tables is distributed, a target table is obtained, and is stored in a target database. Information synchronization is performed through source table definition, storage definition, matching mapping, dictionary mapping, relationship backfilling, deduplication rules, filtering rules, format conversion, self-defined function processing and distribution mapping and the like, a repeated management process is omitted, and data is quickly output.

The invention discloses a brake test bench data analysis system and method. The brake test bench data analysis system comprises a data import module, a data processing module, a visual display module, a test data management module and a system management module. The data import module is used for importing a test data file of the brake test bed and executing three-step import operation: selecting a test name, setting data starting and ending time and confirming point location information; the data processing module is used for carrying out vehicle group sorting, inflection point identification and parameter calculation on imported data; the visual display module is used for displaying data through a curve diagram and a scatter diagram; the test data management module is used for newly adding, editing, deleting, checking, searching and exporting test data; and the system management module is used for user management, role authority, data dictionary, parameter configuration, data security and performance optimization. The data import module supports import of multiple data formats, the problem that a traditional format is single is solved, and data import flexibility is improved.

The invention discloses a building physical fuzzy query method based on a large language model and a medium. The method comprises the following steps: acquiring a current to-be-queried user problem in real time in a building physical fuzzy query system, and analyzing the current to-be-queried user problem to obtain an analysis result of the current to-be-queried user problem; through a multi-type hierarchical fuzzy matching method, comparing the problem analysis result of the current to-be-queried user to generate current matching query key information; inputting the current matching query key information into a pre-constructed building data dictionary knowledge graph and a building physical vector database, and generating a current information fusion candidate answer; and verifying the current information fusion candidate answer through a large language model answer matching degree verification method, and if the verification is passed, obtaining a target fuzzy query answer. The problems of low query efficiency and incompleteness caused by lack of a fuzzy query mechanism for building physical system characteristics are solved, and the building physical fuzzy query efficiency and accuracy are improved.

Techniques herein use in-memory column vectors to process data that is external to a database management system (DBMS) and logically join the external data with data that is native to the DBMS. In an embodiment, a computer maintains a data dictionary for native data that is durably stored in an DBMS and external data that is not durably stored in the DBMS. From a client through a connection to the DBMS, the computer receives a query. The computer loads the external data into an in-memory column vector that resides in random access memory of the DBMS. Based on the query and the data dictionary, the DBMS executes a data join of the in-memory column vector with the native data. To the client through said connection, the computer returns results of the query based on the data join.

The application discloses a data compression method and device, electronic equipment and a readable storage medium, and belongs to the technical field of data processing. The method comprises the following steps: acquiring N data records, each data record comprising a plurality of field values, each field value corresponding to a field; constructing a data dictionary according to the repetition frequency of the field values corresponding to the same field in the N data records, wherein the data dictionary stores the field values of each field that are not repeated; determining the position index of each field value of each data record in the data dictionary, and converting each field value of each data record into a corresponding position index to obtain a position index record corresponding to each data record; and storing the data dictionary and the position index record corresponding to each data record. The scheme provided by the application can solve the problems of high calculation complexity and low compression efficiency of the existing compression technology.

Systems and methods for a multi-tenant parser generation platform. A human-readable document of a data provider system is accessed. The document includes a data dictionary table for opaque data of the data provider system that has a first type. Data dictionary information of the data dictionary table is extracted, and a schema file is generated from the extracted information. The schema file defines a parsing process for parsing an opaque data record of the first. The first schema file specifies each field of the opaque data record of the first type. Parsing instructions are generated based on the schema file. The parsing instructions are for parsing an opaque data record of the first type provided by the data provider system into a set of data fields. The parsing instructions are provided to an entity system external to the platform. The first entity system is associated with a first platform account.