133results about "Semi-structured data indexing" patented technology

The invention provides a vehicle active service system based on an end-side multi-modal large model and a dynamic reasoning method thereof, and belongs to the field of Internet of Vehicles, and the system comprises a multi-modal data collection module which collects multi-modal perception data of a vehicle; the multi-modal large model processing unit is used for carrying out feature extraction on the multi-modal sensing data to obtain features of different modals; the cross-modal attention fusion module is used for converting the feature data of different modals into a query, key and value triple and fusing the query, key and value triple to obtain fused features; the MCP dynamic reasoning controller is used for carrying out preliminary judgment on a vehicle scene based on the fusion features, collecting specific parameter data when further confirmation is needed, and generating an active service decision in combination with a user portrait and historical behavior data; and the active service execution module is used for generating a vehicle-mounted equipment control instruction and executing active service operation. According to the invention, real-time response and intelligent decision-making of vehicle-mounted active services are realized through an end-side multi-modal large model and an MCP dynamic reasoning protocol.

The invention provides an authentication document form generation method and system, and relates to the technical field of data processing, and the method comprises the steps: obtaining an authentication document; converting the authentication document into an XML (Extensible Markup Language) file so as to map authentication document data to an XML tree node of the XML file; standardizing the XML file through the global unique identifier and the tag system to obtain a standardized XML file; in combination with the standardized XML file, template candidate items conforming to different manageable data templates in the authentication document are extracted respectively; in combination with the template candidate item, mapping the authentication document to a target form; and establishing a bidirectional mapping relationship between the target form and the authentication document to realize bidirectional conversion between the target form and the authentication document and complete the form processing of the authentication document. Through establishment of the bidirectional mapping relation, synchronous updating of the form and the document content can be achieved, errors caused by manual operation are avoided, and automation, accuracy and practicability of document conversion are remarkably improved.

A system receives a free text description of functionality desired for an application. The system creates first prompt including the free text description and a first request for a set of recommended components for the application. The system inputs the first prompt to a first generative language model and receives, as output, the set of recommended components for the application. The system generates a set of pages for at least a subset of the set of recommended components using a second generative language model. The system generates a schema for each page, where schema a defines a structure for storing data related to the respective page. The system determines a set of resources to include in each page. The system generates the application with the pages, the schemas, and the resources and provides access to the application to a client device.

A structured document storage format is provided in which tokens used for encoding and decoding are contained within the encoded document in an inline dictionary. Each document is encoded independently, and there is no central dependency or any dependency on other documents during DML and query execution. Each encoded document has all information with it on disk so that the document can be independently shared, decoded, or distributed. A mechanism is provided for quickly determining a mapping between tags and tokens without having to scan the entire inline token dictionary for each document. This allows the database system to process multiple documents, each having its own inline token dictionary, without having to fully scan the inline dictionary of every document for each tag that referenced in an operation.

The invention discloses a multi-type XML (Extensible Markup Language) equipment data processing method and device based on Netty. The method comprises the following steps: constructing a TCP long connection server through a Netty framework to receive a device coding data message; decoding and decompressing the message to obtain XML format data; analyzing the XML data to extract a type identification field; routing the data to a corresponding service processing strategy according to the type identification field; packaging the data into a processing task, and delivering the processing task to a corresponding thread pool for asynchronous processing based on the priority; and finally, converting the processed data into a unified data structure and storing the unified data structure in a database. High-concurrency receiving and processing of equipment data are achieved, multi-type XML message analysis is supported through dynamic routing, key data processing timeliness is guaranteed based on priority scheduling, the data processing throughput is improved by adopting an asynchronous mechanism, and high-concurrency receiving and processing of equipment data are achieved through a unified data conversion standard storage structure. And the efficiency, the real-time performance and the expandability of data processing are remarkably improved.

A computer-implemented method of predicting, simulating, or forecasting values of one or more specified subject-related attributes during a clinical trial comprises: receiving input data comprising: a medical history of a subject, the medical history comprising values of a plurality of subject-related attributes of a subject; and data specifying a requested output, the data comprising: the one or more specified subject-related attributes of the subject and a time frame; and applying a trained generative machine-learning model to the received input data, the trained generative machine-learning model configured to generate output data based on the input data, the output data comprising: respective values of the one or more specified subject-related attributes of the subject in the specified time frame.

Methods, systems, and apparatuses are configured to generate new industrial asset models that can be efficiently queried. The new industrial asset models can be tailored to specific users and represented in an RDF knowledge graph. In particular, the RDF graph can define variables that correspond to OPC variables. The RDF knowledge graph queried via a query that is compliant with a GraphQL API.

The invention discloses an index chain construction method based on an RAG framework, which relates to the technical field of document processing, and comprises the following steps: receiving and analyzing different types of documents; uniformly converting the content into a Markdown format through an OCR (Optical Character Recognition) model, a layout recognition model and a table recognition model; segmenting the Markdown format document into a plurality of chunks, ensuring that a title and a text are logically coherent by utilizing a semantic analysis technology, and independently extracting a table to generate a natural language abstract; performing semantic analysis on each chunk by using a language model, extracting a high-dimensional semantic vector, processing an overlong text through a sliding window, and endowing a title vector with a higher weight to form a knowledge path; for chunk with less content, an adjacent block merging strategy is adopted to optimize a vectorization effect; and creating an index by adopting a cosine similarity method. According to the index chain construction method based on the RAG framework, the problem that in the prior art, the information processing accuracy of unstructured or semi-structured documents is low is solved, and the processing accuracy of the unstructured or semi-structured documents can be improved.

A method (300) of storing semi-structured data (12U) includes receiving user data (12) comprising semi-structured user data from a user (10) of a query system (150). The method includes receiving an indication (14) that the semi-structured user data fails to include a fixed schema. In response, the method further includes parsing the semi-structured user data into a plurality of data paths (210) and extracting a data type (220) associated with each respective data path of the plurality of data paths. The method additionally includes storing the semi-structured user data as a row entry in a table (204) of a database in communication with the query system, wherein each column value associated with the row entry corresponds to a respective one of the plurality of data paths and the data type associated with the respective data path.

The application discloses a database analysis and index optimization method for semi-structured data of signal intelligence, which comprises the following steps: creating at least one physical column for storing parsed data in a database table storing original semi-structured data fields; creating a trigger configured to be activated before inserting or updating a data row into the database table; when the trigger is activated, automatically parsing target data from the semi-structured data field of the data row to be inserted or updated according to a predefined path and writing the target data into the physical column corresponding to the same data row; and creating a database index based on the data in the physical column. The system is used for executing the method. The application realizes the improvement of query performance by automatically and real-timely parsing key fields of semi-structured data into structured columns and establishing indexes in the database, and guarantees zero modification of application layer code, data strong consistency and automation of data processing procedures.

The application provides a power equipment wiring diagram data display method, device and storage medium. The method comprises the following steps: selecting a current data updating mode from a plurality of preset data updating modes; when a trigger condition required by the current data updating mode is met, updating an initialization xml file according to measurement point data, so as to display a graph element corresponding to the measurement point data in a browser. According to the embodiment of the application, when the trigger condition required by the current data updating mode is met, the initialization xml file can be updated according to the measurement point data, so as to display the graph element of different shapes and colors corresponding to the measurement point data in the browser. In addition, the graph element type can be customized according to requirements, and the display mode is flexible.

Processing structured data to improve the accuracy of generative models. [Solution] The structured data processing method is characterized by including an acquisition step of acquiring a document, a conversion step of converting the acquired document into structured data, a formatting step of shaping the converted structured data into data that can be read by a generative model, and an output step of outputting the formatted structured data. For example, if the structured data includes image data, the conversion step incorporates text data converted by OCR processing into the structured data.

Among other things, we describe a method of receiving a portion of metadata from a data source, the portion of metadata describing nodes and edges; generating instances of a data structure representing the portion of metadata, at least one instance of the data structure including an identification value that identifies a corresponding node, one or more property values representing respective properties of the corresponding node, and one or more pointers to respective identification values, each pointer representing an edge associated with a node identified by the corresponding respective identification value; storing the instances of the data structure in random access memory; receiving a query that includes an identification of at least one particular element of data; and using at least one instance of the data structure to cause a display of a computer system to display a representation of lineage of the particular element of data.

The application provides a construction method of an IEC61850 GOOSE protocol dictionary and a protocol feature library, and the dictionary construction comprises the following steps: step A1, using an XML label to represent a protocol field; step A2, taking the label representing the protocol field as element content of a Protocol label, and taking the formed XML file as a protocol dictionary; the feature library construction comprises the following steps: step B1, generating a protocol field table according to the protocol dictionary; step B2, defining multiple function functions according to the characteristics of the protocol field, and constructing a function function table; step B3, constructing protocol features from multiple angles in combination with the field table and the function function table, and using feature rules to represent the protocol features, and then storing the feature rules corresponding to the protocol features into different protocol feature rule tables; and step B4, constructing the protocol feature library based on the protocol field table, the function function table and the protocol feature rule table; the application provides a protocol feature extraction scheme of the IEC61850 GOOSE, and provides a unified protocol feature representation method.

The invention discloses a structural circuit integrated manufacturing-oriented H-AMF multi-material model digital expression method, a storage medium and equipment, and the method comprises the steps: constructing a file header based on an XML architecture, defining a metadata region and a resource region of a structural circuit integrated model in the file header, and building a material library definition in the resource region; a compact ASCII data block is constructed in the XML architecture to serve as a unified geometric object area, and is used for storing vertexes and triangular patches of the structural circuit integrated model; introducing a vertex deduplication algorithm based on a hash table, and performing deduplication on vertexes of the unified geometric object area to obtain an index database; when the triangular patches are generated, reading a file header based on the XML architecture, obtaining material IDs corresponding to the triangular patches, and binding each triangular patch in the index database with the corresponding material ID; and writing the metadata area, the resource area and the index database of the structural circuit integrated model and the index database bound with the material ID into a disk, generating an H-AMF file, and realizing digital expression of the structural circuit integrated model.

The invention relates to the technical field of aviation, in particular to an order data creation, query and modification method and device, and the method comprises the steps: receiving data information of an order created by a passenger for the first time; generating order data in an XML format containing the SPNRID by using the data information of the order created for the first time; the method comprises the following steps: splitting order data in an XML format into a plurality of XML node fragments taking SPNRID as a primary key according to business meanings; each XML node segment with the SPNRID as the primary key is stored in an XML DATA field of a CLOB type of a specified data table, and each data table takes the SPNRID as the primary key. The super passenger reservation record SPNR is created by using a standardized XML format, the SPNR is split and then stored in each database table, a data table does not need to be newly added in a database along with the increase of order types, a field does not need to be independently added for each piece of new order information, the design of the database is simplified, and the efficiency is improved. And the complexity and the coupling degree of the system are greatly reduced, so that the maintenance of the system is simpler and more convenient.

The application discloses a method and device for editing an XML file, electronic equipment and a storage medium, and relates to the technical field of computers. The method comprises the following steps: obtaining an original XML file to be edited; using a parser to parse a data stream of the original XML file, and obtaining a start position and an end position of a target storage unit related to a line record to be edited; sequentially reading the data stream of the original XML file in units of storage units, and judging whether the read storage unit is the target storage unit; if yes, performing the following operation: writing information in the target storage unit into a preset editable storage unit; editing the line record to be edited in the editable storage unit according to an editing requirement for the line record to be edited, forming an edited storage unit, and writing back the edited storage unit. In this way, the problems of memory overflow and long editing and saving time caused by editing an XML file are solved.

A computer system includes multiple data sources each configured to store different data for a portion of a distributed workflow integrated application, a data modeling engine, and processor hardware configured to execute instructions to define a standard data model, the standard data model configured to support a workflow, obtain access details for obtaining data from the multiple data sources, set up the data modeling engine to connect to the multiple data sources, based on the obtained access details, prepare a configuration table to return a list of the multiple data sources used in the workflow and an execution order of the multiple data sources, collect, by the data modeling engine, data from the multiple data sources, and prepare a data object using the standard data model and the data collected from the multiple data sources.

The present application relates to nuclear power engineering drawing semi-structured and search method, device and electronic equipment, including: the drawing to be processed is detected, and the symbol, identification and position information of all objects in the drawing are obtained; the figure text association is carried out; the identification of the figure text association is identified, and the text content of the identification is obtained; the type of the object is determined; the text content is compiled to generate the function position code of the object; the data table is formed based on the text content, the object type, the position information, the function position code and the drawing number of the drawing to be processed; the link relationship of the data table and the drawing, the link relationship of the data entry and the object in the drawing page are constructed, and the semi-structured of the drawing to be processed is completed. The present application greatly reduces the labor cost of engineering drawing data extraction; greatly improves the efficiency and quality of engineering drawing data extraction; also can realize the second search and second determination of the drawing, and effectively improves the efficiency and accuracy of the use of engineering drawing in the business field.

The embodiment of the invention provides a data table evaluation method and device, computer equipment and a storage medium, and relates to the technical field of data management. The method comprises the following steps: acquiring a first data table, a vector database and at least one standard field information of an enterprise; effective metadata in the first data table is subjected to HTML (HyperText Markup Language) tagging processing, a reference text field is obtained, and the reference text field comprises a table name, a field name and classification; converting the reference text field into a first vector; and based on the first vector, the vector database and the at least one standard field information, determining an evaluation result of the first data table, the evaluation result being used for indicating whether the first data table meets the evaluation requirements of the enterprise. By adopting the technical scheme provided by the embodiment of the invention, the evaluation accuracy of the data table can be improved.

The invention discloses a compressed XML database type, system and method supporting efficient query, and relates to the technical field of XML databases, and the database type adopts a hierarchical compression storage architecture and a reverse search query architecture; in the storage stage, XML non-keyword information is coded through Huffman coding, recoverable ordered arrangement is carried out on the coded information through a tree structure, then transcoding is carried out, the information is stored in a disk in a binary form, and compared with a traditional XML database storage mode, at least 50% of storage space is saved. In the query stage, a reverse search mode is adopted, a corresponding Huffman code initial position is positioned through a keyword, then under the optimization effect of a reverse index, reverse search is performed to recover a complete XML structure, and the query complexity is reduced from traditional O (n) to O (1). According to the method, the storage efficiency and the query performance of the XML data are greatly improved, and the method is suitable for large-scale XML data management and application scenes.

The invention discloses a marketing operation and maintenance monitoring visualization system based on a distributed architecture. The marketing operation and maintenance monitoring visualization system comprises a data acquisition module, a business mapping management module, a deployment management module, a load monitoring module and a business monitoring module, the data acquisition module is used for acquiring distributed architecture information of the marketing management system; the service mapping management module is used for carrying out association binding with a preset service process according to the distributed architecture information to obtain mapping relation information; the deployment management module is used for deploying a corresponding load monitoring program according to the distributed architecture information; the load monitoring module is used for acquiring load state data under current deployment through a monitoring program; the service monitoring module is used for predicting a service state according to the load state data and the mapping relation information; according to the invention, load and service state monitoring and prediction can be realized, abnormity can be sensed in advance, service fault reporting is avoided, and system stability is improved; and meanwhile, the architecture and the business process can be accurately associated, the system problem can be quickly positioned, the troubleshooting period is shortened, and the business continuity is guaranteed.

The application discloses a cigarette defect detection method and device, the cigarette defect detection method comprising: receiving a cigarette image collected by an industrial camera; identifying defects in the cigarette image based on a defect detection model to obtain a prediction box containing defect type and position information; converting information of the prediction box into an XML file and storing; digitally analyzing the XML file to obtain a defect value corresponding to the cigarette image; and evaluating the defect level of the cigarette image according to the defect value. The application uses an XML file to store the defect identification result, which not only retains important information of the original cigarette image, but also greatly reduces the storage space occupied by each cigarette image, effectively reducing the storage cost to a certain extent, so that the defect identification result of each cigarette image can be recorded, laying a foundation for full-sample monitoring of cigarette production. Meanwhile, the defect detection model is used for defect identification, which can improve the detection accuracy, adaptability and universality.

To generate logic from a schema, such as a database schema.SOLUTION: A method includes accessing a schema that specifies relationships among datasets (DSs), computations on the DSs, or transformations of the DSs, selecting a DS from among the DSs, and identifying, from the schema, other DSs that are related to the selected DS. Attributes of the DSs are identified, and logical data representing the identified attributes and relationships among the attributes is generated. The logical data is provided to a development environment, which provides access to portions of the logical data representing the identified attributes. A specification that specifies at least one of the identified attributes in performing an operation is received from the development environment. Based on the specification and the relationships among the identified attributes represented by the logical data, a computer program is generated to perform the operation by accessing, from storage, at least one DS having the at least one of the attributes specified in the specification.SELECTED DRAWING: Figure 1

The application provides a kind of unstructured data access method and device, scheme includes: receiving JSON format interface parameter data;Based on the JSON Schema mode definition of pre-configuration, data is format checked, and after checking, it is converted into JsonObject general data carrier;Based on the JsonPath path expression of pre-definition, field in carrier is addressed and read-write operation;The carrier after processing is converted into the document data of database interaction format, simultaneously, JsonPath expression is converted into the field key expression form required by database query command;Based on the field key expression form, database operation command is constructed and executed, and document data is stored or queried in database.

The invention relates to a batch satellite data archiving system based on a builder mode, and belongs to the technical field of remote sensing data management. The system comprises a data preprocessing module used for receiving and analyzing an archiving order, creating and initializing a data archiving object, and adding the data archiving object into an archiving queue; the producer module comprises a producer factory and a plurality of product producers created and managed by the producer factory, the producer factory is used for constructing different product producers for different satellite models and data types, and all the product producers inherit product producer abstract base classes and are endowed with unique identifiers; the product producer is used for executing verification and warehousing operation of the product; and the archiving result synchronization module is used for synchronizing the successfully stored product information to the database and each business system. According to the method, the construction process and the representation of the product are separated, so that the data processing flow is templated and modularized, and the expandability, the maintainability and the batch processing efficiency of the archiving system are remarkably improved.

An example may involve receiving a request to generate a user interface component, wherein the request indicates data usable to populate the user interface component; generating a prompt for a natural language model based on the request and the data; receiving, from the natural language model, a representation of the user interface component based on the prompt; and providing the representation of the user interface component for display.

The present disclosure relates to methods, non-transitory computer readable mediums (CRMs), and systems for the determination of similar information and text generation for auto-annotation of web documents. This disclosure discusses the use of sentence embedding vectors for the determination of similar information. Furthermore, this disclosure discusses the use of natural language processing techniques and deep learning for the generation of text for use within web browser viewable auto-annotations of content within web documents.

A framework for constructing an enterprise-specific knowledge base based on enterprise-specific data including structured data and unstructured data is provided. For each of a plurality of tuples included in the structured data, a relationship between entities that matches a known relationship is identified. Where possible, relationships between entities that match a known relationship are also identified for tuples included in the unstructured data. If a matching relationship between entities cannot be identified for a tuple in the unstructured data, the extracted relationships are sequentially clustered into similar relationships and the relationships are assigned to the clustered tuples. An enterprise-specific knowledge graph is constructed based on structured data tuples and their identified relationships, unstructured data tuples where relationships can be mapped to known relationships and their identified relationships, and unstructured data tuples that cannot be mapped to known relationships and their assigned relationships. The knowledge graph is enriched with any information determined to be missing from the knowledge graph.

The invention provides a lossless extraction method and device for a chart vector diagram in a PDF and a computer readable medium, and relates to the technical field of computers, in response to a chart vector diagram extraction request, obtaining target PDF data according to the chart vector diagram extraction request, and converting the target PDF data into target markup language data; acquiring position information of one or more target chart vector diagrams according to preset chart vector diagram labels in the target markup language data, confirming corresponding target candidate frame ranges according to the position information of the target chart vector diagrams, and performing statistics on the target candidate frame ranges to generate a candidate frame statistical table; calling and acquiring a target candidate frame range in the candidate frame statistical table, and selecting and performing lossless extraction on to-be-extracted chart vector diagram data according to the chart type of the target chart vector diagram to obtain final chart vector diagram data; and converting the markup language data corresponding to the final chart vector diagram data into a target chart vector diagram.