196results about "Semi-structured data indexing" patented technology

The invention provides a vehicle active service system based on an end-side multi-modal large model and a dynamic reasoning method thereof, and belongs to the field of Internet of Vehicles, and the system comprises a multi-modal data collection module which collects multi-modal perception data of a vehicle; the multi-modal large model processing unit is used for carrying out feature extraction on the multi-modal sensing data to obtain features of different modals; the cross-modal attention fusion module is used for converting the feature data of different modals into a query, key and value triple and fusing the query, key and value triple to obtain fused features; the MCP dynamic reasoning controller is used for carrying out preliminary judgment on a vehicle scene based on the fusion features, collecting specific parameter data when further confirmation is needed, and generating an active service decision in combination with a user portrait and historical behavior data; and the active service execution module is used for generating a vehicle-mounted equipment control instruction and executing active service operation. According to the invention, real-time response and intelligent decision-making of vehicle-mounted active services are realized through an end-side multi-modal large model and an MCP dynamic reasoning protocol.

The invention discloses an area-level distributed photovoltaic power station intelligent management method based on a cloud side end architecture, and the method comprises the steps: building a layered architecture: the layered architecture building comprises a sensing layer, a transmission layer, an edge calculation layer, a platform layer and an application layer, and relates to the technical field of energy management and information technology crossing. By deploying various high-precision sensors in the sensing layer, the equipment operation state and environmental factors are sensed comprehensively, and richer data can be obtained. In the aspect of equipment performance analysis, indexes such as average power generation efficiency and the like are calculated, multi-dimensional comparison is carried out by applying time sequence analysis and data normalization processing, and equipment performance abnormity can be found more timely and accurately.

The invention provides an authentication document form generation method and system, and relates to the technical field of data processing, and the method comprises the steps: obtaining an authentication document; converting the authentication document into an XML (Extensible Markup Language) file so as to map authentication document data to an XML tree node of the XML file; standardizing the XML file through the global unique identifier and the tag system to obtain a standardized XML file; in combination with the standardized XML file, template candidate items conforming to different manageable data templates in the authentication document are extracted respectively; in combination with the template candidate item, mapping the authentication document to a target form; and establishing a bidirectional mapping relationship between the target form and the authentication document to realize bidirectional conversion between the target form and the authentication document and complete the form processing of the authentication document. Through establishment of the bidirectional mapping relation, synchronous updating of the form and the document content can be achieved, errors caused by manual operation are avoided, and automation, accuracy and practicability of document conversion are remarkably improved.

The embodiment of the invention provides a vehicle multi-modal data management method and system, electronic equipment and a storage medium, and relates to the technical field of vehicle data management. The method comprises the following steps: adding a task identifier to acquired multi-modal data; dynamically adjusting a storage strategy based on the data type of the multi-modal data and storing the multi-modal data; and optimizing a storage strategy based on the task identifier and the use state of the multi-modal data. According to the method, automatic adjustment of the storage strategy is triggered according to the data use state, a data optimization closed loop is formed, and the problems that according to an existing method, storage is disordered, a storage medium is single, efficiency is low when data for model iteration and training is retrieved and inquired, and then the model iteration and training period is prolonged are solved.

Methods, systems, and computer-readable media for generating a secured hierarchical document are described herein. A hierarchical document is obtained and is processed to generate a secured hierarchical document. A security label is applied to each node in the hierarchical document. The secured hierarchical document is generated by cryptographically segregating the nodes according to the security label of each node. The secured hierarchical document comprises a plurality of encrypted layers. Each encrypted layer comprises at least a subset nodes associated with a respective security label and encrypted with a respective encryption key. The secured hierarchical document is stored to computer-readable memory. Methods, systems, and computer-readable media for searching a corpus of secured hierarchical documents indexed in an index as sensitive information by a computing entity trusted to have access to the sensitive information in the index are also described herein.

The invention belongs to the technical field of computer databases, and particularly relates to a database intelligent field extension method and device based on a JSON field type, and JSON provides a flexible semi-structured storage mode. For fields of different sources, especially those fields only having partial data sources unique, the fields can be selectively stored in JSON fields. Only under the condition of frequent use or business key, the data table field can be solidified into a formal data table field.

The present invention discloses a parameter control method under the QT framework, belonging to the technical field of information transmission and processing. The present invention includes a series of processing procedures such as defining the types and interfaces of function controls based on QT, implementing and forming a function control library, selecting function controls to form a local XML file, dynamically creating function controls to implement interface layout, performing message passing when the attributes of function controls change, and triggering the business logic of function controls. By using the signal and slot communication mechanism in QT, the present invention realizes the business requirements of controlling device parameters by applying various controls in different usage scenarios, and has good adaptability and scalability. The present invention has the advantages of cross-platform, easy expansion, strong reusability, etc., can significantly improve the efficiency of business design and development, and makes the man-machine interface for parameter control friendly, convenient, flexible and consistent.

A system receives a free text description of functionality desired for an application. The system creates first prompt including the free text description and a first request for a set of recommended components for the application. The system inputs the first prompt to a first generative language model and receives, as output, the set of recommended components for the application. The system generates a set of pages for at least a subset of the set of recommended components using a second generative language model. The system generates a schema for each page, where schema a defines a structure for storing data related to the respective page. The system determines a set of resources to include in each page. The system generates the application with the pages, the schemas, and the resources and provides access to the application to a client device.

A structured document storage format is provided in which tokens used for encoding and decoding are contained within the encoded document in an inline dictionary. Each document is encoded independently, and there is no central dependency or any dependency on other documents during DML and query execution. Each encoded document has all information with it on disk so that the document can be independently shared, decoded, or distributed. A mechanism is provided for quickly determining a mapping between tags and tokens without having to scan the entire inline token dictionary for each document. This allows the database system to process multiple documents, each having its own inline token dictionary, without having to fully scan the inline dictionary of every document for each tag that referenced in an operation.

The invention discloses a multi-type XML (Extensible Markup Language) equipment data processing method and device based on Netty. The method comprises the following steps: constructing a TCP long connection server through a Netty framework to receive a device coding data message; decoding and decompressing the message to obtain XML format data; analyzing the XML data to extract a type identification field; routing the data to a corresponding service processing strategy according to the type identification field; packaging the data into a processing task, and delivering the processing task to a corresponding thread pool for asynchronous processing based on the priority; and finally, converting the processed data into a unified data structure and storing the unified data structure in a database. High-concurrency receiving and processing of equipment data are achieved, multi-type XML message analysis is supported through dynamic routing, key data processing timeliness is guaranteed based on priority scheduling, the data processing throughput is improved by adopting an asynchronous mechanism, and high-concurrency receiving and processing of equipment data are achieved through a unified data conversion standard storage structure. And the efficiency, the real-time performance and the expandability of data processing are remarkably improved.

Techniques for processing a dataset comprising data stored in fields to identify field labels. The field labels describe data stored in the dataset fields. The techniques determine whether any field labels in a field label glossary match a field. If none of the field labels in the field label glossary match the field, the techniques generate a new field label using the name of the field. The generated field label may be assigned to the field.

One example described herein can involve a system that receives, from a user, a structured document that describes one or more conditions selected by the user to customize one or more electronic data structures. The system can also query a database to retrieve data from the database. The system can then execute an interpreter program, which can ingest the structured document and the data, identify a subset of the data that satisfies the condition(s), and generate the one or more electronic data structures based on the subset of the data. The electronic data structure(s) can include the identified subset of the data and exclude a remainder of the data. The system can compact the electronic data structure(s) by removing empty fields therein. The system can then provide the compacted data structure(s) to the user.

A computer-implemented method of predicting, simulating, or forecasting values of one or more specified subject-related attributes during a clinical trial comprises: receiving input data comprising: a medical history of a subject, the medical history comprising values of a plurality of subject-related attributes of a subject; and data specifying a requested output, the data comprising: the one or more specified subject-related attributes of the subject and a time frame; and applying a trained generative machine-learning model to the received input data, the trained generative machine-learning model configured to generate output data based on the input data, the output data comprising: respective values of the one or more specified subject-related attributes of the subject in the specified time frame.

Methods, systems, and apparatuses are configured to generate new industrial asset models that can be efficiently queried. The new industrial asset models can be tailored to specific users and represented in an RDF knowledge graph. In particular, the RDF graph can define variables that correspond to OPC variables. The RDF knowledge graph queried via a query that is compliant with a GraphQL API.

To provide a method, a computer readable medium, and a system for creating, organizing, viewing, and connecting annotations of web documents within annotation-enabled web browsers.SOLUTION: A method transmits an annotation highlighted text, an annotation comment, a uniform resource locator (URL), a document object model (DOM) context, a screenshot including a marked annotation highlighted text, and an annotation symbol to an annotation server.SELECTED DRAWING: Figure 14

The invention discloses an index chain construction method based on an RAG framework, which relates to the technical field of document processing, and comprises the following steps: receiving and analyzing different types of documents; uniformly converting the content into a Markdown format through an OCR (Optical Character Recognition) model, a layout recognition model and a table recognition model; segmenting the Markdown format document into a plurality of chunks, ensuring that a title and a text are logically coherent by utilizing a semantic analysis technology, and independently extracting a table to generate a natural language abstract; performing semantic analysis on each chunk by using a language model, extracting a high-dimensional semantic vector, processing an overlong text through a sliding window, and endowing a title vector with a higher weight to form a knowledge path; for chunk with less content, an adjacent block merging strategy is adopted to optimize a vectorization effect; and creating an index by adopting a cosine similarity method. According to the index chain construction method based on the RAG framework, the problem that in the prior art, the information processing accuracy of unstructured or semi-structured documents is low is solved, and the processing accuracy of the unstructured or semi-structured documents can be improved.

A method (300) of storing semi-structured data (12U) includes receiving user data (12) comprising semi-structured user data from a user (10) of a query system (150). The method includes receiving an indication (14) that the semi-structured user data fails to include a fixed schema. In response, the method further includes parsing the semi-structured user data into a plurality of data paths (210) and extracting a data type (220) associated with each respective data path of the plurality of data paths. The method additionally includes storing the semi-structured user data as a row entry in a table (204) of a database in communication with the query system, wherein each column value associated with the row entry corresponds to a respective one of the plurality of data paths and the data type associated with the respective data path.

The application discloses a database analysis and index optimization method for semi-structured data of signal intelligence, which comprises the following steps: creating at least one physical column for storing parsed data in a database table storing original semi-structured data fields; creating a trigger configured to be activated before inserting or updating a data row into the database table; when the trigger is activated, automatically parsing target data from the semi-structured data field of the data row to be inserted or updated according to a predefined path and writing the target data into the physical column corresponding to the same data row; and creating a database index based on the data in the physical column. The system is used for executing the method. The application realizes the improvement of query performance by automatically and real-timely parsing key fields of semi-structured data into structured columns and establishing indexes in the database, and guarantees zero modification of application layer code, data strong consistency and automation of data processing procedures.

The application provides a power equipment wiring diagram data display method, device and storage medium. The method comprises the following steps: selecting a current data updating mode from a plurality of preset data updating modes; when a trigger condition required by the current data updating mode is met, updating an initialization xml file according to measurement point data, so as to display a graph element corresponding to the measurement point data in a browser. According to the embodiment of the application, when the trigger condition required by the current data updating mode is met, the initialization xml file can be updated according to the measurement point data, so as to display the graph element of different shapes and colors corresponding to the measurement point data in the browser. In addition, the graph element type can be customized according to requirements, and the display mode is flexible.

Processing structured data to improve the accuracy of generative models. [Solution] The structured data processing method is characterized by including an acquisition step of acquiring a document, a conversion step of converting the acquired document into structured data, a formatting step of shaping the converted structured data into data that can be read by a generative model, and an output step of outputting the formatted structured data. For example, if the structured data includes image data, the conversion step incorporates text data converted by OCR processing into the structured data.

Among other things, we describe a method of receiving a portion of metadata from a data source, the portion of metadata describing nodes and edges; generating instances of a data structure representing the portion of metadata, at least one instance of the data structure including an identification value that identifies a corresponding node, one or more property values representing respective properties of the corresponding node, and one or more pointers to respective identification values, each pointer representing an edge associated with a node identified by the corresponding respective identification value; storing the instances of the data structure in random access memory; receiving a query that includes an identification of at least one particular element of data; and using at least one instance of the data structure to cause a display of a computer system to display a representation of lineage of the particular element of data.

A method and device for obtaining an XML path of a document element provided by the present disclosure can obtain the XML path relative to a target element through the unique attribute feature possessed by the target element, which can improve the reliability of the XML path of the document element, help improve the efficiency of testers in writing automated test cases, and thus ensure the correct execution of web-side automated testing.

The present invention relates to a high-performance data model access method and device based on a shared memory pool. The method primarily includes: applying for shared memory and mapping the shared memory to a fixed virtual address of a process; traversing XML to create a deduplicated symbol table and placing it in the shared memory; parsing the XML and converting it into a tree structure based on the shared memory pool to form an XML spanning tree; providing a data access interface and defining input parameters so that the input parameters can be used to search for corresponding memory nodes in the XML spanning tree, thereby reading and writing their contents. The present invention can be used to solve the problem of fast access to XML configuration data by multiple processes in a terminal device, reducing memory usage and improving access efficiency. It also addresses the use of pointers in shared memory and the dynamic allocation and release of space.

The application provides a construction method of an IEC61850 GOOSE protocol dictionary and a protocol feature library, and the dictionary construction comprises the following steps: step A1, using an XML label to represent a protocol field; step A2, taking the label representing the protocol field as element content of a Protocol label, and taking the formed XML file as a protocol dictionary; the feature library construction comprises the following steps: step B1, generating a protocol field table according to the protocol dictionary; step B2, defining multiple function functions according to the characteristics of the protocol field, and constructing a function function table; step B3, constructing protocol features from multiple angles in combination with the field table and the function function table, and using feature rules to represent the protocol features, and then storing the feature rules corresponding to the protocol features into different protocol feature rule tables; and step B4, constructing the protocol feature library based on the protocol field table, the function function table and the protocol feature rule table; the application provides a protocol feature extraction scheme of the IEC61850 GOOSE, and provides a unified protocol feature representation method.

The invention discloses a structural circuit integrated manufacturing-oriented H-AMF multi-material model digital expression method, a storage medium and equipment, and the method comprises the steps: constructing a file header based on an XML architecture, defining a metadata region and a resource region of a structural circuit integrated model in the file header, and building a material library definition in the resource region; a compact ASCII data block is constructed in the XML architecture to serve as a unified geometric object area, and is used for storing vertexes and triangular patches of the structural circuit integrated model; introducing a vertex deduplication algorithm based on a hash table, and performing deduplication on vertexes of the unified geometric object area to obtain an index database; when the triangular patches are generated, reading a file header based on the XML architecture, obtaining material IDs corresponding to the triangular patches, and binding each triangular patch in the index database with the corresponding material ID; and writing the metadata area, the resource area and the index database of the structural circuit integrated model and the index database bound with the material ID into a disk, generating an H-AMF file, and realizing digital expression of the structural circuit integrated model.

The invention provides a list data processing method and system based on distributed search and data analysis, and the method comprises the steps: S1, defining a list data transmission mode and a structural mode, carrying out the classification according to the source of data, setting a threshold value for an adaptive data transmission mode, and stipulating a list data file as a standard XML tag and a structured data file; s2, defining a list data transmission mode, and adapting a data transmission mode matched with a scene according to a list data source needing to be collected, a threshold value of single-batch collected data and a data structure form; s3, defining list data service modes, including online, offline and combination modes, and comprehensively covering list data consumption scenes; and S4, establishing structured data storage, establishing an index for a distributed search and data analysis engine, completing list data collection and unification, and responding to a service scene concurrent request. The method comprises the steps of access mode definition, transmission form standard definition, structured storage, index establishment / reconstruction, load balancing and data service.

The invention relates to the technical field of aviation, in particular to an order data creation, query and modification method and device, and the method comprises the steps: receiving data information of an order created by a passenger for the first time; generating order data in an XML format containing the SPNRID by using the data information of the order created for the first time; the method comprises the following steps: splitting order data in an XML format into a plurality of XML node fragments taking SPNRID as a primary key according to business meanings; each XML node segment with the SPNRID as the primary key is stored in an XML DATA field of a CLOB type of a specified data table, and each data table takes the SPNRID as the primary key. The super passenger reservation record SPNR is created by using a standardized XML format, the SPNR is split and then stored in each database table, a data table does not need to be newly added in a database along with the increase of order types, a field does not need to be independently added for each piece of new order information, the design of the database is simplified, and the efficiency is improved. And the complexity and the coupling degree of the system are greatly reduced, so that the maintenance of the system is simpler and more convenient.

Computer-readable media, methods, and systems are disclosed for validating data associated with schemas. A user defines the object model of at least one asset and a first schema is generated in accordance with the defined object model, and a unique fingerprint is generated. Data is collected from one or more devices in accordance with the object model. The collected data is serialized, and a second schema is generated. The second schema is ordered in accordance with the first schema and a unique fingerprint is generated. The fingerprint of the first schema is compared to the fingerprint of the second schema to provide an efficient review process for determining whether the schemas are equal, and the associated data may be validated. A fingerprint cache may be updated with fingerprints associated with a plurality of schemas, as well as version history of each schema, to provide an efficient review process.

The invention discloses a method for calculating machine readable digital uncertainty, which comprises the following steps of: constructing a data storage module for storing uncertainty operation description which comprises parameter input and calculation steps; reading the content of the data storage module, and verifying the content of the data storage module by using a predefined XML Schema file; analyzing all the input parameters, and unifying units of all the input parameters according to physical quantity types of the input parameters; taking the names of the input parameters after unit unification as indexes, and putting all the input parameters into a parameter dictionary; calling the parameter dictionary, and executing calculation steps in the uncertainty operation description in sequence to obtain an uncertainty calculation result; and the uncertainty calculation result is used as an output parameter to be stored in a data storage module. According to the method, data sharing and machine readability are realized through a unified format, meanwhile, the calculation efficiency of uncertainty is improved to a great extent, and the method has very high inclusiveness and flexibility.