247results about "Semi-structured data indexing" patented technology

The invention provides a vehicle active service system based on an end-side multi-modal large model and a dynamic reasoning method thereof, and belongs to the field of Internet of Vehicles, and the system comprises a multi-modal data collection module which collects multi-modal perception data of a vehicle; the multi-modal large model processing unit is used for carrying out feature extraction on the multi-modal sensing data to obtain features of different modals; the cross-modal attention fusion module is used for converting the feature data of different modals into a query, key and value triple and fusing the query, key and value triple to obtain fused features; the MCP dynamic reasoning controller is used for carrying out preliminary judgment on a vehicle scene based on the fusion features, collecting specific parameter data when further confirmation is needed, and generating an active service decision in combination with a user portrait and historical behavior data; and the active service execution module is used for generating a vehicle-mounted equipment control instruction and executing active service operation. According to the invention, real-time response and intelligent decision-making of vehicle-mounted active services are realized through an end-side multi-modal large model and an MCP dynamic reasoning protocol.

The invention discloses an area-level distributed photovoltaic power station intelligent management method based on a cloud side end architecture, and the method comprises the steps: building a layered architecture: the layered architecture building comprises a sensing layer, a transmission layer, an edge calculation layer, a platform layer and an application layer, and relates to the technical field of energy management and information technology crossing. By deploying various high-precision sensors in the sensing layer, the equipment operation state and environmental factors are sensed comprehensively, and richer data can be obtained. In the aspect of equipment performance analysis, indexes such as average power generation efficiency and the like are calculated, multi-dimensional comparison is carried out by applying time sequence analysis and data normalization processing, and equipment performance abnormity can be found more timely and accurately.

The invention belongs to the field of aircraft technical manual, and relates to a visual intelligent auxiliary interactive electronic technical manual development system and method. XML language is adopted to create and form a data module of a technical manual, and full-life-cycle management is carried out on the data module in a public source database. A public information base concept in the S1000D standard is comprehensively supported, an intelligent 3D virtual digital model, an intelligent fault information function and an AI auxiliary function are constructed, and reference is established by performing interactive browsing, click selection and automatic input on the intelligent 3D virtual digital model aiming at a large amount of public information which needs to be frequently and repeatedly referenced in a technical manual. Various data references in a public source database are established in an AI auxiliary function automatic acquisition and automatic input mode, fault information, fault phenomena and isolation step information can be structurally integrated in a data module creation project through an intelligent fault information function, and the display of the fault data through an intelligent 3D virtual digital model is supported.

The invention provides an authentication document form generation method and system, and relates to the technical field of data processing, and the method comprises the steps: obtaining an authentication document; converting the authentication document into an XML (Extensible Markup Language) file so as to map authentication document data to an XML tree node of the XML file; standardizing the XML file through the global unique identifier and the tag system to obtain a standardized XML file; in combination with the standardized XML file, template candidate items conforming to different manageable data templates in the authentication document are extracted respectively; in combination with the template candidate item, mapping the authentication document to a target form; and establishing a bidirectional mapping relationship between the target form and the authentication document to realize bidirectional conversion between the target form and the authentication document and complete the form processing of the authentication document. Through establishment of the bidirectional mapping relation, synchronous updating of the form and the document content can be achieved, errors caused by manual operation are avoided, and automation, accuracy and practicability of document conversion are remarkably improved.

A technical problem to be solved by the present invention is to provide a method for processing real-time accumulated data so as to rapidly search for a packet corresponding to a search condition from a large amount of data called a full packet. The method comprises: a network packet information reception step of acquiring at least one piece of information from flow information including 5-tuple information and package information including meta information, content information, threat detection information, asset information, URL information, and IP information; a step of generating a mapping table in which identification information of the package information and identification information of the flow information are indexed; and a step of generating data specialized for the flow information and storing, in a database, the data including the mapping table.

The invention discloses a semi-structured data compression storage method and device, equipment and a storage medium. Comprising the following steps: acquiring original semi-structured data, and analyzing the original semi-structured data to generate a mapping table; determining a data structure of the column storage file according to the mapping table, and creating header information of the column storage file according to the data structure; and compressing and storing the original semi-structured data into the column storage file based on the header information. By adopting the column storage and the specific compression mode, the value of the specific field can be read without decompressing the whole segment of data, so that the data reading efficiency is greatly improved. The reading inconvenience caused by integral compression is avoided, the data is more flexible and convenient to use, and the readability of the data is improved. The characteristics of the semi-structured data are fully utilized for compression, the compression effect better than that of a traditional general compression algorithm can be achieved, the storage space is saved, and the hardware and time cost of enterprises in the aspects of data storage and processing is reduced.

The embodiment of the invention provides a vehicle multi-modal data management method and system, electronic equipment and a storage medium, and relates to the technical field of vehicle data management. The method comprises the following steps: adding a task identifier to acquired multi-modal data; dynamically adjusting a storage strategy based on the data type of the multi-modal data and storing the multi-modal data; and optimizing a storage strategy based on the task identifier and the use state of the multi-modal data. According to the method, automatic adjustment of the storage strategy is triggered according to the data use state, a data optimization closed loop is formed, and the problems that according to an existing method, storage is disordered, a storage medium is single, efficiency is low when data for model iteration and training is retrieved and inquired, and then the model iteration and training period is prolonged are solved.

Methods, systems, and computer-readable media for generating a secured hierarchical document are described herein. A hierarchical document is obtained and is processed to generate a secured hierarchical document. A security label is applied to each node in the hierarchical document. The secured hierarchical document is generated by cryptographically segregating the nodes according to the security label of each node. The secured hierarchical document comprises a plurality of encrypted layers. Each encrypted layer comprises at least a subset nodes associated with a respective security label and encrypted with a respective encryption key. The secured hierarchical document is stored to computer-readable memory. Methods, systems, and computer-readable media for searching a corpus of secured hierarchical documents indexed in an index as sensitive information by a computing entity trusted to have access to the sensitive information in the index are also described herein.

The invention belongs to the technical field of computer databases, and particularly relates to a database intelligent field extension method and device based on a JSON field type, and JSON provides a flexible semi-structured storage mode. For fields of different sources, especially those fields only having partial data sources unique, the fields can be selectively stored in JSON fields. Only under the condition of frequent use or business key, the data table field can be solidified into a formal data table field.

The invention discloses a publication public information base using method and system, corresponding public information database tables are respectively created through public information types obtained through analysis, and then public information corresponding to the public information base types is respectively input based on the created public information database tables. And converting the public information stored in the public information database table into a corresponding XML file by referring to an XML file data structure to be referenced, storing the converted XML file into a corresponding public information base, and referencing the XML file in the public information base through a data referencing component to use the corresponding public information.

Intelligent indexing system and medical resource scheduling system using the intelligent indexing system. The invention belongs to the field of medical information technology, and specifically relates to the field of medical resource scheduling technology. It solves the technical problem that the existing intelligent indexing system cannot perfectly adapt to the high performance requirements of medical resource scheduling. The intelligent indexing system includes a data acquisition module, a big data storage module, a data processing and integration module, and an intelligent indexing construction module. The medical resource scheduling system using the intelligent indexing system includes a data acquisition and preprocessing module, an intelligent analysis and prediction module, a medical resource allocation module, an intelligent monitoring and optimization module, and a cross-machine collaboration and information sharing module.

The present invention discloses a parameter control method under the QT framework, belonging to the technical field of information transmission and processing. The present invention includes a series of processing procedures such as defining the types and interfaces of function controls based on QT, implementing and forming a function control library, selecting function controls to form a local XML file, dynamically creating function controls to implement interface layout, performing message passing when the attributes of function controls change, and triggering the business logic of function controls. By using the signal and slot communication mechanism in QT, the present invention realizes the business requirements of controlling device parameters by applying various controls in different usage scenarios, and has good adaptability and scalability. The present invention has the advantages of cross-platform, easy expansion, strong reusability, etc., can significantly improve the efficiency of business design and development, and makes the man-machine interface for parameter control friendly, convenient, flexible and consistent.

The invention discloses a foundation pit deformation risk assessment method based on monitoring data, and the method comprises the steps: collecting the monitoring data of a foundation pit construction site, and marking the risk levels; performing sample generation data expansion on the monitoring data by adopting a generative adversarial network of hysteresis decomposition; inputting the expanded monitoring data into a neural network of an adaptive wolf pack optimization algorithm for feature extraction model training; inputting the monitoring data after feature extraction into a mask enhanced self-encoding neural network for feature dimension reduction model training; inputting the monitoring data after dimension reduction training into a classifier model for training; and inputting new monitoring data into the trained feature extraction model, the feature dimension reduction model and the classifier model to obtain a classification result. According to the method, the problems that the data sample size is prior and the model generalization ability is weak in an existing foundation pit deformation risk assessment method are solved.

A system receives a free text description of functionality desired for an application. The system creates first prompt including the free text description and a first request for a set of recommended components for the application. The system inputs the first prompt to a first generative language model and receives, as output, the set of recommended components for the application. The system generates a set of pages for at least a subset of the set of recommended components using a second generative language model. The system generates a schema for each page, where schema a defines a structure for storing data related to the respective page. The system determines a set of resources to include in each page. The system generates the application with the pages, the schemas, and the resources and provides access to the application to a client device.

A structured document storage format is provided in which tokens used for encoding and decoding are contained within the encoded document in an inline dictionary. Each document is encoded independently, and there is no central dependency or any dependency on other documents during DML and query execution. Each encoded document has all information with it on disk so that the document can be independently shared, decoded, or distributed. A mechanism is provided for quickly determining a mapping between tags and tokens without having to scan the entire inline token dictionary for each document. This allows the database system to process multiple documents, each having its own inline token dictionary, without having to fully scan the inline dictionary of every document for each tag that referenced in an operation.

The invention discloses a multi-mode complex event detection and optimization method for semi-structured data, and relates to the field of data stream processing. According to the method, mode matching of the semi-structured data is realized by using a multi-mode normal tree. In order to enable a regular tree mode to be matched with a semi-structured data stream, the patent adopts a method of disassembling the regular tree mode into two parts, namely a tree mode and a regular mode, and realizing matching step by step. The tree mode designs a node relationship in which a user is interested into a logic tree, and a TwigList algorithm is used for matching data meeting conditions in a data stream and storing the data. The regular pattern defines a behavior sequence in which a user is interested, and state transition is realized by using NFA. And carrying out NFA processing on the data stream which is successfully matched with the tree pattern to obtain a final result.

The invention discloses a multi-type XML (Extensible Markup Language) equipment data processing method and device based on Netty. The method comprises the following steps: constructing a TCP long connection server through a Netty framework to receive a device coding data message; decoding and decompressing the message to obtain XML format data; analyzing the XML data to extract a type identification field; routing the data to a corresponding service processing strategy according to the type identification field; packaging the data into a processing task, and delivering the processing task to a corresponding thread pool for asynchronous processing based on the priority; and finally, converting the processed data into a unified data structure and storing the unified data structure in a database. High-concurrency receiving and processing of equipment data are achieved, multi-type XML message analysis is supported through dynamic routing, key data processing timeliness is guaranteed based on priority scheduling, the data processing throughput is improved by adopting an asynchronous mechanism, and high-concurrency receiving and processing of equipment data are achieved through a unified data conversion standard storage structure. And the efficiency, the real-time performance and the expandability of data processing are remarkably improved.

The invention discloses a fluid inclusion analysis method based on a big data structure. The method comprises the following steps: step 1, collecting a sample; step 2, data cleaning and arrangement; step 3, data processing and analysis; 4, identifying the position and morphological characteristics of the inclusion in the image by using YOLOv10; step 5, oil and gas filling period and paleo-pressure evolution analysis: step 5-1, data analysis and feature extraction; 5-2, the oil and gas charging period is recognized; 5-3, palaeopressure change curves of different oil and gas charging periods are drawn, the trend of palaeopressure change is captured, and the future pressure evolution trend is predicted; 5-4, according to the pressure evolution trend and the oil and gas filling period, an oil and gas favorable gathering area is deduced; and step 6, oil and gas accumulation time calibration. According to the method, a large amount of fluid inclusion data can be processed and analyzed, the data can be rapidly processed and analyzed, and the efficiency is improved on the premise that the analysis accuracy and reliability are guaranteed.

Techniques for processing a dataset comprising data stored in fields to identify field labels. The field labels describe data stored in the dataset fields. The techniques determine whether any field labels in a field label glossary match a field. If none of the field labels in the field label glossary match the field, the techniques generate a new field label using the name of the field. The generated field label may be assigned to the field.

One example described herein can involve a system that receives, from a user, a structured document that describes one or more conditions selected by the user to customize one or more electronic data structures. The system can also query a database to retrieve data from the database. The system can then execute an interpreter program, which can ingest the structured document and the data, identify a subset of the data that satisfies the condition(s), and generate the one or more electronic data structures based on the subset of the data. The electronic data structure(s) can include the identified subset of the data and exclude a remainder of the data. The system can compact the electronic data structure(s) by removing empty fields therein. The system can then provide the compacted data structure(s) to the user.

A computer-implemented method of predicting, simulating, or forecasting values of one or more specified subject-related attributes during a clinical trial comprises: receiving input data comprising: a medical history of a subject, the medical history comprising values of a plurality of subject-related attributes of a subject; and data specifying a requested output, the data comprising: the one or more specified subject-related attributes of the subject and a time frame; and applying a trained generative machine-learning model to the received input data, the trained generative machine-learning model configured to generate output data based on the input data, the output data comprising: respective values of the one or more specified subject-related attributes of the subject in the specified time frame.

Methods, systems, and apparatuses are configured to generate new industrial asset models that can be efficiently queried. The new industrial asset models can be tailored to specific users and represented in an RDF knowledge graph. In particular, the RDF graph can define variables that correspond to OPC variables. The RDF knowledge graph queried via a query that is compliant with a GraphQL API.

To provide a method, a computer readable medium, and a system for creating, organizing, viewing, and connecting annotations of web documents within annotation-enabled web browsers.SOLUTION: A method transmits an annotation highlighted text, an annotation comment, a uniform resource locator (URL), a document object model (DOM) context, a screenshot including a marked annotation highlighted text, and an annotation symbol to an annotation server.SELECTED DRAWING: Figure 14

The present patent application discloses a data analytics system with a split plane architecture that utilizes a workflow management module in a control plane for cloud-based computing. The system receives workflow files from client devices and stores those workflow files in a cloud storage associated with the user. The data plane, which executes the workflow file, retrieves the file directly from the cloud storage or through an API provided by the workflow management module. A workflow engine wrapper, containing a stager system and an execution system, prepares workflow files for execution and stores generated results in the cloud storage.

The present invention relates to a database table definition method based on XML files, which realizes automatic generation of database table definition statements by setting XML file structure; defining variables for storing XML file information; reading XML file root node information; and combining data table definition commands according to the read root node information. The present invention improves and innovates the database table creation process, combines the configuration files required in software engineering, adds various information required for database table creation to the original XML file, and realizes automatic definition of database table structure and automatic creation of database tables.

The present invention provides a data enhancement method, system and storage medium in a multi-data mode environment. The method includes: confirming a specified input folder that stores original sample data for training; after the confirmation of the input folder is completed, creating a specified output folder; selecting a corresponding system operation mode and data enhancement algorithm according to the data modality required by the user; performing data enhancement processing on the original sample data in the input folder according to the selected system operation mode and data enhancement algorithm, and generating corresponding enhanced sample data; and saving the original sample data and the enhanced sample data in the output folder. In view of the current scattered situation of data enhancement algorithms, the present invention can quickly complete various data enhancement processing operations on training samples by aggregating multiple system operation modes and corresponding data enhancement algorithms, thereby improving work efficiency.

The invention discloses an index chain construction method based on an RAG framework, which relates to the technical field of document processing, and comprises the following steps: receiving and analyzing different types of documents; uniformly converting the content into a Markdown format through an OCR (Optical Character Recognition) model, a layout recognition model and a table recognition model; segmenting the Markdown format document into a plurality of chunks, ensuring that a title and a text are logically coherent by utilizing a semantic analysis technology, and independently extracting a table to generate a natural language abstract; performing semantic analysis on each chunk by using a language model, extracting a high-dimensional semantic vector, processing an overlong text through a sliding window, and endowing a title vector with a higher weight to form a knowledge path; for chunk with less content, an adjacent block merging strategy is adopted to optimize a vectorization effect; and creating an index by adopting a cosine similarity method. According to the index chain construction method based on the RAG framework, the problem that in the prior art, the information processing accuracy of unstructured or semi-structured documents is low is solved, and the processing accuracy of the unstructured or semi-structured documents can be improved.

A method (300) of storing semi-structured data (12U) includes receiving user data (12) comprising semi-structured user data from a user (10) of a query system (150). The method includes receiving an indication (14) that the semi-structured user data fails to include a fixed schema. In response, the method further includes parsing the semi-structured user data into a plurality of data paths (210) and extracting a data type (220) associated with each respective data path of the plurality of data paths. The method additionally includes storing the semi-structured user data as a row entry in a table (204) of a database in communication with the query system, wherein each column value associated with the row entry corresponds to a respective one of the plurality of data paths and the data type associated with the respective data path.

To provide an information generation system, a workflow system, an information generation program, and a workflow program that facilitate the creation of a template for generating specific information from images in a document.SOLUTION: An information generation system comprises a template generation unit that generates a template for generating specific information including information extracted from an invoice image and a general-purpose information generation unit that generates specific information from an invoice image without using a template. The template generation unit generates a new template (S107) based on the invoice image, the specific information generated by the general-purpose information generation unit from the invoice image, and a template managed in a template database.SELECTED DRAWING: Figure 5