92 results about "Table (information)" patented technology

The invention relates to the technical field of artificial intelligence, can be applied to business scenes of financial science and technology, medical health and the like, and discloses a natural language driven table processing method, device, equipment and medium. And generating and executing an operation action by utilizing the reinforcement learning strategy network, generating a reward signal according to execution result data and user feedback information, storing the state vector representation, the target table operation action and the reward signal into an experience playback queue, and updating network parameters of the reinforcement learning strategy network based on historical data in the experience playback queue. According to the method, the state vector is constructed through the reinforcement learning strategy network in combination with the natural language instruction and the table context, and the operation strategy is continuously optimized according to the operation result and the user feedback, so that intelligent understanding and action planning of the spreadsheet operation intention are realized, and the data processing efficiency and the interaction intelligence level of non-professional users are improved.

According to the data backup method and device provided by the specification, description information corresponding to target data is obtained, and the description information comprises at least one of data change frequency, health state information of a storage medium stored in the target data or table association information; the table association information comprises a plurality of tables used for storing the target data and a dependency relationship among the plurality of tables, and a target backup strategy is intelligently generated through a pre-trained backup strategy model, so that backup of the target data according to the target backup strategy is more intelligent. The target backup strategy is intelligently obtained according to the data change frequency of the target data, the health state information of the storage medium and / or the table association information instead of a fixed backup strategy, so that the data can be effectively protected by performing data backup through the target backup strategy generated by the method in the specification.

The invention discloses an intelligent question and answer method and system for a table-containing document, and the method comprises the steps: firstly obtaining a document, carrying out the data preprocessing of the document, and obtaining a preprocessed table D and text data F; secondly, processing the table data through a large language model to respectively obtain table nodes and table entity nodes; and then the text data F is cut according to paragraphs, each text segment is embedded by embedding the large language model B, text nodes are generated, and a knowledge graph is constructed through recursion based on the text nodes, table nodes and table entity nodes. And finally, according to the knowledge graph, optimizing user query and maximizing retrieval information based on iterative retrieval. And constructing related texts and user queries into structured information, returning the structured information to the large model M, and generating answers. According to the method, documents in various forms can be better processed, and the precision is higher when intelligent question answering is carried out on the document containing the table.

The invention provides a form text boundary adaptive information extraction method and system in the technical field of computer information processing. The method comprises the following steps: S1, identifying a title frame from a form image; s2, calculating the aspect ratio of the title frame to determine the title arrangement direction of the table titles; s3, detecting a text detection box of the table image, and performing classification prediction of a text arrangement direction on the text detection box by combining a text direction model with a title arrangement direction; s4, controlling affine transformation of the table image through the text arrangement direction and the text detection box to obtain a corrected image; s5, identifying a table title in the corrected image, and matching a table type from the table type configuration file based on the table title; s6, extracting keywords from the corrected image based on the table type; and S7, processing the keyword to extract table information. The method has the advantages that the adaptability, accuracy and efficiency of table information extraction are greatly improved.

The invention provides a question and answer method, a table question and answer model training method and device, equipment and a medium, and relates to the technical field of artificial intelligence. The method comprises the following steps: selecting a target table of which table information is matched with a natural language question from a plurality of tables to be selected, wherein the tables to be selected are in a coding format; generating a corresponding table question based on the natural language question and table information of the target table; and inputting the generated table question into a pre-trained table question and answer model to obtain a question and answer result corresponding to the natural language question. According to the technical scheme, the utilization rate of the table information in the table question and answer model can be increased, and the complex table and multi-table question and answer ability is improved.

The invention relates to the technical field of the power industry, and discloses a complex table structure identification method, system and device for the power industry and a medium, and the method comprises the steps: capturing key information, such as visual, text and layout features, of a target to-be-identified table image through a first feature extraction operation; and a data basis is provided for subsequent feature fusion and reasoning. The second feature fusion operation integrates different features, and the first stage strengthens the relation between vision and text features, so that the recognition is more accurate; in the second stage, layout features are fused, and the overall understanding of the table structure is enhanced. In the context aggregation step, a logic relation of table image elements is established, and recognition continuity and accuracy are improved. The line-column and cell relation between elements is analyzed through table image structure reasoning, and the recognition accuracy is ensured. According to the method, efficient and accurate identification of the complex table structure in the power industry is realized, and the automation degree and efficiency of table data processing are improved.

The invention discloses a table processing method and device, a medium, equipment and a product. The method comprises the steps of obtaining a table image of a first table; the table image is processed based on a first multi-modal big language model to obtain a first code, the first code is used for generating a second table corresponding to the first table, and the first multi-modal big language model is used for determining first table information of the first table according to the table image, the first code is generated according to the first table information, and the first table information comprises table structure information and / or cell content information of the first table; and generating the second table according to the first code. By adopting the scheme, the first code is output end to end according to the table image through the first multi-mode large language model, and the accuracy of table processing is improved.

The invention discloses a one-dimensional automatic processing method and system for a complex header of a multi-dimensional table, and the method comprises the steps: (1) extracting table data in a target document, and forming a set T; (2) for any table ti in the T, acquiring basic information of all header cells, and storing the basic information into LC; (3) calculating the hierarchy depth Li of the header, if Ligt; if so, executing the step (4); otherwise, executing the step (6); (4) taking each header cell in the LC as a node, gradually backtracking upwards from the Li layer to construct a header tree structure, merging text contents of all nodes layer by layer from a root node, and taking the merged text contents as a one-dimensional header of a column where the bottommost layer node is located; (5) removing redundant information in the one-dimensional table header to generate a normalized one-dimensional table; (6) generating a normalized one-dimensional table; and (7) circularly executing the steps (2)-(6) until processing of all table data is completed. The method is high in efficiency and high in accuracy.

The invention provides a table data processing method and related equipment. The method comprises the following steps: in response to a first operation on a first table, generating an isolation environment and a second table arranged in the isolation environment; the second table comprises table structure information and / or table data information of the first table; in response to a table configuration operation on the second table, table change information is generated; and in response to a deployment operation in the isolated environment, deploying at least part of the table change information to the first table. According to the table data processing method and the related equipment provided by the invention, modification of the table data in the isolation environment does not influence the table data in the production environment, so that the development and test cost of the table is reduced, and the safety of the table data is guaranteed.

The application discloses a method for automatically inferring semantics of a data cleaning script, comprising loading an original table to the data cleaning script and obtaining an input table and an output table; constructing a table change space, obtaining a table change characteristic set based on comparison between the input / output table and the table change space; taking data conversion operation types that all satisfy inevitable occurrence, impossible occurrence and possible occurrence as candidate data conversion operation types; converting and splicing multiple descriptive texts corresponding to function names, function parameters and table change characteristics to obtain a semantic vector, inputting the semantic vector into a twin convolutional neural network model to obtain candidate data conversion operation type ranking; constructing a parameter slot of each data conversion operation type, inferring the parameter slot of the candidate data conversion operation type by using data cleaning code, table content and table change information of a corresponding row, and obtaining the type and parameters of the data conversion operation based on the inference result. The method can simply and conveniently infer the type and parameters of the data conversion operation in the cleaning code.

The invention relates to a table processing method and electronic equipment. The method comprises the steps of obtaining a to-be-processed worksheet file; determining, through a large language model for table understanding, structured information of the worksheet file, the structured information comprising at least one of the following items of a worksheet for the worksheet file: information of a logical sub-table, row description information, or grouping information; and storing the structured information using a predefined format. In this way, the embodiment of the invention provides a method for understanding the structure of the table, and deep understanding of the internal semantic structure of the table is achieved.

Arrangements for partition handling for multi table scan semi join operations are provided. Partition information of a first logical relation may be determined. Partition information of a first physical operator may be determined based on the partition information of the first logical relation. The partition information of the first physical operator may be stored in a data structure which includes partition information of a fact table and of each reducer in a predefined sequence. Partition information of a second logical relation may be determined. The partition information of a second physical operator may be determined based on the partition information of the second logical relation and the partition information of the first physical operator. The partition information of the second physical operator may be stored in the data structure. Execution of the second physical operator may be performed using the stored partition information, skipping mappings between pairs of partitions.

We provide the system. [Solution] Information processing means for receiving old and new data, A text extraction means for extracting text data from old and new documents, A difference detection means that compares the text data of old and new documents and detects the differences, A table generation means that classifies the detected differences and generates a revised table, An output means for outputting the generated current revised table, A system that includes this.

The invention discloses a table biaxial position coding and task loss function combined large model table question and answer method. Collecting table, question and answer data, and performing structuralization and biaxial position coding processing on the table data to obtain a text word vector set and biaxial position codes; performing fusion processing to obtain a position code after biaxial fusion; after combination processing, sequentially inputting into a model for processing to obtain a table global representation vector; and establishing a loss function training model, and performing prediction processing on an actual application scene by using the trained model to obtain a table answer result. According to the method, through double-axis position coding, the two-way constraint relation between rows and columns is effectively captured, representation is made to better conform to the inherent structure of a table, through mask cell modeling, known data can be learned, missing information can be speculated, the incomplete data processing capacity in a real scene is improved, and the method is suitable for being popularized and applied. The accuracy and robustness in complex table data processing can be remarkably improved.

The application discloses a table information extraction method, system and device based on a compressed pre-training language model. The application models the table information extraction as a reading comprehension problem and inputs the pre-training language model, thereby avoiding error propagation and reducing the participation of rules. Meanwhile, the strong generalization ability and robustness of the pre-training language model can obtain relatively accurate cells in the table that can answer natural language questions, thereby completing the extraction of the associated information in the table.

The invention discloses a table structure extraction method based on a deep cascade network, and the method comprises the steps: obtaining a table image, extracting the visual features of the table image, coding the visual features to obtain enhanced features, and obtaining target query information according to the enhanced features; according to target query information, decoding the enhanced features to obtain a prediction result of a text region bounding box; decoding the prediction result of the text region bounding box to obtain a prediction result of a cell region bounding box; and performing logical position allocation according to a prediction result of the cell region bounding box to obtain table structure content.

This invention relates to a table-based question-and-answer method and apparatus. The table-based question-and-answer method includes: structuring a table in a technical standard document to obtain table information; receiving an input user question and processing it through a preset model to obtain an SQL statement; and querying the answer corresponding to the user question based on the SQL statement and the table information.

This application relates to the technical fields of data processing and artificial intelligence, and discloses a method and apparatus for evaluating and processing retrieved tabular documents. The method includes: parsing the tabular document to obtain at least its table structure information, data content, and metadata information; performing multi-dimensional evaluation based on the table structure information, data content, and metadata information to obtain at least two of the following: table standardization evaluation result, metadata integrity evaluation result, data clarity evaluation result, and contextual relevance evaluation result; and weighting at least two of these results to obtain a comprehensive evaluation result for the tabular document. This method allows for a comprehensive evaluation of tabular documents, providing users with clear optimization guidance.

The invention discloses a complex table structure understanding and information extraction method, system and device and a medium, belongs to the cross technical field of artificial intelligence, computer vision and natural language processing, and aims to solve the technical problem of how to realize accurate understanding and information extraction of a complex table structure. According to the technical scheme, the method comprises the following steps: multi-modal feature extraction: representing table data as a combination of a visual feature vector, a text semantic vector and a layout feature vector, namely, a multi-modal table vector = the visual feature vector, the text semantic vector and the layout feature vector; multi-modal fusion: generating a multi-modal table vector based on the multi-modal large model architecture, performing efficient processing and fusion on the multi-modal table vector, and fully fusing multi-dimensional information of a visual feature vector, a text semantic vector and a layout feature vector; structure perception decoding and semantic enhancement reconstruction are carried out; an adaptive output is generated.

The invention provides a code generation method and system based on a table structure, a server and a medium, and relates to the technical field of computers.The method comprises the steps that table structure analysis is conducted on a data table in a preset data source, and table structure meta-information is obtained; performing field semantic recognition on the table structure meta-information according to a preset rule base, and determining a front-end control type and a back-end verification rule; according to a preset generation strategy, table structure meta-information, a front-end control type and a back-end verification rule, calling a code template to execute rendering processing, and generating an original code; and carrying out front-end and rear-end interface binding on the original code to generate a target code. The project development efficiency and the code quality can be effectively improved.

This invention relates to the field of computer vision technology and discloses a method, apparatus, device, and readable storage medium for table recognition. The method includes: acquiring an image to be recognized; inputting the image to be recognized into a preset table detection model to identify a table image from the image; inputting the table image into the preset table recognition model to determine the endpoint coordinates of each cell in the table image and the connection relationships between the endpoints; and generating a target table based on the endpoint coordinates and connection relationships. By implementing this invention, table recognition is achieved through endpoint extraction and endpoint connection relationship extraction, eliminating reliance on table line extraction, ensuring the accuracy of table structure recognition, and improving the accuracy of table information recognition.

The application provides a big data SQL join intelligent optimization method and device, and belongs to the technical field of SQL optimization application. The method comprises the following steps: S1: collecting and recording user SQL information; S2: analyzing the recorded SQL information to obtain key information of the SQL, wherein the key information comprises a table name, a table partition and a join field; S3: reading fsimage information according to the table name and the table partition through a presto engine to obtain the actual size of the current used table partition in the fsimage information; S4: judging whether the SQL join order is arranged according to a preset order, if not, adjusting the SQL join order to the preset order according to the size of the table partition, and if yes, continuing to execute downwards; and S5: judging whether data skew is caused according to the join field, and if yes, confirming the SQL after rewriting. The application improves the running speed of big data SQL, saves the resources of a big data cluster, and solves the problem of insufficient experience of engineers and the problem of not knowing how to optimize SQL.

The application discloses a construction method table identification method and device, computer equipment and a storage medium, and relates to the technical field of table identification. The method comprises the following steps: acquiring a construction method table, extracting text rows from the construction method table; performing semantic classification on the text rows to determine the field types of the text rows; dividing all method content fields into at least one method block based on semantics; and determining the method number fields, method name fields and applicable part fields matched with the method block based on the position information of the method block, the method number fields, the method name fields and the applicable part fields in the construction method table. The application overturns the traditional table identification process of "restoring the physical structure first, and then extracting the content according to the columns", and breaks through the dependence of traditional table identification on the physical structure through the "semantic aggregation + spatial reverse matching based on the method block" strategy. The "semantic aggregation + spatial positioning" method significantly improves the field recognition accuracy for complex construction method tables.

The invention provides a complex table recognition method and system, and relates to the field of computer vision, and the method comprises the steps: recognizing a table contour in a table image based on a plurality of detection methods to obtain a plurality of recognition results, and fusing the recognition results based on a preset rule to obtain a table bounding box; detecting trunk separation elements capable of segmenting table contents based on multiple image processing methods, and dividing the table into one or more block regions by synthesizing the trunk separation elements obtained by the multiple image processing methods; carrying out independent and parallel analysis processing on the block regions to obtain all cells, and identifying the text content of the cells in each block region by means of an OCR algorithm to obtain the text content; and establishing table hierarchical structure information according to the relative positions of the block regions, and recombining the text content according to the table hierarchical structure information to obtain a table recognition result. A table containing any complex row-crossing and column-crossing merged cells can be accurately identified and reconstructed.

The invention relates to the technical field of data processing, and particularly provides an artificial intelligence-based table generation method, system and device and a storage medium, and the method comprises the following steps: obtaining text data, and extracting an entity from the text data; determining attributes of the entity through syntactic context analysis, and caching corresponding attribute values; matching a pre-configured user attention item with the attribute, determining a table column according to the successfully matched attribute, and determining a table row according to the number of entities in the adjacent matrix; and generating a table based on the table columns and the table rows, and filling the attribute values of the entities to corresponding positions of the table. The table generated by the method is complete in content and high in structural adaptability, and can effectively meet the requirements for multi-dimensional and customized presentation of information in different scenes.

The invention relates to a table model generation method and device, computer equipment, a readable storage medium and a program product. The method comprises the steps of determining a table weight of each initial table in an initial table model based on a table structure relationship of the initial table model; based on a table weight and field weight calculation strategy, determining weight configuration information of each table field in each initial table; and generating a target table model based on a preset table model generation model, the weight configuration information and a table field of the to-be-generated table model. By adopting the method, the generation efficiency of the table model can be improved.

This application discloses a table generation method, apparatus, electronic device, and medium, relating to the field of data processing technology. A specific implementation of the method includes: modifying information in a table to be modified based on preset change rules to obtain a table template file containing at least one variable placeholder; generating a target mapping table file based on at least one variable placeholder and at least one set of actual variable information, the target mapping table file being used to establish a variable mapping relationship between at least one variable placeholder and at least one actual variable in each set of actual variable information; and performing at least one variable substitution operation on the table template file based on at least one set of variable mapping relationships in the target mapping table file to obtain at least one target information table. This achieves automated, standardized, and batch generation of information tables, significantly improving the efficiency and standardization of maintenance document generation, while balancing the flexibility, maintainability, and low-cost requirements of table generation.

The invention provides an LLM-based table data question and answer method, which comprises the following steps of: performing preliminary screening on a to-be-queried disordered table to obtain M rows of data and N columns of data related to a current question, and forming an initial sub-table; on the basis of LLM, whether the data contained in the initial sub-table can answer the current questioning question or not is evaluated; if the data contained in the initial sub-table cannot answer the current question, sequentially selecting a column of data from the (N + 1) th column of data in the candidate column set until a stop condition is met, and forming a target sub-table; on the basis of LLM, description information is added to the target sub-table, and a linguistic table is formed; and based on the LLM, reasoning the linguistic table to obtain the answer content of the current question. Therefore, the context length can be shortened, the table can be simplified as much as possible, the limitation of long context input is reduced, the information density is improved, and the efficiency and accuracy of table understanding and question answering are improved.

The invention discloses a data configuration method and device, a data access method and device, equipment and a storage medium, and relates to the technical field of computers and the Internet. The method comprises the steps of displaying a table configuration interface of a table tool; in response to an operation for a new table control, displaying identification information of a new first table, identification information of a first record contained in the first table, and an attribute configuration interface of the first record; in response to an operation for the attribute configuration interface, configuring at least one self-defined attribute contained in the first record and an attribute parameter corresponding to the at least one self-defined attribute in the attribute configuration interface; in response to the operation of adding the record in the first table, displaying at least one other record, except the first record, added in the first table in the table configuration interface; the data in the first table supports access by a visual programming tool. According to the method, the process of configuring and accessing the data is simplified.

Embodiments of the present disclosure disclose data archiving method, device, electronic equipment, medium and program product. A specific embodiment of the method comprises: performing a main table archiving task corresponding to main table archiving task information to generate main table data to be archived, wherein the main table corresponding to the main table archiving task information has a field association relationship with a set of sub-tables; generating at least one sub-table archiving task information corresponding to at least one target sub-table in the set of sub-tables; for each archiving task information in the set of archiving task information, the following consumption steps are performed: generating an archiving message group for the archiving task information; performing message consumption on the archiving message group to obtain a consumption result group; and generating archiving information for the main table and the at least one target sub-table according to the obtained set of consumption result groups. This embodiment is related to data archiving, and utilizes the generation and consumption of messages to perform data archiving on the data in the main table and the plurality of sub-tables, thereby improving the completeness and archiving efficiency of data archiving.