Column index row value detection method for nonstandard table automatic data processing

By defining keywords and detection ranges, using logical operation relationships to traverse tables to identify column index row values ​​in non-standard tables, the problem of low column index row value recognition efficiency in automated data processing of non-standard tables is solved, and fast and accurate data is achieved deal with.

CN118981464APending Publication Date: 2024-11-19JIHUA 3512 LEATHER & GARMENT
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410854557.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-06-28
Publication Date
2024-11-19

AI Technical Summary

Technical Problem

In batch non-standard table data processing, it is difficult for the prior art to accurately and quickly identify column index row values, resulting in inefficient automation data processing.

Method used

By defining keywords and detection ranges, using a computer to traverse tables and applying logical operation relationships to detect column index row values, improving detection speed and accuracy.

Benefits of technology

It realizes the computer's accurate identification of column index row values ​​in non-standard tables, and improves the speed, accuracy and breadth of automated data processing in non-standard tables.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118981464A_ABST
    Figure CN118981464A_ABST
Patent Text Reader

Abstract

The invention belongs to the technical field of data processing, and particularly relates to a column index row value detection method for nonstandard table automatic data processing. The column index row value detection method for automatic data processing of the non-standard table comprises a data setting step, a table traversing step and a data analysis step. A data setting step: defining keywords and a detection range to generate a detection keyword array and a detection range value; a table traversing step: traversing the table according to the numerical values in the detection keyword array in sequence in a specified direction so as to generate a keyword row value array and a keyword row value array length; and a data analysis step: analyzing and verifying the keyword row value array and the length thereof to generate a table column index row value. According to the detection method, the computer can identify the column index row value in the non-standard table, and the process can be controlled and adjusted, so that automatic data processing of the non-standard table is realized.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of data processing, and in particular relates to a column index row value detection method for automatic data processing of non-standard tables. Background Art

[0002] A column index is a storage structure in a table. The function of an index is equivalent to a book catalog, which can retrieve data and mark data categories. The position of a column index row in a table is not fixed, and different tables have different column index forms. When processing a small amount of table data, you can rely on manual experience to identify the column index row value; when processing batches of standard table data, you can use fixed values ​​to define the column index row value for automated data processing of standard tables; but when processing batches of non-standard table data, in order to achieve automated data processing of non-standard tables, the computer needs to be able to identify the column index row values ​​in non-standard tables.

[0003] Therefore, in order to realize automatic data processing of non-standard tables, an accurate and fast table column index row value detection method is needed.

[0004] To this end, we propose a column index row value detection method for automated data processing of non-standard tables. Summary of the invention

[0005] The present invention aims to propose a column index row value detection method for automatic data processing of non-standard tables, which is used for computer identification of column index row values ​​of non-standard tables, relies on one or more keywords to traverse and analyze the table to detect column index row values, improves the detection speed by defining the detection range of the table, and increases the number of keywords and logical operation relationships to improve the detection accuracy and breadth.

[0006] In order to achieve the above objectives, the present invention adopts the following technical solutions:

[0007] A column index row value detection method for automatic data processing of non-standard tables:

[0008] S1. Set the data step, define keywords and detection range to generate detection keyword array and detection range value;

[0009] S2. A step of traversing the table, in which the values ​​in the detection keyword array are sequentially traversed in the table in the specified direction to generate a keyword row value array;

[0010] S3. Data analysis step, analyzing and verifying the keyword row value array and its length to generate table column index row values.

[0011] Furthermore, in step S1, the method of setting the data step includes:

[0012] Define keywords, which are values ​​that must exist in the table column index; keywords are specifically the keywords that appear most frequently and are required keywords in the table column index of the data processing task, and the number of keywords is recorded as i, i≥1;

[0013] Add logical operation relationships to the keywords, including or and not; to generate a detection keyword array, which is recorded as array A;

[0014] Define the detection range of array A, denoted as (x, y), where x represents the maximum column value to be detected, x≥1; y represents the maximum row value to be detected, y≥1; (x, y) is used to limit the number of generated keywords, the detection keyword array and the detection range value.

[0015] Furthermore, in the logical operation relationship, the logical operator "or" is used to connect different expressions of the same keyword, thereby increasing the search results and improving the recall rate; the logical operator "not" is used to exclude keywords that are not desired to appear, thereby further refining the search results.

[0016] Furthermore, the table traversal method:

[0017] Initialize keyword row value array B, determine detection keyword array A, and traverse the table in the specified direction with the values ​​in detection keyword array A, traversing row by row within the (x, y) detection range; that is, if the value in array A exists in the table cell and satisfies the keyword logic operation, then add this cell row value to keyword row value array B, and end the current value traversal to proceed to the next value traversal, until all values ​​in array A are traversed, and the final length of group B is recorded as i 2 , to generate the keyword row value array and the keyword row value array length.

[0018] Furthermore, the method for analyzing data is as follows: for the keyword row value array B and its length i 2 For analysis, if i 2 = 0, then this table has no keyword column index. 2 >0, select the value with the highest frequency in array B and record it as value c. If there are multiple values ​​c, retain the minimum value c and verify value c.

[0019] Furthermore, the method for verifying the value c is as follows: define a counter i 3 = 0, the values ​​in the detection keyword array A are traversed through the table cells one by one. Within the range of row c of the table, if the values ​​in array A exist in the table cells and satisfy the keyword logical operation relationship, then i 3 =i 3 +1, until all the values ​​in array A are traversed, if i 3! = i, then this table has no keyword column index. If i 3 =i, then the value c is the table column index row value. In summary, due to the adoption of the above technical solution, the beneficial technical effects of the invention are:

[0020] A column index row value detection method for automatic data processing of non-standard tables enables a computer to identify column index row values ​​of non-standard tables, relies on one or more keywords to traverse and analyze the table to detect column index row values, and improves the detection speed by defining the detection range of the table; increases the number of keywords and logical operation relationships to improve detection accuracy and breadth.

[0021] In addition, a column index row value detection method for automated data processing of non-standard tables has the characteristics of controllable detection speed, accuracy and breadth. It relies on keywords to traverse and analyze the table to detect column index row values, which can enable the computer to recognize the column index row values ​​in non-standard tables to perform automated data processing of non-standard tables. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 Flow chart of the detection method.

[0023] Figure 2 Set up a logic diagram for the data steps.

[0024] Figure 3 This is a logic diagram for traversing the table steps.

[0025] Figure 4 Logic block diagram for data analysis steps. DETAILED DESCRIPTION

[0026] In order to make the purpose, technical solution and advantages of the invention more clear, the invention is further described in detail below in combination with the embodiments. It should be understood that the specific embodiments described here are only used to explain the invention and are not used to limit the invention.

[0027] A column index row value detection method for automatic data processing of non-standard tables:

[0028] S1. Set the data step, define keywords and detection range to generate detection keyword array and detection range value;

[0029] S2. A step of traversing the table, in which the values ​​in the detection keyword array are sequentially traversed in the table in the specified direction to generate a keyword row value array;

[0030] S3. Data analysis step, analyzing and verifying the keyword row value array and its length to generate table column index row values.

[0031] In step S1, the step of setting data includes:

[0032] Define keywords, which are values ​​that must exist in the table column index; keywords are specifically the keywords that appear most frequently and are required keywords in the table column index of the data processing task, and the number of keywords is recorded as i, i≥1;

[0033] Add logical operation relationships to the keywords, including or and not, to generate a detection keyword array, which is recorded as array A;

[0034] Define the detection range, denoted as (x, y), where x represents the maximum column value to be detected, x≥1; y represents the maximum row value to be detected, y≥1; (x, y) is used to limit the number of generated keywords, the detection keyword array and the detection range value.

[0035] In the above-mentioned logical operation relationship, the logical operator "or" is used to connect different expressions of the same keyword, which increases the search results and improves the recall rate;

[0036] For example, to find the column index about "neck size" or "neckline", you can use "neck size" or "neckline" as the keyword group value;

[0037] The logical operator "not" is used to exclude unwanted keywords and further refine the search results.

[0038] For example, to find the column index about "bust" but not "error correction", you can use "bust" not "error correction" as the key phrase value.

[0039] The traversal table method:

[0040] Initialize keyword row value array B, determine detection keyword array A, and traverse the table in the specified direction with the values ​​in detection keyword array A. Traverse row by row within the (x, y) detection range (first traverse all cells in the first row, then traverse row by row). That is, if the value in array A exists in the table cell and satisfies the keyword logic operation, add this cell row value to keyword row value array B, and end the current value traversal to proceed to the next value traversal until all values ​​in array A are traversed. The final length of group B is recorded as i. 2 , to generate the keyword row value array and the keyword row value array length.

[0041] The method of analyzing the data:

[0042] For the keyword row value array B and its length i 2 For analysis, if i 2 = 0, then this table has no keyword column index. 2≥0, select the value with the highest frequency in array B and record it as value c. If there are multiple values ​​c, retain the minimum value c and verify value c.

[0043] The method for checking the value c is as follows: define a counter i 3 = 0, the values ​​in the detection keyword array A are traversed through the table cells one by one. Within the range of row c of the table, if the values ​​in array A exist in the table cells and satisfy the keyword logical operation relationship, then i 3 =i 3 +1, until all the values ​​in array A are traversed, if i 3 ! = i, then this table has no keyword column index. If i 3 =i, then the value c is the table column index row value, i 3 !=i refers to counter i 3 The value of is not equal to the length of keyword array A. During the verification of value c, if i 3 If the value of is not equal to i, it means that not all keywords are found in the same row, which may indicate that there is a problem with the column index row value of the table or that the table format does not meet expectations. 3 If it is equal to i, it means that all keywords are found in the same row, and the value c can be confirmed as the column index row value of the table.

[0044] In step S1, a data step is set to define detection keywords 'name', 'gender', 'height', 'chest' and 'neck', i=5, and a logical non ((not)) keyword group ['error correction'] is added to all keywords, that is, in the next traversal, if the table cell value contains a value in the logical non-keyword group, then this cell is not processed, and a logical ((or)) keyword group ['collar', 'collar'] is added to the keyword 'neck' value, that is, in the next traversal of the 'neck' value, if the table cell value contains a value in the logical or keyword group, then this cell is processed to generate a keyword array A ['name', 'gender', 'height', 'chest', 'neck'], and a detection range of (24, 8) is defined. Increasing the number of keywords can improve the accuracy of detection, and adding logical operation relationships to the keyword array or the values ​​in the keyword array can improve the detection breadth. The wider the detection range is defined, the lower the detection speed will be.

[0045] In step S2, the table is traversed and the values ​​in the detection keyword array A['name', 'gender', 'height', 'chest', 'neck'] are traversed in sequence. Figure 1 and Figure 2Table cells, within the detection range of (24, 8), are traversed row by row, that is, all cells in the first row are traversed first, and then traversed row by row. If the value in array A exists in the table cell and satisfies the keyword logical operation relationship, the cell row value is added to the keyword row value array, and the current value traversal is ended and the next value traversal is performed. The final value is recorded as array B, and the length of group B is recorded as i. 2 , until all values ​​in array A are traversed.

[0046]

[0047] Table 1

[0048]

[0049] Table 2

[0050] The keyword row value array B['6','6','6','6','6'] in Table 1 and Figure 1 The length of the keyword row value array i 2 =5;

[0051] The keyword row value array B['4','4','4','4','4'] in Table 2 and Figure 2 The length of the keyword row value array i 2 =5.

[0052] Step S3: Analyze the keyword row value array B and its length i in Table 1 and Table 2 to generate table column index row values.

[0053] Table 1, i 2 > 0, select the value with the highest frequency in array B of Table 1, record it as value c, value c = 6, check value c, define counter i 3 , traverse the values ​​in the detection keyword array A in sequence Figure 1 Table cell, within the range of row 6 of the table, if the value in array A exists in the table cell and satisfies the keyword logical operation relationship, then i 3 =i 3 +1, until all values ​​in array A are traversed, i 3 =5,i=5,i 3 =1, then 6 is the table column index row value;

[0054] Table 2, i 2 > 0, select the value with the highest frequency in array B in Table 2, record it as value c, value c = 4, check value c, define counter i 3 , traverse the values ​​in the detection keyword array A in sequence Figure 1Table cell, in the range of row 4 of the table, if the value in array A exists in the table cell and satisfies the keyword logical operation relationship, then i 3 =i 3 +1, until all values ​​in array A are traversed, i 3 =5,i=5,i 3 =1, then 4 is the table column index row value.

[0055] The above description is a preferred embodiment of the invention and is not intended to limit the invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the invention should be included in the protection scope of the invention.

Claims

1. A method for detecting column index row values ​​for automatic data processing of non-standard tables, characterized by: S1. Set the data step, define keywords and detection range to generate detection keyword array and detection range value; S2. A step of traversing the table, in which the values ​​in the detection keyword array are sequentially traversed in the table in the specified direction to generate a keyword row value array; S3. Data analysis step, analyzing and verifying the keyword row value array and its length to generate table column index row values.

2. The method for detecting column index row values ​​for automatic data processing of non-standard tables according to claim 1, characterized in that: In step S1, the method of setting the data step includes: Define keywords, which are values ​​that must exist in the table column index; keywords are specifically the keywords that appear most frequently and are required keywords in the table column index of the data processing task, and the number of keywords is recorded as i, i≥1; Add logical operation relationships to the keywords, including or and not; to generate a detection keyword array, which is recorded as array A; Define the detection range of array A, denoted as (x, y), where x represents the maximum column value to be detected, x≥1; y represents the maximum row value to be detected, y≥1; (x, y) is used to limit the number of generated keywords, the detection keyword array and the detection range value.

3. The method for detecting column index row values ​​for automatic data processing of non-standard tables according to claim 2, characterized in that: In the logical operation relationship, the logical operator "or" is used to connect different expressions of the same keyword; the logical operator "not" is used to exclude keywords that are not desired to appear, thereby further refining the search results.

4. The method for detecting column index row values ​​for automatic data processing of non-standard tables according to claim 1, characterized in that: In step S2, the method of traversing the table step includes: Initialize keyword row value array B, determine detection keyword array A, and traverse the table in the specified direction with the values ​​in detection keyword array A, traversing row by row within the (x, y) detection range; that is, if the value in array A exists in a table cell and satisfies the keyword logical operation, then add this cell row value to keyword row value array B, and end the current value traversal to proceed to the next value traversal, until all values ​​in array A are traversed, and the final length of group B is denoted as i2, to generate the keyword row value array and the keyword row value array length.

5. The method for detecting column index row values ​​for automatic data processing of non-standard tables according to claim 1, characterized in that: In step S3, the method of analyzing the data step includes: Analyze the keyword row value array B and its length i2. If i2=0, this table has no keyword column index. If i2>0, select the value with the highest frequency in array B and record it as value c. If there are multiple values ​​c, retain the minimum value c and verify value c.

6. A method for detecting column index row values ​​for automatic data processing of non-standard tables according to claim 5, characterized in that: The method for checking the value c includes: defining a counter i3=0, traversing the table cells in turn with the values ​​in the detection keyword array A, within the range of the cth row of the table, if the values ​​in the array A exist in the table cells and satisfy the keyword logic operation relationship, then i3=i3+1, until all the values ​​in the array A are traversed, if i3!=i, then this table has no keyword column index, if i3=i, then the value c is the table column index row value.