Column index row value detection method for nonstandard table automatic data processing
By defining keywords and detection ranges, using logical operation relationships to traverse tables to identify column index row values in non-standard tables, the problem of low column index row value recognition efficiency in automated data processing of non-standard tables is solved, and fast and accurate data is achieved deal with.
Patent Information
- Application Number
- CN202410854557.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-06-28
- Publication Date
- 2024-11-19
AI Technical Summary
In batch non-standard table data processing, it is difficult for the prior art to accurately and quickly identify column index row values, resulting in inefficient automation data processing.
By defining keywords and detection ranges, using a computer to traverse tables and applying logical operation relationships to detect column index row values, improving detection speed and accuracy.
It realizes the computer's accurate identification of column index row values in non-standard tables, and improves the speed, accuracy and breadth of automated data processing in non-standard tables.
Smart Images

Figure CN118981464A_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of data processing, and in particular relates to a column index row value detection method for automatic data processing of non-standard tables. Background Art
[0002] A column index is a storage structure in a table. The function of an index is equivalent to a book catalog, which can retrieve data and mark data categories. The position of a column index row in a table is not fixed, and different tables have different column index forms. When processing a small amount of table data, you can rely on manual experience to identify the column index row value; when processing batches of standard table data, you can use fixed values to define the column index row value for automated data processing of standard tables; but when processing batches of non-standard table data, in order to achieve automated data processing of non-standard tables, the computer needs to be able to identify the column index row values in non-standard tables.
[0003] Therefore, in order to realize automatic data processing of non-standard tables, an accurate and fast table column index row value detection method is needed.
[0004] To this end, we propose a column index row value detection method for automated data processing of non-standard tables. Summary of the invention
[0005] The present invention aims to propose a column index row value detection method for automatic data processing of non-standard tables, which is used for computer identification of column index row values of non-standard tables, relies on one or more keywords to traverse and analyze the table to detect column index row values, improves the detection speed by defining the detection range of the table, and increases the number of keywords and logical operation relationships to improve the detection accuracy and breadth.
[0006] In order to achieve the above objectives, the present invention adopts the following technical solutions:
[0007] A column index row value detection method for automatic data processing of non-standard tables:
[0008] S1. Set the data step, define keywords and detection range to generate detection keyword array and detection range value;
[0009] S2. A step of traversing the table, in which the values in the detection keyword array are sequentially traversed in the table in the specified direction to generate a keyword row value array;
[0010] S3. Data analysis step, analyzing and verifying the keyword row value array and its length to generate table column index row values.
[0011] Furthermore, in step S1, the method of setting the data step includes:
[0012] Define keywords, which are values that must exist in the table column index; keywords are specifically the keywords that appear most frequently and are required keywords in the table column index of the data processing task, and the number of keywords is recorded as i, i≥1;
[0013] Add logical operation relationships to the keywords, including or and not; to generate a detection keyword array, which is recorded as array A;
[0014] Define the detection range of array A, denoted as (x, y), where x represents the maximum column value to be detected, x≥1; y represents the maximum row value to be detected, y≥1; (x, y) is used to limit the number of generated keywords, the detection keyword array and the detection range value.
[0015] Furthermore, in the logical operation relationship, the logical operator "or" is used to connect different expressions of the same keyword, thereby increasing the search results and improving the recall rate; the logical operator "not" is used to exclude keywords that are not desired to appear, thereby further refining the search results.
[0016] Furthermore, the table traversal method:
[0017] Initialize keyword row value array B, determine detection keyword array A, and traverse the table in the specified direction with the values in detection keyword array A, traversing row by row within the (x, y) detection range; that is, if the value in array A exists in the table cell and satisfies the keyword logic operation, then add this cell row value to keyword row value array B, and end the current value traversal to proceed to the next value traversal, until all values in array A are traversed, and the final length of group B is recorded as i 2 , to generate the keyword row value array and the keyword row value array length.
[0018] Furthermore, the method for analyzing data is as follows: for the keyword row value array B and its length i 2 For analysis, if i 2 = 0, then this table has no keyword column index. 2 >0, select the value with the highest frequency in array B and record it as value c. If there are multiple values c, retain the minimum value c and verify value c.
[0019] Furthermore, the method for verifying the value c is as follows: define a counter i 3 = 0, the values in the detection keyword array A are traversed through the table cells one by one. Within the range of row c of the table, if the values in array A exist in the table cells and satisfy the keyword logical operation relationship, then i 3 =i 3 +1, until all the values in array A are traversed, if i 3! = i, then this table has no keyword column index. If i 3 =i, then the value c is the table column index row value. In summary, due to the adoption of the above technical solution, the beneficial technical effects of the invention are:
[0020] A column index row value detection method for automatic data processing of non-standard tables enables a computer to identify column index row values of non-standard tables, relies on one or more keywords to traverse and analyze the table to detect column index row values, and improves the detection speed by defining the detection range of the table; increases the number of keywords and logical operation relationships to improve detection accuracy and breadth.
[0021] In addition, a column index row value detection method for automated data processing of non-standard tables has the characteristics of controllable detection speed, accuracy and breadth. It relies on keywords to traverse and analyze the table to detect column index row values, which can enable the computer to recognize the column index row values in non-standard tables to perform automated data processing of non-standard tables. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] Figure 1 Flow chart of the detection method.
[0023] Figure 2 Set up a logic diagram for the data steps.
[0024] Figure 3 This is a logic diagram for traversing the table steps.
[0025] Figure 4 Logic block diagram for data analysis steps. DETAILED DESCRIPTION
[0026] In order to make the purpose, technical solution and advantages of the invention more clear, the invention is further described in detail below in combination with the embodiments. It should be understood that the specific embodiments described here are only used to explain the invention and are not used to limit the invention.
[0027] A column index row value detection method for automatic data processing of non-standard tables:
[0028] S1. Set the data step, define keywords and detection range to generate detection keyword array and detection range value;
[0029] S2. A step of traversing the table, in which the values in the detection keyword array are sequentially traversed in the table in the specified direction to generate a keyword row value array;
[0030] S3. Data analysis step, analyzing and verifying the keyword row value array and its length to generate table column index row values.
[0031] In step S1, the step of setting data includes:
[0032] Define keywords, which are values that must exist in the table column index; keywords are specifically the keywords that appear most frequently and are required keywords in the table column index of the data processing task, and the number of keywords is recorded as i, i≥1;
[0033] Add logical operation relationships to the keywords, including or and not, to generate a detection keyword array, which is recorded as array A;
[0034] Define the detection range, denoted as (x, y), where x represents the maximum column value to be detected, x≥1; y represents the maximum row value to be detected, y≥1; (x, y) is used to limit the number of generated keywords, the detection keyword array and the detection range value.
[0035] In the above-mentioned logical operation relationship, the logical operator "or" is used to connect different expressions of the same keyword, which increases the search results and improves the recall rate;
[0036] For example, to find the column index about "neck size" or "neckline", you can use "neck size" or "neckline" as the keyword group value;
[0037] The logical operator "not" is used to exclude unwanted keywords and further refine the search results.
[0038] For example, to find the column index about "bust" but not "error correction", you can use "bust" not "error correction" as the key phrase value.
[0039] The traversal table method:
[0040] Initialize keyword row value array B, determine detection keyword array A, and traverse the table in the specified direction with the values in detection keyword array A. Traverse row by row within the (x, y) detection range (first traverse all cells in the first row, then traverse row by row). That is, if the value in array A exists in the table cell and satisfies the keyword logic operation, add this cell row value to keyword row value array B, and end the current value traversal to proceed to the next value traversal until all values in array A are traversed. The final length of group B is recorded as i. 2 , to generate the keyword row value array and the keyword row value array length.
[0041] The method of analyzing the data:
[0042] For the keyword row value array B and its length i 2 For analysis, if i 2 = 0, then this table has no keyword column index. 2≥0, select the value with the highest frequency in array B and record it as value c. If there are multiple values c, retain the minimum value c and verify value c.
[0043] The method for checking the value c is as follows: define a counter i 3 = 0, the values in the detection keyword array A are traversed through the table cells one by one. Within the range of row c of the table, if the values in array A exist in the table cells and satisfy the keyword logical operation relationship, then i 3 =i 3 +1, until all the values in array A are traversed, if i 3 ! = i, then this table has no keyword column index. If i 3 =i, then the value c is the table column index row value, i 3 !=i refers to counter i 3 The value of is not equal to the length of keyword array A. During the verification of value c, if i 3 If the value of is not equal to i, it means that not all keywords are found in the same row, which may indicate that there is a problem with the column index row value of the table or that the table format does not meet expectations. 3 If it is equal to i, it means that all keywords are found in the same row, and the value c can be confirmed as the column index row value of the table.
[0044] In step S1, a data step is set to define detection keywords 'name', 'gender', 'height', 'chest' and 'neck', i=5, and a logical non ((not)) keyword group ['error correction'] is added to all keywords, that is, in the next traversal, if the table cell value contains a value in the logical non-keyword group, then this cell is not processed, and a logical ((or)) keyword group ['collar', 'collar'] is added to the keyword 'neck' value, that is, in the next traversal of the 'neck' value, if the table cell value contains a value in the logical or keyword group, then this cell is processed to generate a keyword array A ['name', 'gender', 'height', 'chest', 'neck'], and a detection range of (24, 8) is defined. Increasing the number of keywords can improve the accuracy of detection, and adding logical operation relationships to the keyword array or the values in the keyword array can improve the detection breadth. The wider the detection range is defined, the lower the detection speed will be.
[0045] In step S2, the table is traversed and the values in the detection keyword array A['name', 'gender', 'height', 'chest', 'neck'] are traversed in sequence. Figure 1 and Figure 2Table cells, within the detection range of (24, 8), are traversed row by row, that is, all cells in the first row are traversed first, and then traversed row by row. If the value in array A exists in the table cell and satisfies the keyword logical operation relationship, the cell row value is added to the keyword row value array, and the current value traversal is ended and the next value traversal is performed. The final value is recorded as array B, and the length of group B is recorded as i. 2 , until all values in array A are traversed.
[0046]
[0047] Table 1
[0048]
[0049] Table 2
[0050] The keyword row value array B['6','6','6','6','6'] in Table 1 and Figure 1 The length of the keyword row value array i 2 =5;
[0051] The keyword row value array B['4','4','4','4','4'] in Table 2 and Figure 2 The length of the keyword row value array i 2 =5.
[0052] Step S3: Analyze the keyword row value array B and its length i in Table 1 and Table 2 to generate table column index row values.
[0053] Table 1, i 2 > 0, select the value with the highest frequency in array B of Table 1, record it as value c, value c = 6, check value c, define counter i 3 , traverse the values in the detection keyword array A in sequence Figure 1 Table cell, within the range of row 6 of the table, if the value in array A exists in the table cell and satisfies the keyword logical operation relationship, then i 3 =i 3 +1, until all values in array A are traversed, i 3 =5,i=5,i 3 =1, then 6 is the table column index row value;
[0054] Table 2, i 2 > 0, select the value with the highest frequency in array B in Table 2, record it as value c, value c = 4, check value c, define counter i 3 , traverse the values in the detection keyword array A in sequence Figure 1Table cell, in the range of row 4 of the table, if the value in array A exists in the table cell and satisfies the keyword logical operation relationship, then i 3 =i 3 +1, until all values in array A are traversed, i 3 =5,i=5,i 3 =1, then 4 is the table column index row value.
[0055] The above description is a preferred embodiment of the invention and is not intended to limit the invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the invention should be included in the protection scope of the invention.
Claims
1. A method for detecting column index row values for automatic data processing of non-standard tables, characterized by: S1. Set the data step, define keywords and detection range to generate detection keyword array and detection range value; S2. A step of traversing the table, in which the values in the detection keyword array are sequentially traversed in the table in the specified direction to generate a keyword row value array; S3. Data analysis step, analyzing and verifying the keyword row value array and its length to generate table column index row values.
2. The method for detecting column index row values for automatic data processing of non-standard tables according to claim 1, characterized in that: In step S1, the method of setting the data step includes: Define keywords, which are values that must exist in the table column index; keywords are specifically the keywords that appear most frequently and are required keywords in the table column index of the data processing task, and the number of keywords is recorded as i, i≥1; Add logical operation relationships to the keywords, including or and not; to generate a detection keyword array, which is recorded as array A; Define the detection range of array A, denoted as (x, y), where x represents the maximum column value to be detected, x≥1; y represents the maximum row value to be detected, y≥1; (x, y) is used to limit the number of generated keywords, the detection keyword array and the detection range value.
3. The method for detecting column index row values for automatic data processing of non-standard tables according to claim 2, characterized in that: In the logical operation relationship, the logical operator "or" is used to connect different expressions of the same keyword; the logical operator "not" is used to exclude keywords that are not desired to appear, thereby further refining the search results.
4. The method for detecting column index row values for automatic data processing of non-standard tables according to claim 1, characterized in that: In step S2, the method of traversing the table step includes: Initialize keyword row value array B, determine detection keyword array A, and traverse the table in the specified direction with the values in detection keyword array A, traversing row by row within the (x, y) detection range; that is, if the value in array A exists in a table cell and satisfies the keyword logical operation, then add this cell row value to keyword row value array B, and end the current value traversal to proceed to the next value traversal, until all values in array A are traversed, and the final length of group B is denoted as i2, to generate the keyword row value array and the keyword row value array length.
5. The method for detecting column index row values for automatic data processing of non-standard tables according to claim 1, characterized in that: In step S3, the method of analyzing the data step includes: Analyze the keyword row value array B and its length i2. If i2=0, this table has no keyword column index. If i2>0, select the value with the highest frequency in array B and record it as value c. If there are multiple values c, retain the minimum value c and verify value c.
6. A method for detecting column index row values for automatic data processing of non-standard tables according to claim 5, characterized in that: The method for checking the value c includes: defining a counter i3=0, traversing the table cells in turn with the values in the detection keyword array A, within the range of the cth row of the table, if the values in the array A exist in the table cells and satisfy the keyword logic operation relationship, then i3=i3+1, until all the values in the array A are traversed, if i3!=i, then this table has no keyword column index, if i3=i, then the value c is the table column index row value.
