Data processing method and related equipment
By determining the number of partitions based on the variable name list in the vertical table and storing and converting data, the problem of inefficient conversion of vertical tables into wide tables is solved, and efficient data processing and storage is achieved.
CN119690961APending Publication Date: 2025-03-25MASHANG CONSUMER FINANCE CO LTD
0 Cites 0 Cited by
Patent Information
- Application Number
- CN202411524974.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-29
- Publication Date
- 2025-03-25
AI Technical Summary
Technical Problem
The prior art is less efficient when converting vertical tables into wide tables, especially when there are many variable names, the SQL code is verbose, resulting in inefficient processing.
Method used
By determining the number of partitions based on the variable name list in the vertical table, establishing the corresponding partition list, storing the data into these partition lists, and converting each partition list into a wide table, and finally horizontally merging to generate the first wide table.
Benefits of technology
This method realizes efficient processing of converting vertical tables into wide tables by partitioning data, reducing code redundancy, saving storage costs, and improving data processing performance.
✦ Generated by Eureka AI based on patent content.
Abstract
The embodiment of the invention discloses a data processing method and related equipment, and the data processing method comprises the steps: determining the number of partitions according to a variable name list in a longitudinal table, and building M partition lists corresponding to the number of the partitions; the header of the longitudinal table comprises a variable name tag; the table body of the longitudinal table comprises K rows of data; the variable name list is composed of K variable names of a column where the variable name tag is located; k and M are integers greater than 1; storing the K rows of data into the M partition lists according to the variable name list; each partition column in the M partition lists is converted into a sub-wide table, M sub-wide tables are obtained, and a header of each sub-wide table comprises at least one variable name in the K variable names; and transversely combining the M sub-wide tables to obtain a first wide table. By adopting the embodiment of the invention, the efficiency of converting the longitudinal table into the wide table can be improved.
Need to check novelty before this filing date? Find Prior Art