Data processing method and apparatus, storage medium, and electronic device
By parsing the dependency information of data tables and storing business data into wide tables, the problem of low efficiency in multi-table queries in big data scenarios is solved, and fast data query is achieved.
CN115017159BActive Publication Date: 2026-04-24STATE GRID DIGITAL TECHNOLOGY HOLDING CO LTD +1
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- STATE GRID DIGITAL TECHNOLOGY HOLDING CO LTD
- Filing Date
- 2022-06-24
- Publication Date
- 2026-04-24
AI Technical Summary
Technical Problem
In big data application scenarios, query efficiency is low when there are multiple related tables to query, and existing technologies are difficult to handle efficiently.
Method used
By obtaining the target query statement corresponding to the data processing instruction, parsing the dependency information of the data table, determining the data type of the business data, and judging whether there is matching data in the storage area, the data is stored in a wide table to form a wide table, thereby enabling fast data retrieval.
Benefits of technology
It improves data query efficiency, enabling users to obtain the query results they need from a single wide table, thus greatly increasing query speed.
✦ Generated by Eureka AI based on patent content.
Smart Images
Figure CN115017159B_ABST
Abstract
The application provides a data processing method and device, a storage medium and an electronic device, wherein a target query statement is acquired first; the target query statement is parsed to obtain dependency information of each data table; when receiving service data transmitted by a preset transmission queue, the data type of the service data is determined; in the case that the data type of the service data is an addition type or a modification type, a target data table to which the service data belongs is determined in each data table; whether there is data matched with the service data in a storage area is judged according to the target data table and the dependency information; if there is data matched with the service data, the service data and the data are combined to form wide table data; and the wide table data is stored in a wide table. The data matched with the service data can be determined through the dependency information of the data table, and then stored in a wide table, so that the query result required by a user can be obtained in a wide table, and the query efficiency is greatly improved.
Need to check novelty before this filing date? Find Prior Art
Citation Information
Patent Citations
Data processing method and system, electronic equipment and storage medium
CN111797157A
Data processing system, method and device and storage medium
CN112948397A