基于数据集市的数据处理方法、装置、设备和存储介质
By automating the table structure configuration and import process for external data, the problem of complexity and high error rate in importing external data into data marts has been solved, improving data import efficiency and accuracy, and saving labor costs.
CN116186039BActive Publication Date: 2026-07-17AGRICULTURAL BANK OF CHINA
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- AGRICULTURAL BANK OF CHINA
- Filing Date
- 2023-02-13
- Publication Date
- 2026-07-17
AI Technical Summary
Technical Problem
In existing technologies, the process of importing external data into data marts is complex, prone to errors, and inefficient, resulting in high manual costs and failing to meet the needs of automated processing.
Method used
By determining the table structure configuration items based on the target historical table of upstream data, a target interface table is generated. The upstream file is automatically retrieved at a preset time, decompressed, and imported into the target interface table. Data is aggregated and fed back according to the requests from downstream systems, thus achieving automated processing.
Benefits of technology
It automates the processing of external data in the data mart, reduces manual costs, and improves the efficiency and accuracy of data import.
✦ Generated by Eureka AI based on patent content.
Smart Images
Figure CN116186039B_ABST
Abstract
本发明公开了一种基于数据集市的数据处理方法、装置、设备和存储介质，包括：根据上游数据对应的目标历史表，确定上游数据的表结构配置项，并根据表结构配置项确定用于导入上游数据的目标接口表；基于上游数据的定时导入时间，获取上游系统下发的上游文件；若文件获取成功，则对上游文件进行解压处理，获取上游数据，且将上游数据导入目标接口表；根据下游系统的数据获取请求，从导入上游数据的目标接口表中提取出下游系统的目标数据，并对目标数据进行汇总，确定宽表；根据宽表，以及宽表的表格属性确定请求反馈表，并将请求反馈表发送至下游系统。提高了外部数据导入数据集市时的数据导入效率和数据导入准确性。
Need to check novelty before this filing date? Find Prior Art