HFile based data batch loading method
A data and batch technology, applied in the field of data processing, can solve the problems of low data loading efficiency and time-consuming, and achieve the effect of improving recording efficiency, avoiding excessive time and improving efficiency
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment Construction
[0053] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings and examples.
[0054] The present invention provides a method for loading data in batches based on HFile, such as figure 1 shown, including the following steps:
[0055] Pre-divide the partition Region to form multiple partition Regions corresponding to the HFile file one by one;
[0056] Read source data records, respectively determine the HFile file to be written to each source data record, and write the source data record into its corresponding HFile file;
[0057] The HFile that has been written to the source data records is loaded to its corresponding partition Region.
[0058] In a typical embodiment of this application, the following methods can be used to form multiple partition Regions corresponding to HFile files one-to-one:
[0059] When pre-partitioning...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com