Method and device for recording valid data based on HAWQ, and medium

A technology of effective data and data, applied in the direction of database indexing, structured data retrieval, special data processing applications, etc., can solve the problem that the HAWQ benchmark table cannot be deleted and modify historical records, and achieve the effect of improving call efficiency

Active Publication Date: 2020-01-07
北京浪潮数据技术有限公司
View PDF5 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of the embodiment of the present invention is to provide a method, device and computer-readable storage medium for record

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for recording valid data based on HAWQ, and medium
  • Method and device for recording valid data based on HAWQ, and medium
  • Method and device for recording valid data based on HAWQ, and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0053] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0054] In order to enable those skilled in the art to better understand the solution of the present invention, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0055] Next, a method for recording valid data based on HAWQ provided by an embodiment of the present invention is described in detail. figure 1 A flow chart of a method for recording valid data base...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a method and a device for recording valid data based on HAWQ and a medium, and the method comprises the steps: calling a preset script program, and generatingan HAWQ reference table and an HAWQ view; and setting a corresponding field identifier for the source data according to the operation type corresponding to the received source data. And the source data and the field identifier corresponding to the source data are added into the HAWQ reference table as a record. And a corresponding field identifier is set for the source data, and a fact which record is added and which record is modified and which record is deleted is effectively recorded. Only data can be added into the HAWQ reference table; data modification and deletion are not supported; therefore, the HAWQ reference table has a lot of invalid data; in order to improve the data calling efficiency, effective data can be screened out from an HAWQ reference table according to a key value and a field identifier corresponding to each record, and the effective data is stored in an HAWQ view, so that the problem that historical records cannot be deleted and modified by the HAWQ reference table is solved.

Description

technical field [0001] The present invention relates to the technical field of data storage, in particular to a method, device and computer-readable storage medium for recording valid data based on HAWQ. Background technique [0002] HAWQ is Hadoop's native SQL query engine, which combines the key technical advantages of MPP database with the scalability and convenience of Hadoop. HAWQ reads data locally from HDFS and writes data to HDFS. Because the data in the current HDFS file can only be added, and modification or deletion is not allowed, so the data in the HAWQ benchmark table only allows the addition mode, and does not allow modification and deletion modes. [0003] However, in practical applications, some data records often need to be modified or deleted multiple times. Since the data in the HAWQ benchmark table is only allowed to be added, when a certain data in the HAWQ benchmark table needs to be modified, new data can only be added to the HAWQ table, and it is n...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/22G06F16/21
CPCG06F16/2282G06F16/21Y02D10/00
Inventor 谭博
Owner 北京浪潮数据技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap