Data lake-based data management system and method

A data management system and data technology, applied in the field of big data, can solve the problems of cumbersome construction process, and achieve the effect of reducing the cumbersome degree and the number of development

Pending Publication Date: 2021-02-02
HANGZHOU HIKVISION DIGITAL TECH
View PDF0 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Obviously, since different business applications use different computing engines, and each computing engine requires different access interfaces to access different data sources, then, when using the above-mentioned related technolog

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data lake-based data management system and method
  • Data lake-based data management system and method
  • Data lake-based data management system and method

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0049] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0050] In related technologies, when using a data lake-based data management system for data management, the computing engine in the management system sends a data access request to the data source to be accessed through a pre-configured access interface that matches the data source to be accessed, and then , the data source to be accessed receives the data access request and feeds back the response result corresponding to the data access request to the computi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a data lake-based data management system and method, and relates to the technical field of big data. The system comprises a plurality of computing engines, a plurality of data sources and a virtual engine device, each computing engine is used for sending a data access request and identification information of a to-be-accessed data source to the virtual engine device and receiving a response result which is fed back by the virtual engine device and corresponds to the data access request; the virtual engine device is used for sending a data access requestto the data source with the identification information; and feeding back a response result fed back by the data source with the identification information to the computing engine sending the data access request, and each data source is used for determining a response result corresponding to the data access request and feeding back the determined response result to the virtual engine device. Compared with the prior art, by applying the system provided by the embodiment of the invention, the repeated development work in the construction process of the data management system based on the data lake can be reduced.

Description

technical field [0001] The present invention relates to the technical field of big data, in particular to a data management system and method based on a data lake. Background technique [0002] Currently, data lakes are increasingly being used in various fields, such as logistics, manufacturing, project management, business management etc. [0003] In related technologies, when using a data lake-based data management system for data management, the computing engine in the management system sends a data access request to the data source to be accessed through a pre-configured access interface that matches the data source to be accessed, Furthermore, the data source to be accessed receives the data access request and feeds back the response result corresponding to the data access request to the computing engine. [0004] Obviously, since different business applications use different computing engines, and each computing engine requires different access interfaces to access d...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/27G06F16/242G06F16/21
CPCG06F16/27G06F16/2433G06F16/21Y02D10/00
Inventor 李锐陈国栋霍元浩臧其涛
Owner HANGZHOU HIKVISION DIGITAL TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap