Unlock instant, AI-driven research and patent intelligence for your innovation.

A method for loading data into a database

A database and data technology, applied in the field of big data, can solve problems such as migration obstacles

Inactive Publication Date: 2019-01-08
佛山市苔藓云链科技有限公司
View PDF1 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, migrating data using traditional technologies involves many complexities, leading to barriers to migration

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method for loading data into a database

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0025] Such as figure 1 Shown is a schematic diagram of a method for loading data into a database according to the present invention, the method comprising:

[0026] receiving a request to import data into a computing environment having at least a distributed data storage system to provide non-relational data storage, the data imported from an external source via an application programming interface (API);

[0027] Analyze one or more characteristics of the request to determine whether the request corresponds to a request to import a large data load;

[0028] If the request is for a large data load, it causes the data to be temporarily stored;

[0029] Create one or more data management jobs to store staged data in one or more nodes of the distributed data storage system;

[0030] sending one or more data management jobs to one or more corresponding nodes in the distributed data storage system;

[0031] Make one or more jobs execute asynchronously to have staged data stored...

Embodiment 2

[0043] A non-transitory computer-readable medium having stored thereon instructions that, when executed by one or more processors, are configurable to cause the one or more processors to:

[0044] receiving a request to import data into a computing environment having at least a distributed data storage system to provide non-relational data storage, the data imported from an external source via an application programming interface (API);

[0045] Analyze one or more characteristics of the request to determine whether the request corresponds to a request to import a large data load;

[0046] If the request is for a large data load, it causes the data to be temporarily stored;

[0047] Create one or more data management jobs to cause staged data to be stored in one or more nodes of the distributed data storage system;

[0048] sending one or more data management jobs to one or more corresponding nodes in the distributed data storage system;

[0049] Make one or more jobs execut...

Embodiment 3

[0061] A system capable of loading data into a database environment with relational and non-relational data stores, the system comprising:

[0062] physical storage device;

[0063]One or more hardware processors, coupled to physical storage devices, one or more hardware processors configurable to receive requests to import data into a computing environment having at least a distributed data storage system to provide non-relational data storage , to import data from an external source through an application programming interface (API), analyze one or more characteristics of the request to determine whether the request corresponds to a request to import a large data load, in order to stage the data while the request is being used for the requested large data load , to create one or more data management jobs to store staged data in one or more nodes of the distributed data storage system, to send the one or more data management jobs to one or more corresponding nodes. A distrib...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A method for loading data into a database includes receiving a request to import data into a computing environment having at least a distributed data storage system to provide non-relational data storage, the data being imported from an external source via an application programming interface (API); analyzing one or more characteristics of the request to determine whether the request corresponds to a request to import a large data load; if the request is for a large data load, causing the data to be scratched; creating one or more data management jobs to store phased data in one or more nodesof a distributed data storage system; sending one or more data management jobs to one or more corresponding nodes in the distributed data storage system; causing one or more jobs to execute asynchronously so that phased data is stored in one or more nodes.

Description

technical field [0001] The present invention relates to the technical field of big data, in particular, to a method for loading data into a database. Background technique [0002] When an individual / organization has a large amount of data, it is common to store the data on devices belonging to different environments. For example, organizations can build large volumes of data over an extended period of time before deciding to switch to a cloud-based environment. This data is migrated to a cloud-based environment where it can be better utilized. However, migrating data using traditional technologies involves many complexities, leading to barriers to migration. [0003] How to load a large amount of data into the database so that the data can be called as needed is a difficult problem in the storage and analysis of massive data. Contents of the invention [0004] The present invention proposes a method for loading data into a database, the method comprising: [0005] rece...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/22G06F16/25G06F16/28
Inventor 刘慧刘灿霞
Owner 佛山市苔藓云链科技有限公司