Unlock instant, AI-driven research and patent intelligence for your innovation.

Data reading method, device and apparatus and storage medium

A data reading and device technology, applied in the field of big data, can solve problems such as outdated Oracle snapshots, system business blocking, and database locks on all tables.

Pending Publication Date: 2020-07-14
PING AN TECH (SHENZHEN) CO LTD
View PDF5 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] There are a large number of data tables stored in the Oracle database. Due to the huge amount of data, when a large number of changes are made to the database, the database will lock the entire table, and the long-term space occupation will cause the exception that the Oracle snapshot is too old.
However, the existing cursor segmentation processing scheme will occupy a large amount of space and cause abnormal operation, and cannot be executed concurrently, occupying too many system resources, and easily causing system business congestion, thereby greatly reducing data processing efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data reading method, device and apparatus and storage medium
  • Data reading method, device and apparatus and storage medium
  • Data reading method, device and apparatus and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0039] The data reading device mainly involved in the embodiments of the present invention refers to a network connection device capable of realizing network connection, and the data reading device may be a server, a cloud platform, or the like. In addition, the mobile terminal involved in the embodiment of the present invention may be a mobile network device such as a mobile phone or a tablet computer.

[0040] refer to figure 1 , figure 1 It is a schematic diagram of the hardware structure of the data reading device involved in each embodiment of the present invention. In the embodiment of the present invention, the data reading device may include a processor 1001 (eg, Central Processing Unit, CPU), a communication bus 1002 , an input port 1003 , an output port 1004 , and a memory 1005 . Wherein, the communicatio...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data reading method, device and apparatus and a storage medium, and the method comprises: obtaining a target data table, extracting the physical address information of the target data table, and generating a to-be-processed task table according to the physical address information; determining a single data processing amount according to a preset service demand, and segmenting the to-be-processed task table into one or more data blocks according to the single data processing amount; and generating a pseudo row of rowids of one or more data blocks, and reading the target data table according to the rowids. Based on big data, the target data table is divided into a plurality of data blocks and then data reading is carried out, so that the data processing efficiency is improved.

Description

technical field [0001] The present invention relates to the technical field of big data, in particular to a data reading method, device, equipment and storage medium. Background technique [0002] There are a large number of data tables stored in the Oracle database. Due to the huge amount of data, when a large number of database changes are made, the database will lock the entire table, and the long-term space occupation will cause the Oracle snapshot to be too old. However, the existing cursor segmentation processing solution will occupy a large amount of space and cause abnormal operation, and cannot be executed concurrently, occupying and consuming too many system resources, which will easily cause system business congestion, thereby greatly reducing data processing efficiency. Therefore, how to improve the efficiency of data processing is a technical problem to be solved urgently. Contents of the invention [0003] The invention provides a data reading method, device...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/22G06F16/25
CPCG06F16/2282G06F16/254
Inventor 帅宇
Owner PING AN TECH (SHENZHEN) CO LTD