Big data writing method and device, reading method and device, and processing system

A data writing and big data technology, applied in the communication field, can solve the problems of slow data access speed, system performance reduction, time consumption, etc., and achieve the effect of reducing time consumption, improving system performance and reducing consumption

Active Publication Date: 2017-11-21
BEIJING TRUSTMEDU SCI TECH
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

If you use a database system to store and read big data, you need to use complex algorithms, such as hash algorithms, to calculate the location of the big data on the disk and to verify various storage strategies, which will easily consume time and lead to data loss. The access speed is slow, the system performance is reduced, and the efficiency is seriously reduced

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data writing method and device, reading method and device, and processing system
  • Big data writing method and device, reading method and device, and processing system
  • Big data writing method and device, reading method and device, and processing system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0066] In order to make the above objects, features and advantages of the present invention more comprehensible, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0067] One of the core concepts of the embodiments of the present invention is that when storing, the large data is divided into multiple pieces of sub-data with the same length, and the position of the data part corresponding to the same field in the multiple pieces of sub-data is fixed in each piece of sub-data. At the same time, Adding the storage position of the current sub-data in the storage medium to each piece of sub-data, therefore, when reading, the storage position of one or more pieces of sub-data to be read is conveniently calculated according to the nature of the arithmetic sequence, In order to read quickly, when updating, since the storage location of one or more pieces of sub-data that has been read is known, it ca...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a big data write-in method and device, a big data read method and device and a big data processing system. The write-in method includes the steps that a write-in request is received; big data are segmented into multiple pieces of subdata according to the write-in request; the subdata are uniform in length, and relative positions of data parts, corresponding to the same field, in the subdata are fixed; the subdata are written in a specified storage medium; storage positions, in the storage medium, of current subdata are added to all the subdata. The big data can be positioned easily, conveniently and rapidly, time consumption is reduced, the speed of storing and reading the big data is increased, and system performance and working efficiency are improved.

Description

technical field [0001] The present invention relates to the field of communication technology, in particular to a method for writing big data, a method for reading big data, a device for writing big data, a device for reading big data, and a Big data processing system. Background technique [0002] With the development of information technology such as the Internet, big data has penetrated into every industry and business function field today and has become an important factor of production. The so-called big data refers to massive, high-growth and diversified information assets that require new processing models to have stronger decision-making power, insight and discovery and process optimization capabilities. [0003] The significance of big data is that it is generated along with the increasingly popular network behavior of human beings, collected by relevant departments and enterprises, and contains unstructured and traditional data information that contains the true i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30G06F3/06
CPCG06F3/061G06F16/2219
Inventor 曾开荣
Owner BEIJING TRUSTMEDU SCI TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap