Data processing method and device and electronic equipment

A data processing and sample data technology, applied in the field of data processing, can solve problems such as redundant decompression operations and cache occupation, and achieve the effects of reducing disk usage, improving efficiency, and improving performance

Pending Publication Date: 2021-10-22
BEIJING BYTEDANCE NETWORK TECH CO LTD
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This will cause redundant decompression operations and cache usage
[0004] It can be seen that the existing data reading operation has redundant decompression operations and technical problems of cache occupation

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device and electronic equipment
  • Data processing method and device and electronic equipment
  • Data processing method and device and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0065] Embodiments of the present disclosure will be described in detail below in conjunction with the accompanying drawings.

[0066] Embodiments of the present disclosure are described below through specific examples, and those skilled in the art can easily understand other advantages and effects of the present disclosure from the contents disclosed in this specification. Apparently, the described embodiments are only some of the embodiments of the present disclosure, not all of them. The present disclosure can also be implemented or applied through different specific implementation modes, and various modifications or changes can be made to the details in this specification based on different viewpoints and applications without departing from the spirit of the present disclosure. It should be noted that, in the case of no conflict, the following embodiments and features in the embodiments can be combined with each other. Based on the embodiments in the present disclosure, a...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a data processing method and device and electronic equipment, and belongs to the technical field of data processing.The method comprises the steps of acquiring an identifier of a to-be-read target record, wherein the target record is any record in a data set; searching a storage area of the target record according to the identifier of the target record in a first corresponding relationship between a pre-stored record identifier and a record storage area; in a storage space corresponding to the data set, acquiring compressed data stored in a storage area of the target record, wherein the compressed data comprises at least one pointer; according to a preset second corresponding relation between pointers and sample data, replacing the pointers of the compressed data with the corresponding sample data to acquire all data of the target record. Through the data processing scheme disclosed by the invention, the efficiency of data reading operation is improved, and unnecessary decompression operation and cache occupation are reduced.

Description

technical field [0001] The present disclosure relates to the technical field of data processing, and in particular to a data processing method, device and electronic equipment. Background technique [0002] The data in the database consists of many records, which are called data collections. In order to distinguish each record in the data set, the records are numbered. In order to reduce the data storage space, the data is usually compressed and stored. The existing data compression scheme is as follows: divide all the records in the data set into multiple blocks, each block contains several records with adjacent numbers, and use a common compression algorithm to individually compress each block as a whole. Then build an index for multiple blocks, called block index. [0003] When reading data, you need to use the block index to locate the block where the record number to be searched is located, decompress the block, and then extract the record with the corresponding numb...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/22G06F16/2455G06F16/174
CPCG06F16/2246G06F16/2272G06F16/2455G06F16/1744
Inventor 雷鹏
Owner BEIJING BYTEDANCE NETWORK TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap