Text compression method and device

A text compression and text technology, applied in the computer field, can solve the problems of large space occupation and slow transmission speed, and achieve the effects of improving efficiency, reducing compression and decompression costs, and reducing transmission volume and storage volume

Pending Publication Date: 2019-04-30
BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD +1
View PDF5 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] In view of this, the embodiments of the present invention provide a method and device for text compression, which can solve the problems of large space occupation and slow transmission speed in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Text compression method and device
  • Text compression method and device
  • Text compression method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] Exemplary embodiments of the present invention are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present invention to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

[0037] In the embodiment of the present invention, in order to solve the problems of large file storage space and slow transmission speed in the prior art, the text itself can be preprocessed, and the source file is encoded to form a concise text, so as to reduce the amount of transmission and storage. Have the effect of improving efficiency.

[0038] Embodiments of the p...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a text compression method and a text compression device, aiming at the problems of large occupied space, low transmission speed and the like in the prior art,and realizing efficient storage and transmission of mass texts by utilizing a high-frequency coding library generated by utilizing a redundant relation of information among mass text data and a big data processing technology. The method comprises the following steps: generating a category label for a source text; searching a corresponding category coding library in a high-frequency coding libraryby utilizing the category label, the high-frequency coding library being a coding library formed by coding data of a high-frequency text block, and dividing the high-frequency text block into one or more category coding libraries according to different categories to which the high-frequency text block belongs; and performing coding serialization on the source text by using the coded data in the category coding library to obtain a compressed text.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a text compression method and device. Background technique [0002] In the process of text storage and transmission, there are usually problems such as large space occupation and slow transmission speed due to redundancy of text information and duplication of known information. Take the massive text data stored in the e-commerce mall at present, such as product snapshot data, order data, financial data, etc., and a large number of historical WEB pages, etc., as an example. Most of these huge objects may be stored directly or after traditional compression. Consumes large amounts of storage media. Therefore, effective text compression techniques are needed to avoid waste of space resources during text storage or transmission. [0003] In the prior art, text compression technology has been around for a long time, and compression algorithms are becoming more and more mature, such...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/22H03M7/30
CPCH03M7/3084G06F40/146
Inventor 赵辉杨丽敏刘诏薛韬
Owner BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products