Supercharge Your Innovation With Domain-Expert AI Agents!

Text compression method and text compression device

A text compression and text technology, applied in the direction of instruments, computing, electrical digital data processing, etc., can solve the problem of low compression rate and achieve the effect of high compression rate

Active Publication Date: 2015-04-01
PEKING UNIV +2
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Since this method compresses and decompresses Chinese text in units of bytes, it can be combined with various current compression algorithms or tools, but it is precisely because this method uses bytes as units instead of words Compression, therefore, there must be a problem of low compression ratio

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Text compression method and text compression device
  • Text compression method and text compression device
  • Text compression method and text compression device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] Hereinafter, the present invention will be described in detail with reference to the drawings and embodiments.

[0023] The technical idea of ​​the present invention is to use words as units instead of words to perform compression, thereby improving the compression ratio. In order to achieve the above object, the text compression method according to the present invention comprises the following steps:

[0024] Step S1, selecting words satisfying predetermined word length and frequency of occurrence conditions from the text to be compressed;

[0025] Step S2, assigning codes to the screening words according to the frequency of occurrence of the screening words; and

[0026] Step S3, compress the text by using the assigned code.

[0027] Wherein, steps S3 and S4 belong to the prior art and can be realized by various known technologies, therefore, their detailed descriptions are omitted in this specification. Hereinafter, step S1 will be mainly described.

[0028] fig...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a text compression method applicable to texts in non-Latin languages such as Chinese and the like. The method includes the steps: screening words meeting the conditions of a predetermined word length and the occurrence frequency from a text to be compressed; allocating codes to the screened words according to the occurrence frequency of the screened words; and utilizing the allocated codes to compress the text. Correspondingly, the invention provides a text compression device. The text compression method and the text compression device have the advantages that alternative words are extracted from the text to be compressed with one word serving as a unit and are screened according to the occurrence frequency of the alternative words, and then only the words with higher occurrence frequency are kept, so that high-frequency expansion words in data of the texts in non-Latin languages such as Chinese and the like can be effectively extracted, the total number of the coded words in a dictionary is decreased, the texts in non-Latin languages such as Chinese and the like are compressed by the aid of the codes, and the high compression ratio is acquired.

Description

technical field [0001] The invention relates to the technical field of text data processing, in particular to a compression method and device suitable for Chinese and other non-Latin language texts. Background technique [0002] At present, there are many relatively mature algorithms for Latin text compression, mainly including statistical methods (eg, Huffman algorithm) and dictionary encoding methods. However, for the compression of Chinese, Japanese, Korean and other language texts, because they cannot determine the boundaries of each word according to separators such as spaces and punctuation like Latin, and the common vocabulary of these languages ​​​​is huge in number and complex in rules, it is difficult Efficiently extract words, update word frequency, and obtain high-frequency extended words in text data by simply applying statistical methods or dictionary encoding methods for Latin languages. In addition, even if the high-frequency extended words in the text data ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
Inventor 仇睿恒胡薇
Owner PEKING UNIV
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com