Disk storage method and device, message pushing method and device and electronic equipment

A technology for storing messages and disk storage. It is used in electrical digital data processing, instruments, input/output to record carriers, etc. It can solve the problem that high concurrency scenarios cannot be deduplicated, and achieve the effect of efficient deduplication storage.

Active Publication Date: 2018-09-25
ALIBABA CLOUD COMPUTING LTD
View PDF9 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Embodiments of the present invention provide a disk storage method and device, a message push method and device, and electronic equipment to solve the defect that existing technologies cannot deduplicate in high-concurrency scenarios, and realize efficient deduplication and storage of massive messages

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Disk storage method and device, message pushing method and device and electronic equipment
  • Disk storage method and device, message pushing method and device and electronic equipment
  • Disk storage method and device, message pushing method and device and electronic equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0034] figure 2 It is a flowchart of an embodiment of the disk storage method provided by the present invention, and the execution body of the method may be the business system described in the above embodiments. Such as figure 2 As shown, the disk storage method includes the following steps:

[0035]S201. Acquire keywords of messages to be stored.

[0036] For different application scenarios, the business system can set different keywords based on one or several specific attributes of the message. When the business system receives a message to be stored, it obtains the keywords set in advance.

[0037] S202, according to the bitmap index of the stored message, use the Bloom filter to perform the heavy judgment operation based on the above keywords on the message to be stored and the stored message, wherein the stored message is stored in the disk, and the bitmap of the stored message Indexes are stored in memory.

[0038] In the embodiment of the present invention, it ...

Embodiment 2

[0044] image 3 It is a flow chart of another embodiment of the disk storage method provided by the present invention. Such as image 3 As shown, on the basis of the foregoing embodiments, the disk storage method provided in this embodiment may further include the following steps:

[0045] S301. Acquire keywords of messages to be stored.

[0046] S302, using a Bloom filter to perform a weight judgment operation based on the above keywords on the message to be stored and the stored message.

[0047] S303, judging the above weight judgment result, if it is repeated, execute step S304; if it is not repeated, execute step S306.

[0048] In the embodiment of the present invention, when the heavy judgment result is not repeated (that is, the keywords in the message to be stored and the stored message are not repeated), the message to be stored is written to the disk; when the heavy judgment result is repeated, because There is a misjudgment in the Bloom filter. At this time, the...

Embodiment 3

[0057] Figure 4 It is a flow chart of another embodiment of the disk storage method provided by the present invention. Such as Figure 4 As shown, the subject of execution of the method may be a business system capable of storing massive data in a high-concurrency scenario, and the disk storage method may include the following steps:

[0058] S401. Acquire keywords of messages to be stored.

[0059] S402. In the memory, perform a weight judgment operation based on the above-mentioned keywords on the message to be stored and the stored message.

[0060] S403, judging the above weight judgment result, if it is repeated, execute step S404; if it is not repeated, execute step S406.

[0061] In the embodiment of the present invention, when the heavy judgment result is not repeated (that is, the keywords in the message to be stored and the stored message are not repeated), the message to be stored is written to the disk; when the heavy judgment result is repeated, because There...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a disk storage method and device, a message pushing method and device and an electronic device. The disk storage method include acquiring key word of a messageto be stored; conducting repetition judgement operation on the message stored and to be stored based on the key word according to the bitmap index of the stored message using the Bloom filter, wherein the stored message is saved in the disk with its bitmap index stored in the random access memory; processing the message to be stored according to the repetition judgement result. The embodiment ofthe disk storage method and device, message pushing method and device and electronic equipment judges the message repetition according to the bitmap index using the Bloom filter, and performs repetition removal or information storage operation according to the repetition judgement result, which can complete searching among voluminous message under low random access memory occupation condition, andrealize highly efficient voluminous message repetition-free storage.

Description

technical field [0001] The invention relates to the technical field of data storage, in particular to a disk storage method and device, a message push method and device, and electronic equipment. Background technique [0002] In the field of data storage technology, the content stored in files by most storage engines is divided into two parts: log (Log) and index (LogIndex). Among them, Log is used to store the detailed content of each message (Record); LogIndex is used to store the keyword (key) of the Record and the offset of the Record in the Log file, and some also store other related content of the Record. [0003] If the storage engine needs to deduplicate (deduplicate records when storing records), the usual solution is to retrieve them directly through the LogIndex, which has the advantage of being able to deduplicate the entire Log globally. [0004] In the process of implementing the present invention, the inventor found at least the following problems in the prio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06G06F17/30
CPCG06F3/0608G06F3/0641
Inventor 刘振东王小瑞冯嘉
Owner ALIBABA CLOUD COMPUTING LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap