Massive fragment data aggregation system and method

A technology of data aggregation and fragmentation, which is used in electrical digital data processing, special data processing applications, instruments, etc., can solve problems such as indeterminate and disordered reception, and achieve the effect of saving server resources.

Inactive Publication Date: 2012-05-16
BEIJING ANTIY NETWORK SAFETY TECH CO LTD
View PDF3 Cites 24 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0009] The number of the above two kinds of fragment files is uncertain. Due to different clients uploading fragments and network delays, the server also receives these fragments out of order.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Massive fragment data aggregation system and method
  • Massive fragment data aggregation system and method
  • Massive fragment data aggregation system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0113] In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present invention, and to make the above-mentioned purposes, features and advantages of the present invention more obvious and easy to understand, the technical solutions in the present invention will be further detailed below in conjunction with the accompanying drawings illustrate.

[0114] Such as figure 1 As shown, it is a schematic diagram of a system for mass segment data aggregation in the present invention, including a segment upload module 101 at the client end, a cache module 102 at the server end, a verification library module 103, a file storage module 104, a segment receiving module 105, a segment processing module 106, Segment merging module 107, segment aggregation module 108;

[0115] Wherein, the file storage module 104 includes three parts, a file location library 1041 , a file cache library 1042 and a file final storage library 1043 .

...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a massive fragment data aggregation system for two kinds of massive fragment data. The system comprises a fragment uploading module of a client, and a cache module, a verification library module, a document storage module, a fragment receiving module, a fragment processing module, a fragment combination module and a fragment aggregation module of a server. Correspondingly, the invention also discloses a massive fragment data aggregation method. By the system and the method, a plurality of technologies such as message queuing services, memory banks, document databases, daemon processes and the like are adopted, so that the massive fragment data can be highly efficiently processed and combined; and a strict combination strategy is adopted, so that combination accuracy is ensured.

Description

technical field [0001] The invention relates to the field of computer databases, in particular to a system and method for processing, merging and converging massive segment data. Background technique [0002] In the computer field, there is such a class of files, called fragments, which are part of an overall file or data. And divided into two types: [0003] 1. Fragments themselves have no independent meaning, and must be completely combined to form a whole to be meaningful. For example multimedia files: pictures, videos, music. When uploading, in order to upload quickly and occupy less network bandwidth, it is split into several small file fragments, and then upload the file fragments separately. After the server receives the fragments, it merges them according to certain rules. Save the merged complete file on the server side. [0004] Such fragments are: [0005] There is a whole first - cut into individuals - uploaded to the server side - the server side reassemble...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 王亮孙晋超杨祖明张栗伟
Owner BEIJING ANTIY NETWORK SAFETY TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap