Hadoop platform and distributed processing programming model-based TCP (transport control protocol) dataflow reassembly method
A technology of distributed processing and programming model, which is applied in the direction of error prevention/detection using return channel, digital transmission system, electrical components, etc., to achieve the effect of reducing overhead and improving operating efficiency
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
Embodiment Construction
[0025] A non-limiting embodiment is given below in conjunction with the accompanying drawings to further illustrate the present invention. It should be understood, however, that these descriptions are exemplary only, and are not intended to limit the scope of the invention. Also, in the following description, descriptions of well-known structures and techniques are omitted to avoid unnecessarily obscuring the concept of the present invention.
[0026] Such as figure 1 As shown, the present invention needs a MapReduce task, massive data is all stored in HDFS with the form of block (default 64MB), revises InputFormat and completes the mapping of fragmentation to key-value pair, and the input key-value pair of Map is , the output key-value pair is . The output of the Map goes through the Shuffle intermediate process to complete the partitioning, sorting, and merging of the output key-value pairs. Gather the "timestamp+serial number+packet payload" of the same five-tuple in the ...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com