Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and device used for processing network data, server and storage medium

A network data and network processing technology, applied in the network field, can solve problems such as reducing system scalability, slowing down Nginx speed, etc., to achieve smooth data flow, improve scalability, and reduce downstream pressure.

Active Publication Date: 2017-11-17
BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD +1
View PDF3 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In the process of realizing the present invention, the inventor found that the prior art has at least the following technical problems: the bottleneck of this design lies in the high coupling between the receiving logic in the lua language and Nginx, which will slow down the speed of Nginx under high concurrency and reduce the system performance. Scalability, the sudden increase in network traffic data during e-commerce promotions can only be resolved through capacity expansion

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device used for processing network data, server and storage medium
  • Method and device used for processing network data, server and storage medium
  • Method and device used for processing network data, server and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. It should be understood, however, that these descriptions are exemplary only, and are not intended to limit the scope of the present disclosure. Also, in the following description, descriptions of well-known structures and techniques are omitted to avoid unnecessarily obscuring the concepts of the present disclosure.

[0028] The terminology used herein is for the purpose of describing particular embodiments only, and is not intended to be limiting of the present disclosure. The words "a", "an" and "the" used herein shall also include the meanings of "plurality" and "multiple", unless the context clearly indicates otherwise. In addition, the terms "comprising", "comprising", etc. used herein indicate the existence of stated features, steps, operations and / or components, but do not exclude the existence or addition of one or more other features, steps, operations or comp...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a method used for processing network data. The method comprises the following steps that: storing received network data into a first buffer zone; analyzing the network data from the first buffer zone; sending the analyzed network data to a message queue system; and if the analyzed network data fails in being sent, storing the analyzed network data into a second buffer zone. By use of the method, two buffer zones are arranged to improve scalability, fault tolerance and stability for processing the network data.

Description

technical field [0001] The present disclosure relates to network technologies, in particular to methods and devices for processing network data, servers and storage media Background technique [0002] The first link of big data is network data collection. Network data collection is generally done by burying points on the client side, and then reporting the network data to the server through the Http protocol after burying the points. This kind of reported data is characterized by massive data and high concurrency requirements, because each click will generate one or more reports. This requires the http server to have high concurrency and high throughput. [0003] The existing solution is to use high-performance web server Nginx+lua. Nginx is a high-performance web server that can be used to receive data, and lua is a lightweight scripting language that can be used to do simple calculations. Network data can then be sent to kafka, and logged to offline files. Among them,...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06G06F9/54
CPCG06F3/0619G06F3/0656G06F3/067G06F9/546
Inventor 安海雄
Owner BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com