Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and device for processing network data, server and storage medium

A network data and network processing technology, applied in the network field, can solve problems such as reducing system scalability and slowing down the speed of Nginx, so as to achieve the effect of smooth data flow, improve scalability, and reduce downstream pressure

Active Publication Date: 2021-02-26
BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD +1
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In the process of realizing the present invention, the inventor found that the prior art has at least the following technical problems: the bottleneck of this design lies in the high coupling between the receiving logic in the lua language and Nginx, which will slow down the speed of Nginx under high concurrency and reduce the system performance. Scalability, the sudden increase in network traffic data during e-commerce promotions can only be resolved through capacity expansion

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for processing network data, server and storage medium
  • Method and device for processing network data, server and storage medium
  • Method and device for processing network data, server and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027]Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. However, it should be understood that these descriptions are only exemplary and are not intended to limit the scope of the present disclosure. In addition, in the following description, descriptions of well-known structures and technologies are omitted to avoid unnecessarily obscuring the concept of the present disclosure.

[0028]The terms used here are only for describing specific embodiments, and are not intended to limit the present disclosure. The words "a", "a (kind)" and "the" used herein shall also include the meanings of "plurality" and "multiple", unless the context clearly dictates otherwise. In addition, the terms "including", "including", etc. used herein indicate the existence of the described features, steps, operations and / or components, but do not exclude the existence or addition of one or more other features, steps, operations or components .

[0029]All terms (inc...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present disclosure provides a method for processing network data, including: storing received network data in a first buffer; parsing the network data from the first buffer; sending the parsed network data to a message queue system; if If sending fails, the parsed network data is stored in the second buffer. The disclosure improves the scalability, fault tolerance and stability of processing network data by setting two buffers.

Description

Technical field[0001]The present disclosure relates to network technology, in particular to methods and devices, servers and storage media for processing network dataBackground technique[0002]The first link of big data is network data collection. Network data collection is generally done by burying points on the user side, and then reporting network data to the server through the Http protocol after burying the points. This kind of reported data is characterized by massive data and high concurrency requirements, because each click will generate one or more reports. This requires the http server to have high concurrency and high throughput.[0003]The existing solution is to use high-performance web server Nginx+lua. Nginx is a high-performance web server that can be used to receive data, and lua is a lightweight scripting language that can be used to do simple calculations. Then you can send network data to kafka and record offline files. Among them, kafka is a disk-based message queu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06G06F9/54
CPCG06F3/0619G06F3/0656G06F3/067G06F9/546
Inventor 安海雄
Owner BEIJING JINGDONG SHANGKE INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com