Method and device for receiving data

A data receiving method and a technology for running data, which are applied in the field of communication, can solve the problems of PingbackServer CPU usage increase, real-time calculation path delay increase, real-time data filtering path delay, etc.

A data receiving method and a technology for running data, which are applied in the field of communication, can solve the problems of PingbackServer CPU usage increase, real-time calculation path delay increase, real-time data filtering path delay, etc.

CN107329832BActive Publication Date: 2021-01-22BEIJING QIYI CENTURY SCI & TECH CO LTD
6 Cites 0 Cited by

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for receiving data
  • Method and device for receiving data
  • Method and device for receiving data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0037] see figure 2 , this embodiment discloses a data receiving method. figure 2 ISO, Android, IPad, PC, and Service are different types of clients. The PingBack cluster includes multiple PingBack servers. Each PingBack server has a disk to store the running data sent by each client. The running data saved in the disk within a preset period is sent to HDFS for batch processing. At the same time, each PingBack server will maintain a local queue, occupying ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The method provides a low-latency PingBack data receiving method and device. According to the method and device, a real-time data filtering path is separated from a batch processing path. Operating data is stored in a local queue of a PingBack server in the real-time data filtering path, so that order placing in the PingBack server is avoided; real-time filtration of the operating data is conducted in a common resource pool, the operating data stored in the local queue needs to be read only once, a plurality of filtration rules stored in the common resource pool are loaded, the operating data is filtered according to the filtration rules separately, and a task of data filtering is transferred from the PingBack server to the common resource pool. According to the method and device, reading of the operating data received from a client in the PingBack server for multiple times is avoided, the occupancy rate of CPU resources of the PingBack server is reduced, and delay of the real-time data filtering path is lowered.

Description

technical field [0001] The present invention relates to the technical field of communications, and more specifically, to a data receiving method and device. Background technique [0002] Online applications, especially various client applications, will report some running information to the server through buried points. By collecting this information, you can detect the health status of the online application, or collect some indicators of the user's use of the service, so as to improve the application or enhance the user experience. This method of collecting application information through buried points is called the Pingback data collection mechanism. The general structure is as follows figure 1 shown. [0003] At present, the process of receiving Pingback data is that each terminal or online service application sends data to each server in the Pingback cluster, and each server writes the data to the disk Disk after receiving the data, and the business setting filter rul...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
22 Jan 2021
Publication
CN107329832B
IPC
G06F9/50; G06F9/54; G06F11/30
CPC
G06F9/5038; G06F9/5088; G06F9/546; G06F11/302; G06F11/3072
Inventors
马元文