Big data real-time processing method, device and equipment

A real-time processing and big data technology, applied in the computer field, can solve problems such as high database access pressure and slow analysis speed, and achieve the effect of improving real-time processing efficiency and data analysis speed

Pending Publication Date: 2021-03-16
CHINA UNITED NETWORK COMM GRP CO LTD
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] This application provides a big data real-time processing method, device and equipment to solve the problem

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data real-time processing method, device and equipment
  • Big data real-time processing method, device and equipment
  • Big data real-time processing method, device and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0054] In order to make the purpose, technical solutions and advantages of this application clearer, the technical solutions in this application will be clearly and completely described below in conjunction with the accompanying drawings in this application. Obviously, the described embodiments are part of the embodiments of this application , but not all examples. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

[0055] With the development of the Internet, the proportion of e-commerce in daily consumption is gradually increasing. And with the development of e-commerce, the business data and log information generated on the business platform will also continue to increase. Currently, users usually analyze service data on the service platform through data analysis. For example, Ali’s double 11 sales big screen. The metho...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a big data real-time processing method, device and equipment. The method comprises the step that a server uses a DTS to monitor a service platform; when the service data is generated in the service platform, the server acquires the service data through the DTS; the server obtains the service data through the DTS and adds the service data into the consumption message queue; and the server can use the Flink framework to realize consumption of the target data in the consumption message queue to obtain a processing result. According to the method, the data analysis speed isincreased, and the real-time processing efficiency of the data is improved.

Description

technical field [0001] The present application relates to computer technology, and in particular to a method, device and equipment for real-time processing of big data. Background technique [0002] With the development of the Internet, the proportion of e-commerce in daily consumption is gradually increasing. And with the development of e-commerce, the business data and log information generated on the business platform will also continue to increase. [0003] In the prior art, for real-time analysis of data access information and log information, the data in the database is usually acquired through kettle, and then the data analysis is realized. [0004] However, with the increase of business information and access data, the existing data analysis method has the problem of heavy database access pressure, which easily leads to slow analysis speed. Contents of the invention [0005] The present application provides a big data real-time processing method, device and equip...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/2457G06F16/248G06F16/25G06F11/30
CPCG06F16/24578G06F16/252G06F16/248G06F11/302G06F11/3051
Inventor 刘海龙胡博张滨董慧周俊儒赵宇
Owner CHINA UNITED NETWORK COMM GRP CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap