Real-time processing method and device based on big data

A technology of real-time processing and big data, applied in the computer field, can solve problems such as increasing the cost of learning, unfavorable real-time data processing business maintenance, etc., and achieve the effect of reducing the cost of learning

Pending Publication Date: 2020-06-02
BEIJING QIHOO TECH CO LTD
View PDF5 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Therefore, when processing data in real time, professional real-time data processing personnel are often required to compile the corresponding execution code according to the grammatical characteristics of the selecte

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real-time processing method and device based on big data
  • Real-time processing method and device based on big data
  • Real-time processing method and device based on big data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0026] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0027] The big data-based real-time processing method and device provided by the present invention can be applied to a preset big data processing system. Such as figure 1 As shown, the preset big data processing system includes: a service interface 11 , an analysis module 12 , a routing module 13 , multiple computing engines 14 and multiple storage engines 15 .

[0028] Wherein, the service interface 11 provides at least one exter...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a real-time processing method and device based on big data. The method comprises the following steps of: receiving a query statement in a specific language format, which is input by utilizing any external calling mode; carrying out grammar analysis and verification on the query statement, and generating a logic query plan; determining whether a storage engine correspondingto the logic query plan comprises a real-time data storage engine or not according to the logic query plan; and if so, converting the query statement into a corresponding real-time calculation task, so as to enable a real-time data storage engine to execute the real-time calculation task. By the adoption of the scheme, a user can process big data in real time only through the input query statementin the specific language format, the learning cost of the user for the real-time data storage engine is reduced, and maintenance of real-time processing services is facilitated.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a real-time processing method and device based on big data. Background technique [0002] With the continuous development of technology and society, all kinds of data are growing in a blowout style. In the process of processing massive data, people usually involve real-time processing of data, for example, real-time statistics of the number of active users or the status of user loss, and so on. [0003] Compared with offline data processing, real-time data processing has the characteristics of long task cycle maintenance time and high compilation difficulty. Therefore, when processing data in real time, professional real-time data processing personnel are often required to compile the corresponding execution code according to the grammatical characteristics of the selected real-time data calculation engine or real-time data storage engine, thereby improving the user's ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/242
Inventor 刘思源朱海龙李铭徐胜国徐皓李铮
Owner BEIJING QIHOO TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap