Distributed RDF stream data processing method, system and device and medium

A processing method and distributed technology, applied in the computer field, can solve the problems of low execution efficiency, high resource occupancy, inability to realize parallel processing, etc., and achieve the effect of reducing resource occupancy and improving execution efficiency.

Active Publication Date: 2020-06-30
SOUTH CHINA NORMAL UNIVERSITY
View PDF4 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Since each operator in the logical query plan of these centralized RSP systems is physically executed in the same thread, parallel processing cannot be achieved, resulting in high resource usage and low execution efficiency.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed RDF stream data processing method, system and device and medium
  • Distributed RDF stream data processing method, system and device and medium
  • Distributed RDF stream data processing method, system and device and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0058] The present invention will be further explained and described below in conjunction with the accompanying drawings and specific embodiments of the description. For the step numbers in the embodiment of the present invention, it is only set for the convenience of explanation and description, and there is no limitation on the order of the steps. The execution order of each step in the embodiment can be carried out according to the understanding of those skilled in the art Adaptive adjustment.

[0059]In the prior art, in order to process RDF stream data, the extension of SPARQL is generally continuously queried through the RSP system. Since each operator in the logical query plan of these centralized RSP systems is physically executed in the same thread, parallel processing cannot be achieved. Moreover, the logical query plans of these RSPs are based on two-way connections, and the number of connections is high and the cost is high. Therefore, when faced with a large amo...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a distributed RDF stream data processing method, system and device and a medium, and the method comprises the steps: configuring a logic operator, and deploying a big data stream processing distributed platform; obtaining a user query request; analyzing the user query request into a query statement in an algebraic form; processing the query statement in the algebraic form by adopting a greedy multi-path connection algorithm and the configured logic operator to generate a logic query plan; converting the logic query plan into a physical plan, wherein the physical plan can be executed and deployed by the big data stream processing distributed platform; based on the logic operator, performing distributed execution on the physical plan through the big data stream processing distributed platform to obtain a processing result stream. According to the method, parallel distributed query processing of the RDF stream data is realized, the execution efficiency is improved,the resource occupancy rate can be reduced, and the method can be widely applied to the technical field of computers.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a distributed RDF stream data processing method, system, device and medium. Background technique [0002] With the rapid development of information technology, people use more and more electronic products such as computers and mobile devices, and more and more devices that can be connected to the network, and the degree of informatization is becoming higher and higher. For example, the ward monitoring system continuously generates information streams of patients' physical indicators. At the same time, in the Web Internet, such as Youtube, Facebook, etc., real-time data streams of various topics are constantly being generated. The integration and use of these heterogeneous streaming data has become a difficult, time-consuming and labor-intensive task. [0003] Among them, RDF (resource description framework) is a framework proposed by WWW to describe information on the World W...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/2455G06F16/2458G06F16/242G06F16/248
CPCG06F16/24568G06F16/2471G06F16/2433G06F16/248Y02D10/00
Inventor 郑滔刘梦赤
Owner SOUTH CHINA NORMAL UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products