Data mining REST service platform based on cloud computing

A data mining and service platform technology, applied to electrical components, transmission systems, etc., can solve problems such as inability to cope with massive data processing and low product returns, and achieve the effects of reduced coupling, low cost, and improved utilization

Active Publication Date: 2015-09-30
ZHEJIANG UNIV OF TECH
View PDF2 Cites 28 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] In order to overcome the shortcomings of existing data mining service methods that cannot handle massive data processing and low product returns, the present invention provides a cloud computing-based data mining REST service platform that is effectively applicable to massive data processing and has high product returns.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data mining REST service platform based on cloud computing
  • Data mining REST service platform based on cloud computing
  • Data mining REST service platform based on cloud computing

Examples

Experimental program
Comparison scheme
Effect test

example

[0080] Example: Platform Rest service interface test

[0081] The service platform test mainly includes two parts, one is to test the Rest service interface of the platform, and the other is to test the cloud mining service SDK. The Rest service interface test is completed through SoapUI. By simulating Http requests on SoapUI, you can view the return value and execution time of each service interface on the platform. The cloud service SDK test uses the JUnit framework to judge whether the API of the SDK returns the expected value through Assert assertion. The cluster environment and software version used in the test are shown in Table 6:

[0082] name

configuration and version

Hadoop, Spark cluster

1 master, 8 workers

server

Tomcat 7.0.57

Rest framework

Jersey 2.15

Rest service testing framework

SoapUI 4.5.2

SDK test framework

Junit 4.1

[0083] Table 6

[0084] SoapUI is a mainstream open source too...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data mining REST service platform based on cloud computing. The data mining REST service platform comprises a cloud computing clustering layer, an algorithm engine layer, a data mining service engine layer and a cloud mining service SDK (software development kit), the cloud computing clustering layer is used for providing cloud storing and parallel computing capacity, the algorithm engine layer is used for providing parallel data mining capacity and providing various parallel algorithm libraries, the data mining service engine layer is used for outwards providing mining cloud services, all services are outwards exposed through a Restful interface, and the cloud mining service SDK is used for providing a mode of locally calling the mining cloud services to use data mining and analyzing functions in business systems by introducing the cloud mining service SDK into other business systems. The data mining REST service platform is effectively suitable for mass data processing and high in product profit.

Description

technical field [0001] The invention relates to the technical field of data mining, in particular to a data mining REST service platform. Background technique [0002] With the rapid development of the Internet, mobile Internet, and the Internet of Things, the types and scale of data in human society are growing at an unprecedented rate. According to the research report of IDC, the total amount of data generated in China in 2013 exceeded 0.8ZB (equivalent to 800 million TB), twice that of 2012, which is equivalent to the total amount of data in the world in 2009. It is estimated that by 2020, the total amount of data in China will be 10 times that of 2013, and how to extract valuable information from massive data will become an urgent problem to be solved. Data mining is the process of extracting potentially useful information and knowledge hidden in a large amount of incompletely noisy actual data, and it can effectively discover valuable information in large-scale data. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08
CPCH04L67/10
Inventor 陈铁明张旭
Owner ZHEJIANG UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap