Big data platform constructing method based on S-PLUS

A big data platform and construction method technology, applied in the construction field of S-PLUS-based big data platform, to achieve high fault tolerance, alleviate data explosion, and facilitate unified management

Inactive Publication Date: 2015-04-29
WUHAN POST & TELECOMM RES INST CO LTD
View PDF3 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Using this platform for data mining, users can solve some typical data mining problems, such as dealing with urban management, urban information system services, social supervision, public safety, etc.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data platform constructing method based on S-PLUS

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] Below in conjunction with specific embodiment, further illustrate the present invention, should be understood that these embodiments are only used to illustrate the present invention and are not intended to limit the scope of the present invention, after having read the present invention, those skilled in the art will understand various equivalent forms of the present invention All modifications fall within the scope defined by the appended claims of the present application.

[0037] The architecture of the construction method of the S-PLUS-based big data platform, as shown in Figure 1, includes the following steps:

[0038] Step 1: Infrastructure virtualization. The use of virtualization technology can realize the integrated integration and shared utilization of host and storage resources, which can not only improve resource utilization, reduce costs, but also reduce the complexity of management. Virtualize facilities, including server virtualization, storage virtuali...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a big data platform constructing method based on S-PLUS. A big data platform comprises a physical layer, a virtualization layer, a service layer and an application layer, wherein heterogeneous hardware resources are deployed on the physical layer; Eucalyptus is used to construct a virtual machine cluster on the virtualization layer, and a Hadoop environment is deployed on the virtual machine cluster; the service layer integrates S-PLUS language, realizes a data mining function and provides services; a clear operation interface is provided to a user on the application layer which has the functions of a data storage and processing system, an array operation tool, a complete and coherent statistical analysis tool and excellent statistical cartography. S-PLUS is a simple and powerful programming language and can control data input and output and realize functions of branching, circulating and user customizing. The big data platform can effectively process targets such as information system services, information monitoring and public safety which need to be paid attention to by an intelligent city system, the targets are displayed in a big data manner and results are analyzed, and high processing efficiency is achieved.

Description

technical field [0001] The present invention relates to a construction method of a big data platform based on S-PLUS, which integrates technologies such as cloud computing, virtualization and Hadoop, and integrates the S-PLUS language, and is suitable for dealing with urban management, urban information system services, social supervision, public Security and other data sets allow users to conduct data mining and analysis through the web interface. Background technique [0002] With the advancement of informatization and the construction of smart cities, the amount of data in units of cities is increasing, and smart cities will generate about 0.3PB-6.7PB of video data every day. In the application of urban systems, a large amount of massive business data is collected, which contains a large amount of unknown and potential information. Data mining is a new business information processing technology, which has been widely used in banking, telecommunications, insurance, transp...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/44G06F17/30
Inventor 肖凌罗振郭嘉许德玮
Owner WUHAN POST & TELECOMM RES INST CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products