Innovation platform data management method and system based on location network

Abstract

The invention provides a method and a system for innovation platform data management based on place net for innovation platform data management based on a place net. The method comprises steps of constructing a frame of an innovation platform by using the service provided by the place net, storing data information of a place net database and information of user operation to the frame of the innovation platform so as to establish the innovation platform by using HBase and the Hadoop Distributed File System (HDFS) of a Hadoop platform, regarding the HDFS and the HBase provided by the innovation platform as the support of file storage and database storage, packaging an application program interface (API) which is accessed by a user by using platform parameters, achieving the operation and management of a distributed file system and a database through a cloud desk for the user, packaging common relational algebra algorithms and distributed data mining algorithms in accordance with a Mapreduce programming framework, integrating the development environment and conducting data preprocessing. According to the method, by the aid of the conveying and calculation of the place and the service data of the place net, relative data information is provided for the establishment of the place net, and data calculation operation and management ports are provided for the expansion of the platform API.

Description

technical field [0001] The invention relates to the field of cloud computing, in particular to a location network-based innovation platform data management method and system. Background technique [0002] The location network server stores a large number of user location information resources, network distribution location information resources, and related service information resources, and provides a related service expansion platform. Therefore, we have built a location network innovation platform on the service platform it provides. At the same time, because the location network uses the MySql database as its location data storage support, with the increase in the number of users, this data storage method will not be suitable for the storage of massive data, so it is necessary to use a database that can store massive data and has good real-time access The database is used as the storage support for location data, so we can consider using Hadoop's HBase distributed databa...

AI Technical Summary

Problems solved by technology

[0004] Hadoop itself also provides HDFS with webpage display and simple operation functions, but the operation functions provided are few and not practical, and the display form of the webpage is not suitable for ordinary users, and the user experience is poor.

Although the Hadoop file system can be mounted locally based on tomcat and Web-Dav, this also requires users to download, configure and install related software, which is obviously cumbersome for some users (such as data analysts), and What it offers right now is not perfect

At the same time, the HBase distributed database provided by the Hadoop platform provides access interfaces in different languages ​​and can be operated through hbase shell commands, but these methods make the database unsuitable for ordinary users.

Images