System and method for developing big data application

Abstract

The invention discloses a system and a method for developing a big data application. The method comprises the following steps: developing the big data application based on a big data application framework and a plug-in; reading data from a data source and verifying the validity of the data; carrying out analysis on the data and converting the data into data with a pre-set format; extracting the data with the pre-set format to obtain a field for generating an index; calculating the field to obtain the index. A module of the big data application is pluggable and the big data application is generated by assembling the plug-in under the big data application framework. The module of the big data application is pluggable and a developer of the big data application does not need to grasp a big data technology theory in a big data application development process, and only needs to develop a service logic plug-in needed by the big data application framework by utilizing a conventional application development technology; the plug-in and the big data application framework are assembled to form the big data application. Hence, a development manner based on the plug-in is adopted, so that the development efficiency of the big data application is improved and a development threshold of the big data application is reduced.

Description

technical field [0001] The invention relates to the field of big data, in particular to a system and method for developing big data applications. Background technique [0002] With the development of Internet technology and information technology, a large amount of information has been digitized, resulting in massive data collections that cannot be captured, managed and processed by conventional tools. This data collection is also called big data. [0003] Big data has massive data scale and diverse data types, and it is a huge challenge to process and analyze these massive and streaming data. In order to better carry out data statistical analysis on big data, big data tools came into being. [0004] Big data tools can be used to develop various big data applications to process massive amounts of data. In the existing technology, big data tools can be used to develop big data applications. The development process is generally a big data development environment built by big...

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to provide a system for big data application development, the purpose is to solve the problem that the threshold of big data application development in the prior art is relatively high, so that the de

Images