DSL-based big data development and application method and device
An application method and big data technology, applied in the direction of program code conversion, creation/generation of source code, code compilation, etc., can solve the problems of poor performance, inability to realize data processing functions, and high use thresholds
Active Publication Date: 2019-07-02
深圳前海信息技术有限公司
View PDF3 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
The above three tools are currently popular big data development and application tools. They can effectively complete the data processing function of one or more stages of big data development and application work, but they cannot realize all stages of big data development and application work. data processing functions
[0004] Although the existing big data development and application methods can process data in a distributed big data system, the functions are relatively single, the performance is not very good, and the threshold for use is relatively high. It is difficult to realize simple and efficient development of data in specific fields application
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0039] It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.
[0040] refer to figure 1 , is a schematic diagram of the steps of the DSL-based big data development and application method in an embodiment of the present invention.
[0041] An embodiment of the present invention proposes a DSL-based big data development and application method, including:
[0042] Step S1, call the function meta-module from the data processing function module library, and use DSL syntax to establish a data application model in a specific field;
[0043] Step S2, running the above-mentioned data application model, analyzing and converting the above-mentioned data application model into an object code script through a DSL parser;
[0044] Step S3, run the above object code script on the distributed big data system, and return the running result.
[0045] At present, many big data development and ap...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention proposes a DSL (Domain Specific Language)-based big data development and application method and apparatus. The method comprises the steps of calling a function unit module from a data processing function module library and establishing a data application model in a specific field by adopting DSL grammar; running the data application model, and analyzing and converting the data application model into a target code script through a DSL analyzer; and running the target code script in a distributed big data system, and returning a running result. According to the DSL-based big data development and application method and apparatus provided by the invention, data processing functions of all stages in big data development and application work are realized; and simple and efficient development and application of data in the specific field are realized through a domain specific language.
Description
technical field [0001] The invention relates to the field of big data development and application, in particular to a DSL-based big data development and application method and device. Background technique [0002] With the advent of the era of big data, data has shown explosive growth and has penetrated into every industry and business field today, becoming an important factor of production. In different industries and business fields, the source, type structure, processing method and application method of data all have their own characteristics; this leads to the high complexity of big data development and application. How to realize the efficient development and application of data in a specific field and reduce the threshold for big data developers, data scientists, and domain experts to develop and apply big data has become an urgent problem to be solved. [0003] At present, many big data development and application solutions based on distributed big data platforms Had...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F8/41
CPCG06F8/31
Inventor 郭宇翔王界兵张伟董迪马梁猛宋泰然李杰
Owner 深圳前海信息技术有限公司