Unlock instant, AI-driven research and patent intelligence for your innovation.

Method and system for data calculation

A data computing and data technology, applied in the field of data analysis, can solve problems such as the inability to provide millisecond-level intensive aggregate computing, and achieve the effect of reducing maintenance costs and simplifying testing methods.

Active Publication Date: 2020-04-10
MASHANG CONSUMER FINANCE CO LTD
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, when performing a single intensive data calculation request, the existing technology cannot provide support for millisecond-level intensive aggregation calculations

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for data calculation
  • Method and system for data calculation
  • Method and system for data calculation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments It is a part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

[0032] see below figure 1 , figure 1 It is a flow chart of a data calculation method provided in the embodiment of this application;

[0033] Specific steps can include:

[0034] Step S101: Preprocessing the external data to obtain the data to be calculated;

[0035] Among them, this solution has received external data by default before performing...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for data calculation. The method includes the steps of conducting preprocessing on external data to obtain data to be calculated; parallelly sending the data to be calculated to a preset quantity of calculation units; storing the data to be calculated into memories of the calculation units, and conducting calculation through a distributed-type SQL calculation engine to obtain a calculation result, wherein the distributed-type calculation engine is formed by transforming an open-source SQL engine and a distributed-type calculation middleware base layer; by adopting the method, millisecond-level intensive calculation of data can be achieved, decrease of maintenance costs is facilitated, and test modes are simplified. The invention further discloses a system for the data calculation which has the advantages above.

Description

technical field [0001] The invention relates to the field of data analysis, in particular to a method and system for data calculation. Background technique [0002] With the rapid development of science and technology, big data technology has become an extremely widely used technology, that is, to improve the "processing ability" of data by mastering huge data information for specialized processing, and to realize the "value-added" of data through "processing". ". [0003] Big data requires special techniques to efficiently process large amounts of data that tolerate elapsed time, including massively parallel processing databases, data mining, distributed file systems, distributed databases, cloud computing platforms, the Internet, and scalable storage systems . In the existing technology, most of the real-time calculations are based on JStorm / storm or Spark. JStorm itself performs aggregation calculations for data within a certain time window. However, when performing a ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/25
Inventor 鹿凌华廖家绪田亚
Owner MASHANG CONSUMER FINANCE CO LTD