Big data processing method and device

A big data processing and data technology, applied in the field of big data, can solve problems such as system crashes

Inactive Publication Date: 2018-02-09
无线生活(杭州)信息科技有限公司
View PDF3 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] In the existing big data tables, the data is very rich and diverse, and the amount of data is huge. It is possible to range from hundreds of thousands to millions or even hundreds of millions. What does the data look like, which is convenient for data analysis and application. For example, the underlying modeling of the data warehouse is the cornerstone of data analysis. How to find garbage data during modeling; Data fetching has very strict requirements on the data forma

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data processing method and device
  • Big data processing method and device
  • Big data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] The preferred embodiments of the present invention will be described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described here are only used to illustrate and explain the present invention, and are not intended to limit the present invention.

[0044] There are generally two ways to obtain the form of big data in the existing technology. The first is the fast way, which is not comprehensive enough. For example, how much data needs to be sampled to fully understand the entire data. The second, comprehensive method, is not fast and concise enough. Some algorithm engineers and data analysts may use statistical knowledge to analyze data in detail, which is too time-consuming and highly professional. Not everyone can do it. Do it, understand it. There is currently no quick, easy, and comprehensive way to understand what the data in tens or billions of tables looks like. However, the present invention solves th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a big data processing method and device, and is used for simply, quickly and integrally reflecting the data form of data. The method comprises the following steps that: obtaining target data to be processed; obtaining a preset data form key index, wherein the data form key index comprises the own attribute information of the data; and according to the preset data form key index, determining the data form of the target data to be determined. By use of the technical scheme, the key index is used for reflecting the data form of certain part of data so as to simply, quicklyand integrally reflect the data form of the data.

Description

technical field [0001] The present invention relates to the field of big data technology, in particular to a big data processing method and device. Background technique [0002] In the existing big data tables, the data is very rich and diverse, and the amount of data is huge. It is possible to range from hundreds of thousands to millions or even hundreds of millions. What does the data look like, which is convenient for data analysis and application. For example, the underlying modeling of the data warehouse is the cornerstone of data analysis. How to find garbage data during modeling; Data fetching has very strict requirements on the data format, such as the length and style of the field displayed, or whether null values ​​are allowed. One piece of data that is not processed in place is likely to crash the system applied to the data; set data cleaning requirements and When making a plan, you must also find out what the data in the table looks like; through the abnormality...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/22G06F16/215
Inventor 王颖
Owner 无线生活(杭州)信息科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap