Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Intelligent analysis method for information big data

An intelligent analysis and big data technology, applied in the field of big data analysis, can solve the problems of low efficiency of large data sets, achieve more flexibility and efficiency, and reduce the effect of data transmission

Pending Publication Date: 2021-08-20
河南华正通信息技术有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This distributed storage system implementation has proven to be inefficient for updating large datasets on the order of terabytes

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Intelligent analysis method for information big data
  • Intelligent analysis method for information big data
  • Intelligent analysis method for information big data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention more clear, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0031] The invention provides a scheme for querying and analyzing intelligence data in a distributed block storage area. The distributed column block storage area is provided by an object storage cluster connected to the client. The object storage cluster includes:

[0032] Data conversion engine, used to divide the data tab...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an intelligence big data intelligent analysis method which comprises the steps: providing a column block storage area in an object storage cluster, wherein the column block storage area is provided with a striped partition data table; transmitting the column blocks from the object storage cluster to a plurality of parsing nodes of an intelligence analysis server; receiving a query request from a client, so that the plurality of analysis nodes perform distributed parallel processing on the query of the data table divided into the column blocks; caching a subset of column blocks associated with the query request to execute a transaction sequence of the query request in the cached subset of column blocks; and obtaining execution results of the transaction sequences of the query requests executed by the plurality of analysis nodes, and combining the execution results of the transaction sequences of the query requests executed by the other analysis nodes by the current analysis node. According to the method, data transmission among a plurality of nodes in the column block storage area is reduced, more flexibility and efficiency are provided in the aspect of query processing, and the method is particularly suitable for data mining of business intelligence application.

Description

technical field [0001] The invention belongs to the field of big data analysis, in particular to an intelligent analysis method for intelligence big data. Background technique [0002] With the rapid development of the mobile Internet, the data volume of business intelligence has exploded. By analyzing the business behavior of partners, discovering potential market demands and risks is an effective means to enhance value and management level. However, the large amount of data has brought challenges to traditional data analysis and processing techniques. And the existing distributed storage systems cannot be seamlessly extended to business intelligence analysis and mining applications that require fast and efficient retrieval and processing of large amounts of data. For example, for terabytes of data, distributed storage systems usually store table data in a specific format, such as storing horizontally partitioned tables on multiple servers to store subsets of data rows in...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/2455G06F16/27G06F8/41G06K9/62
CPCG06F16/24553G06F16/27G06F8/42G06F18/2135
Inventor 梁斌魏保磊史国恩刘娟梁芳支敏刘波孟罡张有为许光辉刘振杰胡建峰郭波
Owner 河南华正通信息技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com