Library mass data analysis and decision-making system for unstructured data

Abstract

The invention discloses a library mass data analysis and decision-making system for unstructured data. The system comprises an unstructured data acquisition module, a big data parallel computing module, a big data parallel analysis module and an unstructured data decision-making module, wherein the unstructured data acquisition module is responsible for acquiring the mass heterogeneous unstructured data, performing primary processing and remotely transmitting the acquired data; the big data parallel computing module mainly completes the storage, indexing, computing analysis and Hadoop computing management operation of the mass data transmitted by the unstructured data acquisition module, and submits a computing result to the big data parallel analysis module; the big data parallel analysismodule is responsible for customizing, analyzing and displaying the result of the unstructured data dimension and measurement; and the unstructured data decision module provides the scientific data decision support for a library by utilizing an analysis result of the big data parallel analysis module.

Description

technical field [0001] The invention belongs to the technical field of big data analysis, and relates to a library mass data analysis and decision-making system for unstructured data. Background technique [0002] With the development of Internet, cloud computing, sensor network and high-speed mobile transmission technology, the world's data environment presents 5 "Volume, Variety, Velocity, Value and Veracity" V" feature. According to IDC monitoring, the total amount of global data doubles about every two years. It is estimated that by 2020, the total amount of global data will reach 35ZB, indicating that the world has entered the era of big data. [0003] In the era of big data, the library's IT system organizational structure and reader service model have undergone tremendous changes, resulting in the library's data structure changing from the traditional two-dimensional table structure to logically express services, business, transactions, customer information, etc. St...

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to provide a Hadoop-based library unstructured big data analysis and decision-making system. In order to overcome the problem that the traditional library data management platform cannot accurately describe and efficiently store and manage unstructured data, by using "data Drive" as the basis for unstructured big data analysis and decision-making, continuously strengthen the availability and controllability management of unstructured big data in collection, noise filtering, value extraction and storage, effectively improving the real-time analysis of unstructured data , human-computer interaction, scientific evaluation and feedback optimization level, as well as the scientific and usability level of library big data decision-making, to achieve reliable big data decision support for personalized readers' reading activities

Images