Big data analysis processing system and method

Abstract

The embodiment of the invention belongs to the technical field of big data, and relates to a big data analysis processing system and method. The system comprises a data acquisition module, an edge computing server, an artificial intelligence processing module, a big data analysis module, and an application access module. The data acquisition module is used for acquiring video image data of each distributed acquisition point in real time, and performing balanced forwarding through a Kafka forwarding service; the edge computing server is used for pre-processing video image data and pushing the pre-processed video image data to the artificial intelligence processing module; the application access module is used for caching multiple paths of video image data and performing structured analysis processing on the video image data to obtain multi-dimensional structured image information, outputting the multi-dimensional structured image information to the big data analysis module, performing professional storage and big data analysis, and providing a quick search interface for the application access module through a distributed real-time search engine; and the application access module is used for providing an access interface for the application platform access system. The working efficiency of the big data application is improved.

Description

technical field [0001] The present invention relates to the field of big data technology, in particular to a big data analysis and processing system and method. Background technique [0002] With the rapid development of the information age, video surveillance has basically achieved full coverage of the city, which has made great progress in my country's smart public security police system, smart city construction and application, but with the advent of the big data era has also brought new Opportunities and Challenges. The utilization efficiency of information resources has become an important indicator in the era of big data. How to solve the massive data utilization, quickly dig out effective information value, and improve the efficiency and accuracy of decision-making is the top priority of public security to promote intelligence and informatization. Heavy. The public security "big data construction" work is a work system supported by information application, with data ...

AI Technical Summary

Problems solved by technology

[0003] At present, the public security system only stores the video images collected by the front-end video surveillance system in the form of video files on the public security video network. The information is quickly and accurately excavated, resulting in a manual operation mode with huge workload and extremely low efficiency

And with the construction of smart city and public security video applications entering a new stage, and the further expansion of social security management's demand for video, it is hoped that the establishment of a comprehensive and comprehensive real-time acquisition, storage, efficient search, analysis and utilization of a large amount of video data will become more and more popular. is getting higher and higher, and the technology existing in the existing video image monitoring system cannot meet the requirements of the above-mentioned deep-level applications

Images