Crossroad data border-crossing implementation method based on Hadoop big data platform

A technology of a big data platform and an implementation method, which is applied in the field of checkpoint passing vehicle information data crossing boundaries, can solve problems such as narrow application fields, achieve the effects of improving efficiency, meeting the requirements of big data processing, and ensuring data transmission

Active Publication Date: 2015-07-01
ANHUI SUN CREATE ELECTRONICS
View PDF4 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The current data cross-border processing method is limited to a certain service field on the same network segment, for example, it is only for the transmission of messages, not all kinds of data information, and the application field is narrow. Therefore, for data cross-border also dwarfs in problem handling

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Crossroad data border-crossing implementation method based on Hadoop big data platform
  • Crossroad data border-crossing implementation method based on Hadoop big data platform
  • Crossroad data border-crossing implementation method based on Hadoop big data platform

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] Such as figure 1 As shown, a checkpoint data crossing implementation method based on the Hadoop big data platform includes: (1) the checkpoint grabbing server 11 of the video network 10 regularly captures passing vehicles from the Hadoop big data platform of the front-end traffic checkpoint information data, and store the data into the first Oracle database 121 of the business front-end processor 12, and the business front-end processor 12 regularly captures the traffic passing picture address URL stored in the server 11 from the checkpoint to the traffic card at the front end through the FTP protocol (2) The border gateway 20 interacts with the first Oracle database 121 of the service front-end processor 12 of the video network 10 in a polling manner to obtain the first Oracle database 121 of the service front-end processor 12 (3) The border gateway 20 synchronizes the obtained passing vehicle information data and passing vehicle pictures to the service server 31 of th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a crossroad data border-crossing implementation method based on a Hadoop big data platform. The method includes the steps that a crossroad capture server of a video network captures passing car information data from the Hadoop big data platform of a traffic crossroad regularly, the data are stored in a service front-end processor, and the service front-end processor loads passing car images from a traffic crossroad server according to the URL stored in the crossroad capture server through the FTP regularly; a border gateway interacts with a first Oracle database in a polling mode to obtain incremental data information; the border gateway writes the passing car information data and the passing car images into a service server of the public security network; a data center system regularly captures passing car information data from a second Oracle database of the service server and obtains passing car images from a second FTP image library. Data information is read and transmitted in a multithreading mode, the processing efficiency is high, the border-crossing data processing mode is flexible, the method can be applied to different systems to process border-crossing data, and mass data border-crossing transmission is realized.

Description

technical field [0001] The invention relates to the technical field of checkpoint crossing vehicle information data crossing boundaries, in particular to a method for implementing checkpoint data boundary crossing based on a Hadoop big data platform. Background technique [0002] With the advancement of Safe City and Smart City projects, the checkpoint system of Safe City has generated a large amount of data. According to statistics, the checkpoint system of Ping An Hefei generates more than 1 million pieces of data every day. How to process these data in a timely, fast and efficient manner has become an issue for Ping An As a hot spot in urban construction, the traditional data storage method can no longer meet the current business needs. More than 1 million pieces of data can process more than 10 pieces of data per second on average. If all the fields of batch information are directly read from the Hadoop big data platform, the The efficiency of data processing is greatly ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30H04L29/08
Inventor 范联伟余保华高景银武永涛
Owner ANHUI SUN CREATE ELECTRONICS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap