Unlock instant, AI-driven research and patent intelligence for your innovation.

Implementation method of bayonet data crossing border based on hadoop big data platform

A technology of a big data platform and an implementation method, which is applied in the field of cross-border information and data at checkpoints, can solve problems such as narrow application fields, and achieve the effect of improving efficiency, meeting big data processing requirements, and ensuring data transmission.

Active Publication Date: 2018-01-19
ANHUI SUN CREATE ELECTRONICS
View PDF4 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The current data cross-border processing method is limited to a certain service field on the same network segment, for example, it is only for the transmission of messages, not all kinds of data information, and the application field is narrow. Therefore, for data cross-border also dwarfs in problem handling

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Implementation method of bayonet data crossing border based on hadoop big data platform
  • Implementation method of bayonet data crossing border based on hadoop big data platform
  • Implementation method of bayonet data crossing border based on hadoop big data platform

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] like figure 1 As shown in FIG. 1, a method for implementing the cross-border of bayonet data based on the Hadoop big data platform includes: (1) the bayonet grabbing server 11 of the video network 10 regularly grabs the passing car from the Hadoop big data platform of the front-end traffic bayonet information data, and store the data in the first Oracle database 121 of the service front-end computer 12, and the service front-end computer 12 regularly fetches the passing picture address URL stored in the server 11 through the FTP protocol to the front-end traffic card (2) The border gateway 20 interacts with the first Oracle database 121 of the service front-end 12 of the video network 10 in a polling manner, and obtains the first Oracle database 121 of the service front-end 12 (3) The border gateway 20 synchronizes the obtained passing information data and passing pictures to the service server 31 of the public security network 30 by ferry; (4) The data center system 32...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a checkpoint data crossing boundary implementation method based on a Hadoop big data platform, comprising: a checkpoint grabbing server of a video network regularly captures passing vehicle information data from a Hadoop big data platform of a traffic checkpoint, and stores the data access to the business front-end processor, and the business front-end processor regularly captures the URL stored in the checkpoint server through the FTP protocol to download the pictures of passing vehicles from the traffic checkpoint server; the border gateway interacts with the first Oracle database in a polling manner to obtain Incremental data information; the border gateway writes the obtained vehicle passing information data and passing vehicle pictures into the business server of the public security network; the data center system regularly grabs the passing vehicle information data from the second Oracle database of the business server, and at the same time from the second Oracle database 2. Obtain the passing car pictures from the FTP picture library. The present invention reads and transmits data information in a multi-threaded manner, and has high processing efficiency; the method for processing cross-boundary data is flexible, and can be applied to different systems for data cross-boundary processing; and solves the problem of mass data cross-boundary transmission.

Description

technical field [0001] The invention relates to the technical field of checkpoint passing information data passing through the boundary, in particular to a method for implementing checkpoint data passing through the boundary based on a Hadoop big data platform. Background technique [0002] With the advancement of safe city and smart city projects, the safe city bayonet system has generated a large amount of data. According to statistics, the Ping An Hefei bayonet system generates more than 1 million pieces of data every day. A hot spot in urban construction, traditional data storage methods can no longer meet current business needs. More than 1 million pieces of data are processed on average over 10 pieces of data per second. If you directly read all fields of batch information from the Hadoop big data platform, it will It greatly reduces the efficiency of data processing, and also has great restrictions on data transmission. [0003] Data crossing the boundary is the proc...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30H04L29/08
Inventor 范联伟余保华高景银武永涛
Owner ANHUI SUN CREATE ELECTRONICS