ARM and FPGA-based intelligent analysis system and analysis method of web camera

Abstract

The invention discloses an ARM and FPGA-based intelligent analysis system and analysis method of a web camera. The system includes a streaming media capture module, a streaming media decoding module and an image recognition and processing module; an RTSP streaming media client is adopted as the streaming media capture module; an ARM-based hardware decoder is adopted as the streaming media decoding module; the RTSP streaming media client operates in the system of a decoding ARM and is connected with the web camera and the hardware decoder; the image recognition and processing module is provided with an FPGA-based hardware accelerator; and the decoding ARM is connected with an FPGA through a PCle high-speed bus. With the ARM and FPGA-based intelligent analysis system and analysis method of the web camera of the invention adopted, the end-to-end delay of an image and image recognition can be compressed within 300 ms, for example, the delay of a 60-frame video stream is smaller than 20 frames. The system is simple in structure and can be connected into an existing IPC network.

Description

technical field [0001] The invention relates to the field of streaming media transmission, in particular to an analysis system and analysis method of an intelligent network camera based on ARM and FPGA. Background technique [0002] The web camera is called WEBCAM for short, and the English full name is WEB CAMERA. It is a new generation of camera produced by combining traditional camera and network technology. Professional software, as long as a standard web browser (such as "Microsoft IE or Netscape), you can monitor its image. [0003] Network camera is a new generation product combining traditional camera and network video technology. In addition to having all the image capture functions of general traditional cameras, it also has a built-in digital compression controller and a WEB-based operating system, which makes video data compressed and encrypted. Finally, it is sent to the end user through the local area network, internet or wireless network. The remote user can...

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to provide a kind of analysis system based on the intelligent network camera of ARM and FPGA, it solves the problem that the current network camera is difficult to access the image recognition processing module, the RTSP stream media client of the very low delay that runs on ARM end serves as The access port of the network camera is used to collect and decode multiple video streams at the same time, and then transmit the decoded images to the FPGA through PCIe, and use the CNN hardware accelerator of the FPGA to recognize the target in real time

Images