Face and pedestrian perception system based on depth camera

A technology of depth camera and perception system, which is applied in the field of face and pedestrian perception system, can solve the problems that developers cannot develop applications, do not allow developers to develop source code, and have no modularization, so as to achieve easy development and expansion, and good application The effect of value, convenience and expansion

Active Publication Date: 2017-10-27
ZHEJIANG UNIV
View PDF6 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Commercial products do not allow developers to develop their source code, which cannot satisfy developers to develop applications according to their own needs
There are also many open source object detection source codes on the Internet, but these source codes are basically only for a certain task or a single camera, and they are not modularized, so it is difficult to reuse them

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Face and pedestrian perception system based on depth camera
  • Face and pedestrian perception system based on depth camera
  • Face and pedestrian perception system based on depth camera

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0034] On the contrary, the invention covers any alternatives, modifications, equivalent methods and schemes within the spirit and scope of the invention as defined by the claims. Further, in order to make the public have a better understanding of the present invention, some specific details are described in detail in the detailed description of the present invention below. The present invention can be fully understood by those skilled in the art without the description of these detailed parts.

[0035] refer to figure 1 , the face and pedestrian perception system based on the depth camera includ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a face and pedestrian perception system based on a depth camera. The system is applied to scenes including a mobile robot, intelligent monitoring and the like. The system at least comprises three modules, wherein a hardware layer module is used for accessing various heterogeneous cameras; a driving layer module is used for unifying various camera driving interfaces through an ROS (Read-Only-Storage) system; and an application layer module comprises a face/ head detector based on a Dlib trainer and RGB(Red, Green and Blue)-D information, a pedestrian detector based on a multi-modal deep learning model and a pedestrian tracker based on a multimachine system. The system can be divided into a single-depth camera system and a multi-depth camera system by aiming at the number of cameras, the perception application of the single-depth camera system comprises face detection and identification and pedestrian detection and tracking; and the multi-depth camera system overcomes the defects of small coverage, a camera network is formed, and the cross-region long-time tracking of the pedestrian is realized.

Description

technical field [0001] The invention belongs to the field of computer vision, and in particular relates to a face and pedestrian perception system applied to a video surveillance scene or deployed on a mobile robot. Background technique [0002] Object detection is the main research basis and hotspot of computer vision system. As a basic task of computer vision, object detection is a research hotspot in academia and industry. Among them, human perception has a wide range of application significance, especially in industries such as intelligent security, unmanned driving and mobile robots. Many of the solutions in these industries use depth cameras for human perception to achieve fast, accurate and three-dimensional positioning. In some commercial and open source codes, it is generally only for a single device or a specific scenario, and it is difficult to carry out secondary development or function expansion and deletion according to user needs. Based on the above reasons...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00
CPCG06V40/161G06V40/20G06V40/10
Inventor 李玺岳亚
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products