Driver posture recognition method based on depth images and virtual data

A deep image and recognition method technology, which is applied in image data processing, 3D image processing, character and pattern recognition, etc., can solve the problems of inability to learn image multi-level structure features, manual extraction of image features is time-consuming and inefficient, virtual data characteristics and Problems such as large differences in real application scenarios can achieve the effects of improving detection accuracy, reducing differences, reducing time-consuming and inefficient

Active Publication Date: 2018-07-31
NANJING UNIV OF SCI & TECH
View PDF11 Cites 45 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The purpose of the present invention is to solve the problems in the above-mentioned driver gesture recognition technology, such as manual extraction of image features is time-consuming and inefficient, shallow learning

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Driver posture recognition method based on depth images and virtual data
  • Driver posture recognition method based on depth images and virtual data
  • Driver posture recognition method based on depth images and virtual data

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0059] The present invention will be further described below in conjunction with the drawings.

[0060] The driver posture recognition method of the present invention includes three main processes: driver joint point detection, virtual driver head posture data set construction, and driver head posture analysis.

[0061] The data source of the present invention is a driver's depth image obtained from a depth image acquisition device, such as figure 1 Shown. The value of each pixel on the depth image represents the distance from the object point to the projection center of the camera, and the shape information and three-dimensional position information of the driver can be obtained through this value. The depth image can be obtained by a binocular vision device or a structured light projection device.

[0062] The driver's joint point detection process is to detect the position of the driver's joint points in the image. The driver's joint points refer to the driver's head, neck, waist...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a driver posture recognition method based on depth images and virtual data. The method includes driver joint detection: the driver depth image and the joint label are used as the input of a deep learning framework Caffe, a deep convolution neural network model is trained, and the joint position of a driver in the image is detected through a deep learning model; virtual driver head posture data set establishment: a driver model is constructed through the modeling function of the three-dimensional modeling software, the head movement of the driver is set by utilizing theanimation function, the driver images is rendered in batches by utilizing the rendering function, the head segmentation processing is carried out on the driver images, and the virtual driver head posture data set is constructed; driver head posture analysis: a deep migration learning model is trained by means of a migration learning method according to the virtual driver head posture data obtainedby the virtual driver head posture data set construction process, and the driver head posture in the target domain image is estimated and the facial feature point position is detected.

Description

technical field [0001] The present invention relates to the fields of computer vision and vehicle assisted driving, and more specifically, relates to a driver gesture recognition method based on depth images and virtual data. Background technique [0002] Driver gesture recognition is an important research topic in the field of vehicle assisted driving, and it is the application of human gesture recognition technology in real scenes. Image-based driver pose recognition refers to detecting the driver's upper body joints, estimating the head pose, and detecting facial feature points in a given driver image. The computer can analyze the driver's posture, and finally realize the warning of the driver's dangerous behavior, and achieve the purpose of reminding the driver. [0003] The input of image-based driver gesture recognition is usually a visible light image. Extract the features of various parts of the human body from the image, such as color, edge, contour, shape, etc., ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/62G06T15/00G06T13/40G06N3/04G06N3/08
CPCG06T13/40G06T15/005G06N3/08G06V20/597G06N3/045G06F18/2413
Inventor 刘柯柯刘亚洲孙权森
Owner NANJING UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap