Road rage monitoring method, system and device based on facial and respiratory characteristics and medium

A facial feature and face technology, applied in computer parts, character and pattern recognition, instruments, etc., can solve problems such as increasing the driver's burden, driver's discomfort, affecting the driver's normal driving behavior, etc., to improve the recognition rate and robustness, high reliability effect

Active Publication Date: 2019-07-09
SHANDONG UNIV
View PDF8 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

These signal acquisition devices increase the driver's burden, may make the driver feel uncomfortable, and affect the driver's normal driving behavior

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Road rage monitoring method, system and device based on facial and respiratory characteristics and medium
  • Road rage monitoring method, system and device based on facial and respiratory characteristics and medium
  • Road rage monitoring method, system and device based on facial and respiratory characteristics and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0040] Such as figure 1 As shown, the road rage detection method based on facial and respiratory features includes:

[0041] Obtain the driver's facial video and breathing data;

[0042] Extracting facial region images from facial videos, and extracting facial features from acquired facial region images;

[0043] extracting breath features from the acquired breath data;

[0044] Perform feature fusion on the collected facial features and breathing features;

[0045] Input the fused features into the trained deep learning model, and output the road rage monitoring status.

[0046] As an embodiment, the specific steps of extracting the face area image from the face video are:

[0047] Select a facial image with a set duration, extract a frame of facial images at intervals of a set time period, extract a total of several frames of facial images, and perform smoothing and denoising processing on each frame of facial images extracted;

[0048] For several frames of images afte...

Embodiment 2

[0119] Embodiment 2: A road rage monitoring system based on facial and breathing features is provided;

[0120] Road rage monitoring system based on facial and breathing features, including:

[0121] Acquisition module, used to obtain the driver's facial video and breathing data;

[0122] The facial feature extraction module is used to extract the facial area image from the facial video, and extracts the facial features from the acquired facial area image;

[0123] Breath feature extraction module, for extracting breath feature from the breath data that obtains;

[0124] The feature fusion module is used to perform feature fusion on the collected facial features and respiratory features;

[0125] The road rage status monitoring module is used to input the fused features into the trained deep learning model and output the road rage monitoring status.

Embodiment 3

[0126] Embodiment 3: This embodiment also provides an electronic device, including a memory, a processor, and computer instructions stored in the memory and run on the processor. When the computer instructions are executed by the processor, each step in the method is completed. For the sake of brevity, the operation will not be repeated here.

[0127] Described electronic device can be mobile terminal and non-mobile terminal, and non-mobile terminal comprises desktop computer, and mobile terminal comprises smart phone (Smart Phone, such as Android mobile phone, IOS mobile phone etc.), smart glasses, smart watch, smart bracelet, tablet computer , laptops, personal digital assistants and other mobile Internet devices that can communicate wirelessly.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a road rage monitoring method, system and device based on facial and respiratory characteristics and a medium, and the method comprises the steps: collecting facial images andrespiratory information of a driver, carrying out the preprocessing of the facial images and the respiratory information, and extracting the characteristics which can reflect the road rage mood of thedriver; performing feature fusion on the extracted two types of features, and then establishing a driver road rage emotion recognition model based on a machine learning method; the model can judge whether the driver is in a road rage state or not, and can adjust the road rage mood of the driver according to the result. Due to the fact that the image and the respiratory information easy to collectare used, the emotional state of the driver can be detected under the condition that normal driving of the driver is not affected, and when the driver is in the road rage emotion, the driver can be reminded, warned and adjusted through the audio device.

Description

technical field [0001] The present disclosure relates to a road rage monitoring method, system, device and medium based on features of facial images and breathing information. Background technique [0002] The statements in this section merely mention background art related to the present disclosure and do not necessarily constitute prior art. [0003] In the process of realizing the present disclosure, the inventors found that the following technical problems existed in the prior art: [0004] "Road rage" refers to the aggressive or angry behavior of the driver of a car or other motor vehicle during driving, such as vulgar gestures, verbal insults, and intentionally driving the vehicle in an unsafe or threatening manner. Studies have shown that road rage affects drivers' normal driving. Aggressive driving, risky driving and wrong driving are all positively correlated with road rage. Nowadays, road rage driving has become an important cause of traffic accidents, so it is ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/46G06K9/62
CPCG06V40/168G06V40/20G06V20/597G06V10/507G06F18/253
Inventor 杨立才张成昱
Owner SHANDONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap