Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and device for establishing detecting model and detecting mobile phone calling/answering behavior

A detection model and mobile phone technology, applied in the detection field, can solve problems such as the inability to automatically detect the driver's mobile phone behavior and hidden safety hazards in the traffic system, and achieve the effect of ensuring local characteristics, ensuring global characteristics, and improving accuracy

Active Publication Date: 2017-06-09
BOCOM SMART INFORMATION TECH CO LTD
View PDF4 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Therefore, the technical problem to be solved by the present invention is that in the prior art, it is impossible to automatically detect whether the driver has a mobile phone behavior during driving, which makes the traffic system a potential safety hazard.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for establishing detecting model and detecting mobile phone calling/answering behavior
  • Method and device for establishing detecting model and detecting mobile phone calling/answering behavior
  • Method and device for establishing detecting model and detecting mobile phone calling/answering behavior

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0028] This embodiment provides a method for establishing a human face and hand detection model, which can be used to establish a related model for identifying whether the driver has a mobile phone behavior during driving, such as figure 1 shown, including the following steps:

[0029] S11: Label the first face information and first hand information when the user does not answer or call the mobile phone in the sample image, and the second face information and second hand information when the user answers or calls the mobile phone, and generate annotated training In the sample, the first and second face information include face features and face location information respectively, and the first and second hand information include hand features and hand location information. For example, if the user is the driver, the image can be obtained by collecting historical video streams in the cockpit. Generally, the car is equipped with a camera. Since the camera is installed on the fron...

Embodiment 2

[0035] This embodiment provides a method for detecting the behavior of calling and receiving mobile phones, which can be used to identify whether the driver has the behavior of calling and receiving mobile phones during driving, such as figure 2 shown, including the following steps:

[0036] S21: Acquire a target image. For example, for the behavior detection process of the driver in the traffic system, the target image can be obtained by collecting the real-time video stream in the cockpit. Generally, the car is equipped with a camera. Since the camera is installed on the front windshield of the car, through The camera installed in the car collects images of the driver's seat area, which can clearly capture the driver's behavior without the assistance of other electronic devices, and will not affect the driver's normal driving.

[0037] S22: Input the target image into the human face and hand detection model established by the method for establishing a human face and hand d...

Embodiment 3

[0041] This embodiment provides a device for establishing a face and hand detection model, which can be used to establish a related model for identifying whether the driver has a mobile phone behavior during driving, such as image 3 Shown, comprise: labeling module 31, extraction module 32 and training module 33, each module function is as follows:

[0042] Annotation module 31 is used for labeling the first face information and the first hand information when the user does not answer and call the mobile phone in the sample image, and the second face information and the second hand information when the user answers and calls the mobile phone, and generates For the training sample after marking, the first and two face information include face features and face position information respectively, and the first and second hand information include hand features and hand position information. For details, refer to step S11 in embodiment 1. A detailed description.

[0043] The extr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a method and a device for establishing a detecting model and detecting a mobile phone calling / answering behavior. The method for establishing the model comprises the steps of marking first face information and first hand information when a user in a sample image is not calling / answering a mobile phone, and second face information and second hand information in calling / answering the mobile phone, generating a marked training sample, wherein the first face information and the second face information respectively comprise face characteristics and face position information, the first hand information and the second hand information respectively comprise hand characteristics and hand position information; respectively extracting a characteristic graph of the training sample by means of five layers of convolution, connecting pooling characteristic graphs which correspond with a third-layer convolution, a fourth-layer convolution and a fifth-layer convolution; and inputting the characteristic graphs into a convolutional neural network for training, thereby obtaining a face detection model and a face detecting model. The method and the device provided by the invention ensure a global characteristic and a local characteristic of the characteristic graph so that the characteristic graphs represent the characteristics of the training sample in a more comprehensive and accurate manner. Furthermore accuracy of the face detecting model and accuracy of the hand detecting model are improved.

Description

technical field [0001] The invention relates to the technical field of detection, in particular to a method and device for establishing a detection model and detecting behaviors of calling and receiving mobile phones. Background technique [0002] Intelligent transportation system is the development direction of the future transportation system, and it is also a frontier research topic in the field of transportation in the world. With the development of computer vision technology, embedded technology, and network communication technology, research on the automatic detection system of vehicle violations has become a research hotspot in current intelligent transportation. As an important measure to ensure the safe driving of drivers and reduce the fatality rate in traffic accidents, with the development of modern communication technology, the behavior of drivers using mobile phones while driving has become a major cause of traffic accidents. It is deplorable that the increase...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62
CPCG06V40/20G06V20/597G06F18/214
Inventor 谢波刘彦张如高
Owner BOCOM SMART INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products