59 results about "Distracted driving" patented technology

The invention discloses a distraction driving detection model based on domain self-adaption, and aims to solve the problem that the performance of an existing distraction driving detection model is reduced due to the fact that distribution differences exist between a source domain and a target domain in the aspects of a driving environment, a shooting view angle, an illumination condition, driver characteristics and the like. According to the model, joint distribution alignment of feature and category prediction is realized through a label guiding domain adversarial network, and the adaptive capacity of the model in a cross-domain scene is remarkably improved. In order to further enhance the discrimination capability and generalization of the model, optimization is carried out from two levels of feature extraction and training strategy: a local feature enhancement module aims to improve the feature representation capability of key local behaviors; and according to the category structured CutMix strategy, the generalization ability of the model is enhanced by constructing a mixed sample. Experimental results show that the detection accuracy and robustness of the model under the cross-domain condition are effectively improved, a reliable technical scheme is provided for driver state monitoring, and the method has important application value for road traffic safety guarantee.

The invention discloses a truck driver safe driving evaluation method based on SEDEA, and the method comprises the steps: regarding the vehicle characteristics, behavior characteristics, road characteristics and environment characteristics of a vehicle in a driving process as external resources of a driver safe driving task, and regarding the characteristics of overspeed driving, fatigue driving, distraction driving and the like as risk results after the resources are utilized; the method comprises the following steps: taking resource utilization efficiency evaluation as a core means to measure the safe driving ability of a truck driver, and constructing a weight system containing multiple inputs and multiple outputs and a resource utilization efficiency evaluation model to calculate a safe driving score of the driver; and various safety indexes and quantitative classification management measures of the driver are given based on the model. The model is in close contact with the safe driving management situation of the truck driver, not only considers the resource input and the efficiency output of the safe travel task of the truck driver, but also sets the optimization direction between different inputs and outputs through a weight system.

A system and method for improved automotive safety, particularly aimed at the prevention of automobile, truck, and other vehicle accidents related to driving in a distracted manner while using a cell phone.

The invention discloses a driving state analysis method based on machine vision and a related device, and relates to the technical field of image processing, and the method comprises the steps: carrying out the definition optimization of each frame of driver image; performing feature point extraction on each frame of driver image after definition optimization based on a calibration network to obtain corresponding feature point information; based on the feature point information, an eye closing adaptive threshold value is analyzed, and fatigue driving state detection of the driver is carried out in combination with micro-expression analysis; carrying out hand-held object detection on the driver based on each frame of driver image to obtain hand-held object information; performing sight liveness analysis based on the feature point information so as to perform distracted driving state detection in combination with the handheld object information; and judging whether early warning information needs to be sent based on the fatigue driving state detection result and the distracted driving state detection result. According to the method, false detection or missing detection of the abnormal driving state can be effectively avoided, and the reliability of driving state analysis is improved.

A method (400) for distraction driver detection and alert includes receiving vehicle speed data (20) from one or more wheel speed sensors (122) disposed on a vehicle (105), and receiving proximity data from one or more proximity sensors disposed on the vehicle, the proximity data indicating a distance (32) of the vehicle relative to any object in front of the vehicle. The method also includes executing a distracted driver detection algorithm (300) that uses the vehicle speed data and the proximity data to determine that the vehicle is interrupting the stop-time traffic flow and that a driver of the vehicle is distracted from operating the vehicle. The method includes instructing a system (270) of the vehicle to output an alert to reengage a driver based on determining that the vehicle is interrupting the stop-time traffic flow and the driver of the vehicle is distracted.

The present invention aims to provide a storage unit that can be attached to a bicycle handlebar, allowing for the storage of a smartphone while simultaneously preventing distracted driving. [Structure] To achieve the above objectives, the present invention: Firstly, a storage unit for bicycle handlebars is attached to the handlebars at the center of the handlebars by fastening means such as screws at the mounting point, with a storage compartment protruding from the mounting point toward the rider, the storage compartment being opened and closed with a lid, and the horizontally elongated storage compartment being a storage space for storing a smartphone horizontally. The above is my proposal.

The invention discloses wearable interaction hardware equipment, and relates to the technical field of man-machine interaction. S1, equipment wearing and setting; s2, reporting contact information; s3, automatically replying the voice message; s4, performing voice reply by the user; and S5, traffic light pause state notification. According to the wearable interaction hardware equipment, a user does not need to hold a mobile phone to check or edit messages, distracted driving is avoided through voice interaction of a Bluetooth headset, the traffic accident risk is reduced, meanwhile, road congestion caused by distraction of a driver is reduced, and timely transmission of emergency messages and delayed processing of non-emergency messages are ensured through emergency feature word recognition; not only are important cooperation or help information not missed, but also normal driving is not interfered, the non-emergency message is automatically replied and the optimal contact time is informed, the communication cost of a user is reduced, and the non-emergency message is broadcasted and replied on the premise of ensuring sufficient time in combination with a traffic light pause state, so that the message processing efficiency is improved, and message accumulation is avoided.

Raw sensor data from a device of a user is collected. The raw data does not include location data for the device. The data is preprocessed to identify driving trips in which the user had the device. The trip data is provided to machine-learning models (MLMs) as input and the MLMs provide as output predictions for each trip's estimated speeds, estimated number of hard brakes and a degree of each hard brake, and estimated degrees of distracted driving. A duration, time of day, and calendar date of each trip is identified. The predictions, duration, time of day, and calendar date are modified into four factor values. The four modified factor values are combined into an overall driver characteristic value and provided to a network service associated with the user for purposes of providing or modifying services provided to the user through the network service based on the overall characteristic value.

The invention discloses an emotion intervention method and device, a vehicle and a storage medium. The method comprises the steps that video data and audio data of a driver and passengers in the vehicle driving process are acquired; performing emotion state detection on the driver according to the video data and the audio data to obtain an emotion score of the driver; when it is determined that the driver and the passenger are in a negative emotional state according to the emotional score, an intervention strategy is determined according to the emotional score, and the intervention strategy is used for smoothing the negative emotion of the driver and the passenger; and performing emotion intervention on the driver and passengers according to the intervention strategy. According to the method, when it is determined that the driver is in the negative emotional state based on the detected emotional score of the driver in the vehicle driving process, emotional intervention is conducted on the driver according to the emotional score so as to flatten the negative emotions of the driver, the situation that the driver is distracted to drive, and consequently the driving risk of vehicle driving is increased can be avoided, and the driving safety is improved. And the driving safety of vehicle driving can be improved.

The invention discloses a safe driving control method based on steering wheel grip strength monitoring, which comprises the following steps: S1, acquiring grip strength data such as grip strength values and distribution areas in real time through array type pressure sensor groups arranged in the circumferential direction of a steering wheel; s2, preprocessing the data and extracting characteristic parameters such as an average grip strength value and a distribution balance degree; s3, inputting the characteristic parameters into a pre-trained deep learning model, and identifying three types of driving states including fatigue, distraction and sudden health abnormality; s4, triggering a corresponding strategy according to an identification result: starting graded early warning and adjusting vehicle power parameters in fatigue or distraction driving, starting emergency control in case of abnormal health, and automatically executing speed reduction, lane keeping and alarming; and S5, reserving a 3s driver feedback window period, judging whether to release the control strategy based on the recovery coefficient, and if no effective feedback is received, continuously executing until the vehicle stops. The grip strength characteristic can be accurately monitored, the abnormal state can be recognized, and the driving safety can be effectively improved by being linked with a vehicle active control system.

An acquisition unit acquires vehicle information and a moving image frame as image information captured by an imaging unit from a database. An extraction unit extracts a captured image in which at least one of a direction of a face of an occupant and a position of a gaze point satisfies a predetermined inattentive driving condition from among captured image in which a vehicle speed is equal to or higher than a predetermined threshold value and a steering angle is within a predetermined range.

The application relates to a light-weight distraction driving recognition method and system based on an improved ConvNeXt, and relates to the field of image classification of deep learning. The method comprises the following steps: 1. obtaining a driving scene image and performing pretreatment; 2. constructing an improved ConvNeXt model, and replacing a ConvNeXt Block module in an original ConvNeXt model with a CR-Former module; 3. iteratively training to obtain a distraction driving behavior recognition model; and 4. inputting an image into the distraction driving behavior recognition model to output a driving behavior recognition result. The system comprises an image acquisition and processing module, a model construction and configuration module, a model iterative training module and a behavior recognition output module which are connected in sequence. The application has the advantages that the model calculation cost is significantly reduced, the hardware resource occupation is reduced, and the capturing capability of the model for driving behavior detail features is effectively improved.

To more accurately detect the driver's condition. [Solution] The driver state detection device of the embodiment includes a recognition unit that recognizes at least one of the gaze or face direction of the driver of a moving object, and a determination unit that determines whether the driver is driving while distracted based on the recognition result of the recognition unit and a distraction determination condition. The determination unit makes a determination of distracted driving using a first distraction determination condition when the turning of the moving object is not predicted or the moving object is not turning, and makes a determination of distracted driving using a second distraction determination condition when the turning of the moving object is predicted or the moving object is turning. When the determination unit determines whether the moving object is turning, it changes the turning determination condition for determining whether the moving object is turning depending on whether the turning direction of the moving object is left or right.

Apparatuses, systems and methods are provided for determining vehicle driver distractions. More particularly, apparatuses, systems and methods are provided for receiving, via a vehicle interior data receiving module, vehicle interior data from at least one vehicle interior sensor, wherein the vehicle interior data is representative of an initial position of a body of at least one vehicle occupant; tracking, via a body tracking module, changes in the body of the at least one vehicle occupant from the initial position of the body; and predicting, via a driver action prediction module, one or more driver actions based at least on the changes in the body of the at least one vehicle occupant.

The invention provides a safe driving monitoring method based on multi-modal data, and the method comprises the following steps: S1, collecting video information during driving through a camera, separating audio information from the video information, and converting the audio information into text information through a voice recognition model; s2, inputting the video information into a target detection model, and when the driver is recognized to be in a fatigue or distracted driving state, generating a corresponding prevention measure; s3, synchronously performing the step S2, respectively extracting a visual initial feature, an audio initial feature and a text initial feature from the video information, the audio information and the text information, inputting the visual initial feature, the audio initial feature and the text initial feature into a multi-modal sentiment analysis model based on a mixed attention mechanism, and when the driver is recognized to be in an emotional driving state, executing the step S3; and corresponding prevention measures are generated. According to the invention, double-line detection is adopted to identify whether the driver is in fatigue, distraction or emotional driving, so that safe driving monitoring is more reliable and effective.

The present invention provides a method, device, electronic device, and storage medium for detecting distracted driving behavior, relating to the technical field of driving behavior detection. The method comprises: obtaining a driving behavior image; inputting the driving behavior image into a distracted driving behavior detection model, and obtaining a distracted driving behavior detection result output by the distracted driving behavior detection model. The distracted driving behavior detection model is trained based on sample driving behavior images and comprises a backbone network feature extraction module, an attention module, and a loss function module. The distracted driving behavior detection result is the result of multi-scale feature extraction, multi-scale feature fusion, and behavior detection performed on the driving behavior image by the backbone network feature extraction module, the attention module, and the loss function module in the distracted driving behavior detection model. The technical solution of the present invention improves the accuracy of distracted driving detection by performing distracted driving detection based on the distracted driving behavior detection model.

The invention discloses a fatigue and distraction driving monitoring device based on physiological features and a monitoring method thereof, particularly relates to the technical field of target extraction, can realize accurate reconstruction of a system state by collecting and utilizing system event data, overcomes limitation and defects of a traditional method, and improves efficiency and accuracy of state reconstruction. The event data is converted into the graphic structure, and the visual and efficient representation method is provided and used for displaying the causal relationship and sequence of the events. According to the technology, large-scale event data can be quickly processed, and the integrity and accuracy of the graph are ensured. Event data are collected and updated in real time, and the system state can be monitored and updated in real time. According to the method, the change of the system state can be quickly responded, and real-time state information is provided, so that the maintainability and the reliability of the system are improved.

This invention belongs to the technical fields of computer vision and machine learning, and relates to a deep learning-based distracted driving behavior recognition technology. Specifically, it provides a two-stage, dual-channel distracted driving behavior recognition method based on keypoint detection to address the poor recognition performance of existing methods. This invention proposes a two-stage recognition network. The first stage uses an Alphapose keypoint detection network to acquire the driver's keypoint information. The second stage uses ResNet-50 as the backbone, designing a heatmap key region map using the keypoint information. A fusion structure is proposed in the dual-channel fusion stage of the original image and the key region map, and spatial and channel attention mechanisms are introduced to enhance the learning of features of interest. Based on the dual-channel network, this invention also introduces a binary classifier module designed using a GCN graph convolutional network model. The binary classifier is used to correct the network prediction results, ultimately effectively improving the recognition performance of distracted driving behavior.

The application discloses a method for recognizing distraction driving behavior based on an improved DCH neural network, which comprises the following steps: constructing a hyper-dimensional calculation model; firstly, constructing an improved DCH neural network; replacing an ADAM optimizer in the DCH model with an improved artificial traveling mouse optimizer; then, using the improved DCH neural network to perform hyper-dimensional vector coding; in a hash code space, the Hamming distance of hash codes of semantically similar images is close, and the Hamming distance of semantically dissimilar images is far; finally, classifying image information of the same category to form a category hyper-dimensional vector; constructing an AdaptHD retraining model; using the model to calculate a classification accuracy rate, and calculating the similarity between all training samples and the category hyper-dimensional vector again; training the model, testing a data set by using the trained model; and outputting a test result; and the application improves the efficiency of the algorithm within an acceptable range of detection precision, reduces the time for training the model, and no longer depends on high-performance edge computing devices.

A distracted driving analysis system for identifying distracted driving events is provided. The system includes a processor in communication with a memory device programmed to: (i) receive driving event records, each driving event record including phone usage by a user, wherein a driving event record is labeled as an actual distracted driving event or a passenger event, (ii) divide the driving event records into at least two clusters based at least in part upon common features and the labels of each driving event record by processing the plurality of driving event records with a semi-supervised machine learning algorithm, (iii) generate a trained model based at least in part upon the at least two clusters, (iv) process a new driving event using the trained model, (v) assign the new driving event to one of the clusters using the trained model, and / or (vi) determine whether the new driving event is an actual distracted driving event or a passenger event.

Systems and methods are provided for programmatically verifying an origin of abnormal driving. Some examples of abnormal driving may include aggressive driving (e.g., tailgating, cut-in lane, etc.), distracted driving (e.g., swerving, delayed reaction, etc.), and reckless driving (e.g., green light running, lane change without signaling, etc.). For example, the systems and methods may receive an identification of a second vehicle performing abnormal driving from an ego vehicle; initiate a verification process of the identification of the abnormal driving; access driving data associated with an origin of the abnormal driving, wherein the driving data includes the ego vehicle and the second vehicle; using the driving data, determine a confirm or deny decision regarding the identification of the second vehicle from the ego vehicle; and provide the confirm or deny decision.

The invention discloses a detection and intervention system and method for distraction driving of a driver and a vehicle, and belongs to the technical field of vehicle detection. The detection and intervention system for distraction driving of the driver comprises a control module, and an execution module, an infrared image detection unit, a steering wheel pressure array detection unit and a positioning detection unit which are respectively connected with the control module, the control module is used for determining a comprehensive distraction score according to the head posture video picture data, the trunk offset data, the pressure distribution data and a preset environment compensation coefficient; under the condition that the driver is determined to have driving distraction according to the comprehensive distraction score, determining a distraction grade of driving distraction and a corresponding target intervention measure according to the comprehensive distraction score, a preset distraction grade interval and a corresponding relation between the preset distraction grade and the intervention measure, and sending the distraction grade and the corresponding target intervention measure to an execution module; the execution module is configured to execute the target intervention measure. The driving behavior of the driver can be quantitatively evaluated and graded intervention can be performed.

The invention provides a forklift-based driver state monitoring method and a forklift-based driver state monitoring system. The forklift-based driver state monitoring system comprises a multispectral imaging unit, a processor and an alarm unit, according to the method, RGB and infrared images are synchronously acquired, and a fusion weight is adaptively calculated based on a brightness mean value and an infrared signal-to-noise ratio, so that multispectral dynamic fusion is realized; recognizing targets such as human faces, cigarettes, mobile phones, transparent glasses, sunglasses and the like by using an improved lightweight detection network, and performing behavior judgment in combination with image-level and video-level classification networks; an MC Dropout uncertainty evaluation and consistency window fusion strategy is adopted, and events such as smoking, calling and distracted driving are output only when two branches are judged to be consistent and the reliability meets a threshold value. The system can realize real-time monitoring on low-computing-power edge equipment, has high stability and low false alarm rate in strong light, night, shielding and vibration scenes, and remarkably improves the safety of the working environment of the forklift.

Raw sensor data from a device of a user is collected. The raw data does not include location data for the device. The data is preprocessed to identify driving trips in which the user had the device. The trip data is provided to machine-learning models (MLMs) as input and the MLMs provide as output predictions for each trip's estimated speeds, estimated number of hard brakes and a degree of each hard brake, and estimated degrees of distracted driving. A duration, time of day, and calendar date of each trip is identified. The predictions, duration, time of day, and calendar date are modified into four factor values. The four modified factor values are combined into an overall driver characteristic value and provided to a network service associated with the user for purposes of providing or modifying services provided to the user through the network service based on the overall characteristic value.

The invention relates to the technical field of automobile control, in particular to a vehicle-mounted multi-mode navigation interaction method, system and equipment and a storage medium. The vehicle-mounted multi-mode navigation system comprises: a navigation prompt module, which is used for outputting a driving navigation prompt; the safety early warning module is used for outputting a driving safety early warning prompt; the head display module is used for projecting a navigation picture or a safety early warning picture on a vehicle window; the steering wheel tactile feedback module is used for providing navigation prompt vibration feedback or safety early warning vibration feedback on a steering wheel; and the controller is used for adjusting the working modes of the head display module and the steering wheel tactile feedback module according to the driving navigation prompt and the driving safety early warning prompt. According to the embodiment of the invention, by constructing a multi-mode navigation interaction system framework and integrating visual and tactile information transmission channels, the dependence of a driver on a central control screen is remarkably reduced, the sight line transfer frequency is reduced, the distraction driving problem caused by a traditional navigation system is effectively relieved, and the driving safety is improved.

This disclosure presents a driving behavior detection method and a training method for a driving behavior detection system. The method includes: acquiring an image dataset of the user to be detected; acquiring a driving behavior detection type; determining the data to be detected based on the image dataset and the driving behavior detection type; inputting the data to be detected into a joint multi-task driving behavior detection system, where the corresponding model performs behavior detection and outputs the driving behavior detection results for the user. This disclosure enables efficient and accurate joint multi-task detection of two typical non-standard driving behaviors: distracted driving and fatigued driving, laying a solid foundation for improving driving safety. Furthermore, it supports single-task detection, either focusing solely on distracted driving or fatigued driving, improving the flexibility and intelligence of the driving behavior detection process.

The invention discloses a grading intervention method for distracted driving, a vehicle machine and a program product, and relates to the technical field of intelligent cabins, and the method comprises the steps: collecting visual data, auditory data and tactile data in a cabin; performing feature extraction on the collected visual data, auditory data and tactile data by using different feature extraction models; performing weighted average on the extracted visual features, auditory features and tactile features to obtain a distraction value of the driver in the cabin; and performing grading intervention on the distraction state of the driver according to the value interval of the distraction value. According to the grading intervention method for distraction driving, the vehicle machine and the program product, the false alarm rate of distraction early warning can be effectively reduced.

The present application relates to the fields of computer vision and deep learning technology, and discloses a method, apparatus, device, and storage medium for identifying distracted driving, which are used to address the technical problem that traditional distracted driving identification solutions have difficulty balancing the timeliness and accuracy of identification. The distracted driving identification method includes: inputting the original driver image data into the input layer of a preset distracted driving identification model for preprocessing, and extracting features from the candidate driver image data through a depthwise separable convolutional layer to obtain an initial driving behavior feature map; inputting the initial driving behavior feature map into a multi-spectral attention layer for spectral segmentation, and performing an attention fusion operation on the feature maps of each spectral range to obtain a fused feature map; inputting the fused feature map into a pooling layer and a feature flattening layer for processing to obtain a feature vector of the driving behavior to be identified; and inputting the feature vector of the driving behavior to be identified into a classifier for driving distracted behavior identification to obtain a distracted driving identification result.

A computer system is provided and is programmed to: (1) receive sensor data associated with a primary vehicle; (2) determine a current condition of a driver of the primary vehicle based upon the sensor data of the primary vehicle; (3) determine a threat level for the primary vehicle based upon the current condition of the driver of the primary vehicle and the sensor data of the primary vehicle; (4) activate at least one action in the primary vehicle based upon the threat level for the primary vehicle; and / or (5) electronically transmit the threat level of the primary vehicle to one or more additional vehicles.