Vehicle safe driving reminding strategy determination method and device and electronic equipment

By acquiring and analyzing vehicle driving status and driver behavior information, and combining deep learning and sensor technology, a comprehensive safe driving reminder strategy is provided. This solves the problems of single and inefficient vehicle safe driving reminder strategies in existing technologies, and achieves fast and accurate driver risk assessment and safety reminders.

CN119037459APending Publication Date: 2024-11-29CHINA FAW CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411116746.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-14
Publication Date
2024-11-29

AI Technical Summary

Technical Problem

Existing vehicle safety driving reminder strategies are simplistic and inefficient, failing to comprehensively assess various risk factors during driving, which can easily lead to misjudgments and affect the driver's normal driving.

Method used

By acquiring the target vehicle's driving status information and the driver's eye status and hand movement trajectory information, deep learning algorithms and sensor devices are used for data analysis and noise reduction to comprehensively assess the driver's risk status. Based on the assessment results, safe driving reminder strategies are determined, including the implementation of vibrators, voice alarms, and autonomous driving modes.

Benefits of technology

It enables rapid and accurate determination of whether the driver is in a safe driving state, improves the efficiency of determining vehicle safe driving reminder strategies, and reduces the risk of traffic accidents.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119037459A_ABST
    Figure CN119037459A_ABST
Patent Text Reader

Abstract

The invention discloses a method and device for determining a vehicle safe driving reminding strategy and electronic equipment. The method comprises the steps that driving state information of a target vehicle and behavior information of a driver are obtained, and the behavior information comprises eye state information and hand movement track information of the driver; vehicle risk assessment is carried out on the behavior information based on the driving state information to obtain a target assessment result, and the target assessment result is used for determining whether the target vehicle is in a safe driving state; according to the target evaluation result, a safe driving reminding strategy is determined, and the safe driving reminding strategy is used for reminding the driver of safe driving. According to the invention, the technical problems of single form and low efficiency of the determination method of the vehicle safe driving reminding strategy in the prior art are solved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of vehicle technology, and in particular to a method, device and electronic equipment for determining a vehicle safe driving reminder strategy. Background Art

[0002] Traffic safety has always been a difficult problem that needs to be solved worldwide. Especially when the driver is driving fatigued, his ability to perceive the surrounding environment, driving judgment and vehicle control will be greatly affected. This is more likely to cause traffic accidents and cause irreparable losses.

[0003] However, the current detection of fatigue driving mostly relies on technologies such as infrared sensors. Although these technologies can provide certain assistance, their application scope and detection accuracy are still limited. In addition, although some studies have analyzed the risk behavior of drivers through linear regression analysis, these methods only focus on a single risk factor and cannot comprehensively evaluate the various risk factors in the driving process. Such a judgment method not only has the risk of misjudgment, but also easily affects the driver's normal driving. Therefore, the existing vehicle safety driving reminder strategy is relatively simple in form and inefficient.

[0004] To address the above-mentioned problems, no effective solution has been proposed yet. Summary of the invention

[0005] The embodiments of the present invention provide a method, device and electronic device for determining a vehicle safe driving reminder strategy, so as to at least solve the technical problems in the related art that the method for determining a vehicle safe driving reminder strategy is single in form and low in efficiency.

[0006] According to one embodiment of the present invention, there is provided a method for determining a vehicle safe driving reminder strategy, comprising: obtaining driving state information of a target vehicle and behavior information of a driver, wherein the behavior information includes eye state information and hand movement trajectory information of the driver; performing a vehicle risk assessment on the behavior information based on the driving state information to obtain a target assessment result, wherein the target assessment result is used to determine whether the target vehicle is in a safe driving state; determining a safe driving reminder strategy according to the target assessment result, wherein the safe driving reminder strategy is used to remind the driver to drive safely.

[0007] Optionally, obtaining the driver's eye state information includes: collecting video information of the driver; and analyzing the video information using a deep learning algorithm to obtain the eye state information.

[0008] Optionally, obtaining the driver's hand movement trajectory information includes: in response to the sensor device detecting the driver's hand, obtaining first voltage information and preset time information; performing noise reduction processing on the first voltage information to obtain target voltage information; and determining the hand movement trajectory information based on the target voltage information and the preset time information.

[0009] Optionally, performing a risk assessment on the behavior information based on the driving status information to obtain a target assessment result includes: performing a vehicle risk assessment on the eye status information based on the driving status information to obtain a first assessment result; performing a vehicle risk assessment on the hand movement trajectory information based on the driving status information to obtain a second assessment result; and determining a target assessment result based on the first assessment result and the second assessment result.

[0010] Optionally, a vehicle risk assessment is performed on the eye status information based on the driving status information to obtain a first assessment result including: in response to the target vehicle being in a driving state, comparing the eye status information with a preset eye height difference threshold to obtain a comparison result; in response to the comparison result determining that the eye status information is less than the preset eye height difference threshold, determining that the first assessment result is that the driver is in an unsafe driving state.

[0011] Optionally, a vehicle risk assessment is performed on the hand movement trajectory information based on the driving status information to obtain a second assessment result including: in response to the target vehicle being in a driving state, a regression analysis is performed on the hand movement trajectory information to obtain an analysis result; in response to the analysis result being greater than or equal to a risk threshold, determining that the second assessment result is that the driver is in an unsafe driving state.

[0012] Optionally, determining the target evaluation result based on the first evaluation result and the second evaluation result includes: in response to the first evaluation result and the second evaluation result determining that the driver is in an unsafe driving state, determining the target evaluation result as the target vehicle being in an unsafe driving state.

[0013] Optionally, determining the safe driving reminder strategy according to the target evaluation result includes: in response to determining that the target evaluation result is that the target vehicle is in an unsafe driving state, executing the safe driving reminder strategy.

[0014] According to one embodiment of the present invention, there is also provided a device for determining a vehicle safe driving reminder strategy, comprising: an acquisition module, used to obtain driving status information of a target vehicle and behavior information of a driver, wherein the behavior information includes eye status information and hand movement trajectory information of the driver; an evaluation module, used to perform a vehicle risk evaluation on the behavior information based on the driving status information to obtain a target evaluation result, wherein the target evaluation result is used to determine whether the target vehicle is in a safe driving state; and a determination module, used to determine a safe driving reminder strategy according to the target evaluation result.

[0015] Optionally, the acquisition module is also used to: collect video information of the driver; and analyze the video information using a deep learning algorithm to obtain eye status information.

[0016] Optionally, the acquisition module is also used to acquire first voltage information and preset time information in response to the sensor device detecting the driver's hand; the device for determining the vehicle safe driving reminder strategy also includes a processing module for performing noise reduction processing on the first voltage information to obtain target voltage information; the determination module is also used to determine the hand movement trajectory information based on the target voltage information and preset time information.

[0017] Optionally, the evaluation module is also used to: perform vehicle risk assessment on eye status information based on driving status information to obtain a first evaluation result; perform vehicle risk assessment on hand movement trajectory information based on driving status information to obtain a second evaluation result; the determination module is also used to determine the target evaluation result based on the first evaluation result and the second evaluation result.

[0018] Optionally, the processing module is also used to compare the eye state information with a preset eye height difference threshold to obtain a comparison result in response to the target vehicle being in a driving state; the determination module is also used to determine that the first assessment result is that the driver is in an unsafe driving state in response to the comparison result determining that the eye state information is less than the preset eye height difference threshold.

[0019] Optionally, the processing module is also used to perform regression analysis on the hand movement trajectory information in response to the target vehicle being in a driving state to obtain an analysis result; the determination module is also used to determine that the second assessment result is that the driver is in an unsafe driving state in response to the analysis result being greater than or equal to a risk threshold.

[0020] Optionally, the determination module is further used to determine that the driver is in an unsafe driving state in response to the first evaluation result and the second evaluation result determining that the driver is in an unsafe driving state, and determine that the target evaluation result is that the target vehicle is in an unsafe driving state.

[0021] Optionally, the processing module is further used to execute a safe driving reminder strategy in response to determining that the target evaluation result is that the target vehicle is in an unsafe driving state.

[0022] According to one embodiment of the present invention, there is also provided an electronic device, comprising: a memory storing an executable program; and a processor for running the program, wherein the method for determining the vehicle safe driving reminder strategy is executed when the program is running.

[0023] According to one embodiment of the present invention, a computer-readable storage medium is also provided, which includes a stored executable program, wherein when the executable program is running, the device where the storage medium is located is controlled to execute the above-mentioned method for determining the vehicle safety driving reminder strategy.

[0024] According to one embodiment of the present invention, a computer program product is also provided, including a computer program, and when the computer program is executed by a processor, the computer program implements the above-mentioned method for determining a vehicle safe driving reminder strategy.

[0025] In an embodiment of the present invention, a method of obtaining the driving state information of the target vehicle and the behavior information of the driver is adopted, and a vehicle risk assessment is performed on the behavior information based on the driving state information to obtain a target assessment result; finally, a safe driving reminder strategy is determined according to the target assessment result, thereby achieving the purpose of quickly and accurately judging whether the driver is in a safe driving state, thereby achieving the technical effect of comprehensively judging whether the vehicle is in a safe driving state by combining different factors and improving the efficiency of determining the vehicle's safe driving reminder strategy, thereby solving the technical problems of the single form and low efficiency of the vehicle's safe driving reminder strategy determination method in the related art. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] The drawings described herein are used to provide a further understanding of the present invention and constitute a part of this application. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the drawings:

[0027] Figure 1 is a flow chart of a method for determining a vehicle safe driving reminder strategy according to one embodiment of the present invention;

[0028] Figure 2 is a schematic diagram of a method for determining a vehicle safe driving reminder strategy according to one embodiment of the present invention;

[0029] Figure 3 is a schematic diagram of another method for determining a vehicle safe driving reminder strategy according to one embodiment of the present invention;

[0030] Figure 4 is a schematic diagram of another method for determining a vehicle safe driving reminder strategy according to one embodiment of the present invention;

[0031] Figure 5 is a flow chart of another method for determining a vehicle safe driving reminder strategy according to one embodiment of the present invention;

[0032] Figure 6 It is a structural block diagram of a device for determining a vehicle safe driving reminder strategy according to one embodiment of the present invention. DETAILED DESCRIPTION

[0033] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0034] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0035] According to an embodiment of the present invention, a method embodiment of a method for determining a vehicle safe driving reminder strategy is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0036] The method embodiment can be executed in an electronic device or a similar computing device including a memory and a processor. Taking running on a vehicle terminal as an example, the vehicle terminal may include one or more processors (the processor may include but is not limited to a central processing unit (CPU), a graphics processing unit (GPU), a digital signal processing (DSP) chip, a microcontroller unit (MCU), a programmable logic device (Field Programmable Gate Array, FPGA), a neural network processor (Neural-network Processor Unit, NPU), a tensor processor (Tensor Processing Unit, TPU), an artificial intelligence (Artificial Intelligence, AI) type processor, etc.) and a memory for storing data. Optionally, the above-mentioned vehicle terminal may also include a transmission device, an input and output device, and a display device for communication functions. It can be understood by those of ordinary skill in the art that the above-mentioned structural description is only for illustration and does not limit the structure of the above-mentioned vehicle terminal. For example, the vehicle terminal may also include more or fewer components than the above-mentioned structural description, or have a configuration different from the above-mentioned structural description.

[0037] The memory can be used to store computer programs, for example, software programs and modules of application software, such as the computer program corresponding to the method for determining the vehicle safe driving reminder strategy in the embodiment of the present invention. The processor executes various functional applications and data processing by running the computer program stored in the memory, that is, the above-mentioned method for determining the vehicle safe driving reminder strategy is realized. The memory may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory may further include a memory remotely arranged relative to the processor, and these remote memories can be connected to the mobile terminal via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0038] The transmission device is used to receive or send data via a network. The specific example of the above network may include a wireless network provided by a communication provider of the mobile terminal. In one example, the transmission device includes a network adapter (Network Interface Controller, referred to as NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device can be a radio frequency (Radio Frequency, referred to as RF) module, which is used to communicate with the Internet wirelessly.

[0039] The display device may be, for example, a touch screen type liquid crystal display (LCD) and a touch display (also referred to as a "touch screen" or "touch display screen"). The liquid crystal display may enable a user to interact with a user interface of a mobile terminal. In some embodiments, the mobile terminal has a graphical user interface (GUI), and a user may interact with the GUI by finger contacts and / or gestures on a touch-sensitive surface, wherein the human-computer interaction functions here may optionally include the following interactions: creating web pages, drawing, word processing, making electronic documents, games, video conferencing, instant messaging, sending and receiving emails, call interfaces, playing digital videos, playing digital music and / or web browsing, etc. The executable instructions for executing the above human-computer interaction functions are configured / stored in a computer program product or readable storage medium executable by one or more processors.

[0040] According to an embodiment of the present invention, a method embodiment of a method for determining a vehicle safe driving reminder strategy is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0041] Figure 1 is a flow chart of a method for determining a vehicle safe driving reminder strategy according to one embodiment of the present invention. Figure 1 As shown, the method comprises the following steps:

[0042] Step S10, obtaining the driving state information of the target vehicle and the behavior information of the driver, wherein the behavior information includes the driver's eye state information and hand movement trajectory information;

[0043] In step S10, the driving state information of the target vehicle is used to indicate whether the target vehicle is in a powered-on but not-driving state or a driving state.

[0044] The above-mentioned driver's eye state information is used to represent the height difference between the driver's upper and lower eyelids during driving.

[0045] The hand movement trajectory information is used to characterize the movement distance and time between the driver's hand and the center console during driving.

[0046] Step S12, performing a vehicle risk assessment on the behavior information based on the driving state information to obtain a target assessment result, wherein the target assessment result is used to determine whether the target vehicle is in a safe driving state;

[0047] Specifically, when the target vehicle is in a driving state, a vehicle risk assessment is performed on the driver's behavior information to determine whether the driver is in a safe driving state, and then a target assessment result is obtained to determine whether the target vehicle is in a safe driving state during the current driving process.

[0048] Step S14, determining a safe driving reminder strategy according to the target evaluation result, wherein the safe driving reminder strategy is used to remind the driver to drive safely.

[0049] In step S14, the above-mentioned safe driving reminder strategy includes but is not limited to: (1) installing a vibrator at the seat and steering wheel position. When the real-time monitoring device determines that the target vehicle is in an unsafe driving state, the vibrator vibrates to remind the driver, and the voice alarm issues a reminder at the same time to remind the driver to pay attention to driving safety; (2) in order to avoid malfunction of the real-time monitoring device, a remote reminder device is set to remind the driver through a remote audio and video call; (3) when the target vehicle is still in an unsafe driving state after the above two strategies are used, the target vehicle is controlled to start the automatic safe driving mode, and conventional control parameters such as direction and speed are uniformly controlled by the automatic driving mode.

[0050] Specifically, Figure 2 is a schematic diagram of a method for determining a vehicle safety driving reminder strategy according to one embodiment of the present invention, such as Figure 2As shown, a vehicle smart card (Intelligent Card for Vehicles, IC) is inserted into the card reader. After the card reader recognizes the vehicle IC card, the target vehicle, real-time monitoring device, alarm device and remote reminder device are all turned on. The camera in the real-time monitoring device is used to obtain the driver's eye state information, and the time detector and infrared sensor in the real-time monitoring device obtain the moving distance and time between the driver's hand and the center console, that is, the hand movement trajectory information. The obtained driver's behavior information is transmitted to the processor, and then the driver is evaluated whether he is in a safe driving state, so as to determine whether the target vehicle is in a safe driving state. When it is determined that the target vehicle is in an unsafe driving state, the alarm device executes the vehicle safe driving reminder strategy, thereby reminding the driver to pay attention to driving safety, wherein the alarm device includes: a vibrator, a voice alarm and a remote reminder device. Vibrators are installed at the seat and steering wheel positions. When the real-time monitoring device determines that the target vehicle is in an unsafe driving state, the vibrator vibrates to remind the driver, and the voice alarm issues a reminder at the same time to remind the driver to pay attention to driving safety. In order to avoid malfunction of the real-time monitoring device, a remote reminder device is set to remind the driver through a remote audio and video call. When the target vehicle is still in an unsafe driving state after the above two strategies are used, the target vehicle is controlled to start the automatic safe driving mode, and conventional control parameters such as direction and speed are uniformly controlled by the automatic driving mode.

[0051] Based on the above steps S10 to S14, the driving state information of the target vehicle and the behavior information of the driver are obtained, and the vehicle risk assessment is performed on the behavior information based on the driving state information to obtain a target assessment result; finally, the safe driving reminder strategy is determined according to the target assessment result, so as to achieve the purpose of quickly and accurately judging whether the driver is in a safe driving state, thereby achieving the technical effect of comprehensively judging whether the vehicle is in a safe driving state by combining different factors and improving the efficiency of determining the vehicle's safe driving reminder strategy, thereby solving the technical problems of the single form and low efficiency of the method for determining the vehicle's safe driving reminder strategy in the related technology.

[0052] Optionally, in step S10, obtaining the driver's eye state information includes:

[0053] Step S101, collecting video information of the driver;

[0054] Step S102: Analyze the video information using a deep learning algorithm to obtain eye status information.

[0055] Specifically, a camera is installed in front of the driver to collect video information of the driver, and a face recognition algorithm is used to analyze the collected video information to obtain the maximum height difference between the driver's upper and lower eyelids.

[0056] Based on the above steps S101 to S102, the video information of the driver is collected; the video information is analyzed using a deep learning algorithm to obtain eye state information. By collecting the driver's video information in real time, it is possible to ensure real-time monitoring of the driver's state and timely detect unsafe driving states. In addition, the deep learning algorithm is used to analyze the video information to improve the recognition accuracy of the eye state information.

[0057] Optionally, in step S10, obtaining the driver's hand movement trajectory information includes:

[0058] Step S103, in response to the sensor device detecting the driver's hand, obtaining first voltage information and preset time information;

[0059] Step S104, performing noise reduction processing on the first voltage information to obtain target voltage information;

[0060] Step S105 , determining the hand movement trajectory information based on the target voltage information and the preset time information.

[0061] Specifically, Figure 3 is a schematic diagram of another method for determining a vehicle safety driving reminder strategy according to one embodiment of the present invention, such as Figure 3 As shown, infrared sensor 1, infrared sensor 2, and infrared sensor 3 are installed at different positions of the vehicle's central control function control area. For example, near the air conditioning button, wind direction control button, and air volume control button. The three infrared sensors are used to measure the moving distance and time between the driver's hand and the center console during driving. The infrared sensor emits infrared light to the driver's hand, and the infrared light is reflected and absorbed by the hand to determine whether the driver's hand is detected. When the infrared sensor detects the driver's hand, it outputs a voltage value by measuring the amount of infrared light absorbed, and then calculates the distance between the hand and the infrared sensor. However, when collecting the distance between the driver's hand and the infrared sensor, the infrared sensor will generate noise in the process, and the noise generated will make the original data of the measured voltage value difficult to analyze. Therefore, in order to more accurately collect the distance data between the driver's hand and the center console, a filtering device such as a filter is used to filter the noise of the infrared sensor.

[0062] Furthermore, a multifunction data acquisition (MDAQ) device was used to collect more accurate frame data of the moving distance and time of the driver's hand and the infrared sensor. In order to monitor the precise distance measurement between the driver's hand and the infrared sensor collected from the data acquisition device, a graphical programming language software (Labview) was used to collect the distance and total time between the driver's hand and each of the three infrared sensors in real time.

[0063] Based on the above steps S103 to S105, in response to the sensor device detecting the driver's hand, first voltage information and preset time information are obtained; the first voltage information is subjected to noise reduction processing to obtain target voltage information; the hand movement trajectory information is determined based on the target voltage information and the preset time information, and the noise of the infrared sensor is filtered by using a filtering device such as a filter, which can reduce measurement errors and improve the accuracy of the hand movement trajectory information, and by installing an infrared sensor in the vehicle's central control function control area, the movement of the driver's hand can be more comprehensively monitored, thereby obtaining more comprehensive hand movement trajectory information.

[0064] Optionally, in step S12, risk assessment is performed on the behavior information based on the driving state information, and the target assessment result obtained includes:

[0065] Step S121, performing a vehicle risk assessment on the eye state information based on the driving state information to obtain a first assessment result;

[0066] Step S122, performing a vehicle risk assessment on the hand movement trajectory information based on the driving state information to obtain a second assessment result;

[0067] Step S123: determining a target evaluation result based on the first evaluation result and the second evaluation result.

[0068] Specifically, during the driving process of the target vehicle, the driver's eye state information is subjected to a vehicle risk assessment to obtain a first assessment result, wherein the first assessment result is used to characterize whether the driver is in an unsafe driving state. Also, during the driving process of the target vehicle, the driver's hand movement trajectory information is subjected to a vehicle risk assessment to obtain a second assessment result, wherein the second assessment result is used to characterize whether the driver is in an unsafe driving state. Whether the target vehicle is in a safe driving state is determined based on the first assessment result and the second assessment result.

[0069] Based on the above steps S121 to S123, a vehicle risk assessment is performed on the eye status information based on the driving status information to obtain a first assessment result; a vehicle risk assessment is performed on the hand movement trajectory information based on the driving status information to obtain a second assessment result; a target assessment result is determined based on the first assessment result and the second assessment result, thereby achieving the purpose of quickly and accurately judging whether the driver is in a safe driving state, thereby achieving the technical effect of comprehensively judging whether the vehicle is in a safe driving state based on different factors and improving the efficiency of determining the vehicle's safe driving reminder strategy, thereby solving the technical problems of the single form and low efficiency of the method for determining the vehicle's safe driving reminder strategy in the related technology.

[0070] Optionally, in step S121, vehicle risk assessment is performed on the eye state information based on the driving state information, and obtaining a first assessment result includes:

[0071] Step S1211, in response to the target vehicle being in a driving state, comparing the eye state information with a preset eye height difference threshold to obtain a comparison result;

[0072] Step S1212, in response to the comparison result determining that the eye state information is less than a preset eye height difference threshold, determining the first evaluation result is that the driver is in an unsafe driving state.

[0073] Specifically, when the target vehicle is in a driving state, the video information collected by the camera is passed through a face recognition algorithm to obtain the maximum height difference between the upper and lower eyelids. The preset eye height difference threshold is determined based on the height difference between the upper and lower eyelids when the driver is in a good state. After continuously processing multiple video information, the maximum height difference between the driver's upper and lower eyelids is compared with the preset eye height difference threshold. If the maximum height difference between the driver's upper and lower eyelids is lower than the preset threshold, it is determined that the driver is in an unsafe driving state.

[0074] Based on the above steps S1211 to S1212, in response to the target vehicle being in a driving state, the eye state information is compared with the preset eye height difference threshold to obtain a comparison result; in response to the comparison result determining that the eye state information is less than the preset eye height difference threshold, the first assessment result is determined to be that the driver is in an unsafe driving state, and real-time video information is used for analysis, which can more accurately capture changes in the driver's state and provide more timely risk assessments. Moreover, by presetting the eye height difference threshold, personalized risk assessments can be performed based on the driver's actual state, rather than using a unified standard, thereby improving the accuracy of the assessment.

[0075] Optionally, in step S122, a vehicle risk assessment is performed on the hand movement trajectory information based on the driving state information, and a second assessment result is obtained including:

[0076] Step S1221, in response to the target vehicle being in a driving state, performing regression analysis on the hand movement trajectory information to obtain an analysis result;

[0077] Step S1222, in response to the analysis result being greater than or equal to the risk threshold, determining that the second assessment result is that the driver is in an unsafe driving state.

[0078] Specifically, the collected frame data is processed by linear regression analysis, wherein the frame data refers to the frame data of the moving distance and time between the driver's hand and the infrared sensor collected by the MDAQ device. The linear regression equation obtained according to the frame data is shown in expression (1).

[0079]

[0080] Among them, Ev i represents the hand movement trajectory information analysis result corresponding to the i-th frame data, u IR1 、u IR2 、u IR3 Respectively represent the distance between the hand and the three sensors, u t represents the movement time of the hand at the three infrared sensors, β0, β1, β2, β3, β4 represent the regression coefficients, and i represents the i-th frame data.

[0081] Specifically, a risk threshold is set according to the frame data collected when the driver is in a good state. The hand movement trajectory information analysis result corresponding to the i-th frame data is calculated according to expression (1) for the currently collected frame data, and the analysis result is compared with the risk threshold. If the hand movement trajectory information analysis result corresponding to the currently collected frame data is greater than or equal to the risk threshold, the second evaluation result determines that the driver is in an unsafe driving state.

[0082] Specifically, Figure 4 is a schematic diagram of another method for determining a vehicle safety driving reminder strategy according to one embodiment of the present invention, such as Figure 4As shown, first, a multifunction data acquisition (MDAQ) device is used to collect more accurate frame data of the moving distance and time of the driver's hand and the infrared sensor in real time. Secondly, in order to more accurately collect the distance data between the driver's hand and the center console, a filter or other filtering device is used to filter the noise of the infrared sensor. Then, a linear regression method is used to process the collected driver frame data and calculate the regression coefficient. Finally, the hand movement trajectory information analysis result corresponding to the i-th frame data is calculated according to the expression (1) based on the currently collected frame data, and the analysis result is compared with the risk threshold. If the hand movement trajectory information analysis result corresponding to the currently collected frame data is greater than or equal to the risk threshold, the second evaluation result determines that the driver is in an unsafe driving state. If the hand movement trajectory information analysis result corresponding to the currently collected frame data is less than the risk threshold, the second evaluation result determines that the driver is in a safe driving state.

[0083] Based on the above steps S1221 to S1222, in response to the target vehicle being in a driving state, a regression analysis is performed on the hand movement trajectory information to obtain an analysis result; in response to the analysis result being greater than or equal to the risk threshold, it is determined that the second assessment result is that the driver is in an unsafe driving state, and a linear regression method is used to model and analyze the driver's behavior, which makes the assessment result more scientific and accurate, and the risk threshold is set based on the frame data collected when the driver is in a good state, so that the assessment result is more targeted and practical, and according to the comparison result of the hand movement trajectory information analysis result and the risk threshold, it can be flexibly determined whether the driver is in a safe or unsafe driving state.

[0084] Optionally, in step S123, determining a target evaluation result based on the first evaluation result and the second evaluation result includes:

[0085] Step S1231, in response to the first evaluation result and the second evaluation result determining that the driver is in an unsafe driving state, determining the target evaluation result is that the target vehicle is in an unsafe driving state.

[0086] Specifically, when both the first evaluation result and the second evaluation result determine that the driver is in an unsafe driving state, the target evaluation result is determined to be that the target vehicle is in an unsafe driving state.

[0087] Based on the above step S1231, in response to the first evaluation result and the second evaluation result determining that the driver is in an unsafe driving state, the target evaluation result is determined to be that the target vehicle is in an unsafe driving state, thereby achieving the purpose of quickly and accurately judging whether the driver is in a safe driving state, thereby achieving the technical effect of comprehensively determining whether the vehicle is in a safe driving state based on different factors and improving the efficiency of determining the vehicle's safe driving reminder strategy, thereby solving the technical problems of the single form and low efficiency of the method for determining the vehicle's safe driving reminder strategy in the related technology.

[0088] Optionally, in step S14, determining a safe driving reminder strategy according to the target evaluation result includes:

[0089] Step S141, in response to determining that the target evaluation result is that the target vehicle is in an unsafe driving state, executing a safe driving reminder strategy.

[0090] Specifically, when it is determined that the target evaluation result is that the target vehicle is in an unsafe driving state, the safe driving reminder strategy is executed. The vibrators installed at the seat and steering wheel generate vibrations to remind the driver, and the voice alarm issues a reminder to remind the driver to pay attention to driving safety; a remote reminder device is set to remind the driver through a remote audio and video call. When the target vehicle is still in an unsafe driving state after the above strategy is used, the target vehicle is controlled to start the automatic safe driving mode, and the conventional control parameters such as direction and speed are uniformly controlled by the automatic driving mode.

[0091] Specifically, reminders are given through vibrators at the seat and steering wheel and voice alarms, which can stimulate the driver's vision and touch at the same time, improving the efficiency and effectiveness of reminders. According to the driver's preferences and reaction characteristics, the intensity of the vibrator and the content and tone of the voice alarm can be adjusted to meet the needs of different drivers. Through the remote reminder device, relevant personnel can monitor the vehicle status in real time, provide feedback and suggestions to the driver in a timely manner, and enhance safety protection. When the driver does not respond to the reminder or the vehicle is still in an unsafe state, the intervention of the automatic safe driving mode can reduce human errors and improve driving safety.

[0092] Based on the above step S141, in response to determining that the target evaluation result is that the target vehicle is in an unsafe driving state, a safe driving reminder strategy is executed, which helps reduce traffic accidents caused by driver negligence or fatigue driving by identifying and reminding the driver to pay attention to driving safety in advance.

[0093] Figure 5 FIG. 1 is a flow chart of another method for determining a vehicle safety driving reminder strategy according to one embodiment of the present invention. Figure 5 As shown, the method comprises the following steps:

[0094] Step S501, obtaining the driving state information of the target vehicle and the behavior information of the driver, wherein the behavior information includes the driver's eye state information and hand movement trajectory information;

[0095] Step S502, in response to the target vehicle being in a driving state, comparing the eye state information with a preset eye height difference threshold to obtain a comparison result;

[0096] Step S503, in response to the comparison result determining that the eye state information is less than a preset eye height difference threshold, determining the first evaluation result is that the driver is in an unsafe driving state;

[0097] Step S504, in response to the target vehicle being in a driving state, performing regression analysis on the hand movement trajectory information to obtain an analysis result;

[0098] Step S505, in response to the analysis result being greater than or equal to the risk threshold, determining that the second assessment result is that the driver is in an unsafe driving state;

[0099] Step S506, in response to the first evaluation result and the second evaluation result determining that the driver is in an unsafe driving state, determining the target evaluation result as the target vehicle being in an unsafe driving state;

[0100] Step S507, in response to determining that the target evaluation result is that the target vehicle is in an unsafe driving state, executing a safe driving reminder strategy.

[0101] Based on the above steps S501 to S507, the driving status information of the target vehicle and the behavior information of the driver are obtained, and the vehicle risk assessment is performed on the behavior information based on the driving status information to obtain a target assessment result; finally, the safe driving reminder strategy is determined according to the target assessment result, so as to achieve the purpose of quickly and accurately judging whether the driver is in a safe driving state, thereby achieving the technical effect of comprehensively judging whether the vehicle is in a safe driving state by combining different factors and improving the efficiency of determining the vehicle's safe driving reminder strategy, thereby solving the technical problems of the single form and low efficiency of the method for determining the vehicle's safe driving reminder strategy in the related technology.

[0102] Through the description of the above implementation methods, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for enabling a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present invention.

[0103] In an embodiment of the present invention, a device for determining a vehicle safe driving reminder strategy is also provided, and the device is used to implement the above-mentioned embodiments and preferred implementation modes, and the descriptions that have been made will not be repeated. As used below, the term "module" can implement a combination of software and / or hardware of a predetermined function. Although the device described in the following embodiments is preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceived.

[0104] Figure 6 FIG. 1 is a structural block diagram of a device for determining a vehicle safety driving reminder strategy according to one embodiment of the present invention. Figure 6 As shown, the device comprises:

[0105] An acquisition module 601 is used to acquire the driving state information of the target vehicle and the behavior information of the driver, wherein the behavior information includes the driver's eye state information and hand movement trajectory information;

[0106] An evaluation module 602 is used to perform a vehicle risk evaluation on the behavior information based on the driving state information to obtain a target evaluation result, wherein the target evaluation result is used to determine whether the target vehicle is in a safe driving state;

[0107] The determination module 603 is used to determine a safe driving reminder strategy according to the target evaluation result.

[0108] Optionally, the acquisition module 601 is also used to: collect video information of the driver; and analyze the video information using a deep learning algorithm to obtain eye state information.

[0109] Optionally, the acquisition module 601 is also used to obtain first voltage information and preset time information in response to the sensor device detecting the driver's hand; the device for determining the vehicle safe driving reminder strategy also includes a processing module 604, which is used to perform noise reduction processing on the first voltage information to obtain target voltage information; the determination module 603 is also used to determine the hand movement trajectory information based on the target voltage information and preset time information.

[0110] Optionally, the evaluation module 602 is also used to: perform a vehicle risk assessment on the eye status information based on the driving status information to obtain a first evaluation result; perform a vehicle risk assessment on the hand movement trajectory information based on the driving status information to obtain a second evaluation result; the determination module 306 is also used to determine the target evaluation result based on the first evaluation result and the second evaluation result.

[0111] Optionally, the processing module 604 is also used to compare the eye state information with a preset eye height difference threshold to obtain a comparison result in response to the target vehicle being in a driving state; the determination module 603 is also used to determine that the first assessment result is that the driver is in an unsafe driving state in response to the comparison result determining that the eye state information is less than the preset eye height difference threshold.

[0112] Optionally, the processing module 604 is also used to perform regression analysis on the hand movement trajectory information in response to the target vehicle being in a driving state to obtain an analysis result; the determination module 603 is also used to determine that the second assessment result is that the driver is in an unsafe driving state in response to the analysis result being greater than or equal to a risk threshold.

[0113] Optionally, the determination module 603 is further configured to determine that the target evaluation result is that the target vehicle is in an unsafe driving state in response to the first evaluation result and the second evaluation result determining that the driver is in an unsafe driving state.

[0114] Optionally, the processing module 604 is further configured to execute a safe driving reminder strategy in response to determining that the target evaluation result is that the target vehicle is in an unsafe driving state.

[0115] It should be noted that the above modules can be implemented by software or hardware. For the latter, it can be implemented in the following ways, but not limited to: the above modules are all located in the same processor; or the above modules are located in different processors in any combination.

[0116] According to one embodiment of the present invention, there is also provided an electronic device, comprising: a memory storing an executable program; and a processor for running the program, wherein the method for determining the vehicle safe driving reminder strategy is executed when the program is running.

[0117] Optionally, in this embodiment, the processor may be configured to perform the following steps through a computer program:

[0118] Step S1, obtaining the driving state information of the target vehicle and the behavior information of the driver, wherein the behavior information includes the driver's eye state information and hand movement trajectory information;

[0119] Step S2, performing a vehicle risk assessment on the behavior information based on the driving state information to obtain a target assessment result, wherein the target assessment result is used to determine whether the target vehicle is in a safe driving state;

[0120] Step S3, determining a safe driving reminder strategy according to the target evaluation result, wherein the safe driving reminder strategy is used to remind the driver to drive safely.

[0121] According to one embodiment of the present invention, a computer-readable storage medium is also provided, which includes a stored executable program, wherein when the executable program is running, the device where the storage medium is located is controlled to execute the above-mentioned method for determining the vehicle safety driving reminder strategy.

[0122] Optionally, in this embodiment, the storage medium may be configured to store a computer program for performing the following steps:

[0123] Step S1, obtaining the driving state information of the target vehicle and the behavior information of the driver, wherein the behavior information includes the driver's eye state information and hand movement trajectory information;

[0124] Step S2, performing a vehicle risk assessment on the behavior information based on the driving state information to obtain a target assessment result, wherein the target assessment result is used to determine whether the target vehicle is in a safe driving state;

[0125] Step S3, determining a safe driving reminder strategy according to the target evaluation result, wherein the safe driving reminder strategy is used to remind the driver to drive safely.

[0126] Optionally, in this embodiment, the above-mentioned storage medium may include but is not limited to: a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk, and other media that can store computer programs.

[0127] According to one embodiment of the present invention, a computer program product is also provided, including a computer program, and when the computer program is executed by a processor, the computer program implements the above-mentioned method for determining a vehicle safe driving reminder strategy.

[0128] Optionally, in this embodiment, the computer program product may be configured as a computer program for executing the following steps:

[0129] Step S1, obtaining the driving state information of the target vehicle and the behavior information of the driver, wherein the behavior information includes the driver's eye state information and hand movement trajectory information;

[0130] Step S2, performing a vehicle risk assessment on the behavior information based on the driving state information to obtain a target assessment result, wherein the target assessment result is used to determine whether the target vehicle is in a safe driving state;

[0131] Step S3, determining a safe driving reminder strategy according to the target evaluation result, wherein the safe driving reminder strategy is used to remind the driver to drive safely.

[0132] Optionally, the specific examples in this embodiment may refer to the examples described in the above embodiments and optional implementation modes, and this embodiment will not be described in detail here.

[0133] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0134] In the above embodiments of the present invention, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0135] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of the units can be a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0136] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0137] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0138] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk and other media that can store program codes.

[0139] The above is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principle of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.

Claims

1. A method for determining a vehicle safe driving reminder strategy, characterized in that: include: Acquire the driving state information of the target vehicle and the behavior information of the driver, wherein the behavior information includes the eye state information and hand movement trajectory information of the driver; Performing a vehicle risk assessment on the behavior information based on the driving state information to obtain a target assessment result, wherein the target assessment result is used to determine whether the target vehicle is in a safe driving state; A safe driving reminder strategy is determined according to the target evaluation result, wherein the safe driving reminder strategy is used to remind the driver to drive safely.

2. The method for determining a vehicle safe driving reminder strategy according to claim 1, characterized in that: Acquiring the driver's eye status information includes: Collecting video information of the driver; The video information is analyzed using a deep learning algorithm to obtain the eye state information.

3. The method for determining a vehicle safe driving reminder strategy according to claim 1, characterized in that: Acquiring the hand movement trajectory information of the driver includes: In response to the sensor device detecting the driver's hand, acquiring first voltage information and preset time information; Performing noise reduction processing on the first voltage information to obtain target voltage information; The hand movement trajectory information is determined based on the target voltage information and the preset time information.

4. The method for determining a vehicle safe driving reminder strategy according to claim 1, characterized in that: Performing a vehicle risk assessment on the behavior information based on the driving state information to obtain a target assessment result includes: Performing a vehicle risk assessment on the eye state information based on the driving state information to obtain a first assessment result; Performing a vehicle risk assessment on the hand movement trajectory information based on the driving state information to obtain a second assessment result; A target evaluation result is determined based on the first evaluation result and the second evaluation result.

5. The method for determining a vehicle safe driving reminder strategy according to claim 4, characterized in that: Performing a vehicle risk assessment on the eye state information based on the driving state information to obtain a first assessment result includes: In response to the target vehicle being in a driving state, comparing the eye state information with a preset eye height difference threshold to obtain a comparison result; In response to the comparison result determining that the eye state information is less than the preset eye height difference threshold, the first assessment result is determined to be that the driver is in an unsafe driving state.

6. The method for determining a vehicle safe driving reminder strategy according to claim 5, characterized in that: Performing a vehicle risk assessment on the hand movement trajectory information based on the driving state information, and obtaining a second assessment result includes: In response to the target vehicle being in a driving state, performing regression analysis on the hand movement trajectory information to obtain an analysis result; In response to the analysis result being greater than or equal to a risk threshold, determining the second assessment result as the driver being in an unsafe driving state.

7. The method for determining a vehicle safe driving reminder strategy according to claim 6, characterized in that: Determining a target evaluation result based on the first evaluation result and the second evaluation result includes: In response to the first evaluation result and the second evaluation result determining that the driver is in an unsafe driving state, the target evaluation result is determined to be that the target vehicle is in an unsafe driving state.

8. The method for determining a vehicle safe driving reminder strategy according to claim 7, characterized in that: Determining the safe driving reminder strategy according to the target evaluation result includes: In response to determining that the target evaluation result is that the target vehicle is in an unsafe driving state, a safe driving reminder strategy is executed.

9. A device for determining a vehicle safe driving reminder strategy, characterized in that: include: An acquisition module, used to acquire the driving state information of the target vehicle and the behavior information of the driver, wherein the behavior information includes the eye state information and hand movement trajectory information of the driver; An evaluation module, used to perform a vehicle risk evaluation on the behavior information based on the driving state information to obtain a target evaluation result, wherein the target evaluation result is used to determine whether the target vehicle is in a safe driving state; A determination module is used to determine a safe driving reminder strategy based on the target evaluation result.

10. An electronic device, characterized in that: include: A memory storing an executable program; A processor is used to run the program, wherein when the program is running, the method for determining the vehicle safe driving reminder strategy described in any one of claims 1 to 8 is executed.

11. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored executable program, wherein when the executable program is running, the device where the storage medium is located is controlled to execute the method for determining the vehicle safe driving reminder strategy as described in any one of claims 1 to 8.

12. A computer program product, characterized in that It comprises a computer program, which, when executed by a processor, implements the method for determining a vehicle safe driving reminder strategy according to any one of claims 1 to 8.