Drunk detection method and device, vehicle-mounted equipment, storage medium and program product

Abstract

The invention relates to a drunkenness detection method and device, vehicle-mounted equipment, a storage medium and a program product. The method comprises the steps that when a vehicle is started, a head image, collected by an image collecting device on the vehicle, of a main driver on the vehicle and first gas sensing data output by an alcohol sensor on the vehicle are obtained, the head image is recognized, and face information and physiological parameters of the main driver are obtained; and analyzing the first gas sensing data to obtain a first alcohol content of the current air in the vehicle, and then performing drunkenness detection according to the facial information, the physiological parameters and the first alcohol content to obtain a first drunkenness detection result. According to the method, whether the main driver is drunk or not is comprehensively judged by using three different types of data including the sensing data of the alcohol sensor, the facial information of the main driver and the physiological parameters, non-inductive drunkenness detection can be realized, the defect of misrecognition of single type of data can be overcome, and the drunkenness detection accuracy can be greatly improved.

Description

Technical Field

[0001] This application relates to the field of intelligent vehicle technology, and in particular to a method, device, in-vehicle equipment, storage medium, and program product for detecting intoxication. Background Technology

[0002] With the research and development and promotion of in-vehicle alcohol detection technology, more and more intelligent vehicles are equipped with alcohol detection systems to detect intoxication in the driver. Currently, in-vehicle alcohol detection systems mainly use contact alcohol sensors or passive alcohol sensors to detect intoxication in the driver. Contact alcohol sensors require the driver to exhale and detect the concentration of alcohol molecules in the driver's breath; while passive alcohol sensors can automatically detect the concentration of alcohol molecules in the air inside the vehicle.

[0003] However, current methods for detecting intoxication suffer from low accuracy. Summary of the Invention

[0004] Therefore, it is necessary to provide a method, device, vehicle-mounted equipment, storage medium, and program product for detecting intoxication that can improve the accuracy of intoxication detection, in response to the above-mentioned technical problems.

[0005] Firstly, this application provides a method for detecting intoxication, including:

[0006] When the vehicle is started, the head image of the driver in the vehicle is acquired by the image acquisition device on the vehicle, and the first gas sensing data output by the alcohol sensor on the vehicle is acquired.

[0007] The head image is identified to obtain the driver's facial information and physiological parameters, and the first gas sensor data is analyzed to obtain the first alcohol content in the current air in the vehicle.

[0008] Based on the facial information, the physiological parameters, and the first alcohol content, an intoxication test is performed to obtain a first intoxication test result.

[0009] In one embodiment, the alcohol sensor is a semiconductor sensor or an infrared sensor, and the step of performing intoxication detection based on the facial information, the physiological parameters, and the first alcohol content to obtain a first intoxication detection result includes:

[0010] The driver is intoxicated based on the first alcohol content to obtain a first detection result, the driver is intoxicated based on the physiological parameters to obtain a second detection result, and the driver is intoxicated based on the facial information to obtain a third detection result.

[0011] If the first detection result indicates that the driver is intoxicated, and at least one of the second and third detection results indicates that the driver is intoxicated, then it is determined that the first intoxication detection result indicates that the driver is intoxicated.

[0012] If the first test result indicates that the driver is not intoxicated, and both the second and third test results indicate that the driver is not intoxicated, then the first intoxication test result indicates that the driver is not intoxicated.

[0013] In one embodiment, the alcohol sensor is an electrochemical sensor, and the process of detecting intoxication based on the facial information, the physiological parameters, and the first alcohol content to obtain a first intoxication detection result includes:

[0014] The facial information, physiological parameters, and the first alcohol content are input into a trained intoxication detection model to perform intoxication detection, and the first intoxication detection result is obtained.

[0015] In one embodiment, the method further includes:

[0016] When the first alcohol test result indicates that the driver is intoxicated, a first prompt message and a first valet service control are displayed on the vehicle's central control screen, and the gear position on the vehicle is restricted to keep it in the parking position; the first prompt message is used to inform the driver that the vehicle is currently in a suboptimal pre-driving condition.

[0017] In response to the driver's triggering operation on the first designated driver service control, after communicating with the third-party designated driver service platform, a first designated driver service request is sent to the third-party designated driver service platform; the first designated driver service request is used to instruct the third-party designated driver service platform to provide designated driver service for the driver.

[0018] In one embodiment, the method further includes:

[0019] During the vehicle's operation, the second gas sensing data output by the alcohol sensor on the vehicle, as well as the vehicle's driving trajectory within a preset time period, are acquired.

[0020] The second gas sensor data is analyzed to obtain the second alcohol content in the current air of the vehicle;

[0021] Based on the driving trajectory and the second alcohol content, a drunk driving test is performed to obtain a second drunk driving test result.

[0022] In one embodiment, the method further includes:

[0023] When the second intoxication test result indicates that the driver is intoxicated, a second prompt message and a second valet driving service control are displayed on the vehicle's central control screen, and the autonomous driving function is activated to control the vehicle to drive to the target location; the second prompt message is used to inform the driver that the vehicle is currently in a suboptimal driving condition;

[0024] In response to the driver's triggering operation on the second chauffeur service control, after communicating with the third-party chauffeur service platform, a second chauffeur service request is sent to the third-party chauffeur service platform; the second chauffeur service request is used to instruct the third-party chauffeur service platform to provide chauffeur service to the driver.

[0025] In one embodiment, prior to communicating with the third-party chauffeur service platform, the method further includes:

[0026] After activating the autonomous driving function, the vehicle is controlled to drive to the target location; or, address information is displayed on the central control display screen; the address information is used to prompt the driver of the target location of the vehicle.

[0027] Secondly, this application also provides a device for detecting intoxication, comprising:

[0028] The first acquisition module is used to acquire, when the vehicle is started, the head image of the driver in the vehicle captured by the image acquisition device in the vehicle, and the first gas sensing data output by the alcohol sensor in the vehicle.

[0029] The first analysis module is used to identify the head image to obtain the facial information and physiological parameters of the driver, and to analyze the first gas sensor data to obtain the first alcohol content in the current air in the vehicle.

[0030] The first detection module is used to perform an intoxication detection based on the facial information, the physiological parameters, and the first alcohol content, and obtain a first intoxication detection result.

[0031] Thirdly, this application also provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to implement the method described in the first aspect above.

[0032] Fourthly, this application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method described in the first aspect above.

[0033] Fifthly, this application also provides a computer program product, including a computer program that, when executed by a processor, implements the method described in the first aspect above.

[0034] The aforementioned method, device, vehicle-mounted equipment, storage medium, and program product for detecting intoxication acquire, upon vehicle startup, a head image of the driver captured by an image acquisition device on the vehicle, and first gas sensing data output by a gas sensor on the vehicle. The head image is then recognized to obtain the driver's facial information and physiological parameters. The first gas sensing data is analyzed to determine the current air alcohol content in the vehicle. Intoxication detection is then performed based on the facial information, physiological parameters, and the first alcohol content to obtain a first intoxication detection result. This method uses three different types of data—gas sensor data, driver's facial information, and physiological parameters—to comprehensively determine whether the driver is intoxicated. Firstly, it enables a non-invasive intoxication detection method, meaning the detection process does not require the driver to actively blow into the air, thus improving the efficiency and recognition rate of alcohol detection. Secondly, because the three types of data are used for comprehensive judgment, the defects of misidentification with single-type data can be overcome, greatly improving the accuracy of intoxication detection. Attached Figure Description

[0035] To more clearly illustrate the technical solutions in the embodiments of this application or related technologies, the drawings used in the description of the embodiments of this application or related technologies will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other related drawings can be obtained based on these drawings without creative effort.

[0036] Figure 1 This is a diagram illustrating the application environment of the alcohol detection method in the embodiments of this application;

[0037] Figure 2 This is one of the flowcharts illustrating the alcohol detection method in the embodiments of this application;

[0038] Figure 3 This is the second schematic flowchart of the alcohol detection method in the embodiments of this application;

[0039] Figure 4 This is the third flowchart illustrating the alcohol detection method in the embodiments of this application;

[0040] Figure 5 This is the fourth flowchart illustrating the alcohol detection method in the embodiments of this application;

[0041] Figure 6 This is the fifth flowchart illustrating the alcohol detection method in the embodiments of this application;

[0042] Figure 7 This is the sixth flowchart illustrating the alcohol detection method in the embodiments of this application;

[0043] Figure 8 This is the tenth flowchart illustrating the alcohol detection method in the embodiments of this application;

[0044] Figure 9 This is eleventh of the flowcharts illustrating the alcohol detection method in the embodiments of this application;

[0045] Figure 10 This is a schematic diagram of the alcohol detection device in the embodiments of this application;

[0046] Figure 11 This is a diagram showing the internal structure of the vehicle-mounted device in an embodiment of this application. Detailed Implementation

[0047] To facilitate understanding of this application, a more complete description will be provided below with reference to the accompanying drawings. Preferred embodiments of this application are shown in the drawings. However, this application can be implemented in many different forms and is not limited to the embodiments described herein. Rather, these embodiments are provided to provide a thorough and complete understanding of the disclosure of this application.

[0048] It should be understood that although the terms “first,” “second,” etc., may be used herein to describe various elements, this does not indicate any order, quantity, or importance, but is merely used to distinguish different components. These terms are used only to distinguish one element from another. For example, without departing from the scope of this application, a first element may be referred to as a second element, and similarly, a second element may be referred to as a first element. Words such as “comprising” or “including” mean that the element or object preceding the word covers the element or object listed after the word and its equivalents, without excluding other elements or objects.

[0049] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein in the specification of this application is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. The term "and / or" as used herein includes any and all combinations of one or more of the associated listed items.

[0050] More and more vehicles are now required to be equipped with alcohol interlocks at the factory to conduct alcohol tests on the driver and passengers to reduce the risk of accidents. The most widely used alcohol interlocks are breathalyzer and passive interlocks. Breathalyzers require the driver's active cooperation to complete the test, but many users are reluctant to cooperate, affecting the effectiveness of this type of detection method in vehicles. Passive alcohol interlocks, on the other hand, use alcohol concentration sensors to detect the concentration of alcohol molecules in the air inside the vehicle. Therefore, in scenarios with good air circulation or where the air contains other substances such as perfume or food that can affect the concentration of alcohol molecules, these types of alcohol interlocks cannot accurately detect intoxication.

[0051] In view of this, embodiments of this application propose a method, device, vehicle-mounted equipment, storage medium, and program product for detecting intoxication, which can improve the accuracy of intoxication detection of the driver by the vehicle.

[0052] It should be noted that the beneficial effects or technical problems solved by the embodiments of this application are not limited to this one, but may also be other implicit or related problems. For details, please refer to the description of the embodiments below.

[0053] The alcohol detection and control method provided in this application embodiment can be applied to, for example... Figure 1 The application environment shown is illustrated. The detection device 102 is installed on the vehicle 104. The detection device 102 is used to detect whether the driver in the vehicle is intoxicated before the vehicle starts and moves; it is also used to detect whether the driver is intoxicated during vehicle operation. In this embodiment, the detection device 102 collects various air data, driver-related data (e.g., driver's facial information, movement information, etc.), and vehicle driving data from the vehicle 104, and analyzes the air data, driver-related data, and driving data to achieve intoxication detection. The detection device 102 can be, but is not limited to, various personal computers, laptops, smartphones, tablets, IoT devices, and portable wearable devices. IoT devices can be smart speakers, smart TVs, smart air conditioners, smart in-vehicle devices, projection devices, etc. Portable wearable devices can be smartwatches, smart bracelets, head-mounted devices, etc. Head-mounted devices can be virtual reality (VR) devices, augmented reality (AR) devices, smart glasses, etc.

[0054] In one exemplary embodiment, such as Figure 2 As shown, a method for detecting intoxication is provided, which can be applied to... Figure 1 Taking the detection device in the middle as an example, the method includes:

[0055] S201, when the vehicle is started, acquire the head image of the driver in the vehicle captured by the image acquisition device on the vehicle, and the first gas sensing data output by the alcohol sensor on the vehicle.

[0056] The image acquisition device is used to capture images of the driver's head; it can be a camera, dashcam, or other similar device. The alcohol sensor is used to detect the alcohol content in the air of the driver's cabin; it can be an electrochemical sensor, a semiconductor sensor, or an infrared sensor.

[0057] In this embodiment, the image acquisition device can be installed at a position relative to the driver's location in the vehicle, enabling it to fully capture the driver's head image. The alcohol sensor can be installed at a position relative to the driver's exhalation location in the vehicle, enabling it to effectively collect the gas data of the driver's exhaled breath. For example, the alcohol sensor can be installed on the vehicle's steering wheel. Vehicle startup refers to the period from vehicle startup to before driving. During this time period, the vehicle activates its image acquisition device to capture consecutive frames of head images of the driver (i.e., video images of the driver), facilitating subsequent analysis of the driver's facial expressions and / or movements based on these consecutive head images. Correspondingly, during the aforementioned time period, the vehicle simultaneously activates its alcohol sensor to collect gas sensing data of the driver's exhaled breath, detecting the alcohol content contained in the breath released after the driver enters the vehicle.

[0058] S202, the head image is recognized to obtain the driver's facial information and physiological parameters, and the first gas sensor data is analyzed to obtain the current alcohol content in the air in the vehicle.

[0059] The facial information includes expression information and / or movement information. Expression information includes at least one of the following: eye gaze state, facial color, etc. Movement information includes at least one of the following: head shaking frequency, mouth opening and closing frequency, etc. Physiological parameters include at least one of the following: heart rate, blood oxygen saturation, respiratory rate, heart rate variability, etc.

[0060] In this embodiment, when the detection device acquires a head image, it can recognize the driver's facial expressions in the head image to identify the driver's eye state and / or face color, obtaining expression information to facilitate subsequent judgment of whether the driver is intoxicated. It can also recognize the driver's movements in the head image (e.g., head shaking and / or mouth closure) to identify the driver's head shaking frequency and / or mouth opening and closing frequency, obtaining movement information to facilitate subsequent judgment of whether the driver is intoxicated. Optionally, it can also recognize the driver's physiological characteristics in the head image to identify at least one physiological parameter such as heart rate, blood oxygen, respiratory rate, and heart rate variability. This physiological characteristic recognition can be achieved using remote photoplethysmography (rPPG). When the detection device acquires the first gas data, it can analyze the alcohol molecule content in the first gas data to obtain the current alcohol content in the vehicle's air. It should be noted that the head image recognition described above can be achieved using a pre-trained image recognition model.

[0061] S203, based on facial information, physiological parameters, and the first alcohol content, a drunkenness test is performed to obtain the first drunkenness test result.

[0062] In this embodiment of the application, when the detection device obtains the driver's facial information, physiological parameters, and first alcohol content based on the aforementioned steps, the first optional method for detecting intoxication is that the detection device can first perform intoxication detection based on the first alcohol content to determine whether the driver is intoxicated, obtaining a detection result based on alcohol content analysis; then, it can perform intoxication detection based on facial information and physiological parameters to determine whether the driver is intoxicated, obtaining a detection result based on these two types of information analysis; finally, the detection result based on these two types of information analysis is used to assist in judging the detection result based on alcohol content analysis, so as to determine the final first intoxication detection result.

[0063] When the detection device obtains the driver's facial information, physiological parameters, and initial blood alcohol content based on the aforementioned steps, the second optional method for detecting intoxication is as follows: the detection device can first perform an intoxication test based on facial information to determine whether the driver is intoxicated, obtaining a test result based on facial information analysis; then, it can perform an intoxication test based on the initial blood alcohol content and physiological parameters to determine whether the driver is intoxicated, obtaining a test result based on the analysis of these two types of information; finally, the test result based on the analysis of these two types of information is used to assist in the judgment of the test result based on facial information analysis to determine the final initial intoxication test result.

[0064] When the detection device obtains the driver's facial information, physiological parameters, and initial blood alcohol content based on the aforementioned steps, the third optional method for detecting intoxication is as follows: the detection device can first perform an intoxication test based on physiological parameters to determine whether the driver is intoxicated, obtaining a test result based on physiological parameter analysis; then, it can perform an intoxication test based on the initial blood alcohol content and facial information to determine whether the driver is intoxicated, obtaining a test result based on the analysis of these two types of information; finally, the test result based on the analysis of these two types of information is used to assist in the judgment of the test result based on facial information analysis to determine the final initial intoxication test result.

[0065] When the detection device obtains the driver's facial information, physiological parameters, and initial blood alcohol content based on the aforementioned steps, the fourth optional method for detecting intoxication is to analyze these three types of data together to determine whether the driver is intoxicated, thus obtaining the initial intoxication detection result. In this fourth optional method, one specific analysis method uses a pre-trained intoxication recognition model to analyze the three types of data to obtain the initial intoxication detection result; another method first assigns corresponding weight coefficients to facial information, physiological parameters, and initial blood alcohol content, then fuses these data according to the weight coefficients for each type of data to obtain fused data, and finally uses the intoxication recognition model to analyze the fused data to obtain the initial intoxication detection result.

[0066] The intoxication detection method described in the above embodiments acquires a head image of the driver from an image acquisition device on the vehicle and first gas sensing data output by a gas sensor on the vehicle when the vehicle is started. The head image is then identified to obtain the driver's facial information and physiological parameters. The first gas sensing data is analyzed to obtain the current air alcohol content in the vehicle. Intoxication detection is then performed based on the facial information, physiological parameters, and the first alcohol content to obtain a first intoxication detection result. This method uses three different types of data—gas sensor data, driver's facial information, and physiological parameters—to comprehensively determine whether the driver is intoxicated. Firstly, it enables a non-invasive intoxication detection method, meaning the detection process does not require the driver to actively blow into the air, thus improving the efficiency and recognition rate of alcohol detection. Secondly, because the three types of data are used for comprehensive judgment, the defects of misidentification with single-type data can be overcome, greatly improving the accuracy of intoxication detection.

[0067] In one exemplary embodiment, when the alcohol sensor installed in the vehicle is a semiconductor sensor or an infrared sensor, a method for detecting intoxication based on three types of data is provided, such as... Figure 3 As shown, the above-mentioned S203 "conducting an alcohol intoxication test based on facial information, physiological parameters, and a first alcohol content to obtain a first alcohol intoxication test result" includes:

[0068] S301, based on the first alcohol content test, determine whether the driver is intoxicated and obtain the first test result.

[0069] The first test result indicates that the driver is intoxicated, or the first test result indicates that the driver is not intoxicated.

[0070] This application relates to a method for alcohol detection based on a first alcohol content. One optional approach is that, after the detection device acquires the first alcohol content, it determines whether the first alcohol content indicates the presence of alcohol molecules in the air of the vehicle. If the first alcohol content indicates the presence of alcohol molecules in the air (i.e., the first alcohol content is greater than zero), then the first detection result indicates that the driver is intoxicated; if the first alcohol content indicates that the air of the vehicle does not contain alcohol molecules (i.e., the first alcohol content is equal to zero), then the first detection result indicates that the driver is not intoxicated. Another optional approach is that, when the detection device acquires the first alcohol content and this first alcohol content indicates the presence of alcohol molecules in the air of the vehicle, it can further compare the first alcohol content with a preset alcohol content threshold. If the first alcohol content is greater than the preset alcohol content threshold, then the first detection result indicates that the driver is intoxicated; if the first alcohol content is not greater than the preset alcohol content threshold, then the first detection result indicates that the driver is not intoxicated. The aforementioned preset alcohol content threshold is a standard alcohol content used to measure the amount of alcohol molecules corresponding to whether a person is intoxicated. The aforementioned preset alcohol content threshold can be determined by the requirements of intoxication testing. It should be noted that the aforementioned first alcohol content is detected by a semiconductor sensor or an infrared sensor. Since the start-up time of the semiconductor sensor or infrared sensor is short, the semiconductor sensor or infrared sensor can start immediately when the vehicle is started, thereby accurately measuring the aforementioned first alcohol content.

[0071] S302, based on physiological parameters, detects whether the driver is intoxicated, and obtains a second test result.

[0072] The second test result indicates that the driver is intoxicated, or the second test result indicates that the driver is not intoxicated.

[0073] This application relates to a method for alcohol detection based on physiological parameters. When the detection device acquires the physiological parameters of the driver, it can further determine whether the physiological parameters meet the physiological conditions corresponding to a preset state of intoxication. If they do, the second detection result indicates that the driver is intoxicated; if they do not, the second detection result indicates that the driver is not intoxicated. The aforementioned physiological parameters may include one parameter or multiple parameters. For example, the physiological parameter may be heart rate, or it may include both heart rate and blood oxygen saturation. The aforementioned physiological conditions may include standard physiological parameters used to assess whether a person is intoxicated. For example, the aforementioned physiological conditions include: heart rate greater than standard heart rate. Another example is that the aforementioned physiological conditions include: the person's actual heart rate is greater than the standard heart rate, and the person's actual blood oxygen saturation is greater than the standard blood oxygen saturation. For example, if the driver's physiological parameters include heart rate, and the corresponding physiological condition is that the heart rate is greater than the standard heart rate, then the heart rate is compared with the standard heart rate. If the heart rate is greater than the standard heart rate, it is determined that the driver's physiological parameters meet the physiological conditions, and thus the second test result indicates that the driver is intoxicated. If the heart rate is not greater than the standard heart rate, it is determined that the driver's physiological parameters do not meet the physiological conditions, and thus the second test result indicates that the driver is not intoxicated.

[0074] S303 uses facial information to detect whether the driver is intoxicated, obtaining a third test result.

[0075] The facial information in this application embodiment includes expression information and motion information. Expression information includes eye state and / or facial color. Motion information includes the driver's head shaking frequency and / or mouth closing frequency.

[0076] This application relates to a method for alcohol detection based on facial information. When the detection device acquires the facial information of the driver, it can first determine the driver's current expression based on the facial expression information, and then determine whether the current expression meets the reference expression corresponding to a preset state of intoxication. If the driver's current expression meets the reference expression corresponding to the preset state of intoxication, the motion information in the facial information is analyzed to determine a third detection result; if the driver's current expression does not meet the reference expression corresponding to the preset state of intoxication, the third detection result indicates that the driver is not intoxicated.

[0077] The method described above for analyzing facial motion information to determine the third detection result includes: first, determining whether the driver has any abnormal movements corresponding to an intoxicated state based on the motion information; if it is determined that the driver has abnormal movements corresponding to an intoxicated state, then the third detection result is determined to indicate that the current driver is intoxicated; if it is determined that the driver does not have any abnormal movements corresponding to an intoxicated state, then the third detection result is determined to indicate that the driver is not intoxicated.

[0078] It should be noted that when the above facial expression information includes the driver's eye state, the reference expression corresponding to the preset state of intoxication is a vacant gaze. That is, if the current facial expression identified based on the facial expression information indicates that the driver's eyes are vacant, the driver is judged to be intoxicated; otherwise, the driver is judged to be non-intoxicated. When the above facial expression information includes the driver's facial color, the reference expression corresponding to the preset state of intoxication is a flushed face (for example, the facial color type is consistent with the preset color type, and the color value of the facial color is greater than the preset color value). In other words, if the facial expression information indicates that the driver's face is flushed, the driver is considered to be intoxicated; otherwise, the driver is considered to be intoxicated. When the facial expression information includes both the driver's eye state and facial color, the corresponding preset reference expression for intoxication is a vacant gaze and a flushed face. That is, if the current facial expression indicates that the driver's eyes are vacant and the face is flushed, the driver is considered to be intoxicated; otherwise, the driver is considered to be intoxicated.

[0079] The action information includes the driver's head shaking frequency and / or mouth closure frequency. Corresponding to the above method for determining whether the driver exhibits abnormal actions corresponding to intoxication based on action information, the method includes: one method is that when the action information includes the driver's head shaking frequency, the driver's head shaking frequency can be compared with a head shaking frequency threshold. If the head shaking frequency is greater than the threshold corresponding to intoxication, then it is determined that the driver is exhibiting abnormal actions corresponding to intoxication; otherwise, it is determined that the driver is not exhibiting abnormal actions corresponding to intoxication. Another method is that when the action information includes the driver's mouth closure frequency, the driver's mouth closure frequency can be compared with a mouth shaking frequency threshold. If the mouth closure frequency is greater than the threshold corresponding to intoxication, then it is determined that the driver is exhibiting abnormal actions corresponding to intoxication; otherwise, it is determined that the driver is not exhibiting abnormal actions corresponding to intoxication. Another method is to determine the driver's behavior when the action information includes the driver's head shaking frequency and mouth closing frequency. If the head shaking frequency is greater than the head shaking frequency threshold corresponding to the intoxication state, and the mouth closing frequency is greater than the mouth shaking frequency threshold, then the driver is determined to have abnormal behavior corresponding to the intoxication state. Otherwise, the driver is determined not to have abnormal behavior corresponding to the intoxication state.

[0080] S304. Based on the first test result, the second test result, and the third test result, the first intoxication test result is obtained.

[0081] This application relates to specific methods for detecting intoxication, including three implementation methods. The first implementation method involves using a first detection result as the basis for judgment, and then using a second and third detection result as auxiliary judgment criteria to further evaluate the first detection result, thus obtaining a final first intoxication detection result. The second implementation method involves using a second detection result as the basis for judgment, and then using the first and third detection results as auxiliary judgment criteria to further evaluate the second detection result, thus obtaining a final first intoxication detection result. The third implementation method involves using a third detection result as the basis for judgment, and then using the first and second detection results as auxiliary judgment criteria to further evaluate the third detection result, thus obtaining a final first intoxication detection result. The methods described in the above embodiments integrate three types of data for intoxication detection, which can improve the accuracy of intoxication detection.

[0082] In one exemplary embodiment, a specific implementation method for alcohol detection based on three types of data is provided, such as... Figure 4 As shown, S304 above, "Based on the first test result, the second test result, and the third test result, the first intoxication test result is obtained," includes:

[0083] S401, if the first test result indicates that the driver is intoxicated, and at least one of the second and third test results indicates that the driver is intoxicated, then the first intoxication test result indicates that the driver is intoxicated.

[0084] S402, if the first test result indicates that the driver is not intoxicated, and the second and third test results both indicate that the driver is not intoxicated, then the first intoxication test result indicates that the driver is not intoxicated.

[0085] This application relates to a specific method for detecting intoxication by using a first detection result as the basic judgment and a second and third detection result as auxiliary judgment criteria. The method includes: the detection device first determines the first detection result; if the first detection result indicates that the driver is intoxicated, then the second and third detection results are further determined; if one or both of the second and third detection results indicate that the driver is intoxicated, then the first intoxication detection result indicates whether the driver is intoxicated; otherwise, the first intoxication detection result indicates whether the driver is not intoxicated. If the first detection result indicates that the driver is not intoxicated, then the second and third detection results are further determined; if both the second and third detection results indicate that the driver is not intoxicated, then the first intoxication detection result indicates whether the driver is not intoxicated; otherwise, the first intoxication detection result indicates whether the driver is intoxicated. The above method uses the results of the alcohol sensor as the basis for judgment, and facial information and physiological parameters as auxiliary factors to determine whether the driver is intoxicated. This overcomes the problem of false detections by alcohol sensors, thus improving the accuracy of intoxication detection. Furthermore, because the alcohol sensor uses a semiconductor or infrared sensor, which has a short startup time, it can accurately measure alcohol content when the vehicle is started. Therefore, the method uses the alcohol sensor's detection results as the basis for judgment, improving the accuracy of alcohol detection during vehicle startup.

[0086] In an exemplary embodiment, when the gas sensor installed on the vehicle is an electrochemical sensor, a method for detecting intoxication based on three types of data is provided. The above-mentioned S203 "detecting intoxication based on facial information, physiological parameters and a first alcohol content to obtain a first intoxication detection result" includes: inputting facial information, physiological parameters and a first alcohol content as analysis objects into a trained intoxication detection model to detect intoxication and obtain a first intoxication detection result.

[0087] In this embodiment, the detection device can pre-train an intoxication recognition model, enabling it to analyze three types of data: facial information, physiological parameters, and initial blood alcohol content (ABV), to identify whether the driver is intoxicated. Specifically, when the vehicle starts, the detection device acquires the driver's current facial information, physiological parameters, and the APV in the driver's cabin, and directly inputs this data into the trained intoxication recognition model to obtain the initial intoxication detection result. Optionally, the detection device can also first fuse the driver's current facial information, physiological parameters, and the APV in the driver's cabin with different weights to obtain fused data, and then input the fused data into the trained intoxication recognition model to obtain the initial intoxication detection result. The above method realizes a method for detecting intoxication based on an intelligent model, improving both the accuracy and intelligence of vehicle intoxication detection.

[0088] In one exemplary embodiment, a method for facial expression recognition is also provided, namely... Figure 2 In the embodiment, the implementation method of S202 "recognizing the head image to obtain the facial information of the driver" is as follows: Figure 5 As shown, this implementation method includes:

[0089] S501, recognize facial expressions in the head image to obtain facial expression information.

[0090] The facial expression information includes the driver's eye contact and / or facial color. Eye contact can be unfocused or normal.

[0091] In this embodiment, when the facial expression information includes the driver's eye gaze, and the detection device acquires a head image, the head image can be input into an eye gaze recognition model to identify changes in the driver's eye gaze and determine whether the driver's eye gaze is unfocused, thus obtaining the driver's eye gaze state. This eye gaze recognition model can be pre-trained based on a large amount of sample data from head images. Similarly, when the facial expression information includes the driver's facial color, and the detection device acquires a head image, the head image can be input into a facial color recognition model to identify changes in the driver's facial color, thus obtaining the driver's facial color. This facial color recognition model can also be pre-trained based on a large amount of sample data from facial images. When facial expression information includes the driver's eye state and facial color, and when the detection device acquires a head image, the head image can be input into the facial expression recognition model to identify the driver's facial expression changes (including changes in eye state and facial color), thereby obtaining the driver's eye state and facial color. The facial expression recognition model can be pre-trained based on a large amount of facial image sample data.

[0092] S502, recognizes head movements in the head image to obtain movement information from the facial information.

[0093] The motion information includes the frequency of the driver's head shaking and / or the frequency of mouth opening and closing.

[0094] In this embodiment, when the action information includes the driver's head shaking frequency, and the detection device acquires a head image, the head image can be input into a head recognition model to identify the driver's head shaking and obtain the driver's head shaking frequency. The head recognition model can be pre-trained based on a large amount of sample data from head images. Similarly, when the action information includes the driver's mouth opening and closing frequency, and the detection device acquires a head image, the head image can be input into a mouth recognition model to identify the driver's mouth opening and closing and obtain the driver's mouth opening and closing frequency. The mouth recognition model can also be pre-trained based on a large amount of sample data from head images. Finally, when the action information includes both head shaking frequency and mouth opening and closing frequency, and the detection device acquires a head image, the head image can be input into an action recognition model to identify the driver's head shaking and mouth opening and closing and obtain the driver's head shaking frequency and mouth opening and closing frequency. The action recognition model can also be pre-trained based on a large amount of sample data from facial images.

[0095] The method described in the above embodiments combines the driver's facial expressions and head movements for alcohol detection, analyzing whether the driver is intoxicated from two different dimensions, which can greatly improve the accuracy of judging whether the driver is intoxicated based on facial information.

[0096] In one exemplary embodiment, a method based on Figure 2 The method for intervening in driving using the intoxication detection method described in the embodiment is as follows: Figure 5 As shown, Figure 2 The method described in the embodiments further includes:

[0097] S601, when the first alcohol test result indicates that the driver is intoxicated, displays the first prompt message and the first chauffeur service control on the vehicle's central control display screen, and restricts the gear position on the vehicle to keep it in the parking gear.

[0098] The first notification message is used to inform the driver that the vehicle is currently in an unsuitable driving condition, meaning the vehicle is not currently suitable for driving. For example, the first notification message might include a field like "The current driver is not suitable for driving." The first-level driver service control is an interactive control that interacts with the driver.

[0099] In this embodiment, when the detection device obtains a first intoxication test result based on the aforementioned steps, and the first intoxication test result indicates that the driver is intoxicated, the detection device can generate a first indication message containing a field such as "unsuitable for driving," and display this first indication message on the current display screen to remind the driver to avoid the risk of intoxicated driving. Correspondingly, a first designated driver service control can also be displayed on the display screen, facilitating the driver to connect with a third-party designated driver service platform based on this control to seek designated driver services.

[0100] Optionally, if the initial alcohol test result indicates that the driver is intoxicated, it means the vehicle is not suitable for driving at this time, and since the vehicle has not yet been driven, the gear shift can be restricted to remain in the parking gear (P). Specifically, the detection device can send a restriction signal to the vehicle's gear shift controller. When the gear shift controller receives this restriction signal, it restricts gear adjustments. That is, if the gear shift controller later receives a gear shift signal, such as shifting from P to a drive, it can remain in P without adjusting the gear.

[0101] S602, in response to the driver's triggering operation on the first-generation driver service control, communicates with the third-party driver service platform and then sends a first-generation driver service request to the third-party driver service platform.

[0102] The first designated driver service request is used to instruct a third-party designated driver service platform to provide designated driver services to the primary driver. The first designated driver service request includes the vehicle's current location, license plate number, vehicle model, and vehicle color.

[0103] In this embodiment, when the driver triggers the first chauffeur service control on the central control display screen, the central control terminal sends a request signal to the detection device. Upon receiving the request signal, the detection device obtains the vehicle's current location, license plate number, and vehicle model, and generates a first chauffeur service request based on this information. Then, it establishes a communication connection with a third-party chauffeur service platform through the vehicle's communication module and sends the first chauffeur service request to the third-party platform. Upon receiving the first chauffeur service request, the third-party platform can instruct a chauffeur to provide chauffeur service to the driver. Optionally, after sending the first chauffeur service request to the third-party platform, the vehicle can also receive chauffeur service information returned by the platform based on the request and display this information on the vehicle's central control display screen to inform the driver of the available chauffeur service. This information may include the value of the service and the driver's information (gender, age, driving experience, etc.), allowing the driver to understand the chauffeur service details. In the above scenario, the central control display screen can show a confirmation control and a denial control. When the confirmation control is triggered, it confirms that the driver actively needs a designated driver service; when the denial control is triggered, it confirms that the driver does not need a designated driver service. Subsequently, if the driver triggers the confirmation control, the system will respond by communicating with the third-party designated driver service platform to call for a designated driver service. If the driver triggers the denial control, the system will not respond by communicating with the third-party designated driver service platform. In this scenario, a corresponding drunk driving warning message or drunk driving symbol can be generated and displayed on the vehicle's light signal display screen, providing pedestrians with information that the driver may be intoxicated, helping others to avoid risks in a timely manner.

[0104] It should be noted that the aforementioned first-line chauffeur service request may also include the vehicle's destination address. This destination address can be automatically entered by the driver when the driver triggers the first-line chauffeur service control; alternatively, it can be automatically extracted by the vehicle from the navigation information entered by the driver when the driver triggers the first-line chauffeur service control. Including the vehicle's destination address in the chauffeur service request facilitates the third-party chauffeur service platform in matching a suitable driver to provide chauffeur service. Furthermore, when the driver triggers the confirmation control, the third-party chauffeur service platform can also send payment information to the vehicle. The central control display shows a payment interface containing this payment information, which may include a payment QR code. The vehicle can then automatically pay based on the payment QR code; alternatively, the driver can manually scan the code to pay. After payment, the third-party chauffeur service platform can assign a driver to provide chauffeur service.

[0105] The method described in the above embodiments can automatically connect to a third-party designated driver service platform to obtain third-party designated driver services when the driver is detected to be intoxicated before the vehicle starts and drives. This provides convenient conditions for handling the vehicle while the driver is intoxicated, improves the vehicle's intelligence, and reduces the probability of drunk driving.

[0106] In one exemplary embodiment, a method for detecting intoxication while a vehicle is in motion is also provided, namely, as follows: Figure 6 As shown, Figure 2 The method described in the embodiments further includes:

[0107] S701 acquires second gas sensing data output by the vehicle's alcohol sensor and the vehicle's driving trajectory within a preset time period during the vehicle's operation.

[0108] In this embodiment, when the vehicle starts moving, its gas sensors are activated to collect gas sensing data from the driver's exhaled breath, in order to detect the alcohol content in the breath released by the driver during vehicle operation. Simultaneously, the vehicle's location information at various times within a preset time period is acquired, and the vehicle's trajectory is determined based on this location information.

[0109] S702 analyzes the second gas sensor data to obtain the second alcohol content in the current air in the vehicle.

[0110] In this embodiment of the application, when the detection device acquires the second gas data, it can analyze the content of alcohol molecules in the second gas data to obtain the second alcohol content of the current air in the vehicle.

[0111] S703, based on the driving trajectory and the second alcohol content, conducts a drunk driving test to obtain the second drunk driving test result.

[0112] In this embodiment of the application, when the detection device obtains the vehicle's driving trajectory and the second alcohol content based on the aforementioned steps, the first optional method for detecting intoxication is that the detection device can first perform intoxication detection based on the second alcohol content to determine whether the driver is intoxicated, and obtain a detection result based on alcohol content analysis; then perform intoxication detection based on the driving trajectory to determine whether the driver is intoxicated, and obtain a detection result based on driving trajectory analysis; finally, use the detection result based on driving trajectory analysis to assist in judging the detection result based on alcohol content analysis, so as to determine the final second intoxication detection result.

[0113] When the detection device obtains the vehicle's driving trajectory and the second alcohol content based on the aforementioned steps, the second optional method for detecting intoxication is as follows: the detection device can first perform an intoxication test based on the driving trajectory to determine whether the driver is intoxicated, obtaining a test result based on the driving trajectory analysis; then, it can perform an intoxication test based on the second alcohol content to determine whether the driver is intoxicated, obtaining a test result based on the alcohol content analysis; finally, the test result based on the alcohol content analysis is used to assist in judging the test result based on the driving trajectory analysis to determine the final second intoxication test result.

[0114] When the detection device obtains the vehicle's driving trajectory and second alcohol content based on the aforementioned steps, a third optional method for detecting intoxication is to analyze both types of data together to determine whether the driver is intoxicated, thus obtaining a second intoxication detection result. In this third optional method, one analysis method uses a pre-trained intoxication recognition model to analyze the two types of data to obtain the second intoxication detection result; another method first assigns corresponding weight coefficients to the driving trajectory and second alcohol content, then fuses the driving trajectory and second alcohol content according to the weight coefficients corresponding to each type of data to obtain fused data, and finally uses the intoxication recognition model to analyze the fused data to obtain the second intoxication detection result.

[0115] The intoxication detection method described in the above embodiments acquires second gas sensing data output by the alcohol sensor on the vehicle during vehicle operation, as well as the vehicle's driving trajectory within a preset time period. The second gas sensing data is analyzed to obtain the current second alcohol content in the air within the vehicle. Intoxication detection is then performed based on the driving trajectory and the second alcohol content to obtain a second intoxication detection result. This method uses both alcohol sensor data and vehicle driving trajectory data to comprehensively determine whether the driver is intoxicated. First, it enables a non-contact intoxication detection method, meaning the detection process does not require the driver to actively blow into the air, thus improving the efficiency and recognition rate of alcohol detection. Second, because the combined judgment of two types of data, along with the driving trajectory, can determine with high probability whether the driver is driving abnormally, this method overcomes the deficiency of misidentification based on a single type of data, greatly improving the accuracy of intoxication detection.

[0116] In one exemplary embodiment, a method based on Figure 6 The method for intervening in driving using the intoxication detection method described in the embodiment is as follows: Figure 7 As shown, Figure 6 The method described in the embodiments further includes:

[0117] S801, when the second intoxication test result indicates that the driver is intoxicated, displays a second prompt message and a second-generation driver service control on the vehicle's central control display screen, and activates the automatic driving function to control the vehicle to the target location.

[0118] The second notification message is used to inform the driver that the vehicle is currently in an unsuitable driving condition. For example, the second notification message may include a field such as "The current driver is not suitable for driving." The second-generation driver service control is an interactive control for interaction with the driver.

[0119] In this embodiment, when the detection device obtains a second intoxication test result based on the aforementioned steps, and this second intoxication test result indicates that the driver is intoxicated, the detection device can generate a second indication message containing information such as "unsuitable for driving," and display this second indication message on the current display screen to remind the driver to avoid the risk of intoxicated driving. Correspondingly, a second designated driver service control can also be displayed on the display screen, facilitating the driver to connect with a third-party designated driver service platform based on this control to seek designated driver services.

[0120] S802, in response to the driver's triggering operation on the second-generation driver service control, communicates with the third-party driver service platform and then sends a second-generation driver service request to the third-party driver service platform.

[0121] The second-generation driver service request is used to instruct the third-party driver service platform to provide driver services to the primary driver. The second-generation driver service request includes the vehicle's parking location, license plate number, vehicle model, and vehicle color.

[0122] In this embodiment, when the user triggers the second-generation driver service control on the central control display screen, the central control terminal sends a request signal to the detection device. Upon receiving the request signal, the detection device obtains information such as the vehicle's parking location, license plate number, and vehicle model. Based on this information, it generates a second-generation driver service request and establishes a communication connection with a third-party driver service platform via the vehicle's communication module. After establishing the connection, the second-generation driver service request is sent to the third-party driver service platform. Upon receiving the second-generation driver service request, the third-party driver service platform can instruct a driver to provide driver service to the vehicle's primary driver. Optionally, after sending the second-generation driver service request to the third-party driver service platform, the vehicle can also receive driver service information returned by the platform based on the request. This information is displayed on the vehicle's central control display screen to inform the primary driver of the available driver service. This information may include the value of the service and the driver's information (gender, age, driving experience, etc.), allowing the primary driver to understand the available driver service details. In the above scenario, the central control display screen can show a confirmation control and a denial control. When the confirmation control is triggered, it confirms that the driver actively needs a designated driver service; when the denial control is triggered, it confirms that the driver does not need a designated driver service. Subsequently, if the driver triggers the confirmation control, the system will respond by communicating with the third-party designated driver service platform to call for a designated driver service. If the driver triggers the denial control, the system will not respond by communicating with the third-party designated driver service platform. In this scenario, a corresponding drunk driving warning message or drunk driving symbol can be generated and displayed on the vehicle's light signal display screen, providing pedestrians with information that the driver may be intoxicated, helping others to avoid risks in a timely manner.

[0123] It should be noted that the parking location of the aforementioned vehicle can be automatically input by the driver when the driver triggers the second-generation driver service control. Alternatively, the parking location can be retrieved by the vehicle based on the navigation information input by the driver, automatically extracted from the navigation information when the driver triggers the second-generation driver service control. The parking location can also be automatically determined by the vehicle when the driver stops driving, and this location will be used as the vehicle's stopping position. Furthermore, the aforementioned second-generation driver service request can also include the vehicle's destination address. This destination address can be automatically input by the driver when the driver triggers the second-generation driver service control; alternatively, it can be retrieved by the vehicle based on the navigation information input by the driver, automatically extracted from the navigation information when the driver triggers the second-generation driver service control. Including the vehicle's destination address in the aforementioned second-generation driver service request facilitates the third-party driver service platform in matching suitable drivers to provide the vehicle with the driver's service. Furthermore, when the driver triggers the confirmation button, the third-party chauffeur service platform can send payment information to the vehicle. The central control display shows a payment interface containing this information, which may include a payment QR code. The vehicle can then automatically pay based on the QR code; alternatively, the driver can manually scan the code to pay. After payment, the third-party chauffeur service platform can assign a driver to provide chauffeur services to the vehicle.

[0124] Optionally, before communicating with a third-party chauffeur service platform, Figure 7 The method described in the embodiments further includes: controlling the vehicle to drive to the target location after activating the autonomous driving function; or, displaying address information on the central control display screen; the address information is used to prompt the driver to the target location of the vehicle.

[0125] The address information is used to indicate the target location of the vehicle to the driver. The target location can be the parking location of the vehicle as described in the above embodiment.

[0126] In this embodiment, when the second intoxication test result indicates that the driver is intoxicated, and the driver triggers the second designated driver service control on the central control display screen, it means that the vehicle is not suitable for driving. Since the vehicle is already in motion, when a designated driver service needs to be called, the autonomous driving function can be activated to control the vehicle to the target location. This target location is then sent to a third-party designated driver service platform so that the designated driver can accurately locate the vehicle. Alternatively, when a designated driver service needs to be called, address information can be displayed on the central control display screen, allowing the driver to view the address and drive the vehicle to the target location indicated by the address. This target location is then sent to a third-party designated driver service platform so that the designated driver can accurately locate the vehicle.

[0127] The method described in the above embodiments can automatically connect to a third-party designated driver service platform to obtain third-party designated driver services when the driver is detected to be intoxicated during the vehicle's operation. This provides convenient conditions for handling the vehicle while the driver is intoxicated, improves the vehicle's intelligence, and reduces the risk of accidents caused by intoxicated driving.

[0128] In addition to the methods described in all the above embodiments, a method for detecting alcohol intoxication is also provided, such as... Figure 9 As shown, the method includes:

[0129] S901, when the vehicle is started, a drunk driving test is performed according to the first drunk driving test strategy, which includes S902-S910; during the vehicle's operation, a drunk driving test is performed according to the second drunk driving test strategy, which includes S911-S916.

[0130] S902, acquire the head image of the driver in the vehicle captured by the image acquisition device on the vehicle, and the first gas sensing data output by the alcohol sensor on the vehicle.

[0131] S903 identifies the head image to obtain the driver's facial information and physiological parameters, and analyzes the first gas sensor data to obtain the current alcohol content in the vehicle's air.

[0132] S904, determine the type of alcohol sensor. If the alcohol sensor is a semiconductor sensor or an infrared sensor, proceed to steps S905-S907; if the gas sensor is an electrochemical sensor, proceed to step S908.

[0133] S905: The system detects whether the driver is intoxicated based on the first alcohol content test, obtaining the first test result; it detects whether the driver is intoxicated based on physiological parameters, obtaining the second test result; and it detects whether the driver is intoxicated based on facial information, obtaining the third test result.

[0134] S906, if the first test result indicates that the driver is intoxicated, and at least one of the second and third test results indicates that the driver is intoxicated, then the first intoxication test result indicates that the driver is intoxicated.

[0135] S907 If the first test result indicates that the driver is not intoxicated, and the second and third test results both indicate that the driver is not intoxicated, then the first intoxication test result indicates that the driver is not intoxicated.

[0136] S908 inputs facial information, physiological parameters, and initial blood alcohol content as the analysis objects into a trained intoxication detection model to perform intoxication detection and obtain the initial intoxication detection result.

[0137] S909, when the first alcohol test result indicates that the driver is intoxicated, displays the first prompt message and the first chauffeur service control on the vehicle's central control display screen.

[0138] The first notification message is used to inform the driver that the vehicle is currently not suitable for driving.

[0139] S910, in response to the driver's triggering operation on the first-generation driver service control, restricts the gear position on the vehicle to keep it in the parking position, and after communicating with the third-party driver service platform, sends a first-generation driver service request to the third-party driver service platform.

[0140] The first designated driver service request is used to instruct a third-party designated driver service platform to provide designated driver services to the main driver.

[0141] S911 acquires the second gas sensing data output by the alcohol sensor on the vehicle, as well as the vehicle's driving trajectory within a preset time period.

[0142] S912 analyzes the second gas sensor data to obtain the second alcohol content in the current air in the vehicle.

[0143] S913, based on the driving trajectory and the second alcohol content, conducts a drunk driving test to obtain the second drunk driving test result.

[0144] S914, when the second intoxication test result indicates that the driver is intoxicated, a second prompt message and a second chauffeur service control are displayed on the vehicle's central control screen.

[0145] S915, in response to the driver's triggering of the second-generation driver service control, activates the autonomous driving function and controls the vehicle to drive to the target location; or, displays address information on the central control display screen.

[0146] The address information is used to indicate the target location of the vehicle to the driver.

[0147] After communicating with a third-party chauffeur service platform, S916 sends a second chauffeur service request to the third-party chauffeur service platform.

[0148] The second chauffeur service request is used to instruct a third-party chauffeur service platform to provide chauffeur services to the main driver.

[0149] Each of the above steps has been described in the foregoing embodiments. For detailed explanations, please refer to the foregoing content. They will not be repeated here.

[0150] It should be understood that although the steps in the flowcharts of the embodiments described above are shown sequentially according to the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless explicitly stated herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least some steps in the flowcharts of the embodiments described above may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be performed alternately or in turn with other steps or at least some of the steps or stages of other steps.

[0151] Based on the same inventive concept, this application also provides an alcohol detection device for implementing the alcohol detection method described above. The solution provided by this device is similar to the solution described in the above method; therefore, the specific limitations of one or more embodiments of the alcohol detection device provided below can be found in the limitations of the alcohol detection method described above, and will not be repeated here.

[0152] In one exemplary embodiment, such as Figure 10 As shown, a drunkenness detection device is provided, comprising:

[0153] The first acquisition module 11 is used to acquire, when the vehicle is started, the head image of the driver in the vehicle captured by the image acquisition device in the vehicle, and the first gas sensing data output by the alcohol sensor in the vehicle.

[0154] The first analysis module 12 is used to identify the head image to obtain the facial information and physiological parameters of the driver, and to analyze the first gas sensor data to obtain the first alcohol content in the current air of the vehicle.

[0155] The first detection module 13 is used to perform intoxication detection based on the facial information, the physiological parameters and the first alcohol content, and obtain a first intoxication detection result.

[0156] In an exemplary embodiment, the first detection module 13, when the alcohol sensor is a semiconductor sensor or an infrared sensor, includes:

[0157] The first detection unit is used to detect whether the driver is intoxicated based on the first alcohol content to obtain a first detection result, and to detect whether the driver is intoxicated based on the physiological parameters to obtain a second detection result, and to detect whether the driver is intoxicated based on the facial information to obtain a third detection result.

[0158] The second detection unit is configured to determine that the first intoxication detection result indicates that the driver is intoxicated when the first detection result indicates that the driver is intoxicated, and at least one of the second and third detection results indicates that the driver is intoxicated; and to determine that the first intoxication detection result indicates that the driver is not intoxicated when the first detection result indicates that the driver is not intoxicated, and both the second and third detection results indicate that the driver is not intoxicated.

[0159] In an exemplary embodiment, the first detection module 13 is specifically used to input the facial information, the physiological parameters, and the first alcohol content as analysis objects into a trained drunkenness detection model when the alcohol sensor is an electrochemical type sensor, to perform drunkenness detection and obtain the first drunkenness detection result.

[0160] In one exemplary embodiment, the above-mentioned alcohol detection device further includes:

[0161] The first display module is used to display a first prompt message and a first valet service control on the central control display screen of the vehicle when the first intoxication test result indicates that the driver is intoxicated, and to restrict the gear position on the vehicle so that the gear position remains in the parking gear; the first prompt message is used to remind the driver that the vehicle is currently in a poor pre-driving state.

[0162] The first response module is used to respond to the driver's trigger operation on the first designated driver service control, communicate with the third-party designated driver service platform, and then send a first designated driver service request to the third-party designated driver service platform; the first designated driver service request is used to instruct the third-party designated driver service platform to provide designated driver service to the driver.

[0163] In one exemplary embodiment, the above-mentioned alcohol detection device further includes:

[0164] The second acquisition module is used to acquire, during the driving of the vehicle, the second gas sensing data output by the alcohol sensor on the vehicle, and the driving trajectory of the vehicle within a preset time period.

[0165] The second analysis module is used to analyze the second gas sensing data to obtain the second alcohol content in the current air of the vehicle;

[0166] The second detection module is used to perform a drunk driving test based on the driving trajectory and the second alcohol content, and obtain a second drunk driving test result.

[0167] In one exemplary embodiment, the above-mentioned alcohol detection device further includes:

[0168] The second display module is used to display a second prompt message and a second valet driving service control on the central control display screen of the vehicle when the second intoxication test result indicates that the driver is intoxicated, and to activate the autonomous driving function to control the vehicle to drive to the target location; the second prompt message is used to inform the driver that the vehicle is currently in a suboptimal driving condition;

[0169] The second response module is used to respond to the driver's triggering operation on the second chauffeur service control, communicate with the third-party chauffeur service platform, and then send a second chauffeur service request to the third-party chauffeur service platform; the second chauffeur service request is used to instruct the third-party chauffeur service platform to provide chauffeur service to the driver.

[0170] In one exemplary embodiment, an in-vehicle device is provided, which may be a server, and its internal structure diagram may be as follows: Figure 11As shown, the vehicle-mounted device includes a processor, memory, input / output interface, communication interface, display unit, and input device. The processor, memory, and input / output interface are connected via a system bus, and the communication interface, display unit, and input device are also connected to the system bus via the input / output interface. The processor provides computing and control capabilities. The memory includes non-volatile storage media and internal memory. The non-volatile storage media stores the operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The input / output interface is used for exchanging information between the processor and external devices. The communication interface is used for wired or wireless communication with external terminals; wireless communication can be achieved through Wi-Fi, mobile cellular networks, Near Field Communication (NFC), or other technologies. When the computer program is executed by the processor, it implements a method for detecting intoxication. The display unit is used to form a visually visible image and can be a display screen, projection device, or virtual reality imaging device. The display screen can be an LCD screen or an e-ink screen. The input device of the computer device can be a touch layer covering the display screen, or buttons, trackballs, or touchpads set on the casing of the computer device, or external keyboards, touchpads, or mice, etc.

[0171] Those skilled in the art will understand that Figure 11 The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0172] In one exemplary embodiment, an in-vehicle device is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor executes the computer program to perform the following steps:

[0173] When the vehicle is started, the head image of the driver in the vehicle is acquired by the image acquisition device on the vehicle, and the first gas sensing data output by the alcohol sensor on the vehicle is acquired.

[0174] The head image is identified to obtain the driver's facial information and physiological parameters, and the first gas sensor data is analyzed to obtain the first alcohol content in the current air in the vehicle.

[0175] Based on the facial information, the physiological parameters, and the first alcohol content, an intoxication test is performed to obtain a first intoxication test result.

[0176] In one embodiment, the processor, when executing a computer program, also performs the following steps:

[0177] The driver is intoxicated based on the first alcohol content to obtain a first detection result, the driver is intoxicated based on the physiological parameters to obtain a second detection result, and the driver is intoxicated based on the facial information to obtain a third detection result.

[0178] If the first detection result indicates that the driver is intoxicated, and at least one of the second and third detection results indicates that the driver is intoxicated, then it is determined that the first intoxication detection result indicates that the driver is intoxicated.

[0179] If the first test result indicates that the driver is not intoxicated, and both the second and third test results indicate that the driver is not intoxicated, then the first intoxication test result indicates that the driver is not intoxicated.

[0180] In one embodiment, the processor, when executing a computer program, also performs the following steps:

[0181] The facial information, physiological parameters, and the first alcohol content are input into a trained intoxication detection model to perform intoxication detection, and the first intoxication detection result is obtained.

[0182] In one embodiment, the processor, when executing a computer program, also performs the following steps:

[0183] When the first alcohol test result indicates that the driver is intoxicated, a first prompt message and a first valet service control are displayed on the vehicle's central control screen, and the gear position on the vehicle is restricted to keep it in the parking position; the first prompt message is used to inform the driver that the vehicle is currently in a suboptimal pre-driving condition.

[0184] In response to the driver's triggering operation on the first designated driver service control, after communicating with the third-party designated driver service platform, a first designated driver service request is sent to the third-party designated driver service platform; the first designated driver service request is used to instruct the third-party designated driver service platform to provide designated driver service for the driver.

[0185] In one embodiment, the processor, when executing a computer program, also performs the following steps:

[0186] During the vehicle's operation, the second gas sensing data output by the alcohol sensor on the vehicle, as well as the vehicle's driving trajectory within a preset time period, are acquired.

[0187] The second gas sensor data is analyzed to obtain the second alcohol content in the current air of the vehicle;

[0188] Based on the driving trajectory and the second alcohol content, a drunk driving test is performed to obtain a second drunk driving test result.

[0189] In one embodiment, the processor, when executing a computer program, also performs the following steps:

[0190] When the second intoxication test result indicates that the driver is intoxicated, a second prompt message and a second valet driving service control are displayed on the vehicle's central control screen, and the autonomous driving function is activated to control the vehicle to drive to the target location; the second prompt message is used to inform the driver that the vehicle is currently in a suboptimal driving condition;

[0191] In response to the driver's triggering operation on the second chauffeur service control, after communicating with the third-party chauffeur service platform, a second chauffeur service request is sent to the third-party chauffeur service platform; the second chauffeur service request is used to instruct the third-party chauffeur service platform to provide chauffeur service to the driver.

[0192] In one embodiment, a computer-readable storage medium is provided having a computer program stored thereon, the computer program performing the following steps when executed by a processor:

[0193] When the vehicle is started, the head image of the driver in the vehicle is acquired by the image acquisition device on the vehicle, and the first gas sensing data output by the alcohol sensor on the vehicle is acquired.

[0194] The head image is identified to obtain the driver's facial information and physiological parameters, and the first gas sensor data is analyzed to obtain the first alcohol content in the current air in the vehicle.

[0195] Based on the facial information, the physiological parameters, and the first alcohol content, an intoxication test is performed to obtain a first intoxication test result.

[0196] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0197] The driver is intoxicated based on the first alcohol content to obtain a first detection result, the driver is intoxicated based on the physiological parameters to obtain a second detection result, and the driver is intoxicated based on the facial information to obtain a third detection result.

[0198] If the first detection result indicates that the driver is intoxicated, and at least one of the second and third detection results indicates that the driver is intoxicated, then it is determined that the first intoxication detection result indicates that the driver is intoxicated.

[0199] If the first test result indicates that the driver is not intoxicated, and both the second and third test results indicate that the driver is not intoxicated, then the first intoxication test result indicates that the driver is not intoxicated.

[0200] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0201] The facial information, physiological parameters, and the first alcohol content are input into a trained intoxication detection model to perform intoxication detection, and the first intoxication detection result is obtained.

[0202] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0203] When the first alcohol test result indicates that the driver is intoxicated, a first prompt message and a first valet service control are displayed on the vehicle's central control screen, and the gear position on the vehicle is restricted to keep it in the parking position; the first prompt message is used to inform the driver that the vehicle is in a suboptimal pre-driving condition.

[0204] In response to the driver's triggering operation on the first designated driver service control, after communicating with the third-party designated driver service platform, a first designated driver service request is sent to the third-party designated driver service platform; the first designated driver service request is used to instruct the third-party designated driver service platform to provide designated driver service for the driver.

[0205] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0206] During the vehicle's operation, the second gas sensing data output by the alcohol sensor on the vehicle, as well as the vehicle's driving trajectory within a preset time period, are acquired.

[0207] The second gas sensor data is analyzed to obtain the second alcohol content in the current air of the vehicle;

[0208] Based on the driving trajectory and the second alcohol content, a drunk driving test is performed to obtain a second drunk driving test result.

[0209] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0210] When the second intoxication test result indicates that the driver is intoxicated, a second prompt message and a second valet driving service control are displayed on the vehicle's central control screen, and the autonomous driving function is activated to control the vehicle to drive to the target location; the second prompt message is used to inform the driver that the vehicle is currently in a suboptimal driving condition;

[0211] In response to the driver's triggering operation on the second chauffeur service control, after communicating with the third-party chauffeur service platform, a second chauffeur service request is sent to the third-party chauffeur service platform; the second chauffeur service request is used to instruct the third-party chauffeur service platform to provide chauffeur service to the driver.

[0212] In one embodiment, a computer program product is provided, including a computer program that, when executed by a processor, performs the following steps:

[0213] When the vehicle is started, the head image of the driver in the vehicle is acquired by the image acquisition device on the vehicle, and the first gas sensing data output by the alcohol sensor on the vehicle is acquired.

[0214] The head image is identified to obtain the driver's facial information and physiological parameters, and the first gas sensor data is analyzed to obtain the first alcohol content in the current air in the vehicle.

[0215] Based on the facial information, the physiological parameters, and the first alcohol content, an intoxication test is performed to obtain a first intoxication test result.

[0216] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0217] The driver is intoxicated based on the first alcohol content to obtain a first detection result, the driver is intoxicated based on the physiological parameters to obtain a second detection result, and the driver is intoxicated based on the facial information to obtain a third detection result.

[0218] If the first detection result indicates that the driver is intoxicated, and at least one of the second and third detection results indicates that the driver is intoxicated, then it is determined that the first intoxication detection result indicates that the driver is intoxicated.

[0219] If the first test result indicates that the driver is not intoxicated, and both the second and third test results indicate that the driver is not intoxicated, then the first intoxication test result indicates that the driver is not intoxicated.

[0220] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0221] The facial information, physiological parameters, and the first alcohol content are input into a trained intoxication detection model to perform intoxication detection, and the first intoxication detection result is obtained.

[0222] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0223] When the first alcohol test result indicates that the driver is intoxicated, a first prompt message and a first valet service control are displayed on the vehicle's central control screen, and the gear position on the vehicle is restricted to keep it in the parking position; the first prompt message is used to inform the driver that the vehicle is currently in a suboptimal pre-driving condition.

[0224] In response to the driver's triggering operation on the first designated driver service control, after communicating with the third-party designated driver service platform, a first designated driver service request is sent to the third-party designated driver service platform; the first designated driver service request is used to instruct the third-party designated driver service platform to provide designated driver service for the driver.

[0225] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0226] During the vehicle's operation, the second gas sensing data output by the alcohol sensor on the vehicle, as well as the vehicle's driving trajectory within a preset time period, are acquired.

[0227] The second gas sensor data is analyzed to obtain the second alcohol content in the current air of the vehicle;

[0228] Based on the driving trajectory and the second alcohol content, a drunk driving test is performed to obtain a second drunk driving test result.

[0229] In one embodiment, when the computer program is executed by a processor, it also performs the following steps:

[0230] When the second intoxication test result indicates that the driver is intoxicated, a second prompt message and a second valet driving service control are displayed on the vehicle's central control screen, and the autonomous driving function is activated to control the vehicle to drive to the target location; the second prompt message is used to inform the driver that the vehicle is currently in a suboptimal driving condition;

[0231] In response to the driver's triggering operation on the second chauffeur service control, after communicating with the third-party chauffeur service platform, a second chauffeur service request is sent to the third-party chauffeur service platform; the second chauffeur service request is used to instruct the third-party chauffeur service platform to provide chauffeur service to the driver.

[0232] Those skilled in the art will understand that all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a non-volatile computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. Any references to memory, databases, or other media used in the embodiments provided in this application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM). The databases involved in the embodiments provided in this application may include at least one type of relational database and non-relational database. Non-relational databases may include, but are not limited to, blockchain-based distributed databases. The processors involved in the embodiments provided in this application may be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, quantum computing-based data processing logic devices, artificial intelligence (AI) processors, etc., and are not limited to these.

[0233] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0234] The embodiments described above are merely illustrative of several implementation methods of this application, and while the descriptions are specific and detailed, they should not be construed as limiting the scope of this patent application. It should be noted that those skilled in the art can make various modifications and improvements without departing from the concept of this application, and these all fall within the protection scope of this application. Therefore, the protection scope of this application should be determined by the appended claims.

Claims

1. A method for detecting intoxication, characterized in that, The method includes: When the vehicle is started, the head image of the driver in the vehicle is acquired by the image acquisition device on the vehicle, and the first gas sensing data output by the alcohol sensor on the vehicle is acquired. The head image is identified to obtain the driver's facial information and physiological parameters, and the first gas sensor data is analyzed to obtain the first alcohol content in the current air in the vehicle. Based on the facial information, the physiological parameters, and the first alcohol content, an intoxication test is performed to obtain a first intoxication test result.

2. The method according to claim 1, characterized in that, The alcohol sensor is a semiconductor sensor or an infrared sensor. The step of performing intoxication detection based on the facial information, the physiological parameters, and the first alcohol content to obtain a first intoxication detection result includes: The driver is intoxicated based on the first alcohol content to obtain a first detection result, the driver is intoxicated based on the physiological parameters to obtain a second detection result, and the driver is intoxicated based on the facial information to obtain a third detection result. If the first detection result indicates that the driver is intoxicated, and at least one of the second and third detection results indicates that the driver is intoxicated, then it is determined that the first intoxication detection result indicates that the driver is intoxicated. If the first test result indicates that the driver is not intoxicated, and both the second and third test results indicate that the driver is not intoxicated, then the first intoxication test result indicates that the driver is not intoxicated.

3. The method according to claim 1, characterized in that, The alcohol sensor is an electrochemical sensor. The process of detecting intoxication based on the facial information, physiological parameters, and the first alcohol content to obtain a first intoxication detection result includes: The facial information, physiological parameters, and the first alcohol content are input into a trained intoxication detection model to perform intoxication detection, and the first intoxication detection result is obtained.

4. The method according to any one of claims 1-3, characterized in that, The method further includes: When the first alcohol test result indicates that the driver is intoxicated, a first prompt message and a first valet service control are displayed on the vehicle's central control screen, and the gear position on the vehicle is restricted to keep it in the parking position; the first prompt message is used to inform the driver that the vehicle is currently in a suboptimal driving condition. In response to the driver's triggering operation on the first designated driver service control, after communicating with the third-party designated driver service platform, a first designated driver service request is sent to the third-party designated driver service platform; the first designated driver service request is used to instruct the third-party designated driver service platform to provide designated driver service for the driver.

5. The method according to any one of claims 1-3, characterized in that, The method further includes: During the vehicle's operation, the second gas sensing data output by the alcohol sensor on the vehicle, as well as the vehicle's driving trajectory within a preset time period, are acquired. The second gas sensor data is analyzed to obtain the second alcohol content in the current air of the vehicle; Based on the driving trajectory and the second alcohol content, a drunk driving test is performed to obtain a second drunk driving test result.

6. The method according to claim 5, characterized in that, The method further includes: When the second intoxication test result indicates that the driver is intoxicated, a second prompt message and a second valet driving service control are displayed on the vehicle's central control screen, and the autonomous driving function is activated to control the vehicle to drive to the target location; the second prompt message is used to inform the driver that the vehicle is currently in a suboptimal driving condition; In response to the driver's triggering operation on the second chauffeur service control, after communicating with the third-party chauffeur service platform, a second chauffeur service request is sent to the third-party chauffeur service platform; the second chauffeur service request is used to instruct the third-party chauffeur service platform to provide chauffeur service to the driver.

7. A device for detecting intoxication, characterized in that, The device includes: The first acquisition module is used to acquire, when the vehicle is started, the head image of the driver in the vehicle captured by the image acquisition device in the vehicle, and the first gas sensing data output by the alcohol sensor in the vehicle. The first analysis module is used to identify the head image to obtain the facial information and physiological parameters of the driver, and to analyze the first gas sensor data to obtain the first alcohol content in the current air in the vehicle. The first detection module is used to perform an intoxication detection based on the facial information, the physiological parameters, and the first alcohol content, and obtain a first intoxication detection result.

8. An in-vehicle device, comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 6.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 6.

10. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to any one of claims 1 to 6.

Images