Drinking determination device and drinking determination method

Abstract

This intoxication determination device (3) is configured so as to comprise: a video acquisition unit (11) that acquires a captured video of an occupant on board a vehicle; a beverage intake behavior determination unit (12) that determines, on the basis of the captured video acquired by the video acquisition unit (11), whether or not the occupant has performed an action of ingesting a beverage inside the vehicle; a vital information acquisition unit (13) that acquires vital information of the occupant; and an intoxication state determination unit (14) that, if it is determined by the beverage intake behavior determination unit (12) that the action of ingesting a beverage has been performed, determines whether the occupant is in a state in which the occupant has drunk alcohol on the basis of the vital information acquired by the vital information acquisition unit (13).

Description

Technical Field

[0001] The present disclosure relates to a drinking determination device and a drinking determination method.

Background Art

[0002] There is a drinking determination device that determines whether or not a passenger riding in a vehicle is in a state of having drunk alcohol (hereinafter referred to as "drinking state"). As such a drinking determination device, for example, Patent Document 1 discloses a monitoring device that acquires a captured image of a passenger from a camera that captures the passenger riding in a vehicle, and determines whether or not the passenger is in a drinking state based on the color of the passenger's face or the temperature of the passenger shown in the captured image.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The monitoring device disclosed in Patent Document 1 has a problem that it may erroneously detect the drinking state of a passenger because it detects that the passenger is in a drinking state based on the captured image of the camera. The color of the passenger's face and the temperature of the passenger vary from person to person. For this reason, even if the passenger has not drunk alcohol, the color of the passenger's face may turn red, and even if the passenger has not drunk alcohol, the temperature of the passenger may rise. In such a case, the drinking state of the passenger may be erroneously detected.

[0005] The present disclosure has been made to solve the above problems, and an object thereof is to obtain a drinking determination device that can reduce the erroneous detection of the drinking state as compared with the monitoring device disclosed in Patent Document 1.

Means for Solving the Problems

[0006] The drinking determination device according to the present disclosure includes a video acquisition unit that acquires a captured video of an occupant in a vehicle, a beverage intake action determination unit that determines whether or not the occupant has taken a beverage in the vehicle based on the captured video acquired by the video acquisition unit, a vital information acquisition unit that acquires the vital information of the occupant, and a drinking state determination unit that determines whether or not the occupant is in a state of having drunk alcohol based on the vital information acquired by the vital information acquisition unit if the beverage intake action determination unit determines that the occupant has taken a beverage. and a vehicle information acquisition unit that acquires vehicle information indicating the steering angle of the vehicle's steering wheel. The beverage intake behavior determination unit determines whether or not the occupant has taken an action of consuming a beverage inside the vehicle only when the steering angle indicated by the vehicle information acquired by the vehicle information acquisition unit is less than or equal to a threshold value. It is such a thing.

Effect of the Invention

[0007] According to the present disclosure, false detection of a drinking state can be reduced more than that of the monitoring device disclosed in Patent Document 1.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Embodiments for Carrying Out the Invention

[0009] Hereinafter, in order to explain the present disclosure in more detail, embodiments for carrying out the present disclosure will be described with reference to the accompanying drawings.

[0010] Embodiment 1. FIG. 1 is a configuration diagram showing the drinking determination device 3 according to Embodiment 1. FIG. 2 is a hardware configuration diagram showing the hardware of the drinking determination device 3 according to Embodiment 1. The drinking determination device 3 shown in FIG. 1 includes a video acquisition unit 11, a beverage intake behavior determination unit 12, a vital information acquisition unit 13, a drinking state determination unit 14, and a warning output unit 15.

[0011] The camera 1 is installed, for example, on the instrument panel, ceiling, A-pillar, or windshield of the vehicle. The camera 1 photographs the passengers in the vehicle and transmits the photographed video of the passengers to the drinking determination device 3. In the drinking determination device 3 shown in FIG. 1, it is assumed that the passenger is the driver of the vehicle. However, the passenger is not limited to the driver of the vehicle and may be a passenger other than the driver.

[0012] The vital sensor 2 is installed, for example, in the passenger compartment of the vehicle. However, this is only an example, and the vital sensor 2 may be worn on the passenger's wrist or the like. The vital sensor 2 measures the vital signs such as the heartbeat of the passenger and transmits the vital information indicating the vital signs of the passenger to the drinking determination device 3. The vital sensor 2 installed in the passenger compartment of the vehicle measures the vital signs of the passenger in a non-contact state. For example, the vital sensor 2 uses a built-in camera to photograph the passenger and measures the vital signs of the passenger based on the photographed image of the passenger. The vital sensor 2 worn on the passenger's wrist or the like directly measures the heart rate of the passenger. Therefore, the vital sensor 2 worn on the passenger's wrist or the like generally has higher measurement accuracy than the vital sensor 2 installed in the passenger compartment of the vehicle.

[0013] The video acquisition unit 11 is realized by, for example, the video acquisition circuit 21 shown in FIG. 2. The video acquisition unit 11 acquires a photographed image of the passenger boarding the vehicle from the camera 1. The video acquisition unit 11 outputs the photographed image of the passenger to each of the beverage intake action determination unit 12, the vital information acquisition unit 13, and the drinking state determination unit 14.

[0014] The beverage intake action determination unit 12 is realized by, for example, the beverage intake action determination circuit 22 shown in FIG. 2. The beverage intake action determination unit 12 acquires a photographed image of the passenger from the video acquisition unit 11. The beverage intake action determination unit 12 determines whether or not the passenger has taken a beverage in the vehicle based on the photographed image. The beverage intake action determination unit 12 outputs a determination result indicating whether or not the action of taking a beverage has been performed to the drinking state determination unit 14.

[0015] The vital information acquisition unit 13 is realized by, for example, the vital information acquisition circuit 23 shown in FIG. 2. The vital information acquisition unit 13 acquires vital information indicating the vital signs of the passenger from the vital sensor 2. The vital information acquisition unit 13 outputs the vital information to the drinking state determination unit 14. In the drinking determination device 3 shown in FIG. 1, the vital information acquisition unit 13 acquires vital information from the vital sensor 2. However, this is merely an example, and the vital information acquisition unit 13 may acquire the captured video from the video acquisition unit 11. In this case, based on the captured video, the vital information acquisition unit 13 acquires, as the vital information of the occupant, the pulse rate of the occupant or the heart rate of the occupant, etc., and outputs the vital information indicating the pulse rate of the occupant, etc. to the drinking state determination unit 14.

[0016] The drinking state determination unit 14 is realized, for example, by the drinking state determination circuit 24 shown in FIG. 2. The drinking state determination unit 14 acquires the determination result from the beverage intake action determination unit 12 and acquires the vital information from the vital information acquisition unit 13. If the drinking state determination unit 14 determines that the action of consuming a beverage has been performed by the beverage intake action determination unit 12, it determines whether the occupant is in a state of drinking alcohol (hereinafter referred to as the "drinking state") based on the vital information. The drinking state determination unit 14 outputs the determination result indicating whether the occupant is in the drinking state to the warning output unit 15. In the drinking determination device 3 shown in FIG. 1, the drinking state determination unit 14 determines whether the occupant is in the drinking state based on the vital information. However, this is merely an example, and the drinking state determination unit 14 may determine whether the occupant is in the drinking state based on the captured video acquired by the video acquisition unit 11.

[0017] The warning output unit 15 is realized, for example, by the warning output circuit 25 shown in FIG. 2. The warning output unit 15 acquires the determination result indicating whether the occupant is in the drinking state from the drinking state determination unit 14. If the drinking state determination unit 14 determines that the occupant is in the drinking state, the warning output unit 15 outputs a warning to the occupant. Specifically, the warning output unit 15 outputs warning information to the vehicle control device 4, causing the vehicle control device 4 to output a warning.

[0018] When the vehicle control device 4 acquires warning information from the warning output unit 15, for example, it causes a warning to be displayed on the instrument panel of the vehicle. Also, when the vehicle control device 4 acquires warning information from the warning output unit 15, for example, it controls the vehicle to move to the road shoulder and then stop.

[0019] In FIG. 1, it is assumed that each of the components of the drinking determination device 3, namely, the video acquisition unit 11, the beverage intake behavior determination unit 12, the vital information acquisition unit 13, the drinking state determination unit 14, and the warning output unit 15, is realized by dedicated hardware as shown in FIG. 2. That is, it is assumed that the drinking determination device 3 is realized by a video acquisition circuit 21, a beverage intake behavior determination circuit 22, a vital information acquisition circuit 23, a drinking state determination circuit 24, and a warning output circuit 25. Each of the video acquisition circuit 21, the beverage intake behavior determination circuit 22, the vital information acquisition circuit 23, the drinking state determination circuit 24, and the warning output circuit 25 corresponds to, for example, a single circuit, a composite circuit, a programmed processor, a parallel-programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a combination thereof.

[0020] The components of the drinking determination device 3 are not limited to those realized by dedicated hardware, and the drinking determination device 3 may be realized by software, firmware, or a combination of software and firmware. Software or firmware is stored in the memory of a computer as a program. A computer means the hardware that executes the program, and for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a central processing unit, a processing unit, an arithmetic unit, a microprocessor, a microcomputer, a processor, or a DSP (Digital Signal Processor) corresponds to it.

[0021] FIG. 3 is a hardware configuration diagram of a computer when the drinking determination device 3 is implemented by software, firmware, or the like. When the drinking determination device 3 is implemented by software, firmware, or the like, a program for causing a computer to execute respective processing procedures in the video acquisition unit 11, the beverage intake behavior determination unit 12, the vital information acquisition unit 13, the drinking state determination unit 14, and the warning output unit 15 is stored in the memory 31. Then, the processor 32 of the computer executes the program stored in the memory 31.

[0022] Also, FIG. 2 shows an example in which each component of the drinking determination device 3 is implemented by dedicated hardware, and FIG. 3 shows an example in which the drinking determination device 3 is implemented by software, firmware, or the like. However, this is merely an example, and some components in the drinking determination device 3 may be implemented by dedicated hardware, and the remaining components may be implemented by software, firmware, or the like.

[0023] Next, the operation of the drinking determination device 3 shown in FIG. 1 will be described. The camera 1 photographs the passengers in the vehicle and transmits the photographed video of the passengers to the drinking determination device 3. The photographed video of the passengers may be not only a moving image but also a plurality of still images arranged in time series. The vital sensor 2 measures the vital signs such as the heartbeat of the passengers and transmits the vital information indicating the vital signs of the passengers to the drinking determination device 3.

[0024] FIG. 4 is a flowchart showing a drinking determination method which is a processing procedure of the drinking determination device 3. The video acquisition unit 11 acquires the photographed video of the passengers from the camera 1 (step ST1 in FIG. 4). The video acquisition unit 11 outputs the photographed video of the passengers to the beverage intake behavior determination unit 12. When the vital information acquisition unit 13 uses the photographed video of the passengers to acquire vital information, the video acquisition unit 11 also outputs the photographed video to the vital information acquisition unit 13. When the drinking state determination unit 14 uses the captured video of the occupant to determine the drinking state, the video acquisition unit 11 also outputs the captured video to the drinking state determination unit 14.

[0025] The beverage intake behavior determination unit 12 acquires the captured video of the occupant from the video acquisition unit 11. The beverage intake behavior determination unit 12 determines whether the occupant has taken a beverage in the vehicle based on the captured video (step ST2 in FIG. 4). The beverage intake behavior determination unit 12 outputs a determination result indicating whether the occupant has taken a beverage to the drinking state determination unit 14. Hereinafter, the determination process of the behavior of taking a beverage by the beverage intake behavior determination unit 12 will be specifically described.

[0026] The beverage intake behavior determination unit 12 performs a detection process of a state in which the occupant's hand is holding a container such as a cup, glass, can, or glass bottle by analyzing the captured video of the occupant. Since the detection process of the state in which the occupant's hand is holding a container itself is a known technique, a detailed description thereof will be omitted. When the beverage intake behavior determination unit 12 detects a state in which the occupant's hand is holding a container, it detects a change in the position of the occupant's head, a change in the position of the occupant's hand, and a change in the angle of the occupant's head from the captured video of the occupant. The occupant's head here is a part above the occupant's neck and includes the entire face of the occupant.

[0027] As shown in FIG. 5, the beverage intake behavior determination unit 12 detects whether the distance between the position of the head and the position of the hand is within the set distance range SDR based on the change in the position of the head and the change in the position of the hand. In the example of FIG. 5, the beverage intake behavior determination unit 12 detects the change in the position of the mouth as the position of the head. FIG. 5A is an explanatory diagram showing a state in which the occupant applies the drinking mouth of the container to his own mouth and starts drinking. FIG. 5B is an explanatory diagram showing a state in which the occupant is drinking while applying the drinking mouth of the container to his own mouth. If the distance L between the position of the occupant's mouth and the position of the occupant's hand is outside the set distance range SDR, the possibility that the occupant is drinking alcohol is low. On the other hand, if the distance L between the position of the occupant's mouth and the position of the occupant's hand is within the set distance range SDR, the possibility that the occupant is drinking alcohol is high. The set distance range SDR is determined according to the size of the container. For example, the minimum value of the set distance range SDR is determined to be 0 [cm], and the maximum value of the set distance range SDR is determined to be a value larger than △△ [cm] than the height dimension of the container. The set distance range SDR may be stored in the internal memory of the beverage intake behavior determination unit 12, or may be provided from outside the drinking determination device 3.

[0028] In order for the occupant to drink alcohol, when the occupant places the drinking mouth of the container on his / her own mouth and the occupant is drinking alcohol, as shown in FIGS. 5A and 5B, the distance L between the position of the mouth and the position of the hand hardly changes. When the occupant actually drinks alcohol, as shown in FIG. 5B, the angle θ of the head often changes so that the face faces upward.

[0029] If the distance L between the position of the mouth and the position of the hand is within the set distance range SDR, the beverage intake behavior determination unit 12 determines that the possibility that the occupant is drinking alcohol is high. Therefore, as shown in FIGS. 5A and 5B, when the distance L between the position of the mouth and the position of the hand hardly changes, it detects whether or not the angle θ of the head changes so that the face faces upward. The determination of whether or not the distance L hardly changes is made by checking whether or not the change ΔL of the distance L continues to be in the state where it is th less than or equal to the threshold value L. The threshold value L th may be stored in the internal memory of the beverage intake behavior determination unit 12, or may be provided from outside the drinking determination device 3. As the distance L between the position of the mouth and the position of the hand, for example, the distance between the position of the lower lip of the occupant and the position of the thumb can be used. The position of the lower lip may be, for example, the position at the center of the lower lip or the position at the edge of the lower lip. The position of the thumb may be, for example, the position at the tip of the thumb, the position at the joint of the thumb, or the position at the base of the thumb.

[0030] The angle θ of the head is the angle formed by the line segment connecting the center of the neck and the center of the top of the head and the vertical direction. Since the process of calculating the angle θ of the head based on the captured image of the occupant is a known technique, a detailed description thereof is omitted. In the example of FIG. 5A, the angle θ of the head of the occupant when starting to drink is 0 degrees. In the example of FIG. 5B, in order for the occupant to drink alcohol, by tilting the head so that the face faces upward, the angle θ of the head becomes larger than 0 degrees. When the distance L between the position of the mouth and the position of the hand hardly changes, if the angle θ of the head changes so that the face faces upward, the beverage intake behavior determination unit 12 outputs a determination result indicating that the occupant has performed the behavior of drinking a beverage to the drinking state determination unit 14. If the beverage intake behavior determination unit 12 does not detect a state where the distance L between the position of the mouth and the position of the hand hardly changes, or even if it detects a state where the distance L hardly changes, if the angle θ of the head does not change so that the face faces upward in that state, the beverage intake behavior determination unit 12 outputs a determination result indicating that the occupant has not performed the behavior of drinking a beverage to the drinking state determination unit 14.

[0031] In the drinking determination device 3 shown in FIG. 1, when the beverage intake behavior determination unit 12 detects that the hand of the occupant is holding a container, from the captured image of the occupant, the position change of the occupant's head, the position change of the occupant's hand, and the angular change of the occupant's head are detected, and based on the position change of the head, the position change of the hand, and the angular change of the head, it is determined whether the occupant has performed the behavior of drinking a beverage. However, since the container is small, when the hand of the occupant is holding the container, the container may be hidden by the hand. In such a case, since there is a possibility that the state where the hand of the occupant is holding the container cannot be detected, the beverage intake behavior determination unit 12 may also determine whether the occupant has performed the behavior of drinking a beverage based on the position change of the head, the position change of the hand, and the angular change of the head even when the state where the hand of the occupant is holding the container cannot be detected.

[0032] In the drinking determination device 3 shown in FIG. 1, the beverage intake behavior determination unit 12 determines whether the occupant has performed the behavior of drinking a beverage based on the position change of the head, the position change of the hand, and the angular change of the head. However, since there is also a possibility that the occupant drinks alcohol with a straw, the beverage intake behavior determination unit 12 may also determine that the occupant has performed the behavior of drinking a beverage if it detects from the captured image of the occupant that the occupant has the straw in the mouth. In the drinking determination device 3 shown in FIG. 1, the beverage intake behavior determination unit 12 determines whether the occupant has performed the behavior of drinking a beverage based on the position change of the head, the position change of the hand, and the angular change of the head. However, this is only an example, and the beverage intake behavior determination unit 12 may also determine that the occupant has performed the behavior of drinking a beverage if it detects, for example, from the captured image of the occupant that a part of the occupant's mouth is hidden by the container.

[0033] In the drinking determination device 3 shown in FIG. 1, a beverage intake behavior determination unit 12 determines whether or not a passenger has taken a beverage based on the captured image of the passenger. When a sensor signal of a sensor (not shown) that detects the smell of alcohol indicates that the smell of alcohol has been detected, the beverage intake behavior determination unit 12 may determine whether or not a passenger has taken a beverage based on the captured image of the passenger. In this way, when using the sensor signal of the sensor that detects the smell of alcohol, the determination accuracy of the beverage intake behavior determination unit 12 can be improved.

[0034] Further, the beverage intake behavior determination unit 12 may provide the captured image of the passenger to a first learning model (not shown) and acquire a determination result indicating whether or not the behavior of taking a beverage has been performed from the first learning model. The first learning model is realized by, for example, a neural network. At the time of learning, first learning data and second learning data are given to the first learning model. The first learning data includes a captured image when a passenger is performing the action of taking a beverage and teacher data indicating that the action of taking a beverage is being performed. The second learning data includes a captured image when a passenger is not performing the action of taking a beverage and teacher data indicating that the action of taking a beverage is not being performed. When the first learning data is given, the first learning model learns the captured image when a passenger is performing the action of taking a beverage, and when the second learning data is given, the first learning model learns the captured image when a passenger is not performing the action of taking a beverage. At the time of inference, when the captured image acquired by the image acquisition unit 11 is given, the first learning model outputs a determination result indicating whether or not the action of taking a beverage has been performed.

[0035] The vital information acquisition unit 13 acquires vital information indicating the vital signs of the passenger from the vital sensor 2 (step ST3 in FIG. 4). The vital information acquisition unit 13 outputs the vital information to the drinking state determination unit 14. In the drinking determination device 3 shown in FIG. 1, the vital information acquisition unit 13 acquires vital information from the vital sensor 2. However, this is merely an example, and the vital information acquisition unit 13 may acquire the captured video from the video acquisition unit 11. In this case, the vital information acquisition unit 13 acquires, as the vital information of the occupant, the pulse rate or the heart rate of the occupant, etc. based on the captured video, and outputs the vital information indicating the pulse rate etc. of the occupant to the drinking state determination unit 14. Since the process of measuring vital signs such as the pulse rate based on the captured video is a known technique, a detailed description thereof will be omitted.

[0036] The drinking state determination unit 14 acquires the determination result from the beverage intake behavior determination unit 12 and acquires the vital information from the vital information acquisition unit 13. If the drinking state determination unit 14 determines that the occupant has taken a beverage (in the case of YES in step ST4 of FIG. 4), the drinking state determination unit 14 determines whether the occupant is in a drinking state based on the vital information (step ST5 of FIG. 4). Hereinafter, the determination process of the drinking state by the drinking state determination unit 14 will be specifically described.

[0037] In the memory of the drinking state determination unit 14, the heart rate or the pulse rate when the occupant is not in a drinking state is recorded. As the heart rate etc. when the occupant is not in a drinking state, for example, the heart rate indicated by the vital information output from the vital information acquisition unit 13 when an occupant who is not in a drinking state boards the vehicle can be used. When the drinking state determination unit 14 determines that the occupant has taken a beverage by the beverage intake behavior determination unit 12, the drinking state determination unit 14 acquires the vital information from the vital information acquisition unit 13. Then, the drinking state determination unit 14 compares the heart rate etc. indicated by the vital information with the heart rate etc. recorded in the memory. The drinking state determination unit 14 determines whether the occupant is in a drinking state based on the comparison result of the heart rate etc. Since the determination process of the drinking state based on the comparison result of the heart rate etc. is a known technique, a detailed description thereof will be omitted. Generally, it is known that the heart rate etc. increase as the intoxication progresses with drinking.

[0038] In the drinking determination device 3 shown in FIG. 1, the drinking state determination unit 14 determines whether or not the occupant is in a drinking state based on the comparison results such as the heart rate. However, this is only an example, and the drinking state determination unit 14 may give the vital information of the occupant to a second learning model (not shown) and obtain the determination result of the drinking state from the second learning model. The second learning model is realized by, for example, a neural network. The second learning model is given the third learning data and the fourth learning data during learning. The third learning data includes the vital information when the occupant is drinking and the teacher data indicating that the occupant is drinking. The fourth learning data includes the vital information when the occupant is not drinking and the teacher data indicating that the occupant is not drinking. When the third learning data is given, the second learning model learns the vital information when the occupant is drinking, and when the fourth learning data is given, the second learning model learns the vital information when the occupant is not drinking. When the vital information is given during inference, the second learning model outputs the determination result of the drinking state.

[0039] In the drinking determination device 3 shown in FIG. 1, the drinking state determination unit 14 determines whether or not it is in a drinking state based on the vital information output from the vital information acquisition unit 13. However, this is only an example, and the drinking state determination unit 14 may determine whether or not the occupant is in a drinking state based on the captured image acquired by the image acquisition unit 11. In this case, the drinking state determination unit 14 detects the number of times the occupant bends down within a certain period by detecting the change in the position of the occupant's head based on the captured image of the occupant. Further, the drinking state determination unit 14 detects the number of times the occupant yawns within a certain period based on the captured image of the occupant. Then, if either one or more of the number of times the occupant bends down and the number of times the occupant yawns exceeds the reference number, the drinking state determination unit 14 may determine that the occupant is in a drinking state.

[0040] Here, the drinking state determination unit 14 determines whether the occupant is in a drinking state based on the captured video acquired by the video acquisition unit 11. However, this is only an example, and the drinking state determination unit 14 may provide the captured video of the occupant to a third learning model (not shown) and obtain the determination result of the drinking state from the third learning model. The third learning model is realized by, for example, a neural network. The third learning model is provided with the fifth learning data and the sixth learning data during learning. The fifth learning data includes the captured video when the occupant is drinking and the teacher data indicating that the occupant is drinking. The sixth learning data includes the captured video when the occupant is not drinking and the teacher data indicating that the occupant is not drinking. When the fifth learning data is provided, the third learning model learns the captured video when the occupant is drinking, and when the sixth learning data is provided, the third learning model learns the captured video when the occupant is not drinking. During inference, when the captured video acquired by the video acquisition unit 11 is provided, the third learning model outputs the determination result of the drinking state.

[0041] The drinking state determination unit 14 outputs the determination result indicating whether it is a drinking state to the warning output unit 15. In the drinking determination device 3 shown in FIG. 1, if the beverage intake behavior determination unit 12 determines that the behavior of taking a beverage is not performed (in the case of NO in step ST4 of FIG. 4), the drinking state determination unit 14 does not perform the process of determining whether the occupant is in a drinking state. The beverage intake behavior determination unit 12 can prevent the occurrence of an incorrect determination in which it is determined that the occupant is in a drinking state when the behavior of taking a beverage is not performed by determining whether the occupant is in a drinking state only when the behavior of taking a beverage is performed. If the beverage intake behavior determination unit 12 does not determine that the behavior of taking a beverage is performed, the drinking state determination unit 14 does not perform the process of determining whether the occupant is in a state of drinking alcohol, so that the processing load of the drinking determination device 3 can be reduced.

[0042] The warning output unit 15 acquires a determination result indicating whether or not the occupant is in a drinking state from the drinking state determination unit 14. If the drinking state determination unit 14 determines that the occupant is in a drinking state (in the case of YES in step ST6 of FIG. 4), the warning output unit 15 outputs warning information to the vehicle control device 4, thereby causing the vehicle control device 4 to output a warning. If the drinking state determination unit 14 determines that the occupant is not in a drinking state (in the case of NO in step ST6 of FIG. 4), the warning output unit 15 does not output warning information to the vehicle control device 4.

[0043] If warning information is output from the warning output unit 15, the vehicle control device 4 causes a warning to be displayed on, for example, the instrument panel of the vehicle. Also, when the vehicle control device 4 acquires warning information from the warning output unit 15, the vehicle control device 4 controls the vehicle to, for example, move the vehicle to the road shoulder and then stop it.

[0044] In the above-described first embodiment, the drinking determination device 3 is configured to include a video acquisition unit 11 that acquires a captured video of the occupant in the vehicle, a beverage intake action determination unit 12 that determines whether or not the occupant has taken a beverage in the vehicle based on the captured video acquired by the video acquisition unit 11, a vital information acquisition unit 13 that acquires the vital information of the occupant, and a drinking state determination unit 14 that determines whether or not the occupant is in a state of having drunk alcohol based on the vital information acquired by the vital information acquisition unit 13 if the beverage intake action determination unit 12 determines that the action of taking a beverage has been performed. Therefore, the drinking determination device 3 can reduce the false detection of the drinking state as compared with the monitoring device disclosed in Patent Document 1.

[0045] Second Embodiment. In the second embodiment, a drinking determination device 3 including a vehicle information acquisition unit 16 that acquires vehicle information indicating the steering angle of the vehicle steering wheel will be described.

[0046] FIG. 6 is a configuration diagram showing a drinking determination device 3 according to Embodiment 2. In FIG. 6, the same reference numerals as those in FIG. 1 denote the same or corresponding parts, and thus detailed description thereof is omitted. FIG. 7 is a hardware configuration diagram showing the hardware of the drinking determination device 3 according to Embodiment 2. In FIG. 7, the same reference numerals as those in FIG. 2 denote the same or corresponding parts, and thus detailed description thereof is omitted. The drinking determination device 3 shown in FIG. 6 includes a video acquisition unit 11, a vehicle information acquisition unit 16, a beverage intake behavior determination unit 17, a vital information acquisition unit 13, a drinking state determination unit 14, and a warning output unit 15. The steering angle sensor 5 measures the steering angle of the vehicle's steering wheel and outputs vehicle information indicating the steering angle of the steering wheel to the drinking determination device 3.

[0047] The vehicle information acquisition unit 16 is realized, for example, by a vehicle information acquisition circuit 26 shown in FIG. 7. The vehicle information acquisition unit 16 acquires vehicle information indicating the steering angle of the vehicle's steering wheel from the steering angle sensor 5. However, the acquisition source of the vehicle information is not limited to the steering angle sensor 5, and may be, for example, the vehicle control device 4. The vehicle information acquisition unit 16 outputs the vehicle information to the beverage intake behavior determination unit 17.

[0048] The beverage intake behavior determination unit 17 is realized, for example, by a beverage intake behavior determination circuit 27 shown in FIG. 7. The beverage intake behavior determination unit 17 acquires the captured video of the occupant from the video acquisition unit 11 and acquires the vehicle information from the vehicle information acquisition unit 16. The beverage intake behavior determination unit 17 determines whether or not the occupant has taken a beverage in the vehicle based on the captured video only when the steering angle indicated by the vehicle information is equal to or less than a threshold value. The threshold value may be stored in the internal memory of the beverage intake behavior determination unit 17 or may be given from outside the drinking determination device 3. The beverage intake behavior determination unit 17 outputs a determination result indicating whether or not the occupant has taken a beverage to the drinking state determination unit 14.

[0049] In FIG. 6, it is assumed that each of the components of the drinking determination device 3, namely, the video acquisition unit 11, the vehicle information acquisition unit 16, the beverage intake behavior determination unit 17, the vital information acquisition unit 13, the drinking state determination unit 14, and the warning output unit 15, is realized by dedicated hardware as shown in FIG. 7. That is, it is assumed that the drinking determination device 3 is realized by a video acquisition circuit 21, a vehicle information acquisition circuit 26, a beverage intake behavior determination circuit 27, a vital information acquisition circuit 23, a drinking state determination circuit 24, and a warning output circuit 25. Each of the video acquisition circuit 21, the vehicle information acquisition circuit 26, the beverage intake behavior determination circuit 27, the vital information acquisition circuit 23, the drinking state determination circuit 24, and the warning output circuit 25 corresponds to, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or a combination thereof.

[0050] The components of the drinking determination device 3 are not limited to those realized by dedicated hardware, and the drinking determination device 3 may be realized by software, firmware, or a combination of software and firmware. When the drinking determination device 3 is realized by software or firmware or the like, a program for causing a computer to execute each processing procedure in the video acquisition unit 11, the vehicle information acquisition unit 16, the beverage intake behavior determination unit 17, the vital information acquisition unit 13, the drinking state determination unit 14, and the warning output unit 15 is stored in the memory 31 shown in FIG. 3. Then, the processor 32 shown in FIG. 3 executes the program stored in the memory 31.

[0051] Also, FIG. 7 shows an example in which each of the components of the drinking determination device 3 is realized by dedicated hardware, and FIG. 3 shows an example in which the drinking determination device 3 is realized by software or firmware or the like. However, this is only an example, and some of the components in the drinking determination device 3 may be realized by dedicated hardware, and the remaining components may be realized by software or firmware or the like.

[0052] Next, the operation of the drinking determination device 3 shown in FIG. 6 will be described. However, except for the vehicle information acquisition unit 16 and the beverage intake behavior determination unit 17, it is the same as the drinking determination device 3 shown in FIG. 1. Therefore, here, mainly, the operations of the vehicle information acquisition unit 16 and the beverage intake behavior determination unit 17 will be described.

[0053] The steering angle sensor 5 measures the steering angle of the vehicle's steering wheel. The steering angle sensor 5 outputs vehicle information indicating the steering angle of the steering wheel to the drinking determination device 3. The vehicle information acquisition unit 16 acquires vehicle information from the steering angle sensor 5. The vehicle information acquisition unit 16 outputs the vehicle information to the beverage intake behavior determination unit 17.

[0054] The beverage intake behavior determination unit 17 acquires the captured image of the occupant from the image acquisition unit 11 and acquires vehicle information from the vehicle information acquisition unit 16. When the steering angle of the steering wheel is large, the traveling direction of the vehicle changes greatly. On the other hand, when the steering angle of the steering wheel is small, especially when the steering angle of the steering wheel is 0 degrees, the traveling direction of the vehicle does not change. Therefore, when the steering angle of the steering wheel is large, the occupant needs to concentrate more on the driving operation of the vehicle than when the steering angle of the steering wheel is small. For this reason, in a state where the steering angle of the steering wheel is large, the possibility that the occupant is drinking alcohol is small. The beverage intake behavior determination unit 17 determines whether or not the occupant has taken a beverage in the vehicle based on the captured image only when the steering angle indicated by the vehicle information is equal to or less than the threshold value. That is, only when the necessity for the occupant to concentrate on the driving operation of the vehicle is low, the beverage intake behavior determination unit 17 determines whether or not the occupant has taken a beverage in the vehicle based on the captured image. The beverage intake behavior determination unit 17 outputs a determination result indicating whether or not the occupant has taken a beverage to the drinking state determination unit 14.

[0055] In the above-described Embodiment 2, the drinking determination device 3 shown in FIG. 6 is configured such that the vehicle information acquisition unit 16 that acquires vehicle information indicating the steering angle of the vehicle's steering wheel is provided, and the beverage intake behavior determination unit 17 determines whether or not the occupant has taken a beverage in the vehicle only when the steering angle indicated by the vehicle information acquired by the vehicle information acquisition unit 16 is equal to or less than a threshold value. Therefore, similar to the drinking determination device 3 shown in FIG. 1, the drinking determination device 3 shown in FIG. 6 can reduce the false detection of the drinking state more than the monitoring device disclosed in Patent Document 1, and can also reduce the processing load of the determination process of the behavior of taking a beverage more than the drinking determination device 3 shown in FIG. 1.

[0056] Embodiment 3. In Embodiment 3, the drinking state determination unit 18 determines whether or not the occupant is in a drinking state when the beverage intake behavior determination unit 12 has not determined that the behavior of taking a beverage has been performed. If it is determined that the occupant is in a drinking state, the drinking determination device 3 that determines that an abnormality has occurred in the occupant will be described.

[0057] FIG. 8 is a configuration diagram showing the drinking determination device 3 according to Embodiment 3. In FIG. 8, the same reference numerals as those in FIGS. 1 and 6 denote the same or corresponding parts, and thus detailed description thereof is omitted. FIG. 9 is a hardware configuration diagram showing the hardware of the drinking determination device 3 according to Embodiment 3. In FIG. 9, the same reference numerals as those in FIGS. 2 and 7 denote the same or corresponding parts, and thus detailed description thereof is omitted. The drinking determination device 3 shown in FIG. 8 includes a video acquisition unit 11, a beverage intake behavior determination unit 12, a vital information acquisition unit 13, a drinking state determination unit 18, and a warning output unit 15.

[0058] The drinking state determination unit 18 is realized by, for example, the drinking state determination circuit 28 shown in FIG. 9. The drinking state determination unit 18 acquires the determination result from the beverage intake behavior determination unit 12, acquires the vital information from the vital information acquisition unit 13, and acquires the captured video from the video acquisition unit 11. The drinking state determination unit 18, similar to the drinking state determination unit 14 shown in FIG. 1, determines whether the occupant is in a drinking state based on vital information or captured video if it is determined by the beverage intake behavior determination unit 12 that an action of consuming a beverage has been performed. Unlike the drinking state determination unit 14 shown in FIG. 1, the drinking state determination unit 18 determines whether the occupant is in a drinking state even when it has not been determined by the beverage intake behavior determination unit 12 that an action of consuming a beverage has been performed. And if the drinking state determination unit 18 determines that the occupant is in a drinking state, it determines that an abnormality has occurred to the occupant. The drinking state determination unit 18 outputs to the warning output unit 15 a determination result indicating whether the occupant is in a drinking state and a determination result indicating that an abnormality has occurred to the occupant.

[0059] The drinking determination device 3 shown in FIG. 8 is one in which the drinking state determination unit 18 is applied to the drinking determination device 3 shown in FIG. 1. However, this is only an example, and the drinking state determination unit 18 may be applied to the drinking determination device 3 shown in FIG. 6.

[0060] In FIG. 8, it is assumed that each of the video acquisition unit 11, beverage intake behavior determination unit 12, vital information acquisition unit 13, drinking state determination unit 18, and warning output unit 15, which are components of the drinking determination device 3, is realized by dedicated hardware as shown in FIG. 9. That is, it is assumed that the drinking determination device 3 is realized by a video acquisition circuit 21, a beverage intake behavior determination circuit 22, a vital information acquisition circuit 23, a drinking state determination circuit 28, and a warning output circuit 25. Each of the video acquisition circuit 21, beverage intake behavior determination circuit 22, vital information acquisition circuit 23, drinking state determination circuit 28, and warning output circuit 25 corresponds to, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or a combination thereof.

[0061] The components of the drinking determination device 3 are not limited to those realized by dedicated hardware, and the drinking determination device 3 may be realized by software, firmware, or a combination of software and firmware. When the drinking determination device 3 is realized by software or firmware or the like, a program for causing a computer to execute respective processing procedures in the video acquisition unit 11, the beverage intake behavior determination unit 12, the vital information acquisition unit 13, the drinking state determination unit 18, and the warning output unit 15 is stored in the memory 31 shown in FIG. 3. Then, the processor 32 shown in FIG. 3 executes the program stored in the memory 31.

[0062] Also, FIG. 9 shows an example in which each of the components of the drinking determination device 3 is realized by dedicated hardware, and FIG. 3 shows an example in which the drinking determination device 3 is realized by software or firmware or the like. However, this is merely an example, and some of the components in the drinking determination device 3 may be realized by dedicated hardware, and the remaining components may be realized by software or firmware or the like.

[0063] Next, the operation of the drinking determination device 3 shown in FIG. 8 will be described. Since parts other than the drinking state determination unit 18 are the same as those of the drinking determination device 3 shown in FIG. 1, only the operation of the drinking state determination unit 18 will be described here.

[0064] The drinking state determination unit 18 acquires a determination result from the beverage intake behavior determination unit 12. Also, the drinking state determination unit 18 acquires vital information from the vital information acquisition unit 13 and acquires a photographed video from the video acquisition unit 11. Similar to the drinking state determination unit 14 shown in FIG. 1, when the drinking state determination unit 18 determines that an action of ingesting a beverage has been performed by the beverage intake behavior determination unit 12, it determines whether the occupant is in a drinking state based on the vital information or the photographed video. The drinking state determination unit 18 outputs a determination result indicating whether the occupant is in a drinking state to the warning output unit 15.

[0065] Unlike the drinking state determination unit 14 shown in FIG. 1, the drinking state determination unit 18 determines whether or not the occupant is in a drinking state based on vital information or a captured video even when the drinking behavior determination unit 12 has not determined that the occupant has taken a beverage. When the occupant is not engaged in the act of consuming a beverage, there is no possibility that the occupant is in a drinking state. Therefore, when the occupant is not engaged in the act of consuming a beverage, the determination that the occupant is in a drinking state is likely to be a false determination due to an abnormality other than the drinking state occurring to the occupant. When the drinking state determination unit 18 determines that the occupant is in a drinking state when the determination that the occupant has taken a beverage has not been made, the drinking state determination unit 18 determines that an abnormality has occurred to the occupant. The drinking state determination unit 18 outputs a determination result indicating that an abnormality has occurred to the occupant to the warning output unit 15.

[0066] The warning output unit 15 acquires a determination result indicating whether or not the occupant is in a drinking state from the drinking state determination unit 18. If the drinking state determination unit 18 determines that the occupant is in a drinking state, the warning output unit 15 outputs warning information to the vehicle control device 4 to cause the vehicle control device 4 to output a warning. If a determination result indicating that an abnormality has occurred to the occupant is output from the drinking state determination unit 18, the warning output unit 15 outputs caution information indicating that an abnormality has occurred to the occupant to the vehicle control device 4 to cause the vehicle control device 4 to report a caution.

[0067] In the above-described Embodiment 3, the drinking state determination unit 18 determines whether or not the occupant is in a drinking state when the drinking behavior determination unit 12 has not determined that the occupant has taken a beverage. If the drinking state determination unit 18 determines that the occupant is in a drinking state, the drinking determination device 3 shown in FIG. 8 is configured to determine that an abnormality has occurred to the occupant. Therefore, similar to the drinking determination device 3 shown in FIG. 1, the drinking determination device 3 shown in FIG. 8 can reduce false detection of the drinking state more than the monitoring device disclosed in Patent Document 1, and can also alert an occupant in whom an abnormality has occurred.

[0068] Embodiment 4 In Embodiment 4, a drinking determination device 3 including an alcohol concentration determination unit 19 that determines whether the alcohol concentration contained in the breath of an occupant is equal to or higher than an allowable concentration will be described.

[0069] FIG. 10 is a configuration diagram showing the drinking determination device 3 according to Embodiment 4. In FIG. 10, the same reference numerals as those in FIGS. 1, 6, and 8 denote the same or corresponding parts, and thus detailed description thereof will be omitted. FIG. 11 is a hardware configuration diagram showing the hardware of the drinking determination device 3 according to Embodiment 4. In FIG. 11, the same reference numerals as those in FIGS. 2, 7, and 9 denote the same or corresponding parts, and thus detailed description thereof will be omitted. The drinking determination device 3 shown in FIG. 10 includes a video acquisition unit 11, a beverage intake behavior determination unit 12, a vital information acquisition unit 13, a drinking state determination unit 14, a warning output unit 15, an alcohol concentration determination unit 19, and a vehicle control unit 20. The breath sensor 6 measures the alcohol concentration contained in the breath of an occupant and outputs concentration information indicating the alcohol concentration to the drinking determination device 3.

[0070] The alcohol concentration determination unit 19 is realized by, for example, an alcohol concentration determination circuit 29 shown in FIG. 11. The alcohol concentration determination unit 19 acquires concentration information from the breath sensor 6. The alcohol concentration determination unit 19 determines whether the alcohol concentration indicated by the concentration information is equal to or higher than the allowable concentration. The allowable concentration may be stored in an internal memory of the alcohol concentration determination unit 19 or may be provided from outside the drinking determination device 3. The alcohol concentration determination unit 19 outputs a determination result indicating whether the alcohol concentration is equal to or higher than the allowable concentration to each of the video acquisition unit 11, the vital information acquisition unit 13, and the vehicle control unit 20.

[0071] The vehicle control unit 20 is realized by, for example, a vehicle control circuit 30 shown in FIG. 11. The vehicle control unit 20 acquires from the alcohol concentration determination unit 19 a determination result indicating whether or not the alcohol concentration is equal to or higher than the allowable concentration. If the alcohol concentration determination unit 19 determines that the alcohol concentration is equal to or higher than the allowable concentration, the vehicle control unit 20 outputs a control signal for interlocking the driving of the vehicle by the occupant to the vehicle control device 4.

[0072] The drinking determination device 3 shown in FIG. 10 is one to which the alcohol concentration determination unit 19 and the vehicle control unit 20 are applied to the drinking determination device 3 shown in FIG. 1. However, this is merely an example, and the alcohol concentration determination unit 19 and the vehicle control unit 20 may be applied to the drinking determination device 3 shown in FIG. 6 or the drinking determination device 3 shown in FIG. 8.

[0073] In FIG. 10, it is assumed that each of the video acquisition unit 11, the beverage intake behavior determination unit 12, the vital information acquisition unit 13, the drinking state determination unit 14, the warning output unit 15, the alcohol concentration determination unit 19, and the vehicle control unit 20, which are components of the drinking determination device 3, is realized by dedicated hardware as shown in FIG. 11. That is, it is assumed that the drinking determination device 3 is realized by a video acquisition circuit 21, a beverage intake behavior determination circuit 22, a vital information acquisition circuit 23, a drinking state determination circuit 24, a warning output circuit 25, an alcohol concentration determination circuit 29, and a vehicle control circuit 30. Each of the video acquisition circuit 21, the beverage intake behavior determination circuit 22, the vital information acquisition circuit 23, the drinking state determination circuit 24, the warning output circuit 25, the alcohol concentration determination circuit 29, and the vehicle control circuit 30 corresponds to, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or a combination thereof.

[0074] The components of the drinking determination device 3 are not limited to those realized by dedicated hardware, and the drinking determination device 3 may be realized by software, firmware, or a combination of software and firmware. When the drinking determination device 3 is realized by software, firmware, or the like, a program for causing a computer to execute respective processing procedures in the video acquisition unit 11, the beverage intake behavior determination unit 12, the vital information acquisition unit 13, the drinking state determination unit 14, the warning output unit 15, the alcohol concentration determination unit 19, and the vehicle control unit 20 is stored in the memory 31 shown in FIG. 3. Then, the processor 32 shown in FIG. 3 executes the program stored in the memory 31.

[0075] In addition, FIG. 11 shows an example in which each component of the drinking determination device 3 is realized by dedicated hardware, and FIG. 3 shows an example in which the drinking determination device 3 is realized by software, firmware, or the like. However, this is only an example, and some components of the drinking determination device 3 may be realized by dedicated hardware and the remaining components may be realized by software, firmware, or the like.

[0076] Next, the operation of the drinking determination device 3 shown in FIG. 10 will be described. Since components other than the alcohol concentration determination unit 19 and the vehicle control unit 20 are the same as those of the drinking determination device 3 shown in FIG. 1, the operations of the alcohol concentration determination unit 19 and the vehicle control unit 20 will be mainly described here.

[0077] After the occupant gets on the vehicle, the breath sensor 6 measures the alcohol concentration contained in the occupant's breath, for example, at the timing when the occupant turns on the ignition switch of the vehicle. The timing at which the breath sensor 6 measures the alcohol concentration is not limited to the timing when the occupant turns on the ignition switch, and may be, for example, the timing when the occupant gets on the vehicle. The breath sensor 6 outputs concentration information indicating the measured alcohol concentration to the drinking determination device 3.

[0078] The alcohol concentration determination unit 19 acquires the concentration information from the breath sensor 6. The alcohol concentration determination unit 19 determines whether the alcohol concentration indicated by the concentration information is equal to or higher than the allowable concentration. If the alcohol concentration is equal to or higher than the allowable concentration, since the occupant is in a drinking state, it is necessary to prevent the occupant from driving the vehicle. The alcohol concentration determination unit 19 outputs a determination result indicating whether or not the alcohol concentration is equal to or higher than the allowable concentration to each of the video acquisition unit 11, the vital information acquisition unit 13, and the vehicle control unit 20.

[0079] Each of the video acquisition unit 11 and the vital information acquisition unit 13 acquires a determination result indicating whether or not the alcohol concentration is equal to or higher than the allowable concentration from the alcohol concentration determination unit 19. If the determination result indicates that the alcohol concentration is equal to or higher than the allowable concentration, the video acquisition unit 11 performs the acquisition process of the captured video because the vehicle control device 4 prevents the occupant from driving the vehicle. If the determination result indicates that the alcohol concentration is equal to or higher than the allowable concentration, the vital information acquisition unit 13 performs the acquisition process of the vital information because the vehicle control device 4 prevents the occupant from driving the vehicle.

[0080] The vehicle control unit 20 acquires a determination result indicating whether or not the alcohol concentration is equal to or higher than the allowable concentration from the alcohol concentration determination unit 19. If the determination result indicates that the alcohol concentration is equal to or higher than the allowable concentration, the vehicle control unit 20 outputs a control signal for interlocking the driving of the vehicle by the occupant to the vehicle control device 4.

[0081] When a control signal for interlocking the driving of the vehicle is output from the vehicle control unit 20, the vehicle control device 4 does not start the engine even if the occupant performs a starting operation of the engine. Further, when a control signal for interlocking the driving of the vehicle is output from the vehicle control unit 20, the vehicle control device 4 causes, for example, a warning indicating that the vehicle cannot be driven due to the drinking state to be displayed on the instrument panel of the vehicle.

[0082] In the above-described Embodiment 4, the alcohol concentration determination unit 19 that determines whether or not the alcohol concentration contained in the breath of the occupant is equal to or higher than the allowable concentration, and if the alcohol concentration determination unit 19 determines that the alcohol concentration is equal to or higher than the allowable concentration, the vehicle control unit 20 that interlocks the driving of the vehicle by the occupant. Thus, the drinking determination device 3 shown in FIG. 10 is configured. Therefore, similar to the drinking determination device 3 shown in FIG. 1, the drinking determination device 3 shown in FIG. 10 can reduce the false detection of the drinking state more than the monitoring device disclosed in Patent Document 1, and can prevent the driving of the vehicle by the occupant in the drinking state.

[0083] Note that in the present disclosure, any combination of the embodiments, modification of any component of each embodiment, or omission of any component in each embodiment is possible.

Industrial Applicability

[0084] The present disclosure is suitable for a drinking determination device and a drinking determination method.

Explanation of Signs

[0085] 1 Camera, 2 Vital sensor, 3 Drinking determination device, 4 Vehicle control device, 5 Steering angle sensor, 6 Breath sensor, 11 Video acquisition unit, 12 Beverage intake behavior determination unit, 13 Vital information acquisition unit, 14 Drinking state determination unit, 15 Warning output unit, 16 Vehicle information acquisition unit, 17 Beverage intake behavior determination unit, 18 Drinking state determination unit, 19 Alcohol concentration determination unit, 20 Vehicle control unit, 21 Video acquisition circuit, 22 Beverage intake behavior determination circuit, 23 Vital information acquisition circuit, 24 Drinking state determination circuit, 25 Warning output circuit, 26 Vehicle information acquisition, 27 Beverage intake behavior determination circuit, 28 Drinking state determination circuit, 29 Alcohol concentration determination circuit, 30 Vehicle control circuit, 31 Memory, 32 Processor.

Claims

1. A video acquisition unit that acquires a photographed video of an occupant riding in a vehicle; A beverage intake action determination unit that determines whether or not the occupant has taken a beverage in the vehicle based on the photographed video acquired by the video acquisition unit; A vital information acquisition unit that acquires vital information of the occupant; If the beverage intake action determination unit determines that the occupant has taken a beverage, a drinking state determination unit that determines whether or not the occupant is in a state of having drunk alcohol based on the vital information acquired by the vital information acquisition unit; A vehicle information acquisition unit that acquires vehicle information indicating the steering angle of the steering wheel of the vehicle, and The beverage intake action determination unit determines whether or not the occupant has taken a beverage in the vehicle only when the steering angle indicated by the vehicle information acquired by the vehicle information acquisition unit is less than or equal to a threshold value. A drinking determination device characterized by the above.

2. A video acquisition unit that acquires a photographed video of an occupant riding in a vehicle; A beverage intake action determination unit that determines whether or not the occupant has taken a beverage in the vehicle based on the photographed video acquired by the video acquisition unit; A vital information acquisition unit that acquires vital information of the occupant; If the beverage intake action determination unit determines that the occupant has taken a beverage, a drinking state determination unit that determines whether or not the occupant is in a state of having drunk alcohol based on the vital information acquired by the vital information acquisition unit or the photographed video acquired by the video acquisition unit is provided, and The drinking state determination unit determines whether or not the occupant is in a state of having drunk alcohol when the beverage intake action determination unit has not determined that the occupant has taken a beverage. If it is determined that the occupant is in a state of having drunk alcohol, a drinking determination device characterized by determining that something abnormal has occurred to the occupant.

3. The drinking determination device according to claim 1 or claim 2, further comprising a warning output unit that outputs a warning to the occupant if the drinking state determination unit determines that the occupant is in a state of having drunk alcohol.

4. The beverage intake action determination unit From the captured video obtained by the video acquisition unit, detect the position change of the occupant's head, the position change of the occupant's hand, and the angular change of the occupant's head, and based on the position change of the head, the position change of the hand, and the angular change of the head, determine whether the occupant has performed an action of consuming a beverage inside the vehicle. The drinking determination device according to claim 1 or claim 2, characterized in that.

5. The vital information acquisition unit The drinking determination device according to claim 1 or claim 2, characterized in that it acquires the vital information of the occupant from a vital sensor that measures the vital signs of the occupant.

6. The vital information acquisition unit The drinking determination device according to claim 1 or claim 2, characterized in that it acquires the vital information of the occupant based on the captured video obtained by the video acquisition unit.

7. An alcohol concentration determination unit that determines whether the alcohol concentration contained in the breath of the occupant is equal to or higher than the allowable concentration, A vehicle control unit that interlocks the driving of the vehicle by the occupant if the alcohol concentration determination unit determines that the alcohol concentration is equal to or higher than the allowable concentration The drinking determination device according to claim 1 or claim 2, characterized in that it is provided with.

8. The video acquisition unit acquires a captured video of the occupant boarding the vehicle, The beverage intake behavior determination unit determines whether the occupant has performed an action of consuming a beverage inside the vehicle based on the captured video obtained by the video acquisition unit, The vital information acquisition unit acquires the vital information of the occupant, The drinking state determination unit determines whether the occupant is in a state of having consumed alcohol based on the vital information acquired by the vital information acquisition unit if the beverage intake behavior determination unit determines that an action of consuming a beverage has been performed, The vehicle information acquisition unit acquires vehicle information indicating the steering angle of the steering wheel of the vehicle, The beverage intake behavior determination unit The drinking determination method is characterized in that it determines whether the occupant has performed an action of consuming a beverage inside the vehicle only when the steering angle indicated by the vehicle information acquired by the vehicle information acquisition unit is equal to or less than a threshold value.

9. The video acquisition unit acquires a captured video of the occupant boarding the vehicle, The beverage intake behavior determination unit determines whether the occupant has performed an action of consuming a beverage inside the vehicle based on the captured video obtained by the video acquisition unit, The vital information acquisition unit acquires the vital information of the occupant, If the drinking state determination unit determines that the action of consuming a beverage has been performed by the beverage intake action determination unit, it determines whether the occupant is in a state of having drunk alcohol based on the vital information acquired by the vital information acquisition unit or the captured video acquired by the video acquisition unit. The drinking state determination unit, when it is not determined by the beverage intake action determination unit that the action of consuming a beverage has been performed, determines whether the occupant is in a state of having drunk alcohol, and if it determines that the occupant is in a state of having drunk alcohol, determines that an abnormality has occurred to the occupant. A drinking determination method characterized by this.

Images