Mask wearing detection device, mask wearing detection method, and mask wearing detection program

Abstract

To provide a mask wearing detection device for checking mask wearing of a driver in effective timing, a mask wearing detection method and a mask wearing detection program.SOLUTION: A mask wearing detection device 1 comprises: an imaging unit 21 for imaging a driver sitting on a driver seat of a vehicle; a speaker 22 provided in a cabinet of the vehicle; a door sensor 13 which is provided on a door adjacent to the driver seat and detects whether or not the door is brought into an open state; a mask wearing detection unit 31 by which, in a case where the door sensor 13 is brought into the open state, a face of the driver is detected from an image picked up by the imaging unit 21 and based on the face of the driver, it is detected whether or not the driver wears a mask correctly; and a warning output unit by which, in a case where the mask wearing detection unit 31 detects that the driver does not wear the mask correctly, a warning which urges the driver to wear the mask correctly is outputted from the speaker 22.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention relates to a mask wearing detection device, a mask wearing detection method, and a mask wearing detection program.

Background Art

[0002] Patent Document 1 discloses an entrance / exit management support device including control means, a touch panel display which is an information output means, a speaker, a USB3.0 interface, a USB adjustment port interface, a network port, and a 10PIN function connection port, a first camera and a second camera, and an infrared temperature measurement module.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The invention described in Patent Document 1 determines whether an entrant is wearing a mask, and if the entrant is not wearing a mask, it causes information prompting mask wearing to be displayed on the display. However, since the invention described in Patent Document 1 performs processing on those passing through the security gate, for example, it is a waste of work to detect whether the driver is constantly wearing a mask during driving, so the invention described in Patent Document 1 cannot be directly applied to a vehicle.

[0005] The present invention has been made in view of such circumstances, and an object thereof is to provide a mask wearing detection device, a mask wearing detection method, and a mask wearing detection program capable of confirming the mask wearing of a driver at an effective timing.

Means for Solving the Problems

[0006] In order to solve the above problems, the mask wearing detection device according to the present invention includes, for example, an imaging unit that images a driver sitting in the driver's seat of a vehicle, a speaker provided in the passenger compartment of the vehicle, a door sensor provided on a door adjacent to the driver's seat for detecting whether the door is in an open state, and when it is detected by the door sensor that the door is in an open state, a face of the driver is detected from an image captured by the imaging unit, and a mask wearing detection unit that detects whether the driver is correctly wearing a mask based on the face of the driver, and an alarm output unit that outputs an alarm for prompting the driver to correctly wear a mask from the speaker when it is detected by the mask wearing detection unit that the driver is not correctly wearing a mask.

[0007] The wear state detection method according to another aspect of the present invention includes, for example, when it is detected by a door sensor provided on a door adjacent to the driver's seat of a vehicle that the door is in an open state, detecting a face of the driver from an image captured by an imaging unit that images the driver sitting in the driver's seat, and detecting whether the driver is correctly wearing a mask based on the face of the driver, and when it is detected that the driver is not correctly wearing a mask, outputting an alarm for prompting the driver to correctly wear a mask from a speaker provided in the passenger compartment of the vehicle.

[0008] The wear state detection program according to another aspect of the present invention causes, for example, a computer to function as a mask wearing detection unit that detects a face of a driver from an image captured by an imaging unit that images the driver sitting in the driver's seat when it is detected by a door sensor provided on a door adjacent to the driver's seat of a vehicle that the door is in an open state, and detects whether the driver is correctly wearing a mask based on the face of the driver, and an alarm output unit that outputs an alarm for prompting the driver to correctly wear a mask from a speaker provided in the passenger compartment of the vehicle when it is detected by the mask wearing detection unit that the driver is not correctly wearing a mask. Note that the computer program can be provided by downloading via a network such as the Internet, or can be provided by recording on various computer-readable recording media such as a CD-ROM.

[0009] In any of the above aspects of the present invention, when it is detected that the door is in the open state, it is detected whether the driver is correctly wearing a mask based on the image captured by the imaging unit. When it is detected that the driver is not correctly wearing a mask, an alarm prompting the driver to correctly wear the mask is output from the speaker. Thereby, it is possible to prevent the driver from getting out of the vehicle without wearing a mask. That is, it is possible to confirm the driver's mask wearing at an effective timing.

[0010] The mask wearing detection unit may detect that the driver is not correctly wearing a mask when the mouth or nose of the driver can be detected from the image. Thereby, it is possible to prevent the driver from getting out of the vehicle in a state where the mask is not correctly worn (such as the nose sticking out).

[0011] The alarm output unit may continue to output the alarm until it is detected by the door sensor that the door is in the closed state. Thereby, it is possible to prevent the driver from getting out of the vehicle forgetting to wear a mask or wearing it incorrectly.

[0012] The alarm output unit may output a notification from the speaker to direct the face towards the imaging unit when the face cannot be recognized from the image in the mask wearing detection unit. Thereby, the probability of successful mask wearing detection can be increased.

[0013] It may include a communication unit that communicates with a server device, and the communication unit may output the detection result in the mask wearing detection unit to the server device. As a result, the administrator can confirm without burden that the driver is wearing the mask correctly while performing the work. In addition, since the report of mask wearing can be automatically made, the burden on the driver, the risk of false reporting, etc. can be reduced.

Effects of the Invention

[0014] According to the present invention, it is possible to confirm the mask wearing of the driver at an effective timing.

Brief Description of the Drawings

[0015]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Modes for Carrying Out the Invention

[0016] Hereinafter, an embodiment of a mask wearing detection device according to the present invention will be described in detail with reference to the drawings. The mask wearing detection device is a device that outputs an alarm when a driver tries to get out of the vehicle without wearing a mask.

[0017] FIG. 1 is a diagram showing an outline of a vehicle 2 in which a mask wearing detection device 1 according to the present embodiment is provided. The vehicle 2 is provided with a driver's seat 11, a driver's seat door 12, a door sensor 13, an in-vehicle device 14, and the like. Further, an imaging unit 21, a speaker 22, a display unit 23, and the like are provided in the passenger compartment 10 of the vehicle 2.

[0018] The driver's seat door 12 is a door adjacent to the driver's seat 11, and the door sensor 13 is provided on the driver's seat door 12. The imaging unit 21 images the driver sitting on the driver's seat 11. The in-vehicle device 14 is connected to the door sensor 13, the imaging unit 21, the speaker 22, etc., and performs various controls of the mask wearing detection device 1.

[0019] FIG. 2 is a block diagram schematically showing an example of the hardware configuration of the mask wearing detection device 1. The mask wearing detection device 1 includes a control device 50, a communication device 52, and a storage device 54. The control device 50 is mainly configured to include a CPU (Central Processing Unit) 56 and a memory 58.

[0020] In the control device 50, the CPU 56 executes a predetermined program stored in the storage device 54 or the memory 58 or the like, thereby functioning as various functional units.

[0021] The communication device 52 is composed of a communication interface or the like for communicating with an external device. The communication device 52 transmits and receives various information to and from, for example, a server device 3.

[0022] The storage device 54 is composed of a hard disk or the like. This storage device 54 stores various programs, various information, and information on processing results necessary for the execution of processing in the control device 50.

[0023] Note that the mask wearing detection device 1 can be realized using an information processing device such as a dedicated or general-purpose server computer. Further, the mask wearing detection device 1 may be composed of a single information processing device, or may be composed of a plurality of information processing devices distributed on a communication network. Also, FIG. 2 only shows a part of the main hardware configuration of the mask wearing detection device 1, and the mask wearing detection device 1 can be provided with other configurations generally provided in a server device.

[0024] FIG. 3 is a diagram showing an outline of the electrical functional blocks of the mask wearing detection device 1. The mask wearing detection device 1 is connected to the server device 3 by wireless or a network.

[0025] The mask wearing detection device 1 mainly includes a door sensor 13, an imaging unit 21, a speaker 22, a display unit 23, and a control unit 30.

[0026] The control unit 30 has at least a mask wearing detection unit 31, an alarm output unit 32, and a communication unit 33 as software resources, by an arithmetic device such as a CPU (Central Processing Unit) 56 (see FIG. 2) for executing information processing and a storage device 54 (see FIG. 2).

[0027] The door sensor 13 detects whether or not the driver's seat door 12 is in an open state. The detection result in the door sensor 13 is input to the mask wearing detection unit 31 and the alarm output unit 32.

[0028] The image of the driver captured by the imaging unit 21 is input to the mask wearing detection unit 31. The imaging unit 21 captures an image when an imaging instruction is output from the mask wearing detection unit 31, and outputs the captured image to the mask wearing detection unit 31.

[0029] When the mask wearing detection unit 31 detects that the driver's door 12 is in an open state by the door sensor 13, it detects the face of the driver from the image captured by the imaging unit 21, and is a functional unit that detects whether the driver is correctly wearing a mask based on the detected face of the driver.

[0030] The fact that the driver's door 12 is in an open state indicates that the driver is about to get out of the vehicle. For example, in a situation where there is a risk of infectious diseases, in transportation and handling operations, it is important to prevent getting out of the vehicle in a state where the mask is forgotten or not correctly worn (such as the nose sticking out). Therefore, when it is detected that the driver's door 12 is in an open state, the mask wearing detection unit 31 can detect whether the mask is correctly worn, and thus can confirm the driver's mask wearing at an effective timing. The function of the mask wearing detection unit 31 will be described in detail later.

[0031] The alarm output unit 32 is a functional unit that outputs an alarm from the speaker 22 or the like. When the mask wearing detection unit 31 detects that the driver is not correctly wearing a mask, the alarm output unit 32 outputs an alarm from the speaker 22 to prompt the driver to wear the mask correctly. The function of the alarm output unit 32 will be described in detail later.

[0032] The communication unit 33 is a functional unit that communicates with the server device 3 or the like. The communication unit 33 outputs the detection result in the mask wearing detection unit 31 to the server device 3.

[0033] Figures 4 to 6 are flowcharts showing the flow of processing performed by the mask wearing detection device 1. First, the mask wearing detection unit 31 determines whether it is detected that the driver's door 12 is in an open state based on the detection result of the door sensor 13 (step SP11). If the driver's door 12 is not in an open state (NO in step SP11), the process of step SP11 is repeated.

[0034] When the driver's door 12 is in the open state (YES in step SP11), the mask wearing detection unit 31 outputs an imaging instruction to the imaging unit 21 and acquires the image captured by the imaging unit 21 (step SP12). Then, the mask wearing detection unit 31 recognizes the face of the driver from the image acquired in step SP12 by image processing (step SP13). Various known methods can be used for the process of recognizing a face from an image.

[0035] The mask wearing detection unit 31 determines whether a face can be recognized from the image in step SP13 (step SP14). If a face cannot be recognized from the image (NO in step SP14), the process proceeds to process A shown in FIG. 5 (to be described in detail later).

[0036] If a face can be recognized from the image (YES in step SP14), the mask wearing detection unit 31 detects the mouth or nose from the image acquired in step SP12 (step SP15). Various known methods can be used for the process of recognizing the mouth or nose from a face image.

[0037] Then, the mask wearing detection unit 31 detects whether the driver is wearing a mask correctly based on the detection result of step SP15 (step SP16). In the present embodiment, the mask wearing detection unit 31 detects that the driver is not wearing a mask correctly when the mouth or nose of the driver can be detected from the image acquired in step SP12.

[0038] If it is detected that the driver is not wearing a mask correctly (NO in step SP16), the process proceeds to process B shown in FIG. 6 (to be described in detail later). If it is detected that the driver is wearing a mask correctly (YES in step SP16), the mask wearing detection unit 31 transmits the detection result of step SP16, that is, that the driver is wearing a mask correctly, to the server device 3 via the communication unit 33 (step SP17).

[0039] FIG. 5 is a flowchart showing the process flow of Process A. When a face cannot be recognized from the image (NO in step SP14, see FIG. 4), the alarm output unit 32 outputs a notification from the speaker 22 to direct the face toward the imaging unit 21 (step SP21). The alarm output unit 32 outputs a signal to the mask wearing detection unit 31 at the same time as it outputs the notification from the speaker 22.

[0040] Next, the mask wearing detection unit 31 outputs an imaging instruction to the imaging unit 21 and acquires the image captured by the imaging unit 21 (step SP22). Note that the mask wearing detection unit 31 may output an imaging instruction to the imaging unit 21 after a certain period of time has elapsed since the alarm output unit 32 outputs the notification.

[0041] Next, the mask wearing detection unit 31 recognizes the face of the driver from the image acquired in step SP22 by image processing (step SP23). The mask wearing detection unit 31 determines whether a face can be recognized from the image in step SP23 (step SP24). If a face can be recognized from the image (YES in step SP24), the mask wearing detection unit 31 proceeds to step SP15 (see FIG. 4).

[0042] If a face cannot be recognized from the image (NO in step SP24), the mask wearing detection unit 31 transmits, via the communication unit 33, the fact that a face cannot be recognized from the image to the server device 3 (step SP25) and ends the series of processes.

[0043] FIG. 6 is a flowchart showing the process flow of process B. When the mask wearing detection unit 31 detects that the driver is not wearing the mask correctly (NO in step SP16, see FIG. 4), the alarm output unit 32 outputs an alarm prompting the driver to wear the mask correctly from the speaker 22 (step SP31). Further, the alarm output unit 32 outputs an alarm from the speaker 22 that prompts the driver to wear the mask correctly and also prompts the driver to close the driver's seat door 12 so as not to get off the vehicle without wearing the mask (step SP31). The alarm that prompts the driver to wear the mask correctly is, for example, "It seems that the mask is not worn correctly. Please close the door and check the mask wearing." etc.

[0044] In step SP31, the alarm output unit 32 outputs the alarm from the speaker 22, but the output form of the alarm is not limited to this. For example, the alarm output unit 32 may output an alarm sound from the speaker 22 and also output an alarm consisting of character information from the display unit 23.

[0045] The alarm output unit 32 acquires the detection result of the door sensor 13 and detects whether the driver's seat door 12 is in the closed state (step SP32). When the alarm output unit 32 does not detect that the driver's seat door 12 is in the closed state (NO in step SP32), the alarm output unit 32 performs the process of step SP33 again. That is, the alarm output unit 32 continues to output the notification until the door sensor 13 detects that the driver's seat door 12 is in the closed state. In addition, when the alarm output unit 32 does not detect that the driver's seat door 12 is in the closed state even after a certain period of time has elapsed, the alarm output unit 32 may output an alarm sound from the speaker 22 in addition to the alarm voice.

[0046] When the alarm output unit 32 detects that the driver's seat door 12 is in the closed state (YES in step SP32), the mask wearing detection unit 31 returns the process to step SP11 (see FIG. 4).

[0047] According to this embodiment, when the mask wearing detection unit 31 detects that the driver's seat door 12 is in an open state by the door sensor 13, that is, before the driver gets out of the vehicle, it is detected from the image captured by the imaging unit 21 whether the driver is wearing a mask correctly. When it is detected that the driver is not wearing a mask correctly, the alarm output unit 32 outputs an alarm from the speaker 22 to prompt the driver to wear the mask correctly, so that the driver can be prevented from getting out of the vehicle in a state of forgetting to wear the mask. That is, in the transportation and handling operations, the mask wearing of the driver can be confirmed at an effective timing.

[0048] Also, according to this embodiment, when the mask wearing detection unit 31 can detect the driver's mouth or nose, by detecting that the driver is not wearing a mask correctly, it is possible to prevent the driver from getting out of the vehicle in a state where the mask is not worn correctly (such as the nose sticking out).

[0049] Also, according to this embodiment, until the door sensor 13 detects that the driver's seat door 12 is in a closed state, the alarm output unit 32 continues to output an alarm, so that the driver can be prevented from getting out of the vehicle in a state of forgetting to wear the mask or not wearing it correctly.

[0050] Also, according to this embodiment, when the face cannot be recognized from the image captured by the imaging unit 21, the alarm output unit 32 outputs a notification from the speaker 22 to prompt the driver to face the imaging unit 21, so that the probability of successful mask wearing detection can be increased.

[0051] Also, according to this embodiment, the communication unit 33 outputs the detection results (the mask is worn correctly and the mask wearing cannot be detected) in the mask wearing detection unit 31 to the server device 3. By referring to the data output to the server device 3, the administrator can confirm without burden that the driver is wearing the mask correctly and performing the work. In addition, since the report of mask wearing can be automatically performed, the burden on the driver, the risk of false reporting, etc. can be reduced.

[0052] In addition, in this embodiment, when an imaging instruction is output from the mask wearing detection unit 31, the imaging unit 21 captures an image and inputs the image to the mask wearing detection unit 31. However, the imaging mode of the imaging unit 21 is not limited to this. For example, the imaging unit 21 may continuously capture images. When the imaging unit 21 continuously captures images, the imaging unit 21 may output the image captured immediately before the instruction from the mask wearing detection unit 31 is input to the mask wearing detection unit 31.

[0053] As described above, the embodiments of the present invention have been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and design changes and the like within the scope not departing from the gist of the present invention are also included.

Explanation of Reference Numerals

[0054] 1: Mask wearing detection device 2: Vehicle 3: Server device 10: Passenger compartment 11: Driver's seat 12: Driver's seat door 13: Door sensor 14: In-vehicle device 21: Imaging unit 22: Speaker 23: Display unit 30: Control unit 31: Mask wearing detection unit 32: Alarm output unit 33: Communication unit 50: Control device 52: Communication device 54: Storage device 56: CPU 58: Memory

Claims

1. An imaging unit that images a driver sitting in the driver's seat of a vehicle; A speaker provided in the passenger compartment of the vehicle; A door sensor provided on a door adjacent to the driver's seat, for detecting whether the door is in an open state; When it is detected by the door sensor that the door is in an open state, a face of the driver is detected from an image captured by the imaging unit, and a mask wearing detection unit that detects whether the driver is correctly wearing a mask based on the face of the driver; An alarm output unit that outputs an alarm from the speaker to prompt correct wearing of a mask when it is detected by the mask wearing detection unit that the driver is not correctly wearing a mask; A mask wearing detection device, characterized by comprising the above.

2. When the mask wearing detection unit can detect the mouth or nose of the driver from the image, it detects that the driver is not correctly wearing a mask The mask wearing detection device according to claim 1, characterized by the above.

3. The alarm output unit continues to output the alarm until it is detected by the door sensor that the door is in a closed state The mask wearing detection device according to claim 1 or 2, characterized by the above.

4. When the face cannot be recognized from the image in the mask wearing detection unit, the alarm output unit outputs a notification from the speaker to direct the face towards the imaging unit The mask wearing detection device according to any one of claims 1 to 3, characterized by the above.

5. Comprising a communication unit that communicates with a server device, The communication unit outputs a detection result in the mask wearing detection unit to the server device The mask wearing detection device according to any one of claims 1 to 4, characterized by the above. A mask wearing detection method performed by a computer for controlling a vehicle, comprising: When it is detected by a door sensor provided on a door adjacent to the driver's seat of the vehicle that the door is in an open state, detecting a face of the driver sitting in the driver's seat from an image captured by an imaging unit that captures the driver, and detecting whether the driver is correctly wearing a mask based on the face of the driver; When it is detected that the driver is not correctly wearing a mask, outputting, from a speaker provided in the passenger compartment of the vehicle, an alarm prompting the driver to correctly wear a mask; A mask wearing detection method, characterized by including the above steps. A computer for controlling a vehicle, When it is detected by a door sensor provided on a door adjacent to the driver's seat of the vehicle that the door is in an open state, a mask wearing detection unit that detects a face of the driver sitting in the driver's seat from an image captured by an imaging unit that captures the driver, and detects whether the driver is correctly wearing a mask based on the face of the driver; and An alarm output unit that outputs, from a speaker provided in the passenger compartment of the vehicle, an alarm prompting the driver to correctly wear a mask when it is detected by the mask wearing detection unit that the driver is not correctly wearing a mask A mask wearing detection program, characterized by causing the computer to function as the above units.

Images