JP2023010024A - Mask-wearing detection device, mask-wearing detection method, and mask-wearing detection program - Google Patents

Abstract

[Problem] To provide a mask wearing detection device, a mask wearing detection method, and a mask wearing detection program for checking whether a driver is wearing a mask at an effective timing. [Solution] A mask wearing detection device 1 includes an image capturing unit 21 that captures an image of a driver sitting in the driver's seat of a vehicle, a speaker 22 provided in the vehicle cabin, a door sensor 13 provided in a door adjacent to the driver's seat and detects whether the door is open or not, a mask wearing detection unit 31 that detects the driver's face from the image captured by the image capturing unit 21 when the door sensor 13 detects that the door is open and detects whether the driver is wearing a mask correctly based on the driver's face, and an alarm output unit that outputs an alarm from the speaker 22 to urge the driver to wear a mask correctly when the mask wearing detection unit 31 detects that the driver is not wearing a mask correctly. [Selected Figure] Figure 3

Description

The present invention relates to a mask-wearing detection device, a mask-wearing detection method, and a mask-wearing detection program.

Patent Document 1 discloses control means, a touch panel display as information output means, a speaker, a USB 3.0 interface, a USB adjustment port interface, a network port, a 10PIN function connection port, a first camera and a second camera, and an entrance/exit management support device comprising an infrared temperature measurement module.

JP 2020-149485 A

The invention described in Patent Document 1 determines whether or not a visitor is wearing a mask, and if the visitor is not wearing a mask, displays information prompting the visitor to wear a mask on the display. However, the invention described in Patent Literature 1 performs processing for those who pass through the security gate, and for example, it is a wasteful task to detect whether or not the mask is always worn while driving. Therefore, the invention described in Patent Document 1 cannot be applied to a vehicle as it is.

The present invention has been made in view of such circumstances, and aims to provide a mask-wearing detection device, a mask-wearing detection method, and a mask-wearing detection program capable of confirming that a driver is wearing a mask at an effective timing. aim.

In order to solve the above problems, the mask wearing detection device according to the present invention includes, for example, an imaging unit that images a driver sitting in a driver's seat of a vehicle, a speaker provided in the cabin of the vehicle, and the driving a door sensor provided on a door adjacent to a seat for detecting whether or not the door is in an open state; A mask wearing detection unit that detects the driver's face from the captured image and detects whether the driver is wearing the mask correctly based on the driver's face, and the mask wearing detection unit and an alarm output unit that outputs an alarm prompting the driver to wear the mask correctly from the speaker when it is detected that the driver is not wearing the mask correctly.

In the wear state detection method according to another aspect of the present invention, for example, when a door sensor provided on a door adjacent to a driver's seat of a vehicle detects that the door is in an open state, the wearer sits on the driver's seat. Detecting the driver's face from the image captured by the imaging unit that captures the driver, and detecting whether the driver is wearing the mask correctly based on the driver's face; and outputting an alarm prompting the driver to wear the mask correctly from a speaker provided in the cabin of the vehicle when it is detected that the driver is not wearing the mask correctly. and

A wear state detection program according to another aspect of the present invention, for example, causes a computer to detect that a door sensor provided in a door adjacent to a driver's seat of a vehicle detects that the door is in an open state. Detecting the driver's face from an image captured by an imaging unit that captures an image of the driver sitting in the seat, and detecting whether the driver is wearing the mask correctly based on the driver's face. a mask wearing detection unit, when the mask wearing detection unit detects that the driver is not wearing the mask correctly, a speaker provided in the cabin of the vehicle issues an alarm prompting the driver to wear the mask correctly. It is characterized by functioning as an alarm output unit that outputs from.
The computer program can be provided by downloading via a network such as the Internet, or can be provided by being recorded on various computer-readable recording media such as a CD-ROM.

In any one of the above aspects of the present invention, when it is detected that the door is open, it is detected whether the driver is wearing the mask correctly based on the image captured by the imaging unit. and, when it is detected that the driver does not wear the mask correctly, the speaker outputs an alarm prompting the driver to wear the mask correctly. As a result, it is possible to avoid going out of the vehicle while forgetting to wear the mask. That is, it is possible to confirm that the driver is wearing a mask at an effective timing.

The mask wearing detection unit may detect that the driver is not wearing the mask correctly when the driver's mouth or nose can be detected from the image. As a result, it is possible to prevent the driver from going out of the vehicle without properly wearing the mask (such as with the nose sticking out).

The alarm output unit may continue to output the alarm until the door sensor detects that the door is closed. This can prevent the driver from leaving the vehicle while forgetting to wear the mask or wearing it incorrectly.

The alarm output unit may output a notification from the speaker to direct the face to the imaging unit when the mask wearing detection unit cannot recognize the face from the image. As a result, the probability of successful mask wearing detection can be increased.

A communication unit that communicates with a server device may be provided, and the communication unit may output a detection result of the mask wearing detection unit to the server device. As a result, the manager can easily confirm that the driver is properly wearing a mask while working. In addition, since the wearing of masks can be reported automatically, it is possible to reduce the burden on drivers and the risk of false reports.

According to the present invention, it is possible to confirm that the driver is wearing a mask at an effective timing.

BRIEF DESCRIPTION OF THE DRAWINGS It is a figure which shows the outline of the vehicle 2 in which the mask wearing detection apparatus 1 which concerns on this Embodiment is provided. 1 is a block diagram schematically showing an example of a hardware configuration of a mask wearing detection device 1; FIG. 2 is a diagram showing an outline of electrical functional blocks of the mask wearing detection device 1. FIG. 4 is a flow chart showing the flow of processing performed by the mask-wearing detection device 1. FIG. 10 is a flowchart showing the flow of processing A; 9 is a flowchart showing the flow of processing B;

Hereinafter, embodiments of a mask-wearing detector according to the present invention will be described in detail with reference to the drawings. A mask-wearing detection device is a device that outputs an alarm when a driver tries to get off without wearing a mask.

FIG. 1 is a diagram showing an outline of a vehicle 2 provided with a mask wearing detection device 1 according to this embodiment. The vehicle 2 is provided with a driver's seat 11, a driver's seat door 12, a door sensor 13, an in-vehicle device 14, and the like. In addition, the vehicle interior 10 of the vehicle 2 is provided with an imaging unit 21, a speaker 22, a display unit 23, and the like.

A driver's seat door 12 is a door adjacent to the driver's seat 11 , and a door sensor 13 is provided on the driver's seat door 12 . The imaging unit 21 images the driver seated in the driver's seat 11 . The in-vehicle device 14 is connected to the door sensor 13 , the imaging unit 21 , the speaker 22 and the like, and performs various controls of the mask wearing detection device 1 .

FIG. 2 is a block diagram schematically showing an example of the hardware configuration of the mask wearing detection device 1. As shown in FIG. The mask wearing detection device 1 includes a control device 50 , a communication device 52 and a storage device 54 . The control device 50 mainly includes a CPU (Central Processing Unit) 56 and a memory 58 .

In the control device 50, the CPU 56 executes predetermined programs stored in the storage device 54, memory 58, or the like, thereby functioning as various functional units.

The communication device 52 is composed of a communication interface or the like for communicating with an external device. The communication device 52 transmits and receives various information to and from the server device 3, for example.

The storage device 54 is composed of a hard disk or the like. The storage device 54 stores various programs and information necessary for execution of processing in the control device 50 and information on processing results.

The mask-wearing detection device 1 can be realized using an information processing device such as a dedicated or general-purpose server computer. Moreover, the mask-wearing detection device 1 may be configured by a single information processing device, or may be configured by a plurality of information processing devices distributed over a communication network. Moreover, FIG. 2 only shows a part of the main hardware configuration of the mask-wearing detection device 1, and the mask-wearing detection device 1 may include other configurations that are generally provided in server devices. can.

FIG. 3 is a diagram showing an outline of electrical functional blocks of the mask-wearing detection device 1. As shown in FIG. The mask-wearing detection device 1 is connected to the server device 3 wirelessly or via a network.

The mask wearing detection device 1 mainly includes a door sensor 13 , an imaging unit 21 , a speaker 22 , a display unit 23 and a control unit 30 .

The control unit 30 uses at least a mask-wearing detection unit 31, It has an alarm output unit 32 and a communication unit 33 .

A door sensor 13 detects whether or not the driver's seat door 12 is in an open state. The detection result of the door sensor 13 is input to the mask wearing detection section 31 and the alarm output section 32 .

An image of the driver captured by the imaging unit 21 is input to the mask wearing detection unit 31 . The image capturing unit 21 captures an image when an imaging instruction is output from the mask wearing detection unit 31 and outputs the captured image to the mask wearing detection unit 31 .

When the door sensor 13 detects that the driver's seat door 12 is open, the mask wearing detection unit 31 detects the driver's face from the image captured by the imaging unit 21, and detects the detected driver's face. This is a functional part that detects whether the driver is wearing the mask correctly based on the face of the driver.

The opening of the driver's door 12 indicates that the driver intends to get off the vehicle. For example, in a situation where there is a risk of infectious diseases, it is necessary to prevent people from forgetting to wear a mask or leaving the vehicle without wearing a mask correctly (such as with their nose sticking out). is important. Therefore, when it is detected that the driver's seat door 12 is in an open state, the mask wearing detection unit 31 detects whether or not the mask is worn correctly, so that the driver's mask is detected at an effective timing. Wearing can be checked. The function of the mask wearing detection unit 31 will be described in detail later.

The alarm output unit 32 is a functional unit that outputs an alarm from the speaker 22 or the like. The alarm output unit 32 outputs an alarm prompting the driver to wear the mask correctly from the speaker 22 when the mask wearing detection unit 31 detects that the driver is not wearing the mask correctly. The function of the alarm output unit 32 will be detailed later.

The communication unit 33 is a functional unit that communicates with the server device 3 and the like. The communication unit 33 outputs the detection result of the mask wearing detection unit 31 to the server device 3 .

4 to 6 are flowcharts showing the flow of processing performed by the mask-wearing detection device 1. FIG. First, the mask-wearing detection unit 31 determines whether or not it is detected that the driver's seat door 12 is open based on the detection result of the door sensor 13 (step SP11). If the driver's door 12 is not open (NO in step SP11), the process of step SP11 is repeated.

When the driver's seat door 12 is open (YES in step SP11), the mask wearing detection unit 31 outputs an imaging instruction to the imaging unit 21 and acquires an image captured by the imaging unit 21 (step SP12). Then, the mask wearing detection unit 31 recognizes the face of the driver by image processing from the image acquired in step SP12 (step SP13). Various known techniques can be used for the process of recognizing a face from an image.

The mask wearing detection unit 31 determines whether or not the face has been recognized from the image in step SP13 (step SP14). If the face cannot be recognized from the image (NO in step SP14), the process proceeds to process A shown in FIG. 5 (detailed later).

If the face can be recognized from the image (YES at step SP14), the mask wearing detection unit 31 detects the mouth or nose from the image acquired at step SP12 (step SP15). Various known techniques can be used for the process of recognizing the mouth or nose from the face image.

Then, the mask wearing detection unit 31 detects whether or not the driver is wearing the mask correctly based on the detection result of step SP15 (step SP16). In this embodiment, the mask wearing detection unit 31 detects that the driver is not wearing the mask correctly when the driver's mouth or nose can be detected from the image acquired in step SP12.

If it is detected that the driver is not wearing the mask correctly (NO in step SP16), the process proceeds to process B shown in FIG. 6 (detailed later). If it is detected that the driver is wearing the mask correctly (YES in step SP16), the mask wearing detection unit 31 detects the detection result of step SP16, that is, that the driver is wearing the mask correctly. is transmitted to the server device 3 via the communication unit 33 (step SP17).

FIG. 5 is a flow chart showing the processing flow of the processing A. As shown in FIG. If the face cannot be recognized from the image (NO in step SP14, see FIG. 4), the alarm output unit 32 outputs a notification from the speaker 22 to direct the face to the imaging unit 21 (step SP21). The alarm output unit 32 outputs a notification from the speaker 22 and also outputs a signal to the mask wearing detection unit 31 at the same time.

Next, the mask wearing detection unit 31 outputs an image capturing instruction to the image capturing unit 21 and acquires an image captured by the image capturing unit 21 (step SP22). Note that the mask-wearing detection unit 31 may output an imaging instruction to the imaging unit 21 after a certain period of time has elapsed since the alarm output unit 32 output the notification.

Next, the mask wearing detection unit 31 recognizes the face of the driver by image processing from the image acquired in step SP22 (step SP23). The mask wearing detection unit 31 determines whether or not the face has been recognized from the image in step SP23 (step SP24). If the face can be recognized from the image (YES in step SP24), the mask-wearing detector 31 proceeds to step SP15 (see FIG. 4).

If the face could not be recognized from the image (NO in step SP24), the mask wearing detection unit 31 transmits to the server device 3 via the communication unit 33 that the face could not be recognized from the image (step SP25), the series of processing ends.

FIG. 6 is a flow chart showing the flow of processing B. FIG. When the mask wearing detection unit 31 detects that the driver is not wearing the mask correctly (NO in step SP16, see FIG. 4), the alarm output unit 32 issues an alarm prompting the driver to wear the mask correctly. is output from the speaker 22 (step SP31). The alarm output unit 32 also outputs an alarm from the speaker 22 to urge the driver to wear the mask correctly and to close the driver's door 12 so as not to get off the vehicle without wearing the mask (step SP31). An example of an alarm prompting the user to wear the mask correctly is, "It seems that the mask is not being worn correctly. Please close the door and check that the mask is being worn."

Although the warning output unit 32 outputs the warning from the speaker 22 in step SP31, the output form of the warning is not limited to this. For example, the alarm output unit 32 may output an alarm sound from the speaker 22 and an alarm consisting of character information from the display unit 23 .

The alarm output unit 32 acquires the detection result of the door sensor 13 and detects whether or not the driver's seat door 12 is closed (step SP32). If the warning output unit 32 does not detect that the driver's door 12 is closed (NO in step SP32), the warning output unit 32 performs the process of step SP33 again. That is, the alarm output unit 32 continues outputting the notification until the door sensor 13 detects that the driver's seat door 12 is closed. Note that the alarm output unit 32 outputs an alarm sound from the speaker 22 in addition to the alarm sound when it is not detected that the driver's door 12 is closed after a certain period of time has passed. good too.

When the alarm output unit 32 detects that the driver's door 12 is closed (YES in step SP32), the mask wearing detection unit 31 returns the process to step SP11 (see FIG. 4).

According to the present embodiment, when the door sensor 13 detects that the driver's seat door 12 is open, that is, when the mask wearing detection unit 31 detects that the driver's seat door 12 is in an open state, the image is captured by the imaging unit 21 before the driver leaves the vehicle. It is detected whether or not the driver is wearing the mask correctly from the captured image, and when it is detected that the driver is not wearing the mask correctly, the alarm output unit 32 prompts the driver to wear the mask correctly. By outputting the alarm from the speaker 22, it is possible to prevent the person from leaving the vehicle while forgetting to wear the mask. In other words, it is possible to confirm that the driver is wearing a mask at an effective timing in the transportation/carrying business.

Further, according to the present embodiment, when the mask-wearing detection unit 31 can detect the driver's mouth or nose, it detects that the driver is not wearing the mask correctly. It is possible to prevent the driver from going out of the vehicle without wearing the mask (with the nose sticking out, etc.).

Further, according to the present embodiment, the alarm output unit 32 continues to output an alarm until the door sensor 13 detects that the driver's seat door 12 is in a closed state. It is possible to prevent the driver from leaving the vehicle without wearing it correctly.

Further, according to the present embodiment, when the face cannot be recognized from the image captured by the imaging unit 21, the alarm output unit 32 outputs a notification from the speaker 22 so that the face is directed to the imaging unit 21. The probability of successful mask wearing detection can be increased.

Further, according to the present embodiment, the communication unit 33 outputs the detection result of the mask wearing detection unit 31 (that the mask is correctly worn and that the wearing of the mask cannot be detected) to the server device 3. Accordingly, by referring to the data output to the server device 3, the manager can confirm that the driver is wearing the mask correctly and doing the work without any burden. In addition, since the wearing of masks can be reported automatically, it is possible to reduce the burden on drivers and the risk of false reports.

In the present embodiment, when an imaging instruction is output from the mask-wearing detection unit 31, the imaging unit 21 takes an image, and the image is input to the mask-wearing detection unit 31. Not limited. For example, the imaging unit 21 may continuously capture images. When the imaging unit 21 continuously captures images, the imaging unit 21 may output to the mask wearing detection unit 31 an image captured immediately before an instruction is input from the mask wearing detection unit 31 .

Although the embodiments of the present invention have been described in detail with reference to the drawings, the specific configuration is not limited to these embodiments, and design changes and the like are also included within the scope of the gist of the present invention. .

1: mask wearing detection device 2: vehicle 3: server device 10: cabin 11: driver's seat 12: driver's seat door 13: door sensor 14: in-vehicle device 21: imaging unit 22: speaker 23: display unit 30: control unit 31: Mask wearing detection unit 32 : Alarm output unit 33 : Communication unit 50 : Control device 52 : Communication device 54 : Storage device 56 : CPU
58: Memory

Claims (7)

an imaging unit that captures an image of the driver sitting in the driver's seat of the vehicle;
a speaker provided in a cabin of the vehicle;
a door sensor provided on a door adjacent to the driver's seat for detecting whether or not the door is in an open state;
When the door sensor detects that the door is open, the face of the driver is detected from the image captured by the imaging unit, and the driver is masked based on the face of the driver. A mask wearing detection unit that detects whether the is worn correctly,
an alarm output unit that outputs an alarm prompting the driver to wear the mask correctly from the speaker when the mask wearing detection unit detects that the driver is not wearing the mask correctly;
A mask wearing detection device comprising: 2. The mask wearing detection unit detects that the driver is not wearing the mask correctly when the driver's mouth or nose can be detected from the image. Mask wearing detection device. The mask-wearing detector according to claim 1 or 2, wherein the alarm output unit continues to output the alarm until the door sensor detects that the door is closed. 4. The alarm output unit outputs a notification from the speaker to direct the face to the imaging unit when the mask wearing detection unit cannot recognize the face from the image. The mask wearing detection device according to claim 1. A communication unit that communicates with a server device,
The mask-wearing detection device according to any one of claims 1 to 4, wherein the communication unit outputs a detection result of the mask-wearing detection unit to the server device. When a door sensor provided on a door adjacent to a driver's seat of a vehicle detects that the door is in an open state, the image captured by an imaging unit that captures an image of the driver sitting in the driver's seat. detecting a driver's face and detecting whether the driver is wearing a mask correctly based on the driver's face;
A step of outputting an alarm prompting the driver to wear the mask correctly from a speaker provided in the cabin of the vehicle when it is detected that the driver is not wearing the mask correctly;
A mask-wearing detection method, comprising: the computer,
When a door sensor provided on a door adjacent to a driver's seat of a vehicle detects that the door is in an open state, the image captured by an imaging unit that captures an image of the driver sitting in the driver's seat. A mask wearing detection unit that detects the driver's face and detects whether the driver is wearing the mask correctly based on the driver's face,
An alarm output for outputting an alarm prompting the driver to wear the mask correctly from a speaker provided in the cabin of the vehicle when the mask wearing detection unit detects that the driver is not wearing the mask correctly. part,
A mask wearing detection program characterized by functioning as a mask wearing detection program.

Images