Spectator monitoring device, spectator monitoring system, spectator monitoring method, and spectator monitoring program

The audience monitoring device and system efficiently detect and notify staff about spectators not wearing masks, improving compliance and safety in crowded facilities by precisely identifying and locating non-compliant individuals.

JP7578144B2Active Publication Date: 2024-11-06NEC CORP
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2022558712
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-10-29
Publication Date
2024-11-06
Estimated Expiration
2040-10-29

AI Technical Summary

Technical Problem

Facility staff find it difficult to identify spectators who are not wearing masks among a large number of attendees, making it challenging to enforce mask-wearing protocols effectively.

Method used

An audience monitoring device and system that acquires images of spectators, detects individuals not wearing masks, specifies their locations, and notifies facility personnel through an information terminal, optionally using facial recognition and biometric authentication for precise identification.

Benefits of technology

Facility staff can easily and efficiently identify and address spectators not wearing masks, enhancing compliance with mask-wearing protocols and reducing the risk of disease transmission.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007578144000001
    Figure 0007578144000001
  • Figure 0007578144000002
    Figure 0007578144000002
  • Figure 0007578144000003
    Figure 0007578144000003
Patent Text Reader

Abstract

A spectator monitoring device (1) according to the present disclosure is provided with: an acquisition unit (11) that acquires a first captured image of a spectator region where a plurality of spectators in a predetermined facility are included; a detection unit (12) that detects, from the first captured image, a non-wearer who is a spectator not wearing a mask; an identification unit (13) for identifying a partial region of the spectator region where the non-wearer is included; and a notification unit (14) that notifies an information terminal of operation personnel of the facility, of warning information about the identified partial region.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an audience monitoring device, an audience monitoring system, an audience monitoring method, and a non-transitory computer-readable medium, and in particular to an audience monitoring device, an audience monitoring system, an audience monitoring method, and a non-transitory computer-readable medium for monitoring whether audience members are wearing masks. [Background technology]

[0002] In recent years, in order to prevent the spread of infection, wearing masks has become a general rule in facilities where large numbers of spectators gather. Patent Document 1 discloses a technology that detects masks from face images and prompts people to remove them if they are wearing a mask. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2017 / 212967 Summary of the Invention [Problem to be solved by the invention]

[0004] In facilities where large numbers of spectators gather, it was difficult for facility staff (operating personnel) to spot spectators who had removed their masks and speak to them.

[0005] The present disclosure has been made to solve such problems, and aims to provide a spectator monitoring device, a spectator monitoring system, a spectator monitoring method, and a non-transitory computer-readable medium that allow facility management personnel to easily identify spectators who have removed their masks from among a large number of spectators. [Means for solving the problem]

[0006] An audience monitoring device according to a first aspect of the present disclosure, An acquisition means for acquiring a first captured image of an audience area including a plurality of audience members in a predetermined facility; A detection means for detecting a non-wearer who is a spectator not wearing a mask from the first captured image; A means for identifying a partial area including the non-wearer in the spectator area; a notification means for notifying an information terminal of an operation staff member of the facility of warning information regarding the specified partial area; Equipped with.

[0007] A spectator monitoring system according to a second aspect of the present disclosure includes: An imaging device that images an audience area including a plurality of audience members in a predetermined facility; an audience monitoring device connected to the imaging device; Equipped with The audience monitoring device comprises: An acquisition means for acquiring a first captured image captured by the imaging device; A detection means for detecting a non-wearer who is a spectator not wearing a mask from the first captured image; A means for identifying a partial area including the non-wearer in the spectator area; a notification means for notifying an information terminal of an operation staff member of the facility of warning information regarding the specified partial area; Equipped with.

[0008] A method for monitoring an audience according to a third aspect of the present disclosure includes: The computer A first photographed image is obtained in which a spectator area including a plurality of spectators in a predetermined facility is photographed; Detecting a non-mask-wearing spectator who is not wearing a mask from the first captured image; Identifying a partial area of ​​the spectator area including the non-wearer; Warning information regarding the identified partial area is notified to an information terminal of an operating staff member of the facility.

[0009] A non-transitory computer-readable medium storing an audience monitoring program according to a fourth aspect of the present disclosure includes: An acquisition process for acquiring a first captured image of an audience area including a plurality of audience members in a predetermined facility; A detection process for detecting non-wearers, which are spectators not wearing masks, from the first captured image; A process of identifying a partial area including the non-wearer in the spectator area; a notification process for notifying an information terminal of an operation staff member of the facility of warning information regarding the specified partial area; to be executed by the computer. Effect of the Invention

[0010] The present disclosure provides an audience monitoring device, an audience monitoring system, an audience monitoring method, and a non-transitory computer-readable medium that enable facility operations personnel to easily identify audience members who are removing their masks from among a large number of spectators. [Brief description of the drawings]

[0011] [Figure 1] 1 is a block diagram showing a configuration of an audience monitoring device according to a first embodiment. [Diagram 2] 4 is a flowchart showing the flow of an audience monitoring method according to the first embodiment. [Diagram 3] FIG. 11 is a block diagram showing the overall configuration of an audience monitoring system according to a second embodiment. [Figure 4] FIG. 11 is a diagram showing an example of a spectator area in a stadium and camera installation positions according to the second embodiment. [Diagram 5] FIG. 11 is a block diagram showing a configuration of an authentication device according to a second embodiment. [Figure 6] 11 is a flowchart showing the flow of face information registration processing according to the second embodiment. [Figure 7] 11 is a flowchart showing the flow of face authentication processing by the authentication device according to the second embodiment. [Figure 8] FIG. 11 is a block diagram showing the configuration of an audience monitoring device according to a second embodiment. [Figure 9]13 is a flowchart showing the flow of an audience monitoring process according to the second embodiment. [Figure 10] FIG. 11 is a diagram showing an example of a display of warning information for a person not wearing a mask according to the second embodiment. [Figure 11] FIG. 11 is a diagram showing an example of a display of warning information for a person not wearing a mask according to the second embodiment. [Figure 12] FIG. 11 is a diagram showing an example of a display of warning information for a person not wearing a mask according to the second embodiment. [Figure 13] FIG. 11 is a block diagram showing the configuration of an audience monitoring device according to a third embodiment. [Figure 14] 13 is a flowchart showing the flow of an audience monitoring process according to the third embodiment. [Figure 15] FIG. 11 is a block diagram showing the configuration of an audience monitoring device according to a fourth embodiment. [Figure 16] 13 is a flowchart showing the flow of an audience monitoring process according to the fourth embodiment. [Figure 17] FIG. 13 is a diagram showing an example of a display of warning information for a person not wearing a mask according to the fourth embodiment. [Figure 18] FIG. 13 is a diagram showing an example of a display of warning information for a person not wearing a mask according to the fourth embodiment. [Figure 19] FIG. 13 is a diagram showing an example of a display of warning information for a person not wearing a mask according to the fourth embodiment. [Figure 20] FIG. 13 is a diagram showing an example of a display of warning information for a person not wearing a mask according to the fourth embodiment. [Figure 21] 13 is a flowchart showing the flow of an audience monitoring process according to the fifth embodiment. [Figure 22] FIG. 13 is a diagram showing an example of a display of warning information for a person not wearing a mask according to the fifth embodiment. [Figure 23] 23 is a flowchart showing the flow of an audience monitoring process according to the sixth embodiment. [Figure 24] FIG. 13 is a block diagram showing the configuration of an audience monitoring device according to a seventh embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In each drawing, the same or corresponding elements are denoted by the same reference numerals, and duplicated descriptions will be omitted as necessary for clarity of explanation.

[0013] <Embodiment 1> FIG. 1 is a block diagram showing the configuration of an audience monitoring device 1 according to the first embodiment. The audience monitoring device 1 is an information processing device for monitoring whether multiple spectators at a specified facility are wearing masks. Here, the audience monitoring device 1 is connected to a network (not shown). The network may be wired or wireless. In addition, a photographing device and an information terminal are connected to the network. The photographing device photographs an audience area including multiple spectators at the specified facility. The photographing device transmits photographed images of the audience area to the audience monitoring device 1 via the network. In addition, the information terminal is an information processing device operated by facility management personnel.

[0014] The spectator monitoring device 1 includes an acquisition unit 11, a detection unit 12, an identification unit 13, and a notification unit 14. The acquisition unit 11 acquires a first captured image of a spectator area including a plurality of spectators in a specified facility. The detection unit 12 detects non-masks, which are spectators not wearing masks, from the first captured image. For example, the detection unit 12 determines whether a mask is present in a face area of ​​a person in the captured image by image recognition. The identification unit 13 identifies a partial area including a person not wearing a mask in the spectator area. The notification unit 14 notifies an information terminal of a facility operation staff member of warning information about the identified partial area. Here, the warning information may be display information for identifying (identifying) the partial area in the captured image, or audio information capable of identifying the partial area.

[0015] 2 is a flowchart showing the flow of the spectator monitoring method according to the first embodiment. First, the acquisition unit 11 acquires a first captured image of a spectator area including a plurality of spectators in a predetermined facility (S11). Next, the detection unit 12 detects non-masks, spectators who are not wearing masks, from the first captured image (S12). Note that if no non-masks are detected, the process returns to step S11 after a predetermined time.

[0016] If a non-wearer is detected in step S12, the identification unit 13 identifies a partial area of ​​the spectator area that includes the non-wearer (S13). Then, the notification unit 14 notifies an information terminal of facility operation staff of warning information about the identified partial area (S14). That is, the notification unit 14 transmits the warning information to the information terminal via the network. As a result, the information terminal receives the warning information from the spectator monitoring device 1 via the network, and displays the warning information on a screen or outputs a sound corresponding to the warning information.

[0017] In this way, according to this embodiment, the facility management personnel can recognize in real time via the information terminal that there are spectators in the spectator area who are not wearing masks. In particular, the management personnel can easily identify the partial area of ​​the spectator area where there are spectators not wearing masks by the warning information. Therefore, the management personnel can be assisted in calling out to spectators who have not taken off their masks to encourage them to wear masks.

[0018] The audience monitoring device 1 includes a processor, a memory, and a storage device, which are not shown in the figure. The storage device stores a computer program that implements the processing of the audience monitoring method according to this embodiment. The processor then loads the computer program from the storage device into the memory and executes the computer program. In this way, the processor realizes the functions of an acquisition unit 11, a detection unit 12, an identification unit 13, and a notification unit 14.

[0019] Alternatively, the acquisition unit 11, the detection unit 12, the identification unit 13, and the notification unit 14 may each be realized by dedicated hardware. In addition, a part or all of the components of each device may be realized by a general-purpose or dedicated circuit, processor, etc., or a combination of these. These may be configured by a single chip, or may be configured by multiple chips connected via a bus. A part or all of the components of each device may be realized by a combination of the above-mentioned circuits, etc., and a program. In addition, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (field-programmable gate array), a quantum processor (quantum computer control chip), etc. can be used as the processor.

[0020] Furthermore, when some or all of the components of audience monitoring device 1 are realized by multiple information processing devices, circuits, etc., the multiple information processing devices, circuits, etc. may be arranged in a centralized or distributed manner. For example, the information processing devices, circuits, etc. may be realized as a client-server system, cloud computing system, etc., in a form in which each is connected via a communication network. Furthermore, the functions of audience monitoring device 1 may be provided in a SaaS (Software as a Service) format.

[0021] <Embodiment 2> The second embodiment is a specific example of the first embodiment. FIG. 3 is a block diagram showing the overall configuration of a spectator monitoring system 1000 according to the second embodiment. The spectator monitoring system 1000 is an information system for monitoring whether a plurality of spectators in a plurality of spectator areas 101 to 10n (n is a natural number of 2 or more) in a stadium 100 are wearing masks. The stadium 100 is an example of a predetermined facility. The spectator area 101 is divided into blocks 1011 to 101i (i is a natural number of 1 or more), and each block includes one or more seats. The same is true for the spectator areas 102 (not shown) to 10n. For example, the spectator area 10n is divided into a plurality of blocks 10n1 to 10nj (j is a natural number of 2 or more), and each block includes one or more seats. The spectator area may be a standing area without seats.

[0022] The spectator monitoring system 1000 comprises a camera 110, a staff terminal 120, a management terminal 130, an authentication device 200, and an spectator monitoring device 300. The camera 110, the staff terminal 120, the management terminal 130, the authentication device 200, and the spectator monitoring device 300 are each connected via a network N. Here, the network N is a wired or wireless communication line.

[0023] The stadium 100 includes a camera 110, a staff terminal 120, and a management terminal 130. The camera 110 is a photographing device that photographs each of the spectator areas 101 to 10n on a spectator area basis. Specifically, the camera 110 moves in a photographing direction (camera orientation) at a predetermined interval, photographs the spectator areas 101 to 10n in order for a predetermined time, photographs the spectator area 10n, and then moves again in the photographing direction of the spectator area 101, and repeats this process. The camera 110 transmits the photographed image of the spectator area to the spectator monitoring device 300 via the network N. At this time, the camera 110 transmits the photographing direction (camera orientation or camera installation position) together with the photographed image to the spectator monitoring device 300. It is sufficient that the camera 110 photographs at least one of the spectator areas 101 to 10n. For example, when the camera 110 photographs the spectator area 101, the other spectator areas 10n, etc. may be photographed by other cameras. Similarly, the other cameras also transmit captured images and shooting directions to the audience monitoring device 300.

[0024] FIG. 4 is a diagram showing an example of the spectator area of ​​the stadium 100 and the camera installation position according to the second embodiment. For example, the camera 110a is shown as being installed in the topmost stage of the stand of the stadium 100. That is, the camera 110a is installed in the stand on the opposite side of the ground from the spectator area 101 to 103 (stand). FIG. 4 shows that the camera 110a has the shooting direction toward the spectator area 101. As described above, the camera 110a moves the shooting direction in the order of the spectator areas 101, 102, and 103 at regular intervals, shoots the spectator area in each shooting direction, and transmits the shot image to the spectator monitoring device 300 via the network N each time. The camera 110b is another example of the camera installation position. The camera 110b is shown as being installed in front of the stand on the spectator area 101 to 103 side. In this case, the camera 110b may also move its shooting direction at regular intervals in the order of spectator areas 101, 102, and 103, and shoot the spectator areas in each shooting direction. Alternatively, separate cameras may be installed in front of each of the spectator areas 101 to 103.

[0025] Returning to FIG. 3, the explanation will be continued. The management terminal 130 is an information processing device operated by the manager U2 in spectator monitoring. The manager U2 is an example of an operation staff member of the stadium 100. The management terminal 130 is an example of the information terminal described above. The management terminal 130 receives warning information, which will be described later, from the spectator monitoring device 300 via the network N and displays the warning information on the screen. The manager U2 then notifies the staff terminal 120 via the management terminal 130 of the position of the person not wearing a mask, etc., based on the warning information displayed on the management terminal 130. For example, the management terminal 130 may transmit the voice of the seat position of the person not wearing a mask, which is generated by the manager U2, to the staff terminal 120 via the network N. Alternatively, the management terminal 130 may transfer the warning information to the staff terminal 120 selected by the manager U2. This allows the stadium staff U1 to check the warning information on the screen of the staff terminal 120, making it easier to grasp the person not wearing a mask.

[0026] The staff terminal 120 is an information processing device operated by a stadium staff U1, who is an example of an operating staff member of the stadium 100. The staff terminal 120 receives and outputs voice information from the management terminal 130 via the network N. This allows the stadium staff U1 to know the specific seat positions of those not wearing masks via the voice information. Therefore, the stadium staff U1 can go close to those not wearing masks and call them to wear masks. The staff terminal 120 may be an example of the information terminal described above. In this case, the staff terminal 120 receives warning information (to be described later) from the audience monitoring device 300 via the network N instead of or together with the management terminal 130, and displays the warning information on the screen. Even in this case, the stadium staff U1 can know the specific seat positions of those not wearing masks.

[0027] The management terminal 130 and the staff terminal 120 are, for example, a mobile phone terminal, a smartphone, a tablet terminal, a PC (Personal Computer) equipped with or connected to a camera, etc. In addition, when the warning information is audio information, the management terminal 130 and the staff terminal 120 output the received audio information.

[0028] Here, an example of advance registration for realizing spectator monitoring in the spectator monitoring system 1000 will be described. Spectators reserve seats for an event on a specific day at the stadium 100 in advance. For example, the spectator uses an information processing device such as a PC or smartphone to purchase an event ticket on an event reservation site, specifying the seat location and inputting personal information, etc. as necessary. The spectator then obtains identification information (e.g., a two-dimensional code) indicating the reserved seat location and personal information, etc. for the event. For example, the spectator's smartphone receives the two-dimensional code. Alternatively, the spectator obtains the two-dimensional code by email, etc., and prints it out.

[0029] The stadium 100 is also equipped with an entrance terminal (not shown) at the entrance gate that controls the entry of spectators. The entrance terminal is an information terminal equipped with a camera and the like, and is connected to the network N. Therefore, the spectator monitoring system 1000 may include the entrance terminal.

[0030] Spectators arrive at the stadium 100 on the day of the event and present a two-dimensional code to the entrance terminal. For example, the spectator displays the two-dimensional code on a smartphone and holds the two-dimensional code over the camera of the entrance terminal. Alternatively, the spectator holds a piece of paper on which the two-dimensional code is printed over the camera of the entrance terminal. The entrance terminal analyzes the two-dimensional code photographed by the camera, extracts the reserved seat position and personal information, etc., and transmits a registration request including the seat position and personal information, etc. to the spectator monitoring device 300 via the network N. If there is no problem with the seat position and personal information, etc. included in the registration request, the spectator monitoring device 300 registers the seat position and personal information, etc. in association with each other, and returns a request to register face information to the entrance terminal. The entrance terminal displays a message indicating the registration request on a screen, photographs an area including the spectator's face, and transmits a face information registration request including the photographed image to the authentication device 200 or the spectator monitoring device 300 via the network N. The authentication device 200 performs face information registration processing in response to the face information registration request as described below, and returns the registration result to the entrance terminal. If the registration is successful, the spectator is allowed to enter stadium 100 through the entrance gate. Authentication device 200 also notifies spectator monitoring device 300 of the user ID (spectator ID) issued at the time of registration.

[0031] Incidentally, when reserving a seat, a spectator may also register his / her own face image. For example, the spectator's information processing device may transmit a face information registration request including a photographed image to the authentication device 200 or the spectator monitoring device 300 via the network N through an event reservation site. Alternatively, even if a spectator does not reserve a seat in advance, the seat may be confirmed through an entrance procedure at an entrance terminal on the day of the event, and at that time, a registration request including the seat position, personal information, etc. and a face information registration request including a photographed image may be transmitted to the spectator monitoring device 300 via the network N.

[0032] The authentication device 200 is an information processing device that stores facial feature information of multiple people (audience members). In response to a facial authentication request received from the outside, the authentication device 200 compares the facial image or facial feature information included in the request with the facial feature information of each user, and returns the comparison result (authentication result) to the request source.

[0033] FIG. 5 is a block diagram showing the configuration of an authentication device 200 according to the second embodiment. The authentication device 200 includes a face information DB (DataBase) 210, a face detection unit 220, a feature point extraction unit 230, a registration unit 240, and an authentication unit 250. The face information DB 210 stores a user ID 211 and face feature information 212 of the user ID in association with each other. The face feature information 212 is a set of feature points extracted from a face image. The authentication device 200 may delete the face feature information 212 in the face feature DB 210 in response to a request from a registered user of the face feature information 212. Alternatively, the authentication device 200 may delete the face feature information 212 after a certain period of time has elapsed since the registration of the face feature information 212.

[0034] The face detection unit 220 detects a face area included in a registration image for registering face information, and outputs the face area to the feature point extraction unit 230. The feature point extraction unit 230 extracts feature points from the face area detected by the face detection unit 220, and outputs face feature information to the registration unit 240. The feature point extraction unit 230 also extracts feature points included in a face image received from the spectator's information processing device, the entrance terminal, or the spectator monitoring device 300, and outputs the face feature information to the authentication unit 250.

[0035] The registration unit 240 issues a new user ID 211 when registering the facial feature information. The registration unit 240 registers the issued user ID 211 in the facial feature information DB 210 in association with the facial feature information 212 extracted from the registration image. The authentication unit 250 performs face authentication using the facial feature information 212. Specifically, the authentication unit 250 compares the facial feature information extracted from the face image with the facial feature information 212 in the facial information DB 210. If the comparison is successful, the authentication unit 250 specifies the user ID 211 associated with the compared facial feature information 212. The authentication unit 250 returns a match of the facial feature information to the audience monitoring device 300 as a facial authentication result. The match of the facial feature information corresponds to the success or failure of authentication. The match of the facial feature information (match) refers to a case where the degree of match is equal to or greater than a predetermined value. If the facial authentication is successful, the facial authentication result includes the specified user ID.

[0036] 6 is a flowchart showing the flow of face information registration processing according to the second embodiment. Here, an information registration terminal (not shown) photographs the body including the face of a spectator (user), and transmits a face information registration request including the photographed image (registration image) to the authentication device 200 via the network N. The information registration terminal is, for example, an information processing device such as a personal computer, a smartphone, or a tablet terminal. For example, the information registration terminal may be an entrance terminal installed at the entrance of the stadium 100. Alternatively, the information registration terminal may be a spectator monitoring device 300 that receives a face information registration request from the entrance terminal.

[0037] First, the authentication device 200 acquires a registration image included in a face information registration request (S21). For example, the authentication device 200 accepts a face information registration request from an information registration terminal via the network N. Next, the face detection unit 220 detects a face area included in the registration image (S22). Next, the feature point extraction unit 230 extracts feature points from the face area detected in step S22, and outputs face feature information to the registration unit 240 (S23). Finally, the registration unit 240 issues a user ID 211, associates the user ID 211 with face feature information 212, and registers the user ID 211 in the face information DB 210 (S24). Note that the authentication device 200 may receive the face feature information 212 from the information registration terminal, and register the user ID 211 in the face information DB 210 in association with the user ID 211. Also, the registration unit 240 may notify the audience monitoring device 300 of the registered (issued) user ID.

[0038] FIG. 7 is a flowchart showing the flow of face authentication processing by the authentication device 200 according to the second embodiment. First, the feature point extraction unit 230 acquires a face image for authentication included in a face authentication request (S31). For example, the authentication device 200 receives a face authentication request from the audience monitoring device 300 via the network N, and extracts face feature information from the face image included in the face authentication request as in steps S21 to S23. Alternatively, the authentication device 200 may receive face feature information from the audience monitoring device 300. Next, the authentication unit 250 compares the acquired face feature information with the face feature information 212 in the face information DB 210 (S32). If the face feature information matches, that is, if the degree of match of the face feature information is equal to or greater than a predetermined value (Yes in S33), the authentication unit 250 identifies the user ID 211 of the user whose face feature information matches (S34), and returns a message to the audience monitoring device 300 indicating that face authentication was successful and the identified user ID 211 (S35). If there is no matching facial feature information (No in S33), the authentication section 250 returns a message to the audience monitoring device 300 indicating that face authentication has failed (S36).

[0039] Returning to Fig. 3 for further explanation, spectator monitoring device 300 is an information processing device that detects people not wearing masks from images of the spectator area captured by camera 110, identifies partial areas including non-wearers, and notifies the management terminal 130 or staff terminal 120 as warning information. Spectator monitoring device 300 may be made redundant with multiple servers, and each functional block may be realized by multiple computers.

[0040] Next, the spectator monitoring device 300 will be described in detail. Fig. 8 is a block diagram showing the configuration of the spectator monitoring device 300 according to the second embodiment. The spectator monitoring device 300 comprises a storage unit 310, a memory 320, an IF (Interface) unit 330, and a control unit 340. The storage unit 310 is an example of a storage device such as a hard disk or a flash memory. The storage unit 310 stores a program 311, a spectator ID 312, a seat position 313, a shooting direction 314, and a spectator area 315. The program 311 is a computer program in which the processing of the spectator monitoring method according to the second embodiment is implemented.

[0041] Spectator ID 312 is identification information of a spectator in stadium 100. Spectator ID 312 may be identification information of a spectator at an event on a specific day. Seat position 313 is information for identifying the position of each seat in spectator areas 101 to 10n. Spectator ID 312 and seat position 313 are associated with each other. Spectator ID 312 also corresponds to user ID 211 in face information DB 210 of authentication device 200. Therefore, it can be said that memory unit 310 stores spectator ID 312 corresponding to facial feature information 212 in face information DB 210 in association with seat position 313.

[0042] The shooting direction 314 is information indicating the camera direction of the camera 110 (or the installation position of the camera). The spectator area 315 is information that defines the blocks and seat positions for each of the spectator areas 101 to 10n. Specifically, one spectator area 315 includes multiple blocks 3151 to 315i. Each block includes multiple seat positions. For example, the block 3151 includes seat positions 31511 to 3151k (k is a natural number equal to or greater than 2). The shooting direction 314 and the spectator area 315 are associated with each other.

[0043] The memory 320 is a volatile storage device such as a RAM (Random Access Memory), and is a storage area for temporarily holding information during operation of the control unit 340. The IF unit 330 is a communication interface with the network N.

[0044] The control unit 340 is a processor, or control device, that controls each component of the audience monitoring device 300. The control unit 340 loads the program 311 from the storage unit 310 into the memory 320 and executes the program 311. In this way, the control unit 340 realizes the functions of a registration unit 341, an acquisition unit 342, a detection unit 343, an authentication control unit 344, an identification unit 345, and a notification unit 346.

[0045] The registration unit 341 registers in the storage unit 310 identification information (audience ID) corresponding to the facial feature information of each of the multiple spectators in association with the seat position. For example, the registration unit 341 receives a registration request including the seat position and personal information from the entrance terminal via the network N, as in the example of advance registration described above. When the registration unit 341 confirms that the received seat position and personal information are not different from the reservation details on the reservation site, the registration unit 341 registers the seat position and personal information in association with each other in the storage unit 310. Then, the registration unit 341 returns a request to register face information to the entrance terminal. When the registration unit 341 receives a face information registration request including a face image of the spectator from the entrance terminal, the registration unit 341 transmits the face information registration request to the authentication device 200 via the network N. Then, the registration unit 341 receives the user ID issued at the time of registration of the face information from the authentication device 200 via the network N, and stores the user ID as the spectator ID 312 in the storage unit 310 in association with the seat position 313 registered in advance. The registration unit 341 also performs the same process when it receives a registration request or a face information registration request from the information processing device of the spectator.

[0046] The acquisition unit 342 is an example of the above-mentioned acquisition unit 11. The acquisition unit 342 acquires a captured image of any of the audience area 101, etc. from the camera 110 via the network N. The acquisition unit 342 acquires the shooting direction together with the captured image from the camera 110.

[0047] The detection unit 343 is an example of the detection unit 12 described above. The detection unit 343 detects non-mask-wearing spectators from the captured image acquired by the acquisition unit 342. The detection unit 343 may analyze the captured image using a known technique to determine whether or not a mask is present in the face area of ​​each person in the captured image. For example, the detection unit 343 may detect non-mask-wearing spectators using an AI (Artificial Intelligence) model that has learned face images of people wearing masks.

[0048] The authentication control unit 344 controls face authentication by referring to the storage unit 310 and the authentication device 200 (which are collectively an example of a storage means) based on the face area of ​​the non-wearer in the captured image. That is, the authentication control unit 344 causes the authentication device 200 to perform face authentication on the face feature information of the non-wearer. For example, the authentication control unit 344 extracts a face area corresponding to the non-wearer of a mask detected by the detection unit 343 from the captured image. Then, the authentication control unit 344 transmits a face authentication request including an image of the extracted face area to the authentication device 200 via the network N, and receives a face authentication result of the user (non-wearer) from the authentication device 200. Alternatively, the authentication control unit 344 may extract face feature information from the face area and include the face feature information in the face authentication request.

[0049] The identification unit 345 is an example of the above-mentioned identification unit 13. The identification unit 345 identifies a partial area including a non-wearer of a mask in the spectator area. Here, the identification unit 345 identifies the seat position of the non-wearer as the partial area. That is, the identification unit 345 identifies the user ID included in the received face recognition result as the spectator ID 312, and identifies the seat position 313 associated with the spectator ID 312 as the partial area. Note that, if the received face recognition result indicates a failure of face recognition, the identification unit 345 cannot identify the spectator ID. In that case, the identification unit 345 may identify the seat position based on the shooting direction of the camera 110 that captured the captured image and the detection position of the non-wearer in the captured image. For example, the identification unit 345 identifies the spectator area 315 associated with the acquired shooting direction 314. Then, the identification unit 345 identifies the detection position of the non-wearer detected by the acquisition unit 342 in the captured image. The identification unit 345 then identifies, as a partial region, a block and a seat position corresponding to the detection position from the identified spectator region 315. The identification unit 345 may identify a block as a partial region without identifying the seat position. Alternatively, the identification unit 345 may identify, as a partial region, the spectator region itself that is the subject of the captured image.

[0050] The notification unit 346 is an example of the notification unit 14 described above. The notification unit 346 transmits warning information to the management terminal 130 or the staff terminal 120 via the network N. Here, the warning information includes the seat position identified by the identification unit 345. The warning information is information that can identify the seat position of the non-wearer in the captured image. For example, the warning information may be a frame that surrounds the face of the non-wearer. Therefore, the notification unit 346 may transmit the warning information so that the captured image is displayed on the management terminal 130 or the staff terminal 120 and then displayed in the captured image. This makes it easier for the manager U2 or the stadium staff U1 to identify the position of the non-wearer and to call out to the non-wearer. Alternatively, the warning information may be audio information of the seat position (seat number, etc.) of the non-wearer. In addition, the warning information may include at least the block identified by the identification unit 345.

[0051] The notification unit 346 may further notify a predetermined output device in the stadium 100 of the warning information. The output device may be, for example, a speaker, an aurora vision (liquid crystal display), digital signage, or the like. In this case, the notification unit 346 may use a speaker or digital signage near the block identified by the identification unit 345 as the output device. For example, a directional speaker may be used as the output device. In this case, the notification unit 346 may output warning information (audio) from the directional speaker toward the identified block. This makes it possible to directly notify the spectators. In addition, the warning information at this time may include audio or message information such as "Please cooperate by wearing a mask."

[0052] In the second embodiment, the seat position of the detected non-mask wearer does not necessarily need to be identified by face authentication. In that case, the spectator monitoring device 300 does not need information associating the spectator ID 312 with the seat position 313 or the authentication control unit 344. Then, the identification unit 345 may identify the seat position as a partial region based on the shooting direction of the camera 110 that captured the captured image and the detected position of the non-mask wearer in the captured image, as described above. Alternatively, the identification unit 345 may identify a block as a partial region based on the shooting direction of the camera 110 that captured the captured image and the detected position of the non-mask wearer in the captured image, as described above. In this case, even if the notification unit 346 cannot identify the seat position, it may transmit an image of the partial region such as a block unit and an image showing the non-mask wearer in a red frame or the like to the staff terminal 120 as warning information.

[0053] 9 is a flowchart showing the flow of spectator monitoring processing according to the present embodiment 2. Here, for example, it is assumed that the camera 110 captures an image in a shooting direction of the spectator area 101, and transmits the captured image and the shooting direction to the spectator monitoring device 300 via the network N. In response to this, the acquisition unit 342 acquires the captured image and the shooting direction from the camera 110 via the network N (S41).

[0054] Next, the detection unit 343 determines whether or not a person not wearing a mask has been detected from the captured image acquired in step S41 (S42). For example, the detection unit 343 analyzes the captured image and identifies one or more spectator face areas included in the captured image. Then, the detection unit 343 determines whether or not a mask is being worn for each identified face area. If no non-mask wearer is detected, the detection unit 343 transmits an instruction to the camera 110 via the network N to move the shooting direction of the camera 110 to the next spectator area (S43).

[0055] If one or more non-wearers are detected in step S42, the authentication control unit 344 and the identification unit 345 perform a process of identifying a partial region for each non-wearer (S44). In the following, a description will be given assuming that one non-wearer is detected, but if two or more non-wearers are detected, step S44 will be performed for each non-wearer.

[0056] Specifically, first, the authentication control unit 344 performs face authentication control of a non-wearer (S441). Specifically, the authentication control unit 344 extracts a face area of ​​the non-wearer from a captured image, and acquires face feature information from the face area. Then, the authentication control unit 344 includes the face feature information in a face authentication request and transmits it to the authentication device 200 via the network N. Then, the authentication control unit 344 receives a face authentication result from the authentication device 200.

[0057] Then, the authentication control unit 344 determines whether or not the face authentication is successful (S442). Specifically, the authentication control unit 344 determines whether or not the received face authentication result includes information indicating success. If it is determined in step S442 that the face authentication is successful, the identification unit 345 identifies the seat position based on the spectator ID of the non-wearer (S443). Specifically, the identification unit 345 acquires the user ID whose face authentication was successful from the face authentication result as the spectator ID. Then, the identification unit 345 identifies the seat position 313 associated with the acquired spectator ID 312 from the memory unit 310.

[0058] If it is determined in step S442 that face authentication has failed, the identification unit 345 identifies the seat position based on the shooting direction (S444). Specifically, as described above, the identification unit 345 identifies the seat position based on the shooting direction and the detection position of the non-wearer.

[0059] After step S443 or S444, the notification unit 346 notifies the management terminal 130 or the staff terminal 120 of warning information including information indicating the identified seat position via the network N (S45). The warning information may include the captured image and the seat position. The notification unit 346 may transmit warning information to the management terminal 130 or the staff terminal 120 to highlight the area in which the non-mask wearer was detected in the map of the entire stadium 100. As a result, for example, the management terminal 130 or the staff terminal 120 can display the map of the entire stadium 100 on the screen and highlight (for example, in red) the spectator area or block in which the non-mask wearer was detected. FIG. 10 is a diagram showing an example of the display of warning information R0 for non-mask wearers according to the second embodiment. Here, the management terminal 130 or the like displays the map of the entire stadium 100 on the screen and highlights the warning information R0 in a partial area (block) in the spectator area 102. When the management terminal 130 or the staff terminal 120 receives the selection of the warning information R0 or the spectator area 102 from the manager U2 or the stadium staff U1, the management terminal 130 or the staff terminal 120 may display a screen shown in FIG. 11 or FIG. 12, which will be described later.

[0060] FIG. 11 is a diagram showing a display example of warning information R1 of a person not wearing a mask according to the second embodiment. Here, the management terminal 130 or the staff terminal 120 displays the warning information R1 on the screen at the detected seat position in the captured image. The warning information R1 is an example including a frame line (dashed line) of the face area of ​​the non-wearer and a seat number (e.g., "S123"). For example, the manager U2 may check the warning information R1 displayed on the management terminal 130 and notify the staff terminal 120 of the seat position (seat number, etc.). This allows the stadium staff U1 to grasp the seat position where the person not wearing a mask is present by the staff terminal 120, and to go close to the non-wearer and urge him to wear a mask. Alternatively, the staff terminal 120 may directly receive and display warning information from the audience monitoring device 300. Note that the management terminal 130 or the staff terminal 120 may display only one of the seat number and frame line of the person not wearing a mask as warning information R1 on the screen.

[0061] FIG. 12 is a diagram showing a display example of warning information R11 of a non-wearer of a mask according to the second embodiment. That is, the warning information R1 in FIG. 11 is not limited to the frame line of the non-wearer or the seat number. FIG. 12 shows that the management terminal 130 or the like displays the warning information R11 on the screen in a block in the spectator area where the non-wearer is detected in the captured image. The warning information R11 is an example including the frame line (dashed line) of the block in which the non-wearer exists in the spectator area in the captured image and the block number (for example, "A23"). Note that the management terminal 130 or the like may display only either the frame line of the block or the block number as the warning information R11 on the screen. Note that the warning information R11 may be a frame surrounding the entire spectator area in which the non-wearer is detected. Alternatively, the warning information R11 may be a frame surrounding a partial area in which the non-wearer exists among a specific block in the captured image. Alternatively, the warning information R11 may be a frame surrounding an area spanning multiple blocks in the spectator area. Furthermore, some or all of the above-mentioned warning information R1 and R11 may be combined.

[0062] In this embodiment, the management personnel, such as the manager U2 and the stadium staff U1, can easily grasp the locations of non-mask-wearing people among many spectators. This can help the management personnel to call out to non-mask-wearing people. In particular, when the seat location of each spectator is registered in advance, the seat location can be accurately identified by using face recognition.

[0063] <Embodiment 3> The third embodiment is a modification of the second embodiment described above. The spectator monitoring device according to the third embodiment further includes a determination unit that, when a non-mask-wearing person is detected, determines whether or not a predetermined condition is met. The notification unit then notifies warning information when it is determined that the predetermined condition is met. This limits excessive notifications of warning information, and allows stadium staff U1 to call out to spectators to wear a mask when it is more necessary.

[0064] Furthermore, it is preferable that the audience monitoring device according to the third embodiment further includes a first measurement unit that measures an index value related to non-wearing of a mask when a non-wearing person is detected. In this case, the determination unit determines whether or not the index value satisfies a predetermined condition. In this way, since the determination is made using the measured index value, it is possible to more accurately determine whether or not to notify warning information.

[0065] Since the overall configuration of this embodiment 3 is the same as that in Fig. 3, it is not illustrated, and only the differences will be explained below. Fig. 13 is a block diagram showing the configuration of an audience monitoring device 300a according to this embodiment 3. Compared to the above-mentioned spectator monitoring device 300, the memory unit 310 of the spectator monitoring device 300a is configured such that program 311 has been replaced with program 311a. Also, compared to the above-mentioned spectator monitoring device 300, the control unit 340 of the spectator monitoring device 300a is configured such that a measurement unit 347 and a judgment unit 348 have been added. The other configuration is the same as that of the spectator monitoring device 300.

[0066] The program 311a is a computer program in which the processing of the audience monitoring method according to the third embodiment is implemented.

[0067] The measurement unit 347 is an example of the first measurement unit described above. For example, the measurement unit 347 may measure the non-wearing time when a non-wearer does not wear a mask as an index value. Alternatively, the measurement unit 347 may measure the number of times a specific spectator is detected as a non-wearer from a plurality of captured images captured a plurality of times in the spectator area as an index value. In this case, the measurement unit 347 stores the number of detections in the memory 320 or the like. Alternatively, the measurement unit 347 may measure the number of non-wearers detected in the spectator area as an index value. Alternatively, when a non-wearer is detected, the measurement unit 347 may measure the crowded state of the spectator area as an index value. Note that the measurement unit 347 may include the distance between the non-wearer and the surrounding spectators in the crowded state.

[0068] The determination unit 348 is an example of the determination unit described above. For example, the determination unit 348 may determine that a predetermined condition is satisfied when the measured non-wearing time exceeds a predetermined time. This can prevent excessive notifications of warning information from being sent out when a spectator has just removed a mask and may then put the mask back on.

[0069] Alternatively, the determination unit 348 may determine that the predetermined condition is met when the measured detection count exceeds a predetermined number. This makes it possible to encourage spectators who remove their masks multiple times, even for a short period of time, to wear masks appropriately.

[0070] Alternatively, the determination unit 348 may determine that the predetermined condition is satisfied when the measured number of detected people exceeds a predetermined number. This makes it possible to suppress excessive notifications of warning information when there are few non-wearers.

[0071] Alternatively, the determination unit 348 may determine that the predetermined condition is satisfied when the measured crowded state exceeds a predetermined level. For example, the determination unit 348 may determine whether the crowded state exceeds a predetermined level based on whether other spectators are present within a predetermined range of a non-wearing spectator in the measured crowded state. This makes it possible to appropriately encourage non-wearing spectators to wear masks when the spectator area is crowded.

[0072] Fig. 14 is a flow chart showing the flow of the audience monitoring process according to the third embodiment. Note that steps S41 to S44 and S45 are the same as those in Fig. 9 described above, so the differences from Fig. 9 will be described below. After step S44, the measurement unit 347 measures an index value relating to not wearing a mask (S46). Here, the index value may be, for example, the above-mentioned non-wearing time, the number of detections, the number of people detected, or the crowded situation, but is not limited to these. In addition, the measurement unit 347 may measure a combination of two or more of the non-wearing time, the number of detections, the number of people detected, and the crowded situation.

[0073] Then, the determination unit 348 determines whether the index value measured in step S46 satisfies a predetermined condition (S47). For example, if the index value is non-wearing time, the determination unit 348 determines whether the non-wearing time exceeds a predetermined time. If the index value is the number of detections, the determination unit 348 determines whether the number of detections exceeds a predetermined number. If the index value is the number of detections, the determination unit 348 determines whether the number of detections exceeds a predetermined number. If the index value is the congestion state, the determination unit 348 determines whether the congestion state exceeds a predetermined degree.

[0074] If it is determined in step S47 that the index value satisfies the predetermined condition, the notification unit 346 notifies the warning information as described above (S45). On the other hand, if it is determined in step S47 that the index value does not satisfy the predetermined condition, the process proceeds to step S43.

[0075] Incidentally, the third embodiment does not necessarily need to include the measurement unit 347. In that case, for example, the determination unit 348 may determine that the predetermined condition is satisfied when the detected non-wearer is not eating or drinking. That is, the determination unit 348 determines whether the detected non-wearer is eating or drinking. For example, the determination unit 348 may use an AI model that has learned images of the area around the face where a person is eating or drinking to determine whether the detected non-wearer is eating or drinking. This can prevent excessive notification of warning information when eating or drinking is occurring. Alternatively, the manager U2 may determine whether the non-wearer is eating or drinking after viewing the captured image and warning information displayed on the management terminal 130, and input the determination result to the audience monitoring device 300 via the management terminal 130. In that case, the determination unit 348 determines that the predetermined condition is not satisfied when the input determination result indicates that the person is eating or drinking. That is, even if the person is not wearing a mask, the person is excluded from the warning target. At this time, the notification unit 346 may instruct to cancel the warning information that has already been notified. Therefore, excessive notification of warning information can also be prevented in this case. However, the determination unit 348 may count the number of times the detected non-wearer eats and drinks. Then, the determination unit 348 may determine that the predetermined condition is satisfied if the number of times the non-wearer eats and drinks exceeds a predetermined value.

[0076] Alternatively, the determination unit 348 may determine that the specified condition is satisfied if the identified partial area is a designated area where wearing of a mask is required. For example, in an eating space in the stadium 100, not wearing a mask may be permitted. For this reason, the spectator monitoring device 300 registers spaces (other than eating spaces) where wearing of a mask is required, such as regular spectator seats, as designated areas in advance. In this case, the determination unit 348 determines whether the seat position or block identified in step S44 is a designated area. This makes it possible to suppress notification of warning information in the eating space.

[0077] <Embodiment 4> The fourth embodiment is a modification of the second or third embodiment described above. The spectator monitoring device according to the fourth embodiment further comprises a second measurement unit that measures an index value relating to non-wearing of a mask when a non-wearer is detected, and a determination unit that determines warning information indicating the level of warning according to the index value. This allows the operation staff to adjust the frequency and level of calling out to the spectator by receiving a notification according to the level of warning, enabling a more detailed response. It is also possible to select whether to increase or decrease the number of notification destinations according to the level of warning.

[0078] Since the overall configuration of the fourth embodiment is the same as that of FIG. 3, it is not illustrated, and only the differences will be described below. FIG. 15 is a block diagram showing the configuration of an audience monitoring device 300b according to the fourth embodiment. The memory unit 310 of the audience monitoring device 300b is different from that of the above-mentioned audience monitoring device 300a in that the program 311a has been replaced with a program 311b. Also, the control unit 340 of the audience monitoring device 300b is different from that of the above-mentioned audience monitoring device 300a in that the judgment unit 348 has been replaced with a decision unit 349. The measurement unit 347 according to the fourth embodiment is an example of the above-mentioned second measurement unit. The other configurations are the same as those of the audience monitoring device 300a. The audience monitoring device 300b can also be realized by making improvements to the audience monitoring device 300 according to the second embodiment.

[0079] The program 311b is a computer program in which the processing of the audience monitoring method according to the fourth embodiment is implemented.

[0080] The determination unit 349 is an example of the determination unit described above. For example, the determination unit 349 may determine the color of the frame surrounding the face area of ​​the non-wearer in the order of blue, yellow, and red, in which the degree of warning increases. For example, the determination unit 349 may determine the degree of warning of the warning information (for example, the color of the frame) according to the non-wearing time. That is, the determination unit 349 may determine the warning information such that the degree of warning increases (is higher) as the non-wearing time increases. This makes it easy to identify spectators (and their locations) who have taken off their masks for a long time among non-wearers, so that the stadium staff U1 can preferentially call out to spectators who have taken off their masks for a long time.

[0081] Alternatively, the determination unit 349 may determine the degree of warning (e.g., the color of the border) of the warning information according to the number of detections. In other words, the determination unit 349 may determine the warning information such that the degree of warning becomes stronger (higher) as the number of detections increases. This makes it easy to identify spectators (and their locations) who have removed their masks multiple times, even in a short period of time, so that the stadium staff U1 can give priority to calling out to those spectators.

[0082] Alternatively, the determination unit 349 may determine the degree of warning of the warning information (e.g., the color of the border) according to the number of detected people. In other words, the determination unit 349 may determine the warning information such that the degree of warning becomes stronger (higher) as the number of detected people increases. This allows the stadium staff U1 to call out to the detected people not wearing masks according to the number of detected people. Furthermore, when the number of detected people exceeds a predetermined number, the determination unit 349 may add a speaker or the like near the identified partial area to the notification destinations of the warning information. This reduces the burden on the stadium staff U1 of calling out to a large number of people.

[0083] Alternatively, the determination unit 349 may determine the degree of warning (for example, the color of the border) of the warning information depending on the congestion situation. In other words, the determination unit 349 may determine the warning information such that the closer the distance between the non-mask wearer and other spectators and the more spectators there are nearby, the stronger (higher) the warning degree becomes. This allows the stadium staff U1 to easily recognize the presence of a non-mask wearer in a densely populated spectator area and to give priority to calling out to the person.

[0084] The determination unit 349 may include in the warning information an index value such as the measured non-wearing time, the number of detections, the number of people detected, or the congestion situation. This allows the management terminal 130 or the like that receives the warning information to display the index value on the screen. Therefore, the manager U2 or stadium staff U1 can visually recognize the color and index value and more easily identify non-wearers.

[0085] Fig. 16 is a flowchart showing the flow of the spectator monitoring process according to the fourth embodiment. Note that steps S41 to S44, S46, and S45 are the same as those in Fig. 14 described above, so the differences from Fig. 14 will be described below. After step S46, the determination unit 349 determines warning information indicating the level of warning according to the index value (S48). Here, the determination unit 349 determines warning information indicating the level of warning according to any one or a combination of multiple of the non-wearing time, the number of detections, the number of people detected, and the congestion situation, as described above. Thereafter, the notification unit 346 notifies the determined warning information as described above (S45).

[0086] 17 to 20 are diagrams showing examples of display of warning information of a person not wearing a mask according to the fourth embodiment. FIG. 17 shows an example in which a notation of "5 minutes of not wearing a mask!" is displayed as warning information R1a when the non-wearing time is measured as the index value. FIG. 18 shows an example in which a notation of "5 times / 15 minutes of not wearing a mask!" is displayed as warning information R1b when the number of detections is measured as the index value. FIG. 19 shows an example in which a notation of "3 people not wearing masks!" is displayed as warning information R1c when the number of people detected per spectator area is measured as the index value. FIG. 20 shows an example in which a notation of "3 people around the person not wearing a mask!" is displayed as warning information R1d when the congestion situation is measured as the index value. Note that FIG. 20 shows an example in which the area surrounding the person not wearing a mask is surrounded by a frame (dashed line), but the frame is not essential. 17 to 20, instead of the borders of the face areas of the non-wearer in the warning information R1a to R1d, borders or block numbers in block units, as in the warning information R11 in FIG. 12 described above, may be used.

[0087] The display examples of warning information in FIGS. 17 to 20 may be applied to the third embodiment.

[0088] In addition, when the detection unit 343 detects that a non-mask wearer shouts, cheers, talks, stands up, or the like, the determination unit 349 may determine the warning information so that the level of warning is increased. For example, the detection unit 343 may detect that the detected non-mask wearer is talking, etc., using an AI model that has learned images of the area around the face where people are talking. Alternatively, the stadium 100 may be equipped with a microphone that collects the voices of spectators for each spectator area or each block. In this case, the detection unit 343 may detect that the detected non-mask wearer is talking, etc., when the volume of sound collected from the microphone corresponding to the specified block is equal to or greater than a predetermined value.

[0089] <Embodiment 5> The fifth embodiment is a modification of the second to fourth embodiments described above. The spectator monitoring device according to the fifth embodiment further includes a third measurement unit that measures the number of non-wearers detected in each of a plurality of partial regions in the spectator area. The identification unit identifies a partial region with a larger number of detected people among the plurality of partial regions, and the notification unit notifies the identified partial region of warning information with priority. This allows the stadium staff U1 to give priority to calling out to blocks with a higher risk of infection. The notification unit may also add a speaker corresponding to the identified block to the notification destination. The third measurement unit may measure an index value related to non-wearing of a mask for each of a plurality of partial regions in the spectator area. The index value may be, for example, the non-wearing time, the number of detections of non-wearers, the congestion situation around the non-wearer, etc., as in the above-mentioned second measurement unit. In this case, the identification unit identifies a partial region with a larger index value among the plurality of partial regions, and the notification unit notifies the identified partial region of warning information with priority. In other words, the identification unit may determine the priority order for notifying the warning information based on the index value for each partial region.

[0090] The overall configuration of the fifth embodiment is the same as that in Fig. 3 and is therefore not shown in the figures. Also, the configuration of the spectator monitoring device of the fifth embodiment is obtained by adding a measuring unit 347 to Fig. 8 and is therefore not shown in the figures, and only the differences will be explained below. The spectator monitoring device of the fifth embodiment can also be realized by making improvements to the spectator monitoring devices 300, 300a, or 300b of the second to fourth embodiments.

[0091] Fig. 21 is a flowchart showing the flow of an audience monitoring process according to the present embodiment 5. Note that steps S41 to S43 are the same as those in Fig. 9 described above, so the following will only explain the differences from Fig. 9.

[0092] If one or more non-wearers are detected in step S42, the measurement unit 347 measures the number of non-wearers detected for each of a plurality of blocks in the spectator area (S51). Then, the identification unit 345 identifies the block with the largest number of detected non-wearers among the plurality of blocks (S52). Then, the notification unit 346 notifies the management terminal 130 or the staff terminal 120 of warning information for identifying the identified block via the network N (S53). At this time, the notification unit 346 may further notify the warning information to a speaker corresponding to the identified block via the network N.

[0093] Thereafter, the identification unit 345 determines whether or not there are any blocks in which non-wearers were detected that have not been notified in step S53 (S54). If it is determined that there are any unnotified blocks, the identification unit 345 identifies the blocks in which the greater number of people were detected among the unnotified blocks (S55). Then, the notification unit 346 notifies the warning information as described above (S53). If it is determined in step S54 that there are no unnotified blocks, the spectator monitoring process ends.

[0094] FIG. 22 is a diagram showing a display example of warning information of a person not wearing a mask according to the fifth embodiment. FIG. 22 shows an example in which three non-mask wearers are detected in the block on the left side from the front of the spectator area, and one non-mask wearer is detected in the block on the right side. According to the flow of FIG. 21, warning information R2a is displayed in the block on the left side first, and then warning information R2b is displayed in the block on the right side. However, warning information R2a and R2b may be displayed simultaneously. Warning information R2a shows the notation "(1) 3 people not wearing masks!", and warning information R2b shows the notation "(2) 1 person not wearing mask!". Therefore, warning information R2a including the notation "(1)" has a higher priority than warning information R2b including the notation "(2)". Also, in this example, the character size of warning information R2a is larger than the character size of warning information R2b. This also shows that warning information R2a has a higher priority than warning information R2b. That is, the manager U2 or the like can ascertain the block with a higher density of non-wearers based on at least one of the display order, the first number, or the character size of the warning information R2a and the warning information R2b. In other words, the manager U2 or the like can ascertain the block with a high priority for encouraging people to wear masks based on at least one of the display order, the first number, or the character size of the warning information. Therefore, the stadium staff U1 can give priority to encouraging people to wear masks to the block corresponding to the warning information R2a.

[0095] In this manner, according to this embodiment, the management terminal 130 or the staff terminal 120 can receive warning information in the order of the blocks with the greatest number of people not wearing masks. Therefore, the manager U2 and stadium staff U1 can know the blocks with the highest priority for calling out to people. Therefore, the stadium staff U1 can call out to people in a way that effectively reduces the risk of infection with infectious diseases.

[0096] <Embodiment 6> The sixth embodiment is a modified example of the second to fifth embodiments described above. In the sixth embodiment, warning information is once notified, and then a notification is made according to the initially detected spectator's situation. For example, the acquisition unit according to the sixth embodiment acquires a second captured image in which the (same) spectator area is captured after the warning information is notified. Then, if a spectator detected as a non-wearer in the first captured image is not detected as a non-wearer in the second captured image, the notification unit may notify the information terminal of that fact. This allows the stadium staff U1 to know that a spectator puts a mask back on after removing the mask once, and therefore to stop calling out to the spectator. This can prevent excessive calling out to the spectator and reduce the burden on the stadium staff U1.

[0097] Moreover, the acquisition unit according to the sixth embodiment acquires a third captured image in which the (same) spectator area is captured after the warning information is notified. The second captured image and the third captured image may be the same. The detection unit detects that a spectator detected as a non-mask wearer in the first captured image has moved from a specified partial area in the third captured image. At this time, the notification unit may notify the information terminal of the detection of the movement. This allows the information terminal to be notified that a spectator has left their seat with their mask removed. Therefore, the stadium staff U1 can call out to the spectator with higher priority.

[0098] In this case, the identification unit may further identify the location of the spectator whose movement has been detected after the spectator has moved. At this time, the notification unit may notify the information terminal of the identified location after the spectator has moved. This allows the spectator's nearest location to be notified even when the mask is removed. Therefore, the stadium staff U1 can track the spectator and call out to him / her. This reduces the burden on the stadium staff U1.

[0099] Incidentally, the overall configuration and the configuration of the audience monitoring device of this embodiment 6 are the same as those in FIG. 3 and FIG. 8, so they are not shown in the figures, and the following will explain the differences.

[0100] Fig. 23 is a flowchart showing the flow of spectator monitoring processing according to this embodiment 6. Note that the same processes as those in Fig. 9 are given the same reference numerals. As a premise, for example, it is assumed that a non-wearer has already been detected in the spectator area 101 and warning information has been notified by the processing in Fig. 9. It is also assumed that the spectator monitoring device 300 has stored in memory 320 the spectator ID or seat position (as well as the time of detection or notification) of the detected non-wearer.

[0101] After that, the camera 110 again captures an image in the shooting direction of the spectator area 101, and transmits the captured image and the shooting direction to the spectator monitoring device 300 via the network N. In response to this, the acquisition unit 342 acquires the (second and third) captured images and the shooting direction from the camera 110 via the network N (S41).

[0102] Next, the detection unit 343 determines whether or not a person not wearing a mask was detected in the previously captured image in the acquired shooting direction (S61). For example, the detection unit 343 refers to the memory 320 and determines whether or not a person not wearing a mask was detected in the previously captured image in the spectator area 101. Furthermore, if it is determined that a person was detected, the detection unit 343 identifies the spectator ID or seat position of the detected non-mask wearer.

[0103] If it is determined that a person not wearing a mask was detected last time (YES in step S61), the detection unit 343 determines whether or not the person not wearing a mask last time has been detected as a person wearing a mask in the current captured image (S62). For example, the detection unit 343 detects a person not wearing a mask in the captured image in the same manner as in step S42, and if detected, determines whether or not the detected person is present in the seat position identified above. Alternatively, the detection unit 343 may determine whether or not the face area in the seat position identified above in the captured image is a person not wearing a mask.

[0104] If the person who was not wearing a mask last time is detected as wearing a mask this time (YES in step S62), the notification unit 346 notifies the management terminal 130 or the staff terminal 120 that the person who was not wearing a mask last time has since put on a mask (and therefore there is no need to call out to them, etc.) (S63).

[0105] If the previous non-wearer is also detected as a non-wearer this time (NO in step S62), the detection unit 343 determines whether the previous non-wearer has moved (S64). For example, the detection unit 343 performs tracking using face recognition on the non-wearer and identifies the position of the non-wearer (spectator) after the movement (S65). At this time, the detection unit 343 may track (measure, detect, identify) the movement of the non-wearer by performing face recognition with multiple cameras. Then, the notification unit 346 notifies the management terminal 130 or the staff terminal 120 of the position of the non-wearer after the movement (S66).

[0106] If it is determined that no person not wearing a mask was detected last time (NO in step S61), the audience monitoring device 300 performs steps S42 to S45, similar to Fig. 9. Note that steps S42 to S45 may be performed regardless of the determination result of step S61.

[0107] In this manner, in the sixth embodiment, warning information is first notified, and then a notification is made according to the initially detected situation of the spectator, allowing the stadium staff U1 to take appropriate action. For example, excessive calling out to spectators who put masks back on can be suppressed. Also, if a non-mask wearer moves, the stadium staff U1 can call out to the spectator as a priority. In particular, at that time, the stadium staff U1 can grasp the location of the non-mask wearer's destination, and can call out to the spectator effectively. These also reduce the burden on the stadium staff U1.

[0108] <Embodiment 7> The seventh embodiment is a modification of the above-mentioned second to sixth embodiments. In the seventh embodiment, a biometric authentication function is built into the spectator monitoring device. The spectator monitoring system according to the seventh embodiment is similar to the above-mentioned spectator monitoring system 1000 in which the authentication device 200 is built into the spectator monitoring device 300c, and therefore illustrations and explanations thereof are omitted.

[0109] 24 is a block diagram showing the configuration of an audience monitoring device 300c according to the seventh embodiment. Compared to the above-mentioned audience monitoring device 300, the memory unit 310 of the audience monitoring device 300c is different in that the program 311 is replaced by a program 311a, and facial feature information 316 is associated with an audience ID 312. Also, compared to the above-mentioned audience monitoring device 300, the control unit 340 of the audience monitoring device 300c is different in that the authentication control unit 344 is replaced by an authentication control unit 344c.

[0110] The program 311a is a computer program in which the processing of the audience monitoring method according to the seventh embodiment is implemented.

[0111] The facial feature information 316 corresponds to the facial feature information 212 of the above-mentioned authentication device 200. The facial feature information 316 is associated with a visitor ID 312 (user identification information). In other words, the storage unit 310 includes the above-mentioned facial information DB 210.

[0112] The authentication control unit 344c controls face authentication by comparing face feature information of multiple people with face feature information of a person not wearing a mask. That is, the authentication control unit 344c performs face authentication by comparing face feature information extracted from the face area of ​​the detected non-wearer with face feature information 316 stored in the storage unit 310, and obtains a face authentication result.

[0113] In this embodiment, step 441 in FIG. 9 described above is replaced with face authentication processing in the audience monitoring device 300c by the authentication control unit 344c.

[0114] In this way, the seventh embodiment can achieve the same effects as those of the second embodiment described above. Therefore, by making similar improvements to the audience monitoring devices according to the third to sixth embodiments, the same effects as those of the third to sixth embodiments can be achieved.

[0115] <Other embodiments> In the above embodiment, the present disclosure has been described as a hardware configuration, but is not limited to this. Any process of the present disclosure can be realized by causing a CPU to execute a computer program.

[0116] In the above example, the program can be stored and provided to the computer using various types of non-transitory computer readable media. The non-transitory computer readable media includes various types of tangible storage media. Examples of the non-transitory computer readable media include magnetic recording media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (e.g., magneto-optical disks), CD-ROM (Read Only Memory), CD-R, CD-R / W, DVD (Digital Versatile Disc), and semiconductor memory (e.g., mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (Random Access Memory)). The program may also be provided to the computer by various types of transitory computer readable media. Examples of the transitory computer readable media include electric signals, optical signals, and electromagnetic waves. The transitory computer readable media can provide the program to the computer via a wired communication path such as an electric wire and an optical fiber, or via a wireless communication path.

[0117] The present disclosure is not limited to the above-described embodiment, and may be modified as appropriate without departing from the spirit and scope of the present disclosure. In addition, the present disclosure may be implemented by appropriately combining the respective embodiments.

[0118] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes. (Appendix A1) An acquisition means for acquiring a first captured image of an audience area including a plurality of audience members in a predetermined facility; A detection means for detecting a non-wearer who is a spectator not wearing a mask from the first captured image; A means for identifying a partial area including the non-wearer in the spectator area; a notification means for notifying an information terminal of an operation staff member of the facility of warning information regarding the specified partial area; An audience monitoring device comprising: (Appendix A2) The identification means identifies a seat position of the non-wearer as the partial area. 13. An audience monitoring device as described in Appendix A1. (Appendix A3) The identification means identifies the seat position based on a photographing direction of a photographing device that photographed the first photographed image and a detected position of the non-wearer in the first photographed image. 13. An audience monitoring device as described in Appendix A2. (Appendix A4) a registration means for registering in a storage means identification information corresponding to the facial feature information of each of the plurality of spectators in association with a seat position; An authentication control means for controlling face authentication by referring to the storage means based on a face area of ​​the non-wearer in the first captured image; Further equipped with The identification means identifies, as the partial area, a seat position associated with a non-wearing spectator who has succeeded in the face authentication. 13. An audience monitoring device as described in Appendix A2. (Appendix A5) The device further includes a determination unit for determining whether a predetermined condition is satisfied when the non-wearer is detected, The notification means notifies the warning information when it is determined that the predetermined condition is satisfied. An audience monitoring device according to any one of appendices A1 to A4. (Appendix A6) A first measuring means for measuring an index value relating to non-wearing of the mask when the non-wearing person is detected, The determining means determines whether or not the index value satisfies the predetermined condition. 13. A crowd monitoring device as described in Appendix A5. (Appendix A7) The first measuring means measures a non-wearing time during which the non-wearer is not wearing a mask as the index value, The determining means determines that the predetermined condition is satisfied when the non-wearing time exceeds a predetermined time. 13. A crowd monitoring device as described in Appendix A6. (Appendix A8) The first measurement means measures, as the index value, the number of times a specific spectator is detected as a non-wearer from a plurality of captured images captured a plurality of times of the spectator area; The determining means determines that the predetermined condition is satisfied when the number of detections exceeds a predetermined number. 13. A crowd monitoring device as described in Appendix A6. (Appendix A9) The first measurement means measures the number of non-wearers detected in the spectator area as the index value, The determining means determines that the predetermined condition is satisfied when the number of detected people exceeds a predetermined number. 13. A crowd monitoring device as described in Appendix A6. (Appendix A10) The first measurement means measures the congestion state of the spectator area as the index value when the non-wearer is detected, The determining means determines that the predetermined condition is satisfied when the congestion state exceeds a predetermined level. 13. A crowd monitoring device as described in Appendix A6. (Appendix A11) The determining means determines that the predetermined condition is satisfied when the detected non-wearer is not eating or drinking. 13. A crowd monitoring device as described in Appendix A5. (Appendix A12) The determining means determines that the specified condition is satisfied when the specified partial area is a designated area where wearing of a mask is required. 13. A crowd monitoring device as described in Appendix A5. (Appendix A13) A second measuring means for measuring an index value relating to non-wearing of the mask when the non-wearer is detected; and determining means for determining warning information indicating a level of warning according to the index value, The notification means notifies the determined warning information. An audience monitoring device according to any one of appendices A1 to A4. (Appendix A14) The second measuring means measures a non-wearing time during which the non-wearer is not wearing a mask as the index value, The determining means determines the warning information according to the non-wearing time. 13. A crowd monitoring device as described in Appendix A13. (Appendix A15) The second measurement means measures, as the index value, the number of times a specific spectator is detected as a non-wearer from a plurality of captured images taken a plurality of times of the spectator area; The determining means determines the warning information according to the number of times of detection. 13. A crowd monitoring device as described in Appendix A13. (Appendix A16) The second measurement means measures the number of non-wearers detected in the spectator area as the index value, The determining means determines the warning information according to the number of detected people. 13. A crowd monitoring device as described in Appendix A13. (Appendix A17) The second measurement means measures the congestion state of the spectator area as the index value when the non-wearer is detected, The determining means determines the warning information according to the congestion state. 13. A crowd monitoring device as described in Appendix A13. (Appendix A18) Further, a third measurement means is provided for measuring the number of non-wearers detected for each of a plurality of partial areas within the spectator area, The identification means identifies a partial area having a larger number of detected people among the plurality of partial areas, The notification means notifies the specified partial area of ​​the warning information with priority. An audience monitoring device according to any one of appendices A1 to A4. (Appendix A19) The acquisition means acquires a second captured image of the spectator area after the warning information is notified, When a spectator detected as the non-wearer in the first captured image is not detected as the non-wearer in the second captured image, the notification means notifies the information terminal of that effect. An audience monitoring device according to any one of appendices A1 to A18. (Appendix A20) The acquisition means acquires a third captured image of the spectator area after the warning information is notified, The detection means detects that the spectator detected as the non-wearer in the first captured image has moved from the identified partial area in the third captured image; The notification means notifies the information terminal of the fact that the movement has been detected. An audience monitoring device according to any one of appendices A1 to A19. (Appendix A21) The identification means identifies a position of the spectator after the movement of the spectator whose movement has been detected, The notification means notifies the information terminal of the specified position after the movement. 13. An audience monitoring device as described in Appendix A20. (Appendix A22) The notification means further notifies the warning information to a predetermined output device in the facility. An audience monitoring device according to any one of appendices A1 to A21. (Appendix B1) An imaging device that images an audience area including a plurality of audience members in a predetermined facility; an audience monitoring device connected to the imaging device; Equipped with The audience monitoring device comprises: An acquisition means for acquiring a first captured image captured by the imaging device; A detection means for detecting a non-wearer who is a spectator not wearing a mask from the first captured image; A means for identifying a partial area including the non-wearer in the spectator area; a notification means for notifying an information terminal of an operation staff member of the facility of warning information regarding the specified partial area; A spectator monitoring system. (Appendix B2) The identification means identifies a seat position of the non-wearer as the partial area. 13. A spectator monitoring system as described in Appendix B1. (Appendix C1) The computer A first photographed image is obtained in which a spectator area including a plurality of spectators in a predetermined facility is photographed; Detecting a non-mask-wearing spectator who is not wearing a mask from the first captured image; Identifying a partial area of ​​the spectator area including the non-wearer; notifying an information terminal of an operation staff member of the facility of warning information regarding the specified partial area; Audience monitoring methods. (Appendix D1) An acquisition process for acquiring a first captured image of an audience area including a plurality of audience members in a predetermined facility; A detection process for detecting non-wearers, which are spectators not wearing masks, from the first captured image; A process of identifying a partial area including the non-wearer in the spectator area; a notification process for notifying an information terminal of an operation staff member of the facility of warning information regarding the specified partial area; A non-transitory computer-readable medium having stored thereon an audience monitoring program that causes a computer to execute the above.

[0119] Although the present invention has been described above with reference to the embodiments (and examples), the present invention is not limited to the above-mentioned embodiments (and examples). Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. [Explanation of symbols]

[0120] 1. Spectator monitoring equipment 11 Acquisition Department 12 Detection unit 13 Specific section 14 Notification Department 1000 Spectator Monitoring System 100 Stadium 101 Spectator Area 1011 Block 101i Block 10n Spectator Area 10n1 Block 10nj Block 110 Camera 110a Camera 110b Camera 120 Staff Terminal 130 Management terminal 200 Authentication Device 210 Face Information DB 211 User ID 212 Facial Feature Information 220 Face detection unit 230 Feature Point Extraction Unit 240 Registration Department 250 Authentication Department 300 Spectator monitoring device 300a Spectator monitoring device 300b Spectator monitoring device 300c Spectator Monitoring Device 310 Storage section 311 Program 311a Program 311b Program 311c Program 312 Spectator ID 313 Seat Location 314 Shooting Direction 315 Spectator Area 3151 Block 31511 Seat position 3151k seat location 315i Block 316 Facial Feature Information 320 Memory 330 IF Section 340 Control Unit 341 Registration Department 342 Acquisition Department 343 Detection Unit 344 Authentication control section 344c Authentication control section 345 Specific part 346 Notification Department 347 Measuring section 348 Judgment section 349 Decision Section R0 Warning Information R1 Warning Information R11 warning information R1a Warning Information R1b warning information R1c Warning Information R1d Warning Information R2a Warning Information R2b warning information N Network U1 Stadium Staff U2 Administrator

Claims

1. An acquisition means for acquiring a first captured image of an audience area including a plurality of audience members in a predetermined facility; A detection means for detecting a non-wearer who is a spectator not wearing a mask from the first captured image; A means for identifying a partial area including the non-wearer in the spectator area; a notification means for notifying an information terminal of an operation staff member of the facility of warning information regarding the specified partial area; An audience monitoring device comprising:

2. The identification means identifies a seat position of the non-wearer as the partial area.

2. An audience monitoring device according to claim 1.

3. The identification means identifies the seat position based on a photographing direction of a photographing device that photographed the first photographed image and a detected position of the non-wearer in the first photographed image.

3. An audience monitoring device according to claim 2.

4. a registration means for registering in a storage means identification information corresponding to the facial feature information of each of the plurality of spectators in association with a seat position; An authentication control means for controlling face authentication by referring to the storage means based on a face area of ​​the non-wearer in the first captured image; Further equipped with The identification means identifies, as the partial area, a seat position associated with a non-wearing spectator who has succeeded in the face authentication.

3. An audience monitoring device according to claim 2.

5. The device further includes a determination unit for determining whether a predetermined condition is satisfied when the non-wearer is detected, The notification means notifies the warning information when it is determined that the predetermined condition is satisfied. An audience monitoring device according to any one of claims 1 to 4.

6. A first measuring means for measuring an index value relating to non-wearing of the mask when the non-wearer is detected, The determining means determines whether or not the index value satisfies the predetermined condition.

6. An audience monitoring device according to claim 5.

7. The first measuring means measures a non-wearing time during which the non-wearer is not wearing a mask as the index value, The determining means determines that the predetermined condition is satisfied when the non-wearing time exceeds a predetermined time. An audience monitoring device according to claim 6.

8. The first measurement means measures, as the index value, the number of times a specific spectator is detected as a non-wearer from a plurality of captured images captured a plurality of times of the spectator area; The determining means determines that the predetermined condition is satisfied when the number of detections exceeds a predetermined number. An audience monitoring device according to claim 6.

9. The first measurement means measures the number of non-wearers detected in the spectator area as the index value, The determining means determines that the predetermined condition is satisfied when the number of detected people exceeds a predetermined number. An audience monitoring device according to claim 6.

10. The first measurement means measures a congestion state of the spectator area as the index value when the non-wearer is detected, The determining means determines that the predetermined condition is satisfied when the congestion state exceeds a predetermined level. An audience monitoring device according to claim 6.

11. The determining means determines that the predetermined condition is satisfied when the detected non-wearer is not eating or drinking.

6. An audience monitoring device according to claim 5.

12. The determining means determines that the specified condition is satisfied when the specified partial area is a designated area where wearing of a mask is required.

6. An audience monitoring device according to claim 5.

13. A second measuring means for measuring an index value relating to non-wearing of the mask when the non-wearer is detected; and determining means for determining warning information indicating a level of warning according to the index value, The notification means notifies the determined warning information. An audience monitoring device according to any one of claims 1 to 4.

14. The second measuring means measures a non-wearing time during which the non-wearer is not wearing a mask as the index value, The determining means determines the warning information according to the non-wearing time. An audience monitoring device according to claim 13.

15. The second measurement means measures, as the index value, the number of times a specific spectator is detected as a non-wearer from a plurality of captured images captured a plurality of times of the spectator area; The determining means determines the warning information according to the number of times of detection. An audience monitoring device according to claim 13.

16. The second measurement means measures the number of non-wearers detected in the spectator area as the index value, The determining means determines the warning information according to the number of detected people. An audience monitoring device according to claim 13.

17. The second measurement means measures a congestion state of the spectator area as the index value when the non-wearer is detected, The determining means determines the warning information according to the congestion state. An audience monitoring device according to claim 13.

18. Further comprising a third measurement means for measuring the number of non-wearers detected for each of a plurality of partial areas within the spectator area; The identification means identifies a partial area having a larger number of detected people among the plurality of partial areas, The notification means notifies the specified partial area of ​​the warning information with priority. An audience monitoring device according to any one of claims 1 to 4.

19. The acquisition means acquires a second captured image of the spectator area after the warning information is notified, When a spectator detected as the non-wearer in the first captured image is not detected as the non-wearer in the second captured image, the notification means notifies the information terminal of that effect. An audience monitoring apparatus according to any preceding claim.

20. The acquisition means acquires a third captured image of the spectator area after the warning information is notified, The detection means detects that the spectator detected as the non-wearer in the first captured image has moved from the specified partial area in the third captured image; The notification means notifies the information terminal of the fact that the movement has been detected. An audience monitoring apparatus according to any preceding claim.

21. The identification means identifies a position of the spectator after the movement of the spectator whose movement has been detected, The notification means notifies the information terminal of the specified position after the movement.

21. An audience monitoring device according to claim 20.

22. The notification means further notifies the warning information to a predetermined output device in the facility. An audience monitoring apparatus according to any preceding claim.

23. An imaging device that images an audience area including a plurality of audience members in a predetermined facility; an audience monitoring device connected to the imaging device; Equipped with The audience monitoring device comprises: An acquisition means for acquiring a first photographed image photographed by the photographing device; A detection means for detecting a non-wearer who is a spectator not wearing a mask from the first captured image; A means for identifying a partial area including the non-wearer in the spectator area; a notification means for notifying an information terminal of an operation staff member of the facility of warning information regarding the specified partial area; A spectator monitoring system.

24. The identification means identifies a seat position of the non-wearer as the partial area.

24. An audience monitoring system according to claim 23.

25. The computer A first photographed image is obtained by photographing an audience area including a plurality of audience members in a predetermined facility; Detecting a non-mask-wearing spectator who is not wearing a mask from the first captured image; Identifying a partial area of ​​the spectator area including the non-wearer; notifying an information terminal of an operation staff member of the facility of warning information regarding the specified partial area; Audience monitoring methods.

26. An acquisition process for acquiring a first captured image of an audience area including a plurality of audience members in a predetermined facility; A detection process for detecting non-wearers, which are spectators not wearing masks, from the first captured image; A process of identifying a partial area including the non-wearer in the spectator area; a notification process for notifying an information terminal of an operation staff member of the facility of warning information regarding the specified partial area; A crowd monitoring program that causes a computer to execute the following:

Citation Information

Patent Citations

  • Device, method and program for estimating spectator status

    JP2004032424A

  • Intercom system

    JP2006285504A

  • Pollinosis information providing system and pollinosis information providing method

    JP2008102784A

  • Image processing system, image processing method, and image processing program

    JP2015019296A

  • Infection risk identification system, information terminal, and infection risk identification method

    JP2020067939A