Processing device, processing method, and program

Abstract

To improve accuracy in detecting a person being in a psychological tension state based on a pulse.SOLUTION: A processing device includes an acquisition section, an image analysis section, a determination section, and a control section. The acquisition section acquires an image obtained by photographing a person. The image analysis section performs biometric authentication and pulse measurement of the person based on the image. The determination section determines whether a state of the person satisfies a warning condition based on a reference pulse registered in association with identification information of the person identified by the biometric authentication and also based on the pulse measured by the pulse measurement. The control section executes warning processing when the state of the person satisfies the warning condition.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to a processing device, a processing method, and a program. [Background technology]

[0002] A technology related to this disclosure is disclosed in Patent Document 1. Patent Document 1 discloses a technology for measuring a subject's heart rate and heart rate variability through image analysis without contacting the subject, and estimating the subject's psychological tension state from the measurement results. Patent Document 1 also discloses that this technology can be used in airports and commercial facilities to estimate a person's risk level (attention level) from the estimated psychological tension state. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2023-36691 Summary of the Invention [Problem to be solved by the invention]

[0004] This disclosure aims to improve upon prior art such as that disclosed in US Pat. No. 6,239,999. [Means for solving the problem]

[0005] According to this disclosure: an acquisition means for acquiring an image of a person; an image analysis means for performing biometric authentication and pulse measurement of the person based on the image; a determination means for determining whether the state of the person satisfies a warning condition based on a reference pulse rate registered in association with the identification information of the person identified by the biometric authentication and the pulse rate measured by the pulse measurement; a control means for performing a warning process when the state of the person satisfies the warning condition; A processing device is provided having:

[0006] Also, according to this disclosure: One or more computers Acquire an image of a person, Based on the image, biometric authentication and pulse measurement of the person are performed; determining whether the state of the person satisfies a warning condition based on a reference pulse rate registered in association with the identification information of the person identified by the biometric authentication and the pulse rate measured by the pulse measurement; A processing method is provided for performing a warning process when the state of the person satisfies the warning condition.

[0007] Also, according to this disclosure: Computer, an acquisition means for acquiring an image of a person; an image analysis means for performing biometric authentication and pulse measurement of the person based on the image; a determination means for determining whether the state of the person satisfies a warning condition based on a reference pulse registered in association with the identification information of the person identified by the biometric authentication and the pulse measured by the pulse measurement; a control means for performing a warning process when the state of the person satisfies the warning condition; A program is provided to function as a [Effects of the Invention]

[0008] According to one aspect of the present disclosure, an improvement over the prior art is achieved. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 2 is a diagram illustrating an example of a functional block diagram of a processing device. [Figure 2] 10 is a flowchart illustrating an example of a processing flow of the processing device. [Figure 3] FIG. 2 is a diagram illustrating an example of a hardware configuration of a processing device. [Figure 4] FIG. 2 is a diagram schematically illustrating an example of information processed by a processing device. [Figure 5]10 is a flowchart showing another example of the processing flow of the processing device. [Figure 6] 10 is a flowchart showing another example of the processing flow of the processing device. [Figure 7] FIG. 10 is a diagram schematically illustrating another example of information processed by the processing device. [Figure 8] FIG. 10 is a diagram schematically illustrating another example of information processed by the processing device. [Figure 9] 10 is a flowchart showing another example of the processing flow of the processing device. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. In this disclosure, the drawings relate to one or more embodiments. In all drawings, similar components are designated by similar reference numerals, and descriptions thereof will be omitted as appropriate.

[0011] <<First embodiment>> Fig. 1 is a functional block diagram showing an overview of a processing device 10. As shown in Fig. 1, the processing device 10 has an acquisition unit 11, an image analysis unit 12, a determination unit 13, and a control unit 14. These functional units execute the processing of the flowchart in Fig. 2.

[0012] In S10, the acquisition unit 11 acquires an image of a person. In S11, the image analysis unit 12 performs biometric authentication and pulse measurement of the person based on the image acquired in S11. In S12, the judgment unit 13 judges whether the state of the person satisfies the warning condition based on the reference pulse rate registered in association with the identification information of the person identified by biometric authentication and the pulse rate measured by pulse measurement. In S13, the control unit 14 performs a warning process if the state of the person satisfies the warning condition.

[0013] In this way, the processing device 10 determines whether the person's condition satisfies the warning condition, i.e., whether the person is in a state of psychological tension, based on the "reference pulse associated with the person and registered" and the person's pulse measured by pulse measurement. However, pulse rates vary from person to person. Therefore, if the above determination is made using a "reference pulse common to all people," the accuracy of the determination will be poor. However, if the processing device 10 makes the above determination using a "reference pulse for each person," the accuracy of the determination will be improved.

[0014] Furthermore, the processing device 10 makes the above determination using "a reference pulse registered in association with the identification information of a person identified by biometric authentication." That is, the processing device 10 reads out a person's reference pulse based on the result of the person's biometric authentication. Such a processing device 10 can prevent the inconvenience of erroneously reading out another person's reference pulse, resulting in poor accuracy of the above determination. In other words, the processing device 10, which accurately reads out a person's reference pulse based on the result of biometric authentication, improves the accuracy of the above determination.

[0015] The processing device 10 also performs biometric authentication and pulse measurement of a person based on an image of the person. The processing device 10 then determines the state of the person based on the result of the pulse measurement. In recent years, biometric authentication has been performed in various situations, such as when entering and exiting a facility. In addition to such biometric authentication, the processing device 10 can also determine the state of the person (whether the person is in a psychologically tense state, etc.) by further using the image used in the biometric authentication.

[0016] Furthermore, providing separate input devices for biometric authentication and pulse measurement can result in inconveniences such as increased costs and a large installation space. However, with the processing device 10 that performs both biometric authentication and pulse measurement based on a photographed image of a person, it is sufficient to install a camera. This processing device 10 can reduce these inconveniences.

[0017] <<Second embodiment>> <Summary> The processing apparatus 10 of the second embodiment is a specific embodiment of the configuration of the processing apparatus 10 of the first embodiment, which will be described in detail below.

[0018] <Hardware configuration> First, an example of the hardware configuration of the processing device 10 will be described. Each functional unit of the processing device 10 is realized by any combination of hardware and software. Those skilled in the art will understand that there are many variations in the realization method and device. The software includes programs that are pre-loaded in the device before shipping, and programs downloaded from recording media such as CDs (Compact Discs) or servers on the Internet.

[0019] FIG. 3 is a block diagram illustrating an example of the hardware configuration of a processing device 10. As shown in FIG. 3, the processing device 10 has a processor 1A, a memory 2A, an input / output interface 3A, a peripheral circuit 4A, and a bus 5A. The peripheral circuit 4A includes various modules. The processing device 10 does not necessarily have to have the peripheral circuit 4A. Note that the processing device 10 may be composed of multiple devices that are physically and / or logically separated. In this case, each of the multiple devices may have the above hardware configuration.

[0020] The bus 5A is a data transmission path for the processor 1A, memory 2A, peripheral circuit 4A, and input / output interface 3A to mutually transmit and receive data. The processor 1A is, for example, a central processing unit (CPU) or a graphics processing unit (GPU). The memory 2A is, for example, a random access memory (RAM) or a read-only memory (ROM). The input / output interface 3A includes interfaces for acquiring information from input devices, external devices, external servers, external sensors, cameras, etc., and interfaces for outputting information to output devices, external devices, external servers, etc. The input / output interface 3A also includes an interface for connecting to a communication network such as the Internet. Examples of input devices include a keyboard, mouse, microphone, physical buttons, and touch panel. Examples of output devices include a display, projector, speaker, printer, and mailer. The processor 1A can issue commands to each module and perform calculations based on the results of those calculations.

[0021] <Usage scenario> The processing device 10 of the second embodiment detects suspicious individuals based on the results of pulse measurement when they exit a facility. More specifically, the processing device 10 measures the pulse of each person entering the facility and registers the pulse as reference information. Then, the processing device 10 measures the pulse of each person exiting the facility when they exit, and detects suspicious individuals based on each measurement result and each reference information.

[0022] Such a processing device 10 can detect suspicious individuals who may be in a state of psychological tension when leaving the facility, such as individuals attempting to remove prohibited items that are prohibited from being removed from the facility.

[0023] <Functional configuration> Next, the functional configuration of the processing device 10 will be described in detail. Fig. 1 shows an example of a functional block diagram of the processing device 10. As shown in the figure, the processing device 10 has an acquisition unit 11, an image analysis unit 12, a determination unit 13, and a control unit 14. Below, the processing executed by these functional units will be described separately for when entering a facility and when leaving the facility.

[0024] When entering the facility The acquisition unit 11 acquires an image of a person who is about to enter a facility, taken at the time of entrance to the facility.

[0025] Facilities include, but are not limited to, businesses, schools, commercial facilities, public facilities, residential facilities, buildings, and the like.

[0026] A camera is installed at the entrance to the facility. The camera may detect visible light and create an image. Alternatively, the camera may detect infrared light and create an image. Alternatively, the camera may detect other electromagnetic waves and create an image. Alternatively, the camera may have two or more of the following functions: a function to detect visible light and create an image, a function to detect infrared light and create an image, and a function to detect other electromagnetic waves and create an image.

[0027] The camera may generate moving images or may continuously generate multiple still images in time series. The camera and processing device 10 are connected to each other so that they can communicate with each other. The camera transmits the generated images to the processing device 10 in real time processing. The acquisition unit 11 acquires the "images of a person attempting to enter a facility taken at the time of entry into the facility" transmitted by the camera.

[0028] The processing device 10 measures the person's pulse based on the image generated by the camera. To measure the pulse, a predetermined length of image capture is required. Therefore, a person attempting to enter a facility must stop in front of the camera for a certain period of time to have their face captured by the camera. In this case, a display may be installed near the camera. The processing device 10 may then display facility information, advertisements, etc. on the display while capturing the image of the person attempting to enter. This allows the time spent in front of the camera to be used to provide useful information.

[0029] The image analysis unit 12 measures the pulse of the person based on the image acquired by the acquisition unit 11. Then, the image analysis unit 12 associates the measured pulse with the person and stores it in a storage device. The pulse stored in this manner and associated with the person becomes the reference pulse for each person. The storage device may be provided within the processing device 10, or may be provided in an external device communicatively connected to the processing device 10.

[0030] Fig. 4 shows an example of information stored in the storage device by the image analysis unit 12. In the example shown in Fig. 4, personal identification information, the entry time, and the pulse rate measured at the time of entry are registered in association with each other.

[0031] Image-based pulse measurement can be realized using any well-known technology. In recent years, there have been technologies for measuring pulse (heart rate) without contact using iris images or face images. The image analysis unit 12 uses such technologies to measure a person's pulse based on the image acquired by the acquisition unit 11. For example, the image analysis unit 12 may employ a technology for measuring pulse based on changes in facial color. Alternatively, the image analysis unit 12 may employ a technology for measuring pulse based on irises, such as that disclosed in Patent Document 1.

[0032] Next, a method for determining personal identification information of a person to which a measured pulse is to be linked will be described. The image analysis unit 12 can adopt any of the following first to third determination examples.

[0033] ○First decision example In the first determination example, only those who have successfully passed the biometric authentication are permitted to enter the facility. Then, the image analysis unit 12 identifies the person's personal identification information based on the result of the biometric authentication. The image analysis unit 12 associates the person's pulse rate measured based on the image acquired by the acquisition unit 11 with the personal identification information identified by the biometric authentication based on the image, and registers the information (see FIG. 4).

[0034] "Biometric authentication" is an authentication process based on an image of a person's face. Examples of biometric authentication are face authentication and iris authentication. The image analysis unit 12 can perform biometric authentication using any well-known technology. For example, personal information about each person who is allowed to enter the facility is stored in advance in a storage device. The storage device may be provided within the processing device 10, or may be provided in an external device communicably connected to the processing device 10.

[0035] The personal information includes at least personal identification information for distinguishing between multiple people who are permitted to enter the facility, and biometric information of each person. The biometric information is information used for biometric authentication. Examples of the biometric information include, but are not limited to, face information (face image, features of facial appearance, etc.) and iris information (iris image, features of iris appearance, etc.).

[0036] The image analysis unit 12 performs biometric authentication by comparing the image acquired by the acquisition unit 11 with personal information of each person permitted to enter the facility. If biometric information that matches the biometric information extracted from the image acquired by the acquisition unit 11 has been registered in advance as personal information, the image analysis unit 12 determines that the authentication has been successful. On the other hand, if biometric information that matches the biometric information extracted from the image acquired by the acquisition unit 11 has not been registered in advance as personal information, the image analysis unit 12 determines that the authentication has failed.

[0037] If the biometric authentication is successful, the control unit 14 may perform a process to permit the person to pass through the entrance of the facility. For example, the control unit 14 may send information indicating that the person is to pass through the entrance of the facility to a control device of a mechanism (door D, gate, etc.) that controls the person's passage. The control device unlocks or opens the door D or opens the gate in response to the information.

[0038] Alternatively, the control unit 14 may cause an output device installed at the entrance of the facility to output information indicating that the person is allowed to pass through the entrance of the facility. If the output device is a display or a projection device, a message or image, such as "OK," indicating that passage through the entrance is permitted may be output from the output device. If the output device is a speaker, a message, such as "OK," indicating that passage through the entrance is permitted, or a sound, such as "ping pong," indicating that passage through the entrance is permitted may be output from the output device. If the output device is a lamp, a lamp of a color, such as a blue lamp, may be lit to indicate that passage through the entrance is permitted.

[0039] On the other hand, if the biometric authentication fails, the control unit 14 performs error processing. For example, the control unit 14 may send information indicating that the biometric authentication failed to a control device of a mechanism (door D, gate, etc.) that controls the passage of a person. The control device locks or closes the door D or closes the gate in response to the information.

[0040] Additionally, if the biometric authentication fails, the control unit 14 may cause an output device installed at the entrance of the facility to output information indicating that the biometric authentication has failed. If the output device is a display or a projection device, a message or image indicating that the biometric authentication has failed, such as "NG," may be output from the output device. Alternatively, if the output device is a speaker, a message indicating that the biometric authentication has failed, such as "NG," or a sound indicating that the biometric authentication has failed, such as a "beep," may be output from the output device. Alternatively, if the output device is a lamp, a lamp of a color indicating that the biometric authentication has failed, such as a red lamp, may be lit.

[0041] ○Second decision example In the second determination example, biometric authentication is not performed when entering the facility. That is, no advance registration of personal information is performed as in the first determination example. In the second determination example, biometric information of the person entering the facility is acquired at the time of entry and stored in a storage device. The storage device may be provided within the processing device 10, or may be provided in an external device communicatively connected to the processing device 10.

[0042] That is, in the second determination example, the image analysis unit 12 issues new personal identification information corresponding to each person detected from the image acquired by the acquisition unit 11. The image analysis unit 12 also extracts biometric information of the person from the image acquired by the acquisition unit 11. The image analysis unit 12 also measures the pulse rate of the person based on the image acquired by the acquisition unit 11.

[0043] Then, the image analysis unit 12 registers the person's biometric information and the person's measured pulse rate in association with the newly issued personal identification information of the person.

[0044] ○Third decision example In the third determination example, the first determination example and the second determination example are combined. That is, the image analysis unit 12 performs biometric authentication based on the image acquired by the acquisition unit 11. If the biometric authentication is successful, the image analysis unit 12 associates the pulse rate of the person measured based on the image acquired by the acquisition unit 11 with the person's identification information specified by the biometric authentication based on the image acquired by the acquisition unit 11 using the method of the first determination example, and registers the information (see FIG. 4).

[0045] On the other hand, if the biometric authentication fails, the image analysis unit 12 registers the person's biometric information and the person's measured pulse rate by linking them to the person's newly issued personal identification information using the method of the second determination example.

[0046] Next, an example of the flow of processing performed by the processing device 10 when entering a facility will be described using the flowchart in Figure 5. Note that the purpose here is to explain the flow of processing. Since the details of each process have been described above, the explanation here will be omitted as appropriate.

[0047] In addition, in this example, the processing device 10 determines the personal identification information of the person to which the measured pulse is linked in the first determination example. That is, personal information of each person who is permitted to enter the facility is stored in advance in the storage device, and only those who have successfully passed biometric authentication based on this personal information are permitted to enter the facility.

[0048] First, the processing device 10 acquires an image of a person entering a facility, taken at the time of the person's entry into the facility (S20). Next, the processing device 10 performs biometric authentication and pulse measurement of the person based on the image acquired in S20 (S21).

[0049] If the biometric authentication is successful (Yes in S22), the processing device 10 registers the pulse measured in S21 as a reference pulse, linking it to the person identified by the biometric authentication (the person's personal identification information) (S23).Then, the processing device 10 performs a process to permit passage through the entrance of the facility (S24).

[0050] On the other hand, if the biometric authentication fails (No in S22), the processing device 10 performs error processing (S25). In this case, the processing device 10 does not register the reference pulse.

[0051] As a modified example, the processing device 10 may perform only biometric authentication in S21 without measuring the pulse. If the biometric authentication is successful (Yes in S22), the processing device 10 may measure the person's pulse and register it as a reference pulse. In this case, the pulse measurement may be performed based on an image generated during the biometric authentication, or may be performed based on an image newly generated after the biometric authentication. In this modified example, if the biometric authentication fails, the pulse measurement is not performed.

[0052] When leaving the facility Returning to FIG. 1, the acquisition unit 11 acquires an image of a person about to leave a facility, taken at the time of the person's exit from the facility.

[0053] A camera is installed at the exit of the facility. The camera may detect visible light and create an image. The camera may also detect infrared light and create an image. The camera may also detect other electromagnetic waves and create an image. The camera may also have two or more of the following functions: a function to detect visible light and create an image, a function to detect infrared light and create an image, and a function to detect other electromagnetic waves and create an image.

[0054] The camera may generate moving images or may continuously generate multiple still images in time series. The camera and processing device 10 are connected to each other so that they can communicate with each other. The camera transmits the generated images to the processing device 10 in real time processing. The acquisition unit 11 acquires the "images taken of a person about to leave the facility at the time of exiting the facility" transmitted by the camera.

[0055] The processing device 10 measures the person's pulse based on the image generated by this camera. To measure the pulse, a predetermined length of image capture is required. Therefore, a person about to leave the facility stops in front of the camera for a certain period of time to have their face captured by the camera. In this case, a display may be installed near the camera. Then, while the processing device 10 is capturing an image of the person about to leave, it may display facility guide information, advertisements, etc. on the display. This makes it possible to use the time that the person stops in front of the camera for a certain period of time to provide useful information.

[0056] The image analysis unit 12 performs biometric authentication and pulse measurement of the person based on the image acquired by the acquisition unit 11.

[0057] When the first determination example is adopted, personal information of each person who is permitted to enter the facility is stored in advance in a storage device, and the image analysis unit 12 performs biometric authentication based on this personal information.

[0058] When the second determination example is adopted, the biometric information of the person who entered the facility is stored in the storage device at the time of entry to the facility. The image analysis unit 12 performs biometric authentication based on the biometric information of the person stored in the storage device at the time of entry to the facility.

[0059] When the third determination example is adopted, personal information of each person who is permitted to enter the facility is stored in advance in the storage device. Furthermore, for a person whose personal information is not stored in advance in the storage device, the biometric information of that person is stored in the storage device when that person enters the facility. The image analysis unit 12 performs biometric authentication based on this information.

[0060] Image-based pulse measurement can be realized using any well-known technology. As described above, there are technologies for measuring pulse (heart rate) without contact using iris images or face images. The image analysis unit 12 uses such technologies to measure the person's pulse based on the image acquired by the acquisition unit 11.

[0061] The determination unit 13 reads from the storage device the reference pulse (pulse at the time of entry) that is registered in association with the personal identification information of the person identified by the biometric authentication at the time of exit. Then, the determination unit 13 determines whether the person's condition satisfies the warning condition based on the reference pulse (pulse at the time of entry) and the pulse measured in the pulse measurement at the time of exit (pulse at the time of exit).

[0062] The warning condition is one of the following: The threshold is a predetermined value. The difference between the reference pulse (pulse at the time of entry) and the pulse measured at the time of exit (pulse at the time of exit) is greater than or equal to the threshold. The rate of change from the reference pulse (pulse at the time of entry) to the pulse measured at the time of exit (pulse at the time of exit) is above the threshold.

[0063] The control unit 14 performs processing according to the result of the biometric authentication and the determination result of the determination unit 13 .

[0064] If the biometric authentication is successful and the state of the person does not satisfy the warning condition, the control unit 14 can perform a process to permit passage through the exit.

[0065] For example, the control unit 14 may transmit information indicating that passage through the exit is permitted to a control device of a mechanism (door D, gate, etc.) that controls the passage of a person. The control device unlocks or opens the door D or the gate in response to the information.

[0066] Alternatively, the control unit 14 may cause an output device installed at an exit of the facility to output information indicating that passage through the exit of the facility is permitted. If the output device is a display or a projection device, a message or image indicating that passage through the exit is permitted, such as "OK," may be output from the output device. If the output device is a speaker, a message indicating that passage through the exit is permitted, such as "OK," or a sound indicating that passage through the exit is permitted, such as "ping pong," may be output from the output device. If the output device is a lamp, a lamp of a color indicating that passage through the exit is permitted, such as a blue lamp, may be lit.

[0067] On the other hand, the control unit 14 can perform error processing in any of the following cases. Biometric authentication failed - The person's condition meets the warning conditions

[0068] As an error processing, the control unit 14 may send information indicating that passage through the exit is not permitted to a control device of a mechanism (door D, gate, etc.) that controls passage of a person. The control device may lock the door D, close the door D, or close the gate in response to the information.

[0069] Alternatively, the control unit 14 may perform a warning process as the error process. As the warning process, the control unit 14 may cause an output device installed at the exit of the facility to output information indicating that the error has occurred. If the output device is a display or a projection device, a message or image indicating that passage through the exit is not permitted, such as "NG," may be output from the output device. Alternatively, if the output device is a speaker, a message indicating that passage through the exit is not permitted, such as "NG," or a sound indicating that passage through the exit is not permitted, such as "Boom," may be output from the output device. Alternatively, if the output device is a lamp, a lamp of a color indicating that passage through the exit is not permitted, such as a red lamp, may be lit.

[0070] Next, an example of the flow of processing performed by the processing device 10 when exiting a facility will be described using the flowchart in Figure 6. Note that the purpose here is to explain the flow of processing. Since the details of each process have been described above, the explanation here will be omitted as appropriate.

[0071] First, the processing device 10 acquires an image of a person exiting a facility (S30), and then performs biometric authentication and pulse measurement of the person based on the image acquired in S30 (S31).

[0072] If the biometric authentication fails (No in S32), the processing device 10 performs error processing (S36).

[0073] On the other hand, if the biometric authentication is successful (Yes in S32), the processing device 10 reads out the reference pulse that is registered in association with the identification information of the person identified by the biometric authentication. Then, the processing device 10 determines whether the person's condition satisfies the warning condition based on the read-out reference pulse and the pulse measured in S31 (S33).

[0074] If the person's condition satisfies the warning condition (Yes in S34), the processing device 10 performs error processing (S36). On the other hand, if the person's condition does not satisfy the warning condition (No in S34), the processing device 10 performs processing to permit passage through the facility exit (S35).

[0075] As a modified example, the processing device 10 may perform only biometric authentication in S31 without measuring the pulse. If the biometric authentication is successful (Yes in S32), the processing device 10 may measure the pulse of the person. In this case, the pulse measurement may be performed based on an image generated during the biometric authentication, or may be performed based on an image newly generated after the biometric authentication. In this modified example, if the biometric authentication fails, the pulse measurement is not performed.

[0076] "Action and effect" According to the processing apparatus 10 of the second embodiment, the same effects as those of the processing apparatus 10 of the first embodiment are achieved.

[0077] Furthermore, the processing device 10 can measure the pulse of each person entering a facility and register the pulse as reference information. Then, when exiting the facility, the processing device 10 can measure the pulse of each person exiting the facility and determine the state of each person based on each measurement result and each reference information. With this type of processing device 10, it is possible to detect suspicious individuals who may be in a state of psychological tension when exiting the facility, such as individuals attempting to remove prohibited items from the facility.

[0078] Furthermore, when biometric authentication is performed upon exiting a facility, the processing device 10 can further use the image used in the biometric authentication to determine the state of the person (whether the person is in a psychologically tense state, etc.).

[0079] <<Third embodiment>> The processing device 10 of the third embodiment causes the mobile terminal carried by the person to perform a predetermined output process (for example, output of a warning sound) as the error process described in the second embodiment. This will be described in detail below.

[0080] A person entering a facility installs a predetermined application on their own mobile device in advance. Then, the person logs in to the application using their own personal identification information. The server of this application manages the logged-in users. Based on the information managed by this server, the processing device 10 causes the mobile device that has logged in using the predetermined personal identification information to perform a predetermined output process. This process can be realized using any widely known technology.

[0081] The application server and the processing device 10 may be physically and / or logically separate devices, or may be the same device. Examples of mobile devices include, but are not limited to, smartphones, tablet devices, mobile phones, smart watches, and laptops.

[0082] As the error processing (warning processing) described in the second embodiment, the control unit 14 causes the logged-in portable terminal to perform a predetermined output processing using the personal identification information of the person specified by biometric authentication. That is, the control unit 14 can cause the portable terminal carried by a person to be notified, such as a person who failed biometric authentication or a person whose state satisfies a warning condition, to perform a predetermined output processing.

[0083] The predetermined output process includes at least one of the following. Note that by making the output process noticeable to people nearby, the presence of the person to be notified can be made known to them. For this reason, it is preferable to output sound from the speaker at a high volume. - Processing to output warning messages such as "NG" or warning sounds such as "Boo" from the speaker -Processing to output warning messages such as "NG" or images on the display - Lighting or blinking the lamp Vibrator vibration process

[0084] After starting the predetermined output process on the portable terminal carried by the person to be notified, the control unit 14 may continue the predetermined output process until a predetermined end timing. The predetermined end timing will be described below.

[0085] The control unit 14 displays a UI screen for performing authentication processing of the attendant on the display of the mobile terminal that is performing a predetermined output processing. The attendant is a person who is positioned at the entrance or exit of the facility and manages entry and exit to the facility. The authentication information of the attendant is registered in advance in the processing device 10. The authentication information may be biometric information or information such as a password or a personal identification number. The biometric information here is information that can be input via the mobile terminal, and examples thereof include, but are not limited to, face information (face image, features of facial appearance, etc.), iris information (iris image, features of iris appearance, etc.), and fingerprint information.

[0086] In this example, the predetermined end timing is the timing when the authentication process of the staff member is successful via the portable terminal performing the predetermined output process. The portable terminal performing the predetermined output process is the portable terminal carried by the person to be notified. In other words, the authentication process of the staff member is performed via the portable terminal carried by the person to be notified.

[0087] When a mobile device carried by a person at the entrance or exit of a facility starts the predetermined output process described above, an attendant rushes to the person. The attendant then performs authentication processing via the mobile device carried by the person to be notified. For example, the attendant enters a password or PIN into the mobile device, photographs the person's face, or enters a fingerprint into the mobile device. The mobile device transmits the input information to the processing device 10. The control unit 14 performs biometric authentication of the attendant based on the received information. If the biometric authentication of the attendant is successful, the control unit 14 transmits information to the mobile device to terminate the predetermined output process. The mobile device terminates the predetermined output process in response to receiving the information.

[0088] In this way, the control unit 14 can cause the portable terminal of the person to be notified to start a predetermined output process, and then acquire authentication information of a predetermined person different from the person to be notified from the portable terminal, and execute authentication processing for the predetermined person based on the acquired authentication information. Then, if the authentication processing for the predetermined person is successful, the control unit 14 can cause the portable terminal to end the predetermined output process.

[0089] In the above example, the predetermined person is an attendant at the entrance or exit of the facility, but it may be any other person.

[0090] Other configurations of the processing apparatus 10 of the third embodiment are similar to those of the processing apparatus 10 of the first and second embodiments.

[0091] The processing device 10 of the third embodiment achieves the same effects as the processing device 10 of the first and second embodiments. Furthermore, the processing device 10 can cause a mobile terminal carried by a person to be notified, such as a person who has failed biometric authentication or a person whose condition satisfies a warning condition, to perform a predetermined output process (e.g., output of a warning sound). Such a processing device 10 can notify people around the person to be notified of their presence. As a result, staff at the entrance or exit of the facility can take appropriate action against the person to be notified.

[0092] Furthermore, the processing device 10 can cause the portable terminal carried by the person to be notified to continue a predetermined output process until biometric authentication of the predetermined person via the portable terminal is successful. Such processing device 10 can prevent the person to be notified from fleeing the scene without being addressed by the predetermined person. For example, if the person to be notified is a person who is trying to take out a prohibited item that is prohibited from being taken out of a facility, the person to be notified can be prevented from taking out the prohibited item.

[0093] <<Fourth embodiment>> In the fourth embodiment, cameras are installed at various locations within the facility in addition to the entrances and exits of the facility, and pulse measurements of people are performed at various locations within the facility. The processing device 10 then uses multiple pulse statistics obtained from multiple pulse measurements as a reference value for each person. This will be described in detail below.

[0094] In the fourth embodiment, a camera is installed at at least one point within the facility in addition to the entrance and exit of the facility. For example, if there are multiple areas or rooms within the facility, a camera may be installed at the entrance and exit of each area or room.

[0095] Alternatively, if the facility is an amusement facility, a terminal with a camera may be installed within the facility as entertainment equipment. A person may operate the terminal to take a picture of themselves, edit the image, or add a frame specific to the facility. The image taken with the terminal may then be stored on a specified server so that the person can download it.

[0096] In this way, the acquisition unit 11 acquires an image of a person taken at at least one point within the facility.

[0097] The image analysis unit 12 performs biometric authentication and pulse measurement based on the image. Then, the image analysis unit 12 stores the measured pulse in a predetermined storage device, linking it to the person (personal identification information) identified by the biometric authentication. The storage device may be provided within the processing device 10, or may be provided in an external device communicably connected to the processing device 10.

[0098] In the fourth embodiment, multiple pulses are stored in association with each person (person identification information). The determination unit 13 uses the statistical value of the multiple pulses as a reference pulse for each person to determine whether the person's condition satisfies the warning condition. The statistical value may be, but is not limited to, an average value, a maximum value, a minimum value, a mode value, a median value, etc.

[0099] The determination unit 13 can determine whether the state of the person at the facility exit satisfies the warning condition. Then, the control unit 14 performs processing according to the result of the biometric authentication and the determination result of the determination unit 13 at the facility exit.

[0100] Alternatively, the determination unit 13 may determine whether the person's condition satisfies the warning condition each time a person is photographed within the facility as described above. Then, the control unit 14 may perform processing according to the result of biometric authentication and the determination result of the determination unit 13 each time a person is photographed within the facility. In this case, the determination unit 13 determines the reference pulse of each person based on the pulse rates that have been stored (accumulated) in association with each person up to that point. If one pulse rate is stored at that time, the determination unit 13 uses that pulse rate as the reference pulse. If multiple pulse rates are stored at that time, the determination unit 13 uses the statistical value of the multiple pulse rates as the reference pulse.

[0101] Other configurations of the processing apparatus 10 of the fourth embodiment are similar to those of the processing apparatus 10 of the first to third embodiments.

[0102] The processing device 10 of the fourth embodiment achieves the same effects as the processing devices 10 of the first to third embodiments. Furthermore, the processing device 10 can measure the pulse of each person at multiple times and use the statistical value of these measurements as the reference pulse of each person. A person's pulse may fluctuate from time to time. The processing device 10, which uses the statistical value of pulses measured at multiple times as the reference pulse of each person, can determine whether the condition of each person satisfies the warning condition based on the more reliable reference pulse.

[0103] <<Fifth Embodiment>> The processing device 10 of the fifth embodiment measures a person's pulse rate based on an image using multiple means. The processing device 10 then uses a statistical value of multiple pulse rates measured by the multiple means as a reference value for each person. This will be described in detail below.

[0104] The image analysis unit 12 measures the pulse of the person using a plurality of means based on the image acquired by the acquisition unit 11. For example, the image analysis unit 12 may employ a technique for measuring the pulse based on changes in facial color. Alternatively, the image analysis unit 12 may employ a technique for measuring the pulse based on the iris, as disclosed in Patent Document 1.

[0105] In the fifth embodiment, pulses measured by a plurality of means are stored, linked to each person (personal identification information). When the configuration of the fourth embodiment is adopted, pulses measured at at least one location within the facility are also stored, linked to each person (personal identification information). That is, a plurality of pulses measured by a plurality of means at each of at least one location within the facility are stored, linked to each person (personal identification information).

[0106] The determination unit 13 uses the statistical values ​​of the plurality of pulse rates as a reference pulse rate for each person to determine whether the person's condition satisfies the warning condition. The statistical values ​​include, but are not limited to, an average value, a maximum value, a minimum value, a mode value, a median value, etc.

[0107] The determination unit 13 can determine whether the state of the person at the facility exit satisfies the warning condition. Then, the control unit 14 performs processing according to the result of the biometric authentication and the determination result of the determination unit 13 at the facility exit.

[0108] The determination unit 13 may determine whether the person's condition satisfies the warning condition based on the pulse rate measured by a predetermined means at the exit of the facility and the reference pulse rate determined as described above.

[0109] Alternatively, the determination unit 13 may determine whether the person's condition satisfies the warning condition based on the statistical values ​​of multiple pulse rates measured by multiple means at the facility exit and the reference pulse rate determined as described above. The statistical values ​​may be, but are not limited to, the average, maximum, minimum, mode, median, etc.

[0110] Other configurations of the processing apparatus 10 of the fifth embodiment are similar to those of the processing apparatus 10 of the first to fourth embodiments.

[0111] The processing device 10 of the fifth embodiment achieves the same effects as the processing devices 10 of the first to fourth embodiments. Furthermore, the processing device 10 can measure the pulse of each person by multiple means and use the statistical value of these as the reference pulse of each person. In this way, the processing device 10, which uses the statistical value of pulses measured by multiple means as the reference pulse of each person, can determine whether the condition of each person satisfies the warning condition based on the more reliable reference pulse.

[0112] <<Sixth embodiment>> The processing device 10 of the sixth embodiment further performs a personal belongings inspection using images used for biometric authentication and pulse measurement, as will be described in detail below.

[0113] The image analysis unit 12 performs a personal belongings inspection in addition to biometric authentication and pulse measurement of the person based on the image acquired by the acquisition unit 11. The personal belongings inspection involves processing to detect certain prohibited items from among the person's belongings. The image analysis unit 12 can perform a personal belongings inspection in addition to biometric authentication and pulse measurement of the person based on images generated by the same camera. Note that the images for biometric authentication and pulse measurement and the images for personal belongings inspection may be images taken at the same time or at different times.

[0114] For example, the camera may capture an image showing the entire body of a person. That is, the person stands in a position where their entire body is captured and has the camera take a picture. The image analysis unit 12 may then perform biometric authentication, pulse measurement, and a baggage inspection based on the image showing the entire body of the person. In this case, the image analysis unit 12 may process the image showing the entire body of the person as is to perform biometric authentication and pulse measurement. Alternatively, the image analysis unit 12 may extract the person's face from the image showing the entire body of the person and generate an enlarged image. The image analysis unit 12 may then perform biometric authentication and pulse measurement based on the image with the enlarged face.

[0115] Alternatively, the camera may capture a close-up image of a person's face and an image of the person's entire body at different times. That is, the person may stand in a position that captures their entire body and have the camera take a picture. At another time, the person may stand in a position that captures a close-up image of their face and have the camera take a picture. Then, the image analysis unit 12 may perform biometric authentication and pulse measurement based on the close-up image of the person's face. The image analysis unit 12 may also perform a baggage inspection based on the image that captures the person's entire body.

[0116] The possession inspection is realized by detecting predetermined prohibited items from within the image. The predetermined prohibited items are registered in advance in the processing device 10. For example, as shown in FIG. 7, prohibited items that are prohibited from being taken out of the facility are registered in the processing device 10 as predetermined prohibited items. The image analysis unit 12 detects such predetermined prohibited items within the image through image analysis.

[0117] The process of detecting a predetermined prohibited object from an image can be realized using any well-known technology. For example, a classifier that has been trained to detect predetermined objects may be used to detect the predetermined prohibited object from an image. Alternatively, image analysis technology such as template matching or feature matching may be used to detect the predetermined prohibited object from an image.

[0118] The predetermined prohibited items may be different for each person. For example, a person who has applied to take out the prohibited items in advance may be allowed to take out the prohibited items. In this case, the contents of the application are stored in a predetermined storage device. The storage device may be provided within the processing device 10 or may be provided in an external device communicably connected to the processing device 10.

[0119] An example of information indicating the details of a prior application stored in a storage device is shown in Figure 8. Figure 8 shows the details of an application in which the removal date is February 9, 2024. This information links personal identification information and the items to be removed.

[0120] After identifying a person (personal identification information) through biometric authentication, the image analysis unit 12 uses the personal identification information as a key to search for prior application details stored in the storage device that specify that date as the removal date. If personal identification information that matches the key is found, the image analysis unit 12 identifies the items to be removed that are linked to the personal identification information. The image analysis unit 12 then performs an inspection of the person's belongings by detecting, from images of the person, all items among the specified prohibited items (see FIG. 7), excluding the identified items.

[0121] As another example, predetermined prohibited objects for each person may be stored in advance in a storage device. The storage device may be provided within the processing device 10, or may be provided in an external device communicably connected to the processing device 10. The predetermined prohibited objects may be different for each person.

[0122] When the image analysis unit 12 identifies a person (personal identification information) through biometric authentication, it reads information indicating predetermined prohibited items that is linked to the person's identification information and stored in the storage device.The image analysis unit 12 then performs an inspection of the person's belongings by detecting the predetermined prohibited items indicated by the read information from an image of the person.

[0123] A rule may be established in advance that only transparent bags or purses are allowed to be brought into the facility by people entering the facility. If such a rule is in place, the above-described image analysis-based bag inspection can detect fraudulent acts such as hiding certain prohibited items in a bag or purse. In this case, the image analysis unit 12 may also use image analysis to detect people attempting to bring in non-transparent bags or purses.

[0124] The process of detecting opaque bags in an image can be realized using any well-known technology. For example, a classifier trained on machine learning to detect opaque bags may be used to detect opaque bags in an image. Alternatively, image analysis techniques such as template matching and feature matching may be used to detect opaque bags in an image.

[0125] When a predetermined prohibited item is detected among the person's belongings, the control unit 14 performs error processing (warning processing). The content of the error processing is the same as in the first to fifth embodiments.

[0126] Next, an example of the flow of processing performed by the processing device 10 when exiting a facility will be described using the flowchart in Figure 9. Note that the purpose here is to explain the flow of processing. Since the details of each process have been described above, the explanation here will be omitted as appropriate.

[0127] First, the processing device 10 acquires an image of a person exiting a facility (S40), and then performs biometric authentication, pulse measurement, and a possessions inspection of the person based on the image acquired in S40 (S41).

[0128] If the biometric authentication fails (No in S42), the processing device 10 performs error processing (S47).

[0129] On the other hand, if the biometric authentication is successful (Yes in S42), the processing device 10 reads out the reference pulse that is registered in association with the identification information of the person identified by the biometric authentication. Then, the processing device 10 determines whether the person's condition satisfies the warning condition based on the read-out reference pulse and the pulse measured in S41 (S43).

[0130] If the person's condition satisfies the warning condition (Yes in S44), the processing device 10 performs error processing (S47). On the other hand, if the person's condition does not satisfy the warning condition (No in S44), the processing device 10 determines whether the person passed the possession inspection in S41 (S45).

[0131] If a specified prohibited item is detected in the personal belongings inspection, i.e., if the personal belongings inspection is not passed (No in S45), the processing device 10 performs error processing (S47). On the other hand, if a specified prohibited item is not detected in the personal belongings inspection, i.e., if the personal belongings inspection is passed (Yes in S45), the processing device 10 performs processing to permit passage through the facility exit (S46).

[0132] As a modified example, the processing device 10 may perform only biometric authentication in S41, without measuring the pulse and inspecting the belongings. If the biometric authentication is successful (Yes in S42), the processing device 10 may measure the pulse and inspect the belongings of the person. In this case, the pulse measurement and inspection of the belongings may be performed based on an image generated during the biometric authentication, or may be performed based on an image newly generated after the biometric authentication. In this modified example, if the biometric authentication fails, the pulse measurement and inspection of the belongings are not performed.

[0133] Other configurations of the processing apparatus 10 of the sixth embodiment are similar to those of the processing apparatus 10 of the first to fifth embodiments.

[0134] The processing device 10 of the sixth embodiment achieves the same effects as the processing devices 10 of the first to fifth embodiments. The processing device 10 also performs a personal belongings inspection using images used for biometric authentication and pulse measurement. Such a processing device 10 is preferable because it can perform various processes in a single system.

[0135] <<Modifications>> Modifications applicable to all the embodiments will be described below, which also achieve the same effects as the first to sixth embodiments.

[0136] <First Modification> The acquisition unit 11 may acquire an image of each person taken before the person enters the facility. The image analysis unit 12 may then measure the pulse based on such an image, associate the measured pulse with each person (personal identification information), and store the information in a storage device. The storage device may be provided within the processing device 10, or may be provided in an external device communicatively connected to the processing device 10.

[0137] For example, a person visiting a facility installs a predetermined application on a mobile device they carry. Then, the person logs in to the application using their own personal identification information before visiting the facility (for example, the day before or a time before the visit on the day). The person then performs an input within the application to start the process of registering their pulse.

[0138] In response to this input, the mobile terminal activates its camera function and takes a picture of the person's face. The mobile terminal then transmits the captured image to the processing device 10. The acquisition unit 11 acquires the image transmitted from the mobile terminal in this manner. The image analysis unit 12 measures the pulse based on the image, and stores the measured pulse in a storage device, linking it to the person (person identification information).

[0139] In this modification, the determination unit 13 determines whether the person's condition satisfies the warning condition even when the person enters a facility. That is, the determination unit 13 determines whether the person's condition satisfies the warning condition based on the reference pulse, which is the pulse registered in advance as described above, and the pulse measured based on an image taken at the entrance to the facility upon entry. Then, the control unit 14 performs error processing if the person's condition satisfies the warning condition.

[0140] According to this modification, when a person enters a facility, it is possible to determine whether the person's state satisfies the warning condition and to perform processing according to the determination result. As a result, it is possible to detect a person who is in a psychological state of tension when entering the facility, for example, because they are about to bring a dangerous object into the facility.

[0141] <Second Modification> The processing device 10 may store the result of biometric authentication by the image analysis unit 12 and the result of determination by the determination unit 13 as to whether the person's state satisfies the warning condition as log information in a storage device. The storage device may be provided within the processing device 10, or may be provided in an external device communicably connected to the processing device 10. According to this modification, it is possible to detect a suspicious person after the fact by checking the log information.

[0142] <Third Modification> The determination unit 13 may compare the pulse measured based on the captured image with multiple reference pulses, which are pulses registered in advance, to identify a person who does not satisfy the warning condition. For example, the determination unit 13 may compare the measured pulse with each of the multiple reference pulses and extract a reference pulse that falls within a predetermined range in which the relationship with the measured pulse is determined to be normal. The determination unit 13 may then identify biometric information associated with the extracted reference pulse as biometric information to be used for biometric authentication. If the identified biometric information is present, the image analysis unit 12 can perform biometric authentication based on the biometric information included in the image and the identified biometric information. If there is no reference pulse within the predetermined range or if biometric authentication fails, the control unit 14 can determine that the measured person's condition satisfies the warning condition and perform error processing.

[0143] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0144] In addition, in the flowcharts used in the above description, multiple steps (processes) are described in order. However, the order of the steps performed in each embodiment is not limited to the order described. In each embodiment, the order of the steps shown in the drawings can be changed as long as it does not cause any problems in terms of the content.

[0145] A part or all of the above-described embodiments can be described as, but not limited to, the following supplementary notes. 1. An acquisition means for acquiring an image of a person; an image analysis means for performing biometric authentication and pulse measurement of the person based on the image; a determination means for determining whether the state of the person satisfies a warning condition based on a reference pulse rate registered in association with the identification information of the person identified by the biometric authentication and the pulse rate measured by the pulse measurement; a control means for performing a warning process when the state of the person satisfies the warning condition; A processing device having: 2. The acquisition means: acquiring the image of the person at an exit of the facility; The control means 2. The processing device according to claim 1, wherein if the biometric authentication is successful and the state of the person does not satisfy the warning condition, the processing is performed to allow passage through the exit. 3. The control means 3. The processing device according to 1 or 2, wherein the warning processing is performed by causing a mobile terminal that has logged in to perform a predetermined output processing using identification information of the person identified by the biometric authentication. 4. The control means After causing the portable terminal to start the predetermined output process, authentication information of a predetermined person different from the person is acquired from the portable terminal, and an authentication process for the predetermined person is executed based on the acquired authentication information; 4. The processing device according to 3, wherein if the authentication process for the predetermined person is successful, the processing device causes the mobile terminal to end the predetermined output process. 5. The acquisition means acquiring the images of the person at an entrance to a facility and an exit of the facility; The determination means registering the pulse of the person measured based on the image of the person taken at the entrance of the facility as the reference pulse; 5. A processing device according to any one of 1 to 4, which determines whether the person's condition satisfies the warning condition based on the person's pulse measured based on the image of the person taken at the exit of the facility and the reference pulse. 6. The acquisition means acquiring the images of the person at an entrance to a facility, an exit from the facility, and at least one location within the facility; The determination means 6. A processing device according to any one of 1 to 5, which uses as the reference pulse a statistical value of the pulse of the person measured based on the image of the person taken at the entrance of the facility and the pulse of the person measured based on the image of the person taken at the at least one location, to determine whether the person's condition satisfies the warning condition. 7. The image analysis means measuring the pulse of the person using a plurality of means based on the image; The determination means 7. The processing device according to any one of 1 to 6, wherein the statistical value of the pulse of the person identified by the plurality of means is registered as the reference pulse. 8. The image analysis means Further, a personal belongings inspection is performed based on the image to detect predetermined prohibited items among the personal belongings of the person. The control means 8. The processing device according to any one of 1 to 7, which performs the warning process when a predetermined prohibited item is detected among the person's belongings. 9. One or more computers: Acquire an image of a person, Based on the image, biometric authentication and pulse measurement of the person are performed; determining whether the state of the person satisfies a warning condition based on a reference pulse rate registered in association with the identification information of the person identified by the biometric authentication and the pulse rate measured by the pulse measurement; A processing method for performing a warning process when the state of the person satisfies the warning condition. 10. Computer an acquisition means for acquiring an image of a person; an image analysis means for performing biometric authentication and pulse measurement of the person based on the image; a determination means for determining whether the state of the person satisfies a warning condition based on a reference pulse registered in association with the identification information of the person identified by the biometric authentication and the pulse measured by the pulse measurement; a control means for performing a warning process when the state of the person satisfies the warning condition; A program that functions as a

[0146] Some or all of Supplements 2 to 8 that are dependent on the processing device of Supplement 1 described above may also be dependent on the processing method of Supplement 9 and the program of Supplement 10 in the same dependent relationship as Supplement 1 and Supplements 2 to 8. Furthermore, within the scope of each of the above-mentioned embodiments, some or all of the configurations described as Supplements can be realized in various hardware, software, various recording means for recording software, or systems. [Explanation of symbols]

[0147] 10 Processing equipment 11 Acquisition Department 12 Image analysis section 13 Judgment Department 14 Control Unit 1A processor 2A Memory 3A input / output I / F 4A peripheral circuit 5A Bus

Claims

1. an acquisition means for acquiring an image of a person; an image analysis means for performing biometric authentication and pulse measurement of the person based on the image; a determination means for determining whether the state of the person satisfies a warning condition based on a reference pulse rate registered in association with the identification information of the person identified by the biometric authentication and the pulse rate measured by the pulse measurement; a control means for performing a warning process when the state of the person satisfies the warning condition; A processing device having:

2. The acquisition means acquiring the image of the person at an exit of the facility; The control means The processing device according to claim 1 , wherein if the biometric authentication is successful and the state of the person does not satisfy the warning condition, a process is performed to permit passage through the exit.

3. The control means The processing device according to claim 1 , wherein the warning process comprises causing a mobile terminal that has logged in using the identification information of the person specified by the biometric authentication to perform a predetermined output process.

4. The control means After causing the portable terminal to start the predetermined output process, authentication information of a predetermined person different from the person is acquired from the portable terminal, and an authentication process for the predetermined person is executed based on the acquired authentication information; The processing device according to claim 3 , wherein when the authentication process for the predetermined person is successful, the processing device causes the portable terminal to end the predetermined output process.

5. The acquisition means acquiring the images of the person at an entrance to a facility and an exit of the facility; The determination means registering the pulse of the person measured based on the image of the person taken at the entrance of the facility as the reference pulse; The processing device according to claim 1 , wherein the processing device determines whether the condition of the person satisfies the warning condition based on the pulse of the person measured based on the image of the person taken at the exit of the facility and the reference pulse.

6. The acquisition means acquiring the images of the person at an entrance to a facility, an exit from the facility, and at least one location within the facility; The determination means 2. The processing device according to claim 1, wherein the pulse of the person measured based on the image of the person taken at the entrance of the facility and a statistical value of the pulse of the person measured based on the image of the person taken at the at least one location are used as the reference pulse to determine whether the person's condition satisfies the warning condition.

7. The image analysis means measuring the pulse of the person using a plurality of means based on the image; The determination means The processing device according to claim 1 , wherein a statistical value of the pulse of the person identified by the plurality of means is registered as the reference pulse.

8. The image analysis means Further, a personal belongings inspection is performed based on the image to detect predetermined prohibited items among the personal belongings of the person. The control means The processing device according to claim 1 , wherein the warning process is performed when a predetermined prohibited item is detected among the person's belongings.

9. One or more computers Acquire an image of a person, Based on the image, biometric authentication and pulse measurement of the person are performed; determining whether the state of the person satisfies a warning condition based on a reference pulse rate registered in association with the identification information of the person identified by the biometric authentication and the pulse rate measured by the pulse measurement; A processing method for performing a warning process when the state of the person satisfies the warning condition.

10. Computer, an acquisition means for acquiring an image of a person; an image analysis means for performing biometric authentication and pulse measurement of the person based on the image; a determination means for determining whether the state of the person satisfies a warning condition based on a reference pulse registered in association with the identification information of the person identified by the biometric authentication and the pulse measured by the pulse measurement; a control means for performing a warning process when the state of the person satisfies the warning condition; A program that functions as a

Images