Information processing device, information processing method, and recording medium

The information processing device addresses the challenge of identifying individuals with overlapping attributes by using a combination of overlapping and non-overlapping attributes to generate precise notification information, enhancing the accuracy and clarity of authentication processes.

WO2025253542A1PCT designated stage Publication Date: 2025-12-11NEC CORP
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2024/020526
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-06-05
Publication Date
2025-12-11

AI Technical Summary

Technical Problem

Existing information processing systems struggle to accurately identify and notify specific individuals in a crowd based on overlapping attributes, leading to confusion and inefficiencies in authentication processes.

Method used

An information processing device and method that acquires images of individuals, performs authentication, recognizes attributes, determines overlapping attributes, and generates notification information to uniquely identify individuals for notification, using a combination of overlapping and non-overlapping attributes to ensure accurate identification.

Benefits of technology

The system effectively distinguishes between individuals with overlapping attributes, ensuring precise notification by including non-overlapping attributes in the notification information, thereby improving the accuracy and clarity of authentication processes.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2024020526_11122025_PF_FP_ABST
    Figure JP2024020526_11122025_PF_FP_ABST
Patent Text Reader

Abstract

This information processing device comprises: an acquisition means for acquiring an image including a person to be authenticated in a prescribed area; an authentication means for performing authentication processing on the person to be authenticated in the image; a recognition means for recognizing an attribute of the person to be authenticated in the image; a decision means for deciding, on the basis of the result of the authentication processing, whether the attribute of the person to be authenticated determined as a notification subject overlaps with an attribute of another person to be authenticated located in the prescribed area; a determination means for determining, on the basis of the decision result, notification information including the attribute of the notification subject; and a notification means for notifying the notification information by voice.
Need to check novelty before this filing date? Find Prior Art

Description

Information processing device, information processing method, and recording medium

[0001] The present disclosure relates to the technical fields of an information processing device, an information processing method, and a recording medium.

[0002] Known examples of this type of device are those that perform authentication processing for multiple subjects who are present in a predetermined area. For example, Patent Document 1 discloses a device that acquires an image including a predetermined area through which subjects pass, and performs facial recognition while tracking the subjects within the image.

[0003] WO 2023 / 152970

[0004] An object of this disclosure is to provide an information processing device, an information processing method, and a recording medium that aim to improve upon the techniques disclosed in prior art documents.

[0005] One aspect of the information processing device disclosed herein comprises an acquisition means for acquiring an image including a person to be authenticated in a specified area, an authentication means for performing an authentication process for the person to be authenticated in the image, a recognition means for recognizing attributes of the person to be authenticated in the image, a determination means for determining whether the attributes of the person to be authenticated determined to be a notification target based on the result of the authentication process overlap with the attributes of other people to be authenticated who are present in the specified area, a determination means for determining notification information including the attributes of the person to be notified based on the determination result, and a notification means for notifying the notification information by voice.

[0006] One aspect of the information processing method disclosed herein involves using at least one computer to acquire an image including a person to be authenticated in a specified area, performing an authentication process on the person to be authenticated in the image, recognizing attributes of the person to be authenticated in the image, determining whether the attributes of the person to be authenticated determined to be the subject of notification based on the results of the authentication process overlap with attributes of other people to be authenticated who are present in the specified area, determining notification information including the attributes of the subject of notification based on the determination result, and notifying the notification information by voice.

[0007] One aspect of the recording medium of this disclosure is a recording medium having recorded thereon a computer program that causes at least one computer to execute an information processing method, which includes acquiring an image including a person to be authenticated in a specified area, performing an authentication process for the person to be authenticated in the image, recognizing attributes of the person to be authenticated in the image, determining whether the attributes of the person to be authenticated determined to be a notification target based on the result of the authentication process overlap with attributes of other people to be authenticated who are present in the specified area, determining notification information including the attributes of the person to be notified based on the determination result, and notifying the notification information by voice.

[0008] 1 is a block diagram showing the hardware configuration of a gateless authentication system; FIG. 2 is a top view showing an example of the operation of the gateless authentication system; FIG. 3 is a block diagram showing the functional configuration of a first information processing device, showing a flowchart showing the flow of the operation of the gateless authentication system; FIG. 4 is a flowchart showing the flow of notification information generation processing by the first information processing device; FIG. 5 is a schematic diagram (part 1) showing an example of a method for determining notification information in a second information processing device; FIG. 6 is a schematic diagram (part 2) showing an example of a method for determining notification information in a second information processing device; FIG. 7 is a flowchart showing the flow of notification information generation processing by a third information processing device; FIG. 8 is a block diagram showing the functional configuration of a fourth information processing device; FIG. 9 is a flowchart showing the flow of notification information generation processing by the fourth information processing device; FIG. 10 is a block diagram showing the functional configuration of a fifth information processing device; FIG. 11 is a flowchart showing the flow of notification information generation processing by the fifth information processing device.

[0009] Hereinafter, embodiments of an information processing device, an information processing method, and a recording medium will be described with reference to the drawings.

[0010] First Embodiment A first information processing apparatus will be described with reference to FIGS. 1 to 5. FIG.

[0011] (Configuration of Gateless Authentication System) First, the hardware configuration of a gateless authentication system to which the first information processing device is applied will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the hardware configuration of the gateless authentication system.

[0012] 1, the gateless authentication system 1 includes a processor 11, a RAM (Random Access Memory) 12, a ROM (Read Only Memory) 13, a storage device 14, an input device 15, an output device 16, a user terminal 20, and an authentication device 30. The processor 11, RAM 12, ROM 13, storage device 14, input device 15, output device 16, user terminal 20, and authentication device 30 are all connected via a data bus 17. Note that the data bus 17 may be an interface other than a data bus (for example, a LAN, a USB, etc.).

[0013] The processor 11 loads a computer program. For example, the processor 11 is configured to load a computer program stored in at least one of the RAM 12, the ROM 13, and the storage device 14. Alternatively, the processor 11 may load a computer program stored in a computer-readable storage medium using a storage medium reading device (not shown). The processor 11 may acquire (i.e., load) the computer program from a device (not shown) located outside the gateless authentication system 1 via a network interface. The processor 11 executes the loaded computer program to perform various processes. When the processor 11 executes the loaded computer program, functional blocks related to the processes executed by the gateless authentication system 1 are realized within the processor 11. In other words, the processor 11 may function as a controller that executes each control in the gateless authentication system 1 (in other words, the first information processing device).

[0014] The processor 11 may be configured as, for example, a central processing unit (CPU), a graphics processing unit (GPU), a field-programmable gate array (FPGA), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), or a quantum processor. The processor 11 may be configured as one of these, or may be configured to use multiple processors in parallel.

[0015] The RAM 12 temporarily stores computer programs executed by the processor 11. The RAM 12 temporarily stores data that the processor 11 temporarily uses while it is executing the computer programs. The RAM 12 may be, for example, a dynamic random access memory (D-RAM) or a static random access memory (SRAM). Alternatively, other types of volatile memory may be used instead of the RAM 12.

[0016] The ROM 13 stores computer programs executed by the processor 11. The ROM 13 may also store fixed data. The ROM 13 may be, for example, a programmable read-only memory (PROM) or an erasable read-only memory (EPROM). Alternatively, other types of non-volatile memory may be used instead of the ROM 13.

[0017] The storage device 14 stores data that is to be saved long-term by the gateless authentication system 1. The storage device 14 may operate as a temporary storage device for the processor 11. The storage device 14 may store computer programs executed by the processor 11. The storage device 14 may include, for example, at least one of a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device.

[0018] The input device 15 is a device that receives input instructions from a user of the gateless authentication system 1. The input device 15 may include, for example, at least one of a keyboard, a mouse, and a touch panel. The input device 15 may also be, for example, a device that includes a microphone and is capable of voice input.

[0019] The output device 16 is a device that outputs information related to the gateless authentication system 1 to the outside. For example, the output device 16 may be a display device (e.g., a display or a monitor) that can display information related to the gateless authentication system 1. The output device 16 may also be a speaker or the like that can output information related to the gateless authentication system 1 as audio.

[0020] The user terminal 20 is a terminal used by a user (specifically, a monitor) of the gateless authentication system 1. The user terminal 20 includes a display unit 201. The display unit 201 is a display mounted on the user terminal 20. The user terminal 20 may be configured as, for example, an HMD (Head Mounted Display). The HMD may use AR (Augmented Reality), VR (Virtual Reality), or MR (Mixed Reality). Note that the user terminal 20 may be a terminal other than an HMD, and may be configured as, for example, a smartphone, a tablet, a laptop, or the like.

[0021] The authentication device 30 is a device that executes authentication processing in the gateless authentication system 1. The authentication device 30 includes a camera 301. The camera 301 is positioned so as to capture an image of the authentication area through which the person to be authenticated passes. The authentication device 30 executes authentication processing using the image captured by the camera 301. For example, the authentication device 30 detects the person to be authenticated in the image and acquires biometric information from the person to be authenticated. The authentication device 30 then compares the biometric information of the person to be authenticated with pre-registered registration information (i.e., biometric information of registered users) to execute authentication processing for the person to be authenticated. The authentication device 30 may have a function for storing registration information for multiple registered users. Alternatively, the registration information may be stored in an external storage device or the like, and the authentication device 30 may read it to execute authentication processing. The authentication device 30 may execute authentication processing by calculating a score according to the degree of match between the biometric information and the registration information. In this case, the authentication device 30 may determine that the authentication process is successful (i.e., the target and the registered user match) if the score is higher than a predetermined authentication threshold, and may determine that the authentication process is unsuccessful (i.e., the target and the registered user do not match) if the score is lower than the predetermined authentication threshold. Furthermore, the authentication device 30 may calculate a score according to the degree of mismatch between the biometric information and the registered information and perform the authentication process. In this case, the authentication device 30 may determine that the authentication process is successful if the score is lower than a predetermined authentication threshold, and may determine that the authentication process is unsuccessful if the score is higher than the predetermined authentication threshold. The type of biometric information used by the authentication device 30 is not particularly limited, and the authentication process may be performed using, for example, biometric information related to the face or iris.

[0022] Each of the components of the gateless authentication system 1 described above may function as a first information processing device. For example, the first information processing device may be configured by the processor 11, RAM 12, and ROM 13 of the components of the gateless authentication system 1. Note that part of the calculation function of the first information processing device may be realized by an external server, a cloud, or the like.

[0023] (Gateless Authentication) Next, an example of the operation of the gateless authentication system 1 to which the first information processing device is applied will be described with reference to Fig. 2. Fig. 2 is a top view showing an example of the operation of the gateless authentication system.

[0024] 2, the gateless authentication system 1 is configured to be able to perform authentication processing (hereinafter referred to as "gateless authentication") for a person to be authenticated 50 passing through an authentication area R. In the example shown in FIG. 2, the person to be authenticated 50 is walking from the left side to the right side of the figure. The authentication area R is set, for example, at the entrance of various facilities, and a person to be authenticated 50 who is successfully authenticated is permitted to enter the facility, and a person to be authenticated 50 who is unsuccessful in authentication is prohibited from entering the facility. There may be multiple people to be authenticated 50 in the authentication area R. In this case, the gateless authentication system 1 simply performs authentication processing for each of the multiple people to be authenticated 50.

[0025] An authentication device 30 is installed at the end of the authentication area R (specifically, the end ahead in the direction of travel of the person to be authenticated 50). The authentication device 30 is provided with a camera 301, which captures an image of the authentication area R. The camera 301 is installed in a position that includes at least a portion of the authentication area R within its imaging range. Note that although an example in which one camera 301 is installed is given here, multiple cameras 301 may also be installed. In this case, it is preferable that the multiple cameras 301 are installed so as to capture images of the authentication area R from different positions and at different angles.

[0026] At least one monitor 60 is assigned to the authentication device 30. The monitor 60 uses the user terminal 20 to monitor the person to be authenticated 50 who is performing gateless authentication. For example, if there is a person to be authenticated 50 who has not been successfully authenticated (hereinafter referred to as an "unauthenticated person"), information about the unauthenticated person may be displayed on the display unit 201 of the user terminal. Upon seeing this information, the monitor 60 calls out to the unauthenticated person and prohibits them from passing through. The monitor 60 may also guide the unauthenticated person to perform gateless authentication again. In this case, the monitor 60 may instruct the person to face the camera 301.

[0027] (Operation of Gateless Authentication System) Next, the flow of operations of the gateless authentication system 1 will be described with reference to Fig. 3. Fig. 3 is a flowchart showing the flow of operations of the gateless authentication system.

[0028] 3, when the gateless authentication system 1 starts operating, the camera 301 first captures an image of the person to be authenticated 50 and acquires an authentication image including the person to be authenticated 50 (step S101). The authentication device 30 then detects the person to be authenticated 50 from the authentication image and starts tracking them (step S102). An individual tracking ID is assigned to each person to be authenticated 50 being tracked. Note that the authentication device 30 may detect multiple people to be authenticated 50 from a single image. In this case, the authentication unit 120 may track multiple people to be authenticated 50 simultaneously in parallel.

[0029] The subsequent processing from step S103 onwards is executed for each target. The authentication device 30 first acquires a target ID and a tracking ID for each target (step S201). Then, the authentication device 30 determines whether a new tracking ID has been assigned (step S202). That is, the authentication device 30 determines whether tracking of a new person to be authenticated 50 has begun. Note that if it is determined that a new tracking ID has not been assigned (step S202: NO), the authentication device 30 determines whether the person to be authenticated 50 being tracked has already been authenticated (step S203). That is, the authentication device 30 executes authentication processing for the person to be authenticated 50 being tracked and determines whether the authentication processing has been successful.

[0030] If the person to be authenticated 50 being tracked has already been authenticated (step S203: YES), the authentication device 30 determines that the person to be authenticated 50 is allowed to pass (step S204). On the other hand, if it determines that a new tracking ID has been assigned (step S202: YES) or if the person to be authenticated 50 being tracked has not already been authenticated (step S203: NO), the authentication device 30 executes authentication processing for the person to be authenticated 50 (step S205). If the authentication processing is successful (step S205: YES), the authentication device 30 associates the tracking ID assigned to the person to be authenticated 50 with the target ID identified by the authentication (i.e., the ID set for each registered user) and stores them (step S207). If the person to be authenticated 50 is successfully authenticated, the authentication device 30 determines that the person to be authenticated 50 is allowed to pass (step S204).

[0031] On the other hand, if the authentication process fails (step S206: NO), the authentication device 30 determines whether an alert has already been issued for the person to be authenticated 50 (step S208). An alert is issued, for example, when the number of authentication failures exceeds a predetermined threshold N. Examples of the number of authentication failures include the number of consecutive frames of authentication failure and the duration of consecutive authentication failures. For the person to be authenticated 50 for whom an alert has already been issued (step S208: YES), the authentication device 30 determines that the person to be authenticated 50 is not allowed to pass (step S29). If an alert has not been issued (step S208: NO), the authentication device 30 determines whether the number of consecutive frames of authentication failure exceeds a predetermined threshold N (step S210). If the number of consecutive frames of authentication failure exceeds the predetermined threshold N (step S210: YES), the authentication device 30 issues an alert for the person to be authenticated 50 and determines that the person to be authenticated 50 is not allowed to pass (step S209). On the other hand, if the number of consecutive frames of authentication failure does not exceed the predetermined threshold N (step S210: NO), authentication device 30 continues tracking of user 50 as being under evaluation (step S211).

[0032] When the processing for each object up to step S104 is completed, the first information processing device executes a notification information generation process (step S105). This notification information generation process will be described in detail later.

[0033] Thereafter, the gateless authentication system 1 determines whether or not the input of the image captured by the camera 301 has been completed (step S106). If the input of the image has been completed (step S106: YES), the series of operations ends. On the other hand, if the input of the image has not been completed (step S106: NO), the process is repeated from step S101.

[0034] (Configuration of Information Processing Apparatus) Next, the functional configuration of the first information processing apparatus applied to the above-described gateless authentication system 1 will be described with reference to Fig. 4. Fig. 4 is a block diagram showing the functional configuration of the first information processing apparatus.

[0035] 4, the first information processing device 10 is configured to be able to execute at least a part of the processes executed by the gateless authentication system 1. Specifically, the first information processing device 10 is configured to be able to execute mainly the notification information generation process in the gateless authentication system 1 (i.e., the process of step S105 in FIG. 3). However, the first information processing device 10 may be configured to be able to execute processes other than the notification information generation process in the gateless authentication system 1.

[0036] The first information processing device 10 is configured to include, as components for realizing its functions, an image acquisition unit 110, an authentication unit 120, an attribute recognition unit 130, a determination unit 140, a notification information determination unit 150, and a notification unit 160. Each of the image acquisition unit 110, the authentication unit 120, the attribute recognition unit 130, the determination unit 140, the notification information determination unit 150, and the notification unit 160 may be a processing block realized by the above-mentioned processor 11 (see FIG. 1 ).

[0037] The image acquisition unit 110 is configured to be able to acquire an image including the person to be authenticated 50 in the authentication area R. The image acquisition unit 110 acquires an image captured by the camera 301 (see FIG. 2 ). However, the image acquisition unit 110 may acquire an image captured by a camera other than the camera 301. The image acquisition unit 110 may acquire multiple images that are consecutive in time series (in other words, a video). The image acquired by the image acquisition unit 110 (hereinafter referred to as an "authentication image" as appropriate) is configured to be output to each of the authentication unit 120 and the attribute recognition unit 130.

[0038] The authentication unit 120 is configured to be able to perform authentication processing for the person to be authenticated 50 using the authentication image acquired by the image acquisition unit 110. The authentication processing performed by the authentication unit 120 is the authentication processing performed by the authentication device 30 already described. That is, the authentication unit 120 may be configured as a part of the authentication device 30. The authentication unit 120 may perform tracking processing for the person to be authenticated 50 in order to perform the authentication processing. Specifically, as already described with reference to FIG. 3, the authentication unit 120 may be configured to perform tracking processing for the person to be authenticated 50 and perform authentication processing for the person to be authenticated 50 being tracked. Note that the authentication unit 120 may continue to perform authentication processing for the person to be authenticated 50 for whom the authentication processing has been successful. The authentication result by the authentication unit 120 is configured to be output to the determination unit 140.

[0039] The attribute recognition unit 130 is configured to be able to recognize the attributes of the person to be authenticated 50 using the authentication image acquired by the image acquisition unit 110. The attributes may be, for example, age, gender, height, hairstyle, color of clothing on the upper body, color of clothing on the lower body, belongings, clothing, group (number of people traveling together), and movement mode (e.g., walking, running, etc.). When multiple people to be authenticated 50 are present in the authentication area R, the attribute recognition unit 130 may recognize attributes for each of the multiple people to be authenticated 50. Furthermore, the attribute recognition unit 130 may be configured to recognize multiple types of attributes for one person to be authenticated 50. Information related to the attributes recognized by the attribute recognition unit 130 is configured to be output to the determination unit 140.

[0040] The determination unit 140 is configured to determine whether or not there is overlap in attributes for multiple authentication-subjects 50 present in the authentication area R. More specifically, the determination unit 140 determines whether or not there is overlap between the attributes of the authentication-subject 50 determined to be the notification target (hereinafter, simply referred to as the "notification target") and the attributes of other authentication-subjects 50. When multiple types of attributes are recognized, the determination unit 140 may determine whether or not there is overlap for each of the multiple types of attributes. In this case, the determination unit 140 may determine whether or not there is overlap for each of the multiple types of attributes in stages (i.e., one by one). The order may be based on a predetermined priority or the like. The order may also be rearranged as appropriate. Alternatively, the determination unit 140 may determine whether or not there is overlap for each of the multiple types of attributes in parallel (i.e., for multiple attributes simultaneously). The determination result of the determination unit 140 (e.g., information regarding overlapping attributes) is output to the notification information determination unit 150.

[0041] The determination unit 140 may be configured to execute a process for determining whether the authentication-subject 50 is a notification target before executing the process for determining whether the above-described attributes are duplicated (hereinafter referred to as the "duplication determination process" as appropriate). In this case, the determination unit 140 may determine the authentication-subject 50 as a notification target based on the authentication result of the authentication unit 120. The notification target is the authentication-subject 50 who should be notified to the monitor 60 of the gateless authentication system 1. For this reason, the determination unit 140 may determine, for example, that the authentication-subject 50 who is approaching the exit of the authentication area R without successful authentication is a notification target. On the other hand, the determination unit 140 may determine that the authentication-subject 50 who is near the entrance of the authentication area R is not a notification target, even if the authentication process is unsuccessful. Furthermore, the determination unit 140 may determine that the authentication-subject 50 who has failed the authentication process even once is a notification target. For example, the determination unit 140 may determine the person to be notified as a notification target when the person to be authenticated 50 has succeeded in the first authentication process but failed in the second authentication process. The determination unit 140 may also determine the person to be notified as a notification target based on a preset blacklist (i.e., a list of users who should be prohibited from passing through the authentication area R). For example, when the determination unit 140 determines as a result of the authentication process that the person to be authenticated 50 is the same person as a user included in the blacklist, the determination unit 140 may determine that the person to be authenticated 50 is the notification target.

[0042] The notification information determination unit 150 is configured to be able to determine notification information based on the determination result of the determination unit 140. The notification information is information about the notification target to be notified to the monitor 60, and includes attributes of the notification target. The attributes included in the notification information are recognized by the attribute recognition unit 130. For example, if the attribute recognition unit 130 recognizes age, sex, and height as attributes of the person to be authenticated 50, the notification information may include information such as "30s," "male," and "height 180 cm." An upper limit (for example, 2 to 3) may be set for the number of attributes to be included in the notification information.

[0043] The notification information determination unit 150 may be configured to change the attributes to be included in the notification information depending on the determination result. That is, the notification information determination unit 150 may change the attributes to be included in the notification information depending on whether it is determined that there are overlapping attributes or not. Furthermore, the notification information determination unit 150 may include attributes determined to be overlapping (hereinafter, appropriately referred to as "overlapping attributes") in the notification information. Furthermore, the notification information determination unit 150 may include attributes determined to be non-overlapping (hereinafter, appropriately referred to as "non-overlapping attributes") in the notification information. Specific methods for determining notification information by the notification information determination unit 150 will be described in more detail in other embodiments described later.

[0044] The notification unit 160 is configured to be able to notify the monitor 60 of the notification information. More specifically, the notification unit 160 is configured to be able to notify the monitor 60 of the notification information determined by the notification information determination unit 150 by transmitting the notification information determined by the notification information determination unit 150 to the user terminal 20, thereby notifying the monitor 60 of the notification information by voice. For example, the notification unit 160 may use a speaker or the like mounted on the user terminal 20 to output a message or the like to convey the attributes of the notification target. For example, the notification unit 160 may output a message such as "Please stop a man in his 30s who is 180 cm tall from passing by" by voice. Furthermore, the notification unit 160 may provide notification in other ways in addition to voice. For example, the notification unit 160 may provide notification by image or text in addition to a voice message.

[0045] <Notification Information Generation Process> Next, the notification information generation process executed by the first information processing device 10 (i.e., the process of step S105 in FIG. 3) will be described in more detail with reference to FIG. 5. FIG. 5 is a flowchart showing the flow of the notification information generation process by the first information processing device. Note that FIG. 5 also includes processes other than the notification generation process.

[0046] 5, when the first information processing device 10 operates, the image acquisition unit 110 first acquires an authentication image (step S11). Then, the authentication unit 120 uses the authentication image acquired by the image acquisition unit 110 to perform authentication processing of the person to be authenticated 50 in the image (step S12).

[0047] Next, the determination unit 140 determines the authentication-subject 50 who is the notification target based on the result of the authentication process by the authentication unit 120 (step S13). Although not shown in the flow, if there is no notification target, the subsequent processes may be omitted. In this case, the process may be restarted from step S11 after a predetermined period of time has elapsed.

[0048] Next, the attribute recognition unit 130 recognizes the attributes of the person to be authenticated 50 in the image based on the authentication image (step S14). Note that the process of step S14 may be executed at an earlier stage. For example, the process of step S14 may be executed immediately after the image is acquired in step S11 (i.e., before the authentication process of step S12 is executed). Alternatively, the process of step S14 may be executed in parallel with the authentication process of step S12.

[0049] Next, the determination unit 140 determines whether there are two or more authenticated persons 50 in the authentication area R (step S15). This process is for determining whether it is necessary to perform the duplication determination process described below. If there is one or fewer authenticated persons 50, the duplication determination process cannot actually be performed. Therefore, if there are not two or more authenticated persons (step S15: NO), the notification information determination unit 150 does not perform the duplication determination process and determines the notification information based on the attributes recognized in step S14 (step S16). For example, the notification information determination unit 150 may determine the notification information as including a predetermined initial attribute that has been set in advance. Then, the notification unit 160 transmits the notification information determined by the notification information determination unit 150 to the user terminal 20 (step S19).

[0050] On the other hand, if there are two or more authentication subjects (step S15: YES), the determination unit 140 executes a duplication determination process (step S17). In this case, the notification information determination unit 150 determines notification information based on the determination result of the duplication determination process (step S18). For example, if the notification information determination unit 150 determines that there are duplicate attributes, it may add another attribute to a predetermined initial attribute or replace the predetermined initial attribute with another attribute. Thereafter, the notification unit 160 transmits the notification information determined by the notification information determination unit 150 to the user terminal 20 (step S19).

[0051] (Technical Effects) Next, technical effects obtained by the first information processing device 10 will be described.

[0052] As described with reference to Figures 1 to 5, the first information processing device 10 determines whether the attributes of the notification target overlap with the attributes of other authentication-subjects 50, and determines notification information based on the determination result. This prevents the monitor 60 from confusing the notification target with other authentication-subjects 50 when the attributes overlap. For example, if the notification information only includes the overlapping attributes, the monitor 60 will not be able to properly determine which authentication-subject 50 is the notification target. In such a case, determining the notification information to include information other than the overlapping attributes allows the monitor 60 to properly determine the notification target.

[0053] Second Embodiment A second information processing device 10 will be described with reference to Figures 6 and 7. The second information processing device 1 differs in some configurations and operations from the first information processing device 10 described above, but other parts may be similar to the first information processing device 10. Therefore, the following will describe in detail the parts that differ from the first embodiment, and will omit explanations of other overlapping parts as appropriate.

[0054] (Method for determining notification information) First, a specific example of a method for determining notification information by the second information processing device 10 will be described with reference to Fig. 6. Fig. 6 is a schematic diagram (part 1) showing an example of a method for determining notification information in the second information processing device.

[0055] In the example shown in Fig. 6, authentication subjects 50A and 50B are present in authentication area R. The authentication subjects 50A and 50B have overlapping attributes in that their gender is "male," their age is "in their 20s," their hairstyle is "short hair," and their upper body clothing color is "red." Therefore, it is not possible to distinguish between authentication subjects 50A and 50B using notification information that includes only the above-mentioned gender, age, hairstyle, and upper body clothing color. Therefore, if it is determined that only one of authentication subjects 50A and 50B is the notification target, monitor 60 will not be able to identify the notification target from the notification information.

[0056] On the other hand, the color of the clothing on the lower half of the authentication-subject 50A is "black," and the color of the clothing on the lower half of the authentication-subject 50B is "orange." In other words, the attributes of the clothing colors on the lower half of the authentication-subject 50A and 50B do not overlap. Therefore, if notification information is determined to include the color of the clothing on the lower half of the body, it is possible to distinguish between the authentication-subject 50A and the authentication-subject 50B. For example, if the notification information includes information that the clothing color on the lower half of the body is "black," it can be determined that the notification target is the authentication-subject 50A, not the authentication-subject 50B. Similarly, if the notification information includes information that the clothing color on the lower half of the body is "orange," it can be determined that the notification target is the authentication-subject 50B, not the authentication-subject 50A.

[0057] If the attributes of the authentication-subject 50 include a minority attribute, the attribute may be preferentially included. A minority attribute may be an attribute that is rare and unlikely to overlap. For example, if the color of the clothing on the upper half of the subject's body is "black" and the color of the clothing on the lower half of the subject's body is "gold," the color of the clothing on the lower half of the body can be determined to be a minority attribute. In this case, the notification information determination unit 150 may preferentially include the color of the clothing on the lower half of the body in the notification information. Alternatively, the minority attribute may be an attribute that is rare among the authentication-subjects present in the authentication area R. For example, if there is only one person whose upper half of the body is "black" among multiple authentication-subjects present in the authentication area, the attribute of the color of the clothing on the upper half of the body being "black" can be determined to be a minority attribute. In this case, the notification information determination unit 150 may preferentially include the color of the clothing on the upper half of the body being "black" in the notification information.

[0058] (Modification) Next, a modification of the method of determining notification information by the second information processing device 10 will be described with reference to Fig. 7. Fig. 7 is a schematic diagram (part 2) showing an example of the method of determining notification information in the second information processing device.

[0059] In the example shown in Fig. 7, authentication subjects 50C, 50D, and 50E are present in authentication area R. The authentication subjects 50C, 50D, and 50E have overlapping attributes in that their gender is "male," their age is "in their 20s," and their hairstyle is "short hair." Therefore, it is not possible to distinguish between authentication subjects 50C, 50D, and 50E using notification information that includes only the gender, age, and hairstyle described above. Therefore, if only one of authentication subjects 50C, 50D, and 50E is determined to be the notification target, monitor 60 cannot identify the notification target from the notification information.

[0060] On the other hand, the color of the clothing on the upper half of the authentication-subject 50C is "blue," and the color of the clothing on the upper half of the authentication-subject 50D is "green." In other words, the authentication-subjects 50C and 50D do not have the same attribute in terms of the color of their upper half of the clothing. Therefore, if notification information is determined to include the color of the upper half of the clothing, it is possible to distinguish between the authentication-subjects 50C and 50D. However, the color of the clothing on the upper half of the clothing of the authentication-subject 50E is also "blue." In other words, the color of the clothing on the upper half of the clothing of the authentication-subjects 50C and 50E does not overlap. Therefore, while it is possible to distinguish between the authentication-subjects 50C and 50D by only including the color of the clothing on the upper half of the clothing, it is not possible to distinguish between the authentication-subjects 50C and 50E.

[0061] Furthermore, the color of the clothing on the lower half of the authentication-subject 50C is "black," while the color of the clothing on the upper half of the authentication-subject 50E is "navy blue." In other words, the authentication-subjects 50C and 50E do not have the same attribute in terms of the color of their lower half of the clothing. Therefore, if notification information is determined to include the color of the lower half of the clothing, it is possible to distinguish between the authentication-subjects 50C and 50E. However, the color of the clothing on the lower half of the authentication-subject 50D is also "black." In other words, the color of the clothing on the lower half of the authentication-subject 50C and 50D does not overlap. Therefore, while it is possible to distinguish between the authentication-subjects 50C and 50E by only including the color of the clothing on the lower half of the clothing, it is not possible to distinguish between the authentication-subjects 50C and 50D.

[0062] As described above, it is not possible to distinguish between the authentication-subjects 50C, 50D, and 50E based on either the color of the upper body clothing or the color of the lower body clothing alone. However, it is possible to distinguish between the authentication-subjects 50C, 50D, and 50E by using a combination of both the color of the upper body clothing and the color of the lower body clothing. For example, if the notification information includes information that the color of the upper body clothing is "blue" and the color of the lower body clothing is "black," it can be determined that the notification target is the authentication-subject 50C, and not the authentication-subjects 50D and 50E. Similarly, if the notification information includes information that the color of the upper body clothing is "green" and the color of the lower body clothing is "black," it can be determined that the notification target is the authentication-subject 50D, and not the authentication-subjects 50C and 50E. Furthermore, if the notification information includes information that the color of the clothing on the upper body is "blue" and the color of the clothing on the lower body is "navy blue," it can be determined that the notification is to be sent to person 50E, not persons 50C and 50D.

[0063] In the above example, non-overlapping attributes are described as being included in the notification information, but overlapping attributes may also be included in the notification information. That is, the notification information may be information that includes both overlapping attributes and non-overlapping attributes. As already described, as long as the notification information includes non-overlapping attributes, it is possible to identify the notification target. However, determining the notification information to include overlapping attributes in addition to non-overlapping attributes may make it easier to identify the notification target.

[0064] For example, if there are 10 people to be authenticated 50, four males and six females, "gender" is a duplicated attribute. Therefore, it is difficult to identify the notification recipient simply by including "gender" in the notification information. However, if the notification information includes information that the person is "male," it is possible to narrow down the notification recipient candidates to at least four people out of the ten people. Furthermore, if the notification information includes information that the person is "female," it is possible to narrow down the notification recipient candidates to at least six people out of the ten people.

[0065] (Technical Effects) Next, technical effects obtained by the second information processing device 10 will be described.

[0066] As described with reference to FIGS. 6 and 7 , the second information processing device 10 determines notification information to include non-overlapping attributes. In this way, even if some attributes overlap, it is possible to appropriately identify the notification target based on the non-overlapping attributes. Furthermore, by combining multiple attributes and determining notification information so that at least some attributes do not overlap, it is possible to appropriately identify the notification target even in situations where it is difficult to identify the notification target using only one attribute. Furthermore, by setting attributes that can narrow down the candidate notification targets as attributes that satisfy predetermined conditions and including overlapping attributes that satisfy the predetermined conditions in the notification information, it is possible to more appropriately identify the notification target compared to when only non-overlapping attributes are included in the notification information.

[0067] <Third Embodiment> A third information processing device 10 will be described with reference to Fig. 8. The third information processing device 10 differs in some configurations and operations from the first and second information processing devices 10 described above, but other parts may be similar to the first and second information processing devices 10. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit explanations of other overlapping parts as appropriate.

[0068] <Notification information generation process> Next, the notification information generation process executed by the third information processing device 10 will be described with reference to Fig. 8. Fig. 8 is a flowchart showing the flow of the notification information generation process by the third information processing device. Note that in Fig. 8, the same processes as those shown in Fig. 5 are denoted by the same reference numerals.

[0069] 8, when the third information processing device 10 operates, the image acquisition unit 110 first acquires an authentication image (step S11). Then, the authentication unit 120 uses the authentication image acquired by the image acquisition unit 110 to perform authentication processing of the person to be authenticated 50 in the image (step S12).

[0070] Next, the determination unit 140 determines the person to be authenticated 50 to be notified based on the result of the authentication process by the authentication unit 120 (step S13). Then, the attribute recognition unit 130 recognizes the attributes of the person to be authenticated 50 in the image based on the authentication image (step S14).

[0071] Next, the determination unit 140 determines whether there are two or more authentication-subjects 50 in the authentication area R (step S15). If there are not two or more authentication-subjects (step S15: NO), the notification information determination unit 150 does not execute the duplication determination process and determines notification information based on the attributes recognized in step S14 (step S16). Thereafter, the notification unit 160 transmits the notification information determined by the notification information determination unit 150 to the user terminal 20 (step S19).

[0072] On the other hand, if there are two or more persons to be authenticated (step S15: YES), the determination unit 140 executes a duplication determination process (step S17). Then, based on the result of the duplication determination process, the determination unit 140 determines whether all attributes are duplicated (step S31).

[0073] If none of the attributes overlap (step S31: NO), the notification information determination unit 150 determines the notification information based on the determination result of the overlap determination process (step S18). For example, the notification information determination unit 150 may determine the notification information so as to include non-overlapping attributes, as described in the second embodiment. Thereafter, the notification unit 160 transmits the notification information determined by the notification information determination unit 150 to the user terminal 20 (step S19).

[0074] On the other hand, if all attributes are overlapping (step S31: YES), there are no non-overlapping attributes, and therefore the notification information determination unit 150 cannot determine notification information to include non-overlapping attributes. In this case, the notification information determination unit 150 determines notification information to include location information of the notification target (step S32). For example, the notification information may include information indicating where the notification target is located within the authentication area R. Thereafter, the notification unit 160 transmits the notification information determined by the notification information determination unit 150 to the user terminal 20 (step S19).

[0075] The notification information determination unit 150 may determine the notification information to include, in addition to the above-described position information, information that makes the location of the notification target easier to understand. For example, the notification information determination unit 150 may determine the notification information to include the distance from the monitor 60 to the notification target. Alternatively, the notification information determination unit 150 may determine the notification information to include the direction of the notification target as seen from the monitor 60. Alternatively, the notification information determination unit 150 may determine the notification information to include information about landmarks (e.g., pillars) that exist near the notification target.

[0076] The relative positional relationship between the notification target and the monitor 60 may be calculated from their respective position information. In this case, the position information of the monitor 60 may be estimated from an image captured by the camera 301 or may be obtained from the user terminal 20.

[0077] (Technical Effects) Next, technical effects obtained by the third information processing apparatus 10 will be described.

[0078] As described with reference to Fig. 8, in the third information processing device 10, notification information is determined to include location information of the notification target. In this way, even when it is difficult to identify the notification target based on attributes alone (for example, when all attributes are overlapped), it becomes possible to appropriately identify the notification target. Furthermore, if information regarding the distance to the notification target, the direction of the notification target, landmarks, etc. is notified in addition to the location information, it becomes easier to identify the notification target.

[0079] <Fourth embodiment> A fourth information processing device 10 will be described with reference to Figures 9 and 10. The fourth information processing device 10 differs in some configurations and operations from the first to third information processing devices 10 described above, but other parts may be similar to the first to third information processing devices 10. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and descriptions of other overlapping parts will be omitted as appropriate.

[0080] (Functional Configuration) First, the functional configuration of the fourth information processing device 10 will be described with reference to Fig. 9. Fig. 9 is a block diagram showing the functional configuration of the fourth information processing device. Note that in Fig. 9, the same elements as those shown in Fig. 4 are denoted by the same reference numerals.

[0081] 9, the fourth information processing device 10 is configured to include, as components for realizing its functions, an image acquisition unit 110, an authentication unit 120, an attribute recognition unit 130, a determination unit 140, a notification information determination unit 150, a notification unit 160, and a reliability calculation unit 170. That is, the fourth information processing device 10 further includes a reliability calculation unit 170 in addition to the configuration described in the first embodiment (see FIG. 4). Note that the reliability calculation unit 170 may be a processing block realized by the above-mentioned processor 11 (see FIG. 1).

[0082] The reliability calculation unit 170 is configured to be able to calculate the reliability of an attribute. Here, "reliability" refers to a degree of certainty when an attribute is recognized by the attribute recognition unit 130. When multiple types of attributes are recognized by the attribute recognition unit 130, the reliability calculation unit 170 calculates the reliability for each of the multiple types of attributes. Information related to the reliability calculated by the reliability calculation unit 170 is configured to be output to the notification information determination unit 150.

[0083] The notification information determination unit 150 in the fourth information processing device 10 is configured to be able to determine notification information based on the reliability calculated by the reliability calculation unit 170. Specifically, when determining notification information based on the determination result, the notification information determination unit 150 determines attributes to be included in the notification information using the reliability. For example, the notification information determination unit 150 causes attributes whose reliability is higher than a predetermined value to be included in the notification information. Alternatively, the notification information determination unit 150 causes a predetermined number of attributes to be included in the notification information in descending order of reliability.

[0084] <Notification information generation process> Next, the notification information generation process executed by the fourth information processing device 10 will be described with reference to Fig. 10. Fig. 10 is a flowchart showing the flow of the notification information generation process by the fourth information processing device. Note that in Fig. 10, the same processes as those shown in Fig. 5 are denoted by the same reference numerals.

[0085] 10, when the fourth information processing device 10 operates, the image acquisition unit 110 first acquires an authentication image (step S11). Then, the authentication unit 120 executes authentication processing of the person to be authenticated 50 in the image using the authentication image acquired by the image acquisition unit 110 (step S12).

[0086] Next, the determination unit 140 determines the person to be authenticated 50, who is the notification target, based on the result of the authentication process by the authentication unit 120 (step S13). Then, the attribute recognition unit 130 recognizes the attributes of the person to be authenticated 50 in the image based on the authentication image (step S14). Thereafter, the reliability calculation unit 170 calculates the reliability for each of the multiple types of attributes recognized by the attribute recognition unit 130 (step S41).

[0087] Next, the determination unit 140 determines whether there are two or more persons to be authenticated 50 in the authentication area R (step S15). If there are not two or more persons to be authenticated (step S15: NO), the notification information determination unit 150 does not execute the duplication determination process, and determines the notification information based on the attribute recognized in step S14 (step S16).

[0088] On the other hand, if there are two or more subjects to be authenticated (step S15: YES), the determination unit 140 executes a duplication determination process (step S17). Then, the notification information determination unit 150 determines notification information based on the determination result of the duplication determination process and the reliability calculated in step S41 (step S42). Thereafter, the notification unit 160 transmits the notification information determined by the notification information determination unit 150 to the user terminal 20 (step S19).

[0089] (Technical Effects) Next, technical effects obtained by the fourth information processing apparatus 10 will be described.

[0090] As described with reference to Figures 9 and 10, in the fourth information processing device 10, attributes to be included in the notification information are determined based on the reliability of the attributes. In this way, it is possible to determine the notification information more appropriately compared to when reliability is not used. For example, if an attribute with low reliability is included in the notification information, there is a possibility that the recognized attribute is incorrect, and it may not be possible to appropriately determine the notification target. On the other hand, if an attribute with high reliability is included in the notification information, there is a low possibility that the recognized attribute is incorrect, and it is possible to appropriately determine the notification target.

[0091] Fifth Embodiment A fifth information processing device 10 will be described with reference to Figures 11 and 12. The fifth information processing device 10 differs in some configurations and operations from the first to fourth information processing devices 10 described above, but other parts may be similar to the first to fourth information processing devices 10. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit explanations of other overlapping parts as appropriate.

[0092] (Functional Configuration) First, the functional configuration of the fifth information processing device 10 will be described with reference to Fig. 11. Fig. 11 is a block diagram showing the functional configuration of the fifth information processing device. Note that in Fig. 11, the same elements as those shown in Fig. 4 are denoted by the same reference numerals.

[0093] 11 , the fifth information processing device 10 is configured to include, as components for realizing its functions, an image acquisition unit 110, an authentication unit 120, an attribute recognition unit 130, a determination unit 140, a notification information determination unit 150, a notification unit 160, and an input detection unit 180. That is, the fifth information processing device 10 further includes the input detection unit 180 in addition to the configuration described in the first embodiment (see FIG. 4 ). Note that the input detection unit 180 may be a processing block realized by the above-mentioned processor 11 (see FIG. 1 ).

[0094] The input detection unit 180 is configured to be able to detect an input by the monitor 60. Specifically, the input detection unit 180 is configured to be able to detect an operation performed by the monitor 60 when he or she wishes to check notification information. In the fifth information processing device 10, as in the above-described embodiments, a notification regarding the notification target is sent to the monitor. However, a situation may arise in which the monitor 60 requests another notification, for example, if he or she misses the notification information. In such a case, the input detection unit 180 detects an operation by the monitor 60 to request another notification. When the input detection unit 180 detects an input by the monitor 60, it instructs the image acquisition unit 110 to acquire a new image. Then, when the image acquisition unit 110 acquires a new image, the notification information determination unit 150 determines new notification information based on the image.

[0095] <Notification information generation process> Next, the notification information generation process executed by the fifth information processing device 10 will be described with reference to Fig. 12. Fig. 12 is a flowchart showing the flow of the notification information generation process by the fifth information processing device. Note that in Fig. 12, the same processes as those shown in Fig. 5 are denoted by the same reference numerals.

[0096] 12, when the fifth information processing device 10 operates, the image acquisition unit 110 first acquires an authentication image (step S11). Then, the authentication unit 120 uses the authentication image acquired by the image acquisition unit 110 to perform authentication processing of the person to be authenticated 50 in the image (step S12).

[0097] Next, the determination unit 140 determines the person to be authenticated 50 to be notified based on the result of the authentication process by the authentication unit 120 (step S13). Then, the attribute recognition unit 130 recognizes the attributes of the person to be authenticated 50 in the image based on the authentication image (step S14).

[0098] Next, the determination unit 140 determines whether there are two or more authentication-subjects 50 in the authentication area R (step S15). If there are not two or more authentication-subjects (step S15: NO), the notification information determination unit 150 does not execute the duplication determination process and determines notification information based on the attributes recognized in step S14 (step S16). Thereafter, the notification unit 160 transmits the notification information determined by the notification information determination unit 150 to the user terminal 20 (step S19).

[0099] On the other hand, if there are two or more people to be authenticated (step S15: YES), the determination unit 140 executes a duplication determination process (step S17). In this case, the notification information determination unit 150 determines notification information based on the determination result of the duplication determination process (step S18). Thereafter, the notification unit 160 transmits the notification information determined by the notification information determination unit 150 to the user terminal 20 (step S19).

[0100] After the notification information is transmitted, the input detection unit 180 determines whether or not an input by the monitor 60 has been detected (step S51). If an input by the monitor 60 has not been detected (step S51: NO), the process ends. On the other hand, if an input by the monitor 60 has been detected (step S51: YES), the image acquisition unit 110 acquires a new image (step S52). Then, the process from step S14 onward is executed again. That is, the duplication determination process is performed using the new image, and a notification (re-notification) is performed using new notification information.

[0101] (Technical Effects) Next, technical effects obtained by the fifth information processing apparatus 10 will be described.

[0102] 11 and 12 , in the fifth information processing device 10, when an input by the monitor 60 is detected, a notification is again made using new notification information. In this way, when the monitor 60 requests reconfirmation of the notification information, it is possible to provide an appropriate notification according to the current situation. For example, even if there were no authenticated persons 50 with overlapping attributes at the time the first notification was made, there is a possibility that an authenticated person 50 with overlapping attributes may have appeared by the time the monitor 60 requests reconfirmation. Even in such cases, if new notification information is determined based on a new image, it is possible to provide an appropriate notification that reflects the current situation.

[0103] The scope of each embodiment also includes a processing method in which a program that operates the configuration of each embodiment to realize the functions of the above-described embodiments is recorded on a recording medium, the program recorded on the recording medium is read as code, and the program is executed on a computer. In other words, a computer-readable recording medium is also included in the scope of each embodiment. Furthermore, each embodiment includes not only a recording medium on which the above-described program is recorded, but also the program itself.

[0104] Examples of recording media that can be used include floppy disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, magnetic tapes, non-volatile memory cards, and ROMs. Furthermore, the scope of each embodiment is not limited to programs that execute processes by themselves, but also includes programs that execute processes by operating on an OS in conjunction with other software or expansion board functions. Furthermore, the program itself may be stored on a server, and part or all of the program may be downloadable from the server to a user terminal. The program may be provided to the user in, for example, a SaaS (Software as a Service) format.

[0105] <Supplementary Notes> The above-described embodiment may be further described as in the following supplementary notes, but is not limited to the following.

[0106] (Supplementary Note 1) The information processing device described in Supplementary Note 1 is an information processing device that includes an acquisition means for acquiring an image including a person to be authenticated in a specified area, an authentication means for performing an authentication process for the person to be authenticated in the image, a recognition means for recognizing attributes of the person to be authenticated in the image, a determination means for determining whether or not the attributes of the person to be authenticated determined to be a notification target based on the result of the authentication process overlap with the attributes of other people to be authenticated who are present in the specified area, a determination means for determining notification information including the attributes of the person to be notified based on the determination result, and a notification means for notifying the notification information by voice.

[0107] (Appendix 2) The information processing device described in Appendix 2 is the information processing device described in Appendix 1, wherein the determination means determines the notification information to include non-overlapping attributes, which are attributes that do not overlap between the notification target and the other authenticated person, when it is determined that the attributes of the notification target and the attributes of the other authenticated person overlap.

[0108] (Appendix 3) The information processing device described in Appendix 3 is the information processing device described in Appendix 2, in which the determination means determines the notification information by combining multiple types of the attributes so that at least some attributes do not overlap between the notification target and the other authenticated person.

[0109] (Appendix 4) The information processing device described in Appendix 4 is the information processing device described in Appendix 2 or 3, wherein the determination means determines the notification information to include overlapping attributes in addition to the non-overlapping attributes when overlapping attributes, which are attributes that overlap between the attribute of the notification target and the other authenticated person, satisfy a predetermined condition.

[0110] (Appendix 5) The information processing device described in Appendix 5 is the information processing device described in any one of Appendices 1 to 4, wherein the determination means determines the notification information to include location information of the notification target when it is determined that the attributes of the notification target and the attributes of the other authenticated person overlap.

[0111] (Supplementary Note 6) The information processing device described in Supplementary Note 6 is the information processing device described in Supplementary Note 5, wherein the determining means determines the notification information so that the notification information includes, in addition to the location information, at least one of the distance from the notification recipient to which the notification information is notified to the notification target, the direction of the notification target as seen from the notification recipient, and landmarks in the vicinity of the notification target.

[0112] (Supplementary Note 7) The information processing device described in Supplementary Note 7 is the information processing device described in any one of Supplements 1 to 6, further comprising a calculation means for calculating a reliability for each of a plurality of attributes, and the determination means determines an attribute to be included in the notification information based on the reliability.

[0113] (Appendix 8) The information processing device described in Appendix 8 is the information processing device described in Appendices 1 to 7, further comprising a detection means for detecting input from a notification recipient to whom the notification information is notified, wherein the determination means, when detecting input from the notification recipient, re-determines whether or not the attributes of the notification target overlap with the attributes of the other authenticated person, and the decision means newly determines notification information including the attributes of the notification target based on the result of the re-determination.

[0114] (Supplementary Note 9) The information processing method described in Supplementary Note 9 is an information processing method that, by at least one computer, acquires an image including a person to be authenticated in a specified area, performs an authentication process for the person to be authenticated in the image, recognizes attributes of the person to be authenticated in the image, determines whether or not the attributes of the person to be authenticated determined to be a notification target based on the result of the authentication process overlap with attributes of other people to be authenticated who are present in the specified area, determines notification information including the attributes of the notification target based on the determination result, and notifies the notification information by voice.

[0115] (Appendix 10) The recording medium described in Appendix 10 is a recording medium having recorded thereon a computer program for causing at least one computer to execute an information processing method, which includes acquiring an image including a person to be authenticated in a specified area, performing an authentication process for the person to be authenticated in the image, recognizing attributes of the person to be authenticated in the image, determining whether or not the attributes of the person to be authenticated who is determined to be a notification target based on the result of the authentication process overlap with attributes of other people to be authenticated who are present in the specified area, determining notification information including the attributes of the person to be notified based on the determination result, and notifying the notification information by voice.

[0116] (Appendix 11) The computer program described in Appendix 11 is a computer program that causes at least one computer to execute an information processing method, which includes acquiring an image including a person to be authenticated in a specified area, performing an authentication process for the person to be authenticated in the image, recognizing attributes of the person to be authenticated in the image, determining whether or not the attributes of the person to be authenticated who has been determined to be a notification target based on the result of the authentication process overlap with attributes of other people to be authenticated who are present in the specified area, determining notification information including the attributes of the notification target based on the determination result, and notifying the notification information by voice.

[0117] This disclosure may be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification, and information processing devices, information processing methods, and recording media that involve such modifications are also included in the technical idea of ​​this disclosure.

[0118] REFERENCE SIGNS LIST 10 Information processing device 11 Processor 12 RAM 13 ROM 14 Storage device 15 Input device 16 Output device 17 Data bus 20 User terminal 201 Display unit 30 Authentication device 301 Camera 50 Person to be authenticated 60 Surveillance officer 110 Image acquisition unit 120 Authentication unit 130 Attribute recognition unit 140 Determination unit 150 Notification information determination unit 160 Notification unit 170 Reliability calculation unit 180 Input detection unit R Authentication area

Claims

1. An information processing device comprising: an acquisition means for acquiring an image including a person to be authenticated in a specified area; an authentication means for performing an authentication process for the person to be authenticated in the image; a recognition means for recognizing attributes of the person to be authenticated in the image; a determination means for determining whether or not the attributes of the person to be authenticated determined to be a notification target based on the result of the authentication process overlap with the attributes of other people to be authenticated who are present in the specified area; a determination means for determining notification information including the attributes of the person to be notified based on the determination result; and a notification means for notifying the notification information by voice.

2. The information processing device of claim 1, wherein the determination means determines the notification information to include non-overlapping attributes that are attributes that do not overlap between the notification target and the other authenticated person when it is determined that the attributes of the notification target and the attributes of the other authenticated person overlap.

3. The information processing device according to claim 2, wherein the determining means determines the notification information by combining a plurality of types of the attributes so that at least some attributes do not overlap between the notification target and the other authenticated person.

4. The information processing device according to claim 2, wherein the determination means determines the notification information so as to include the overlapping attribute in addition to the non-overlapping attribute when the overlapping attribute, which is an attribute that overlaps between the attribute to be notified and the other authenticated person, satisfies a predetermined condition.

5. An information processing device according to any one of claims 1 to 4, wherein the determination means determines the notification information to include location information of the notification target when it is determined that the attributes of the notification target overlap with the attributes of the other authenticated user.

6. The information processing device according to claim 5, wherein the determining means determines the notification information so as to include, in addition to the location information, at least one of the distance from the notification recipient to whom the notification information is notified to the notification target, the direction of the notification target as seen from the notification recipient, and landmarks in the vicinity of the notification target.

7. An information processing device according to any one of claims 1 to 4, further comprising a calculation means for calculating a reliability for each of a plurality of attributes, wherein the determination means determines the attribute to be included in the notification information based on the reliability.

8. An information processing device as described in claims 1 to 4, further comprising a detection means for detecting input from a notification recipient to whom the notification information is notified, wherein when the determination means detects input from the notification recipient, it re-determines whether the attributes of the notification target overlap with the attributes of the other authenticated person, and the decision means newly determines notification information including the attributes of the notification target based on the result of the re-determination.

9. An information processing method comprising: acquiring, by at least one computer, an image including a person to be authenticated in a specified area; performing an authentication process for the person to be authenticated in the image; recognizing attributes of the person to be authenticated in the image; determining whether or not the attributes of the person to be authenticated determined to be a notification target based on the results of the authentication process overlap with attributes of other people to be authenticated who are present in the specified area; determining notification information including the attributes of the notification target based on the determination result; and notifying the notification information by voice.

10. A recording medium having recorded thereon a computer program for causing at least one computer to execute an information processing method, which comprises acquiring an image including a person to be authenticated in a specified area, performing an authentication process for the person to be authenticated in the image, recognizing attributes of the person to be authenticated in the image, determining whether or not the attributes of the person to be authenticated determined to be the subject of notification based on the results of the authentication process overlap with the attributes of other people to be authenticated who are present in the specified area, determining notification information including the attributes of the subject of notification based on the determination result, and notifying the notification information by voice.

Citation Information

Patent Citations

  • Target person tracking method and system and related device

    CN109815818A

  • Suspicious person handling apparatus, suspicious person handling method and program

    JP2015191597A

  • Patient monitoring apparatus

    JP2020146345A

  • Authentication control device, authentication control system, authentication control method, and non-transitory computer readable medium

    WO2022003852A1

  • Monitoring system, camera, analyzing device, and ai model generating method

    WO2022059123A1