Information processing system, information processing device, information processing method, and storage medium

Abstract

An information processing system comprises: an acquisition means for acquiring a captured image captured using a possessed information processing device possessed by an object; and a first determination means for determining, on the basis of a luminance value of the captured image, at least one of whether the object can enter a predetermined area or whether the object can exit the predetermined area.

Description

Information processing system, information processing device, information processing method, and recording medium

[0001] The present disclosure relates to the technical fields of an information processing system, an information processing device, an information processing method, and a recording medium.

[0002] In an area where confidential information is managed (information management area), if an image is taken using a camera equipped in an information terminal, there is a risk that the confidential information may be leaked. For example, Patent Document 1 proposes an information terminal that can prevent confidential information from being taken out of the information management area.

[0003] Japanese Patent Application Laid-Open No. 2014-235718

[0004] An object of this disclosure is to provide an information processing system, an information processing device, an information processing method, and a recording medium that aim to improve the technology related to the above-mentioned prior art documents.

[0005] One aspect of the information processing system includes an acquisition means for acquiring an image captured using an information processing device possessed by a subject, and a first determination means for determining, based on the brightness value of the captured image, at least one of whether the subject is permitted to enter a specified area and whether the subject is permitted to exit the specified area.

[0006] One aspect of an information processing device is an information processing device possessed by a subject, and is equipped with an acquisition means for acquiring an image captured using an imaging function installed therein, and a determination means for determining, based on the brightness value of the captured image, at least one of whether the subject is permitted to enter a specified area and whether the subject is permitted to exit the specified area.

[0007] One aspect of the information processing method is an information processing method executed by a computer, which includes acquiring an image captured using an information processing device possessed by a subject, and determining, based on the brightness value of the image, at least one of whether the subject is allowed to enter a specified area and whether the subject is allowed to exit the specified area.

[0008] One aspect of the recording medium has recorded thereon a computer program for causing a computer to execute an information processing method that includes acquiring an image captured using an information processing device possessed by a subject, and determining, based on the brightness value of the image, at least one of whether the subject is permitted to enter a specified area and whether the subject is permitted to exit the specified area.

[0009] 1 is a block diagram showing a configuration of an example of an information processing device according to the embodiment. 2 is a flowchart showing an example of an operation of the information processing device according to the embodiment. 3 is a block diagram showing a configuration of an example of an information processing system according to the embodiment. 4 is a block diagram showing a configuration of an example of an information processing device according to the embodiment. 5 is a block diagram showing a configuration of an example of an information processing device according to the embodiment. 6 is a flowchart showing an example of an operation of the information processing system according to the embodiment. 7 is a block diagram showing a configuration of an example of an information processing system according to the embodiment. 8 is a flowchart showing an example of an operation of the information processing system according to the embodiment. 9 is a block diagram showing a configuration of an example of an information processing system according to the embodiment. 10 is a flowchart showing an example of an operation of the information processing system according to the embodiment. 11 is a block diagram showing a configuration of an example of an information processing system according to the embodiment. 12 is a flowchart showing an example of an operation of the information processing system according to the embodiment.

[0010] [1: First embodiment]

[0011] An information processing system, an information processing device, an information processing method, and a recording medium according to a first embodiment will be described with reference to Fig. 1 and Fig. 2. In the following, the information processing system, the information processing device, the information processing method, and the recording medium according to the first embodiment will be described using an information processing device 10.

[0012] 1, the information processing device 10 includes a first acquisition unit 11 and a first determination unit 12. The operation of the information processing device 10 will be described with reference to the flowchart of FIG.

[0013] As shown in FIG. 2 , the first acquisition unit 11 acquires captured images captured using an information processing device owned by the subject (step S11). The first acquisition unit 11 may acquire captured images captured using an information processing device carried by the subject. Alternatively, the first acquisition unit 11 may acquire captured images captured using an information processing device owned by the subject. The information processing device may include, for example, a small surveillance camera installed by the subject in a location that provides a bird's-eye view of the surroundings, such as on top of a storage shed. The subject may install the information processing device in an out-of-sight location. The first acquisition unit 11 may acquire captured images captured using an information processing device installed by the subject. The subject may retrieve the installed information processing device after capturing the image. The subject may wish to enter or exit a predetermined area. The predetermined area may be an area where the subject's freedom to capture images is restricted. The information processing device owned by the subject may be the information processing device 10 itself. In this case, the captured image may be an image acquired using an imaging function installed in the information processing device 10.

[0014] The first determination unit 12 determines whether the target can enter the predetermined area or whether the target can exit the predetermined area based on the brightness value of the captured image (step S12). For example, if the brightness value of the captured image is less than a predetermined value, this indicates a state in which the imaging function of the information processing device cannot receive light. In other words, if the brightness value of the captured image is less than a predetermined value, this may indicate a state in which no light is incident on the imaging function of the information processing device. If the brightness value of the captured image is less than a predetermined value, this may indicate a state in which the imaging function of the information processing device cannot freely capture images of the predetermined area.

[0015] The first determination unit 12 may determine that the subject is allowed to enter the predetermined area or may determine that the subject is allowed to exit from the predetermined area when the imaging function of the information processing device is in a state where it cannot freely image the predetermined area. Furthermore, the first determination unit 12 may determine that the subject is not allowed to enter the predetermined area or may determine that the subject is not allowed to exit from the predetermined area when the imaging function of the information processing device is in a state where it can freely image the predetermined area.

[0016] In this way, the information processing device 10 performs an information processing method that includes acquiring an image captured using an information processing device owned by the subject, and determining whether the subject is allowed to enter a specified area or whether the subject is allowed to exit from the specified area based on the brightness value of the captured image.

[0017] The information processing device 10 described above may be realized by a computer reading a computer program recorded on a recording medium. In this case, the recording medium may have recorded thereon a computer program for causing the computer to execute an information processing method including acquiring an image captured using an information processing device owned by a subject, and determining whether the subject is permitted to enter a predetermined area or whether the subject is permitted to exit the predetermined area based on a brightness value of the captured image.

[0018] In this embodiment, the information processing device 10 includes the first acquisition unit 11 and the first determination unit 12. However, as will be described in other embodiments, the functions of the first acquisition unit 11 and the first determination unit 12 may be realized in different devices. [Technical effect]

[0019] The information processing device 10 according to this disclosure can restrict a subject from freely taking images in a predetermined area where the subject's freedom to take images is restricted. Furthermore, the information processing device 10 can restrict a camera or the like from freely taking images in a predetermined area where the subject's freedom to take images is restricted by the imaging function of the camera or the like. Therefore, the information processing device 10 can realize measures against information theft, information leaks, espionage, etc. [2: Second Embodiment]

[0020] A second embodiment of an information processing system, an information processing device, an information processing method, and a recording medium will be described with reference to Figures 3 to 6. Hereinafter, the second embodiment of an information processing system, an information processing device, an information processing method, and a recording medium will be described using an information processing system S. Note that, with regard to the second embodiment, descriptions that overlap with the description of the first embodiment will be omitted as appropriate.

[0021] The information processing system S according to this embodiment may be applied to managing the entry and exit of subjects to a predetermined area (referred to as a "restricted area") where entry and exit are restricted. The restricted area may be an area where only subjects permitted to enter can enter. The restricted area may be an area where even subjects permitted to enter are restricted from freely taking images. The restricted area may be, for example, a factory site. Therefore, except in special cases, subjects cannot bring any objects possessing an imaging function into the restricted area. For example, subjects may be required to deposit any objects possessing an imaging function before entering the restricted area.

[0022] The special case is when an item with an imaging function, but not using the imaging function, needs to be brought into the restricted area. Examples of items with an imaging function include notebook personal computers (notebook PCs), tablets, smartphones, and wearable devices. For example, a presentation using a notebook PC in the restricted area is an example of a case where an item with an imaging function needs to be brought into the restricted area.

[0023] In such special cases where an item with an imaging function but not using the imaging function needs to be brought into a restricted area, a light-blocking material may be attached to the lens portion before entering the restricted area to prevent light from entering the imaging function. When the light-blocking material is properly attached to the lens portion, the brightness value of an image captured using the imaging function will be less than a predetermined value. The predetermined value may be 0. In other words, when the light-blocking material is properly attached to the lens portion, nothing may appear in the captured image.

[0024] The light-blocking member may be a seal member. The light-blocking member may have an irreversible property that results in a different state when attached and when removed. For example, the light-blocking member may be a member that completely blocks light from the attached area when attached, but when removed, letters, patterns, etc. are revealed, making it impossible to block light from the area. The light-blocking member may also be a member that breaks when an attempt is made to remove the attached member. When the member breaks, a staff member, security guard, etc. in the restricted area can know that a target has attempted to remove the seal member. The staff member in the restricted area may be a person who manages entry and exit to the restricted area. Such a light-blocking member is called a "security seal."

[0025] As shown in Fig. 3, the information processing system S includes a possessed information processing device 20 and an entrance / exit management device 30. The possessed information processing device 20 and the entrance / exit management device 30 are configured to be able to communicate with each other. The possessed information processing device 20 and the entrance / exit management device 30 may communicate wirelessly or by wire. The possessed information processing device 20 may be the above-mentioned item with an imaging function that needs to be brought into the restricted area, and is possessed by the subject. The entrance / exit management device 30 may be an installed information processing device, such as a personal computer or a server. [2-1: Configuration of the possessed information processing device 20]

[0026] Next, the configuration of the possessive information processing device 20 will be described with reference to Fig. 4. Fig. 4 is a block diagram showing the configuration of the possessive information processing device 20.

[0027] 4 , the possessive information processing device 20 includes a calculation device 21, a storage device 22, a communication device 23, and a camera 27. The possessive information processing device 20 may further include an input device 24 and an output device 25. However, the possessive information processing device 20 does not have to include at least one of the input device 24 and the output device 25. The calculation device 21, the storage device 22, the communication device 23, the camera 27, the input device 24, and the output device 25 may be connected via a data bus 26.

[0028] The arithmetic device 21 includes at least one processor (i.e., one processor or multiple processors) as hardware. The processor may include, for example, a processor conforming to a von Neumann computer architecture. The processor conforming to the von Neumann computer architecture may include at least one of a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit). The processor may include, for example, a processor conforming to a non-von Neumann computer architecture. The processor conforming to the non-von Neumann computer architecture may include at least one of an FPGA (Field Programmable Gate Array) and an ASIC (Application Specific Circuit).

[0029] The arithmetic device 21 reads a computer program 221 including at least one of computer program code and computer program instructions. For example, the arithmetic device 21 may read the computer program 221 stored in the storage device 22. For example, the arithmetic device 21 may read the computer program 221 stored in a computer-readable, non-transitory storage medium using a storage medium reading device (not shown) included in the possessive information processing device 20. The computer program 221 read from the storage medium may be stored in the storage device 22. The arithmetic device 21 may acquire (i.e., download or read) the computer program 221 from a device (not shown) located outside the possessive information processing device 20 via the communication device 23 (or another communication device). The downloaded computer program 221 may be stored in the storage device 22.

[0030] The arithmetic device 21 executes the loaded computer program 221. As a result, logical functional blocks for executing information processing to be performed by the possessive information processing device 20 are realized within the arithmetic device 21. In other words, the arithmetic device 21, together with the storage device 22 or the like in which the computer program 221 is recorded (in other words, together with the storage device 22 and the computer program 221 recorded in the storage device 22 or the like), can function as a controller or computer for realizing logical functional blocks for executing processing to be performed by the possessive information processing device 20. In other words, the at least one processor included in the arithmetic device 21, the memory (recording medium) included in the storage device 22 or the like, and the computer program 221 are configured so that the possessive information processing device 20 performs the information processing to be performed by the possessive information processing device 20.

[0031] The recording medium for recording the computer program 221 executed by the arithmetic device 21 may be at least one of a CD-ROM, CD-R, CD-RW, flexible disk, MO, DVD-ROM, DVD-RAM, DVD-R, DVD+R, DVD-RW, DVD+RW, Blu-ray (registered trademark), or other optical disk, a magnetic medium such as a magnetic tape, a magneto-optical disk, a semiconductor memory such as a USB memory, or any other medium capable of storing a program. The recording medium may include a device capable of recording a computer program (for example, a general-purpose device or a dedicated device in which the computer program 221 is implemented in a state in which it can be executed in at least one of the forms of software and firmware). Furthermore, each process or function included in the computer program 221 may be realized by a logical processing block realized within the arithmetic device 21 when the arithmetic device 21 (i.e., processor) executes the computer program 221, or may be realized by hardware such as a predetermined gate array (FPGA (Field Programmable Gate Array), ASIC (Application Specific Integrated Circuit)) provided in the arithmetic device 21, or may be realized in a form that mixes logical processing blocks and partial hardware modules that realize some elements of the hardware.

[0032] The storage device 22 includes at least one memory capable of storing desired data. In other words, the storage device 22 includes at least one memory containing desired data. For example, the storage device 22 may store a computer program 221 executed by the arithmetic device 21. In this case, the storage device 22 (memory) may be used as the above-mentioned recording medium for recording the computer program 221 executed by the arithmetic device 21. The storage device 22 may temporarily store data used by the arithmetic device 21 when the arithmetic device 21 executes the computer program 221. The storage device 22 may also store data to be stored long-term by the information processing device 20. The storage device 22 may include at least one of a RAM (Random Access Memory), a ROM (Read Only Memory), a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device. In other words, the storage device 22 may include a non-temporary recording medium.

[0033] The communication device 23 may be capable of communicating with a device (e.g., the entry / exit management device 30) external to the possessive information processing device 20. The communication device 23 may perform wired communication or wireless communication.

[0034] The camera 27 may capture images using light having a predetermined wavelength. The camera 27 may be a camera capable of capturing images using light in the visible wavelength range (a so-called visible light camera). The camera 27 may be a camera capable of capturing images using light in the near-infrared wavelength range (a so-called near-infrared camera). Alternatively, the possessive information processing device 20 may be equipped with a visible light camera and a near-infrared camera.

[0035] The input device 24 is a device capable of accepting information input to the possessive information processing device 20 from the outside. The input device 24 may include an operation device (e.g., a keyboard, a mouse, a touch panel, etc.) that can be operated by a user of the possessive information processing device 20. The input device 24 may include a recording medium reading device that can read information recorded on a recording medium that is detachable from the possessive information processing device 20, such as a USB (Universal Serial Bus) memory. Note that when information is input to the possessive information processing device 20 via the communication device 23 (in other words, when the possessive information processing device 20 acquires information via the communication device 23), the communication device 23 may function as an input device.

[0036] The output device 25 is a device capable of outputting information to the outside of the possessive information processing device 20. The output device 25 may output visual information such as text or images, auditory information such as sound, or tactile information such as vibration, as the information. The output device 25 may include, for example, at least one of a display, a speaker, a printer, and a vibration motor. The output device 25 may be capable of outputting information to a recording medium detachable from the possessive information processing device 20, such as a USB memory. Note that when the possessive information processing device 20 outputs information via the communication device 23, the communication device 23 may function as the output device.

[0037] 4 shows an example of logical functional blocks realized in the arithmetic device 21 to execute information processing. As shown in FIG. 4, a first acquisition unit 211, a second acquisition unit 213, and a transmission unit 214 are realized in the arithmetic device 21. The "first acquisition unit 211" is a component corresponding to the "first acquisition unit 11" in the first embodiment described above. Note that the processes performed by the first acquisition unit 211, the second acquisition unit 213, and the transmission unit 214 will be described in detail later with reference to FIG. 6, and therefore will not be described here.

[0038] The computer program 221 in this embodiment may include an application program 22a. The application program 22a may be installed in the possessive information processing device 20, and the application program 22a may implement at least the first acquisition unit 211 and the transmission unit 214. [2-2: Configuration of the entry / exit management device 30]

[0039] Next, the configuration of the entrance / exit management device 30 will be described with reference to Fig. 5. Fig. 5 is a block diagram showing the configuration of the entrance / exit management device 30.

[0040] 5, the entrance / exit management device 30 includes a calculation device 31, a storage device 32, a communication device 33, and a camera 37. The entrance / exit management device 30 may further include an input device 34 and an output device 35. However, the entrance / exit management device 30 does not have to include at least one of the input device 34 and the output device 35. The calculation device 31, the storage device 32, the communication device 33, the camera 37, the input device 34, and the output device 35 may be connected via a data bus 36.

[0041] The arithmetic device 31 includes at least one processor (i.e., one processor or multiple processors) as hardware. The processor may include, for example, a processor conforming to a von Neumann computer architecture. The processor conforming to the von Neumann computer architecture may include at least one of a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit). The processor may include, for example, a processor conforming to a non-von Neumann computer architecture. The processor conforming to the non-von Neumann computer architecture may include at least one of an FPGA (Field Programmable Gate Array) and an ASIC (Application Specific Circuit).

[0042] The arithmetic device 31 reads a computer program 321 including at least one of computer program code and computer program instructions. For example, the arithmetic device 31 may read the computer program 321 stored in the storage device 32. For example, the arithmetic device 31 may read the computer program 321 stored in a computer-readable, non-transitory storage medium using a storage medium reading device (not shown) included in the access control device 30. The computer program 321 read from the storage medium may be stored in the storage device 32. The arithmetic device 31 may acquire (i.e., download or read) the computer program 321 from a device (not shown) located outside the access control device 30 via the communication device 33 (or another communication device). The downloaded computer program 321 may be stored in the storage device 32.

[0043] The arithmetic device 31 executes the loaded computer program 321. As a result, logical functional blocks for executing the information processing that the access control device 30 should perform are realized within the arithmetic device 31. In other words, the arithmetic device 31, together with the storage device 32 etc. in which the computer program 321 is recorded (in other words, together with the storage device 32 and the computer program 321 recorded in the storage device 32 etc.), can function as a controller or computer for realizing the logical functional blocks for executing the processing that the access control device 30 should perform. In other words, the at least one processor included in the arithmetic device 31, the memory (recording medium) included in the storage device 32 etc., and the computer program 321 are configured so that the access control device 30 performs the information processing that the access control device 30 should perform.

[0044] The recording medium for recording the computer program 321 executed by the arithmetic device 31 may be at least one of the following: a CD-ROM, CD-R, CD-RW, a flexible disk, an MO, a DVD-ROM, a DVD-RAM, a DVD-R, a DVD+R, a DVD-RW, a DVD+RW, or an optical disk such as Blu-ray (registered trademark), a magnetic medium such as a magnetic tape, a magneto-optical disk, a semiconductor memory such as a USB memory, or any other medium capable of storing a program. The recording medium may include a device capable of recording the computer program 321 (for example, a general-purpose device or a dedicated device in which the computer program 321 is implemented in a state in which it can be executed in at least one of the forms of software and firmware). Furthermore, each process or function included in the computer program 321 may be realized by a logical processing block realized within the arithmetic device 31 (i.e., processor) when the arithmetic device 31 executes the computer program 321, or may be realized by hardware such as a predetermined gate array (FPGA (Field Programmable Gate Array), ASIC (Application Specific Integrated Circuit)) provided in the arithmetic device 31, or may be realized in a form that mixes logical processing blocks and partial hardware modules that realize some elements of the hardware.

[0045] The storage device 32 includes at least one memory capable of storing desired data. In other words, the storage device 32 includes at least one memory containing desired data. For example, the storage device 32 may store a computer program 321 executed by the arithmetic device 31. In this case, the storage device 32 (memory) may be used as the above-mentioned recording medium for recording the computer program 321 executed by the arithmetic device 31. The storage device 32 may temporarily store data used by the arithmetic device 31 when the arithmetic device 31 is executing the computer program 321. The storage device 32 may also store data to be stored long-term by the access control device 30. The storage device 32 may include at least one of a RAM (Random Access Memory), a ROM (Read Only Memory), a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device. In other words, the storage device 32 may include a non-temporary recording medium.

[0046] The communication device 33 may be capable of communicating with a device (for example, the possessed information processing device 20) external to the entry / exit management device 30. The communication device 33 may perform wired communication or wireless communication.

[0047] The camera 37 may capture images using light having a predetermined wavelength. The camera 37 may be a camera capable of capturing images using light in the visible wavelength range (a so-called visible light camera). The camera 37 may be a camera capable of capturing images using light in the near-infrared wavelength range (a so-called near-infrared camera). Alternatively, the entrance / exit management device 30 may be equipped with a visible light camera and a near-infrared camera.

[0048] The input device 34 is a device capable of accepting information input to the access control device 30 from outside. The input device 34 may include an operation device (e.g., a keyboard, a mouse, a touch panel, etc.) that can be operated by a user of the access control device 30. The input device 34 may include a recording medium reading device that can read information recorded on a recording medium that is detachable from the access control device 30, such as a USB (Universal Serial Bus) memory. Note that when information is input to the access control device 30 via the communication device 33 (in other words, when the access control device 30 obtains information via the communication device 33), the communication device 33 may function as an input device.

[0049] The output device 35 is a device capable of outputting information to the outside of the access control device 30. The output device 35 may output visual information such as text or images, auditory information such as sound, or tactile information such as vibration, as the information. The output device 35 may include, for example, at least one of a display, a speaker, a printer, and a vibration motor. The output device 35 may be capable of outputting information to a recording medium that is detachable from the access control device 30, such as a USB memory. Note that when the access control device 30 outputs information via the communication device 33, the communication device 33 may function as an output device.

[0050] 5 shows an example of logical functional blocks realized in the arithmetic device 31 to execute information processing. As shown in FIG. 5, a first determination unit 312, a third acquisition unit 315, a first authentication unit 316, and an entry / exit control unit 317 are realized in the arithmetic device 31. The "first determination unit 312" is a component corresponding to the "first determination unit 12" in the first embodiment described above. Note that the processes performed by the first determination unit 312, the third acquisition unit 315, the first authentication unit 316, and the entry / exit control unit 317 will be described in detail later with reference to FIG. 6, and therefore will not be described here. [2-3: Information Processing Method Executed by Information Processing System S]

[0051] The information processing system S is configured as a system for managing items brought into a restricted area by a subject entering or leaving the restricted area. An information processing method executed by the information processing system S will be described with reference to Fig. 6. Fig. 6 is a flowchart showing the flow of the information processing method executed by the information processing system S. In the second embodiment, the operation by the information processing system S when a subject enters and the operation by the information processing system S when the subject exits may be the same.

[0052] 6 , when the information processing operation by the information processing system S starts, the third acquisition unit 315 acquires biometric information of the target (step S21). The biometric information is information related to physical characteristics of the target. Examples of the biometric information include at least one of a facial image including the target's face, an iris image including the target's iris, a fingerprint pattern of the target, a palmprint pattern of the target, a vein pattern of the target's fingers and palm, audio information including the target's voice, and sound information including the target's otoacoustic emissions.

[0053] The first authentication unit 316 performs biometric authentication of the target using biometric information (step S22). Examples of authentication using biometric information include at least one of face authentication, iris authentication, fingerprint authentication, palm print authentication, vein authentication, voice print authentication, and ear acoustic authentication. The target may be authenticated using one piece of biometric information. Alternatively, the target may be authenticated using a combination of multiple pieces of biometric information. In other words, the first authentication unit 316 may perform multimodal biometric authentication.

[0054] In this embodiment, a case will be described in which the first authentication unit 316 performs at least one of face authentication using a face image and iris authentication using an eye image. When the first authentication unit 316 performs face authentication using a face image, the third acquisition unit 315 acquires a face image including the target's face. The third acquisition unit 315 may acquire a face image captured and generated by the camera 37. The first authentication unit 316 may calculate a face matching score (referred to as a "face matching score") as the first matching score by matching the face image with a pre-registered face image. Alternatively, the first authentication unit 316 may calculate the face matching score as the first matching score by matching feature amounts extracted from the face image with pre-registered feature amounts.

[0055] When the first authentication unit 316 performs iris authentication using an eye image, the third acquisition unit 315 acquires an eye image including the target's eye. The third acquisition unit 315 may acquire an eye image captured and generated by the camera 37. The first authentication unit 316 may generate an iris image by extracting an area corresponding to the target's iris from the eye image. The first authentication unit 316 may compare the iris image with a pre-registered iris image to calculate a matching score related to the iris (referred to as an "iris matching score") as the second matching score. Alternatively, the first authentication unit 316 may compare feature amounts extracted from the iris image with pre-registered feature amounts to calculate the iris matching score as the second matching score.

[0056] The matching score (e.g., face matching score and iris matching score) may mean a value indicating the degree of match between the target biometric information and pre-registered biometric information. The matching score may also mean a value indicating the degree of match between the feature extracted from the target biometric information and the pre-registered feature.

[0057] In biometric authentication, if the matching score is equal to or greater than a predetermined threshold, it is determined that the subject (i.e., the person to be authenticated) is a person who has been registered in advance (i.e., a registered person). For example, in the case of multimodal biometric authentication in which multiple modals are used in combination, a matching score is calculated for each modal. In multimodal biometric authentication, if all of the multiple matching scores are equal to or greater than a predetermined threshold, it may be determined that the subject is a registered person.

[0058] Note that if biometric authentication identifies a person as being permitted to bring the information processing device 20 having an image capturing function into a restricted area, the determination of whether the image capturing function can be used (steps S23 to S27 described below) may be omitted. Furthermore, if biometric authentication fails, the entry / exit control unit 317 may output an alert. The entry / exit control unit 317 may notify a security guard (including a robot) that there is a subject whose biometric authentication has failed. Furthermore, the entry / exit control unit 317 may control the closing of the entry / exit gate to prevent the subject from entering or exiting.

[0059] If the biometric authentication of the target is successful (step S22: successful), the first acquisition unit 211 acquires (step S23) the captured image captured by the camera 27. In other words, the application program 22a controls the capture of the image by the camera 27, thereby realizing the acquisition of the captured image.

[0060] The second acquisition unit 213 acquires location information related to the captured image (step S24). The second acquisition unit 213 may acquire location information of the possessed information processing device 20. The second acquisition unit 213 may acquire location information of the possessed information processing device 20 when capturing an image with the camera 27. Note that the order of execution of step S21 and step S22 does not matter. They may be executed in parallel.

[0061] The transmitting unit 214 transmits the captured image, the positional information related to the captured image, and the information indicating the time when the image was captured to the entry / exit management device 30 (step S25). In other words, the application program 22a controls the communication device 23 to realize the transmission of the captured image, the positional information related to the captured image, and the information indicating the time when the image was captured.

[0062] The first determination unit 312 determines whether the target is permitted to enter or exit the restricted area based on the brightness value of the captured image, location information related to the captured image, and information indicating the time of capture (step S26). The first determination unit 312 may determine whether the brightness value of the captured image is equal to or less than a predetermined value (e.g., 0). In this case, the first determination unit 312 may permit the target to enter or exit the restricted area if the brightness value of the captured image is equal to or less than the predetermined value. The first determination unit 312 may permit the target to enter or exit the restricted area if the captured image was captured at a location where the target is entering or exiting the restricted area.

[0063] The function of the first determination unit 312 may be included in the possessive information processing device 20. In this case, the function of the first determination unit 312 may be realized by the application program 22a. In this case, the transmission unit 214 may transmit the determination result by the application program 22a to the entry / exit management device 30.

[0064] The entry / exit control unit 317 permits entry or exit depending on the determination result (step S27). If the imaging function determination result indicates that entry / exit is not permitted, the entry / exit control unit 317 may output an alert. The entry / exit control unit 317 may notify a security guard (including a robot) that there is a subject for whom the imaging function determination result indicates that entry / exit is not permitted. The entry / exit control unit 317 may also control the closure of the entry / exit gate to prevent the subject from entering or exiting. If the entry / exit control unit 317 denies entry, it may not open the entry gate and prevent the subject from entering the restricted area. If the entry / exit control unit 317 denies exit, it may not open the exit gate and stop the subject in the entrance area.

[0065] The application program 22a may also have a function of monitoring the operation of the camera 27. For example, when the camera 27 operates within a restricted area, the application program 22a may transmit an image captured by the camera 27 and location information related to the captured image to the entrance / exit management device 30. In this way, the application program 22a may notify a security guard (including a robot) that the camera 27 has operated within the restricted area. [2-4: Technical Effects]

[0066] The information processing system S according to this disclosure can restrict a subject from freely taking images in an area where the subject's freedom to take images is restricted. Therefore, the information processing system S can realize measures against information theft, information leaks, espionage, etc. [3: Third Embodiment]

[0067] A third embodiment relating to an information processing system, an information processing device, an information processing method, and a recording medium will be described with reference to Figures 7 and 8. Below, the third embodiment relating to an information processing system, an information processing device, an information processing method, and a recording medium will be described using an information processing system S. Note that, for the third embodiment, descriptions that overlap with the descriptions of the first and second embodiments will be omitted as appropriate. Note that, in the drawings, parts common to the second embodiment are indicated by the same reference numerals.

[0068] 7, the information processing system S according to the third embodiment may include a possession information processing device 20 and an entry / exit management device 30. The calculation device 31 included in the entry / exit management device 30 according to the third embodiment may have, as logically realized functional blocks or as physically realized processing circuits, a fourth acquisition unit 318, a fifth acquisition unit 319, an identification unit 320, and a matching unit 321 in addition to a first determination unit 312, a third acquisition unit 315, a first authentication unit 316, and an entry / exit control unit 317. [3-1: Information Processing Method Executed by the Information Processing System S]

[0069] An information processing method executed by the information processing system S will be described with reference to Fig. 8. Fig. 8 is a flowchart showing the flow of the information processing method executed by the information processing system S. In the third embodiment, the operation by the information processing system S when a target enters and the operation by the information processing system S when the target exits may be the same.

[0070] 8, when the information processing operation by the information processing system S starts, the third acquisition unit 315 acquires biometric information of the target (step S21). The first authentication unit 316 performs biometric authentication of the target using the biometric information (step S22).

[0071] If the biometric authentication of the target is successful (step S22: successful), the fourth acquisition unit 318 acquires possession information related to the possessed information processing device 20 possessed by the target, which is associated with the target identified by the biometric authentication (step S31). The possession information includes security seal information related to the security seal associated with the possessed information processing device 20.

[0072] The fifth acquisition unit 319 acquires an image including the possessive information processing device 20 (step S32). The fifth acquisition unit 319 may control the camera 37 to acquire an image including the possessive information processing device 20.

[0073] The identification unit 320 identifies at least one of the state and number of security seals currently affixed to the possessed information processing device 20 based on an image including the possessed information processing device 20 (step S33). The identification unit 320 may use image analysis to confirm whether a security seal is affixed to the lens portion of the possessed information processing device 20. The identification unit 320 may confirm whether the security seal has been removed. If the security seal has an irreversible property that results in a different state when affixed and when removed, the identification unit 320 can confirm whether the security seal has been removed based on an image including the possessed information processing device 20. If the identification unit 320 confirms that the security seal has been removed, it may output an alert to staff, security guards, etc. in the restricted area.

[0074] The collation unit 321 collates at least one of the state and number of security seals currently affixed to the possessive information processing device 20 with the security seal information (step S34).

[0075] If the verification unit 321 verifies that the state and number of security stickers match, the first acquisition unit 211 acquires the captured image captured by the camera 27 (step S23), and the second acquisition unit 213 acquires location information related to the captured image (step S24). The transmission unit 214 transmits the captured image, location information related to the captured image, and information indicating the time of capture to the entry / exit management device 30 (step S25). The first determination unit 312 determines whether or not the person is allowed to enter or exit the restricted area based on the brightness value of the captured image, the location information related to the captured image, and the information indicating the time of capture (step S26). The entry / exit control unit 317 permits entry or exit depending on the determination result (step S27). [3-2: Technical Effects]

[0076] In this embodiment, the target and the authorized device are registered in association with each other, and the authorized device and the security seal corresponding to the device are also registered in association with each other. The information processing system S according to this disclosure can identify the target using biometric authentication to identify the authorized device associated with the target, thereby preventing the target from bringing unauthorized devices into the restricted area. Furthermore, the information processing system S identifies at least one of the state and number of security seals currently affixed to the personal information processing device 20, so it can allow the personal information processing device 20 with the security seal properly affixed to it to be brought into the restricted area. [4: Fourth Embodiment]

[0077] A fourth embodiment relating to an information processing system, an information processing device, an information processing method, and a recording medium will be described with reference to Figures 9 and 10. Below, the fourth embodiment relating to an information processing system, an information processing device, an information processing method, and a recording medium will be described using an information processing system S. Note that, for the fourth embodiment, descriptions that overlap with the descriptions of the first to third embodiments will be omitted as appropriate. Note that, in the drawings, parts common to the second and third embodiments are designated by the same reference numerals.

[0078] 9, the information processing system S according to the fourth embodiment may include a possessed information processing device 20 and an entry / exit management device 30. The calculation device 31 included in the entry / exit management device 30 may have, as logically realized functional blocks or as physically realized processing circuits, a sixth acquisition unit 322, a detection unit 323, a second determination unit 324, an instruction unit 325, and a registration unit 326 in addition to a first determination unit 312, a third acquisition unit 315, a first authentication unit 316, an entry / exit control unit 317, and a fifth acquisition unit 319. [4-1: Information Processing Method Executed by the Information Processing System S]

[0079] The information processing system S is configured as a system for managing items brought into a restricted area by a subject entering or exiting the restricted area. An information processing method executed by the information processing system S will be described with reference to FIG. 10 . FIG. 10 is a flowchart showing the flow of the information processing method executed by the information processing system S. The information processing method executed by the information processing system S, which will be described with reference to FIG. 10 , may be an operation performed by the information processing system S when a subject enters the restricted area. When a subject enters the restricted area, the information processing system S may instruct the subject to place all electronic devices in their possession into a specific container. Examples of electronic devices include personal computers (including laptops and tablet computers), smartphones, digital cameras, video cameras, etc. Furthermore, when a subject enters the restricted area, the information processing system S may check whether the subject is carrying electronic devices in a location other than the specific container.

[0080] 10, when the information processing operation by the information processing system S starts, the third acquisition unit 315 acquires biometric information of the target (step S21). The first authentication unit 316 performs biometric authentication of the target using the biometric information (step S22).

[0081] If the biometric authentication of the subject is successful (step S22: successful), the sixth acquisition unit 322 acquires an image of a specific container (referred to as a "container image") carried by the subject (step S41). The sixth acquisition unit 322 may acquire the container image captured by the camera 37. The specific container may be made of a material that transmits light having a predetermined wavelength. In the fourth embodiment, the camera 37 may capture an image of the container using light having a predetermined wavelength. The light having a predetermined wavelength may be near-infrared light.

[0082] The detection unit 323 detects the items contained in the container by applying predetermined image processing to the container image (step S42). The second determination unit 324 determines whether the detected items include a predetermined item to which a security seal should be affixed (step S43).

[0083] If it is determined that the detected items include a predetermined item, the instruction unit 325 instructs the target on the position on the predetermined item where the security seal should be affixed (step S44). The instruction unit 325 may instruct the target on the position where the security seal should be affixed by displaying the position of the lens of the possessed information processing device 20 on a display. The target affixes the security seals while the number of seals is confirmed under the supervision of a security guard (including a robot), a camera, or the like.

[0084] If it is determined that the detected items include a plurality of predetermined items (i.e., if the predetermined items include a first item and a second item), the instructing unit 325 may instruct the target to affix a first security seal to the first item and a second security seal to the second item. For example, the first item may be a notebook PC, and the second item may be a tablet PC.

[0085] The second security seal may be different from the first security seal. The first security seal and the second security seal may differ from each other in at least one of shape, pattern, and color. Each security seal may appear the same when imaged using visible light, but may have a different pattern when imaged using near-infrared light. For example, even if a subject brings multiple devices of the same type into a restricted area, the affixed security seals can distinguish each device. By making the security seals different in shape, pattern, color, etc., it is possible to manage each device even when multiple devices of the same type are brought in.

[0086] The fifth acquisition unit 319 acquires an article image including a predetermined article to which a security seal is attached (step S45). The fifth acquisition unit 319 may acquire an article image captured by the camera 37.

[0087] The registration unit 326 identifies the relationship between the specified item and the security seal affixed to the specified item based on the item image. The registration unit 326 registers security seal information indicating the correspondence between the specified item and the security seal affixed to the specified item (step S46). The security seal information may be registered by being included in terminal information that associates the target with the possessed information processing device 20. The security seal information may be, for example, information that associates the shape, pattern, color, texture, etc. of the security seal with information such as the shape, pattern, color, texture, type (different versions) of the possessed information processing device 20 around the affixed security seal.

[0088] The first acquisition unit 211 acquires the captured image captured by the camera 27 (step S23). The second acquisition unit 213 acquires location information related to the captured image (step S24). The transmission unit 214 transmits the captured image, the location information related to the captured image, and information indicating the time when the image was captured to the entry / exit management device 30 (step S25).

[0089] The first determination unit 312 determines whether or not the person is permitted to enter the restricted area based on the brightness value of the captured image, the positional information of the captured image, and the information indicating the time when the image was captured (step S26). The entry / exit control unit 317 permits entry or exit depending on the determination result (step S27).

[0090] Note that the operation of the information processing system S when the target exits in the fourth embodiment may be the same as the operation of the information processing system S when the target exits in at least one of the second and third embodiments. [4-2: Technical Effects]

[0091] The information processing system S according to this disclosure can identify an item being brought in by storing it in a container made of a material that transmits light having a predetermined wavelength. The information processing system S can determine whether the object is a malicious person by specifying the affixing of a security seal to the object and confirming that the object has affixed the seal as specified. The information processing system S affixes security seals that look different in near-infrared light but the same in visible light, making it possible to detect the affixing of fraudulent security seals (for example, intentional affixing of an unspecified security seal by a malicious person). [5: Fifth Embodiment]

[0092] A fifth embodiment relating to an information processing system, an information processing device, an information processing method, and a program will be described with reference to Figures 11 to 14. Hereinafter, the fifth embodiment relating to an information processing system, an information processing device, an information processing method, and a program will be described using an information processing system S. Note that, for the fifth embodiment, descriptions that overlap with the descriptions of the first to fourth embodiments will be omitted as appropriate. Note that, in the drawings, parts common to the first to fourth embodiments are indicated by the same reference numerals.

[0093] In the fifth embodiment, the restricted area may include a first restricted area and a second restricted area. The first restricted area may be a restricted area to which entry is permitted when no light is incident on the imaging function of the information processing device 20. In contrast, the second restricted area may be a restricted area to which entry is permitted by disabling the imaging function. On the other hand, the second restricted area may be a restricted area to which the imaging function can be enabled with the permission of a person with authorization. [5-1: Configuration of the Information Processing System S]

[0094] The information processing system S according to the fifth embodiment may include a personal information processing device 20 and an entry / exit management device 30. As shown in FIG. 11 , the personal information processing device 20 according to the fourth embodiment may further include a fingerprint sensor 28. The arithmetic device 21 included in the personal information processing device 20 may include, as logically realized functional blocks or physically realized processing circuits, an image providing unit 215, a switching unit 216, and a second authentication unit 217 in addition to a first acquisition unit 211, a second acquisition unit 213, and a transmission unit 214. As shown in FIG. 12 , the arithmetic device 31 included in the entry / exit management device 30 may include, as logically realized functional blocks or physically realized processing circuits, a seventh acquisition unit 327 and a third determination unit 328 in addition to a first determination unit 312, a third acquisition unit 315, a first authentication unit 316, and an entry / exit control unit 317. [5-2: Information Processing Method Executed by the Information Processing System S]

[0095] The information processing system S is configured as a system for managing items brought into a restricted area by a subject entering or leaving the restricted area. An information processing method executed by the information processing system S will be described with reference to Fig. 13. Fig. 13 is a flowchart showing the flow of the information processing method executed by the information processing system S. The information processing method executed by the information processing system S, which will be described with reference to Fig. 13, may be an operation performed by the information processing system S when a subject enters the restricted area.

[0096] 13 , when the information processing operation by the information processing system S starts, the third acquisition unit 315 acquires biometric information of the target (step S21). The first authentication unit 316 performs biometric authentication of the target using the biometric information (step S22).

[0097] If the target biometric authentication is successful (step S22: successful), the image providing unit 215 displays an image related to the application program 22a on the display of the personal information processing device 20 (step S51). The image related to the application program 22a may be, for example, a two-dimensional code, a one-dimensional code, or the like. The seventh acquiring unit 327 acquires an image including the display of the personal information processing device 20 (step S52). The third determining unit 328 determines whether the application program 22a is installed on the personal information processing device 20 based on the image including the display of the personal information processing device 20 (step S53).

[0098] If the application program 22a is installed in the personal information processing device 20 (step S53: Yes), the first acquisition unit 211 acquires a captured image captured by the camera 27 (step S23). The second acquisition unit 213 acquires location information related to the captured image (step S24). The transmission unit 214 transmits the captured image, the location information related to the captured image, and information indicating the time when the image was captured to the entry / exit management device 30 (step S25).

[0099] The first determination unit 312 determines whether the target is permitted to enter or exit the restricted area based on the brightness value of the captured image, location information related to the captured image, and information indicating the time of capture (step S26). The entry / exit control unit 317 permits entry depending on the determination result (step S27). Thus, in the fifth embodiment, the target is permitted to enter the restricted area if it is determined that the application program 22a is installed in the possessed information processing device 20 in addition to the biometric authentication result and brightness value determination. [5-3: Information Processing Method Executed by the Possessed Information Processing Device 20]

[0100] The possessive information processing device 20 according to the fifth embodiment is configured as a device for managing the behavior of a target within a second restricted area. An information processing method executed by the possessive information processing device 20 will be described with reference to Fig. 14. Fig. 14 is a flowchart showing the flow of the information processing method executed by the possessive information processing device 20.

[0101] 14, the switching unit 216 determines whether the position indicated by the position information of the possessed information processing device 20 indicates a position within the second restricted area (step S54). If the position indicated by the position information of the possessed information processing device 20 indicates a position within a predetermined area (step S54: Yes), the switching unit 216 disables the function of the camera 27 (step S55). In other words, the function of the camera 27 is disabled by the application program 22a.

[0102] Alternatively, when the position indicated by the position information of the possessive information processing device 20 indicates a position within a predetermined area, the switching unit 216 may turn off the power of the possessive information processing device 20. Note that the switching unit 216 may enable the function of the camera 27 when the position indicated by the position information of the possessive information processing device 20 no longer indicates a position within a predetermined area.

[0103] If the fingerprint sensor 28 acquires fingerprint information as biometric information (step S56: Yes), the second authentication unit 217 performs biometric authentication of the predetermined person using the fingerprint information acquired by the fingerprint sensor 28. The second authentication unit 217 determines whether the fingerprint information acquired by the fingerprint sensor 28 is information on the fingerprint of the predetermined person (step S57). The predetermined person may be a person different from the target and may be a person who has permission to capture an image of the target within the second restricted area. The fingerprint information of the predetermined person is available to the second authentication unit 217. The second authentication unit 217 may compare the fingerprint information acquired by the fingerprint sensor 28 with the fingerprint information of the predetermined person.

[0104] If the fingerprint information acquired by fingerprint sensor 28 is information on the fingerprint of a predetermined person (step S57: Yes), switching unit 216 enables the imaging function of camera 27. In other words, if the fingerprint information acquired by fingerprint sensor 28 is information on the fingerprint of a predetermined person, application program 22a enables the function of camera 27. Switching unit 216 may disable the imaging function again after a predetermined time has elapsed since enabling the imaging function (the predetermined time may be determined by a person who has permission to capture images within the second restricted area, and may be, for example, several minutes).

[0105] When capturing an image within the restricted area, it is necessary to peel off the security seal. Therefore, if the switching unit 216 has once enabled the image capturing function within the second restricted area, the switching unit 216 may keep the image capturing function disabled even after leaving the second restricted area. In other words, the switching unit 216 may disable the image capturing function until the user leaves the restricted area, so that the user cannot capture an image using the image capturing function in the first restricted area.

[0106] Furthermore, when the imaging function of the camera 27 is enabled, the switching unit 216 may transmit information indicating that the imaging function has been enabled to the entrance / exit management device 30. The entrance / exit management device 30 has information indicating that the imaging function of the camera 27 has been enabled and that the security seal has been removed. The entrance / exit management device 30 may also permit the subject, who has been authorized by a person with permission to take images within the second restricted area, to exit the restricted area even if the security seal affixed to the subject's device has been removed when the subject leaves the restricted area. On the other hand, the entrance / exit management device 30 may require the subject to disclose the image content captured within the restricted area when the subject leaves the restricted area. The entrance / exit management device 30 may require the image content captured by the camera 27 to be confirmed by at least the person who authorized the subject to take images within the second restricted area and the person managing entrance / exit.

[0107] The first target may be permitted to enter the restricted area when no light is incident on the imaging function, and the second target may be permitted to enter the restricted area by disabling the imaging function. In this case, the target may be distinguished as the first target or the second target by biometric authentication. [5-4: Technical Effects]

[0108] The information processing system S according to this disclosure checks whether a predetermined application program 22a is installed in the personal information processing device 20 when the person enters a restricted area, and can permit the person to enter if the predetermined application program 22a is installed in the personal information processing device 20. As a result, the information processing system S can permit the personal information processing device 20, whose imaging function is disabled in the second restricted area, to be brought into the restricted area. Furthermore, when it is necessary to use the personal information processing device 20 in the second restricted area, the information processing system S can use the personal information processing device 20 with the approval of a person who can approve the use of the personal information processing device 20. The information processing system S can authenticate a person who can be permitted to use the personal information processing device 20 by biometric authentication. [6: Sixth Embodiment]

[0109] An information processing system, an information processing device, an information processing method, and a program according to a sixth embodiment will be described with reference to Figures 15 and 16. Hereinafter, the sixth embodiment will be described using an information processing system S. Note that, for the sixth embodiment, descriptions that overlap with the descriptions of the first to fifth embodiments will be omitted as appropriate. Note that, in the drawings, parts common to the first to fifth embodiments are designated by the same reference numerals.

[0110] 15, the information processing system S according to the fifth embodiment includes a fixed information processing device 50 in addition to the personal information processing device 20 and the entrance / exit management device 30. The fixed information processing device 50 may be installed and used at a predetermined position within the restricted area. [6-1: Configuration of the Fixed Information Processing Device 50]

[0111] 15 , the fixed information processing device 50 includes a calculation device 51, a storage device 52, a communication device 53, and a camera 57. The fixed information processing device 50 may further include an input device 54 and an output device 55. However, the fixed information processing device 50 does not necessarily have to include at least one of the input device 54 and the output device 55. The calculation device 51, the storage device 52, the communication device 53, the camera 57, the input device 54, and the output device 55 may be connected via a data bus 56.

[0112] The arithmetic device 51 includes at least one processor (i.e., one processor or multiple processors) as hardware. The processor may include, for example, a processor conforming to a von Neumann computer architecture. The processor conforming to the von Neumann computer architecture may include at least one of a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit). The processor may include, for example, a processor conforming to a non-von Neumann computer architecture. The processor conforming to the non-von Neumann computer architecture may include at least one of an FPGA (Field Programmable Gate Array) and an ASIC (Application Specific Circuit).

[0113] The arithmetic device 51 reads a computer program 521 including at least one of computer program code and computer program instructions. For example, the arithmetic device 51 may read the computer program 521 stored in the storage device 52. For example, the arithmetic device 51 may read the computer program 521 stored in a computer-readable, non-transitory storage medium using a storage medium reading device (not shown) included in the fixed information processing device 50. The computer program 521 read from the storage medium may be stored in the storage device 52. The arithmetic device 51 may acquire (i.e., download or read) the computer program 521 from a device (not shown) located outside the fixed information processing device 50 via the communication device 53 (or another communication device). The downloaded computer program 521 may be stored in the storage device 52.

[0114] The arithmetic device 51 executes the loaded computer program 521. As a result, logical functional blocks for executing information processing to be performed by the fixed information processing device 50 are realized within the arithmetic device 51. In other words, the arithmetic device 51, together with the storage device 52 or the like in which the computer program 521 is recorded (in other words, together with the storage device 52 and the computer program 521 recorded in the storage device 52 or the like), can function as a controller or computer for realizing logical functional blocks for executing processing to be performed by the fixed information processing device 50. In other words, the at least one processor included in the arithmetic device 51, the memory (recording medium) included in the storage device 52 or the like, and the computer program 521 are configured so that the fixed information processing device 50 performs the information processing to be performed by the fixed information processing device 50.

[0115] The recording medium for recording the computer program 521 executed by the arithmetic unit 51 may be at least one of a CD-ROM, CD-R, CD-RW, flexible disk, MO, DVD-ROM, DVD-RAM, DVD-R, DVD+R, DVD-RW, DVD+RW, and Blu-ray (registered trademark) optical disk, magnetic medium such as magnetic tape, magneto-optical disk, semiconductor memory such as USB memory, and any other medium capable of storing a program. The recording medium may include a device capable of recording the computer program 521 (for example, a general-purpose device or a dedicated device in which the computer program 521 is implemented in a state in which it can be executed in at least one of the forms of software and firmware). Furthermore, each process or function included in the computer program 521 may be realized by a logical processing block realized within the arithmetic device 51 (i.e., processor) when the arithmetic device 51 executes the computer program 521, or may be realized by hardware such as a predetermined gate array (FPGA (Field Programmable Gate Array), ASIC (Application Specific Integrated Circuit)) included in the arithmetic device 51, or may be realized in a form that mixes logical processing blocks and partial hardware modules that realize some elements of the hardware.

[0116] The storage device 52 includes at least one memory capable of storing desired data. In other words, the storage device 52 includes at least one memory containing desired data. For example, the storage device 52 may store a computer program 521 executed by the arithmetic device 51. In this case, the storage device 52 (memory) may be used as the above-mentioned recording medium for recording the computer program 521 executed by the arithmetic device 51. The storage device 52 may temporarily store data used by the arithmetic device 51 when the arithmetic device 51 is executing the computer program 521. The storage device 52 may also store data to be stored long-term by the fixed information processing device 50. The storage device 52 may include at least one of a RAM (Random Access Memory), a ROM (Read Only Memory), a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device. In other words, the storage device 52 may include a non-transitory recording medium.

[0117] The communication device 53 may be capable of communicating with a device (e.g., the entry / exit management device 30) external to the fixed information processing device 50. The communication device 53 may perform wired communication or wireless communication.

[0118] The camera 57 may capture images using light having a predetermined wavelength. The camera 57 may be a camera capable of capturing images using light in the visible wavelength range (a so-called visible light camera). The camera 57 may be a camera capable of capturing images using light in the near-infrared wavelength range (a so-called near-infrared camera). Alternatively, the fixed information processing device 50 may be equipped with a visible light camera and a near-infrared camera.

[0119] The input device 54 is a device capable of accepting information input to the fixed information processing device 50 from outside. The input device 54 may include an operation device (e.g., a keyboard, a mouse, a touch panel, etc.) that can be operated by a user of the fixed information processing device 50. The input device 54 may include a recording medium reading device capable of reading information recorded on a recording medium that is detachable from the fixed information processing device 50, such as a USB (Universal Serial Bus) memory. Note that when information is input to the fixed information processing device 50 via the communication device 53 (in other words, when the fixed information processing device 50 acquires information via the communication device 53), the communication device 53 may function as an input device.

[0120] The output device 55 is a device capable of outputting information to the outside of the fixed information processing device 50. The output device 55 may output visual information such as text or images, auditory information such as sound, or tactile information such as vibration, as the information. The output device 55 may include, for example, at least one of a display, a speaker, a printer, and a vibration motor. The output device 55 may be capable of outputting information to a recording medium detachable from the fixed information processing device 50, such as a USB memory. Note that when the fixed information processing device 50 outputs information via the communication device 53, the communication device 53 may function as an output device.

[0121] 15 shows an example of logical functional blocks realized in the arithmetic device 51 to execute information processing. As shown in FIG. 15, an imaging control unit 511, a storage control unit 512, a ninth acquisition unit 513, a third authentication unit 514, and a permission unit 515 are realized in the arithmetic device 51. [6-2: Information Processing Method Executed by the Fixed Information Processing Device 50]

[0122] The fixed information processing device 50 is configured as a device for managing the behavior of a target within a restricted area. An information processing method executed by the fixed information processing device 50 will be described with reference to Fig. 16. Fig. 16 is a flowchart showing the flow of the information processing method executed by the fixed information processing device 50.

[0123] The camera 57 is provided to capture an image of at least a part of the surroundings of the fixed information processing device 50. The camera 57 may be provided to capture an image of at least a part of the subject who uses the fixed information processing device 50.

[0124] 16 , the imaging control unit 511 controls the camera 57 to capture an image of at least a part of the surroundings of the fixed information processing device 50 regardless of whether the fixed information processing device 50 is being used (step S61). The storage control unit 512 controls the storage device 52 to store a surrounding image generated by the camera 57 capturing an image of at least a part of the surroundings of the fixed information processing device 50 (step S62).

[0125] The ninth acquisition unit 513 determines whether there is a target who will use the fixed information processing device 50 (step S63). For example, the ninth acquisition unit 513 may determine that there is a target who will use the fixed information processing device 50 when the target is captured within a predetermined range of the image captured by the camera 57. Alternatively, the ninth acquisition unit 513 may determine that there is a target who will use the fixed information processing device 50 when an input operation is performed on the input device 54.

[0126] When the subject uses the fixed information processing device 50 (step S63: Yes), the ninth acquisition unit 513 acquires biometric information of the subject using the fixed information processing device 50 (step S64). The ninth acquisition unit 513 may acquire the biometric information of the subject by capturing an image with the camera 57. The biometric information of the subject may be, for example, a facial image of the subject. Alternatively, the biometric information of the subject may be an eye image of the subject.

[0127] The third authentication unit 514 performs biometric authentication of the target using the biometric information (step S65). The biometric authentication may be, for example, facial authentication. Alternatively, the biometric authentication may be iris authentication. If the biometric authentication identifies the target as a person authorized to use the fixed information processing device 50 (step S66: Yes), the permission unit 515 permits the target to use the fixed information processing device 50. When the target starts using the fixed information processing device 50, the storage control unit 512 controls the storage device 52 to store the target's biometric information and the target's usage history of the fixed information processing device 50 in association with each other (step S67).

[0128] If the biometric authentication does not identify the target as a person authorized to use the fixed information processing device 50 (step S66: No), the permission unit 515 outputs an alert (step S68). For example, the permission unit 515 may notify at least one of a security guard (including a robot) and the entrance / exit management device 30 that a person unauthorized to use the fixed information processing device 50 has attempted to use it. [6-3: Technical Effects]

[0129] Since the fixed information processing device 50 in the restricted area records its operation history along with biometric information, the information processing system S can prevent fraudulent activities using the fixed information processing device 50 in the restricted area. Specifically, if fraudulent activities are discovered, the information processing system S can identify the person who committed the fraud based on the biometric information. For example, if an image captured by the camera 57 is accessed, the person who accessed the image captured by the camera 57 can be identified. Also, if a person performs fraudulent imaging using the camera 57, the person who performed the fraudulent imaging using the camera 57 can be identified. Also, if a fraudulent activity such as stopping the operation of the camera 57 or erasing information stored in the storage device 52 is performed, the person who performed the fraudulent activity can be identified. In this way, if fraudulent activities such as data leakage or espionage are discovered, the person who performed the fraudulent activity can be identified from the information stored in the storage device 52. [7: Addendum]

[0130] Some or all of the above embodiments may be described as, but are not limited to, the following supplementary notes. [Supplementary Note 1] An information processing system including: an acquisition means for acquiring a captured image captured using an information processing device possessed by a subject; and a first determination means for determining, based on a brightness value of the captured image, whether or not the subject is permitted to enter a predetermined area and / or whether or not the subject is permitted to exit the predetermined area. [Supplementary Note 2] The information processing system according to Supplementary Note 1 includes: an information processing device possessed by the subject, on which a predetermined application program is installed, the acquisition means and transmission means being realized by the predetermined application program; and an access control device in which the first determination means is realized, wherein the transmission means transmits the captured image to the access control device. [Supplementary Note 3] The information processing system according to Supplementary Note 1, wherein the first determination means determines whether or not the brightness value of the captured image is equal to or less than a predetermined value, and, if the brightness value of the captured image is equal to or less than the predetermined value, permits the subject to enter the predetermined area and / or permits the subject to exit the predetermined area. [Supplementary Note 4] The information processing system according to Supplementary Note 3, including a third acquisition means that acquires biometric information of the target, and a first authentication means that performs biometric authentication of the target using the biometric information, wherein the first determination means, if the biometric authentication is successful and the luminance value of the captured image is equal to or less than the predetermined value, permits at least one of the target to enter a predetermined area and the target to exit from the predetermined area. [Supplementary Note 5] The information processing system according to Supplementary Note 1, wherein the acquisition means acquires positional information and time information related to the captured image in addition to the luminance value of the captured image, and the first determination means makes the determination based on the positional information and time information related to the captured image in addition to the luminance value of the captured image.[Supplementary Note 6] The information processing system according to Supplementary Note 4, including: a fourth acquisition means for acquiring possession information related to a possessed information processing device carried by the subject and associated with the subject identified by the biometric authentication, the possession information including security seal information related to a security seal associated with the possessed information processing device, a fifth acquisition means for acquiring an image including the possessed information processing device, an identification means for identifying at least one of a state and a number of security seals currently affixed to the possessed information processing device based on the image including the possessed information processing device, and a comparison means for comparing the identified state and / or number of the security seals with the security seal information. [Supplementary Note 7] The information processing system according to Supplementary Note 1, including: a sixth acquisition means for capturing an image of a container made of a material that transmits light having a predetermined wavelength and carried by the subject, using light having the predetermined wavelength, to acquire a container image, a detection means for detecting items contained in the container by performing predetermined image processing on the container image, and a second determination means for determining whether the detected items include a predetermined item to which a security seal should be affixed. [Supplementary Note 8] The information processing system of Supplementary Note 7 further includes an instruction means for instructing the target as to where on the predetermined item a security seal should be affixed when it is determined that the detected items include the predetermined item. [Supplementary Note 9] The information processing system of Supplementary Note 8 further includes an instruction means for instructing the target to affix a first security seal to the first item and a second security seal to the second item, the second security seal being different from the first security seal, when it is determined that the detected items include the predetermined item and the predetermined items include a first item and a second item. [Supplementary Note 10] The information processing system of claim 9 further includes an instruction means for instructing the target to affix a first security seal to the first item and a second security seal to the second item, the second security seal being different from the first security seal. [Supplementary Note 11] The information processing system of Supplementary Note 7 further includes an instruction means for instructing the target to affix a first security seal to the first item and a second security seal to the second item, the second security seal being different from the first security seal.[Supplementary Note 12] The information processing system of Supplementary Note 7, including: a fifth acquisition means for acquiring an article image including the specified article with a security seal affixed, and a registration means for registering security seal information indicating a relationship between the specified article and the security seal affixed to the specified article based on the article image. [Supplementary Note 13] The information processing system of Supplementary Note 2, including: a seventh acquisition means for acquiring a screen image including a screen of an information processing device held by the subject, and a third determination means for determining whether a specified application is installed on the information processing device held by the subject based on the screen image. [Supplementary Note 14] The information processing system of Supplementary Note 2, wherein the information processing device held by the subject implements, by the specified application program, [Supplementary Note 15] The possessed information processing device is the information processing system described in Supplementary Note 14, wherein the possessed information processing device is realized by the predetermined application program as follows: an eighth acquisition means for acquiring biometric information of a predetermined person different from the target when the imaging function is disabled, and a second authentication means for performing biometric authentication of the predetermined person using the acquired biometric information, and when biometric authentication by the second authentication means is successful, the switching means enables the imaging function. [Supplementary Note 16] The information processing system described in Supplementary Note 1, including an information processing device comprising: a ninth acquisition means for acquiring biometric information of the target, a third authentication means for performing biometric authentication of the target using the biometric information, an authorization means for permitting the target to use the information processing device when the target is identified by the biometric authentication as a person authorized to use the information processing device, and a storage means for storing a usage history of the information processing device of the target in association with the biometric information.[Supplementary Note 17] The information processing system according to Supplementary Note 16, wherein the information processing device comprises an imaging means for imaging at least a portion of the surroundings of the information processing device, the imaging means capturing an image of at least a portion of the surroundings regardless of whether the information processing device is being used or not, and the storage means stores an image generated by the imaging means capturing an image of at least a portion of the surroundings. [Supplementary Note 18] An information processing device carried by a subject, comprising: an acquisition means for acquiring an image captured using an imaging function provided thereon; and a determination means for determining, based on a brightness value of the captured image, at least one of whether the subject is allowed to enter a predetermined area and whether the subject is allowed to exit the predetermined area. [Supplementary Note 19] An information processing method executed by a computer, comprising: acquiring an image captured using an information processing device carried by a subject; and determining, based on a brightness value of the captured image, at least one of whether the subject is allowed to enter a predetermined area and whether the subject is allowed to exit the predetermined area. [Supplementary Note 20] A recording medium having recorded thereon a computer program for causing a computer to execute an information processing method including: acquiring an image captured using an information processing device possessed by a subject; and determining, based on a brightness value of the captured image, at least one of whether or not the subject is permitted to enter a predetermined area and whether or not the subject is permitted to exit from the predetermined area.

[0131] Furthermore, some or all of the configurations described in Supplementary Notes 2 to 17, which are dependent on Supplementary Notes 1, and Supplementary Notes 18 to 20, may be dependent in the same manner as Supplementary Notes 2 to 17. Furthermore, not limited to Supplementary Notes 1, 18, 19, and 20, some or all of the configurations described as Supplements may be dependent on various hardware, software, various recording means for recording software, or systems, within the scope of each of the above-mentioned embodiments.

[0132] This disclosure may be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification, and information processing systems, information processing devices, information processing methods, and programs that involve such modifications are also included in the technical idea of ​​this disclosure.

[0133] 10 Information processing device 11, 211 First acquisition unit 12, 312 First determination unit S Information processing system 20 Possessed information processing device 213 Second acquisition unit 214 Transmission unit 215 Image provision unit 216 Switching unit 217 Second authentication unit 22a Application program 27 Camera 28 Fingerprint sensor 30 Entrance / exit management device 315 Third acquisition unit 316 First authentication unit 317 Entrance / exit control unit 318 Fourth acquisition unit 319 Fifth acquisition unit 320 Identification unit 321 Matching unit 322 Sixth acquisition unit 323 Detection unit 324 Second determination unit 325 Instruction unit 326 Registration unit 327 Seventh acquisition unit 328 Third determination unit 37 Camera 50 Fixed information processing device 511 Imaging control unit 512 Storage control unit 513 Ninth acquisition unit 514 Third authentication unit 515 Authorization unit 57 Camera

Claims

1. An information processing system comprising: an acquisition means for acquiring an image captured using an information processing device possessed by a subject; and a first determination means for determining, based on the brightness value of the captured image, at least one of whether the subject is permitted to enter a specified area and whether the subject is permitted to exit from the specified area.

2. The information processing system according to claim 1, comprising: an information processing device possessed by the subject, on which a predetermined application program is installed and which realizes the acquisition means and transmission means by the predetermined application program; and an entry / exit management device in which the first determination means is realized, wherein the transmission means transmits the captured image to the entry / exit management device.

3. The information processing system of claim 1, wherein the first determination means determines whether the brightness value of the captured image is equal to or less than a predetermined value, and if the brightness value of the captured image is equal to or less than the predetermined value, allows the subject to enter the predetermined area and / or allow the subject to exit the predetermined area.

4. An information processing system as described in claim 3, comprising: a third acquisition means for acquiring biometric information of the subject; and a first authentication means for performing biometric authentication of the subject using the biometric information, wherein the first determination means, if the biometric authentication is successful and the brightness value of the captured image is equal to or less than the predetermined value, permits at least one of the subject to enter a predetermined area and the subject to exit from the predetermined area.

5. The information processing system according to claim 1, wherein the acquisition means acquires positional information and time information relating to the captured image in addition to the brightness value of the captured image, and the first determination means makes the determination based on the positional information and time information relating to the captured image in addition to the brightness value of the captured image.

6. An information processing system as described in claim 4, further comprising: a fourth acquisition means for acquiring possession information relating to a possessed information processing device possessed by the subject and associated with the subject identified by the biometric authentication, the possession information including security seal information relating to a security seal associated with the possessed information processing device; a fifth acquisition means for acquiring an image including the possessed information processing device; an identification means for identifying at least one of the state and number of security seals currently affixed to the possessed information processing device based on the image including the possessed information processing device; and a comparison means for comparing at least one of the state and number of the identified security seals with the security seal information.

7. An information processing system as described in claim 1, comprising: a sixth acquisition means for capturing an image of a container made of a material that transmits light having a predetermined wavelength and carried by the subject using light having the predetermined wavelength to acquire a container image; a detection means for detecting items contained in the container by applying predetermined image processing to the container image; and a second determination means for determining whether the detected items include a predetermined item that should have a security seal affixed to it.

8. An information processing system according to claim 7, further comprising an instruction means for instructing the target as to the position on the specified item where a security seal should be affixed when it is determined that the detected items include the specified item.

9. The information processing system of claim 8, wherein if it is determined that the detected items include the specified items, and if the specified items include a first item and a second item, the instruction means instructs the target to affix a first security seal to the first item and a second security seal different from the first security seal to the second item.

10. The information processing system according to claim 9, wherein the first security seal and the second security seal differ from each other in at least one of shape, pattern, and color.

11. The information processing system according to claim 7, wherein the light having the predetermined wavelength is near-infrared light.

12. An information processing system as described in claim 7, comprising: a fifth acquisition means for acquiring an image of an item including the specified item with a security seal affixed thereto; and a registration means for registering security seal information indicating the relationship between the specified item and the security seal affixed to the specified item based on the item image.

13. An information processing system as described in claim 2, comprising: a seventh acquisition means for acquiring a screen image including a screen of an information processing device owned by the subject; and a third determination means for determining whether a predetermined application is installed on the information processing device owned by the subject based on the screen image.

14. The information processing system of claim 2, wherein the information processing device possessed by the subject is realized by the specified application program with a second acquisition means for acquiring location information of the possessed information processing device, and a switching means for disabling the imaging function of the possessed information processing device when the location indicated by the location information indicates a location within a specified area.

15. The information processing system described in claim 14, wherein the possessed information processing device realizes, by the specified application program, an eighth acquisition means for acquiring biometric information of a specified person other than the target when the imaging function is disabled, and a second authentication means for performing biometric authentication of the specified person using the acquired biometric information, and when biometric authentication by the second authentication means is successful, the switching means enables the imaging function.

16. The information processing system of claim 1, comprising an information processing device comprising: a ninth acquisition means for acquiring biometric information of the target; a third authentication means for performing biometric authentication of the target using the biometric information; an authorization means for authorizing the target to use the information processing device when the biometric authentication identifies the target as a person authorized to use the information processing device; and a storage means for storing the target's usage history of the information processing device in association with the biometric information.

17. The information processing system according to claim 16, wherein the information processing device comprises an imaging means for imaging at least a portion of the surroundings of the information processing device, the imaging means imaging at least a portion of the surroundings regardless of whether the information processing device is being used or not, and the storage means stores an image generated by the imaging means imaging at least a portion of the surroundings.

18. An information processing device possessed by a subject, comprising: an acquisition means for acquiring an image captured using an imaging function installed therein; and a determination means for determining, based on the brightness value of the captured image, at least one of whether the subject is permitted to enter a specified area and whether the subject is permitted to exit from the specified area.

19. An information processing method executed by a computer, comprising: acquiring an image captured using an information processing device possessed by a subject; and determining, based on the brightness value of the captured image, at least one of whether the subject is permitted to enter a specified area and whether the subject is permitted to exit from the specified area.

20. A recording medium having recorded thereon a computer program for causing a computer to execute an information processing method including: acquiring an image captured using an information processing device possessed by a subject; and determining, based on the brightness value of the captured image, at least one of whether or not the subject is permitted to enter a specified area and whether or not the subject is permitted to exit from the specified area.

Images