Information processing device, information processing method, and recording medium

Abstract

This information processing device includes: first acquisition means for acquiring a first face image obtained by imaging a face of an object person; first determination means for determining whether or not a face image successful in a first face collation with the first face image is registered in storage means in a first mode; first registration means for registering the first face image in the storage means in a second mode when the face image successful in the first face collation is not registered in the storage means in the first mode; second acquisition means for acquiring a second face image obtained by imaging a face of an object person who desires payment related to purchase of a predetermined commodity; second determination means for determining whether or not the face image successful in a second face collation with the second face image is registered in the storage means in a second mode; settlement means for executing payment processing when the face image successful in the second face collation is registered in the storage means in the second mode; and second registration means for registering the registered face image successful in the second face collation registered in the storage means in the second mode in the storage means in the first mode when the payment processing is executed.

Description

Information processing device, information processing method, and recording medium

[0001] The present disclosure relates to the technical fields of an information processing device, an information processing method, and a recording medium.

[0002] There are known techniques for a seller to limit the number of specific products that can be sold. For example, Patent Document 1 discloses a technique for preventing a customer from selling more than the limited number of products that a seller wishes to purchase when the customer wishes to purchase the product.

[0003] Japanese Patent Application Laid-Open No. 2021-124855

[0004] An object of this disclosure is to provide an information processing device, an information processing method, and a recording medium that aim to improve the related techniques described above.

[0005] One aspect of the information processing device disclosed herein includes a first acquisition means for acquiring first biometric information from at least some of the subjects; a first determination means for determining whether biometric information that succeeds in the first matching with the first biometric information is registered in a storage means in a first manner; a first registration means for registering the first biometric information in a second manner in the storage means if the biometric information that succeeds in the first matching is not registered in the storage means in the first manner; a second acquisition means for acquiring second biometric information from at least some of the subjects who wish to make payment for the purchase of a specified product; a second determination means for determining whether biometric information that succeeds in the second matching with the second biometric information is registered in the storage means in the second manner; a payment means for executing the payment process if the biometric information that succeeds in the second matching is registered in the storage means in the second manner; and a second registration means for registering the registered biometric information that succeeds in the second matching and is registered in the storage means in the first manner when the payment process is executed.

[0006] One aspect of the information processing method disclosed herein includes acquiring first biometric information from at least some of the subjects, determining whether biometric information that succeeds in the first matching with the first biometric information is registered in a storage means in a first aspect, and if the biometric information that succeeds in the first matching is not registered in the storage means in the first aspect, registering the first biometric information in a second aspect in the storage means, acquiring second biometric information from at least some of the subjects who wish to make payment for the purchase of a specified product, determining whether biometric information that succeeds in the second matching with the second biometric information is registered in the storage means in the second aspect, and if the biometric information that succeeds in the second matching is registered in the storage means in the second aspect, executing the payment processing, and if the payment processing is executed, registering the registered biometric information that succeeds in the second matching and is registered in the storage means in the first aspect.

[0007] One aspect of the recording medium of this disclosure has recorded thereon a computer program that causes a computer to execute an information processing method, including acquiring first biometric information from at least some of the subjects, determining whether biometric information that succeeds in a first matching with the first biometric information is registered in a storage means in a first aspect, and if the biometric information that succeeds in the first matching is not registered in the storage means in the first aspect, registering the first biometric information in a second aspect in the storage means, acquiring second biometric information from at least some of the subjects who wish to make payment for the purchase of a specified product, determining whether biometric information that succeeds in a second matching with the second biometric information is registered in the storage means in the second aspect, and if the biometric information that succeeds in the second matching is registered in the storage means in the second aspect, executing the payment processing, and if the payment processing is executed, registering the registered biometric information that succeeds in the second matching and is registered in the storage means in the first aspect.

[0008] 1 is a block diagram showing a configuration of an information processing device according to the present disclosure. FIG. 2 is a flowchart showing a flow of information processing operation in an information processing device according to the present disclosure. FIG. 3 is a block diagram showing a configuration of an information processing device according to the present disclosure. FIG. 4 is a flowchart showing a flow of information processing operation in an information processing device according to the present disclosure. FIG. 5 is a block diagram showing a configuration of an information processing device according to the present disclosure. FIG. 6 is a flowchart showing a flow of information processing operation in an information processing device according to the present disclosure. FIG. 7 is a schematic diagram showing an overview of information processing operation in an information processing device according to the present disclosure. FIG. 8 is a schematic diagram showing an overview of information processing operation in an information processing device according to the present disclosure. FIG. 9 is a schematic diagram showing an overview of information processing operation in an information processing device according to the present disclosure. FIG. 10 is a block diagram showing a configuration of an information processing device according to the present disclosure. FIG. 11 is a flowchart showing a flow of information processing operation in an information processing device according to the present disclosure.

[0009] Hereinafter, embodiments of an information processing device, an information processing method, and a recording medium will be described with reference to the drawings. [1: First Embodiment]

[0010] A first embodiment of an information processing device, an information processing method, and a recording medium will be described with reference to Fig. 1 and Fig. 2. In the following, the first embodiment of the information processing device, the information processing method, and the recording medium will be described using an information processing device 10.

[0011] 1, information processing device 10 includes first acquisition unit 11, first determination unit 12, first registration unit 13, second acquisition unit 14, second determination unit 15, settlement unit 16, and second registration unit 17. The operation performed by information processing device 10 will be described with reference to the flowchart of FIG.

[0012] As shown in FIG. 2 , the first acquisition unit 11 acquires first biometric information from at least a portion of the subject (step S1). The biometric information acquired from at least a portion of the subject is referred to as "first biometric information." The subject may be a person who is managed for purchasing a predetermined product. The predetermined product is a product whose number that can be purchased by the same person is limited. For example, the predetermined product may be a product that can only be purchased one by one per person. This embodiment describes a case where the predetermined product is a product that can only be purchased one by one per person.

[0013] Biometric information is information relating to the physical characteristics of a subject. Examples of biometric information include at least one of a facial image of the subject's face, an iris image of the subject's iris, a fingerprint image of the subject's fingerprints, a palm print image of the subject's palm print, an image of the veins of the subject's fingers and palm, and audio information including the subject's voice.

[0014] The first determination unit 12 determines whether biometric information that is successful in the first matching with the first biometric information is registered in the storage means in a first manner (step S2). Matching of information with the first biometric information is referred to as "first matching." Matching may be matching between biometric information, and it may be determined that matching is successful when the similarity between the biometric information exceeds a threshold. Examples of matching include at least one of facial image matching, iris image matching, fingerprint image matching, palm print image matching, vein image matching, and voiceprint matching.

[0015] The first aspect is a storage aspect of biometric information in a storage means. The first aspect may be, for example, a storage aspect in which the biometric information is stored in a first area in the storage means. The first aspect may be, for example, a storage aspect in which label information indicating the first aspect is associated with the biometric information and stored in the storage means.

[0016] If the biometric information that passes the first matching is not registered in the storage means in the first mode, the first registration unit 13 registers the first biometric information in the storage means in a second mode (step S3). The second mode is a mode in which the biometric information is stored in the storage means. The second mode may be, for example, a mode in which the biometric information is stored in a second area in the storage means. The second mode may be, for example, a mode in which label information indicating the second mode is associated with the biometric information and stored in the storage means.

[0017] This is an aspect different from the first aspect and the second aspect. In this embodiment, whether or not the subject is able to purchase a predetermined product may be determined depending on the aspect in which the biometric information is stored in the storage means.

[0018] The second acquisition unit 14 acquires biometric information from at least some of the subjects who wish to pay for the purchase of the predetermined product (step S4). The biometric information acquired from the subjects who wish to pay for the purchase of the predetermined product is referred to as "second biometric information."

[0019] The second determination unit 15 determines whether biometric information that matches the second biometric information is registered in the storage device in a second manner (step S5). Matching the information with the second biometric information is referred to as "second matching." In this embodiment, a person who matches the second biometric information may be eligible to purchase a specific product.

[0020] If the biometric information that passes the second matching is registered in the storage means in the second mode, the settlement unit 16 executes the payment process (step S6). When the payment process is executed, the second registration unit 17 registers the registered biometric information that passes the second matching and is registered in the storage means in the second mode in the storage means in the first mode (step S7). Therefore, if the first matching is performed again on the subject, the first matching will be successful. In other words, a person who passes the first matching is a person who has already purchased the specified product. Therefore, a person who passes the first matching is a person who cannot purchase the specified product. In this way, whether the matching is successful or not can be used to determine whether the subject is a person who can purchase the specified product.

[0021] In this way, the information processing device 10 performs an information processing method including: acquiring first biometric information from at least some of the subjects; determining whether or not biometric information that is successful in the first matching with the first biometric information is registered in a first manner in the storage means; if the biometric information that is successful in the first matching is not registered in the storage means in the first manner, registering the first biometric information in a second manner in the storage means; acquiring second biometric information from at least some of the subjects who wish to pay for the purchase of a specified product; determining whether or not biometric information that is successful in the second matching with the second biometric information is registered in the storage means in the second manner; if the biometric information that is successful in the second matching is registered in the storage means in the second manner, executing payment processing; and if the payment processing is executed, registering the registered biometric information that is successful in the second matching and that is registered in the storage means in the first manner.

[0022] The information processing device 10 may be realized by a computer reading a computer program recorded on a recording medium. In this case, the computer program may cause the computer to execute an information processing method including: acquiring first biometric information from at least some of the subjects; determining whether biometric information that successfully passes the first matching with the first biometric information is registered in a first manner in a storage device; registering the first biometric information in a second manner in a storage device if the biometric information that successfully passes the first matching is not registered in the storage device in the first manner; acquiring second biometric information from at least some of the subjects who wish to pay for a predetermined product; determining whether biometric information that successfully passes the second matching with the second biometric information is registered in the storage device in the second manner; executing payment processing if the biometric information that successfully passes the second matching is registered in the storage device in the second manner; and registering the registered biometric information that successfully passes the second matching, registered in the storage device in the first manner, in a storage device if the payment processing is executed. [2: Second Embodiment]

[0023] A second embodiment of an information processing device, an information processing method, and a recording medium will be described with reference to Figures 3 and 4. Hereinafter, the second embodiment of an information processing device, an information processing method, and a recording medium will be described using an information processing device 100. In the second and subsequent embodiments, a case where biometric information is a face image will be described as an example, but a case where biometric information other than a face image is used will also be described as appropriate.

[0024] 3, the information processing device 100 includes a first acquisition unit 111, a first determination unit 112, a first registration unit 113, a second acquisition unit 114, a second determination unit 115, a settlement unit 116, and a second registration unit 117. The operation performed by the information processing device 100 will be described with reference to the flowchart of FIG.

[0025] As shown in FIG. 4, the first acquisition unit 111 acquires a facial image of the target person (step S11). The facial image of the target person is referred to as a "first facial image." The target person may be a person who is managed for purchasing a predetermined product. The predetermined product is a product for which the number that the same person can purchase is limited. For example, the predetermined product may be a product that can only be purchased one by one per person. This embodiment describes a case where the predetermined product is a product that can only be purchased one by one per person.

[0026] The first determination unit 112 determines whether a face image that can be successfully matched with the first face image is registered in the storage unit in a first manner (step S12). Matching with the first face image is referred to as “first face matching.” The face matching may be a match between face images, and it may be determined that face matching is successful when the similarity between the face images exceeds a threshold.

[0027] The first aspect is a storage aspect of a facial image in a storage means. The first aspect may be, for example, a storage aspect in which a facial image is stored in a first area in the storage means. The first aspect may be, for example, a storage aspect in which label information indicating the first aspect is associated with the facial image and stored in the storage means.

[0028] If a facial image that succeeds in the first face matching is not registered in the storage means in the first manner, the first registration unit 113 registers the first facial image in the storage means in a second manner (step S13). The second manner is a manner in which the facial image is stored in the storage means. The second manner may be, for example, a manner in which the facial image is stored in a second area in the storage means. The second manner may be, for example, a manner in which label information indicating the second manner is associated with the facial image and stored in the storage means.

[0029] This is a different aspect from the first aspect and the second aspect. In this embodiment, whether or not the subject is able to purchase a predetermined product may be determined depending on the aspect in which the face image is stored in the storage means.

[0030] The second acquisition unit 114 acquires a facial image of the subject who wishes to make payment for the purchase of the predetermined product (step S14). The facial image of the subject who wishes to make payment for the purchase of the predetermined product is referred to as a "second facial image."

[0031] The second determination unit 115 determines whether a face image that successfully matches the second face image is registered in the storage means in a second manner (step S15). The face matching with the second face image is referred to as "second face matching." In this embodiment, a person who successfully matches the second face image may be a person who is eligible to purchase a predetermined product.

[0032] If the face image for which the second face matching is successful is registered in the storage means in the second manner, the settlement unit 116 executes the payment process (step S16). When the payment process is executed, the second registration unit 117 registers the face image for which the second face matching is successful, which is registered in the storage means in the second manner, in the storage means in the first manner (step S17). Therefore, if the first face matching is performed again for the subject, the first face matching will be successful. In other words, a person for whom the first face matching is successful is a person who has already purchased the specified product. Therefore, a person for whom the first face matching is successful is a person who cannot purchase the specified product. In this way, it is possible to determine whether the subject is a person who can purchase the specified product depending on whether the face matching is successful or not. [Technical Effect]

[0033] For products where the number of items that can be purchased by the same person is limited, if the purchaser's purchases are not managed, the purchaser may mistakenly or maliciously purchase more than the permitted number, which may create a sense of unfairness among other customers. For example, by handing over product exchange tickets and exchanging the tickets for products on a one-to-one basis, it is possible to manage only one item per person. However, managing items using product exchange tickets requires printing each time a sale is made. This requires time and cost for both the store selling the product and the purchaser.

[0034] The information processing device 100 according to this disclosure manages purchases of predetermined products by differentiating the storage state of facial images of subjects who have purchased predetermined products from the storage state of facial images of subjects who have not purchased the predetermined products. Since purchases of predetermined products by subjects are managed by matching facial images, the subjects only have their faces photographed, and the store only has to photograph the subjects' faces, reducing the workload on humans. The information processing device 100 can ensure a sense of fairness in that each person gets one product. [3: Third Embodiment]

[0035] A third embodiment of an information processing device, an information processing method, and a recording medium will be described with reference to FIGS. 5 to 11. Hereinafter, the third embodiment of an information processing device, an information processing method, and a recording medium will be described using an information processing device 20. Note that, for the third embodiment, descriptions that overlap with the descriptions of the first and second embodiments will be omitted as appropriate. [3-1: Configuration of Information Processing Device 20]

[0036] The configuration of the information processing device 20 will be described with reference to Fig. 5. Fig. 5 is a block diagram showing the configuration of the information processing device 20.

[0037] 5 , the information processing device 20 includes a calculation device 21 and a storage device 22. The information processing device 20 may further include a communication device 23, an input device 24, and an output device 25. However, the information processing device 20 does not necessarily include at least one of the communication device 23, the input device 24, and the output device 25. The calculation device 21, the storage device 22, the communication device 23, the input device 24, and the output device 25 may be connected via a data bus 26.

[0038] The arithmetic device 21 includes at least one processor (i.e., one processor or multiple processors) as hardware. The processor may include, for example, a processor conforming to a von Neumann computer architecture. The processor conforming to the von Neumann computer architecture may include at least one of a CPU (Central Processing Unit) and a GPU (Graphics Processing Unit). The processor may include, for example, a processor conforming to a non-von Neumann computer architecture. The processor conforming to the non-von Neumann computer architecture may include at least one of an FPGA (Field Programmable Gate Array) and an ASIC (Application Specific Circuit).

[0039] The arithmetic device 21 reads a computer program 221 including at least one of computer program code and computer program instructions. For example, the arithmetic device 21 may read the computer program 221 stored in the storage device 22. For example, the arithmetic device 21 may read the computer program 221 stored in a computer-readable, non-transitory recording medium using a recording medium reading device (not shown) included in the information processing device 20. The computer program 221 read from the recording medium may be stored in the storage device 22. The arithmetic device 21 may acquire (i.e., download or read) the computer program 221 from a device (not shown) located outside the information processing device 20 via the communication device 23 (or another communication device). The downloaded computer program 221 may be stored in the storage device 22.

[0040] The arithmetic device 21 executes the loaded computer program 221. As a result, logical functional blocks for executing information processing to be performed by the information processing device 20 are realized within the arithmetic device 21. In other words, the arithmetic device 21, together with the storage device 22 or the like in which the computer program 221 is recorded (in other words, together with the storage device 22 and the computer program 221 recorded in the storage device 22 or the like), can function as a controller or computer for realizing logical functional blocks for executing processing to be performed by the information processing device 20. In other words, the at least one processor included in the arithmetic device 21, the memory (recording medium) included in the storage device 22 or the like, and the computer program 221 are configured so that the information processing device 20 performs the information processing to be performed by the information processing device 20.

[0041] The recording medium for recording the computer program 221 executed by the arithmetic device 21 may be at least one of a CD-ROM, CD-R, CD-RW, flexible disk, MO, DVD-ROM, DVD-RAM, DVD-R, DVD+R, DVD-RW, DVD+RW, Blu-ray (registered trademark), or other optical disk, a magnetic medium such as a magnetic tape, a magneto-optical disk, a semiconductor memory such as a USB memory, or any other medium capable of storing a program. The recording medium may include a device capable of recording a computer program (for example, a general-purpose device or a dedicated device in which the computer program 221 is implemented in a state in which it can be executed in at least one of the forms of software and firmware). Furthermore, each process or function included in the computer program 221 may be realized by a logical processing block realized within the arithmetic device 21 when the arithmetic device 21 (i.e., processor) executes the computer program 221, or may be realized by hardware such as a predetermined gate array (FPGA (Field Programmable Gate Array), ASIC (Application Specific Integrated Circuit)) provided in the arithmetic device 21, or may be realized in a form that mixes logical processing blocks and partial hardware modules that realize some elements of the hardware.

[0042] The storage device 22 includes at least one memory capable of storing desired data. In other words, the storage device 22 includes at least one memory containing desired data. For example, the storage device 22 may store a computer program 221 executed by the arithmetic device 21. In this case, the storage device 22 (memory) may be used as the above-mentioned recording medium for recording the computer program 221 executed by the arithmetic device 21. The storage device 22 may temporarily store data used by the arithmetic device 21 when the arithmetic device 21 is executing the computer program 221. The storage device 22 may also store data to be stored long-term by the information processing device 20. The storage device 22 may include at least one of a RAM (Random Access Memory), a ROM (Read Only Memory), a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device. In other words, the storage device 22 may include a non-temporary recording medium.

[0043] The storage device 22 may store a facial image 222 of a purchaser of a predetermined product. The facial image of a purchaser of a predetermined product may be stored in a storage device other than the storage device 22. For example, the facial image of a purchaser of a predetermined product may be stored in a storage device provided in an external device of the information processing device 20. A case where the facial image of a purchaser of a predetermined product is stored in the storage device 22 will be described below.

[0044] The communication device 23 may be capable of communicating with devices external to the information processing device 20. The communication device 23 may perform wired communication or wireless communication.

[0045] The input device 24 is a device capable of accepting information input to the information processing device 20 from outside. The input device 24 may include an operation device (e.g., a keyboard, a mouse, a touch panel, etc.) that can be operated by a user of the information processing device 20. The input device 24 may include a recording medium reading device that can read information recorded on a recording medium that is detachable from the information processing device 20, such as a USB (Universal Serial Bus) memory. Note that when information is input to the information processing device 20 via the communication device 23 (in other words, when the information processing device 20 acquires information via the communication device 23), the communication device 23 may function as an input device.

[0046] The output device 25 is a device capable of outputting information to the outside of the information processing device 20. The output device 25 may output visual information such as text or images, auditory information such as sound, or tactile information such as vibration, as the information. The output device 25 may include, for example, at least one of a display, a speaker, a printer, and a vibration motor. The output device 25 may be capable of outputting information to a recording medium detachable from the information processing device 20, such as a USB memory. Note that when the information processing device 20 outputs information via the communication device 23, the communication device 23 may function as the output device.

[0047] 5 shows an example of logical functional blocks implemented in the calculation device 21 to perform speech recognition. As shown in FIG. 5, the calculation device 21 may include a first acquisition unit 211, a first determination unit 212, a first registration unit 213, a second acquisition unit 214, a second determination unit 215, a settlement unit 216, a second registration unit 217, and an output control unit 218. The "first acquisition unit 211" is a component corresponding to the "first acquisition unit 11" in the first embodiment described above, the "first determination unit 212" is a component corresponding to the "first determination unit 12" in the first embodiment described above, the "first registration unit 213" is a component corresponding to the "first registration unit 13" in the first embodiment described above, the "second acquisition unit 214" is a component corresponding to the "second acquisition unit 14" in the first embodiment described above, the "second determination unit 215" is a component corresponding to the "second determination unit 15" in the first embodiment described above, the "payment unit 216" is a component corresponding to the "payment unit 16" in the first embodiment described above, and the "second registration unit 217" is a component corresponding to the "second registration unit 17" in the first embodiment described above. Note that when the information processing device 20 is configured on the cloud (IaaS), the "hardware" may be "virtual hardware." [3-2: Information Processing Method Executed by Information Processing Device 20]

[0048] The information processing device 20 is configured as a device for managing sales of predetermined products. The predetermined product may be a product for which the number of purchases that can be made by one subject is set. The information processing device 20 may be configured as a device for managing so that the subject does not purchase more than the number of purchases that can be made. There may be two or more types of predetermined products. The number of purchases that can be made may be set for each product. [3-2-1: When there is one type of predetermined product and the number of purchases that can be made is 1]

[0049] An information processing method executed by the information processing device 20 when there is one type of predetermined product and the purchase quantity is one will be described with reference to Figs. 6 to 9. Hereinafter, one type of predetermined product will be referred to as "product A." Fig. 6 is a flowchart showing the flow of the information processing method executed by the information processing device 20. Fig. 7 is a schematic diagram showing an overview of a situation in which the information processing device 20 is applied. Figs. 8 and 9 are schematic diagrams illustrating an example of how a face image is stored.

[0050] 6 , if there is a subject who wishes to consider purchasing product A (step S21: Yes), the first acquisition unit 211 acquires a first face image capturing an image of the face of the subject who wishes to consider purchasing product A (step S22). Step S22 may be, for example, processing in a situation where the subject declares that they are considering purchasing product A.

[0051] For example, the first acquisition unit 211 may acquire a first facial image captured by a store clerk accepting a request to consider purchasing product A using a camera mounted on a terminal device carried by the store clerk. The terminal device carried by the store clerk may be, for example, a tablet. As illustrated in FIG. 7 , a subject P may notify a store clerk S1 that he or she is considering purchasing the product, and the store clerk S1 may capture an image of the subject P's face using a camera C1 mounted on the tablet. Alternatively, the first acquisition unit 211 may acquire a first facial image captured by a fixed camera installed so as to be able to capture an image of an entrance to a sales floor for product A, for example.

[0052] The first determination unit 212 determines whether a face image that succeeds in the first face matching with the first face image is registered in the storage device 22 in a first mode (step S23). For example, as shown in FIG. 8 , the area 222 for storing face images FI in the storage device 22 may include a first storage area 2221 and a second storage area 2222. In this case, the first mode may be a mode in which the face image FI is stored in the first storage area 2221. Furthermore, the second mode may be a mode in which the face image FI is stored in the second storage area 2222. Alternatively, as shown in FIG. 9 , the first mode may be a mode in which label information L indicating the first mode is associated with the face image FI and stored in the area 222 for storing face images in the storage device 22. Furthermore, the second mode may be a mode in which label information L indicating the second mode is associated with the face image FI and stored in the area 222 for storing face images in the storage device 22.

[0053] This section explains how to acquire biometric information when the biometric information is an image other than a facial image. For example, when the biometric information is an iris image, two types of iris images, a right-eye iris image and a left-eye iris image, can be acquired from the same person. Therefore, if it is not specified which eye the iris image should be acquired from, the same person may make purchases by registering both a left-eye iris image and a right-eye iris image.

[0054] In this embodiment, in order to prevent the same person from registering multiple types of biometric information and making multiple purchases, if multiple types of biometric information can be acquired, the biometric information may be acquired from a predetermined body part. For example, if the biometric information is an iris image, the predetermined body part may be the right eye, and an iris image may be acquired from the right eye, but not from the left eye. Alternatively, if the biometric information is an iris image, the predetermined body part may be the left eye, and an iris image may be acquired from the left eye, but not from the right eye. For example, if the biometric information is a fingerprint image, the predetermined body part may be the index finger of the right hand, and a fingerprint image may be acquired from the index finger of the right hand, but not from any fingers other than the index finger of the right hand. Alternatively, if the biometric information is a fingerprint image, the predetermined body part may be any finger other than the index finger of the right hand. For example, if the biometric information is a palmprint image, the predetermined body part may be the right palm, and a palmprint image may be acquired from the right palm, but not from the left palm. Alternatively, if the biometric information is a palmprint image, the predetermined body part may be the left palm. For example, when the biometric information is a vein image, the predetermined part may be the index finger of the right hand, and the vein image may be acquired from the index finger of the right hand, and no vein images may be acquired from parts of the right hand other than the index finger. Alternatively, when the biometric information is a vein image, the predetermined part may be a finger other than the index finger of the right hand.

[0055] For example, the first acquisition unit 211 may determine from which part the biometric information was acquired based on an image captured by an imaging unit that acquires the biometric information. If the biometric information is an iris image, the first acquisition unit 211 may determine whether the iris image is of the right eye or the left eye based on the shape of the eye.

[0056] For example, the first acquisition unit 211 may determine from which part of the body the biometric information was acquired based on an image captured by an imaging unit other than the imaging unit that acquires the biometric information. If the biometric information is an iris image, the first acquisition unit 211 may determine from which eye the iris image was acquired based on an image captured by an imaging unit capable of capturing an image including both eyes. If the biometric information is a fingerprint image, a palm print image, or a vein image, the first acquisition unit 211 may determine from which part of the body the fingerprint image, palm print image, or vein image was acquired based on an image captured by an imaging unit capable of capturing an image including both hands.

[0057] If the first acquisition unit 211 determines that the biometric information has been acquired from a part other than the predetermined part, it may determine that the acquisition by the first acquisition unit 211 has failed, and invalidate the biometric information acquired by the first acquisition unit 211. Alternatively, a store clerk may determine from which part of the body the biometric information was acquired by visual confirmation. If the store clerk determines that the biometric information has been acquired from a part other than the predetermined part, the store clerk may invalidate the biometric information acquired by the first acquisition unit 211.

[0058] If a facial image that succeeds in the first face matching with the first facial image is not registered in the storage device 22 in the first mode (step S23: NO), the first registration unit 213 registers the first facial image in the storage device 22 in the second mode (step S24). For example, as shown in Fig. 8, the first registration unit 213 may register the first facial image FI in the second storage area 2222. Alternatively, for example, as shown in Fig. 9, the first registration unit 213 may associate the first facial image FI with label information L indicating the second mode and register it in the area 222 for storing facial images of the storage device 22.

[0059] If there is a target person who wishes to purchase Product A (Step S25: Yes), the second acquisition unit 214 acquires a second face image capturing an image of the face of the target person who wishes to purchase Product A (Step S26). Step S26 may be, for example, processing in a situation where the target person who has decided to purchase Product A applies for the purchase.

[0060] The subject who wishes to purchase Product A may be a subject who wishes to make payment for the purchase of Product A. Alternatively, the subject may be a subject who wishes to settle the purchase of Product A. For example, the second acquisition unit 214 may acquire a second facial image captured by a store clerk who accepts payment for the purchase of Product A using a camera mounted on a terminal device carried by the store clerk. As illustrated in FIG. 7 , the subject P may request a purchase from the store clerk S2, and the store clerk S2 may capture an image of the subject P's face using a camera C2 mounted on a tablet. Alternatively, the second acquisition unit 214 may acquire a second facial image captured by a fixed camera installed so as to be able to capture an image of the vicinity of the display shelf on which Product A is displayed, etc.

[0061] The second determination unit 215 determines whether a face image that succeeds in the second face matching with the second face image is registered in the storage device 22 in the second format (step S27). If a face image that succeeds in the second face matching is registered in the storage device 22 in the second format (step S27: Yes), the payment unit 216 executes payment processing (step S28). The payment unit 216 may execute payment processing by facial authentication. The payment unit 216 may execute payment processing using a payment method linked to the subject.

[0062] When the payment process is executed, the second registration unit 217 registers the face image that has been registered in the storage device 22 in the second mode and that has succeeded in the second face matching in the storage device 22 in the first mode (step S29). The face image that has succeeded in the second face matching is referred to as a "registered face image." For example, as shown in FIG. 8, the second registration unit 217 may register the registered face image FI that was registered in the second memory area 2222 in the first memory area 2221. Alternatively, for example, as shown in FIG. 9, the second registration unit 217 may change the label information L that indicates the second mode and that is associated with the registered face image FI to the label information L that indicates the first mode.

[0063] When the payment process is executed, the facial image that is registered in the storage device 22 in the second mode and that has succeeded in the second face matching is registered in the storage device 22 in the first mode. Therefore, a subject whose facial image that has succeeded in the first face matching with the first facial image is registered in the storage device 22 in the first mode is a subject who has purchased product A. In other words, a subject who has purchased product A is a subject who cannot purchase product A. Therefore, if a facial image that has succeeded in the first face matching with the first facial image is registered in the storage device 22 in the first mode (step S23: Yes), the output control unit 218 outputs information indicating that product A cannot be purchased (step S30).

[0064] Furthermore, when the payment process is executed, the facial image that has been registered in the storage device 22 in the second mode and that has succeeded in the second face matching is registered in the storage device 22 in the first mode. Therefore, a subject for whom a facial image that has succeeded in the second face matching with the second facial image has not been registered in the storage device 22 in the second mode is a subject who has purchased product A. In other words, a subject who has purchased product A is a subject who cannot purchase the specified product. Therefore, if a facial image that has succeeded in the second face matching has not been registered in the storage device 22 in the second mode (step S27: No), the output control unit 218 outputs information indicating that the specified product cannot be purchased (step S30). [3-2-2: When there is one type of specified product and the number of purchases available is two or more]

[0065] 10 and 11 , an information processing method executed by the information processing device 20 when there is one type of predetermined product and the number of purchases available is two or more will be described. Fig. 10 is a flowchart showing the flow of the information processing method executed by the information processing device 20. Fig. 11 is a schematic diagram showing an overview of the information processing method executed by the information processing device 20.

[0066] As shown in Figure 10, if there is a subject who wishes to consider purchasing product A (step S21: Yes), the first acquisition unit 211 acquires a first facial image capturing the face of the subject who wishes to consider purchasing product A (step S22).

[0067] The first determination unit 212 determines whether a face image that is successful in the first face matching with the first face image is registered in the storage device 22 in a first manner (step S23). If a face image that is successful in the first face matching with the first face image is not registered in the storage device 22 in the first manner (step S23: NO), the first registration unit 213 determines whether a face image that is successful in the first face matching with the first face image is registered in the storage device 22 in a second manner (step S31). If a face image that is successful in the first face matching with the first face image is not registered in the storage device 22 in the second manner (step S31), the first registration unit 213 registers the first face image in the storage device 22 in the second manner (step S24).

[0068] When the number of items that can be purchased is two or more, for example, the second storage area 2222 may include an area for each purchase number. For example, when the number of items that can be purchased is two, the second storage area 2222 may include an area for storing facial images of subjects whose purchase number is still zero and an area for storing facial images of subjects whose purchase number is one. Alternatively, when the number of items that can be purchased is two or more, for example, label information indicating the purchase number may be associated with the facial image registered in the storage device 22 in the second mode.

[0069] Alternatively, when the number of purchases that can be made is two or more, it may be determined whether the facial image is registered in the storage device 22 in a first manner or a second manner, depending on label information indicating the number of purchases that is associated with the facial image registered in the storage device 22. For example, as shown in Fig. 11, when the number of purchases that can be made is two, it may be determined that the facial image associated with label information L indicating the number of purchases is 0 or 1 is registered in the storage device 22 in the second manner. Also, when the number of purchases that can be made is two, it may be determined that the facial image associated with label information L indicating the number of purchases is 2 is registered in the storage device 22 in the first manner.

[0070] If there is a target person who wishes to purchase product A (step S25: Yes), the second acquisition unit 214 acquires a second face image capturing the face of the target person who wishes to purchase product A (step S26).

[0071] The second determination unit 215 determines whether a face image that is successful in the second face matching with the second face image is registered in the storage device 22 in the second format (step S27). If a face image that is successful in the second face matching is registered in the storage device 22 in the second format (step S27: Yes), the settlement unit 216 executes payment processing (step S28).

[0072] The second registration unit 217 determines whether the number of purchases of the product A by the subject has reached the purchase limit (step S32). If the number of purchases of the product A by the subject has reached the purchase limit (step S32: Yes), the second registration unit 217 registers the registered face image that has been registered in the storage device 22 in the second mode and that has succeeded in the second face matching in the storage device 22 in the first mode (step S29).

[0073] If the number of purchases of product A by the subject does not reach the purchaseable number (step S32: No), the second registration unit 217 updates the purchase quantity information corresponding to the registered facial image registered in the storage device 22 in the second manner (step S33). If the second memory area 2222 includes an area for each purchase quantity, the second registration unit 217 may change the area for storing the registered facial image in the second memory area 2222. Alternatively, the second registration unit 217 may update label information indicating the purchase quantity associated with the registered facial image.

[0074] If a face image that is successful in the first face matching with the first face image is registered in the storage device 22 in the first format (step S23: Yes), the output control unit 218 outputs information indicating that the product A cannot be purchased (step S30). Also, if a face image that is successful in the second face matching is not registered in the storage device 22 in the second format (step S27: No), the output control unit 218 outputs information indicating that the product A cannot be purchased (step S30). [3-2-3: When there are two or more types of specified products]

[0075] If there are two or more types of predetermined products, a storage area may be set for each product, and an information processing method similar to the information processing method described above may be executed for each product. For example, if there are two types of predetermined products, product B and product C, and the purchase quantity of product B is one, an information processing method similar to the information processing method described with reference to Figures 6 to 9 may be executed for product B. Furthermore, if the purchase quantity of product C is two or more, an information processing method similar to the information processing method described with reference to Figures 10 and 11 may be executed for product C. [3-3: Technical Effects]

[0076] The information processing device 20 according to this disclosure manages purchases of predetermined products by subjects by matching facial images, and therefore can sell predetermined products while ensuring a sense of fairness and without imposing a burden on humans. [4: Fourth Embodiment]

[0077] A fourth embodiment of an information processing device, an information processing method, and a recording medium will be described with reference to Figures 12 and 13. Hereinafter, the fourth embodiment of an information processing device, an information processing method, and a recording medium will be described using an information processing device 30. Note that, for the fourth embodiment, descriptions that overlap with the descriptions of the first to third embodiments will be omitted as appropriate. Note that, in the drawings, parts common to the first to third embodiments are indicated by the same reference numerals.

[0078] As shown in FIG. 12, the calculation device 21 provided in the information processing device 30 has, as logical functional blocks, a first acquisition unit 211, a first judgment unit 212, a first registration unit 213, a second acquisition unit 214, a second judgment unit 215, a payment unit 216, a second registration unit 217, an output control unit 218, a product quantity acquisition unit 319, and a calculation unit 320.

[0079] The storage device 22 may store the product count 323 of a predetermined product. The product count of a predetermined product may include the inventory quantity of the predetermined product and the sales quantity of the predetermined product. The product count of a predetermined product may be stored in a storage device other than the storage device 22. For example, the product count of a predetermined product may be stored in a storage device provided in a device external to the information processing device 20. The following describes a case where the product count of a predetermined product is stored in the storage device 22. [4-1: Information processing method executed by the information processing device 30]

[0080] An information processing method executed by the information processing device 30 will be described with reference to Fig. 13. Fig. 13 is a flowchart showing the flow of the information processing method executed by the information processing device 30. When there are two or more types of predetermined products, the information processing operation described with reference to Fig. 13 may be performed for each product.

[0081] 13 , when the store closes (step S35: Yes), the product number acquisition unit 319 acquires the number of predetermined products in stock and the number of predetermined products sold (step S36). The product number acquisition unit 319 may acquire the number of predetermined products in stock and the number of predetermined products sold when the register is closed. The register closing may be an operation performed after the store closes for the day. The register closing may be an operation that determines at least the number of predetermined products in stock at the end of the day's business and the number of predetermined products sold during the store's business hours for the day.

[0082] The calculation unit 320 calculates and outputs the available purchase quantity based on the inventory quantity of the specified product and the sales quantity of the specified product (step S37). The information processing device 30 may set the calculated available purchase quantity as the available sales quantity for the next day. Alternatively, the store clerk may set the available sales quantity for the next day based on the calculated available purchase quantity.

[0083] In step S36, the product number acquisition unit 319 may acquire at least one of the ratio of the number of people who succeeded in the first face matching to the number of people who failed the first face matching and the ratio of the number of people who succeeded in the second face matching to the number of people who failed the second face matching, in addition to the inventory number of the specific product and the sales number of the specific product. In this case, in step S37, the calculation unit 320 may calculate the available number of products based on at least one of the ratio of the number of people who succeeded in the first face matching to the number of people who failed the first face matching and the ratio of the number of people who succeeded in the second face matching to the number of people who failed the second face matching, in addition to the inventory number of the specific product and the sales number of the specific product.

[0084] It can be considered that if the number of people who have attempted to purchase more than once is increased, the number of people who do not attempt to purchase legitimately may increase. For this reason, the acquired ratio may be used as a weighting factor to suppress an increase in the number of people who can purchase. Furthermore, the acquired ratio may be used as a weighting factor to not suppress an increase in the number of people who can purchase if the proportion of people who have purchased legitimately is high.

[0085] Alternatively, if many people have attempted to purchase two or more times, it can be assumed that many people want to purchase two or more of the specified product. Therefore, the obtained ratio may be used as a weighting factor to increase the number of items available for purchase. For example, if there is a large amount of inventory and many people want to purchase two or more times, the number of items available for purchase may be increased to increase sales. How the ratio is used may be determined based on the sales purpose and the characteristics of the specified product.

[0086] The product number acquisition unit 319 may further acquire sales period information indicating a sales period. In this case, the calculation unit 320 may calculate the available number of products by taking the sales period information into account. [4-2: Technical Effects]

[0087] If there is a limit on the number of items that can be purchased, the inventory may not decrease if sales do not increase as expected. However, if the limit on the number of items that can be purchased is abolished, there may be cases where people who want to purchase a specific product are unable to do so. The information processing device 30 according to this disclosure calculates the number of items that can be purchased based on the number of items sold and the number of items in stock, so that the inventory of the specific product can be reduced at an ideal pace. Furthermore, the information processing device 30 can prevent cases where people who want to purchase a specific product are unable to purchase it. [5: Fifth Embodiment]

[0088] A fifth embodiment relating to an information processing device, an information processing method, and a recording medium will be described with reference to Figures 14 and 15. Hereinafter, the fifth embodiment relating to an information processing device, an information processing method, and a recording medium will be described using an information processing device 40. Note that, for the fifth embodiment, descriptions that overlap with the descriptions of the first to fourth embodiments will be omitted as appropriate. Note that, in the drawings, parts common to the first to fourth embodiments are designated by the same reference numerals.

[0089] As shown in Fig. 14, the arithmetic device 21 included in the information processing device 40 includes, as logical functional blocks, a third acquisition unit 421, a third registration unit 422, a fourth acquisition unit 423, a third determination unit 424, an output control unit 418, and a settlement unit 416. The storage device 22 may store instruction information 425. The instruction information may be stored in a storage device other than the storage device 22. For example, the instruction information may be stored in a storage device included in a device external to the information processing device 20. Below, a case where instruction information is registered in the storage device 22 will be described. [5-1: Information Processing Method Executed by the Information Processing Device 40]

[0090] The information processing device 40 may be used in facilities such as theme parks where people can experience something out of the ordinary. An information processing method executed by the information processing device 40 will be described with reference to Fig. 15. Fig. 15 is a flowchart showing the flow of the information processing method executed by the information processing device 40.

[0091] 15, when the target expresses an instruction (step S41: Yes), the third acquisition unit 421 acquires an image (step S42). The image may be an instruction image captured including the target expressing the instruction and the target's face. The target expressing the instruction may be an object performing a specific action. The target may be a theme park character, employee, etc. The target may be a theme park guest. Hereinafter, the target will be referred to as a character, and the target will be referred to as a guest.

[0092] When a character performs a specific action near a guest, the third acquisition unit 421 may acquire an instruction image including the character and the guest, captured by a theme park employee. Alternatively, the character may perform a specific action near a guest who is in a specific location. The third acquisition unit 421 may acquire an instruction image from a fixed camera capturing an image of the specific location.

[0093] The specific action may be, for example, the action of casting a spell. Instead of performing the specific action, the character may hold a specific object and appear in the image together with the guest. The specific object may be an object of a unique color, an object of a unique shape, etc. The specific object may be a red wand, a tool associated with magic, etc. The specific object may be an object that emits a predetermined radio wave.

[0094] The third registration unit 422 extracts instruction information indicating an instruction expressed by the character from the instruction image. The third registration unit 422 associates the instruction information with a facial image of the guest's face area in the instruction image and registers the association information in a storage area of ​​the instruction information 425 (step S43). That is, the third registration unit 422 registers an instruction related to the guest and a facial image that can identify the guest in association with each other. For example, if it is the guest's birthday, the instruction related to the guest may be an instruction to celebrate the guest when the guest goes shopping.

[0095] If the specific object is an object that emits a predetermined radio wave, the third registration unit 422 may receive the predetermined radio wave. The third registration unit 422 may register instruction information corresponding to the predetermined radio wave and a facial image of the guest in association with each other.

[0096] If the guest requests a predetermined process (step S44: Yes), the fourth acquisition unit 423 acquires a facial image of the guest's face (step S45). The predetermined process may be a payment process. If the guest requests to purchase a product, the fourth acquisition unit 423 may acquire a facial image of the guest's face. The facial image acquired by the fourth acquisition unit 423 is referred to as a "second facial image."

[0097] The third determination unit 424 determines whether a face image that can be successfully matched with the second face image is registered in the storage area of ​​the instruction information 425 (step S46). A face image that can be successfully matched with the second face image is referred to as a "registered face image."

[0098] If a registered face image that successfully matches the second face image is registered in the storage device 22 (step S46: Yes), the output control unit 418 outputs information based on the instruction information associated with the registered face image (step S47).

[0099] The output control unit 418 may output information related to the character that cast a spell on the guest in step S41 (Example 1). For example, the output control unit 418 may display an effect related to the character on a display device. The output control unit 418 may also output a receipt with the character printed on it. The output control unit 418 may also output information related to payment in the voice of the character.

[0100] For example, if the instruction information indicates that today is the guest's birthday, the output control unit 418 may output an instruction to the store clerk to celebrate the guest's birthday (Example 2). For example, the output control unit 418 may output an instruction to the store clerk to present the guest with a special gift such as a sticker. The output control unit 418 may implement both the output of Example 1 and the output of Example 2.

[0101] The payment unit 416 executes the payment process (step S48). The payment unit 216 may execute the payment process using a payment method associated with the guest through facial recognition. [5-2: Technical Effects]

[0102] When facial images are captured for facial recognition at a theme park or the like, guests lose their sense of immersion and feel as if they have been brought back to reality. The information processing device 40 according to this disclosure captures facial images for facial recognition while taking photographs of characters and guests together, so guests do not lose their sense of immersion at a theme park or the like. [6: Supplementary Note]

[0103] The above-described embodiment may be further described as follows, but is not limited to the following. [Supplementary Note 1] An information processing device comprising: a first acquisition means for acquiring a first facial image obtained by capturing an image of a face of a subject; a first determination means for determining whether a facial image that succeeds in first face matching with the first facial image is registered in a first manner in a storage means; a first registration means for registering the first facial image in a second manner in the storage means when the facial image that succeeds in first face matching is not registered in the storage means in the first manner; a second acquisition means for acquiring a second facial image obtained by capturing an image of the face of a subject who wishes to make payment for the purchase of a predetermined product; a second determination means for determining whether a facial image that succeeds in second face matching with the second facial image is registered in the storage means in the second manner; a payment means for executing the payment process when the facial image that succeeds in second face matching is registered in the storage means in the second manner; and a second registration means for registering the registered facial image that succeeds in second face matching, which is registered in the storage means in the first manner, in the storage means when the payment process has been executed. [Supplementary Note 2] The information processing device according to claim 1, further comprising: an output unit that outputs information indicating that the product cannot be purchased when a facial image that succeeds in the first face matching is registered in the storage unit in the first manner. [Supplementary Note 3] The information processing device according to claim 1, further comprising: a facial image of a subject who has purchased the available number of the product is registered in the storage unit in the first manner, and a facial image of a subject who is eligible to purchase the product is registered in the storage unit in the second manner. [Supplementary Note 4] The information processing device according to claim 3, further comprising: a second registration unit that, when the number of purchases of the product reaches the available number, deletes the registered facial image that succeeds in the second face matching and is registered in the storage unit in the second manner, and registers the registered facial image in the storage unit in the first manner. [Supplementary Note 5] The information processing device according to claim 2, further comprising: a product number acquisition unit that acquires the inventory number of the product and the sales number of the product; and a calculation unit that calculates and outputs the available purchase number based on the inventory number of the product and the sales number of the product.and a registering means for registering, in a storage means, information on the instruction information associated with the registered face image of the subject who desires a predetermined process. [Supplementary Note 6] The information processing device according to claim 4, wherein the calculating means calculates the available quantity based on the inventory quantity of the product and the sales quantity of the product, as well as the ratio of the number of people who succeeded in the first face matching to the number of people who failed the first face matching, or the ratio of the number of people who succeeded in the second face matching to the number of people who failed the second face matching. [Supplementary Note 7] The information processing device includes: a third acquiring means for acquiring an instruction image captured including an object representing an instruction and a face of the subject; a third registering means for extracting instruction information indicative of the instruction represented by the object from the instruction image, and associating the instruction information with a face image of a face region of the subject in the instruction image and registering the association between the instruction information and the face image of the subject in a storage means; a fourth acquiring means for acquiring a second face image captured of the face of the subject who desires a predetermined process; a third determining means for determining whether a face image that succeeds in face matching with the second face image is registered in the storage means; and an output means for outputting information based on the instruction information associated with the registered face image when a registered face image that succeeds in face matching with the second face image is registered in the storage means. [Supplementary Note 8] An information processing method executed by a computer, comprising: acquiring a first facial image capturing a face of a subject; determining whether or not a facial image that succeeds in first face matching with the first facial image is registered in a storage means in a first manner; if the facial image that succeeds in first face matching is not registered in the storage means in the first manner, registering the first facial image in the storage means in a second manner; acquiring a second facial image capturing a face of a subject who wishes to make payment for the purchase of a predetermined product; determining whether or not a facial image that succeeds in second face matching with the second facial image is registered in the storage means in the second manner; if the facial image that succeeds in second face matching is registered in the storage means in the second manner, executing the payment process; and if the payment process has been executed, registering the registered facial image that succeeds in second face matching, registered in the storage means in the first manner.[Supplementary Note 9] A recording medium having recorded thereon a computer program causing a computer to execute an information processing method, the information processing method including: acquiring a first facial image obtained by capturing an image of a subject's face; determining whether or not a facial image that succeeds in first face matching with the first facial image is registered in a storage means in a first manner; if the facial image that succeeds in first face matching is not registered in the storage means in the first manner, registering the first facial image in the storage means in a second manner; acquiring a second facial image obtained by capturing an image of a subject's face who wishes to make payment for the purchase of a predetermined product; determining whether or not a facial image that succeeds in second face matching with the second facial image is registered in the storage means in the second manner; if the facial image that succeeds in second face matching is registered in the storage means in the second manner, executing the payment process; [Supplementary Note 10] An information processing device comprising: a first acquisition means for acquiring first biometric information from at least some of subjects; a first determination means for determining whether biometric information that succeeds in the first matching with the first biometric information is registered in a first manner in a storage means; a first registration means for registering the first biometric information in a second manner in a storage means when the biometric information that succeeds in the first matching is not registered in the storage means in the first manner; a second acquisition means for acquiring second biometric information from at least some of subjects who wish to make payment for the purchase of a predetermined product; a second determination means for determining whether biometric information that succeeds in the second matching with the second biometric information is registered in the storage means in the second manner; a payment means for executing the payment process when the biometric information that succeeds in the second matching is registered in the storage means in the second manner; and a second registration means for registering the registered biometric information that succeeds in the second matching and that is registered in the storage means in the first manner when the payment process has been executed. [Supplementary Note 11] The information processing device according to Supplementary Note 10, further comprising an output means for outputting information indicating that the product cannot be purchased when the biometric information that succeeds in the first matching is registered in the storage means in the first manner.[Supplementary Note 12] The information processing device of Supplementary Note 10, wherein biometric information of subjects who have purchased the available number of products is registered in the storage means in the first mode, and biometric information of subjects who are eligible to purchase the products is registered in the storage means in the second mode. [Supplementary Note 13] The information processing device of Supplementary Note 12, wherein the second registration means, when the number of purchases of the product reaches the available number, deletes the registered biometric information for which the second matching has succeeded, registered in the storage means in the second mode, and registers the registered biometric information in the storage means in the first mode. [Supplementary Note 14] The information processing device of Supplementary Note 11, comprising: product number acquisition means for acquiring the number of products in stock and the number of products sold; and calculation means for calculating and outputting the available number of products based on the number of products in stock and the number of products sold. [Supplementary Note 15] The information processing device of Supplementary Note 14, wherein the calculation means calculates the available number of products based on the number of products in stock and the number of products sold, as well as the ratio of the number of people who succeeded in the first matching to the number of people who failed the first matching, or the ratio of the number of people who succeeded in the second matching to the number of people who failed the second matching. [Supplementary Note 16] An information processing device comprising: a third acquisition means for acquiring an instruction image captured including an object representing an instruction and at least a part of a subject; a third registration means for extracting instruction information indicating the instruction represented by the object from the instruction image, and associating the instruction information with a biometric image of at least a part of the subject in the instruction image and registering the association in a storage means; a fourth acquisition means for acquiring a second biometric image captured of at least a part of the subject who desires a predetermined process; a third determination means for determining whether a biometric image that can be successfully matched with the second biometric image is registered in the storage means; and an output means for outputting information based on the instruction information associated with the registered biometric image when a registered biometric image that can be successfully matched with the second biometric image is registered in the storage means.[Supplementary Note 17] An information processing method executed by a computer, comprising: acquiring first biometric information from at least some of subjects; determining whether or not biometric information that succeeds in a first matching with the first biometric information is registered in a storage means in a first manner; if the biometric information that succeeds in the first matching is not registered in the storage means in the first manner, registering the first biometric information in a second manner in the storage means; acquiring second biometric information from at least some of subjects who wish to make payment for the purchase of a predetermined product; determining whether or not biometric information that succeeds in a second matching with the second biometric information is registered in the storage means in the second manner; if the biometric information that succeeds in the second matching is registered in the storage means in the second manner, executing the payment process; and if the payment process has been executed, registering the registered biometric information that succeeds in the second matching and that is registered in the storage means in the first manner. [Supplementary Note 18] A recording medium having recorded thereon a computer program causing a computer to execute an information processing method, the information processing method including: acquiring first biometric information from at least some of the subjects; determining whether or not biometric information that succeeds in a first matching with the first biometric information is registered in a storage means in a first manner; if the biometric information that succeeds in the first matching is not registered in the storage means in the first manner, registering the first biometric information in a second manner in the storage means; acquiring second biometric information from at least some of the subjects who wish to make payment for the purchase of a predetermined product; determining whether or not biometric information that succeeds in a second matching with the second biometric information is registered in the storage means in the second manner; if the biometric information that succeeds in the second matching is registered in the storage means in the second manner, executing the payment process; and if the payment process has been executed, registering the registered biometric information that succeeds in the second matching and is registered in the storage means in the first manner.

[0104] This disclosure may be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification, and information processing devices, information processing methods, and recording media that involve such modifications are also included in the technical idea of ​​this disclosure.

[0105] 10, 20, 30, 40, 100 Information processing device 11, 111, 211 First acquisition unit 12, 112, 212 First determination unit 13, 113, 213 First registration unit 14, 114, 214 Second acquisition unit 15, 115, 215 Second determination unit 16, 116, 216, 416 Settlement unit 17, 117, 217 Second registration unit 218, 418 Output control unit 319 Product number acquisition unit 320 Calculation unit 421 Third acquisition unit 422 Third registration unit 423 Fourth acquisition unit 424 Third determination unit

Claims

1. An information processing device comprising: a first acquisition means for acquiring first biometric information from at least some of the subjects; a first determination means for determining whether biometric information that is successful in the first matching with the first biometric information is registered in a first manner in a storage means; a first registration means for registering the first biometric information in a second manner in a storage means if the biometric information that is successful in the first matching is not registered in the storage means in the first manner; a second acquisition means for acquiring second biometric information from at least some of the subjects who wish to make payment for the purchase of a specified product; a second determination means for determining whether biometric information that is successful in the second matching with the second biometric information is registered in the storage means in the second manner; a payment means for executing the payment process if the biometric information that is successful in the second matching is registered in the storage means in the second manner; and a second registration means for registering the registered biometric information that is successful in the second matching and that is registered in the storage means in the first manner when the payment process has been executed.

2. An information processing device according to claim 1, further comprising an output means for outputting information indicating that the product cannot be purchased if biometric information that passes the first matching is registered in the storage means in the first manner.

3. An information processing device as described in claim 1, wherein the biometric information of a subject who has purchased the available number of the product is registered in the storage means in the first manner, and the biometric information of a subject who is eligible to purchase the product is registered in the storage means in the second manner.

4. An information processing device as described in claim 3, wherein the second registration means, when the number of purchases of the product reaches the purchaseable number, deletes the registered biometric information that has been registered in the storage means in the second manner and that has succeeded in the second matching, and registers the registered biometric information in the storage means in the first manner.

5. An information processing device as described in claim 2, comprising: a product quantity acquisition means for acquiring the inventory quantity of the product and the sales quantity of the product; and a calculation means for calculating and outputting the purchaseable quantity based on the inventory quantity of the product and the sales quantity of the product.

6. The information processing device according to claim 5, wherein the calculation means calculates the number of items available for purchase based on the number of items in stock and the number of items sold, as well as the ratio of the number of people who succeeded in the first matching to the number of people who failed the first matching, or the ratio of the number of people who succeeded in the second matching to the number of people who failed the second matching.

7. An information processing device comprising: a third acquisition means for acquiring an instruction image captured including an object representing an instruction and at least a portion of a subject; a third registration means for extracting instruction information indicating the instruction represented by the object from the instruction image and associating the instruction information with a biometric image of at least a portion of the subject in the instruction image and registering the associated information in a storage means; a fourth acquisition means for acquiring a second biometric image captured of at least a portion of the subject desiring a predetermined process; a third determination means for determining whether a biometric image that can be successfully matched with the second biometric image is registered in the storage means; and an output means for outputting information based on the instruction information associated with the registered biometric image when a registered biometric image that can be successfully matched with the second biometric image is registered in the storage means.

8. An information processing method executed by a computer, comprising: acquiring first biometric information from at least some of the subjects; determining whether biometric information that succeeds in the first matching with the first biometric information is registered in a first manner in a storage means; if the biometric information that succeeds in the first matching is not registered in the storage means in the first manner, registering the first biometric information in a second manner in a storage means; acquiring second biometric information from at least some of the subjects who wish to make payment for the purchase of a specified product; determining whether biometric information that succeeds in the second matching with the second biometric information is registered in the storage means in the second manner; if the biometric information that succeeds in the second matching is registered in the storage means in the second manner, executing the payment process; and if the payment process has been executed, registering the registered biometric information that succeeds in the second matching and is registered in the storage means in the first manner.

9. A recording medium having recorded thereon a computer program causing a computer to execute an information processing method including: acquiring first biometric information from at least some of the subjects; determining whether or not biometric information that is successful in a first matching with the first biometric information is registered in a storage means in a first manner; if the biometric information that is successful in the first matching is not registered in the storage means in the first manner, registering the first biometric information in a second manner in the storage means; acquiring second biometric information from at least some of the subjects who wish to make payment for the purchase of a specified product; determining whether or not biometric information that is successful in a second matching with the second biometric information is registered in the storage means in the second manner; if the biometric information that is successful in the second matching is registered in the storage means in the second manner, executing the payment process; and if the payment process has been executed, registering the registered biometric information that is registered in the storage means in the second manner and that is successful in the second matching in the storage means in the first manner.

Images