Information Processing System, Customer Identification Device, Information Processing Method, and Program

Abstract

To provide a new technique for identifying a person who makes a settlement using face authentication processing.SOLUTION: An information processing system includes: an acquisition unit that acquires an image generated by a camera; a selection unit that extracts a person in the acquired image, and selects, when multiple persons are extracted, a person with action as a person who performs a settlement process; an identification unit that identifies the person based on the image in which the person is included, and database information in which a feature value of a face is registered; and a settlement unit (checkout unit) that performs the settlement process with respect to the identified person.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an information processing system, a customer identification device, an information processing method, and a program.

Background Art

[0002] Patent Document 1 discloses an information processing system that uses face authentication processing for accounting work. The information processing system is disclosed to acquire information including the face information of a visitor, and to perform face authentication using the face information of the visitor included in the acquired information and the registered face information of each member registered in the member database.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the technology of identifying a person to be settled using face authentication processing, when a plurality of persons are extracted from an image, there is a problem that the identification accuracy of the person to be settled decreases. An object of the present invention is to improve the identification accuracy of a person to be settled using face authentication processing.

Means for Solving the Problems

[0005] According to the present invention, an acquisition means for acquiring an image of a face generated by a camera, a selection means for extracting a person in the acquired image and, when a plurality of persons are extracted, selecting a person with movement as the person to perform settlement processing, an identification means for identifying the person based on the image including the selected person and database information in which face feature amounts are registered, a settlement means for performing settlement processing on the identified person, An information processing system having the same is provided.

[0006] Also, according to the present invention, acquisition means for acquiring a face image generated by a camera; selection means for extracting a person in the acquired image and, when a plurality of persons are extracted, selecting a person with movement as the person who performs a settlement process; identification means for identifying the person based on the image including the selected person and database information in which face feature amounts are registered; notification means for notifying an accounting device of information for identifying the person who performs the settlement process identified by the identification means; A customer identification device having the same is provided.

[0007] Also, according to the present invention, a computer acquires a face image generated by a camera, extracts a person in the acquired image, and when a plurality of persons are extracted, selects a person with movement as the person who performs a settlement process, identifies the person based on the image including the selected person and database information in which face feature amounts are registered, and performs a settlement process on the identified person, An information processing method is provided.

[0008] Also, according to the present invention, a computer is caused to function as acquisition means for acquiring a face image generated by a camera, selection means for extracting a person in the acquired image and, when a plurality of persons are extracted, selecting a person with movement as the person who performs a settlement process, identification means for identifying the person based on the image including the selected person and database information in which face feature amounts are registered, settlement means for performing a settlement process on the identified person, and a program is provided.

Advantages of the Invention

[0009] According to the present invention, it is possible to improve the identification accuracy of a person to be settled using face authentication processing.

Brief Description of the Drawings

[0010] The above-mentioned object, as well as other objects, features, and advantages, will be further clarified by the preferred embodiments described below and the following accompanying drawings.

[0011]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Mode for Carrying Out the Invention

[0012] <First Embodiment> FIG. 1 shows an example of a functional block diagram of the information processing system 100 according to the present embodiment. As shown in the figure, the information processing system 100 includes an acquisition unit 11, a specifying unit 12, a selection unit 14, and a settlement unit 21. The information processing system 100 according to the present embodiment is, for example, a POS (point of sales) register. The POS register may be premised on being operated by a store clerk or may be premised on being operated by a customer.

[0013] Here, an example of the hardware configuration of the information processing system 100 will be described. Each functional unit included in the information processing system 100 according to the present embodiment is realized by an arbitrary combination of hardware and software centered on a CPU (Central Processing Unit), a memory, a program loaded into the memory, a storage unit such as a hard disk for storing the program (in addition to a program stored in advance at the stage of shipping the device, a program downloaded from a storage medium such as a CD (Compact Disc) or a server on the Internet can also be stored), and a network connection interface. And it is understood by those skilled in the art that there are various modifications to the realization method and device.

[0014] FIG. 2 is a block diagram illustrating the hardware configuration of the information processing system 100 according to the present embodiment. As shown in FIG. 2, the information processing system 100 includes a processor 1A, a memory 2A, an input / output interface 3A, a peripheral circuit 4A, and a bus 5A. The peripheral circuit 4A includes various modules.

[0015] Bus 5A is a data transmission path for the processor 1A, memory 2A, peripheral circuit 4A, and input / output interface 3A to transmit and receive data with each other. The processor 1A is an arithmetic processing device such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit). The memory 2A is a memory such as a RAM (Random Access Memory) or a ROM (Read Only Memory). The input / output interface 3A includes an interface for acquiring information from an input device (e.g., keyboard, mouse, microphone, physical keys, touch panel display, code reader, etc.), an external device, an external server, an external sensor, etc., and an interface for outputting information to an output device (e.g., display, speaker, printer, meter, etc.), an external device, an external server, etc. The processor 1A can issue commands to each module and perform operations based on their operation results.

[0016] Next, each functional unit shown in FIG. 1 will be described in detail.

[0017] The settlement unit 21 has means (registration means) for performing a process (registration process) of registering a product to be settled and means (settlement means) for performing a settlement process.

[0018] First, the registration process by the settlement unit 21 will be described. The settlement unit 21 has means for inputting information for identifying a product to be settled. The input is realized through any device such as a code reader, physical keys, a touch panel display, a microphone, a camera, etc. [[ID=???]]

[0019] It seems there is an unclear "???" in the original text where the "ID=13" should be. This might be a formatting or tagging error in the provided original text. I've translated the rest as accurately as possible.For example, information for identifying a product attached to a product may be input by reading a code indicating the information with a code reader. Alternatively, information for identifying a product may be input by operating a physical key or a touch panel display. Alternatively, information for identifying a product may be input by voice via a microphone. Alternatively, information for identifying a product may be input using a camera that photographs a product to be settled and means for specifying a product included in an image generated by the camera based on a feature amount of the appearance of the product or a code (information for identifying a product attached to the product) included in the image.

[0020] The settlement unit 21 can acquire product information (e.g., price, etc.) corresponding to information for identifying a product to be settled from a pre-prepared product master. Then, the settlement unit 21 can calculate the total price of one or more products to be settled. The settlement unit 21 can further display information for identifying a product to be settled, the calculated total, etc. on a display or the like.

[0021] Next, the settlement process by the settlement unit 21 will be described. The settlement process is to complete a purchase and sale transaction by selecting a payment method (cash, credit card, points, etc.) for which the payment amount has been determined. The settlement unit 21 can perform a settlement process using electronic money information or point information corresponding to the customer identified by the face authentication process. That is, when the settlement unit 21 acquires information for identifying the customer (the person who pays the price) identified by the specifying unit 12 described below, it can acquire electronic money information or point information corresponding to the customer from the server. Then, the settlement unit 21 can perform a settlement process using the electronic money information or point information. That is, a settlement process may be performed in which the total price of the products to be settled is paid with electronic money or points, or a settlement process may be performed in which the points given in this shopping are added to the remaining points indicated by the point information. Also, in the case of the information processing system 100 in a store installed within an organization such as a company, a settlement process may be performed in which the payment amount is associated with information for identifying a customer (e.g., employee number) within the organization and deducted from the salary.

[0022] In addition, the settlement unit 21 may be able to perform settlement processing using cash, credit cards, other electronic money, points, etc. For example, when a customer is not identified by the identification unit 12, settlement processing may be performed by the other methods exemplified.

[0023] The settlement unit 21 performs the registration process and the settlement process in this order. When an operation to start the settlement process is performed after the registration process of registering at least one product by the settlement unit 21, the settlement unit 21 starts the settlement process accordingly.

[0024] The operation to start the settlement process may be, for example, pressing a physical key corresponding to "start settlement process". Alternatively, the operation may be, for example, an operation (e.g., touch) on an area corresponding to "start settlement process" on the touch panel area. Alternatively, the operation may be one that inputs a predetermined word corresponding to "start settlement process" via a microphone. Note that the examples here are merely examples and are not limited thereto.

[0025] The acquisition unit 11 acquires an image (an image of the customer's face) generated by a camera that photographs the customer. The camera is installed near the information processing system 100, for example, integrally with the information processing system 100. And the camera is installed to photograph a customer located near the information processing system 100, more specifically, a customer during accounting. The camera may continuously photograph a moving image or may photograph a still image at a predetermined timing. That is, the acquisition unit 11 may acquire images of a plurality of frames continuously generated at predetermined time intervals from the camera, or may acquire one image generated at a certain timing from the camera.

[0026] The selection unit 14 extracts the persons in the image acquired by the acquisition unit 11. When a plurality of persons are extracted, based on at least one of the distance from the settlement device (in the case of this embodiment, the information processing system 100), the frequency of appearance (that is, the frequency of being photographed by the camera during a predetermined time period), and the time of appearance (that is, the time of being photographed by the camera during a predetermined time period), the person who performs the settlement process can be selected from among the plurality of persons.

[0027] The selection unit 14 of this embodiment can select the person who performs the settlement process from among the plurality of persons mainly based on the distance from the settlement device. When the camera is near the settlement device, for example, when it is installed integrally with the settlement device, the "distance between the camera and the person" indicates the "distance between the settlement device and the person".

[0028] For example, the selection unit 14 may select the person with the smallest distance from the camera as the person who performs the settlement process. Alternatively, the selection unit 14 may select the persons with a distance from the camera equal to or less than a reference value as candidates for the person who performs the settlement process. And when there are a plurality of candidates selected based on the distance from the camera, the selection unit 14 may select the person who performs the settlement process from among the plurality of candidates based on other conditions.

[0029] The distance from the camera may be estimated by image analysis. For example, the person in whom the length of a predetermined part of the body (e.g., the distance between the eyes) is imaged as the longest may be identified as the person with the smallest distance from the camera. Alternatively, the person in whom the length of a predetermined part of the body (e.g., the distance between the eyes) is imaged as being equal to or greater than a reference value may be identified as the person with a distance from the camera equal to or less than the reference value. Note that the distance from the camera may be estimated by other methods.

[0030] Here, the above-mentioned other conditions applicable when there are multiple candidates selected based on the distance from the settlement device will be described. For example, the selection unit 14 may select, as the person to perform the settlement process, the person among the multiple candidates whose time (the time included in the image) photographed by the camera during a predetermined time period is the longest. Alternatively, the selection unit 14 may select, as the person to perform the settlement process, the person among the multiple candidates whose frequency (the frequency included in the image) photographed by the camera during a predetermined time period is the highest. The photographed frequency may be, for example, the number of times counted with one extraction from the image of one frame regarded as one time. The photographed time is synonymous with the time included in the moving image. In order to calculate the photographed time and frequency, it is necessary to group the same person included across multiple frames of images. For example, those with similar feature amounts extracted from the images may be grouped together.

[0031] The start timing of the above-mentioned predetermined time period may be, for example, a predetermined operation performed before the operation to start the settlement process. As an example, the timing of the first product registration, etc. is exemplified, but it is not limited thereto. The end timing of the above-mentioned predetermined time period may be, for example, the timing when there is an operation to start the settlement process, etc. is exemplified, but it is not limited thereto.

[0032] Another example of the above-mentioned other conditions will be described. For example, the selection unit 14 may select, as the person to perform the settlement process, the person among the multiple candidates who has performed a predetermined action determined in advance. The predetermined action is a predetermined action considered to be performed by the person who performs the settlement process. For example, "raising the hand", "pointing at oneself with a finger, etc." are exemplified, but it is not limited thereto. This is an action considered to be performed by the person who performs the settlement process in response to an inquiry from the store clerk "Who will pay?".

[0033] Explain other examples of the above other conditions. For example, the selection unit 14 may select, from among a plurality of candidates, a person who made a predetermined statement as the person who performs the settlement process. The content of the statement is considered to be something that the person who performs the settlement process would say. The content of the statement may be, for example, information that identifies the settlement method. That is, "cash", "card", etc., or the name or common name of a predetermined payment service, etc. may be considered. For example, when the name of a payment service that uses face authentication is "Face Pass", the selection unit 14 may identify the person who said "kaopasu".

[0034] In the case of this example, the information processing system 100 may have a microphone (voice acquisition means). Then, the selection unit 14 may detect that a predetermined statement as described above has been made by analyzing the sound collected by the microphone. And the selection unit 14 may analyze the moving image captured by the camera and identify a person whose mouth is moving (or who is making a predetermined movement corresponding to the content of the statement) at the timing when a predetermined statement is detected.

[0035] Note that the selection unit 14 may select, from among the persons whose estimated age estimated based on the image is equal to or higher than the reference value, the person who performs the settlement process (the person who satisfies the conditions such as the distance condition from the above camera and other conditions). In other words, the selection unit 14 may exclude persons whose estimated age estimated based on the image is less than the reference value from the persons who perform the settlement process.

[0036] Note that when a person whose estimated age is equal to or higher than the reference value and a person whose estimated age is less than the reference value are extracted from the image, the selection unit 14 may select the person who performs the settlement process from among the persons whose estimated age is equal to or higher than the reference value. That is, when only persons whose estimated age is less than the reference value are extracted, the selection unit 14 may select the person who performs the settlement process from among the persons whose estimated age is less than the reference value.

[0037] In addition, the selection unit 14 may select, from among the persons who are moving, the person who performs the settlement process (the person who satisfies the conditions such as the distance condition from the above camera and other conditions). In other words, the selection unit 14 may exclude persons who are not moving from the persons who perform the settlement process.

[0038] In addition, when one person is extracted from the image, the selection unit 14 can select the person as the person who performs the payment process.

[0039] The specifying unit 12 specifies the person extracted in the image based on the database information in which the feature amounts of the appearances of a plurality of persons are registered. The specifying unit 12 extracts the feature amounts of the appearance of the person extracted from the image. Then, the specifying unit 12 collates the feature amounts of the person extracted in the image with the feature amounts of the appearances of a plurality of persons included in the database information, and specifies the person whose similarity is equal to or higher than the reference value.

[0040] When the person whose similarity is equal to or higher than the reference value can be specified in the database information, the specifying unit 12 outputs the information for identifying the person as the specification result. On the other hand, when the person whose similarity is equal to or higher than the reference value cannot be specified in the database information, "no corresponding person" is output as the specification result.

[0041] Here, an example of the processing flow of the information processing system 100 will be described using the sequence diagram of FIG. 3. Here, it is assumed that the selection unit 14 selects the person with the smallest distance from the camera as the person who performs the payment process.

[0042] The information processing system 100 performs the registration / payment process and the authentication process (the process of specifying the person who performs the payment process) in parallel. First, in the registration / payment process, when the product registration process is started (S10), that fact is notified to the authentication process (S11). In response to this, in the authentication process, the process of specifying the customer is started. Specifically, an image is acquired (S14), and the person who performs the payment process is selected from the persons included in the image (S15). In S15, first, the persons included in the image are extracted. When there are a plurality of persons included in the image, the person with the smallest distance from the camera is selected as the person who performs the payment process. On the other hand, when there is one person included in the image, that person is selected as the person who performs the payment process.

[0043] Thereafter, the information processing system 100 performs a process of identifying a person who performs the settlement process (S16). That is, the feature amount of the appearance of the person selected to perform the settlement process in S15 is extracted, and a collation process is performed using the above database information. Then, the information processing system 100 accumulates the identification result (information for identifying a person or no corresponding person) obtained by the collation process (S17). In the authentication process, S14 to S17 are repeated until the notification in S18 is received.

[0044] On the other hand, in the registration / settlement process, even after the start of the product registration process in S10, the product registration is accepted (S12). While no operation to start the settlement process is performed (No in S13), the product registration is accepted (S12). When an operation to start the settlement process is performed (Yes in S13), that fact is notified to the authentication process (S18).

[0045] In the authentication process, for example, in response to the notification in S18, the process of identifying the customer (S14 to S17) is terminated. Then, a predetermined identification result (information for identifying a person or no corresponding person associated with a predetermined frame) is extracted from the identification results accumulated until then (S19) and notified to the registration / settlement process (S20).

[0046] For example, the latest identification result may be extracted when the notification in S18 is made. And when the latest identification result is information for identifying a person, that identification result may be notified to the registration / settlement process. On the other hand, when the latest identification result is no corresponding person, other identification results may be extracted under a predetermined search condition. And when the other identification result is information for identifying a person, that identification result may be notified to the registration / settlement process. On the other hand, when the other identification result is no corresponding person, other identification results may be further extracted under a predetermined search condition. And when the identification results are no corresponding person for a predetermined number continuously, no corresponding person may be notified to the registration / settlement process.

[0047] In the registration and settlement process, based on the specific result obtained in S20, a settlement process is performed (S21). When information for identifying a person is obtained as the specific result, for example, electronic money information or point information corresponding to the information for identifying the person can be obtained from the server, and the settlement process can be performed using the electronic money information or the point information. On the other hand, when "no corresponding person" is obtained as the specific result, for example, the settlement process can be performed by other methods.

[0048] Here, an example where the camera captures a moving image has been described. When the camera captures a still image, the authentication process executes S14 to S16 in response to the notification in S11, and notifies the specific result to the registration and settlement process at an arbitrary timing. Then, when the registration and settlement process receives an operation to start the settlement process (Yes in S13), it performs the settlement process (S21) based on the specific result notified from the authentication process at an arbitrary timing.

[0049] Next, another example of the processing flow of the information processing system 100 of the present embodiment will be described using the sequence diagram of FIG. 4. Here, it is assumed that the selection unit 14 determines a person whose distance from the camera is equal to or less than a reference value as a candidate for the person who will perform the settlement process, and determines a person who satisfies a predetermined condition among the candidates as the person who will perform the settlement process.

[0050] The information processing system 100 performs the registration and settlement process and the authentication process (the process of identifying the person who will perform the settlement process) in parallel. First, in the registration and settlement process, when the product registration process is started (S30), that fact is notified to the authentication process (S31). In response to this, in the authentication process, the process of identifying the customer is started. Specifically, an image is acquired (S34), and a candidate for performing the settlement process is selected from among the people included in the image (S35). In S35, first, the people included in the image are extracted. Then, a person whose distance from the camera is equal to or less than a reference value among the people included in the image is selected as a candidate for the person who will perform the settlement process.

[0051] Thereafter, the information processing system 100 performs a process of identifying each candidate for the person who will perform the settlement process (S36). That is, it extracts the feature amounts of the appearance of each candidate and performs a matching process using the above database information. Then, the information processing system 100 accumulates the identification results (information for identifying a person or no corresponding person) for each candidate (S37). In the authentication process, S34 to S37 are repeated until the notification in S38 is received.

[0052] On the other hand, in the registration / settlement process, even after the start of the product registration process in S30, the product registration is accepted (S32). While no operation to start the settlement process is performed (No in S33), the product registration is accepted (S32). When an operation to start the settlement process is performed (Yes in S33), that fact is notified to the authentication process (S38).

[0053] In the authentication process, for example, in response to the notification in S38, the process of identifying the customer (S34 to S37) is terminated. Then, the person who will perform the settlement process is determined from among the candidates for the person who will perform the settlement process (S39), and the identification result of that person is notified to the registration / settlement process (S40).

[0054] In S39, the information processing system 100 groups the same person selected as a candidate across a plurality of frames based on, for example, the results accumulated so far (e.g., the identification results (information for identifying a person or no corresponding person) of each candidate and the feature amounts of the appearance associated with each frame obtained by image analysis). For example, those with similar feature amounts of each person extracted from the image may be grouped together. And when a plurality of groups are generated, the information processing system 100 may determine that there are a plurality of candidates for the person who will perform the settlement process. On the other hand, when one group is generated, the information processing system 100 may determine that there is one candidate for the person who will perform the settlement process.

[0055] When there are multiple candidates for the person to perform the settlement process, a person who meets the other conditions among them can be selected as the person to perform the settlement process. The other conditions are as described above. On the other hand, when there is only one candidate for the person to perform the settlement process, that person can be selected as the person to perform the settlement process.

[0056] In the registration and settlement process, based on the specific result obtained in S40, the settlement process is performed (S41). When information for identifying a person is obtained as the specific result, for example, electronic money information or point information corresponding to the information for identifying the person can be obtained from the server, and the settlement process can be performed using the electronic money information or point information. On the other hand, when "no corresponding person" is obtained as the specific result, for example, the settlement process can be performed by other methods.

[0057] Here, an example where the camera captures a moving image has been described. When the camera captures a still image, the authentication process executes S34, S35, S36, and S39 in this order in response to the notification in S31, and notifies the registration and settlement process of the specific result at an arbitrary timing. Then, when an operation to start the settlement process is received (Yes in S33), the registration and settlement process performs the settlement process (S41) based on the specific result notified from the authentication process at an arbitrary timing.

[0058] According to the information processing system 100 of the present embodiment described above, for example, even when a plurality of people are included in an image and a plurality of people are extracted from the image, one person who performs the settlement process can be selected from among them. As a result, the settlement process can be appropriately performed based on the information corresponding to the selected person (e.g., electronic money information or point information).

[0059] In addition, the information processing system 100 of the present embodiment can select a person who performs a settlement process based on the distance from the cash register. For example, a person who performs a settlement process is considered to be located near the cash register in order to perform work for settlement or respond to a store clerk. Therefore, the information processing system 100 of the present embodiment can select a person with the smallest distance from the cash register as the person who performs the settlement process. As a result, it is possible to accurately select a person who performs a settlement process from among a plurality of extracted persons.

[0060] In addition, the information processing system 100 can select a person whose distance from the cash register is equal to or less than a reference value and who satisfies other conditions as the person who performs the settlement process. Also, the information processing system 100 can select a person whose appearance frequency is equal to or more than a predetermined value and who satisfies other conditions as the person who performs the settlement process. Also, the information processing system 100 can select a person whose appearance time is equal to or more than a predetermined value and who satisfies other conditions as the person who performs the settlement process.

[0061] For example, a person who performs a settlement process is considered to be located in front of the information processing system 100 or a store clerk for the longest time and to be included in the images captured by the camera for the longest time in order to perform work for settlement or respond to a store clerk. Therefore, the information processing system 100 can select, as the person who performs the settlement process, a person whose distance from the cash register is equal to or less than a reference value and whose frequency or time of being captured by the camera in a predetermined time period (e.g., the time period during which accounting is being performed) is the largest. As a result, it is possible to accurately select a person who performs a settlement process from among a plurality of extracted persons.

[0062] In addition, a person whose distance from the cash register is equal to or less than a reference value and who has made a predetermined speech or action for settlement can be selected as the person who performs the settlement process. For example, a person who has spoken about a payment method can be selected as the person who performs the settlement process. As a result, it is possible to accurately select a person who performs a settlement process from among a plurality of extracted persons.

[0063] For example, when a parent and child visit the store together, it is considered that the parent will make the payment. Therefore, when a person with an estimated age equal to or higher than the reference value and a person with an estimated age lower than the reference value are extracted, the information processing system 100 according to the present embodiment can select a person who will perform the payment process by excluding the person with an estimated age lower than the reference value. As a result, it is possible to accurately select a person who will perform the payment process from among the plurality of extracted persons.

[0064] For another example, when a person included in a poster or a signboard is included in the image, the information processing system 100 can extract the person from the image. By excluding a person without movement and selecting a person who will perform the payment process, the information processing system 100 according to the present embodiment can exclude a person included in a poster or a signboard and select a person who will perform the payment process. As a result, it is possible to accurately select a person who will perform the payment process from among the plurality of extracted persons.

[0065] In addition, in the present embodiment, a person who will perform the payment process can be selected based on a condition that is relatively easy to determine, such as "the distance from the settlement device is equal to or less than the reference value". When a plurality of persons are selected by the said index, that is, when it is not possible to narrow down to one person, a person who will perform the payment process can be selected based on other conditions where the detection difficulty becomes high. By adopting such a configuration, the processing load on the computer can be reduced.

[0066] <Second Embodiment> The configuration of the selection unit 14 of the information processing system 100 according to the present embodiment is different from that of the first embodiment. Other configurations are the same as those of the first embodiment.

[0067] The selection unit 14 extracts the persons in the image, and when a plurality of persons are extracted, it mainly selects a person who will perform the payment process based on at least one of the appearance frequency (that is, the frequency of being photographed by the camera during a predetermined time period) and the appearance time (that is, the time of being photographed by the camera during a predetermined time period).

[0068] For example, the selection unit 14 may select, as the person who performs the settlement process, the person who has been photographed by the camera most frequently during a predetermined time period, or the person who has been photographed by the camera for the longest time during a predetermined time period. Alternatively, the selection unit 14 may select, as candidates for the person who performs the settlement process, those persons whose frequency of being photographed by the camera during a predetermined time period, or the time for which they have been photographed by the camera during a predetermined time period, is equal to or higher than a reference value. And when there are a plurality of candidates selected based on the frequency of being photographed by the camera during a predetermined time period, or the time for which they have been photographed by the camera during a predetermined time period, the selection unit 14 may select, based on other conditions, the person who performs the settlement process from among the plurality of candidates.

[0069] Here, the above-mentioned other conditions that apply when there are a plurality of candidates selected based on the frequency of being photographed by the camera during a predetermined time period, or the time for which they have been photographed by the camera during a predetermined time period, will be described. For example, the selection unit 14 may select, as the person who performs the settlement process, the person among the plurality of candidates who is at the shortest distance from the settlement device (in the case of this embodiment, the information processing system 100). For example, the person who has the highest frequency or the longest time of being at the shortest distance from the settlement device during a predetermined time period may be selected as the person who performs the settlement process. Alternatively, the person who is at the shortest distance from the settlement device at a predetermined timing (e.g., the timing when an operation to start the settlement process is performed) may be selected as the person who performs the settlement process.

[0070] Another example of the above-mentioned other conditions will be described. For example, the selection unit 14 may select, as the person who performs the settlement process, the person among the plurality of candidates who has performed a predetermined action determined in advance. The predetermined action is a predetermined action that is considered to be performed by the person who performs the settlement process. For example, "raising a hand", "pointing at oneself with a finger or the like" are exemplified, but are not limited thereto. This is an action that is considered to be performed by the person who performs the settlement process in response to a query from a store clerk such as "Who will make the payment?".

[0071] Describe other examples of the above other conditions. For example, the selection unit 14 may select, from among a plurality of candidates, a person who made a predetermined statement as the person who performs the settlement process. The content of the statement is considered to be something that a person who performs the settlement process would say. The content of the statement may be, for example, information that identifies the settlement method, etc. That is, things like "cash", "card", etc., or the name or general term of a predetermined payment service, etc. are considered. For example, when the name of a payment service that uses face authentication is "Face Pass", the selection unit 14 may identify a person who said "kaopasu".

[0072] In the case of this example, the information processing system 100 may have a microphone. And the selection unit 14 may detect that a predetermined statement as described above was made by analyzing the sound collected by the microphone. And the selection unit 14 may analyze the moving image captured by the camera and identify a person whose mouth is moving (or who is making a predetermined movement corresponding to the content of the statement) at the timing when a predetermined statement is detected.

[0073] Note that the selection unit 14 may select, from among the persons whose estimated age estimated based on the image is equal to or higher than the reference value, the person who performs the settlement process (the person who satisfies the conditions such as the distance condition from the above camera and other conditions). In other words, the selection unit 14 may exclude a person whose estimated age estimated based on the image is less than the reference value from the persons who perform the settlement process.

[0074] Note that when a person whose estimated age is equal to or higher than the reference value and a person whose estimated age is less than the reference value are extracted from the image, the selection unit 14 may select the person who performs the settlement process from among the persons whose estimated age is equal to or higher than the reference value. That is, when only a person whose estimated age is less than the reference value is extracted, the selection unit 14 may select the person who performs the settlement process from among the persons whose estimated age is less than the reference value.

[0075] In addition, the selection unit 14 may select, from among the moving persons, the person who performs the settlement process (the person who satisfies the conditions such as the distance condition from the above camera and other conditions). In other words, the selection unit 14 may exclude a person who is not moving from the persons who perform the settlement process.

[0076] In addition, when one person is extracted from the image, the selection unit 14 can select the person as the person who performs the payment process.

[0077] Here, an example of the processing flow of the information processing system 100 of the present embodiment will be described using the sequence diagram of FIG. 5. Here, the selection unit 14 is assumed to select a person who performs the payment process based on the frequency of shooting by the camera during a predetermined time period or the time of shooting by the camera during a predetermined time period. Note that the camera shoots a moving image.

[0078] The information processing system 100 performs the registration / payment process and the authentication process (the process of identifying the person who performs the payment process) in parallel. First, in the registration / payment process, when the product registration process is started (S50), that fact is notified to the authentication process (S51).

[0079] In the registration / payment process, even after the start of the product registration process in S50, the registration of products is accepted (S52). While no operation to start the payment process is performed (No in S53), the registration of products is accepted (S52). When an operation to start the payment process is performed (Yes in S53), that fact is notified to the authentication process (S54).

[0080] In the authentication process, in response to the notification in S54, a process of identifying the customer is started. Specifically, the moving image generated by the camera during a predetermined time period (for example, between the notification in S51 and the notification in S54) is processed to select the person who performs the payment process (S55).

[0081] For example, the person with the highest frequency of being photographed by the camera during a predetermined time period, or the person with the longest time of being photographed by the camera during a predetermined time period, may be determined as the person who performs the settlement process. Alternatively, a person whose frequency of being photographed by the camera during a predetermined time period, or the time of being photographed by the camera during a predetermined time period is equal to or higher than a reference value, may be determined as a candidate for the person who performs the settlement process. And when there are multiple candidates determined based on the frequency of being photographed by the camera during a predetermined time period, or the time of being photographed by the camera during a predetermined time period, the person who performs the settlement process may be selected from among the multiple candidates based on other conditions. The details are as described above.

[0082] After that, the feature amount of the appearance of the person selected as the person who performs the settlement process is extracted from the image, and based on the feature amount and the database information in which the feature amounts of the appearances of each of the multiple persons are registered, the person who performs the settlement process is identified (S56). Then, the identification result (information for identifying the person or no corresponding person) is notified to the registration / settlement process (S57).

[0083] In the registration / settlement process, the settlement process is performed based on the identification result obtained in S57 (S58). When information for identifying a person is obtained as the identification result, for example, the electronic money information or point information corresponding to the information for identifying the person can be obtained from the server, and the settlement process can be performed using the electronic money information or point information. On the other hand, when no corresponding person is obtained as the identification result, for example, the settlement process can be performed by other methods.

[0084] According to the information processing system 100 of the present embodiment described above, for example, even when a plurality of persons are included in the image and a plurality of persons are extracted from the image, one person who performs the settlement process can be selected from among them. As a result, the settlement process can be appropriately performed based on the information corresponding to the selected person (e.g., electronic money information or point information).

[0085] In addition, the information processing system 100 of the present embodiment can select a person who performs a settlement process based on at least one of the frequency of shooting by a camera during a predetermined time period and the time of shooting by the camera during the predetermined time period. For example, a person who performs a settlement process is considered to be located in front of the information processing system 100 or a store clerk for the longest time for work for settlement or response to a store clerk, etc., and is considered to be included in the image captured by the camera for the longest time. Therefore, the information processing system 100 can select, as a person who performs a settlement process, a person with the highest frequency of shooting by a camera during a predetermined time period (e.g., the time period when accounting is being performed) or a person with the longest time. As a result, it is possible to accurately select a person who performs a settlement process from among a plurality of extracted persons.

[0086] In addition, the information processing system 100 can select, as a person who performs a settlement process, a person whose frequency of shooting by a camera during a predetermined time period or the time of shooting by a camera during the predetermined time period is equal to or higher than a reference value and who satisfies other conditions.

[0087] For example, a person who performs a settlement process is considered to be located near the information processing system 100 for work for settlement or response to a store clerk, etc. Therefore, the information processing system 100 of the present embodiment can determine, as a person who performs a settlement process, a person whose frequency of shooting by a camera during a predetermined time period or the time of shooting by a camera during the predetermined time period is equal to or higher than a reference value and whose distance from the information processing system 100 is the smallest. As a result, it is possible to accurately select a person who performs a settlement process from among a plurality of extracted persons.

[0088] In addition, it is possible to select, as a person who performs a settlement process, a person whose frequency of shooting by a camera during a predetermined time period or the time of shooting by a camera during the predetermined time period is equal to or higher than a reference value and who has made a predetermined speech or action for settlement. For example, a person who has spoken about a payment method can be selected as a person who performs a settlement process. As a result, it is possible to accurately select a person who performs a settlement process from among a plurality of extracted persons.

[0089] In addition, for example, when a parent and a child visit the store together, it is considered that the parent will make the payment. Therefore, when a person with an estimated age equal to or greater than the reference value and a person with an estimated age less than the reference value are extracted, the information processing system 100 of the present embodiment can select the person who will perform the payment process by excluding the person with an estimated age less than the reference value. As a result, it is possible to accurately select the person who will perform the payment process from among the plurality of extracted persons.

[0090] In addition, for example, when a person included in a poster or a signboard is included in the image, the information processing system 100 can extract the person from the image. By selecting the person who will perform the payment process while excluding the person who is not moving, the information processing system 100 of the present embodiment can select the person who will perform the payment process while excluding the person included in the poster or the signboard. As a result, it is possible to accurately select the person who will perform the payment process from among the plurality of extracted persons.

[0091] In addition, in the present embodiment, the person who will perform the payment process can be selected based on a condition that can be relatively easily determined, such as "the frequency of being photographed by the camera during a predetermined time period or the time of being photographed by the camera during a predetermined time period is equal to or greater than the reference value". And when a plurality of persons are selected by the said index | finger, ie, when it cannot be narrowed down to one person, the person who will perform a payment process can be selected based on other conditions with high detection difficulty. By adopting such a configuration, the processing load on the computer can be reduced.

[0092] <Third Embodiment> FIG. 11 shows an example of a functional block diagram of the information processing system 100 of the present embodiment. The information processing system 100 of the present embodiment is different from the first and second embodiments in that it has a second selection unit 15. Other configurations are the same as those of the first and second embodiments.

[0093] The second selection unit 15 selects a person who has performed a predetermined action as the person who will perform the payment process.

[0094] For example, the second selection unit 15 may select, as the person who will perform the settlement process, a person who has performed a predetermined action from among the persons included in the image acquired by the acquisition unit 11. The predetermined action is a predetermined action that is considered to be performed by the person who will perform the settlement process. For example, "raising a hand", "pointing at oneself with a finger or the like" are exemplified, but are not limited thereto. This is an action that is considered to be performed by the person who will perform the settlement process in response to an inquiry from the store clerk such as "Who will pay?".

[0095] In addition, when a plurality of persons are selected by the second selection unit 15, the selection unit 14 may execute the process of selecting the person who will perform the settlement process from among them. The selection unit 14 can select, for example, the person with the shortest distance to the settlement device among the plurality of persons selected by the second selection unit 15, the person with the highest frequency of being photographed by the camera during a predetermined time period, or the person who has been photographed for the longest time as the person who will perform the settlement process.

[0096] Also in this embodiment, the same operational effects as those of the first and second embodiments can be realized. Further, according to this embodiment, after narrowing down the candidates for the person who will perform the settlement process by the process of the second selection unit 15, the process of the selection unit 14 can be executed.

[0097] <Fourth Embodiment> FIG. 12 shows an example of a functional block diagram of the information processing system 100 of this embodiment. The information processing system 100 of this embodiment is different from the first and second embodiments in that it has a third selection unit 16. Other configurations are the same as those of the first and second embodiments.

[0098] The third selection unit 16 selects, as the person who will perform the settlement process, a person who has made a predetermined statement.

[0099] For example, the third selection unit 16 may select, as the person who performs the settlement process, a person who made a predetermined statement from among the persons included in the image acquired by the acquisition unit 11. The content of the statement is considered to be something that the person who performs the settlement process would say. The content of the statement may be, for example, information that identifies the settlement method, etc. That is, "cash", "card", etc., or the name or common name of a predetermined payment service, etc. may be considered. For example, when the name of the payment service using face authentication is "Face Pass", the second selection unit 15 may identify the person who said "kaopasu".

[0100] In the case of this example, the information processing system 100 may have a microphone (voice acquisition means). Then, the third selection unit 16 may detect that a predetermined statement as described above has been made by performing voice analysis on the sound collected by the microphone. And the third selection unit 16 may analyze the moving image captured by the camera and identify the person whose mouth is moving (or who is making a predetermined movement corresponding to the content of the statement) at the timing when a predetermined statement is detected.

[0101] Note that when a plurality of persons are selected by the third selection unit 16, the selection unit 14 may execute the process of selecting the person who performs the settlement process from among them. The selection unit 14 can select, for example, the person with the shortest distance to the settlement device among the plurality of persons selected by the third selection unit 16, the person with the highest frequency of being photographed by the camera during a predetermined time period, or the person who has been photographed for a long time, etc., as the person who performs the settlement process.

[0102] Also in this embodiment, the same operational effects as those of the first and second embodiments can be realized. Further, according to this embodiment, after narrowing down the candidates for the person who performs the settlement process by the process of the third selection unit 16, the process of the selection unit 14 can be executed.

[0103] <The Fifth Embodiment> FIG. 13 shows an example of a functional block diagram of the information processing system 100 according to the present embodiment. The information processing system 100 according to the present embodiment is different from the first and second embodiments in that it has a fourth selection unit 17. Other configurations are the same as those in the first and second embodiments.

[0104] The fourth selection unit 17 selects, as a person who performs the settlement process, a person whose estimated age estimated based on the image acquired by the acquisition unit 11 is equal to or greater than a reference value.

[0105] When a person whose estimated age is equal to or greater than the reference value and a person whose estimated age is less than the reference value are extracted from the image, the fourth selection unit 17 may select, as a person who performs the settlement process, a person whose estimated age is equal to or greater than the reference value. And when only a person whose estimated age is less than the reference value is extracted, the fourth selection unit 17 may select, as a person who performs the settlement process, a person whose estimated age is less than the reference value.

[0106] When a plurality of persons are selected by the fourth selection unit 17, the selection unit 14 may execute a process of selecting a person who performs the settlement process from among them. The selection unit 14 can select, for example, a person having the shortest distance to the payment device among the plurality of persons selected by the fourth selection unit 17, a person having the highest frequency of being photographed by the camera during a predetermined time period, or a person having a long photographed time as a person who performs the settlement process.

[0107] Also in the present embodiment, the same operational effects as those in the first and second embodiments can be realized. Further, according to the present embodiment, after narrowing down candidates for a person who performs the settlement process by the process of the fourth selection unit 17, the process of the selection unit 14 can be executed. <Sixth Embodiment> FIG. 14 shows an example of a functional block diagram of the information processing system 100 according to the present embodiment. The information processing system 100 according to the present embodiment is different from the first and second embodiments in that it has a fifth selection unit 18. Other configurations are the same as those in the first and second embodiments.

[0108] The fifth selection unit 18 selects a moving person as the person who performs the settlement process.

[0109] In addition, when a plurality of persons are selected by the fifth selection unit 18, the selection unit 14 may execute a process of selecting a person who performs the settlement process from among them. For example, the selection unit 14 may select, as the person who performs the settlement process, a person with the shortest distance to the settlement device among the plurality of persons selected by the fifth selection unit 18, a person with the highest frequency of being photographed by the camera during a predetermined time period, or a person with the longest photographed time.

[0110] Also in this embodiment, the same operational effects as those of the first and second embodiments can be achieved. Further, according to this embodiment, after narrowing down the candidates for the person who performs the settlement process by the process of the fifth selection unit 18, the process of the selection unit 14 can be executed.

[0111] <Seventh Embodiment> As shown in FIG. 6, the information processing system 100 of this embodiment includes a customer identification device 10 and a settlement device 20. The information processing system 100 realizes the predetermined processes described in the first to sixth embodiments by the collaborative processing of the customer identification device 10 and the settlement device 20. Although implementation examples will be described later, the customer identification device 10 and the settlement device 20 may be configured to be physically and / or logically integrated, or may be configured to be physically and / or logically separated.

[0112] First, an example of the hardware configuration of the customer identification device 10 and the settlement device 20 will be described. Each functional unit included in the customer identification device 10 and the settlement device 20 of the present embodiment is realized by an arbitrary combination of hardware and software centered around a CPU, a memory, a program loaded into the memory, a storage unit such as a hard disk that stores the program (in addition to the program stored in advance at the stage of shipping the device, a program downloaded from a storage medium such as a CD or a server on the Internet can also be stored), and a network connection interface. And it is understood by those skilled in the art that there are various modifications to the realization method and device.

[0113] FIG. 2 is a block diagram illustrating the hardware configuration of the customer identification device 10 and the settlement device 20 of the present embodiment. As shown in FIG. 2, the customer identification device 10 and the settlement device 20 have a processor 1A, a memory 2A, an input / output interface 3A, a peripheral circuit 4A, and a bus 5A. The peripheral circuit 4A includes various modules. When the customer identification device 10 and the settlement device 20 are physically and / or logically separated and configured, each of the customer identification device 10 and the settlement device 20 has a hardware configuration as shown in FIG. 2.

[0114] Bus 5A is a data transmission path for the processor 1A, memory 2A, peripheral circuit 4A, and input / output interface 3A to transmit and receive data with each other. The processor 1A is an arithmetic processing device such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit). The memory 2A is a memory such as a RAM (Random Access Memory) or a ROM (Read Only Memory). The input / output interface 3A includes an interface for acquiring information from an input device (e.g., keyboard, mouse, microphone, physical keys, touch panel display, code reader, etc.), an external device, an external server, an external sensor, etc., and an interface for outputting information to an output device (e.g., display, speaker, printer, mailer, etc.), an external device, an external server, etc. The processor 1A can issue commands to each module and perform operations based on their calculation results.

[0115] FIG. 7 shows an example of a functional block diagram of the settlement device 20. As shown in the figure, the settlement device 20 has a settlement unit 21. Since the configuration of the settlement unit 21 is the same as that of the first to sixth embodiments, the description thereof is omitted here.

[0116] FIG. 8 shows an example of a functional block diagram of the customer identification device 10. As shown in the figure, the customer identification device 10 has an acquisition unit 11, an identification unit 12, a notification unit 13, and a selection unit 14. The customer identification device 10 may further have a second selection unit 15, a third selection unit 16, a fourth selection unit 17, or a fifth selection unit 18. Since the configurations of the acquisition unit 11, the identification unit 12, the selection unit 14, the second selection unit 15, the third selection unit 16, the fourth selection unit 17, and the fifth selection unit 18 are the same as those of the first to sixth embodiments, the description thereof is omitted here.

[0117] The notification unit 13 notifies the settlement device 20 of the identification result of the identification unit 12 for the person determined as the person who performs the settlement process by the selection unit 14. The identification result is information for identifying the person who performs the settlement process, or no relevant person.

[0118] Note that the customer identification device 10 and the payment device 20 can transmit and receive information to and from each other. For example, the payment device 20 acquires the above identification result from the customer identification device 10.

[0119] In addition, the payment device 20 notifies the customer identification device 10 that a predetermined operation has been performed. As an example, in the accounting process (registration process, settlement process, etc.) for a certain customer, when a predetermined operation that is performed before the operation to start the settlement process is performed, the payment device 20 may notify the customer identification device 10 that the operation has been performed accordingly. For example, the payment device 20 may notify the customer identification device 10 that the first product registration has been made in the accounting process for the customer. As another example, the payment device 20 may notify the customer identification device 10 that the operation to start the settlement process has been performed.

[0120] The flow of processing of the information processing system 100 according to the present embodiment is the same as that shown in the sequence diagrams of FIGS. 3 to 5. The registration / settlement process illustrated by the payment device 20 is performed, and the authentication process illustrated by the customer identification device 10 is executed.

[0121] Next, an implementation example of the information processing system 100 according to the present embodiment realized by the customer identification device 10 and the payment device 20 will be described.

[0122] As shown in FIG. 9, the customer identification device 10 and the payment device 20 may be realized by the physically and / or logically separated POS register 1 and the attached device 2. The POS register 1 and the attached device 2 are configured to be able to communicate with each other by wire and / or wirelessly. The POS register 1 and the attached device 2 may be connected one-to-one as shown in the figure, or a plurality of POS registers 1 may be connected to one attached device 2.

[0123] In the case of the example of FIG. 9, the payment device 20 may be realized by the POS register 1, and the customer identification device 10 may be realized by the attached device 2.

[0124] Alternatively, the POS register 1 may implement the settlement device 20 and some functions of the customer identification device 10, and the accessory device 2 may implement some other functions of the customer identification device 10. For example, the POS register 1 may implement the acquisition unit 11 of the customer identification device 10 and some functions of the identification unit 12 (e.g., the function of extracting a person from an image and the function of extracting the feature amount of the person). Then, the accessory device 2 may implement some other functions of the identification unit 12 (e.g., the function of collating the feature amount of the person extracted from the image with the database information registering the feature amounts of the appearances of a plurality of persons), the notification unit 13, and the selection unit 14. The accessory device 2 may further include a second selection unit 15, a third selection unit 16, a fourth selection unit 17, or a fifth selection unit 18.

[0125] According to the information processing system 100 of the present embodiment described above, the same operational effects as those of the first and second embodiments can be obtained. Also, as shown in FIG. 9, by configuring the information processing system 100 with the POS register 1 and another device (accessory device 2), an existing POS register 1 that does not have the function of executing face authentication processing can be used. As a result, the cost of introducing a new system can be suppressed.

[0126] <Eighth Embodiment> In the present embodiment, similar to the seventh embodiment, the information processing system 100 is realized by the customer identification device 10 and the settlement device 20. The information processing system 100 of the present embodiment has a different implementation example from that of the seventh embodiment. Other configurations are the same as those of the seventh embodiment.

[0127] In the present embodiment, as shown in FIG. 10, the customer identification device 10 and the settlement device 20 are realized by the physically and / or logically separated POS register 1 and the server 3. The POS register 1 and the server 3 are configured to be able to communicate with each other by wire and / or wirelessly. As shown in the figure, a plurality of POS registers 1 are connected to one server 3.

[0128] In the case of the example of FIG. 10, the settlement device 20 may be realized by the POS register 1, and the customer identification device 10 may be realized by the server 3.

[0129] Alternatively, the POS register 1 may realize the settlement device 20 and a part of the functions of the customer identification device 10, and the server 3 may realize the other part of the functions of the customer identification device 10. For example, the POS register 1 may realize the acquisition unit 11 of the customer identification device 10 and a part of the functions of the identification unit 12 (e.g., the function of extracting a person from an image and the function of extracting the feature amount of the person). Then, the server 3 may realize the other part of the functions of the identification unit 12 (e.g., the function of collating the feature amount of the person extracted from the image with the database information registering the feature amounts of the appearances of a plurality of persons), the notification unit 13, and the selection unit 14. The server 3 may further include a second selection unit 15, a third selection unit 16, a fourth selection unit 17, or a fifth selection unit 18.

[0130] According to the information processing system 100 of the present embodiment described above, the same operational effects as those of the first to seventh embodiments can be obtained. Further, as shown in FIG. 10, by adopting a configuration in which the information processing system 100 is realized by the POS register 1 and another device (server 3), an existing POS register 1 that does not have the function of executing face authentication processing can be used. As a result, the cost of introducing a new system can be suppressed.

[0131] Some or all of the above embodiments may be described as follows in the appended claims, but are not limited thereto. 1. Acquisition means for acquiring an image of a face generated by a camera; Selection means for extracting a person in the acquired image and, when a plurality of persons are extracted, selecting a person for performing a settlement process based on at least one of the distance from the settlement device, the frequency of appearance, and the time of appearance; Identification means for identifying the person based on the image including the selected person and database information in which face feature amounts are registered; Settlement means for performing a settlement process on the identified person; An information processing system having 2. In the information processing system according to 1, The selection means determines a person with a small distance from the settlement device as a person who performs settlement processing. An information processing system. 3. In the information processing system according to 1, The selection means selects at least one of a person with a high frequency and a person with a long time photographed by the camera during a predetermined time period as a person who performs settlement processing. An information processing system. 4. In the information processing system according to any one of 1 to 3, The information processing system further includes a second selection means for selecting a person who has performed a predetermined action as a person who performs settlement processing. 5. In the information processing system according to any one of 1 to 4, Voice acquisition means for acquiring voice, The information processing system further includes a third selection means for selecting a person who has made a predetermined utterance as a person who performs settlement processing based on the acquired voice. 6. In the information processing system according to any one of 1 to 5, The information processing system further includes a fourth selection means for selecting a person whose estimated age estimated based on the image is equal to or higher than a reference value as a person who performs settlement processing. 7. In the information processing system according to any one of 1 to 6, The information processing system further includes a fifth selection means for selecting a moving person as a person who performs settlement processing. 8. Acquisition means for acquiring a face image generated by a camera, Extract the person in the acquired image, and when a plurality of persons are extracted, select a person who performs settlement processing based on at least one of the distance from the settlement device, the frequency of appearance, and the time of appearance. Selection means, Identification means for identifying the person based on the image including the selected person and the database information in which the face feature amount is registered, A notification means for notifying an accounting device of information for identifying a person who performs the settlement process specified by the specific means; A customer identification device having the same. 9. A computer performs: An acquisition step of acquiring a face image generated by a camera; An extraction step of extracting a person in the acquired image, and when a plurality of persons are extracted, selecting a person who performs a settlement process based on at least one of the distance from the accounting device, the frequency of appearance, and the time of appearance; An identification step of identifying the person based on the image including the selected person and database information in which face feature amounts are registered; A settlement step of performing a settlement process on the identified person; An information processing method for executing the same. 10. A computer is caused to function as: An acquisition means for acquiring a face image generated by a camera; A selection means for extracting a person in the acquired image and, when a plurality of persons are extracted, selecting a person who performs a settlement process based on at least one of the distance from the accounting device, the frequency of appearance, and the time of appearance; An identification means for identifying the person based on the image including the selected person and database information in which face feature amounts are registered; A settlement means for performing a settlement process on the identified person; A program for causing the computer to function as such. 11. A computer performs: An acquisition step of acquiring a face image generated by a camera; An extraction step of extracting a person in the acquired image, and when a plurality of persons are extracted, selecting a person who performs a settlement process based on at least one of the distance from the accounting device, the frequency of appearance, and the time of appearance; An identification step of identifying the person based on the image including the selected person and database information in which face feature amounts are registered; A notification step of notifying an accounting device of information for identifying the person who performs the settlement process identified in the identification step; A customer identification method for performing 12. A computer, an acquisition means for acquiring an image of a face generated by a camera, extracting a person in the acquired image, and when a plurality of persons are extracted, selecting a person for performing a settlement process based on at least one of a distance from a settlement device, a frequency of appearance, and a time of appearance; a selection means, a specifying means for specifying the person based on the image including the selected person and database information in which face feature amounts are registered, a notification means for notifying a settlement device of information for identifying the person for the person who performs the settlement process specified by the specifying means, A program that functions as

[0132] Although the invention of the present application has been described with reference to the embodiments above, the invention of the present application is not limited to the above embodiments. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the invention of the present application within the scope of the invention of the present application.

[0133] This application claims priority based on Japanese Patent Application No. 2016-248811 filed on December 22, 2016, and incorporates all of the disclosures thereof herein.

Claims

1. An acquisition means for acquiring an image of a face generated by a camera; A selection means for extracting a person in the acquired image, and when a plurality of persons are extracted, selecting a person with movement as the person to perform a settlement process; An identification means for identifying the person based on the image including the selected person and database information in which facial feature amounts are registered; A settlement means for performing a settlement process on the identified person; characterized by comprising; When a plurality of persons are selected as the person with movement, the selection means selects, from among the plurality of selected persons, a person with a small distance from a settlement device as the person to perform a settlement process. An information processing system.

2. An acquisition means for acquiring an image of a face generated by a camera; A selection means for extracting a person in the acquired image, and when a plurality of persons are extracted, selecting a person with movement as the person to perform a settlement process; An identification means for identifying the person based on the image including the selected person and database information in which facial feature amounts are registered; A settlement means for performing a settlement process on the identified person; characterized by comprising; When a plurality of persons are selected as the person with movement, the selection means selects, from among the plurality of selected persons, at least one of a person with a high shooting frequency and a long shooting time by the camera during a predetermined time period as the person to perform a settlement process. An information processing system.

3. In the information processing system according to claim 1 or 2, The selection means selects, as the person to perform a settlement process, a person whose estimated age estimated based on the image is equal to or higher than a reference value. An information processing system.

4. In the information processing system according to any one of claims 1 to 3, When a plurality of persons are extracted, the selection means excludes a person without movement from the persons to perform a settlement process. An information processing system.

5. In the information processing system according to any one of claims 1 to 4, When a plurality of persons are extracted, the selection means excludes a person without movement from among the plurality of extracted persons, and selects a person to perform a settlement process from among the remaining persons. An information processing system.

6. An acquisition means for acquiring an image of a face generated by a camera; A selection means for extracting a person in the acquired image, and when a plurality of persons are extracted, selecting a person with movement as the person to perform a settlement process; Specific means for identifying the person based on the image including the selected person and database information in which facial feature amounts are registered; Notification means for notifying an accounting device of information for identifying the person who is to perform the settlement process identified by the specific means; and having; The selection means is a customer identification device that, when a plurality of persons are selected as the moving persons, selects, from among the plurality of selected persons, the person having a small distance from the accounting device as the person who is to perform the settlement process.

7. Acquisition means for acquiring an image of a face generated by a camera; Extraction means for extracting a person in the acquired image, and when a plurality of persons are extracted, selection means for selecting a moving person as the person who is to perform the settlement process; Specific means for identifying the person based on the image including the selected person and database information in which facial feature amounts are registered; Notification means for notifying an accounting device of information for identifying the person who is to perform the settlement process identified by the specific means; and having; The selection means is a customer identification device that, when a plurality of persons are selected as the moving persons, selects, from among the plurality of selected persons, at least one of the person having a high shooting frequency and the person having a long shooting time by the camera during a predetermined time period as the person who is to perform the settlement process.

8. A computer, acquires an image of a face generated by a camera, extracts a person in the acquired image, and when a plurality of persons are extracted, selects a moving person as the person who is to perform the settlement process, identifies the person based on the image including the selected person and database information in which facial feature amounts are registered, performs a settlement process on the identified person, In the process of selecting the person who is to perform the settlement process, when a plurality of persons are selected as the moving persons, an information processing method of selecting, from among the plurality of selected persons, the person having a small distance from the accounting device as the person who is to perform the settlement process.

9. A computer, acquires an image of a face generated by a camera, extracts a person in the acquired image, and when a plurality of persons are extracted, selects a moving person as the person who is to perform the settlement process, identifies the person based on the image including the selected person and database information in which facial feature amounts are registered, performs a settlement process on the identified person, In the process of selecting a person who performs the settlement process, when a plurality of persons are selected as the moving persons, at least one of the person with a high frequency of being photographed by the camera and the person with a long time during a predetermined time period is selected from the plurality of selected persons as the person who performs the settlement process. Information processing method.

10. A computer, An acquisition means for acquiring a face image generated by a camera, An extraction means for extracting a person in the acquired image, and when a plurality of persons are extracted, a selection means for selecting a moving person as a person who performs a settlement process, An identification means for identifying the person based on the image including the selected person and the database information in which the face feature amount is registered, A settlement means for performing a settlement process on the identified person, Function as, When a plurality of persons are selected as the moving persons, the selection means selects, from the plurality of selected persons, a person with a small distance from the settlement device as the person who performs the settlement process. Program.

11. A computer, An acquisition means for acquiring a face image generated by a camera, An extraction means for extracting a person in the acquired image, and when a plurality of persons are extracted, a selection means for selecting a moving person as a person who performs a settlement process, An identification means for identifying the person based on the image including the selected person and the database information in which the face feature amount is registered, A settlement means for performing a settlement process on the identified person, Function as, When a plurality of persons are selected as the moving persons, the selection means selects, from the plurality of selected persons, at least one of the person with a high frequency of being photographed by the camera and the person with a long time during a predetermined time period as the person who performs the settlement process. Program.

Images