Article registration device, settlement system, settlement device, article registration method, and program

Abstract

To reduce the load of tracking processing while customers are in transit.SOLUTION: An article registration device according to the present disclosure includes: settlement data generation means for generating settlement data for articles purchased by customers; first image acquisition means for acquiring first characteristic data of a customer; data storage means for storing the settlement data and the first characteristic data in association; second characteristic data receiving means for receiving second characteristic data of the customer acquired by the settlement device from which the customer executes settlement processing of the settlement data; settlement data selection means for selecting the settlement data associated with the first characteristic data determined to match the second characteristic data from the stored settlement data; and settlement data transmission means for transmitting the selected settlement data to the settlement device.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present disclosure relates to a product registration device, a checkout system, a checkout device, a product registration method, a checkout method, and a program. [Background technology]

[0002] Patent Document 1 discloses an information processing device that detects the position of a customer based on the detection results of a pressure detection mat, and identifies the checkout device to which the customer is moving based on the detected position of the customer. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-184320 Summary of the Invention [Problem to be solved by the invention]

[0004] The invention described in Patent Document 1 requires a process for constantly tracking the movement of customers within a store in order to determine the customer operating the checkout device.

[0005] An object of the present disclosure is to provide a product registration device and the like that reduces the burden of tracking processing while a customer is on the move. [Means for solving the problem]

[0006] In one embodiment of the present disclosure, a product registration device comprises a settlement data generation means for generating settlement data for a product purchased by a customer, a first feature data acquisition means for acquiring first feature data of the customer, a data storage means for storing the settlement data and the first feature data in association with each other, a second feature data receiving means for receiving second feature data of the customer acquired by a settlement device from the settlement device where the customer performs the settlement process for the settlement data, a settlement data selection means for selecting, from the stored settlement data, the settlement data associated with the first feature data determined to match the second feature data, and a settlement data transmission means for transmitting the selected settlement data to the settlement device.

[0007] A settlement system in one embodiment of the present disclosure comprises the above-mentioned product registration device, a settlement device comprising a second feature data acquisition means for acquiring the second feature data of the customer settling for the product, a feature data transmission means for transmitting the second feature data to the product registration device, a settlement data receiving means for receiving the settlement data of the customer from the product registration device, and a settlement processing means for executing settlement processing of the received settlement data.

[0008] In one embodiment of the present disclosure, the settlement device includes a second feature data acquisition means for acquiring second feature data of a customer settling for a product, a feature data transmission means for transmitting the second feature data to a product registration device, a settlement data receiving means for receiving the customer's settlement data from the product registration device, and a settlement processing means for executing settlement processing for the received settlement data.

[0009] A product registration method in one embodiment of the present disclosure generates settlement data for a product purchased by a customer, acquires first feature data for the customer, associates and stores the settlement data and the first feature data, receives second feature data for the customer acquired by a settlement device from the settlement device where the customer performs the settlement process for the settlement data, selects from the stored settlement data the settlement data associated with the first feature data determined to match the second feature data, and transmits the selected settlement data to the settlement device.

[0010] In one embodiment of the present disclosure, a settlement method includes a product registration device that executes the above-mentioned product registration method, a settlement device that acquires the second characteristic data of the customer who is settling for the product, transmits the second characteristic data to the product registration device, receives the settlement data of the customer from the product registration device, and executes settlement processing for the received settlement data.

[0011] Another settlement method in one embodiment of the present disclosure includes acquiring second characteristic data of a customer who is settling for a product, transmitting the second characteristic data to a product registration device, receiving the customer's settlement data from the product registration device, and executing a settlement process for the received settlement data.

[0012] A program in one embodiment of the present disclosure causes a computer to perform the following processes: generating settlement data for a product purchased by a customer; acquiring first feature data for the customer; associating and storing the settlement data and the first feature data; receiving second feature data for the customer acquired by a settlement device from the settlement device where the customer performs the settlement process for the settlement data; selecting, from the stored settlement data, the settlement data associated with the first feature data that is determined to match the second feature data; and transmitting the selected settlement data to the settlement device.

[0013] Another program in one embodiment of the present disclosure causes a computer to perform the following processes: acquiring second characteristic data of a customer paying for a product; transmitting the second characteristic data to a product registration device; receiving payment data of the customer from the product registration device; and executing payment processing for the received payment data. [Effects of the Invention]

[0014] According to the present disclosure, it is possible to achieve the effect of reducing the load of tracking processing while a customer is moving. [Brief explanation of the drawings]

[0015] [Figure 1] FIG. 2 is a block diagram showing an example of the configuration of a settlement system. [Figure 2] FIG. 2 is a block diagram showing an example of the configuration of a product registration device. [Figure 3] 3 is a block diagram showing an example of the configuration of a first feature data acquisition unit. FIG. [Figure 4] FIG. 2 is a block diagram showing an example of the configuration of a settlement device. [Figure 5] 10 is a block diagram showing an example of the configuration of a second feature data acquisition unit. FIG. [Figure 6] FIG. 10 is a flowchart illustrating an example of an operation of the product registration device. [Figure 7] FIG. 10 is a flow chart showing an example of the operation of the settlement device. [Figure 8] FIG. 10 is a block diagram showing an example of the configuration of a commodity registration device according to a first modified example. [Figure 9] FIG. 10 is a block diagram showing an example of the configuration of a commodity registration device according to a second modified example. [Figure 10] FIG. 2 is a block diagram illustrating an example of a hardware configuration. DETAILED DESCRIPTION OF THE INVENTION

[0016] Embodiments of the present disclosure will be described with reference to the drawings. However, the embodiments are not limited to those described in the drawings.

[0017] First Embodiment FIG. 1 is a block diagram showing an example of the configuration of a checkout system 30. The checkout system 30 includes a product registration device 10 and a checkout device 20. The product registration device 10 and the checkout device 20 are connected to each other so that they can communicate with each other, constituting the checkout system 30. In FIG. 1, the product registration device 10 is connected to one checkout device 20 as an example, but it may be connected to multiple checkout devices 20. For example, the checkout system 30 may be a semi-self-checkout system consisting of one product registration device 10 and multiple checkout devices 20.

[0018] The product registration device 10 is operated by a store clerk to generate settlement data used to settle the price of products purchased by a customer. The settlement data is data used to settle the price of the products purchased by a customer, and includes, for example, but is not limited to, the name, code, unit price, purchase quantity, date and time, and total price of the products purchased by the customer. The settlement data may also include data related to the customer who purchased the products, such as the customer's identifier.

[0019] FIG. 2 is a block diagram showing an example of the configuration of the product registration device 10. The product registration device 10 includes a payment data generation unit 110, a first feature data acquisition unit 120, a data storage unit 140, a second feature data reception unit 150, a payment data selection unit 160, and a payment data transmission unit 170. The product registration device 10 may also include other components. For example, the product registration device 10 may include a configuration such as a touch panel and operation keys that allow a store clerk to register product data. Alternatively, the product registration device 10 may include a scanner that reads barcodes and two-dimensional codes affixed to products. Alternatively, the product registration device 10 may include an IC reader that reads information from IC tags affixed to products. Alternatively, the product registration device 10 may include a receiver that acquires product data from a shopping cart, such as a smart cart, that automatically identifies products placed in a customer's cart.

[0020] The settlement data generation unit 110 generates settlement data for products purchased by a customer. For example, the settlement data generation unit 110 generates the settlement data based on product data entered by a store clerk using a touch panel, operation keys, a scanner, or the like provided on the product registration device 10. However, the settlement data generation unit 110 may generate the settlement data using other methods. For example, the settlement data generation unit 110 may generate the settlement data based on product data acquired from an IC reader that reads information from an IC tag attached to the product. Alternatively, the settlement data generation unit 110 may generate the settlement data by acquiring product data from a shopping cart that automatically identifies products. Alternatively, if the shopping cart generates the settlement data, the settlement data generation unit 110 may acquire the settlement data generated by the shopping cart as the settlement data. The settlement data generation unit 110 may use any existing product registration method, not limited to the above examples.

[0021] The first feature data acquisition unit 120 acquires customer feature data. Hereinafter, the feature data acquired by the first feature data acquisition unit 120 will be referred to as "first feature data." The first feature data is data used to determine whether the customer matches the customer's second feature data. The first feature data may be any data that can determine whether the customer matches, such as the coordinates of one or more feature points in a facial image. Feature points are, for example, distinctive parts of the face, such as the eyes, nose, and mouth.

[0022] However, the first feature data may be other data. For example, the first feature data may be feature amounts calculated from the facial shape and feature points, such as the eyes, nose, and mouth, in a face image used in general face authentication. Alternatively, the first feature data may be a face image of a customer. However, when feature amounts are used, a process of calculating feature amounts from feature points is required. Therefore, by using coordinates as the first feature data, the first feature data acquisition unit 120 can reduce the processing load compared to when feature amounts are used. Alternatively, feature data has a smaller data volume than a face image. Therefore, by using coordinates as the first feature data, the first feature data acquisition unit 120 can reduce the amount of data to be processed compared to when a face image is used. However, using a face image and feature amounts often improves the accuracy of match determination, as described below, compared to when coordinates are used. Therefore, the first feature data acquisition unit 120 can select the format of the first feature data taking into account the usage environment, etc.

[0023] When the first feature data is the coordinates of feature points or the like, the first feature data acquisition unit 120 may acquire a facial image of the customer and acquire the first feature data using the acquired facial image. The configuration in this case will be described. FIG. 3 is a block diagram showing an example of the configuration of the first feature data acquisition unit 120 in such a case. The first feature data acquisition unit 120 includes a first image acquisition unit 121 and a first feature data extraction unit 122.

[0024] The first image acquisition unit 121 acquires a facial image of a customer who purchases a product. Hereinafter, the facial image acquired by the first image acquisition unit 121 will be referred to as the "first facial image." If the product registration device 10 is equipped with a photographing device such as a camera, the first image acquisition unit 121 may acquire the first facial image from the photographing device provided in the product registration device 10. However, the first image acquisition unit 121 may also acquire the first facial image from another device. For example, if a photographing device that photographs an area including the product registration device 10 is provided in a store, the first image acquisition unit 121 may acquire the first facial image from an image captured by the photographing device provided in the store. For example, the first image acquisition unit 121 may acquire, as the first facial image, a facial image of the customer at a position determined based on the position and orientation of the product registration device 10 in an image captured by the photographing device provided in the store. For example, the first image acquisition unit 121 may determine the aisle location of the customer based on the position and orientation of the merchandise registration device 10 in an image captured by a photographing device installed in the store, and may use the facial image of the person image in the determined aisle as the first facial image. In this case, the first image acquisition unit 121 may acquire an image of a certain range, such as an image of the aisle, and extract the portion of the first facial image included in the image.

[0025] However, facial images often have more feature points per unit area than full-body and half-body images. Furthermore, facial image feature points are often less affected by color and other factors than clothing and other factors. For example, a black-and-white image can be used as a facial image. That is, a facial image requires fewer pixels than a full-body and half-body image. Therefore, by using a facial image, the first image acquisition unit 121 can reduce the number of pixels required compared to a full-body and half-body image. This also applies to the settlement device 20, which will be described later. However, the "first facial image" is not limited to an image of the facial portion, but may be an image including the face, such as an upper-body image or a full-body image. Similarly, the second facial image, which will be described later, is not limited to an image of the facial portion, but may be an image including the face, such as an upper-body image or a full-body image.

[0026] The first feature data extraction unit 122 extracts first feature data from the first face image. For example, the first feature data extraction unit 122 may extract the coordinates of one or more feature points in the first face image. Alternatively, the first feature data extraction unit 122 may extract feature amounts calculated from the face shape and feature points such as the eyes, nose, and mouth in the first face image. However, when feature amounts are used, a process of calculating the feature amounts from the feature points is required. Therefore, when the first feature data extraction unit 122 uses coordinates as the first feature data, the processing load can be reduced compared to when feature amounts are used.

[0027] The first feature data acquisition unit 120 may receive, as at least a portion of the first feature data, the first feature data from a device such as a customer terminal operated by a customer. An example of the operation in this case will be described below. First, the customer installs an app capable of registering and transmitting feature data on the customer terminal in advance, and registers the feature data. Then, when registering a product in the product registration device 10, the customer operates the customer terminal to transmit the customer's feature data to the first feature data acquisition unit 120. The first feature data acquisition unit 120 receives the feature data from the customer terminal as the first feature data. Alternatively, when registering a product in the product registration device 10, the customer may operate the customer terminal to display a code of the customer's feature data. In this case, the first feature data acquisition unit 120 may read the code using a scanner or the like and obtain the feature data from the code.

[0028] Some customers do not like having their facial images taken in stores. The product registration device 10 has the above-described configuration and can operate without taking facial images of customers who have saved their feature data on a terminal or the like.

[0029] The data storage unit 140 stores the settlement data and the first feature data in association with each other. The data storage unit 140 may be configured to store the settlement data and the first feature data in a storage device or the like, or may store the settlement data and the first feature data in an external storage device. The first feature data is data that can be used to identify a customer. Therefore, for safety reasons, it is desirable that the first feature data be stored in a volatile storage device such as a memory. This is because an erasure operation on a non-volatile storage device such as a hard disk may erase only management information, and even if the erasure operation is performed, the data itself may remain in the non-volatile storage device.

[0030] The second characteristic data receiving unit 150 receives the second characteristic data of the customer acquired by the settlement device 20 from the settlement device 20 on which the customer executes the settlement process of the settlement data. As will be explained in detail later, the settlement device 20 is the device on which the customer executes the settlement process of the settlement data. The second characteristic data is the characteristic data of the customer acquired by the settlement device 20. In other words, the second characteristic data is the characteristic data of the customer who settles the settlement at the settlement device 20.

[0031] The second feature data receiving unit 150 may receive from the settlement device 20, in addition to the second feature data, a "device identifier" which is an identifier for identifying the settlement device 20. Alternatively, the second feature data receiving unit 150 may receive from the settlement device 20, in addition to the second feature data, a "data identifier" which is an identifier for identifying the second feature data.

[0032] The second feature data is data used to determine whether the second feature data matches the first feature data. Therefore, if the first feature data are coordinates of feature points, the second feature data are coordinates of the feature points. Alternatively, if the first feature data are feature quantities, the second feature data are feature quantities. Alternatively, if the first feature data are a facial image, the second feature data are a facial image. However, the coordinates and feature quantities of feature points are smaller in data volume than a facial image. Therefore, by using the coordinates or feature quantities of feature points as the first feature data and the second feature data, the second feature data receiving unit 150 can save communication bandwidth compared to using a facial image. Furthermore, by using the coordinates or feature quantities of feature points in communication with the checkout device 20 in the store, the second feature data receiving unit 150 can avoid communicating facial images, which are customer privacy information. However, the second feature data receiving unit 150 may acquire data such as facial images as the second feature data.

[0033] The settlement data selection unit 160 selects settlement data associated with first feature data determined to match the second feature data in the stored first feature data. The determination of match between the first feature data and the second feature data does not have to be a perfect match of the data, as long as it can be determined that the customer is the same, and may be a match that allows for a certain degree of error. For example, the determination of match between the first feature data and the second feature data may be a match within an acceptable range used in general facial recognition. The settlement data selection unit 160 may acquire first feature data that matches the second feature data using a trained model that has been trained to determine facial match using machine learning, and select settlement data associated with the acquired first feature data.

[0034] The settlement data transmission unit 170 transmits the selected settlement data to the settlement device 20. If the second feature data receiving unit 150 has received a device identifier, the settlement data transmission unit 170 transmits the settlement data to the settlement device 20 corresponding to the device identifier. If the second feature data receiving unit 150 has received a data identifier for identifying the second feature data, the settlement data transmission unit 170 may transmit the data identifier in addition to transmitting the settlement data. Alternatively, the settlement data transmission unit 170 may transmit the second feature data in addition to transmitting the settlement data.

[0035] As described above, the settlement data generation unit 110 generates settlement data for a customer. The first feature data acquisition unit 120 acquires the first feature data of the customer corresponding to the settlement data generated by the settlement data generation unit 110. The data storage unit 140 then associates the settlement data with the first feature data and stores them. In other words, the data storage unit 140 associates the settlement data with the first feature data of the customer corresponding to the settlement data and stores them.

[0036] The second feature data receiving unit 150 then receives the second feature data of the customer who will settle their bill at the settlement device 20. The settlement data selecting unit 160 selects the settlement data associated with the first feature data that is determined to match the second feature data in the stored first feature data. In other words, the settlement data selecting unit 160 selects the settlement data of the first feature data that matches the second feature data of the customer who will settle their bill at the settlement device 20. As a result, the settlement data transmitting unit 170 transmits the settlement data of the customer who will settle their bill at the settlement device 20 to the settlement device 20.

[0037] In this way, the merchandise registration device 10 transmits to the settlement device 20 settlement data corresponding to the second characteristic data of the customer who settles the payment at the settlement device 20. Therefore, the merchandise registration device 10 does not need to track the movement of the customer.

[0038] The settlement device 20 is a device operated by a customer to receive settlement data from the product registration device 10 and settle the price of purchased products using the received settlement data. FIG. 4 is a block diagram showing an example of the configuration of the settlement device 20. The settlement device 20 includes a second feature data acquisition unit 210, a feature data transmission unit 230, a settlement data reception unit 240, and a settlement processing unit 250.

[0039] The second feature data acquisition unit 210 acquires customer feature data. Hereinafter, the feature data acquired by the second feature data acquisition unit 210 will be referred to as "second feature data." The second feature data is data used by the merchandise registration device 10 to determine whether it matches the customer's first feature data. For example, if the merchandise registration device 10 uses coordinates of feature points as the first feature data, the second feature data is the coordinates of the feature points. If the merchandise registration device 10 uses feature amounts of the feature points as the first feature data, the second feature data is the feature amounts of the feature points. If the merchandise registration device 10 uses a facial image as the first feature data, the second feature data is the facial image.

[0040] When the second feature data is the coordinates of feature points or the like, the second feature data acquisition unit 210 may acquire a facial image of the customer and acquire the second feature data using the acquired facial image. The configuration in this case will be described. FIG. 5 is a block diagram showing an example of the configuration of the second feature data acquisition unit 210 in such a case. The second feature data acquisition unit 210 includes a second image acquisition unit 211 and a second feature data extraction unit 212.

[0041] The second image acquisition unit 211 acquires a facial image of a customer paying for merchandise. Hereinafter, the facial image acquired by the second image acquisition unit 211 will be referred to as the "second facial image." If the checkout device 20 is equipped with a photographing device such as a camera, the second image acquisition unit 211 may acquire the second facial image from the photographing device provided in the checkout device 20. However, the second image acquisition unit 211 may also acquire the second facial image from another device. For example, if a photographing device that photographs an area including the checkout device 20 is provided in the store, the second image acquisition unit 211 may acquire the second facial image from the photographing device provided in the store, similar to the first image acquisition unit 121.

[0042] The second feature data extraction unit 212 extracts feature data from the second face image. Hereinafter, the feature data extracted by the second feature data extraction unit 212 will be referred to as "second feature data." The second feature data extraction unit 212 may use a method similar to that used by the first feature data extraction unit 122 to extract the second feature data. However, the second feature data extraction unit 212 may use a method different from that used by the first feature data extraction unit 122 as long as it can extract data that can be used to determine whether the first feature data and the second feature data match. The second feature data extraction unit 212 may set a data identifier for the extracted second feature data.

[0043] The second feature data acquisition unit 210 may receive, as at least a portion of the second feature data, second feature data from a device such as a customer terminal operated by a customer, similar to the first feature data acquisition unit 120. For example, the second feature data acquisition unit 210 may acquire feature data transmitted by a customer's operation, or may acquire feature data from a code of the feature data displayed on the terminal device.

[0044] Some customers do not like having their facial images captured at stores. The payment device 20 has the above-described configuration and can operate without capturing facial images for customers who have stored their feature data on a terminal or the like.

[0045] The feature data transmitting unit 230 transmits the second feature data to the second feature data receiving unit 150 of the product registration device 10. The feature data transmitting unit 230 may transmit a data identifier of the second feature data in addition to the second feature data. The feature data transmitting unit 230 may transmit a device identifier in addition to the second feature data.

[0046] The settlement data receiving unit 240 receives the customer's settlement data from the settlement data transmitting unit 170 of the product registration device 10. If the feature data transmitting unit 230 transmits a data identifier of the second feature data, the settlement data receiving unit 240 may receive the settlement data and the data identifier. In this case, the settlement data receiving unit 240 may compare the data identifier transmitted by the feature data transmitting unit 230 with the received data identifier to determine whether the correct settlement data has been received. If the received settlement data is incorrect, the settlement data receiving unit 240 may output an alert. The settlement data receiving unit 240 may receive the second feature data instead of the data identifier. In this case, the settlement data receiving unit 240 may compare the second feature data transmitted by the feature data transmitting unit 230 with the received second feature data to determine whether the correct settlement data has been received.

[0047] The settlement processing unit 250 executes settlement processing of the received settlement data. For example, if the settlement device 20 is equipped with a touch panel and a cashier (not shown), the settlement processing unit 250 displays the settlement data and keys operated by the customer on the touch panel, and executes the settlement processing based on the customer's key operation and the cash deposited in the cashier. The settlement processing unit 250 may execute settlement processing using not only cash but also card payments such as credit cards and mobile payments using smartphones. After completing the settlement processing, the settlement processing unit 250 may output the settlement result to another device such as the store server or the product registration device 10 via a transmission unit (not shown).

[0048] In this way, the settlement device 20 can acquire settlement data by transmitting the acquired customer characteristic data to the merchandise registration device 10. Therefore, the settlement device 20 does not need to track the movement of the customer.

[0049] FIG. 6 is a flow diagram showing an example of the operation of the product registration device 10. The settlement data generation unit 110 generates settlement data for the product purchased by the customer (step S401). The first feature data acquisition unit 120 acquires the customer's first feature data (step S402). The data storage unit 140 associates the settlement data with the first feature data and stores them (step S404). The second feature data reception unit 150 receives the customer's second feature data acquired by the settlement device 20 from the settlement device 20 where the customer executes the settlement process for the settlement data (step S405). The settlement data selection unit 160 selects, from the stored settlement data, settlement data associated with the first feature data determined to match the second feature data (step S406). The settlement data transmission unit 170 transmits the selected settlement data to the settlement device (step S407).

[0050] 7 is a flow diagram showing an example of the operation of the settlement device 20. The second characteristic data acquisition unit 210 acquires second characteristic data of a customer who is settling for merchandise (step S501). The characteristic data transmission unit 230 transmits the second characteristic data to the merchandise registration device 10 (step S503). The settlement data reception unit 240 receives the customer's settlement data from the merchandise registration device 10 (step S504). The settlement processing unit 250 executes settlement processing for the received settlement data (step S505).

[0051] As described above, the product registration device 10 includes a settlement data generation unit 110, a first feature data acquisition unit 120, a data storage unit 140, a second feature data receiving unit 150, a settlement data selection unit 160, and a settlement data transmission unit 170. The settlement data generation unit 110 generates settlement data for products purchased by a customer. The first feature data acquisition unit 120 acquires the customer's first feature data. The data storage unit 140 associates the settlement data with the first feature data and stores the associated data. The second feature data receiving unit 150 receives the customer's second feature data acquired by the settlement device 20, where the customer executes the settlement process for the settlement data. The settlement data selection unit 160 selects, from the stored settlement data, the settlement data associated with the first feature data determined to match the second feature data. The settlement data transmission unit 170 transmits the selected settlement data to the settlement device 20.

[0052] The settlement device 20 includes a second feature data acquisition unit 210, a feature data transmission unit 230, a settlement data receiving unit 240, and a settlement processing unit 250. The second feature data acquisition unit 210 acquires second feature data of a customer who is settling for merchandise. The feature data transmission unit 230 transmits the second feature data to the merchandise registration device 10. The settlement data receiving unit 240 receives the customer's settlement data from the merchandise registration device 10. The settlement processing unit 250 executes settlement processing for the received settlement data.

[0053] That is, the merchandise registration device 10 transmits to the settlement device 20 settlement data corresponding to the second characteristic data of the customer acquired by the settlement device 20. Therefore, the merchandise registration device 10 can transmit to the settlement device 20 settlement data of the customer who will settle at the settlement device 20 without tracking the customer. As a result, the merchandise registration device 10 can reduce the burden of tracking the customer while he or she is moving.

[0054] The settlement device 20 can receive settlement data using the acquired second characteristic data of the customer. Therefore, the settlement device 20 can receive settlement data of the customer who is settling the bill without tracking the customer. As a result, the settlement device 20 can reduce the burden of tracking the customer while they are moving.

[0055] Furthermore, the merchandise registration device 10 receives second characteristic data of a customer who is about to settle a payment at the settlement device 20, and transmits settlement data corresponding to the received second characteristic data. Therefore, the customer can settle a payment at the settlement device 20 at the timing they wish to settle a payment. In this way, the merchandise registration device 10 and the settlement device 20 can improve customer convenience.

[0056] Furthermore, even if there are multiple payment terminals 20, the product registration device 10 can use the device identifier to send payment data to the payment terminal 20 that has acquired the customer's facial image. Therefore, for example, if there are multiple payment terminals 20, the customer can complete payment at any of the payment terminals 20. For example, a customer can use a shopping cart until payment at the payment terminal 20, but after payment, they often put items in a shopping bag and move on. Therefore, if there are many items, the customer is likely to want to use a payment terminal 20 that is close to the exit to shorten the distance they travel with their shopping bag. On the other hand, if there are few items, the customer is likely to want to use a payment terminal 20 that allows quick payment, regardless of the distance from the exit, in order to quickly check out. In this way, the payment terminal 20 that the customer wants to use changes depending on the status of the items to be purchased. The product registration device 10 can then send payment data to the payment terminal 20 that the customer wants to use. Therefore, when there are multiple settlement devices 20, the merchandise registration device 10 can improve the selectability of the settlement device 20 that the customer will use for settlement.

[0057] <Modification> The embodiment may be used with modifications. Modifications are described below. The embodiment and each modification may be combined.

[0058] (First Modification) Fig. 8 is a block diagram showing an example of the configuration of the merchandise registration device 12 of the first modified example. The merchandise registration device 12 includes a display control unit 180 in addition to the configuration of the merchandise registration device 10 of Fig. 1 and the first feature data acquisition unit 120 of Fig. 2. The components other than the display control unit 180 operate in the same manner as described above, and therefore detailed description thereof will be omitted.

[0059] The display control unit 180 controls a display device that displays information to the customer. The display device may be provided in the merchandise registration device 12 or may be provided as a separate device. The display control unit 180 then causes the display device to display instructions for the customer. For example, if the first feature data extraction unit 122 is unable to extract the first feature data from the first facial image, the display control unit 180 causes the display device to display a request to re-acquire the first facial image. The customer can refer to this request and re-capture the first facial image using the photographing device. The first image acquisition unit 121 can then acquire the re-captured first facial image. The merchandise registration device 12 may repeat this operation until it is able to extract the first feature data.

[0060] When a customer retakes the first facial image, displaying the facial image captured by a photographing device such as a camera allows the customer to understand the correct photographing position. Therefore, when reacquiring the first facial image, display control unit 180 may cause the display device to display the first facial image acquired by first image acquisition unit 121.

[0061] The merchandise registration device 12 has the above-described configuration, and when the first feature data extraction unit 122 cannot extract the first feature data, the merchandise registration device 12 can request the customer to reacquire the first facial image.

[0062] (Second Modification) 9 is a block diagram showing an example of the configuration of a product registration device 13 of the second modified example. In addition to the configuration of the product registration device 10, the product registration device 13 includes a payment result receiving unit 155 and an alert processing unit 190. The components other than the payment result receiving unit 155 and the alert processing unit 190 operate in the same manner as described above, so detailed description thereof will be omitted. The product registration device 13 may also include a display control unit 180.

[0063] The settlement result receiving unit 155 receives the settlement result from the settlement processing unit 250 of the settlement device 20. For example, the settlement result receiving unit 155 may receive the settlement result from the settlement processing unit 250 of the settlement device 20. Alternatively, if the settlement processing unit 250 transmits the settlement result to a store server, the settlement result receiving unit 155 may receive the settlement result from the store server. The settlement result receiving unit 155 may transmit the received settlement result to another device such as the store server.

[0064] The alert processing unit 190 outputs an alert during the settlement process. For example, the alert processing unit 190 may output an alert indicating that the settlement is not complete as an alert during the settlement process. Specifically, for example, if the settlement result receiving unit 155 is unable to receive the settlement result of the settlement data even after a time limit has elapsed since the settlement data transmitting unit 170 output the settlement data to the settlement device 20, the alert processing unit 190 may output an alert indicating that the settlement is not complete. In this case, the alert processing unit 190 may output the alert to, for example, the store server or a store clerk's terminal.

[0065] The alert processing unit 190 may output other data related to the alert in addition to the alert. For example, the alert processing unit 190 may output settlement data for which the settlement process is not completed as data related to the alert to an alert output destination such as a store server or a store clerk's terminal. Alternatively, the alert processing unit 190 may output first feature data associated with the settlement data for which the settlement process is not completed. Alternatively, if the first feature data is extracted from the first facial image, the alert processing unit 190 may output the first facial image from which the first feature data associated with the settlement data for which the settlement process is not completed has been extracted.

[0066] Furthermore, if the settlement data selection unit 160 is unable to select first feature data that is determined to match the second feature data from the stored first feature data, the alert processing unit 190 may output an alert indicating that the first feature data cannot be selected.

[0067] In this way, the merchandise registration device 13 can use the above configuration to notify a store clerk or the like of any problems in the payment process.

[0068] <Hardware configuration> The hardware configuration of the product registration devices 10, 12, and 13 will now be described. Each component of the product registration devices 10, 12, and 13 may be configured using a hardware circuit. Alternatively, each component of the product registration devices 10, 12, and 13 may be configured using multiple devices connected via a network. For example, the product registration devices 10, 12, and 13 may be configured using cloud computing. Alternatively, multiple components of the product registration devices 10, 12, and 13 may be configured as a single piece of hardware. Alternatively, the product registration devices 10, 12, and 13 may be implemented as a computer including a processor, memory, and a network interface. The processor may be, for example, but is not limited to, a central processing unit (CPU). The memory may be, for example, but is not limited to, a read-only memory (ROM) and a random access memory (RAM).

[0069] 10 is a block diagram showing the configuration of a computer 600, which is an example of the hardware configuration of the product registration devices 10, 12, and 13. The computer 600 includes a CPU 610, a ROM 620, a RAM 630, a storage device 640, and a network interface 650.

[0070] The CPU 610 loads a program from at least one of the ROM 620 and the storage device 640. Then, the CPU 610 controls the RAM 630, the storage device 640, and the network interface 650 based on the loaded program. The computer 600 including the CPU 610 controls these components to realize the functions of each component in the product registration devices 10, 12, and 13. In this way, the computer 600 may realize its functions as a combination of hardware and software.

[0071] The CPU 610 may read a program contained in a computer-readable recording medium 690 using a recording medium reading device (not shown). Alternatively, the CPU 610 may receive a program from an external device (not shown) via the network interface 650, store the program in the RAM 630 or the storage device 640, and operate based on the stored program.

[0072] The ROM 620 stores programs and fixed data executed by the CPU 610. The ROM 620 is, for example, a programmable ROM (P-ROM) or a flash ROM. The RAM 630 temporarily stores programs and data executed by the CPU 610. The RAM 630 is, for example, a dynamic RAM (D-RAM). The storage device 640 stores data and programs that the computer 600 stores long-term. The storage device 640 may also operate as a temporary storage device for the CPU 610. The storage device 640 is, for example, a hard disk drive or a solid state drive (SSD).

[0073] The ROM 620 and the storage device 640 are non-volatile (non-transitory) recording media. On the other hand, the RAM 630 is a volatile (transitory) recording media. The CPU 610 can operate based on programs stored in the ROM 620, the storage device 640, and the RAM 630. In other words, the CPU 610 can operate using either a non-volatile recording medium or a volatile recording medium. When realizing each function, the CPU 610 may use at least one of the RAM 630 and the storage device 640 as a temporary storage medium for programs and data.

[0074] The network interface 650 relays data exchange with external devices (not shown) via a network. The network interface 650 is, for example, a local area network (LAN) card. Furthermore, the network interface 650 is not limited to a wired connection, and may be wireless.

[0075] The computer 600 configured in this manner executes the operations of the components in the merchandise registration devices 10, 12, and 13, thereby realizing the functions of the merchandise registration devices 10, 12, and 13.

[0076] The settlement device 20 may also be configured using a computer 600 shown in FIG.

[0077] A part or all of the above-described embodiments can be described as, but not limited to, the following supplementary notes.

[0078] (Appendix 1) a payment data generating means for generating payment data for products purchased by a customer; a first characteristic data acquisition means for acquiring first characteristic data of the customer; a data storage means for storing the settlement data and the first characteristic data in association with each other; a second characteristic data receiving means for receiving second characteristic data of the customer acquired by the settlement device from the settlement device where the customer executes the settlement process of the settlement data; a settlement data selection means for selecting, from the stored settlement data, the settlement data associated with the first characteristic data determined to match the second characteristic data; a settlement data transmitting means for transmitting the selected settlement data to the settlement device; A product registration device comprising:

[0079] (Appendix 2) The first feature data acquisition means a first image acquisition means for acquiring a first facial image of the customer; a first feature data extraction means for extracting the first feature data from the first face image; 2. The product registration device according to claim 1, comprising:

[0080] (Appendix 3) The first feature data acquisition means receiving characteristic data of the customer from a customer terminal operated by the customer; 3. A product registration device according to claim 1 or 2.

[0081] (Appendix 4) a display control means for controlling a display device that displays information to the customer; when the first feature data cannot be extracted from the first face image, the display control means causes the display device to display a request to re-acquire the first face image. 3. A product registration device as described in appendix 2.

[0082] (Appendix 5) the display control means causes the display device to display the first face image acquired by the first image acquisition means when reacquiring the first face image. 5. A product registration device as described in appendix 4.

[0083] (Appendix 6) a settlement result receiving means for receiving a settlement result of the settlement data from the settlement device; an alert processing means for outputting an alert indicating that the settlement is not completed when the settlement result receiving means is unable to receive the settlement result of the settlement data even after a time limit has elapsed since the settlement data transmitting means output the settlement data to the settlement device; 6. The product registration device according to any one of Supplementary Notes 1 to 5, comprising:

[0084] (Appendix 7) The alert processing means outputs at least one of the settlement data for which the settlement process is not completed and the first characteristic data associated with the settlement data for which the settlement process is not completed. 7. A product registration device as described in appendix 6.

[0085] (Appendix 8) When the settlement data selection means cannot select the first feature data that is determined to match the second feature data from the stored first feature data, the alert processing means outputs an alert indicating that the first feature data cannot be selected. 8. The product registration device according to claim 6 or 7.

[0086] (Appendix 9) the first feature data and the second feature data are coordinates of one or more feature points in the first face image and the second face image, A product registration device according to any one of appendixes 1 to 8.

[0087] (Appendix 10) The first feature data is stored in a volatile storage means. 10. A product registration device according to any one of appendices 1 to 9.

[0088] (Appendix 11) A product registration device according to any one of Supplementary Notes 1 to 10; second characteristic data acquisition means for acquiring the second characteristic data of the customer who is paying for the product; a characteristic data transmitting means for transmitting the second characteristic data to the product registration device; a payment data receiving means for receiving the payment data of the customer from the product registration device; a settlement processing means for executing a settlement process of the received settlement data; A settlement device comprising: A settlement system that includes:

[0089] (Appendix 12) The second feature data acquisition means a second image acquisition means for acquiring a second facial image of the customer; second feature data extraction means for extracting the second feature data from the second face image; 12. The settlement system according to claim 11, comprising:

[0090] (Appendix 13) The second feature data acquisition means receiving characteristic data of the customer from a customer terminal operated by the customer; 13. A settlement system as described in Appendix 11 or 12.

[0091] (Appendix 14) second characteristic data acquisition means for acquiring second characteristic data of a customer who is paying for the product; a characteristic data transmitting means for transmitting the second characteristic data to the product registration device; a payment data receiving means for receiving payment data of the customer from the product registration device; a settlement processing means for executing a settlement process of the received settlement data; A settlement device comprising:

[0092] (Appendix 15) The second feature data acquisition means a second image acquisition means for acquiring a second facial image of the customer; second feature data extraction means for extracting the second feature data from the second face image; 15. The settlement device according to claim 14, comprising:

[0093] (Appendix 16) The second feature data acquisition means receiving characteristic data of the customer from a customer terminal operated by the customer; 16. The settlement device according to claim 14 or 15.

[0094] (Appendix 17) Generate checkout data for products purchased by customers; Acquire first characteristic data of the customer; The settlement data and the first characteristic data are stored in association with each other; receiving second characteristic data of the customer acquired by the settlement device from the settlement device that executes the settlement process of the settlement data; Selecting the settlement data associated with the first characteristic data determined to match the second characteristic data from the stored settlement data; transmitting the selected settlement data to the settlement device; How to register a product.

[0095] (Appendix 18) The product registration device executes the product registration method described in Supplementary Note 14, The settlement device, Acquire the second characteristic data of the customer who is paying for the product; transmitting the second characteristic data to the product registration device; receiving the settlement data of the customer from the product registration device; Execute a settlement process for the received settlement data. Payment method.

[0096] (Appendix 19) Acquire second characteristic data of the customer who is checking out the product; Sending the second characteristic data to a product registration device; receiving payment data of the customer from the product registration device; Execute a settlement process for the received settlement data. Payment method.

[0097] (Appendix 20) generating checkout data for products purchased by a customer; A process of acquiring first characteristic data of the customer; a process of storing the settlement data and the first characteristic data in association with each other; receiving, from a settlement device where the customer executes a settlement process for the settlement data, second characteristic data of the customer acquired by the settlement device; A process of selecting, from the stored settlement data, the settlement data associated with the first feature data determined to match the second feature data; a process of transmitting the selected settlement data to the settlement device; A program that causes a computer to execute the following.

[0098] (Appendix 21) A process of acquiring second characteristic data of a customer who checks out for the product; a process of transmitting the second characteristic data to a product registration device; receiving payment data of the customer from the product registration device; A process of executing a settlement process of the received settlement data; A program that causes a computer to execute the following.

[0099] Furthermore, some or all of the configurations described in Supplementary Notes 2 to 10, which are dependent on Supplementary Note 1, may also be dependent on Supplementary Note 17 and Supplementary Note 20 in the same dependent relationship as Supplementary Note 2 to 10. Some or all of the configurations described in Supplementary Notes 12 and 13, which are dependent on Supplementary Note 11, may also be dependent on Supplementary Note 18 in the same dependent relationship as Supplementary Note 12 to 13. Some or all of the configurations described in Supplementary Notes 15 and 16, which are dependent on Supplementary Note 14, may also be dependent on Supplementary Note 19 and Supplementary Note 21 in the same dependent relationship as Supplementary Note 15 to 16. Furthermore, not limited to Supplementary Note 1, Supplementary Note 11, Supplementary Note 14, and Supplementary Note 17 to Supplementary Note 21, some or all of the configurations described as Supplements may also be dependent on various hardware, software, various recording means for recording software, or systems, within the scope of the above-mentioned embodiments.

[0100] Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention. [Explanation of symbols]

[0101] 10 Product registration device 12 Product registration device 13 Product registration device 20 Payment device 30 Payment System 110 Settlement data generation unit 120 First feature data acquisition unit 121 First image acquisition unit 122 First feature data extraction unit 140 Data Storage Unit 150 Second feature data receiving unit 155 Settlement result receiving unit 160 Settlement data selection section 170 Settlement data transmission unit 180 Display control unit 190 Alert Processing Unit 210 Second feature data acquisition unit 211 Second image acquisition unit 212 Second feature data extraction unit 230 Feature data transmission unit 240 Settlement data receiving unit 250 Settlement Processing Unit 260 Feature data receiving unit 610 CPU 620 ROM 630 RAM 640 Storage device 650 network interface 690 Recording Media

Claims

1. a payment data generating means for generating payment data for products purchased by a customer; a first characteristic data acquisition means for acquiring first characteristic data of the customer; a data storage means for storing the settlement data and the first characteristic data in association with each other; a second characteristic data receiving means for receiving second characteristic data of the customer acquired by the settlement device from the settlement device in which the customer executes the settlement process of the settlement data; a settlement data selection means for selecting, from the stored settlement data, the settlement data associated with the first characteristic data determined to match the second characteristic data; a settlement data transmitting means for transmitting the selected settlement data to the settlement device; A product registration device comprising:

2. The first feature data acquisition means a first image acquisition means for acquiring a first facial image of the customer; a first feature data extraction means for extracting the first feature data from the first face image; The product registration device according to claim 1 .

3. The first feature data acquisition means receiving, as the first characteristic data, characteristic data of the customer from a customer terminal operated by the customer; The product registration device according to claim 1 .

4. a display control means for controlling a display device that displays information to the customer; when the first feature data cannot be extracted from the first face image, the display control means causes the display device to display a request to re-acquire the first face image. The product registration device according to claim 2 .

5. a settlement result receiving means for receiving a settlement result of the settlement data from the settlement device; an alert processing means for outputting an alert indicating that the settlement is not completed when the settlement result receiving means is unable to receive the settlement result of the settlement data even after a time limit has elapsed since the settlement data transmitting means output the settlement data to the settlement device; The product registration device according to claim 1 .

6. The alert processing means outputs at least one of the settlement data for which the settlement process is not completed and the first characteristic data associated with the settlement data for which the settlement process is not completed. The product registration device according to claim 5.

7. The product registration device according to any one of claims 1 to 6, second characteristic data acquisition means for acquiring the second characteristic data of the customer who is paying for the product; a characteristic data transmitting means for transmitting the second characteristic data to the product registration device; a payment data receiving means for receiving the payment data of the customer from the product registration device; a settlement processing means for executing a settlement process of the received settlement data; The settlement device comprising: A settlement system that includes:

8. second characteristic data acquisition means for acquiring second characteristic data of a customer who is paying for the product; a characteristic data transmitting means for transmitting the second characteristic data to the product registration device; a payment data receiving means for receiving payment data of the customer from the product registration device; a settlement processing means for executing a settlement process of the received settlement data; A settlement device comprising:

9. Generate checkout data for products purchased by customers; Acquire first characteristic data of the customer; The settlement data and the first characteristic data are stored in association with each other; receiving second characteristic data of the customer acquired by the settlement device from the settlement device that executes the settlement process of the settlement data; Selecting the settlement data associated with the first characteristic data determined to match the second characteristic data from the stored settlement data; transmitting the selected settlement data to the settlement device; How to register a product.

10. generating checkout data for products purchased by a customer; A process of acquiring first characteristic data of the customer; a process of storing the settlement data and the first characteristic data in association with each other; receiving, from a settlement device where the customer executes a settlement process for the settlement data, second characteristic data of the customer acquired by the settlement device; A process of selecting, from the stored settlement data, the settlement data associated with the first feature data determined to match the second feature data; a process of transmitting the selected settlement data to the settlement device; A program that causes a computer to execute the following.

Images