Information processing apparatus, control method, and storage medium

Abstract

To provide a control method and an information processor for acquiring the information of a customer relating to a service available for the customer regardless of the presence / absence of member registration.SOLUTION: An information processing apparatus 2000 acquires an image including a customer, generates attribute information of the customer on the basis of history information of the customer, and outputs the attribute information corresponding to the customer specified by the image, wherein a screen for receiving a change of the attribute information of the customer is displayed, a screen for receiving a selection of whether the change of the attribute information of the customer continues only this time or continues later is displayed, and when the selection of continuing later is received, the attribute information of the customer stored in a storage means in association with the customer is updated on the basis of the change.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing device and a control method. [Background technology]

[0002] Technologies for managing customer information have been developed in POS (Point of Sales) systems, etc. For example, Patent Document 1 discloses a technology for managing customer information such as name, address, and whether or not the customer uses plastic shopping bags, in association with a customer's identification number that can be read from a membership card. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2007-102527 Summary of the Invention [Problem to be solved by the invention]

[0004] The system in Patent Document 1 uses a customer identifier read from the customer's membership card, so unless the customer is registered as a member, the customer's information cannot be obtained.

[0005] The present invention has been made in view of the above-mentioned problems, and one of the objects of the present invention is to provide a technology that can acquire customer information related to services that the customer can use, regardless of whether the customer is a registered member or not. [Means for solving the problem]

[0006] The control method of the present invention comprises: A control method implemented by one or more computers, comprising: Display a screen that accepts changes to customer attribute information, Display a screen that allows the user to select whether the change in the customer's attribute information is a one-time change or a continuation of the change in the customer's attribute information; If the selection to continue the service is accepted, the attribute information of the customer stored in the storage means in association with the customer is updated based on the change.

[0007] The information processing device of the present invention comprises: an output processing means for displaying a screen for accepting changes to customer attribute information and for displaying a screen for accepting selection of whether the change to the customer attribute information is a one-time change or a continuation of the change; and a storage processing means for updating the attribute information of the customer stored in the storage means in association with the customer based on the change when the selection to continue the service is accepted.

[0008] The program of the present invention causes a computer to execute each process included in the control method of the present invention. [Effects of the Invention]

[0009] According to the present invention, a technique is provided that can acquire customer information related to services that the customer can use, regardless of whether the customer is a registered member or not. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a block diagram illustrating an example of an information processing apparatus according to a first embodiment together with its usage environment. [Figure 2] 2 is a diagram conceptually illustrating an example of the operation of the information processing apparatus of the first embodiment. FIG. [Figure 3] FIG. 1 is a diagram illustrating a computer for realizing an information processing device. [Figure 4] 1 is a flowchart illustrating the flow of processing executed by the information processing apparatus of the first embodiment. [Figure 5] FIG. 10 is a diagram illustrating an example of the correspondence between customer features and attribute information in a table format. [Figure 6] FIG. 10 is a diagram illustrating another example of attribute information. [Figure 7] FIG. 10 is a diagram illustrating an example of output information. [Figure 8] FIG. 10 is a diagram illustrating an example of a window for changing the contents of output information. [Figure 9] FIG. 10 is a block diagram illustrating an information processing apparatus according to a second embodiment. [Figure 10] 10 is a flowchart illustrating the flow of processing executed by an information processing apparatus according to a second embodiment. [Figure 11] FIG. 10 is a diagram illustrating an example of history information in a table format. [Figure 12] FIG. 10 is a block diagram illustrating an information processing apparatus according to a third embodiment. [Figure 13] 11 is a flowchart illustrating the flow of processing executed by an information processing apparatus according to a third embodiment. [Figure 14] FIG. 10 is a diagram illustrating an example of an input screen. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all drawings, like components are designated by like reference numerals, and their description will be omitted where appropriate. Furthermore, in each block diagram, unless otherwise specified, each block represents a functional configuration, not a hardware configuration.

[0012] [Embodiment 1] FIG. 1 is a block diagram illustrating an information processing device 2000 according to the first embodiment together with its usage environment. The information processing device 2000 includes a calculation unit 2020 and an output control unit 2040. The storage device 10 stores customer features and attribute information of the customer in association with each other. The attribute information of a certain customer indicates the customer's attributes related to a service used by the customer at a store. More specifically, the customer's attributes related to a service indicate whether or not the customer will use the service (whether or not the customer uses the service) or whether or not the customer owns an item used when using the service (whether or not the customer owns an item related to the use of the service). An example of an item used when using a service is a point card used when using a point service.

[0013] The calculation unit 2020 acquires a captured image of a customer. The calculation unit 2020 further calculates the feature amounts of the customer included in the acquired captured image. The feature amounts of the customer are arbitrary values ​​that represent the appearance features of the customer (for example, facial features). The output control unit 2040 uses the calculated feature amounts to acquire attribute information associated with the feature amounts of the customer included in the acquired captured image from the storage device 10. Then, the output control unit 2040 outputs information based on the customer attributes indicated in the acquired attribute information. The information based on the customer attributes indicated in the attribute information is the information indicated in the attribute information itself, or information indicated in the attribute information processed using a predetermined method.

[0014] FIG. 2 is a diagram conceptually illustrating the operation of the information processing device 2000 of the first embodiment. A customer 40 purchases a product by paying for it at a cash register terminal 50. The cash register terminal 50 is operated by a store clerk 30. A camera 20 is installed near the cash register terminal 50 and captures an image of the customer 40. The storage device 10 stores attribute information indicating the customer's attributes related to the point service in association with the customer's features. More specifically, the attribute information indicates whether the customer has a point card.

[0015] The information processing device 2000 acquires a feature amount of the customer 40 captured by the camera 20. Here, it is assumed that the feature amount of the customer 40 is v1. The information processing device 2000 acquires attribute information associated with the feature amount v1 from the storage device 10. This attribute information indicates "point card ownership: yes". Therefore, the information processing device 2000 outputs information indicating that "customer 40 owns a point card."

[0016] This allows the store clerk 30 to know that the customer 40 will be using a point card. The store clerk 30 may then ask the customer, for example, "Do you have a point card?" to prompt the customer to present the point card.

[0017] The attribute information associated with v2 indicates "point card possession: none." Therefore, when the facial feature amount of customer 40 is v2, the information processing device 2000 outputs information indicating that "customer 40 does not own a point card." In this case, for example, the store clerk 30 does not ask customer 40 to present a point card. In addition, for example, the store clerk 30 may make a statement to confirm that customer 40 does not have a point card, such as "You don't have a point card, do you?", assuming that customer 40 does not have a point card.

[0018] <Actions and Effects> In this embodiment, customer attribute information is stored in association with customer feature amounts that can be calculated from a captured image that includes the customer. By using this method of identifying a customer using customer feature amounts, it is not necessary to use an identifier (e.g., a member ID) assigned to the customer to identify the customer in order to obtain attribute information. Therefore, regardless of whether the customer is a registered member, attribute information indicating whether the customer uses services available at the store or whether the customer owns items related to the services can be obtained.

[0019] For example, suppose the attribute information is information indicating "whether or not a customer has a membership card." In this case, the attribute information is stored in association with the customer's membership ID. With this method, in order to obtain the attribute information indicating whether or not a customer has a membership card, the customer must be asked to present their membership card. In other words, if the customer has not registered as a member, it is not possible to determine whether or not to request the customer to present their membership card.

[0020] In this case, the information processing device 2000 of this embodiment calculates the feature amount of the customer from the captured image containing the customer, and can acquire the customer's attribute information using the feature amount. Therefore, the customer's attribute information can be used to determine whether or not to request the customer to present a membership card.

[0021] This embodiment will be described in further detail below.

[0022] <Example of hardware configuration of information processing device 2000> Each functional component of the information processing device 2000 may be realized by hardware that realizes the functional component (e.g., a hardwired electronic circuit, etc.), or may be realized by a combination of hardware and software (e.g., a combination of an electronic circuit and a program that controls it, etc.). The following further describes the case where each functional component of the information processing device 2000 is realized by a combination of hardware and software.

[0023] 3 is a diagram illustrating a computer 1000 for realizing the information processing device 2000. The computer 1000 may be any of various computers. For example, the computer 1000 may be a personal computer (PC), a server machine, a tablet terminal, or a smartphone. The computer 1000 may be a dedicated computer designed to realize the information processing device 2000, or may be a general-purpose computer.

[0024] The computer 1000 includes a bus 1020, a processor 1040, a memory 1060, a storage device 1080, an input / output interface 1100, and a network interface 1120. The bus 1020 is a data transmission path for the processor 1040, the memory 1060, the storage device 1080, the input / output interface 1100, and the network interface 1120 to transmit and receive data to and from each other. The processor 1040 is an arithmetic processing device such as a central processing unit (CPU) or a graphics processing unit (GPU). The memory 1060 is a main storage device realized by a random access memory (RAM) or the like. The storage device 1080 is an auxiliary storage device realized by a hard disk, a solid state drive (SSD), a read-only memory (ROM), a memory card, or the like. However, the storage device 1080 may be realized by hardware similar to that used to realize the main storage device, such as RAM.

[0025] The input / output interface 1100 is an interface for connecting the computer 1000 with input / output devices. For example, the input / output interface 1100 is connected to input devices such as a keyboard and a mouse, and output devices such as a display device.

[0026] The network interface 1120 is an interface for connecting to a communication network such as a WAN (Wide Area Network) or a LAN (Local Area Network).

[0027] The storage device 1080 stores program modules that implement the various functions of the information processing device 2000. The processor 1040 reads these program modules into the memory 1060 and executes them to implement the various functions corresponding to the program modules.

[0028] <Processing flow> 4 is a flowchart illustrating the flow of processing executed by the information processing device 2000 of the first embodiment. The calculation unit 2020 acquires a captured image of a customer (S102). The calculation unit 2020 calculates a feature amount of the customer included in the captured image (S104). The output control unit 2040 uses the calculated feature amount to acquire attribute information associated with the feature amount of the customer included in the captured image from the storage device 10 (S106). The output control unit 2040 outputs information based on the acquired attribute information (S108).

[0029] <Scenes where the information processing device 2000 is used> The information processing device 2000 can be used in various situations where customers are served. For example, the information processing device 2000 can be used in a situation where a store clerk who operates a product registration device serves a customer (a situation where a product is registered as a payment target). The product registration device is a cash register terminal used to register a product as a payment target.

[0030] The attribute information used in this scenario indicates, for example, whether or not a shopping bag is used, whether or not the customer has a point card, whether or not disposable chopsticks are needed, whether or not hot and cold items are to be separated into bags, whether or not the purchased items are to be delivered to the customer's home, whether or not a receipt is needed, the payment method (cash, electronic money, or credit card), the type of card used when paying with electronic money, whether or not the customer is a minor, etc. The store clerk can use the output information based on this attribute information to decide whether or not to ask the customer to present their point card.

[0031] In addition, for example, the information processing device 2000 can be used in a scene where a customer visiting a restaurant is served. The attribute information used in this scene indicates, for example, whether the customer would like to use a smoking seat or a non-smoking seat, whether they would like a counter seat or a table seat, or whether they would like a seat by the window. The staff can use the output information based on this attribute information to determine the seat to provide to the customer.

[0032] In addition, for example, the information processing device 2000 can be used in a scene where an order is received from a customer. The attribute information used in this scene indicates, for example, conditions regarding seasoning and toppings when ordering food and drink (such as the strength of flavor, the amount of toppings, or the type of toppings), whether to use chopsticks or a fork, or whether to use a napkin. The waiter can use the output information based on this attribute information to understand the conditions that the customer desires for food and drink.

[0033] <Example of computer 1000 realizing information processing device 2000> Various types of computers can be used as the specific computer 1000 for realizing the information processing device 2000. For example, the computer 1000 is a server (hereinafter referred to as a store server) installed in a store where the information processing device 2000 is used. Alternatively, the computer 1000 may be a server (hereinafter referred to as an external server) installed outside the store where the information processing device 2000 is used.

[0034] Furthermore, for example, the computer 1000 may be a product registration device. In this case, the information processing device 2000 is operated by, for example, a store clerk who uses the product registration device to serve customers. The product registration device may be provided integrally with a payment device, or may be provided separately from the payment device. The payment device is a cash register terminal used for payment processing (such as payment of the price) of products registered as items to be paid for.

[0035] When the product registration device and the settlement device are integrated, the registration process for registering products as items to be settled and the settlement process (such as paying the price) for the products registered as items to be settled are performed using the same cash register terminal. A format in which the registration process and the settlement process are performed by the customer is called a self-service format. On the other hand, when the product registration device and the settlement device are separate, the process for registering products as items to be settled and the settlement process for the products registered as items to be settled are performed at different cash register terminals. This format is called a semi-self-service format, in which, for example, the product registration device is operated by a store clerk and the settlement device is operated by the customer.

[0036] Alternatively, for example, the computer 1000 may be a mobile terminal used by a waiter. The mobile terminal used by a waiter is, for example, a mobile terminal operated by a waiter to record to which seat a customer has been shown, or a mobile terminal operated by a waiter to record orders received from customers.

[0037] <Acquisition of captured image: S102> The calculation unit 2020 acquires captured images of customers. To this end, a camera 20 is installed in the store to capture images of customers and generate captured images. The camera 20 may be a camera that generates video or a camera that captures still images. In the former case, the captured images are image frames that make up the video.

[0038] Camera 20 is installed in a position where it can capture an image of a customer. When capturing an image of a customer paying for a product, camera 20 is installed, for example, at or near a product registration device. When capturing an image of a customer who has just entered the store, camera 20 is installed, for example, at or near the store entrance. When capturing an image of a customer placing an order, camera 20 is installed, for example, at or near the customer's seat.

[0039] The calculation unit 2020 may acquire the captured image by any method. For example, the calculation unit 2020 may acquire the captured image by accessing a storage device in which the captured image is stored. The storage device in which the captured image is stored may be provided inside the camera 20 that generated the captured image, or may be provided outside the camera 20. Furthermore, for example, the calculation unit 2020 may acquire the captured image by receiving the captured image transmitted from the camera 20 or the like.

[0040] <Calculating customer features: S104> The calculation unit 2020 calculates the feature amount of the customer included in the acquired captured image (S104). Here, existing technology can be used to calculate the feature amount of the person included in the image.

[0041] <About attribute information> The attribute information indicates the attributes of the customer regarding the service that the customer uses. Examples of the attribute information are as described above.

[0042] Fig. 5 is a diagram illustrating an example of the correspondence between customer features and attribute information in the form of a table. The table in Fig. 5 is called table 500. Table 500 has two columns: feature 502 and attribute information 504. Feature 502 indicates the customer feature. Attribute information 504 indicates the attribute information described above.

[0043] Here, table 500 may further indicate conditions under which the attribute information applies. For example, the attribute information may indicate attributes related to the use of shopping bags (such as whether or not shopping bags are used). In this case, the condition under which the attribute information applies is, for example, the quantity (number, weight, volume, etc.) of products purchased by a customer. The attribute information indicates whether or not shopping bags are used, the number of shopping bags to be used, etc., in association with a range of the number of products purchased by a customer.

[0044] FIG. 6 is a diagram illustrating another example of attribute information. In FIG. 6, table 500 has application conditions 506. Application conditions 506 indicate conditions under which attribute information is applied. For example, the record in the second row of table 500 in FIG. 6 indicates that "if a customer whose facial feature is v1 purchases less than three items, this customer will not use a shopping bag." On the other hand, the record in the third row of table 500 in FIG. 6 indicates that "if a customer whose facial feature is v1 purchases three or more items, this customer will use a shopping bag." Furthermore, the record in the fifth row of table 500 in FIG. 6 indicates that "if a customer whose facial feature is v2 purchases three or more items, this customer will not use a shopping bag under any condition."

[0045] <Acquisition of attribute information: S104> The output control unit 2040 acquires attribute information associated with the feature amounts of the customer included in the captured image, using the feature amounts of the customer calculated by the calculation unit 2020. Specifically, the output control unit 2040 acquires attribute information associated with the feature amounts of the customer that are highly similar to the feature amounts of the customer calculated by the calculation unit 2020, from the attribute information stored in the storage device 10. For example, the output control unit 2040 acquires attribute information stored in the storage device 10 in association with the same feature amounts as the feature amounts calculated by the calculation unit 2020. As another example, the output control unit 2040 acquires attribute information stored in the storage device 10 in association with the feature amounts stored in the storage device 10 that have a degree of similarity to the feature amounts calculated by the calculation unit 2020 that is equal to or greater than a predetermined value. As another example, the output control unit 2040 acquires attribute information stored in the storage device 10 in association with the feature amounts stored in the storage device 10 that have the highest degree of similarity to the feature amounts calculated by the calculation unit 2020. The predetermined value may be set in advance in the output control unit 2040, or may be stored in a storage device accessible from the output control unit 2040.

[0046] The storage device 10 may be any storage device accessible from the output control unit 2040. The storage device 10 may be provided inside the information processing device 2000 or outside the information processing device 2000. In the former case, the storage device 10 is realized as the storage device 1080 in FIG. 4, for example. In the latter case, the storage device 10 is realized as a NAS (Network Attached Storage) provided outside the information processing device 2000, for example.

[0047] <Output by output control unit 2040: S106> The output control unit 2040 outputs information (hereinafter, output information) based on the customer attributes indicated in the acquired attribute information. FIG. 7 is a diagram illustrating an example of output information. In the example of FIG. 7, the information processing device 2000 is a product registration device operated by a store clerk. The display screen 60 is a screen displayed on a display device connected to the product registration device. The display screen 60 displays product information read by the store clerk using a barcode reader or the like, the total price of the products, and the like.

[0048] Furthermore, the display screen 60 includes a window 62. The window 62 is a window that includes output information. The output control unit 2040 controls the display device to display the window 62 on the display device.

[0049] In the example of Figure 7, there are two types of attribute information. The first type of attribute information indicates whether or not the customer uses a shopping bag. The second type of attribute information indicates whether or not the customer has a point card.

[0050] In this example, the feature of customer A is associated with a first type of attribute information, "Shopping bag use: No," and a second type of attribute information, "Point card possession: Yes." Therefore, the window 62 output by the output control unit 2040 displays the information, "Shopping bag use: No," and "Point card possession: Yes."

[0051] For example, in the example of Figure 7, suppose a store clerk operates the product registration device. In this case, the store clerk sees window 62 and realizes that customer A does not use a shopping bag and that customer A has a point card. Therefore, the store clerk asks customer A, "Do you have a point card?", asking customer A to show the card. However, since customer A does not use a shopping bag, the store clerk does not ask customer A about a shopping bag, for example. Alternatively, the store clerk may ask a question to confirm that customer A does not need a shopping bag, such as, "You do not need a shopping bag, do you?"

[0052] 7, assume that customer A operates the product registration device. In this case, information processing device 2000 is a self-service device. Customer A looks at window 62, confirms that he or she will not be using a shopping bag, and that he or she has a point card, and then presses button 64. As a result, the product registration process in the product registration device proceeds to the next stage.

[0053] Here, the information processing device 2000 may receive an input requesting a change in the content of the output information. Fig. 8 is a diagram showing an example of a window for changing the content of the output information. Note that the display screen 60 is omitted from Fig. 8.

[0054] 8 has a button 66 for requesting a change in the content of the output information. Here, suppose that window 62 displays "Shopping bag: No," but the customer decides, "I would like to use a shopping bag this time." For example, even if a customer normally uses their own bag, they may want to use a shopping bag because they forgot their own bag or for some other reason.

[0055] In such a case, the customer presses the button 66. In response to the button 66 being pressed, the output control unit 2040 displays a window 68 shown in Fig. 8(b), for example.

[0056] Window 68 has radio buttons for selecting whether or not to use a shopping bag and whether or not to have a point card. The default values ​​of the radio buttons are set according to the content of the output information. After changing the shopping bag usage setting from "yes" to "no," the customer presses the OK button. In this way, the customer can communicate to the store clerk that they wish to use a shopping bag.

[0057] When a store clerk operates the product registration device, the store clerk may operate window 68. In this case, for example, the store clerk asks the customer what changes they would like to make to the output information, and operates window 68 in accordance with the information the customer provides.

[0058] Here, information processing device 2000 may or may not update the attribute information based on the content of the output information changed using window 68. Whether or not to update the attribute information may be determined in advance, or may be selected by the customer.

[0059] In the latter case, for example, the output control unit 2040 displays the window 68 of FIG. 8(c) instead of the window 68 of FIG. 8(b). The window 68 of FIG. 8(c) has radio buttons for selecting either "This time only" or "In the future." If the former is selected, the information processing device 2000 does not update the attribute information based on the changes made by the customer. On the other hand, if the latter is selected, the information processing device 2000 updates the attribute information based on the changes made by the customer.

[0060] The method of outputting the output information is not limited to displaying it on a display device. For example, the output information may be output as audio. In this case, for example, the store clerk may wear earphones in advance, and the output information may be output to the earphones.

[0061] When output devices such as a display device or earphones are connected to the information processing device 2000, the output control unit 2040 outputs output information to these output devices. On the other hand, when an output device is not connected to the information processing device 2000, the information processing device 2000 transmits the output information to another device to which the output device is connected. The device that receives the output information controls the output device to output the output information. For example, when the information processing device 2000 is realized as a store server, the output control unit 2040 transmits the output information to a product registration device operated by a store clerk. The product registration device that receives the output information controls the display device or earphones connected to the product registration device to output the output information.

[0062] The information processing device 2000 may use the attribute information to generate a message for the customer and output the message. For example, assume that the attribute information is information regarding whether or not a service will be used. In this case, if the attribute information indicates that "Service A will be used," the message "Service A is necessary" is output, and if the attribute information indicates that "Service A will not be used," the message "Service A is unnecessary" is output.

[0063] Messages can also be generated in a similar way when the attribute information indicates whether or not the user owns something used to use a service (such as a point card). For example, if the attribute information indicates that the user owns a point card, the message "You have a point card, don't you?" is displayed, and if the attribute information indicates that the user does not own a point card, the message "You do not have a point card, do you?" is displayed.

[0064] By outputting messages tailored to the customer's attributes in this way, it is possible to reduce the stress and discomfort felt by customers who are asked questions by store clerks. For example, some customers may feel uncomfortable if a store clerk always asks them, "Would you like to use Service A?" even though they do not normally use Service A. On the other hand, if the clerk asks, "You will not be using Service A, will you?", the customer will feel that "the store clerk understands me," and the customer will not feel uncomfortable, or the degree of discomfort they feel will be reduced.

[0065] [Embodiment 2] 9 is a block diagram illustrating an information processing apparatus 2000 according to the second embodiment. Except for the matters described below, the information processing apparatus 2000 according to the second embodiment is the same as the information processing apparatus 2000 according to the first embodiment.

[0066] The information processing device 2000 of the second embodiment includes a first generating unit 2060. The first generating unit 2060 generates attribute information using history information. The history information is information indicating the history of a customer's actions and status regarding the use of a service. For example, the history information indicates whether the customer used a shopping bag or whether the customer presented a point card. Furthermore, the first generating unit 2060 associates the generated attribute information with the customer's feature amount calculated by the calculating unit 2020 and stores the information in the storage device 10.

[0067] <Processing flow> FIG. 10 is a flowchart illustrating the flow of processing executed by the information processing device 2000 of the second embodiment. The calculation unit 2020 acquires a captured image and calculates feature quantities of a customer (S202, S204). Hereinafter, this customer will also be referred to as a "customer for whom attribute information is to be generated." The first generation unit 2060 acquires history information (S206). The first generation unit 2060 generates attribute information using the acquired history information (S208). The first generation unit 2060 associates the feature quantities calculated in S204 with the attribute information generated in S208, and stores them in the storage device 10 (S210).

[0068] <Regarding history information: S206> As described above, history information is information that indicates the history of a customer's behavior and status regarding the use of a service. FIG. 11 is a diagram illustrating an example of history information in a table format. The table in FIG. 11 is denoted as table 600. Table 600 has columns of feature amount 602, history information 604, and date and time 606. Feature amount 602 indicates a feature amount of a customer. History information 604 indicates the customer's past behavior and status. Date and time 606 indicates the date and time corresponding to the behavior and status indicated in history information 604.

[0069] The history information is assumed to be stored in advance in a storage device accessible from the first generation unit 2060. The first generation unit 2060 acquires the history information from this storage device.

[0070] To generate the attribute information, only history information corresponding to the feature of the customer included in the captured image (the behavioral history of the customer for which the attribute information is to be generated) may be used, or other history information may be used in addition to this history information. In the former case, the first generation unit 2060 acquires history information associated with a feature that has a high degree of similarity to the feature calculated by the calculation unit 2020 (for example, a feature that matches the calculated feature).

[0071] On the other hand, in the latter case, the first generation unit 2060 acquires, for example, all history information. In addition, for example, the first generation unit 2060 acquires history information of other customers who have something in common with the customer for whom attribute information is to be generated. The commonalities include, for example, age, gender, or personality.

[0072] For example, when the age of the customer is used as the common feature, the first generating unit 2060 acquires history information of customers whose ages are close to the age estimated from the customer features calculated by the calculating unit 2020. Similarly, when the gender of the customer is used as the common feature, the first generating unit 2060 acquires history information of customers whose gender is the same as the gender of the customer estimated by the calculating unit 2020. Similarly, when the personality of the customer is used as the common feature, the first generating unit 2060 acquires history information of customers whose personality is classified as the same as the personality of the customer estimated by the calculating unit 2020. Here, for example, the personality of the customer is classified into types such as a gentle personality, a nervous personality, or a careless personality. Note that known technology can be used to estimate a person's age, gender, or personality using the features of a person's face.

[0073] When using such commonalities among customers, it is preferable to store the history information of each customer in association with information for identifying the commonalities among customers (such as the customer's age). The information for identifying the commonalities among customers may be the customer's age estimated from the customer's features, or the customer's actual age. In the latter case, the information for identifying the commonalities among customers is assumed to be known in advance by some method (for example, membership information or a questionnaire).

[0074] <Generating attribute information: S208> The first generating unit 2060 generates attribute information using the acquired history information (S208). If only one piece of history information is acquired, the first generating unit 2060 generates attribute information from that history information. For example, if the history information indicates "point card ownership: none", the first generating unit 2060 generates attribute information "point card ownership: none".

[0075] When there is a plurality of pieces of acquired history information, the first generating unit 2060 generates attribute information by statistically processing the acquired history information. For example, when generating attribute information regarding whether or not a point card is owned, the first generating unit 2060 compares the number of pieces of history information indicating "point card owned: yes" with the number of pieces of history information indicating "point card owned: no", and generates attribute information based on the content of the history information with the greater number. For example, when the number of pieces of history information indicating "point card owned: yes" is greater, the first generating unit 2060 generates attribute information indicating "point card owned: yes".

[0076] Here, the first generating unit 2060 may generate attribute information by performing weighted statistical processing on the history information. For example, the first generating unit 2060 acquires the history information of all customers, assigns a large weight to the history information of customers who have something in common with the customer included in the captured image acquired by the calculating unit 2020, and assigns a small weight to the other history information, and then generates attribute information from this history information.

[0077] For example, suppose you want to generate attribute information about whether or not a customer has a point card, and that history information is associated with the customer's age in 10-year increments (teens, twenties, thirties, etc.).

[0078] Under these conditions, it is assumed that the age of the customer for whom attribute information is to be generated is “in their twenties.” In this case, the first generating unit 2060 assigns a large weight to the history information of each customer in their twenties, and a small weight to the history information of customers of other ages.

[0079] In this way, by assigning weights to history information according to the commonalities with the customer for whom attribute information is to be generated, the generated attribute information is more likely to reflect the behavior of customers who have commonalities with the customer for whom attribute information is to be generated, thereby making it possible to predict the attributes of the customer for whom attribute information is to be generated with high accuracy.

[0080] <Trigger for performing processing by the information processing apparatus 2000 according to the second embodiment> A series of processes related to generating attribute information (processing in FIG. 10 ) is executed, for example, when a customer for whom no corresponding attribute information exists is served. The information processing device 2000 attempts to output output information about the served customer based on the functions described in the first embodiment. If a feature highly similar to the feature of the customer included in the acquired captured image is not stored in the storage device 10, the first generation unit 2060 generates attribute information using the method described above. According to this method, attribute information about a new customer is generated when the customer is served. Therefore, attribute information about the new customer is automatically generated. However, the timing when the first generation unit 2060 generates attribute information may be any timing and is not limited to the timing when the customer is served.

[0081] <Hardware configuration> The hardware configuration of the computer that realizes the information processing device 2000 of the second embodiment is shown in Fig. 3, for example, as in the first embodiment. However, the storage device 1080 of the computer 1000 that realizes the information processing device 2000 of this embodiment further stores a program module that realizes the functions of the information processing device 2000 of this embodiment.

[0082] <Actions and Effects> According to the information processing device 2000 of this embodiment, customer attribute information is generated using history information. Therefore, the customer attribute information is generated based on the past actions and states of the customer and other customers. This makes it possible to estimate customer attributes with high accuracy.

[0083] Furthermore, if attribute information is generated using only the historical information of the customer for whom the attribute information is to be generated, it is possible to predict the customer's future behavior and state based on the customer's past behavior and state trends.

[0084] Furthermore, by using historical information of customers other than the customer for whom the attribute information is to be generated, it is possible to predict the future behavior and state of the customer for whom the attribute information is to be generated based on the trends in the past behavior and state of various customers. This method is particularly suitable in cases where, for example, the customer for whom the attribute information is to be generated is a new customer and therefore no historical information exists for that customer.

[0085] Furthermore, by using historical information of customers who have something in common with the customer for whom attribute information is being generated, it is possible to predict the future behavior and state of the customer for whom attribute information is being generated based on the trends in the past behavior and state of customers who have something in common with the customer for whom attribute information is being generated.

[0086] [Embodiment 3] 12 is a block diagram illustrating an information processing device 2000 of embodiment 3. Except for the matters described below, the information processing device 2000 of embodiment 3 is similar to the information processing device 2000 of embodiment 1 or the information processing device 2000 of embodiment 2.

[0087] The information processing device 2000 of the third embodiment includes an input accepting unit 2080 and a second generating unit 2100. The input accepting unit 2080 accepts input representing attributes of a customer related to a service, for the customer included in the captured image acquired by the calculating unit 2020. The second generating unit 2100 generates attribute information based on the input accepted by the input accepting unit 2080. Furthermore, the second generating unit 2100 associates the generated attribute information with the feature amount of the customer included in the captured image acquired by the calculating unit 2020, and stores the generated attribute information in the storage device 10.

[0088] <Processing flow> 13 is a flowchart illustrating the flow of processing executed by the information processing device 2000 of the third embodiment. The calculation unit 2020 calculates a feature amount of a customer using a captured image (S302, S304). The input receiving unit 2080 receives an input indicating an attribute of the customer related to the service (S306). The second generation unit 2100 generates attribute information based on the received input (S308). The second generation unit 2100 associates the calculated special report amount with the generated attribute information and stores them in the storage device 10 (S310).

[0089] <Input Acceptance: S306> Various methods can be used for the input receiving unit 2080 to receive input. For example, input to the input receiving unit 2080 is performed using an input screen displayed on a display device. For example, this display device is configured using a touch panel that receives input operations.

[0090] 14 is a diagram illustrating an example of an input screen. Input screen 80 is an input screen displayed on a display device. Input screen 80 has input area 82 and input area 84. Input area 82 is an input area that accepts input regarding whether or not a shopping bag is used. Input area 84 is an input area that accepts input regarding whether or not a point card is owned.

[0091] For example, suppose that input screen 80 is displayed on the display device of the product registration device. This display device can be viewed and operated by a store clerk. The clerk asks the customer whether they need a shopping bag and enters the answer in input area 82. Similarly, the clerk asks the customer whether they have a point card and enters the answer in input area 84. By storing attribute information generated using these results in storage device 10, when the same customer visits the store again, the clerk will be able to determine whether the customer will use a shopping bag or whether they have a point card before asking the customer.

[0092] The input to the input screen 80 may be performed by the customer. In this case, the input screen 80 is displayed on a display device that can be viewed and operated by the customer. For example, the product registration device is provided with a display device that can be viewed by the store clerk, as well as a separate display device that can be viewed by the customer.

[0093] Here, a default value may be set on the input screen 80. The default value is, for example, a fixed value that is set in advance. For example, the default value for whether or not the user has a point card is set to "Yes." In this case, "Yes" is displayed in the input area 84 as the default value.

[0094] Furthermore, for example, the default value may be calculated using the history information described above. Specifically, the attribute information generated by the first generating unit 2060 of the second embodiment is used as the default value. For example, when the attribute information "Possession of point card: Yes" is generated by the first generating unit 2060 of the second embodiment, the default value of the input area 84 is set to "Yes."

[0095] By calculating default values ​​using the history of customer behavior and status in this way, the probability that the customer's actual behavior and status will match the default values ​​increases compared to when fixed values ​​are used as default values. If the customer's actual behavior and status match the default values, the store clerk or customer does not need to enter anything into input area 82 or input area 84. This reduces the work required of the store clerk.

[0096] <Generating attribute information: S308> The second generating unit 2100 generates attribute information using the input received by the input receiving unit 2080 (S308). For example, when the input "point card ownership: yes" is received, the second generating unit 2100 generates attribute information "point card ownership: yes".

[0097] <Trigger for performing processing by the information processing apparatus 2000 according to the third embodiment> A series of processes related to generating attribute information (processing in FIG. 13 ) is performed, for example, when a customer for whom no corresponding attribute information exists is served. The information processing device 2000 attempts to output output information for the served customer based on the functions described in the first embodiment. If attribute information associated with features highly similar to the features of the customer included in the acquired captured image is not stored in the storage device 10, the information processing device 2000 outputs the input screen 80 described above, etc. Then, the information processing device 2000 generates attribute information using the received input. According to this method, attribute information for a new customer is generated when the customer is served.

[0098] Alternatively, for example, the series of processes related to the generation of attribute information may be initiated in response to an operation by a store clerk. For example, a button for transitioning to the above-mentioned input screen 80 may be displayed on a display device of a terminal operated by the store clerk (for example, a display device of a product registration device). The store clerk presses the button to display input screen 80, where the store clerk can input information related to the customer's attributes or have the customer input information related to the attributes.

[0099] An input triggered by a store clerk's operation is performed, for example, to update attribute information. For example, when serving a certain customer, the output information output by the output control unit 2040 indicates "point card owned: no," but the customer presents a point card. In this case, the store clerk displays the input screen 80 and inputs "point card owned: yes." In response to this input, the second generation unit 2100 generates attribute information "point card owned: yes" and stores the generated attribute information in the storage device 10 in place of the existing attribute information associated with the feature amount of the customer. In other words, the second generation unit 2100 updates the attribute information using the input received by the input receiving unit 2080.

[0100] <Hardware configuration> The hardware configuration of the computer that realizes the information processing device 2000 of the third embodiment is shown in Fig. 3, for example, as in the first embodiment. However, the storage device 1080 of the computer 1000 that realizes the information processing device 2000 of this embodiment further stores a program module that realizes the functions of the information processing device 2000 of this embodiment.

[0101] <Actions and Effects> According to the information processing device 2000 of this embodiment, input regarding customer attributes is accepted, and attribute information is generated using the input. In this way, attribute information that predicts the future behavior and state of a customer can be generated based on the actual behavior and state of the customer. Therefore, customer attribute information can be generated with high accuracy. <Modification> The second generating unit 2100 can also generate attribute information using information input using a customer's mobile terminal. The customer inputs information about the customer's attributes using the mobile terminal. The input receiving unit 2080 receives the information input using the customer's mobile terminal. The second generating unit 2100 generates attribute information using the input received by the input receiving unit 2080. This allows attribute information to be generated without the customer visiting the store.

[0102] Although the embodiments of the present invention have been described above with reference to the drawings, these are merely examples of the present invention, and it is also possible to adopt combinations of the above-described embodiments or various other configurations.

[0103] A part or all of the above-described embodiments can be described as, but not limited to, the following supplementary notes. 1. A calculation means for calculating a feature amount of a customer using a captured image of the customer; an output control means for acquiring attribute information associated with the characteristic amounts of a customer from a storage device that stores attribute information indicating whether the customer uses a service available to the customer at the store or whether the customer owns an item related to the service, in association with the characteristic amounts of the customer, and outputting information based on the acquired attribute information; An information processing device having the above. 2. An information processing device as described in 1., which has a generation means for generating the attribute information using historical information indicating the history of the customer's behavior or status regarding the use of the service, and storing the generated attribute information in the storage device in association with the customer's features contained in the acquired captured image. 3. The information processing device according to 2., wherein the generating means generates the attribute information using history information of each of a plurality of customers. 4. An input receiving means for receiving input regarding the use of a service from a customer included in the acquired captured image; a generating means for generating the attribute information based on the input received by the input receiving means, and storing the generated attribute information in the storage device in association with a feature amount of the customer included in the acquired captured image; 1. The information processing device according to claim 1. 5. The information processing device according to any one of 1 to 4, wherein the storage device stores the attribute information in further association with a condition to which the attribute information is applied. 6. The attribute information indicates whether or not a shopping bag is used, 6. The information processing device according to 5., wherein the condition to which the attribute information is applied is a condition related to the quantity of goods to be purchased. 7. The output control means further outputs a message to the customer asking whether or not to use the service; An information processing device described in any one of 1. to 6., wherein the message output when the acquired attribute information indicates that the service will be used and the message output when the acquired attribute information indicates that the service will not be used are different from each other. 8. An information processing device described in any one of 1. to 7., which is connected to at least one of a display unit that displays the attribute information to the customer and a display unit that displays the attribute information to a store clerk.

[0104] 9. A computer-implemented control method comprising: a calculation step of calculating a feature amount of the customer using a captured image of the customer; and an output control step of acquiring attribute information associated with the customer's characteristics from a storage device that stores attribute information indicating whether the customer uses a service available to the customer at the store or whether the customer owns an item related to the service, in association with the customer's characteristics, and outputting information based on the acquired attribute information. 10. A control method according to claim 9, which includes a generation step of generating the attribute information using historical information indicating the history of the customer's behavior or status regarding the use of the service, and storing the generated attribute information in the storage device in association with the customer's features contained in the acquired captured image. 11. The control method according to claim 10, wherein in the generating step, the attribute information is generated using history information of each of a plurality of customers. 12. An input receiving step of receiving input regarding the use of a service from a customer included in the acquired captured image; a generating step of generating the attribute information based on the input received in the input receiving step, and storing the generated attribute information in the storage device in association with a feature amount of the customer included in the acquired captured image; 9. The control method according to claim 9. 13. The control method according to any one of 9. to 12., wherein the storage device stores the attribute information in further association with a condition to which the attribute information is applied. 14. The attribute information indicates whether or not a shopping bag is used, 13. The control method according to claim 13, wherein the condition to which the attribute information is applied is a condition related to the quantity of the product to be purchased. 15. In the output control step, a message is further output to ask the customer whether or not they wish to use the service; A control method described in any one of 9. to 14., wherein the message output when the acquired attribute information indicates that the service will be used and the message output when the acquired attribute information indicates that the service will not be used are different from each other. 16. A control method described in any one of 9. to 15., wherein the computer is connected to at least one of a display unit that displays the attribute information to the customer and a display unit that displays the attribute information to a store clerk.

[0105] 17. A program that causes a computer to execute each step of the control method described in any one of 9. to 16. [Explanation of symbols]

[0106] 10 Storage device 20 Camera 30 Store Clerk 40 customers 50 cashier terminal 60 display screen 62 windows 64 buttons 66 Buttons 68 Windows 80 Input screen 82 Input Area 84 Input Area 500 tables 502 features 504 Attribute information 506 Applicable Conditions 600 tables 602 Features 604 History Information 606 Date and Time 1000 calculator 1020 Bus 1040 processor 1060 memory 1080 storage device 1100 Input / Output Interface 1120 Network Interface 2000 Information Processing Equipment 2020 Calculation Department 2040 Output control section 2060 1st generation part 2080 Input Reception Section 2100 2nd generation section

Claims

1. A control method implemented by one or more computers, comprising: Display a screen that accepts changes to customer attribute information, Display a screen that allows the user to select whether the change in the customer's attribute information is a one-time change or a continuation of the change in the customer's attribute information; When the selection to continue the service is accepted, the attribute information of the customer stored in the storage means in association with the customer is updated based on the change. Control method.

2. 2. The control method according to claim 1, The computer A control method for identifying the customer from an image including the customer.

3. 3. The control method according to claim 1 or 2, The computer A control method for generating the attribute information using history information of the customer, and storing the generated attribute information in the storage means in association with the customer.

4. 4. The control method according to claim 1, The computer When the selection of this one-time-only is accepted, the attribute information of the customer stored in the storage means is not updated.

5. 5. The control method according to claim 1, The computer A control method in which a screen for accepting changes to the attribute information of the customer is displayed when the store clerk attends to the customer.

6. 6. The control method according to claim 1, A control method for displaying attribute information of the identified customer, which is stored in the storage means in association with the customer, on a screen for accepting changes to the attribute information.

7. 7. The control method according to claim 1, A control method, wherein the attribute information indicates at least one of the customer's payment method and whether the customer owns an item related to the use of a service that the customer can use at the store.

8. 8. The control method according to claim 1, A control method, wherein the screen for accepting changes to the customer's attribute information and the screen for accepting the selection are displayed on a device operated by the customer or a store clerk.

9. 3. The control method according to claim 2, A control method in which the image is an image of the customer who has entered the store taken by a camera installed at or near the entrance of the store.

10. 3. The control method according to claim 2, A control method in which the image is an image of the customer taken by a camera installed near a device operated by a store clerk or the customer.

11. 4. The control method according to claim 3, A control method, wherein the customer history information includes information indicating the history of the customer's behavior or state.

12. an output processing means for displaying a screen for accepting changes to customer attribute information and for displaying a screen for accepting selection of whether the change to the customer attribute information is a one-time change or a continuation of the change; and a storage processing means for updating the attribute information of the customer stored in the storage means in association with the customer based on the change when the selection to continue the service is accepted. Information processing device.

13. On the computer, A program for executing each process of the control method according to any one of claims 1 to 11.

Images