Information processing device, control method, and program

Abstract

To increase opportunities to grasp customer information.SOLUTION: An information processing device 2000 obtains an image including a customer, generates attribute information of the customer based on history information of the customer, and outputs attribute information corresponding to a customer specified by the image.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information processing device and a control method. [Background technology]

[0002] Technologies for managing customer information in POS (Point of Sales) systems etc. have been developed. For example, Patent Document 1 discloses a technology for managing a customer's name, address, whether the customer uses plastic bags, etc. in association with a customer's identification number that can be read from a membership card. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2007-102527 A Summary of the Invention [Problem to be solved by the invention]

[0004] The system of Patent Document 1 uses a customer identifier read from the customer's membership card. Therefore, unless the customer is registered as a member, the customer's information cannot be obtained.

[0005] The present invention has been made in view of the above problems. One of the objects of the present invention is to provide a technique for acquiring customer information related to services that the customer can use, regardless of whether the customer is a registered member or not. [Means for solving the problem]

[0006] The information processing device of the present invention comprises: An acquisition means for acquiring an image including a customer; A generating means for generating attribute information of the customer based on history information of the customer; an output means for outputting attribute information corresponding to the customer identified by the image; Havedeath, The attribute information includes information regarding conditions that the customer desires for food and drink. .

[0007] The control method of the present invention is executed by a computer that realizes an information processing device. The control method includes: Get an image containing the customer, generating attribute information of the customer based on historical information of the customer; outputting attribute information corresponding to the customer identified by the image; Including fruit, The attribute information includes information regarding the conditions that the customer desires for food and beverages. nothing.

[0008] The program of the present invention causes a computer to execute each step of the control method of the present invention. Effect of the Invention

[0009] According to the present invention, a technique is provided that can acquire customer information related to services that the customer can use, regardless of whether the customer is a registered member or not. [Brief description of the drawings]

[0010] [Figure 1] 1 is a block diagram illustrating an example of an information processing apparatus according to a first embodiment together with its usage environment. [Diagram 2] 2 is a diagram conceptually illustrating an example of the operation of the information processing device of the first embodiment. FIG. [Diagram 3] FIG. 1 is a diagram illustrating a computer for implementing an information processing device. [Figure 4] 4 is a flowchart illustrating a flow of processing executed by the information processing apparatus of the first embodiment. [Diagram 5] 10 is a diagram illustrating an example of the association between features and attribute information of customers in a table format. FIG. [Figure 6] FIG. 11 is a diagram illustrating another example of attribute information. [Figure 7] FIG. 11 is a diagram illustrating an example of output information. [Figure 8]FIG. 13 is a diagram illustrating an example of a window for changing the contents of output information. [Figure 9] FIG. 11 is a block diagram illustrating an information processing apparatus according to a second embodiment. [Figure 10] 11 is a flowchart illustrating the flow of processing executed by an information processing apparatus according to a second embodiment. [Figure 11] FIG. 11 is a diagram illustrating an example of history information in a table format. [Figure 12] FIG. 11 is a block diagram illustrating an information processing apparatus according to a third embodiment. [Figure 13] 11 is a flowchart illustrating the flow of processing executed by an information processing apparatus according to a third embodiment. [Figure 14] FIG. 13 is a diagram illustrating an example of an input screen. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, the embodiments of the present invention will be described with reference to the drawings. In all drawings, the same components are given the same reference numerals, and the description will be omitted as appropriate. In each block diagram, unless otherwise specified, each block represents a functional configuration, not a hardware configuration.

[0012] [Embodiment 1] FIG. 1 is a block diagram illustrating an information processing device 2000 according to the first embodiment together with its usage environment. The information processing device 2000 includes a calculation unit 2020 and an output control unit 2040. The storage device 10 stores a feature amount of a customer in association with attribute information of the customer. The attribute information of a certain customer indicates attributes of the customer related to a service used by the customer in a store. More specifically, the attributes of the customer related to a service indicate whether the customer uses the service (whether or not the service is used) or whether or not the customer owns an object used when using the service (whether or not the object related to the use of the service is owned). An example of an object used when using a service is a point card used when using a point service.

[0013] The calculation unit 2020 acquires a captured image of a customer. The calculation unit 2020 further calculates a feature amount of the customer included in the acquired captured image. The feature amount of the customer is an arbitrary value representing an appearance feature (e.g., a facial feature) of the customer. The output control unit 2040 acquires attribute information associated with the feature amount of the customer included in the acquired captured image from the storage device 10 using the calculated feature amount. Then, the output control unit 2040 outputs information based on the customer attributes indicated in the acquired attribute information. The information based on the customer attributes indicated in the attribute information is the information indicated in the attribute information itself, or information indicated in the attribute information processed using a predetermined method.

[0014] 2 is a diagram conceptually illustrating the operation of the information processing device 2000 of the first embodiment. A customer 40 purchases a product by paying for the product at a cash register terminal 50. The cash register terminal 50 is operated by a store clerk 30. A camera 20 is installed near the cash register terminal 50 and captures an image of the customer 40. The storage device 10 stores attribute information indicating the customer's attributes related to the point service in association with the customer's features. More specifically, the attribute information indicates whether or not the customer has a point card.

[0015] The information processing device 2000 acquires a feature amount of the customer 40 captured by the camera 20. Here, it is assumed that the feature amount of the customer 40 is v1. The information processing device 2000 acquires attribute information associated with the feature amount v1 from the storage device 10. This attribute information indicates "point card ownership: yes". Therefore, the information processing device 2000 outputs information indicating that "customer 40 owns a point card."

[0016] This allows the store clerk 30 to know that the customer 40 will use a point card. The store clerk 30 may then ask the customer, for example, "Do you have a point card?" to prompt the customer to present the point card.

[0017] The attribute information associated with v2 indicates "point card ownership: none". Therefore, when the facial feature amount of customer 40 is v2, the information processing device 2000 outputs information indicating that "customer 40 does not own a point card". In this case, for example, the store clerk 30 does not ask customer 40 to present a point card. In addition, for example, the store clerk 30 may make a statement to confirm that customer 40 does not have a point card, such as "You don't have a point card, do you?"

[0018] <Actions and Effects> In this embodiment, the attribute information of a customer is stored in association with the characteristic amount of the customer that can be calculated from a captured image in which the customer is included. By using such a method of identifying a customer using the characteristic amount of the customer, it is not necessary to use an identifier (e.g., a member ID (identifier)) assigned to the customer to identify the customer in order to obtain the attribute information. Therefore, regardless of whether the customer is a registered member or not, attribute information indicating whether the customer uses a service that the customer can use in a store or whether the customer owns an item related to the service can be obtained.

[0019] For example, suppose the attribute information is information indicating "whether or not a customer has a membership card." In this case, suppose the attribute information is stored in association with the customer's membership ID. With this method, in order to obtain the attribute information indicating whether or not a customer has a membership card, the customer must be asked to present the membership card. In other words, if the customer has not registered as a member, it is not possible to determine whether or not to request the customer to present their membership card.

[0020] On the other hand, in this case, the information processing device 2000 of the present embodiment can calculate the feature amount of the customer from the captured image including the customer, and can obtain the attribute information of the customer using the feature amount. Therefore, the attribute information of the customer can be used to determine whether or not to request the customer to present a membership card.

[0021] This embodiment will be described in further detail below.

[0022] <Example of Hardware Configuration of Information Processing Device 2000> Each functional component of the information processing device 2000 may be realized by hardware that realizes each functional component (e.g., a hardwired electronic circuit, etc.), or may be realized by a combination of hardware and software (e.g., a combination of an electronic circuit and a program that controls it, etc.). The case where each functional component of the information processing device 2000 is realized by a combination of hardware and software will be further described below.

[0023] 3 is a diagram illustrating a computer 1000 for realizing the information processing device 2000. The computer 1000 may be any of a variety of computers. For example, the computer 1000 may be a personal computer (PC), a server machine, a tablet terminal, or a smartphone. The computer 1000 may be a dedicated computer designed to realize the information processing device 2000, or may be a general-purpose computer.

[0024] The computer 1000 includes a bus 1020, a processor 1040, a memory 1060, a storage device 1080, an input / output interface 1100, and a network interface 1120. The bus 1020 is a data transmission path for the processor 1040, the memory 1060, the storage device 1080, the input / output interface 1100, and the network interface 1120 to transmit and receive data to and from each other. The processor 1040 is an arithmetic processing device such as a central processing unit (CPU) or a graphics processing unit (GPU). The memory 1060 is a main storage device realized by a random access memory (RAM) or the like. The storage device 1080 is an auxiliary storage device realized by a hard disk, a solid state drive (SSD), a ROM, a memory card, or the like. However, the storage device 1080 may be realized by the same hardware as that used to realize the main storage device, such as a RAM.

[0025] The input / output interface 1100 is an interface for connecting the computer 1000 to an input / output device. For example, the input / output interface 1100 is connected to input devices such as a keyboard and a mouse, and output devices such as a display device.

[0026] The network interface 1120 is an interface for connecting to a communication network such as a WAN (Wide Area Network) or a LAN (Local Area Network).

[0027] The storage device 1080 stores program modules that realize the various functions of the information processing device 2000. The processor 1040 reads these program modules into the memory 1060 and executes them to realize the various functions corresponding to the program modules.

[0028] <Processing flow> 4 is a flowchart illustrating a process flow executed by the information processing device 2000 of the first embodiment. The calculation unit 2020 acquires a captured image of a customer (S102). The calculation unit 2020 calculates a feature amount of the customer included in the captured image (S104). The output control unit 2040 acquires attribute information associated with the feature amount of the customer included in the captured image from the storage device 10 using the calculated feature amount (S106). The output control unit 2040 outputs information based on the acquired attribute information (S108).

[0029] <Scenes where the information processing device 2000 is used> The information processing device 2000 can be used in various situations in which customers are served. For example, the information processing device 2000 can be used in a situation in which a store clerk who operates a product registration device serves a customer (a situation in which a product is registered as a payment target). The product registration device is a cash register terminal used to register a product as a payment target.

[0030] The attribute information used in this scene indicates, for example, whether or not a shopping bag is used, whether or not the customer has a point card, whether or not disposable chopsticks are needed, whether or not hot and cold items are to be separated into bags, whether or not the purchased items are to be delivered to the customer's home, whether or not a receipt is needed, the payment method (cash, electronic money, or credit card), the type of card used when paying with electronic money, whether or not the customer is a minor, etc. The store clerk can use the output information based on this attribute information to decide whether or not to ask the customer to present a point card.

[0031] In addition, for example, the information processing device 2000 can be used in a scene where a customer who visits a restaurant is served. The attribute information used in this scene indicates, for example, whether a smoking seat or a non-smoking seat is to be used, whether a counter seat or a table seat is to be used, or whether a window seat is desired. The staff can use the output information based on this attribute information to determine the seat to be provided to the customer.

[0032] In addition, for example, the information processing device 2000 can be used in a scene where an order is received from a customer. The attribute information used in this scene indicates, for example, conditions regarding seasoning and toppings when ordering food and drink (strength of flavor, amount of toppings, type of toppings, etc.), whether chopsticks or a fork is used, whether a napkin is used, etc. The waiter can use the output information based on this attribute information to understand the conditions that the customer desires for food and drink.

[0033] <Example of computer 1000 realizing information processing device 2000> Various types of computers can be used as the specific computer 1000 for realizing the information processing device 2000. For example, the computer 1000 is a server (hereinafter, a store server) installed in a store where the information processing device 2000 is used. Alternatively, the computer 1000 may be a server (hereinafter, an external server) installed outside the store where the information processing device 2000 is used.

[0034] Furthermore, for example, the computer 1000 may be a product registration device. In this case, the information processing device 2000 is operated by, for example, a store clerk who uses the product registration device to serve customers. The product registration device may be provided integrally with a settlement device, or may be provided separately from the settlement device. The settlement device is a cash register terminal used for settlement processing (such as payment of the price) of products registered as items to be settled.

[0035] When the product registration device and the settlement device are integrated, the registration process for registering products as items to be settled and the settlement process for the products registered as items to be settled (such as paying the price) are carried out using the same cash register terminal. A format in which the registration process and the settlement process are carried out by the customer is called a self-service format. On the other hand, when the product registration device and the settlement device are separate, the process for registering products as items to be settled and the settlement process for the products registered as items to be settled are carried out at different cash register terminals. This format is called a semi-self-service format, and for example, the product registration device is operated by a store clerk and the settlement device is operated by the customer.

[0036] Alternatively, for example, the computer 1000 may be a mobile terminal used by a waiter. The mobile terminal used by a waiter is, for example, a mobile terminal operated by the waiter to record which seat the waiter has guided a customer to, or a mobile terminal operated by the waiter to record orders received from customers.

[0037] <Acquisition of captured image: S102> The calculation unit 2020 acquires a captured image of a customer. To this end, a camera 20 is installed in the store to capture an image of the customer. The camera 20 may be a camera that generates a moving image, or a camera that captures a still image. In the former case, the captured image is an image frame that constitutes the moving image.

[0038] Camera 20 is provided in a position where it can capture an image of a customer. When capturing an image of a customer paying for an item, camera 20 is provided, for example, at a product registration device or nearby. When capturing an image of a customer who has just arrived at the store, camera 20 is provided, for example, at the store entrance or nearby. When capturing an image of a customer placing an order, camera 20 is provided, for example, at the customer's seat or nearby.

[0039] The calculation unit 2020 may acquire the captured image by any method. For example, the calculation unit 2020 acquires the captured image by accessing a storage device in which the captured image is stored. The storage device in which the captured image is stored may be provided inside the camera 20 that generated the captured image, or may be provided outside the camera 20. Furthermore, for example, the calculation unit 2020 may acquire the captured image by receiving the captured image transmitted from the camera 20 or the like.

[0040] <Calculation of customer features: S104> The calculation unit 2020 calculates the feature amount of the customer included in the acquired captured image (S104). Here, the technique for calculating the feature amount of the person included in the image can use existing technology.

[0041] <About attribute information> The attribute information indicates the attributes of the customer related to the service that the customer uses. Examples of the attribute information are as described above.

[0042] Fig. 5 is a diagram illustrating an example of the correspondence between customer features and attribute information in the form of a table. The table in Fig. 5 is called table 500. Table 500 has two columns, feature amounts 502 and attribute information 504. Feature amounts 502 indicate customer features. Attribute information 504 indicates the attribute information described above.

[0043] Here, table 500 may further indicate conditions to which the attribute information applies. For example, the attribute information indicates attributes related to the use of shopping bags (whether or not shopping bags are used). In this case, the condition to which the attribute information applies is, for example, the amount of products purchased by a customer (number, weight, volume, etc.). The attribute information indicates whether or not shopping bags are used, the number of shopping bags to be used, etc., in association with a range of the number of products purchased by a customer.

[0044] FIG. 6 is a diagram illustrating another example of attribute information. In FIG. 6, table 500 has application conditions 506. Application conditions 506 indicate conditions under which attribute information is applied. For example, the record in the second row of table 500 in FIG. 6 indicates that "if a customer whose facial feature is v1 purchases less than three items, this customer will not use a shopping bag." On the other hand, the record in the third row of table 500 in FIG. 6 indicates that "if a customer whose facial feature is v1 purchases three or more items, this customer will use a shopping bag." Also, the record in the fifth row of table 500 in FIG. 6 indicates that "if a customer whose facial feature is v2 purchases three or more items, this customer will use a shopping bag unconditionally."

[0045] <Acquisition of attribute information: S104> The output control unit 2040 acquires attribute information associated with the feature amount of the customer included in the captured image by using the feature amount of the customer calculated by the calculation unit 2020. Specifically, the output control unit 2040 acquires attribute information associated with the feature amount of the customer having a high similarity to the feature amount of the customer calculated by the calculation unit 2020 from among the attribute information stored in the storage device 10. For example, the output control unit 2040 acquires attribute information stored in the storage device 10 in association with the same feature amount as the feature amount calculated by the calculation unit 2020. As another example, the output control unit 2040 acquires attribute information stored in the storage device 10 in association with the feature amount having a similarity to the feature amount calculated by the calculation unit 2020 that is equal to or greater than a predetermined value from among the feature amounts stored in the storage device 10. As another example, the output control unit 2040 acquires attribute information stored in the storage device 10 in association with the feature amount having the highest similarity to the feature amount calculated by the calculation unit 2020 from among the feature amounts stored in the storage device 10. The above-mentioned predetermined value may be preset in the output control unit 2040, or may be stored in a storage device accessible from the output control unit 2040.

[0046] The storage device 10 may be any storage device accessible from the output control unit 2040. The storage device 10 may be provided inside the information processing device 2000 or outside the information processing device 2000. In the former case, the storage device 10 is realized as the storage device 1080 in FIG. 4, for example. In the latter case, the storage device 10 is realized as a NAS (Network Attached Storage) provided outside the information processing device 2000, for example.

[0047] <Output by output control unit 2040: S106> The output control unit 2040 outputs information based on the customer attributes indicated in the acquired attribute information (hereinafter, output information). FIG. 7 is a diagram illustrating an example of output information. In the example of FIG. 7, the information processing device 2000 is a product registration device operated by a store clerk. The display screen 60 is a screen displayed on a display device connected to the product registration device. The display screen 60 displays product information read by the store clerk using a barcode reader or the like, the total price of the products, and the like.

[0048] Furthermore, the display screen 60 includes a window 62. The window 62 is a window that includes output information. The output control unit 2040 controls the display device to display the window 62 on the display device.

[0049] In the example of Figure 7, there are two types of attribute information. The first type of attribute information indicates whether or not the customer uses a shopping bag. The second type of attribute information indicates whether or not the customer has a point card.

[0050] In this example, the feature amount of customer A is associated with a first type of attribute information, "Shopping bag use: No," and a second type of attribute information, "Point card ownership: Yes." Therefore, the window 62 output by the output control unit 2040 displays the information, "Shopping bag use: No," and "Point card ownership: Yes."

[0051] For example, in the example of FIG. 7, assume that a store clerk operates the product registration device. In this case, the store clerk sees window 62 and understands that customer A does not use a shopping bag and that customer A has a point card. The store clerk then asks customer A, "Do you have a point card?", requesting the customer to show the point card. However, since customer A does not use a shopping bag, for example, the store clerk does not ask customer A about a shopping bag. Alternatively, for example, the store clerk may ask a question to confirm that a shopping bag is not needed, such as, "You do not need a shopping bag, do you?"

[0052] As another example, assume that customer A operates the product registration device in the example of Fig. 7. In this case, the information processing device 2000 is a self-service type device. Customer A looks at window 62, confirms that he or she will not be using a shopping bag and that he or she has a point card, and presses button 64. As a result, the product registration process in the product registration device proceeds to the next stage.

[0053] Here, the information processing device 2000 may receive an input requesting a change in the content of the output information. Fig. 8 is a diagram showing an example of a window for changing the content of the output information. Note that the display screen 60 is omitted in Fig. 8.

[0054] 8 has a button 66 for requesting a change in the contents of the output information. Here, suppose that although "Shopping bag use: Not available" is displayed in window 62, the customer thinks, "I would like to use a shopping bag this time." For example, even if a customer normally uses his or her own bag, there are cases when the customer wants to use a shopping bag because he or she forgot to bring his or her own bag.

[0055] In such a case, the customer presses the button 66. In response to the button 66 being pressed, the output control unit 2040 displays, for example, a window 68 shown in FIG.

[0056] Window 68 has radio buttons for selecting whether or not to use a shopping bag, and whether or not to own a point card. The default values ​​of the radio buttons are set according to the contents of the output information. After changing the use of a shopping bag from "yes" to "no," the customer presses the OK button. In this way, the customer can communicate to the store clerk that they would like to use a shopping bag.

[0057] When a store clerk operates the product registration device, the store clerk may operate window 68. In this case, for example, the store clerk asks the customer what changes he or she would like to make to the output information, and operates window 68 in accordance with the changes he or she hears from the customer.

[0058] Here, the information processing device 2000 may or may not update the attribute information based on the contents of the output information changed using the window 68. Whether or not to update the attribute information may be determined in advance, or may be selected by the customer.

[0059] In the latter case, for example, the output control unit 2040 displays the window 68 in Fig. 8(c) instead of the window 68 in Fig. 8(b). The window 68 in Fig. 8(c) has radio buttons for selecting either "this time only" or "in the future." When the former is selected, the information processing device 2000 does not update the attribute information based on the changes made by the customer. On the other hand, when the latter is selected, the information processing device 2000 updates the attribute information based on the changes made by the customer.

[0060] The method of outputting the output information is not limited to the method of displaying the output information on a display device. For example, the output information may be output as a voice. In this case, for example, the store clerk may wear earphones in advance, and the output information may be output to the earphones.

[0061] When an output device such as a display device or an earphone is connected to the information processing device 2000, the output control unit 2040 outputs output information to the output device. On the other hand, when an output device is not connected to the information processing device 2000, the information processing device 2000 transmits output information to another device to which the output device is connected. The device that receives the output information controls the output device to output the output information. For example, when the information processing device 2000 is realized as a store server, the output control unit 2040 transmits the output information to a product registration device operated by a store clerk. The product registration device that receives the output information controls a display device or an earphone connected to the product registration device to output the output information.

[0062] The information processing device 2000 may generate a message for a customer using the attribute information and output the message. For example, assume that the attribute information is information regarding whether or not a service is used. In this case, if the attribute information indicates that "Service A will be used," a message saying "Service A is necessary" is output, and if the attribute information indicates that "Service A will not be used," a message saying "Service A is unnecessary" is output.

[0063] Messages can also be generated in a similar manner when the attribute information indicates whether or not the user owns something used to use a service (such as a point card).For example, if the attribute information indicates that the user "owns a point card," a message saying "You have a point card, don't you?" is displayed, and if the attribute information indicates that the user "does not own a point card," a message saying "You don't have a point card, do you?" is displayed.

[0064] By outputting messages tailored to the customer's attributes in this way, it is possible to reduce the stress and discomfort felt by customers who are asked questions by store clerks. For example, some customers may feel uncomfortable if a store clerk always asks "Would you like to use Service A?" even though they do not normally use Service A. On the other hand, if the clerk asks "You will not use Service A, will you?", the customer will feel that "the store clerk understands me," and the customer will not feel uncomfortable, or the degree of discomfort felt by the customer will be reduced.

[0065] [Embodiment 2] 9 is a block diagram illustrating an information processing device 2000 according to the second embodiment. Except for the matters described below, the information processing device 2000 according to the second embodiment is similar to the information processing device 2000 according to the first embodiment.

[0066] The information processing device 2000 of the second embodiment has a first generating unit 2060. The first generating unit 2060 generates attribute information using history information. The history information is information indicating the history of a customer's actions and status regarding the use of a service. For example, the history information indicates whether the customer used a shopping bag or whether the customer presented a point card. Furthermore, the first generating unit 2060 associates the generated attribute information with the feature amount of the customer calculated by the calculating unit 2020 and stores it in the storage device 10.

[0067] <Processing flow> FIG. 10 is a flowchart illustrating a process flow executed by the information processing device 2000 of the second embodiment. The calculation unit 2020 acquires a captured image and calculates a feature amount of a customer (S202, S204). Hereinafter, this customer is also referred to as a "customer for whom attribute information is generated." The first generation unit 2060 acquires history information (S206). The first generation unit 2060 generates attribute information using the acquired history information (S208). The first generation unit 2060 associates the feature amount calculated in S204 with the attribute information generated in S208, and stores them in the storage device 10 (S210).

[0068] <About history information: S206> As described above, history information is information that indicates the history of a customer's behavior and state regarding the use of a service. FIG. 11 is a diagram illustrating an example of history information in the form of a table. The table in FIG. 11 is denoted as table 600. Table 600 has columns of feature amount 602, history information 604, and date and time 606. Feature amount 602 indicates a feature amount of a customer. History information 604 indicates the customer's past behavior and state. Date and time 606 indicates the date and time corresponding to the behavior and state indicated in history information 604.

[0069] The history information is assumed to be stored in advance in a storage device accessible from the first generation unit 2060. The first generation unit 2060 acquires the history information from this storage device.

[0070] To generate the attribute information, only history information corresponding to the feature of the customer included in the captured image (behavioral history of the customer for which the attribute information is generated) may be used, or other history information may be used in addition to this history information. In the former case, the first generating unit 2060 acquires history information associated with a feature having a high similarity to the feature calculated by the calculating unit 2020 (for example, a feature that matches the calculated feature).

[0071] On the other hand, in the latter case, the first generating unit 2060 acquires, for example, all the history information. In addition, for example, the first generating unit 2060 acquires history information of other customers who have something in common with the customer for whom the attribute information is generated. The thing in common is, for example, age, sex, or personality.

[0072] For example, when the age of the customer is used as the common point, the first generating unit 2060 acquires history information of customers whose age is close to the age estimated from the feature amount of the customer calculated by the calculating unit 2020. Similarly, when the gender of the customer is used as the common point, the first generating unit 2060 acquires history information of customers whose gender is the same as the gender of the customer estimated by the calculating unit 2020. Similarly, when the personality of the customer is used as the common point, the first generating unit 2060 acquires history information of customers whose personality is classified as the same personality as the personality of the customer estimated by the calculating unit 2020. Here, for example, the personality of the customer is classified into types such as a gentle personality, a nervous personality, or a rough personality. Note that a known technology can be used for estimating a person's age, gender, or personality using the feature amount of the person's face.

[0073] When utilizing such commonalities among customers, it is preferable to store the history information of each customer in association with information for identifying the commonalities among customers (such as the customer's age). The information for identifying the commonalities among customers may be an age estimated from the customer's features, or the customer's actual age. In the latter case, the information for identifying the commonalities among customers is assumed to be known in advance by some method (for example, membership information or a questionnaire).

[0074] <Generating attribute information: S208> The first generating unit 2060 generates attribute information using the acquired history information (S208). If only one piece of history information is acquired, the first generating unit 2060 generates attribute information from that history information. For example, if the history information indicates "point card ownership: none", the first generating unit 2060 generates attribute information "point card ownership: none".

[0075] When there are multiple pieces of acquired history information, the first generating unit 2060 generates attribute information by performing statistical processing on the acquired history information. For example, when generating attribute information regarding the ownership or non-ownership of a point card, the first generating unit 2060 compares the number of pieces of history information indicating "point card ownership: yes" with the number of pieces of history information indicating "point card ownership: no", and generates attribute information based on the content of the history information with the greater number. For example, when the number of pieces of history information indicating "point card ownership: yes" is greater, the first generating unit 2060 generates attribute information indicating "point card ownership: yes".

[0076] Here, the first generating unit 2060 may generate attribute information by performing weighted statistical processing on the history information. For example, the first generating unit 2060 acquires history information of all customers, assigns a large weight to the history information of customers who have something in common with the customer included in the captured image acquired by the calculating unit 2020, assigns a small weight to the other history information, and generates attribute information from the history information.

[0077] For example, suppose that attribute information is to be generated regarding the ownership of a point card, and that history information is associated with the customer's age divided into 10-year age groups (teens, twenties, thirties, etc.).

[0078] Under these conditions, it is assumed that the age of the customer for which attribute information is to be generated is “in their 20s.” In this case, the first generating unit 2060 assigns a large weight to the history information of each customer in their 20s, and assigns a small weight to the history information of customers of other ages.

[0079] In this way, by weighting the history information according to the commonalities with the customer for whom the attribute information is to be generated, the generated attribute information is more likely to reflect the behavior of customers who have commonalities with the customer for whom the attribute information is to be generated, and therefore the attributes of the customer for whom the attribute information is to be generated can be predicted with high accuracy.

[0080] <Occasion for performing processing by the information processing device 2000 according to the second embodiment> A series of processes (processing of FIG. 10) related to the generation of attribute information is executed, for example, when a customer for whom there is no corresponding attribute information is served is served. The information processing device 2000 attempts to output output information about the served customer based on the function described in the first embodiment. Then, when a feature amount having a high similarity to the feature amount of the customer included in the acquired captured image is not stored in the storage device 10, the first generating unit 2060 generates attribute information by the above-mentioned method. According to this method, attribute information about a new customer is generated when the customer is served. Therefore, attribute information of the new customer is automatically generated. However, the timing when the first generating unit 2060 generates attribute information may be any timing, and is not limited to the timing when the customer is served.

[0081] <Hardware configuration> The hardware configuration of the computer that realizes the information processing device 2000 of the second embodiment is shown in Fig. 3, for example, as in the first embodiment. However, the storage device 1080 of the computer 1000 that realizes the information processing device 2000 of this embodiment further stores a program module that realizes the functions of the information processing device 2000 of this embodiment.

[0082] <Actions and Effects> According to the information processing device 2000 of this embodiment, customer attribute information is generated using history information. Therefore, the customer attribute information is generated based on the past actions and states of the customer and other customers. In this way, the customer attributes can be estimated with high accuracy.

[0083] Furthermore, if attribute information is generated using only the historical information of the customer for whom the attribute information is to be generated, it is possible to predict the customer's future behavior and state based on the trends in the customer's past behavior and state.

[0084] In addition, by using history information of customers other than the customer for whom the attribute information is generated, it is possible to predict the future behavior and state of the customer for whom the attribute information is generated based on the tendencies of various customers' past behavior and states. This method is particularly suitable in cases where the customer for whom the attribute information is generated is a new customer and therefore no history information exists.

[0085] Furthermore, by using historical information of customers who have something in common with the customer for whom the attribute information is being generated, it is possible to predict the future behavior and state of the customer for whom the attribute information is being generated based on the tendencies in the past behavior and state of customers who have something in common with the customer for whom the attribute information is being generated.

[0086] [Embodiment 3] 12 is a block diagram illustrating an information processing device 2000 of embodiment 3. Except for the matters described below, the information processing device 2000 of embodiment 3 is similar to the information processing device 2000 of embodiment 1 or the information processing device 2000 of embodiment 2.

[0087] The information processing device 2000 of the third embodiment includes an input receiving unit 2080 and a second generating unit 2100. The input receiving unit 2080 receives an input representing attributes of a customer related to a service, for the customer included in the captured image acquired by the calculation unit 2020. The second generating unit 2100 generates attribute information based on the input received by the input receiving unit 2080. Furthermore, the second generating unit 2100 associates the generated attribute information with the feature amount of the customer included in the captured image acquired by the calculation unit 2020, and stores the generated attribute information in the storage device 10.

[0088] <Processing flow> 13 is a flowchart illustrating a process flow executed by the information processing device 2000 of the third embodiment. The calculation unit 2020 calculates a feature amount of a customer using a captured image (S302, S304). The input receiving unit 2080 receives an input indicating an attribute of the customer related to the service (S306). The second generation unit 2100 generates attribute information based on the received input (S308). The second generation unit 2100 stores the calculated special report amount and the generated attribute information in association with each other in the storage device 10 (S310).

[0089] <Input Acceptance: S306> Various methods can be adopted for the input receiving unit 2080 to receive input. For example, input to the input receiving unit 2080 is performed using an input screen displayed on a display device. For example, this display device is configured using a touch panel that receives input operations.

[0090] 14 is a diagram illustrating an example of an input screen. Input screen 80 is an input screen displayed on a display device. Input screen 80 has input area 82 and input area 84. Input area 82 is an input area that accepts input regarding whether or not a shopping bag is used. Input area 84 is an input area that accepts input regarding whether or not a point card is owned.

[0091] For example, assume that an input screen 80 is displayed on the display device of the product registration device. This display device can be viewed and operated by a store clerk. The store clerk asks the customer whether or not he needs a shopping bag, and inputs the result in an input area 82. Similarly, the store clerk asks the customer whether or not he has a point card, and inputs the result in an input area 84. By storing attribute information generated using these results in the storage device 10, when the same customer visits the store again, the store clerk can determine whether or not the customer will use a shopping bag and whether or not the customer has a point card before asking the customer.

[0092] The input to the input screen 80 may be performed by the customer. In this case, the input screen 80 is displayed on a display device that can be viewed and operated by the customer. For example, the product registration device is provided with a display device that is viewed by the store clerk, as well as a separate display device that is viewed by the customer.

[0093] Here, a default value may be set in the input screen 80. The default value is, for example, a fixed value that is set in advance. For example, the default value for whether or not the user has a point card is set to "Yes." In this case, "Yes" is displayed in the input area 84 as the default value.

[0094] Also, for example, the default value may be calculated using the history information described above. Specifically, the attribute information generated by the first generating unit 2060 of the second embodiment is used as the default value. For example, when the attribute information "Point card ownership: Yes" is generated by the first generating unit 2060 of the second embodiment, the default value of the input area 84 is set to "Yes".

[0095] By calculating default values ​​using the history of customer behavior and status in this way, the probability that the customer's actual behavior and status will match the default values ​​increases compared to when a fixed value is used as the default value. If the customer's actual behavior and status match the default values, the store clerk or customer does not need to enter anything into input area 82 or input area 84. This reduces the work of the store clerk.

[0096] <Generating attribute information: S308> The second generating unit 2100 generates attribute information using the input received by the input receiving unit 2080 (S308). For example, when the input "point card ownership: yes" is received, the second generating unit 2100 generates attribute information "point card ownership: yes".

[0097] <Occasion for performing processing by the information processing device 2000 according to the third embodiment> A series of processes (processing in FIG. 13) related to the generation of attribute information is performed, for example, when a customer for whom no corresponding attribute information exists is served. The information processing device 2000 attempts to output output information for the served customer based on the functions described in the first embodiment. If attribute information associated with features highly similar to the features of the customer contained in the captured image is not stored in the storage device 10, the information processing device 2000 outputs the input screen 80 described above, etc. Then, the information processing device 2000 generates attribute information using the received input. According to this method, attribute information for a new customer is generated when the customer is served.

[0098] Alternatively, for example, a series of processes related to the generation of attribute information may be started in response to an operation by a store clerk. For example, a button for transitioning to the above-mentioned input screen 80 is displayed on a display device of a terminal operated by the store clerk (for example, a display device of a product registration device). The store clerk presses the button to display the input screen 80, where the store clerk can input information related to the customer's attributes or have the customer input information related to the attributes.

[0099] An input triggered by an operation of a store clerk is performed, for example, to update attribute information. For example, when serving a certain customer, the output information output by the output control unit 2040 indicates "point card owned: no", but the customer presents a point card. In this case, the store clerk displays the input screen 80 and inputs "point card owned: yes". In response to this input, the second generation unit 2100 generates attribute information "point card owned: yes", and stores the generated attribute information in the storage device 10 in place of the existing attribute information associated with the feature amount of the above customer. In other words, the second generation unit 2100 updates the attribute information using the input received by the input reception unit 2080.

[0100] <Hardware configuration> The hardware configuration of the computer realizing the information processing device 2000 of the third embodiment is shown in Fig. 3, for example, as in the first embodiment. However, the storage device 1080 of the computer 1000 realizing the information processing device 2000 of this embodiment further stores a program module realizing the functions of the information processing device 2000 of this embodiment.

[0101] <Actions and Effects> According to the information processing device 2000 of this embodiment, input regarding customer attributes is accepted, and attribute information is generated using the input. In this way, attribute information that predicts the future behavior and state of a customer can be generated based on the actual behavior and state of the customer. Therefore, customer attribute information can be generated with high accuracy. <Modification> The second generating unit 2100 can also generate attribute information using information input using a customer's mobile terminal. The customer inputs information related to the customer's attributes using the mobile terminal. The input receiving unit 2080 receives the information input using the customer's mobile terminal. The second generating unit 2100 generates attribute information using the input received by the input receiving unit 2080. This allows attribute information to be generated without the customer visiting the store.

[0102] Although the embodiments of the present invention have been described above with reference to the drawings, these are merely examples of the present invention, and it is also possible to adopt combinations of the above-described embodiments or various configurations other than those described above.

[0103] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes. 1. A calculation means for calculating a feature amount of a customer by using a captured image of the customer; an output control means for acquiring attribute information associated with a characteristic amount of a customer from a storage device that stores attribute information indicating whether the customer uses a service available to the customer in a store or whether the customer owns an item related to the service in association with the characteristic amount of the customer, and for outputting information based on the acquired attribute information; An information processing device having the above configuration. 2. An information processing device as described in 1., which has a generation means for generating the attribute information using historical information indicating the history of a customer's behavior or status regarding the use of a service, and storing the generated attribute information in the storage device in association with the customer's features contained in the acquired captured image. 3. The information processing device according to 2., wherein the generating means generates the attribute information using history information of each of a plurality of customers. 4. An input receiving means for receiving an input regarding the use of a service for a customer included in the captured image; a generating means for generating the attribute information based on the input received by the input receiving means, and storing the generated attribute information in the storage device in association with a feature amount of the customer included in the captured image; 1. The information processing device according to claim 1. 5. An information processing device according to any one of 1 to 4, wherein the storage device stores the attribute information in further association with a condition to which the attribute information is applied. 6. The attribute information indicates whether or not shopping bags are used, 6. The information processing device according to claim 5, wherein the condition to which the attribute information is applied is a condition related to the quantity of goods to be purchased. 7. The output control means further outputs a message to the customer asking whether or not the customer is using the service; An information processing device described in any one of 1. to 6., wherein a message output when the acquired attribute information indicates that the service will be used and a message output when the acquired attribute information indicates that the service will not be used are different from each other. 8. An information processing device described in any one of 1. to 7., connected to at least one of a display unit that displays the attribute information toward the customer and a display unit that displays the attribute information toward a store clerk.

[0104] 9. A computer-implemented control method comprising: a calculation step of calculating a feature amount of the customer using a captured image of the customer; and an output control step of acquiring attribute information associated with the customer's characteristics from a storage device that stores attribute information indicating whether the customer uses a service available to the customer at a store or whether the customer owns an item related to the use, in association with the customer's characteristics, and outputting information based on the acquired attribute information. 10. A control method as described in 9., comprising a generation step of generating the attribute information using historical information indicating the history of a customer's behavior or status regarding the use of a service, and storing the generated attribute information in the storage device in association with the customer's features contained in the acquired captured image. 11. The control method according to claim 10, wherein in the generating step, the attribute information is generated using history information of each of a plurality of customers. 12. An input receiving step of receiving an input regarding the use of a service for a customer included in the captured image; a generating step of generating the attribute information based on the input received in the input receiving step, and storing the generated attribute information in the storage device in association with a feature amount of the customer included in the captured image; 9. The control method according to claim 9. 13. The control method according to any one of 9. to 12., wherein the storage device stores the attribute information in further association with a condition to which the attribute information is applied. 14. The attribute information indicates whether or not shopping bags are used, 14. The control method according to claim 13, wherein the condition to which the attribute information is applied is a condition related to the quantity of goods purchased. 15. In the output control step, a message is further output to ask the customer whether or not he / she uses the service; A control method described in any one of 9. to 14., in which a message output when the acquired attribute information indicates that the service will be used and a message output when the acquired attribute information indicates that the service will not be used are different from each other. 16. A control method described in any one of 9. to 15., wherein the computer is connected to at least one of a display unit that displays the attribute information to the customer and a display unit that displays the attribute information to a store clerk.

[0105] 17. A program for causing a computer to execute each step of the control method described in any one of 9. to 16. [Explanation of symbols]

[0106] 10 Storage device 20 Camera 30. Store Clerk 40 customers 50 Cashier terminal 60 display screen 62 Windows 64 Buttons 66 Buttons 68 Windows 80 Input screen 82 Input Area 84 Input Area 500 Tables 502 Features 504 Attribute information 506 Applicable conditions 600 Tables 602 Features 604 History Information 606 Date 1000 calculator 1020 Bus 1040 Processor 1060 Memory 1080 Storage Device 1100 Input / Output Interface 1120 Network Interface 2000 Information processing equipment 2020 Calculation Department 2040 Output control section 2060 1st generation part 2080 Input reception section 2100 2nd generation section

Claims

1. An acquisition means for acquiring an image including a customer; A generating means for generating attribute information of the customer based on historical information of the customer; an output means for outputting attribute information corresponding to the customer identified by the image; Equipped with The attribute information includes information regarding the food and drink order that the customer places and receives. Information processing device.

2. The attribute information includes information regarding seasonings or toppings in the customer's food and beverage order. The information processing device according to claim 1 .

3. the output means outputs the attribute information at a timing when an order for food and drink from the customer is received.

3. The information processing device according to claim 1 or 2.

4. The attribute information includes information regarding the customer's use of shopping bags.

4. The information processing device according to claim 1.

5. The information processing apparatus according to claim 4 , wherein the output means outputs the attribute information of the customer in accordance with a condition related to an amount of merchandise purchased by the customer, which is applied to each of the attribute information of the customer.

6. The image is an image captured by a camera attached to the product registration device.

6. The information processing device according to claim 1.

7. The output means outputs the attribute information to a display device connected to the product registration device.

7. The information processing apparatus according to claim 1.

8. The product registration device is a device that can be operated by the customer.

8. The information processing device according to claim 6 or 7.

9. The attribute information includes information regarding the use of cutlery.

9. The information processing device according to claim 1.

10. The attribute information includes information regarding use of restaurants, 10. The information processing device according to claim 1.

11. The attribute information includes information indicating whether a smoking seat or a non-smoking seat is to be used. The information processing device according to claim 10.

12. The attribute information includes information indicating at least one of whether the customer desires a counter seat or a table seat and whether the customer desires a window seat.

12. The information processing device according to claim 10 or 11.

13. The attribute information includes information indicating whether or not the user owns a point card. The information processing device according to claim 1 .

14. The attribute information includes information indicating a payment method of the customer.

14. The information processing device according to claim 1.

15. The generating means generates the attribute information at the timing of performing a settlement process. The information processing device according to claim 14.

16. One or more computers Get an image containing the customer, generating attribute information of the customer based on historical information of the customer; outputting attribute information corresponding to the customer identified by the image; The attribute information includes information regarding the food and drink order that the customer places and receives. Control methods.

17. On the computer, an acquisition step of acquiring an image including the customer; A generation step of generating attribute information of the customer based on history information of the customer; an output step of outputting attribute information corresponding to the customer identified by the image; The attribute information includes information regarding the food and drink order that the customer places and receives. program.

Images