Sales data processing apparatus and non-transitory computer readable medium

Abstract

To provide a technique capable of providing optimum sales promotion information for each user.SOLUTION: A sales data processor constituted of a portable terminal for receiving the operation of a user who registers merchandise or a service provided in a store includes an acquisition part and a notification processing part. The acquisition unit acquires at least one of image data including a face image of the user and voice data including voice of the user. The notification processing unit notifies of recommendation information regarding the product, the service, or the store according to at least one of an attribute of the user estimated on the basis of at least one of the image data and the sound data acquired by the acquisition unit and position information of the user.SELECTED DRAWING: Figure 9

Description

[Technical Field]

[0001] An embodiment of the present invention relates to a sales data processing device and an information processing program. [Background technology]

[0002] In stores such as supermarkets, there is an increasing number of systems that allow users to register products themselves while walking around the store. These systems include, for example, shopping cart systems with product registration functions, and self-scanning systems that use mobile terminals owned by the user or mobile terminals prepared in advance by the store, etc. In this way, because users use terminals while shopping, an environment is being created in which information is provided to users while they are shopping.

[0003] Therefore, when shopping is carried out by a group including a plurality of users, it is being considered to provide optimal sales promotion information to each of the plurality of users on the same terminal. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Publication No. 2022-178576 Summary of the Invention [Problem to be solved by the invention]

[0005] The problem to be solved by the embodiments of the present invention is to provide a technology that can provide optimal sales promotion information for each user. [Means for solving the problem]

[0006] According to an embodiment, a sales data processing device including a mobile terminal that accepts user operations to register products or services offered at a store includes an acquisition unit and a notification processing unit. The acquisition unit acquires at least one of image data including a facial image of the user and audio data including audio of the user. The notification processing unit notifies the user of recommendation information related to the product, service, or store according to at least one of the user's attributes estimated based on at least one of the image data and audio data acquired by the acquisition unit and location information of the user. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a block diagram showing an outline of a configuration example of a store system according to an embodiment. [Figure 2] FIG. 2 is a block diagram illustrating an outline of a configuration example of a server according to the embodiment. [Figure 3] FIG. 3 is a block diagram illustrating an outline of a configuration example of a terminal according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of a data structure of user information according to the embodiment. [Figure 5] FIG. 5 is a diagram illustrating an example of a data structure of product information according to the embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of a data structure of transaction information according to the embodiment. [Figure 7] FIG. 7 is a diagram illustrating an example of a data structure of person estimation information according to the embodiment. [Figure 8] FIG. 8 is a diagram illustrating an example of a data structure of recommendation information according to the embodiment. [Figure 9] FIG. 9 is a sequence diagram illustrating an example of a procedure for information processing by the store system according to the embodiment. [Figure 10] FIG. 10 is a sequence diagram showing another example of the procedure of information processing by the store system according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0008] (Embodiment) Hereinafter, embodiments will be described with reference to the drawings. Note that the scale of each part in each drawing used in the following description of the embodiments may be changed as appropriate. Also, for the sake of explanation, each drawing used in the following description of the embodiments may omit components.

[0009] The following description will be given using an example of a store that sells products. The store is assumed to be a physical store. Products include not only tangible products but also non-tangible products such as services or tickets. Services are services provided to customers. The store may be a store that primarily sells tangible products, or a store that primarily sells the provision of services. For example, stores that primarily sell tangible products include, but are not limited to, convenience stores, supermarkets, and home improvement stores. For example, stores that primarily sell the provision of services include, but are not limited to, restaurants and sports gyms.

[0010] A product transaction is the transfer of costs from a customer to a store in connection with the sale of a product by the store. From the store's perspective, the transaction involves the sale of a product. From the customer's perspective, the transaction involves the purchase of a product.

[0011] (Configuration example) FIG. 1 is a block diagram showing an outline of an example of the configuration of a store system S. The store system S includes a server 1, an access point 2, a checkout device 3, and a mobile terminal 4. The server 1, access point 2, and checkout device 3 are connected to each other via a network NW so that they can communicate with each other. The network NW is a local area network (LAN) or the like. The LAN may be a wireless LAN or a wired LAN. While FIG. 1 shows one access point 2, the store system S may include multiple access points 2. While FIG. 1 shows one checkout device 3, the store system S may include multiple checkout devices 3. Although FIG. 1 shows one mobile terminal 4, the store system S may include multiple mobile terminals 4. The store system S may also refer to a system including at least two devices. The mobile terminal 4 is an example of a sales data processing device.

[0012] The server 1 is a device that processes information in a store. The server 1 may be, for example, a server used in a cloud service. The server 1 is an example of an information processing device. An example of the configuration of the server 1 will be described later.

[0013] The access point 2 is a device capable of wireless communication with the mobile terminal 4. The access point 2 relays communication between the server 1 and the mobile terminal 4.

[0014] The accounting device 3 is a device that processes the accounting of products registered by a user using a mobile terminal 4. Hereinafter, registered products are also referred to as registered products. Product registration is also referred to as product registration. Product registration refers to the processing of registering products that are the subject of a transaction. Products that are the subject of a transaction are also referred to as trading products. Product registration is the registration of a product as a trading product. For example, product registration includes adding data related to trading products to a product registration list. Data related to trading products is also referred to as trading product data. The product registration list may include trading product data for each trading product for one transaction. The trading product data is data about the details of the trading product. The trading product data may include a product code for the trading product. The product code for the trading product is identification information that can uniquely identify the trading product. The trading product data may include the price of the trading product. The price of the trading product is the price per unit of the trading product. The trading product data may include the number of trading products. The number of trading products is the number of trading products included in one transaction. For example, the product registration list is stored in a transaction management server that manages each transaction. The transaction management server may be the server 1 or another server. The product registration list is also called transaction information.

[0015] The products that are the subject of a transaction are also called products that are the subject of a transaction. The accounting device 3 can process offline transactions using cash. The accounting device 3 can also process online transactions using credit cards, debit cards, electronic money, code payments, points, etc.

[0016] The mobile terminal 4 is a device used by a user shopping at a store. The mobile terminal 4 is a device that accepts user operations to register products or services provided at the store. The mobile terminal 4 communicates wirelessly with the access point 2 and communicates with the server 1 via the access point 2. The mobile terminal 4 may also communicate with the server 1 via a network such as a mobile communication network or the Internet, without going through the access point 2. The mobile terminal 4 is mounted on a shopping cart CA. The shopping cart CA is an example of a vehicle for transporting products. The mobile terminal 4 is a tablet terminal, a smartphone, or the like, but is not limited to these. An example configuration of the mobile terminal 4 will be described later. Note that the mobile terminal 4 may not necessarily be mounted on the shopping cart CA, but may be held and operated by a user shopping at the store.

[0017] In the store system S described above, a user makes a purchase as follows: The user walks around the store with a shopping cart CA equipped with a mobile terminal 4. The user registers products using the mobile terminal 4. The user places the registered products in the shopping cart CA. After completing product registration, the user heads to the checkout device 3. The user pays for all registered products at the checkout device 3. Alternatively, for example, the mobile terminal 4 may pre-store one or more of the user's desired online non-cash payment methods (e.g., credit card payment, debit card payment, electronic money payment, code payment, or point payment using a point card). The mobile terminal 4 may then perform the checkout for the registered products upon receiving a user operation to perform the checkout using the payment method pre-stored on the mobile terminal 4. In this case, the user can complete the checkout for the registered products on the mobile terminal 4 instead of using the checkout device 3.

[0018] An example of the configuration of the server 1 will be described. FIG. 2 is a block diagram showing an outline of an example of the configuration of the server 1. As shown in FIG. The server 1 includes a processing circuit 10, a main memory 11, an auxiliary storage device 12, and a communication interface 13. In Fig. 2, the interface is indicated as "I / F".

[0019] The processing circuit 10 corresponds to the central part of the server 1. The processing circuit 10 is an element that constitutes the computer of the server 1. The processing circuit 10 includes one or more circuits that perform multiple processes based on multiple functions. For example, the circuit may be, but is not limited to, a processor, an ASIC (Application Specific Integrated Circuit), or an FPGA (Field-Programmable Gate Array). For example, the processor may be, but is not limited to, a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit). The processing circuit 10 loads a program that is pre-stored in the main memory 11 or the auxiliary storage device 12 into the main memory 11. The program is a program that can cause the processing circuit 10 to execute the processes of each unit realized by the processing circuit 10, which will be described later. The processing circuit 10 performs various processes by executing the program loaded into the main memory 11.

[0020] The main memory 11 includes elements corresponding to the main memory portion of the server 1. The main memory 11 is an element that constitutes the computer of the server 1. The main memory 11 includes a non-volatile memory area and a volatile memory area. The main memory 11 stores an operating system or a program in the non-volatile memory area. The main memory 11 uses the volatile memory area as a work area where data is rewritten as appropriate by the processing circuit 10. For example, the main memory 11 includes a ROM (Read Only Memory) as a non-volatile memory area. For example, the main memory 11 includes a RAM (Random Access Memory) as a volatile memory area.

[0021] The auxiliary storage device 12 corresponds to the auxiliary storage portion of the server 1. The auxiliary storage device 12 may be, but is not limited to, an EEPROM (registered trademark) (Electric Erasable Programmable Read-Only Memory), an HDD (Hard Disc Drive), an SSD (Solid State Drive), or a flash memory. The auxiliary storage device 12 stores the above-mentioned programs, data used by the processing circuit 10 to perform various processes, and data generated by the processes in the processing circuit 10. The auxiliary storage device 12 is an example of a storage portion of the server 1.

[0022] The auxiliary storage device 12 includes a user information storage area 121. The user information storage area 121 stores user information. The user information is a collection of user information records generated for each user.

[0023] The user information will be described with reference to FIG. The user information record includes information such as a user ID, a user name, attribute information, and family structure. The user ID is unique identification information assigned to each user to identify the user individually. The user ID is also referred to as user identification information. The user name is a name or nickname registered by the user. The attribute information is information indicating the user's attributes. The attribute information includes at least one piece of information, such as the user's gender and age. The attribute information may be, for example, information for dividing users into multiple categories. The category is, for example, a division for classifying users based on their purchasing tendencies. The category may be a division for classifying users who are the target of sales promotions. The category includes, for example, adults, men, women, children, girls, and boys. The term "category" may be read as "attributes." The term "attributes" may be read as "categories." The family structure may include information indicating the number of family members, family attributes, and the like. The family attributes include, for example, husband, wife, boys, and girls.

[0024] FIG. 4 shows, for example, that a user with user ID "0001" has the user name "A," an attribute "female," and a family structure of "husband, wife, son." The family structure may include information indicating the categories of family members. For example, the user information may include information indicating "male, female, son" as information on the family structure of the user with user ID "0001." The shopping group to which the user with user ID "0001" belongs can be estimated based on the family structure information. A shopping group is, for example, a group made up of users who shop together with a certain user. A shopping group is a group made up of multiple customers who shop at the same store at the same time. A shopping group is a group that includes at least one user who purchases a product that is paid for in the same transaction. A shopping group may include multiple users. For example, a case will be described in which a user with user ID "0001" visits store X with his son and shops. In this case, the user with user ID "0001" and the boy are users who belong to the same shopping group. The boy is a user in the shopping group to which the user with user ID "0001" belongs. The users in a shopping group refer to the members of the shopping group. Members are also called members. The users in a shopping group are also called users included in the shopping group. The users included in a shopping group are not limited to family members. For example, a shopping group may include friends, colleagues, etc. A shopping group is a group made up of multiple users who use the same mobile terminal 4.

[0025] The user information may include purchase history information. The purchase history includes information on products the user has purchased in the past, the date and time of the purchase, etc. The user information may also include point information. Points indicate benefits given to the user. Benefits are beneficial events provided to the user. The data in the user information storage area 121 is updated every time the data included in the user information is updated.

[0026] The auxiliary storage device 12 includes a product information storage area 122. The product information storage area 122 stores product information for each product. The product information is a collection of product information records generated for each product. The product information is also called a product master.

[0027] The product information will be described with reference to FIG. The product information record includes information such as a product code, product name, price, and location information. The product code is a code that can uniquely identify a product. The product code is also called product identification information. The product description is a description of the product set for each product. The product name is the name of the product set for each product. The price is the price per unit of the product. The location information is information that indicates the location of the product. The location information may be information that indicates the location where the product is displayed in a store. The location information may be information that indicates the location of a shelf where the product is displayed in a store. The location information may be information that indicates the location of an aisle facing the shelf where the product is displayed in a store. Product information can be set and updated by a store manager, etc. The data in the product information storage area 122 is updated every time the data included in the product information is updated.

[0028] 5, a product with product code "P0001" is linked to the product name "Tomato," the price "100" yen, and the location information "A001." The product with product code "P0001" is displayed on a shelf with shelf number "A001," for example.

[0029] The product information may include information indicating the product category. Product categories include, for example, fruits and vegetables, meat, dairy products, etc. The product category may also be a category related to the product display position or sales area in the store.

[0030] The auxiliary storage device 12 includes a transaction information storage area 123. The transaction information storage area 123 stores transaction information for each of a plurality of transactions. The transaction information is a collection of transaction information records generated for each transaction. A transaction is a transaction of goods based on the accounting of the goods. For example, the transaction information storage area 123 stores transaction information for one shopping group as transaction information for one transaction.

[0031] The transaction information will be described with reference to FIG. The transaction information record includes information indicating a transaction ID, shopping group ID, group composition, user, registered product information, price, and status. The transaction ID is unique identification information assigned to each transaction. The shopping group ID is unique identification information assigned to each shopping group. The group composition is information identifying users included in the shopping group. The group composition may be information indicating the usernames of users included in the shopping group. The group composition may be information indicating the attributes of users included in the shopping group. The information indicating the group composition may be updated when a user included in a shopping group is detected or when the attributes of a user included in a shopping group are estimated. The user information is information indicating the user currently using the mobile device 4. Usage includes performing a product registration operation. The user is also referred to as the current user or the present user. The user is a user included in the group composition. The user information is information that is updated each time the user using the mobile device 4 is changed. For example, if user "A" is using the mobile device 4, the user information indicates "A." When the user using the mobile terminal 4 changes from user "A" to user "B," the user information is updated from "A" to "B." The registered product information includes product information for the registered product. The product information for the registered product includes the product code, product name, quantity, etc. The price indicates the total price of the registered product. The registered product information can be updated based on user operations on the mobile terminal 4. The user operations include product registration operations such as registering a product, changing the quantity, and canceling.

[0032] The status indicates the state of the transaction. Examples of transaction states include: entered, unsettled, in checkout, and left. entered indicates the state from the start of use until the first product registration process is performed. unsettled indicates the state in which product registration process is being performed for a transaction made on the mobile terminal 4. in checkout indicates the state in which payment process is being performed for a transaction made on the mobile terminal 4. left indicates the state in which transaction process such as product registration process and payment process has been completed for a transaction made on the mobile terminal 4. The data in the transaction information storage area 123 is updated every time the data included in the transaction information is updated.

[0033] In the example of FIG. 6, the transaction with transaction ID "T0001" indicates that it is a transaction of the group with shopping group ID "G01." The group with shopping group ID "G01" includes "A, B, and C," the user is "A," and the status is "unsettled." For example, in the transaction with transaction ID "T0001," one of "A, B, and C" included in the group uses the mobile terminal 4. The shopping group may be set based on user information or may be set based on the operation of the user of the mobile terminal 4. Note that the group composition may be information indicating "male, female, and male child."

[0034] The auxiliary storage device 12 includes a person estimation information storage area 124. The person estimation information storage area 124 stores person estimation information. The person estimation information is information for estimating the attributes of a user. The person estimation information may also be information for estimating a category of a user.

[0035] The person estimation information will be described with reference to FIG. The person estimation information includes information indicating a judgment threshold for each attribute. The judgment threshold indicates, for example, a threshold for judging an attribute. The judgment threshold includes, for example, a threshold for audio judgment and a threshold for image judgment. The threshold for audio judgment is, for example, a threshold for a feature extracted from audio data. The threshold for image judgment is, for example, a threshold for a feature extracted from image data. The image data is, for example, face image data. The image data is not limited to face image data, but may be person image data including the whole body. The threshold for image judgment may be set according to the type of image data. The data in the person estimation information storage area 124 is updated every time the data included in the person estimation information is updated.

[0036] 7 shows person estimation information for estimating attributes based on at least one of audio feature amounts and image feature amounts. The person estimation information includes, for example, a determination threshold for each of the attributes "male, female, boy, girl."

[0037] The auxiliary storage device 12 includes a recommendation history information storage area 125. The recommendation history information storage area 125 stores recommendation history information. The recommendation history information indicates a history of notification of recommendation information to a user of the mobile terminal 4. The recommendation history information is a collection of recommendation history information records generated for each recommendation.

[0038] The recommendation history information will be described with reference to FIG. The recommendation history information record includes information indicating a recommendation ID, a trigger, attributes, and recommendation information. The recommendation ID is unique identification information assigned to each recommendation made to a user of the mobile terminal 4. The trigger indicates the event that triggered the recommendation. The trigger may indicate the timing at which the recommendation was made. The attributes indicate the attributes of the recommendation target user who made the recommendation. The recommendation target user indicates the user making the recommendation. The recommendation target user is, for example, the current user of the mobile terminal 4. The recommendation information indicates recommendation information notified to the recommendation target user. The recommendation information includes information regarding at least one of a recommended product, a recommended service, and a recommended event. The recommendation information may be sales promotion information. For example, the recommendation information is recommendation information regarding a product, recommendation information regarding a service, or recommendation information regarding a store. The recommendation information regarding a product is, for example, information indicating a recommended product. The service-related recommendation information is information indicating recommended services, and the store-related recommendation information is information indicating recommended events.

[0039] Recommended products may be set for each product location or each product category. Recommended products may be products set based on the user's location information. For example, if the user is in a vegetable section, recommended products may be products set based on the location information of the vegetable section. For example, if the user is in a tomato section, recommended products may be products displayed close to the tomatoes. If the user is in a tomato section, recommended products may be products in the same category as tomatoes. Recommended products may be products set based on the user's attribute information. For example, if the user's attribute is male, recommended products may be products that are often purchased by men. Recommended products may be products set based on the user's location information and the user's attribute information. For example, if the user's current location is in a tomato section and the user's attribute is male, recommended products may be products displayed close to the tomato section that is often purchased by men, or products in the same category as tomatoes.

[0040] The recommended service is, for example, information about services available at a store. Services include services that provide services such as reservation services and reservation services. The recommended service is a service that is set based on at least one of the user's location information and the user's attribute information. For example, if the user is in the pastry section, the recommended service may indicate a service for reserving a whole cake. For example, if User B is male, the recommended service may indicate services available to men.

[0041] A recommended event is, for example, information about an event at a store, a shopping mall, or the like. Events include events that offer special benefits such as sale days and double points days. Events include special events, sales, or the like. A recommended event is a service that is set based on at least one of the user's location information and the user's attribute information. For example, if the user is in the meat section, a recommended event may indicate a pork sale day. For example, if the user is male, a recommended service may indicate an event that is popular among men. The data in the recommendation history information storage area 125 is updated every time the data included in the recommendation history information is updated.

[0042] 8, for example, the recommendation history information of recommendation ID "R0001" indicates the trigger "tomato registration", the attribute "female", and the recommendation information "product XX". In this example, the current user of the mobile terminal 4 is "female", and based on the registration of a tomato by the current user of the mobile terminal 4, information indicating the recommended product "product XX" has been notified to the mobile terminal 4.

[0043] The auxiliary storage device 12 may store recommendation information. The recommendation information may include, for example, a product code of a recommended product. The recommendation information may include service identification information indicating a recommended service. The recommendation information may include event identification information indicating a recommended event. The recommendation information is information linked to at least one of the user's location information and the user's attributes.

[0044] The user's location information is, for example, location information of a product registered by the user of the mobile terminal 4. The user's location information may also be location information of the mobile terminal 4. If the store system S includes multiple cameras, the server 1 may acquire the location information of the mobile terminal 4 based on image capture data from the multiple cameras. The server 1 may acquire the location information of the mobile terminal 4 based on a beacon signal received by the mobile terminal 4. In this example, a transmitter that emits a beacon signal indicating the area is provided in each of multiple areas of the store. The areas are virtual regions divided by product category. The areas are areas for each product category, such as fruits, vegetables, seafood, or meat, but are not limited to these. The mobile terminal 4 receives a beacon signal emitted from a transmitter corresponding to the area in which the mobile terminal 4 is located. The server 1 may acquire the location information of the mobile terminal 4 based on a GPS signal received by the mobile terminal 4.

[0045] The recommendation information may be information set for each store. The recommendation information may be updated as appropriate.

[0046] The auxiliary storage device 12 may store map information for the store. The map shows multiple areas of the store. The map information may be updated as needed.

[0047] The communication interface 13 is an interface for connecting the server 1 to other devices so that they can communicate with each other. The communication interface 13 is an example of a communication unit of the server 1.

[0048] The hardware configuration of the server 1 is not limited to the above configuration, and the server 1 allows the omission or modification of the above components and the addition of new components as appropriate.

[0049] Each unit realized by the processing circuit 10 will be described. The processing circuit 10 realizes a communication processing unit 101, an estimation processing unit 102, a recommendation processing unit 103, and a product registration unit 104. Each unit realized by the processing circuit 10 can also be referred to as each function. Each unit realized by the processing circuit 10 can also be referred to as being realized in a control unit including the processing circuit 10 and a main memory 11.

[0050] The communication processing unit 101 processes communication with the mobile terminal 4 via the communication interface 13. The communication processing unit 101 outputs information to the mobile terminal 4 via the communication interface 13. The communication processing unit 101 acquires information from the mobile terminal 4 via the communication interface 13.

[0051] The communication processing unit 101 acquires at least one of image data and audio data from the mobile terminal 4 via the communication interface 13. The image data is, for example, image data of the user of the mobile terminal 4 photographed by the mobile terminal 4. The image data is, for example, image data including a facial image of the user of the mobile terminal 4 photographed by the mobile terminal 4. The audio data is, for example, audio data including the audio of the user of the mobile terminal 4 acquired by the mobile terminal 4, or audio data including the audio of a user present in the vicinity of the mobile terminal 4. The communication processing unit 101 outputs recommendation information to the mobile terminal 4 via the communication interface 13. The communication processing unit 101 acquires product information of the trading product from the mobile terminal 4 via the communication interface 13.

[0052] The estimation processing unit 102 estimates the attributes of the user of the mobile terminal 4 based on at least one of the image data and the audio data acquired by the communication processing unit 101. The estimation processing unit 102 estimates the attributes of the user of the mobile terminal 4 based on, for example, person estimation information stored in the person estimation information storage area 124. The estimation processing unit 102 may estimate the attributes of the user of the mobile terminal 4 using a learning model that estimates attributes from features extracted from the image data or the audio data. The learning model is, for example, configured by a neural network, and the estimation processing unit 102 performs deep learning with AI (artificial intelligence) using training data.

[0053] The estimation processing unit 102 may estimate the attributes of users who belong to the same shopping group. The estimation processing unit 102 may estimate the attributes of the user of the mobile terminal 4 based on at least one of image data and audio data and user information. For example, the estimation processing unit 102 may estimate, based on the user information, whether the attributes of the user estimated based on at least one of image data and audio data are the attributes of users who belong to the same shopping group. In one example, the estimation processing unit 102 may estimate the attributes of users who belong to the same shopping group based on information indicating the family structure of the user of the mobile terminal 4. A case will be described where the attribute of the user estimated based on at least one of image data and audio data is "male." The estimation processing unit 102 may estimate "male" as the attribute of users who belong to the same shopping group based on the fact that the family structure of the user of the mobile terminal 4 includes "male."

[0054] In another example, the estimation processing unit 102 may estimate the attribute of users belonging to the same shopping group based on information indicating the group composition of users of the mobile terminal 4. A case will be described where the attribute of a user estimated based on at least one of image data and audio data is "male." The estimation processing unit 102 may estimate "male" as the attribute of users belonging to the same shopping group based on the information indicating the group composition including "male."

[0055] The estimation processing unit 102 may estimate the attribute of a user based on at least one of image data and voice data and the content of the conversation. For example, the estimation processing unit 102 may analyze the content of the conversation from the voice data and estimate the attribute of users who belong to the same shopping group. A case will be described where the attribute of a user estimated based on at least one of image data and voice data is "boy." The estimation processing unit 102 may estimate "boy" as the attribute of users who belong to the same shopping group based on the fact that the content of the conversation indicates a conversation between a parent and a child. Note that the estimation processing unit 102 may estimate the attribute of users who belong to the same shopping group based on at least one of image data and voice data, user information, and the content of the conversation.

[0056] The estimation processing unit 102 may estimate attributes of users belonging to the same shopping group based on the directionality, intensity, or sound pressure of the sound. The estimation processing unit 102 may estimate the attributes of users belonging to the same shopping group based on the directivity, intensity, or sound pressure of the sound, and information indicating family composition, and based on at least one of image data and sound data. The estimation processing unit 102 may estimate the attributes of users belonging to the same shopping group based on at least one of image data and sound data, the directivity, intensity, or sound pressure of the sound, and user information. For example, a case will be described in which sound data belonging to "boy" is detected at a mobile device 4 with a higher intensity than other devices (when the intensity is equal to or greater than a predetermined value). If "boy" is included in the information indicating the family composition or the information indicating the group composition of the user of the mobile device 4, the estimation processing unit 102 may estimate "boy" as an attribute of users belonging to the same shopping group of the mobile device 4. For example, when the voice data includes the voice of a user using the mobile terminal 4 and the voice of another user using a mobile terminal different from the mobile terminal 4, the estimation processing unit 102 may estimate the attributes of users who belong to the same shopping group as the user using the mobile terminal 4 based on the directionality, intensity, or sound pressure of the voice.

[0057] The estimation processing unit 102 may determine that the estimated user attribute is an attribute of a user belonging to the same shopping group, based on an operation by the user of the mobile terminal 4. The user operation is, for example, an operation to input an instruction to determine the attribute.

[0058] The recommendation processing unit 103 extracts recommendation information according to at least one of the user attributes and the user location information estimated by the estimation processing unit 102. The recommendation processing unit 103 determines the recommendation information to be output to the mobile terminal 4 based on the recommendation information stored in the auxiliary storage device 12, for example.

[0059] The recommendation information may be recommendation information for users in a shopping group to which the user of the mobile terminal 4 belongs, which is estimated based on the voice data.

[0060] The recommendation processing unit 103 may extract recommendation information based on acquiring product information from the mobile terminal 4. The recommendation processing unit 103 may extract recommendation information based on a change in the attributes of the user of the mobile terminal 4. A change in the attributes of the user of the mobile terminal 4 includes the estimation by the estimation processing unit 102 of attributes different from the attributes of the previous user. The recommendation processing unit 103 may extract recommendation information based on the user of the mobile terminal 4 entering a specific area. The recommendation processing unit 103 acquires location information of the user of the mobile terminal 4 based on, for example, location information of a product. The recommendation processing unit 103 may extract recommendation information based on location information of the user of the mobile terminal 4. The recommendation processing unit 103 may extract recommendation information based on at least one of the following triggers: a product being registered by the user of the mobile terminal 4; an attribute of a user different from the previous user of the mobile terminal 4 being estimated; and the user of the mobile terminal 4 entering a specific area.

[0061] The product registration unit 104 handles the registration of one or more trading products.

[0062] An example of the configuration of the mobile terminal 4 will be described. FIG. 3 is a block diagram showing an outline of an example of the configuration of the mobile terminal 4. As shown in FIG. The mobile terminal 4 includes a processing circuit 40, a main memory 41, an auxiliary storage device 42, an input device 43, a display device 44, a photographing device 45, an audio input device 46, an audio output device 47, a communication interface 48, and a connection interface 49. In Fig. 3, the interface is indicated as "I / F".

[0063] The processing circuit 40 corresponds to the central part of the mobile terminal 4. The processing circuit 40 is an element that constitutes the computer of the mobile terminal 4. The processing circuit 40 has the same hardware configuration as the processing circuit 10 described above. The processing circuit 40 loads a program that is pre-stored in the main memory 41 or the auxiliary storage device 42 into the main memory 41. The program is a program that can cause the processing circuit 40 to execute the processing of each part realized by the processing circuit 40, which will be described later. The processing circuit 40 performs various processes by executing the program loaded into the main memory 41.

[0064] The main memory 41 includes elements corresponding to the main storage portion of the mobile terminal 4. The main memory 41 is an element that constitutes the computer of the mobile terminal 4. The main memory 41 has the same hardware configuration as the above-mentioned main memory 11. The main memory 41 stores programs.

[0065] The auxiliary storage device 42 corresponds to the auxiliary storage portion of the mobile terminal 4. The auxiliary storage device 42 is an element that constitutes the computer of the mobile terminal 4. The auxiliary storage device 42 has the same hardware configuration as the above-mentioned auxiliary storage device 12. The auxiliary storage device 42 stores the above-mentioned programs. The auxiliary storage device 42 is an example of a storage unit of the mobile terminal 4.

[0066] The input device 43 is a device that can input instructions based on user operations. The input device 43 may include a pressable button. The input device 43 may include a touch panel that is integrated with the display device 44. The input device 43 is an example of an input unit of the mobile terminal 4.

[0067] The display device 44 is a device capable of displaying various images. The display device 44 is, but is not limited to, a liquid crystal display or an organic EL (Electro Luminescence) display. The display device 44 is an example of a display unit of the mobile terminal 4.

[0068] The photographing device 45 is a device capable of acquiring image data by photographing. For example, the photographing device 45 is a camera.

[0069] The voice input device 46 is a device that can input voice. For example, the voice input device 46 is a microphone. The voice input device 46 is an example of an input unit of the mobile terminal 4.

[0070] The audio output device 47 is a device that can output audio. For example, the audio output device 47 is a speaker. The audio output device 47 is an example of an audio output unit of the mobile terminal 4.

[0071] The communication interface 48 includes an interface for connecting the mobile terminal 4 to other devices so that they can communicate with each other. The communication interface 48 may include an interface capable of receiving a beacon signal. The communication interface 48 may include an interface capable of receiving a GPS (Global Positioning System) signal. The communication interface 48 is an example of a communication unit of the mobile terminal 4.

[0072] The connection interface 49 is an interface to which a device can be connected. For example, the device is a scanner. The scanner is a device capable of reading information recorded on a code symbol such as a barcode symbol or a two-dimensional code symbol. The device may include a reader. The reader is a device that reads card data recorded on a card medium. The reader may include a contact reader that reads card data recorded on a magnetic stripe of the card medium. The reader may include a contactless reader that reads card data recorded on an IC (Integrated Circuit) tag of the card medium. The IC tag includes an IC chip and an antenna. The reader may include a writer function that records card data on the card medium.

[0073] The hardware configuration of the mobile terminal 4 is not limited to the above configuration. The mobile terminal 4 allows the above components to be omitted or changed, and new components to be added, as appropriate.

[0074] Each unit realized by the processing circuit 40 will be described below. The processing circuitry 40 realizes a communication processing unit 401, an acquisition unit 402, a notification processing unit 403, and an input processing unit 404. Each unit realized by the processing circuitry 40 can also be referred to as each function. Each unit realized by the processing circuitry 40 can also be referred to as being realized in a control unit including the processing circuitry 40 and the main memory 41.

[0075] The communication processing unit 401 processes communication with the server 1 via the communication interface 48. The communication processing unit 401 outputs information to the server 1 via the communication interface 48. The communication processing unit 401 acquires information from the server 1 via the communication interface 48.

[0076] The communication processing unit 401 outputs product information to the server 1 via the communication interface 48. The communication processing unit 401 outputs at least one of image data and audio data to the server 1 via the communication interface 48. The communication processing unit 401 acquires recommendation information from the server 1 via the communication interface 48.

[0077] The acquisition unit 402 acquires image data from the image capture device 45. The acquisition unit 402 acquires audio data from the audio input device .

[0078] The notification processing unit 403 notifies the user of the mobile terminal 4. For example, the notification processing unit 403 displays a recommendation information image based on the recommendation information on the display device 44. The notification processing unit 403 may output a sound based on the recommendation information via the audio output device 47. The notification processing unit 403 notifies the user of the mobile terminal 4, who is estimated based on the image data or audio data, of the recommendation information to any user in a shopping group made up of multiple users who use the same mobile terminal 4. When the audio data includes the audio of the user who uses the mobile terminal 4 and the audio of another user who uses a different mobile terminal from the mobile terminal 4, the notification processing unit 403 may notify the user of the mobile terminal 4 of the recommendation information estimated based on the directionality, intensity, or sound pressure of the audio.

[0079] The notification processing unit 403 notifies the recommendation information based on at least one of the following triggers: a product is registered by the user of the mobile terminal 4; attributes of another user different from the user of the mobile terminal 4 are estimated; and the user of the mobile terminal 4 enters a specific area.

[0080] The input processing unit 404 detects an input based on a user's operation via the input device 43 .

[0081] (Example of operation) The processing of the store system S will be described. In the following description focusing on the server 1, the server 1 may be read as the processing circuit 10. Similarly, in the following description focusing on the mobile terminal 4, the mobile terminal 4 may be read as the processing circuit 40. The processing procedures described below are merely examples, and each process may be modified as much as possible. Furthermore, steps may be omitted, replaced, or added as appropriate depending on the embodiment.

[0082] In the following process, it is assumed that user A (current user) of the mobile terminal 4 is shopping at store X and registering products on the mobile terminal 4. User A of the mobile terminal 4 may set up a shopping group in advance. For example, user A of the mobile terminal 4 can shop with multiple users belonging to the same shopping group using one or more carts. When user A of the mobile terminal 4 uses multiple carts with other users in the shopping group, the multiple carts may be grouped. For example, user A of the mobile terminal 4 sets up a shopping group by registering identification information for multiple mobile terminals 4 to be grouped. The identification information for the mobile terminal 4 may be a cart number, the IP address of the mobile terminal 4, etc. Products registered on multiple mobile terminals 4 grouped as a shopping group are processed collectively as a single transaction. The users of the multiple grouped mobile terminals 4 are members of the shopping group. In the following example, user A registers user B and user C, who are members of his family, as members of the shopping group.

[0083] User A of the mobile terminal 4 may register multiple users who use one mobile terminal 4 as users who make up a shopping group. For example, user A of the mobile terminal 4 and other users who make up the shopping group can shop using the same mobile terminal 4. User A can register, for example, user B and user C, who are members of his family, as members of the shopping group.

[0084] When a shopping group is set by user A of the mobile terminal 4, the mobile terminal 4 records information about the shopping group in the transaction information. The information about the shopping group is, for example, information indicating the group composition. The mobile terminal 4 may output transaction information including information indicating the group composition to the server 1 every time a shopping group is set. Note that the mobile terminal 4 may output information about the shopping group to the server 1 every time a shopping group is set. The server 1 may record information about the shopping group in the user information record of user A.

[0085] In the following example, it is assumed that user A is the user when he starts using the mobile terminal 4. User A goes shopping at store X with a shopping group that includes user A, user B, and user C. An example will be described in which user A is a woman, user B is a man, and user C is a boy. It is assumed that user A, user B, and user C go shopping using one mobile terminal 4.

[0086] 9 is a sequence diagram showing an example of the procedure of information processing by the store system according to the embodiment. In this example, a case will be described in which the current user of the mobile terminal 4 is estimated based on image data. Estimating the current user includes estimating that the user of the mobile terminal 4 has changed.

[0087] User A performs a login operation. For example, User A logs in by obtaining a login code indicated by a barcode, two-dimensional code, or the like installed at the entrance of Store X. The user of the mobile terminal 4 logs in via a login device installed at the entrance of Store X. For example, when the user starts a dedicated application program on the mobile terminal 4, a barcode, two-dimensional code, or the like representing the member ID is displayed on the display device 44. The user reads the member ID via the login device and logs in. Logging in is also called checking in. The member ID is, for example, unique identification information assigned to members of Store X. The member ID may also be a user ID.

[0088] The processing circuit 40 of the mobile terminal 4 performs a login process (ACT1). The process of ACT1 may be a process by the communication processing unit 401 realized by the processing circuit 40. In ACT1, for example, the processing circuit 40 acquires login information based on a login operation by user A. The login information may include the user ID of the mobile terminal 4, the terminal ID of the mobile terminal 4, etc. The processing circuit 40 outputs the login information to the server 1 via the communication interface 48. The login may be performed by a known process.

[0089] The processing circuit 10 of the server 1 acquires login information from the mobile terminal 4 via the communication interface 13. Based on the login information, the processing circuit 10 acquires the user information of user A stored in the user information storage area 121 (ACT11).

[0090] The processing circuit 10 identifies the current user of the portable terminal 4 based on the user information (ACT12). The processing of ACT12 may be processing by the estimation processing unit 102 realized by the processing circuit 10. In ACT12, for example, the processing circuit 10 identifies the current user of the portable terminal 4 based on the user name linked to the user ID, attribute information, etc. The processing circuit 10 may also identify the attributes of the current user of the portable terminal 4. The processing circuit 10 may determine the attributes of user A based on image data of user A captured by the portable terminal 4. The processing circuit 10 may also determine the attributes of user A based on voice data of user A acquired by the portable terminal 4.

[0091] User A performs a product registration operation for one or more trading products using the mobile terminal 4. The product registration operation includes, for example, an operation of reading a code symbol attached to the product via a scanner. The product registration operation may also include an operation of selecting a product registration button on a product registration image by touch input or the like.

[0092] The processing circuit 40 of the mobile terminal 4 acquires product information of the transaction product based on the product registration operation by user A (ACT2). The product information is, for example, a product code. ACT2 may be processing by the acquisition unit 402 realized by the processing circuit 40. In ACT2, for example, the processing circuit 40 acquires the product code recorded in the code symbol. The processing circuit 40 outputs the product code to the server 1 via the communication interface 48.

[0093] The processing circuit 10 of the server 1 acquires a product code via the communication interface 13. The processing circuit 10 performs product registration processing (ACT13). ACT13 may be processing by the product registration unit 104 realized by the processing circuit 10. In ACT13, for example, the processing circuit 10 refers to the product information stored in the product information storage area 122 and acquires trading product data for the product corresponding to the product code. The trading product data includes data such as the product code, product name, product price, and product quantity. The product corresponding to the product code is also referred to as the trading product.

[0094] The mobile terminal 4 may refer to the product information stored in the auxiliary storage device 42 and acquire trading product data for the product corresponding to the product code. In this case, the mobile terminal 4 may output the trading product data for the trading product to the server 1. The server 1 may perform product registration processing based on the trading product data.

[0095] When performing product registration processing, the mobile terminal 4 may associate information indicating a registrant with the registered product information.When performing product registration processing, the mobile terminal 4 may associate information indicating a registered group with the registered product information.

[0096] Based on the completion of the product registration process, the server 1 outputs a registration completion notification to the mobile terminal 4 via the communication interface 13. The mobile terminal 4 receives the registration completion notification via the communication interface 48. The mobile terminal 4 may display a notification indicating that the product registration has been completed on the display device 44.

[0097] It is assumed that the current user of the mobile terminal 4 has changed from user A to user B. The photographing device 45 of the portable terminal 4 takes an image of user B. For example, the photographing device 45 takes an image of user B's face. The processing circuit 40 acquires image data photographed by the photographing device 45 (ACT3). ACT3 may be processing by the acquisition unit 402 realized by the processing circuit 40. The processing circuit 40 outputs the image data to the server 1 via the communication interface 48. Note that the processing circuit 40 may output the image data to the server 1 based on the photographing device 45 having taken an image of another user different from user A (previous user). The other user different from the previous user of the portable terminal 4 is also referred to as the current user. The current user is an example of a user in a group to which the previous user belongs.

[0098] The server 1 acquires image data from the mobile terminal 4 via the communication interface 13. The processing circuit 10 of the server 1 estimates the attributes of the current user based on the image data (ACT14). ACT14 may be processing by the estimation processing unit 102 realized by the processing circuit 10. In ACT14, for example, the processing circuit 10 refers to the person estimation information stored in the person estimation information storage area 124 and estimates the attributes of the user corresponding to the image data. For example, the processing circuit 10 compares the feature amount of the image data with an image determination threshold included in the person estimation information and estimates the attributes of the user corresponding to the image data. In this example, the processing circuit 10 estimates that the attribute of user B is "male" based on the feature amount of the facial image data of user B.

[0099] The processing circuit 10 may estimate the attribute of user B based on the image data and the user information of user A. The processing circuit 10 may refer to the user information of user A and estimate the attribute of user B based on the image data and information indicating the family structure. The processing circuit 10 may refer to the transaction information of the mobile terminal 4 and estimate the attribute of user B based on the image data and information indicating the group structure. A case will be described in which the attribute estimated from the image data is "male." For example, the processing circuit 10 refers to the user information of user A. The processing circuit 10 determines whether the family members include a "male" based on the information indicating the family structure. If the family members include a "male," the processing circuit 10 may estimate the attribute of user B to be "male" as an attribute of a user belonging to the same shopping group as user A. For example, the processing circuit 10 refers to the transaction information of the mobile terminal 4. The processing circuit 10 determines whether the shopping group members include a "male" based on the information indicating the group structure. If the members of the shopping group include "male," processing circuit 10 may infer that the attribute of user B is "male" as an attribute of a user who belongs to the same shopping group as user A. Processing circuit 10 infers that the attribute of user B ("male") is an attribute of the current user of mobile terminal 4. A user who belongs to the same shopping group as user A is an example of a user in the group to which the user of mobile terminal 4 belongs.

[0100] The processing circuit 10 may add user B, who is estimated as the current user, to the information indicating the group composition. For example, the processing circuit 10 may output information indicating the attributes of user B to the server 1. The server 1 may add the information indicating the attributes of user B to the information indicating the group composition of the transaction information of the mobile terminal 4. The server 1 updates the information indicating the group composition based on the estimation of a new attribute as an attribute of a member of the shopping group.

[0101] The processing circuit 10 performs recommendation processing (ACT15). ACT15 may be processing by the recommendation processing unit 103 realized by the processing circuit 10. The processing circuit 10 performs recommendation processing based on the estimated attributes of another user (user B) different from the user (user A) of the mobile terminal 4. The user (user A) of the mobile terminal 4 is also referred to as the previous user of the mobile terminal 4. The other user is also referred to as the current user of the mobile terminal 4. In this example, the current user (user B) of the mobile terminal 4 is an example of another user different from the user (previous user) of the mobile terminal 4.

[0102] In one example, the processing circuit 10 performs recommendation processing based on the estimated attributes of the current user of the mobile terminal 4. For example, the processing circuit 10 acquires recommendation information corresponding to the attributes of the current user based on the recommendation information stored in the auxiliary storage device 12. A case will be described where the attribute of the current user is estimated to be "male." For example, the processing circuit 10 acquires information on recommended products associated with "male" as recommendation information.

[0103] In another example, the processing circuit 10 may perform the recommendation process based on the location information of the mobile terminal 4. The location information of the mobile terminal 4 is an example of location information of the user of the mobile terminal 4. For example, the processing circuit 10 may determine the location information of the mobile terminal 4 based on product information acquired immediately before performing the recommendation process. In this example, for example, the processing circuit 10 may determine the location information of the mobile terminal 4 based on the location information of the trading product registered in ACT13. A case will be described in which the trading product registered in ACT13 is "tomato." The processing circuit 10 acquires the location information of "tomato" based on the product information stored in the product information storage area 122. The processing circuit 10 may determine the location information of "tomato" as the location information of the mobile terminal 4. For example, the processing circuit 10 acquires information about recommended products linked to the location information of "tomato" as recommendation information. Based on the location information of "tomato," the processing circuit 10 may acquire information about products displayed in a position close to the location of "tomato" as recommended product information. The processing circuit 10 may determine the location information of the mobile terminal 4 based on the location information acquired from the mobile terminal 4.

[0104] In yet another example, the processing circuit 10 may perform recommendation processing based on the estimated attribute of the current user and the location information of the mobile terminal 4. A case will be described in which the attribute of the current user is estimated to be "male" and the trading product registered in ACT 13 is "tomato." For example, the processing circuit 10 may acquire, as recommendation information, information on a recommended product linked to the location information of "tomato" from among the recommended products linked to "male."

[0105] The processing circuit 10 may determine the recommendation information by referring to the product information stored in the auxiliary storage device 12. For example, the processing circuit 10 stores at least one of product location information and recommended attribute information in the product information. The recommended attribute information is, for example, information indicating an attribute set as a recommended product. For example, if "avocado" is set as a recommended product for "male," the recommended attribute information of the product "avocado" may indicate "male." In this case, the processing circuit 10 may refer to the product information and acquire the recommendation information based on at least one of the estimated user attribute and the location information of the mobile terminal 4. A case will be described in which the user attribute is estimated to be "male" and the trading product registered in ACT13 is "tomato." For example, the processing circuit 10 acquires, as recommendation information, the product "avocado," which is close to the location of "tomato" and for which "male" is the recommended attribute information.

[0106] Note that the processing circuitry 10 may acquire at least one of a recommended service or a recommended event as recommendation information instead of or in addition to a recommended product.

[0107] The processing circuit 10 updates the recommendation information stored in the recommendation history information storage area 125. For example, the processing circuit 10 records information indicating that a recommendation has been made in the recommendation history information storage area 125. The processing circuit 10 records that the user of the mobile terminal 4 has been changed as the event that triggered the recommendation. For example, the processing circuit 10 records "user change" in the trigger field. The processing circuit 10 records the attribute of the changed user, "male," in the attribute field. The processing circuit 10 records information about the recommended product, "avocado," in the recommendation information field.

[0108] The processing circuitry 10 outputs the recommendation information to the mobile terminal 4 via the communication interface 13. The processing circuitry 40 of the mobile terminal 4 acquires the recommendation information via the communication interface .

[0109] The processing circuitry 40 of the mobile terminal 4 notifies the current user of the mobile terminal 4 of the recommendation information based on the recommendation information (ACT4). ACT4 may be processing by the notification processing unit 403 realized by the processing circuitry 40. In ACT4, the processing circuitry 40 displays a notification on the display device 44, for example. The notification is a message including the recommendation information. The notification may include a message such as "Avocado is recommended." The notification is not limited to text data, and may include image data or video data. The processing circuitry 40 may output the notification as audio via the audio output device 47.

[0110] In addition, the processing circuit 10 of the server 1 may perform a recommendation process for the current user (user A) of the mobile terminal 4 based on the registration of the trading product in ACT13. In this example, the processing circuit 10 may, for example, acquire location information of the mobile terminal 4 based on location information of the registered product. The processing circuit 10 may acquire information on the recommended product as recommendation information based on the location information of the mobile terminal 4. The processing circuit 10 may acquire information on the recommended product as recommendation information based on the attributes of the user of the mobile terminal 4 identified in ACT12. The processing circuit 10 may acquire information on the recommended product as recommendation information based on the location information of the mobile terminal 4 and the attributes of the user of the mobile terminal 4.

[0111] The mobile terminal 4 may acquire voice data in addition to the image data in ACT3. The processing circuit 40 of the mobile terminal 4 outputs the voice data and the image data to the server 1 via the communication interface 48. The server 1 may estimate the attributes of the added user based on the voice data and the image data. According to this example, the server 1 can estimate the user's attributes based on the voice data and the image data, thereby improving the accuracy of attribute estimation.

[0112] According to this example, the mobile terminal 4 acquires voice data and can notify the user of recommendation information based on at least one of the attributes of a user different from the previous user of the mobile terminal 4, estimated based on the voice data, and the location information of the mobile terminal 4. Therefore, the mobile terminal 4 can notify the user different from the user who registered the product using the mobile terminal 4 of recommendation information based on the attributes. This allows the mobile terminal 4 to provide optimal sales promotion information to other users in the shopping group to which the user using the mobile terminal 4 belongs. Furthermore, the mobile terminal 4 can notify the user of recommendation information based on the location information of the mobile terminal 4. Therefore, the mobile terminal 4 can notify the user of the mobile terminal 4 of recommendation information about products, etc., displayed near the user of the mobile terminal 4. For example, the mobile terminal 4 can increase the user's desire to purchase by recommending products that are easily accessible to the user of the mobile terminal 4 as recommended products. In this way, the mobile terminal 4 can provide optimal sales promotion information for each user.

[0113] Furthermore, the mobile terminal 4 can notify the user of the mobile terminal 4 of recommended information based on the registration of a product by the user of the mobile terminal 4. Therefore, the mobile terminal 4 can recommend products that are displayed in a position close to the position of the registered product in real time. This allows the mobile terminal 4 to provide optimal sales promotion information for each user.

[0114] The mobile terminal 4 can notify a user of recommendation information that is estimated based on image data and is a user in a group to which the user of the mobile terminal 4 belongs. For example, if the attributes of a user estimated based on image data are the attributes of a user in a group to which the user of the mobile terminal 4 belongs, the mobile terminal 4 estimates the user as the current user of the mobile terminal 4 and notifies the current user of recommendation information. For example, if the attributes of the estimated user are estimated to be the attributes of a user in a group to which the user of the mobile terminal 4 belongs based on information indicating the family structure of the user of the mobile terminal 4 or information indicating the members of a shopping group, the mobile terminal 4 notifies the user of recommendation information. Therefore, the mobile terminal 4 can notify the user of recommendation information only if the estimated user attributes are the attributes of the members of the shopping group to which the user of the mobile terminal 4 belongs. This allows the mobile terminal 4 to reliably notify users in the shopping group of recommendation information. In this way, the mobile terminal 4 can provide optimal promotional information for each user.

[0115] 10 is a sequence diagram showing another example of the procedure of information processing by the store system according to the embodiment. In this example, a case will be described in which attributes of the user of the mobile terminal 4 are estimated based on voice data.

[0116] 9, the processing circuit 40 of the mobile terminal 4 performs login processing based on the login operation of the user A. It is assumed that the user A is using the mobile terminal 4 to register a product.

[0117] User A converses with user C who belongs to the shopping group. The voice input device 46 of the mobile terminal 4 acquires the conversation voice between user A and user C. The processing circuit 40 acquires voice data from the conversation voice acquired by the voice input device 46 (ACT101). ACT101 may be processing by the acquisition unit 402 realized by the processing circuit 40. The processing circuit 40 may acquire voice data of the conversation voice between user A and user C, or may acquire voice data of the voice of user C. The processing circuit 40 outputs the voice data to the server 1 via the communication interface 48. For example, the processing circuit 40 outputs the voice data to the server 1 via the communication interface 48. Note that the processing circuit 40 may output the voice data to the server 1 based on the fact that the voice input device 46 has acquired the voice of a user with attributes different from user A (the current user). A user with attributes different from the previous user is also referred to as an additional user. The additional user is an example of another user different from the user (the current user) of the mobile terminal 4. The additional user is an example of a user in a group to which the current user belongs.

[0118] The server 1 acquires the voice data from the mobile terminal 4 via the communication interface 13. The processing circuit 10 of the server 1 estimates attributes of the added user based on the voice data (ACT111). ACT111 may be processing by the estimation processing unit 102 realized by the processing circuit 10. In ACT111, for example, the processing circuit 10 refers to the person estimation information stored in the person estimation information storage area 124 and estimates the attributes of the user corresponding to the voice data. The processing circuit 10 compares the feature amount of the voice data with a voice determination threshold included in the person estimation information and estimates the attributes of the user corresponding to the voice data. For example, the processing circuit 10 may process the voice data including the voices of users A and C to remove voice data corresponding to the attributes of the previous user. The processing circuit 10 may estimate the attributes of the user corresponding to the voice data based on the processed voice data. In this example, the processing circuit 10 estimates that the attribute of user C is "boy" based on the feature amount of user C's voice data.

[0119] The processing circuit 10 may estimate the attribute of user C based on the voice data and the user information of user A. The processing circuit 10 may refer to the user information of user A and estimate the attribute of user C based on the voice data and information indicating a family structure. The processing circuit 10 may refer to the transaction information of the mobile terminal 4 and estimate the attribute of user C based on the voice data and information indicating a group structure. A case will be described in which the attribute estimated from the voice data is "boy." For example, the processing circuit 10 refers to the user information of user A. The processing circuit 10 determines whether the family members include a "boy" based on the information indicating the family structure. If the family members include a "boy," the processing circuit 10 may estimate the attribute of user C to be "male" as an attribute of a user belonging to the same shopping group as user A. For example, the processing circuit 10 refers to the transaction information of the mobile terminal 4. The processing circuit 10 determines whether the shopping group members include a "boy" based on the information indicating the group structure. If the members of the shopping group include a "boy," the processing circuit 10 may infer that the attribute of user C is "boy" as an attribute of a user who belongs to the same shopping group as user A. The processing circuit 10 infers user C ("boy") as a member of the shopping group of mobile terminal 4. User C who belongs to the same shopping group as user A is an example of a user in the group to which the user of mobile terminal 4 belongs.

[0120] If the attribute estimated from the voice data is not included in the information indicating the family structure or the information indicating the group structure, the processing circuit 10 may determine that the estimated attribute is not an attribute of a user in the group to which the current user of the mobile terminal 4 belongs. In this case, the processing circuit 10 may terminate the processing.

[0121] The processing circuit 10 may estimate the attributes of user C based on the content of the conversation included in the voice data. For example, the processing circuit 10 may perform voice recognition processing on the voice data to recognize the content of the conversation. For example, if the content of the conversation is a conversation between a parent and a child, the processing circuit 10 may estimate the attributes of user C as the attributes of a user in a group to which the current user of the mobile terminal 4 (user A) belongs. Note that the content of the conversation is not limited to a conversation between a parent and a child, and may indicate a conversation between members of a shopping group. The processing circuit 10 may estimate the attributes of the additional user estimated from the voice data as the attributes of a user in a group to which the current user of the mobile terminal 4 belongs, based on the fact that the content of the conversation is a conversation within a shopping group.

[0122] The processing circuit 10 may estimate the attribute of the added user based on the directivity, intensity, or sound pressure of the sound. For example, if the intensity of the sound data is equal to or greater than a predetermined value, the processing circuit 10 may estimate the attribute of user C as the attribute of a user in the group to which the current user of the mobile terminal 4 (user A) belongs.

[0123] The processing circuit 10 outputs the estimated information to the mobile terminal 4 via the communication interface 13. The estimated information includes, for example, information indicating the estimated attributes of the user.

[0124] The processing circuit 40 of the mobile terminal 4 acquires the estimated information from the server 1 via the communication interface 48. The processing circuit 40 displays the estimated information on the display device 44 (ACT102). ACT102 may be processing by the notification processing unit 403 realized by the processing circuit 40. In ACT102, for example, the processing circuit 40 creates estimated information notification image data based on the estimated information. The estimated information notification image includes a message indicating the estimated information. The message indicating the estimated information includes a message indicating the attributes of the added user estimated by the server 1. The message indicating the estimated information may include a message inquiring whether the attributes of the added user estimated by the server 1 are the attributes of a user in the group to which the current user belongs. The message indicating the estimated information may be, for example, "A boy has been detected as an added user. Is he a member of the group?" The estimated information notification image may include a confirm button. The confirm button is, for example, an operator that allows the current user of the mobile terminal 4 to input an instruction to confirm that the estimated attributes of the added user are the attributes of a user in the group to which the current user belongs. The estimated information notification image may include a "Yes" button and a "No" button instead of the confirmation button. The "Yes" button is an operator that allows the current user of the mobile terminal 4 to input an instruction to confirm that the estimated attributes of the additional user are the attributes of a user in the group to which the current user belongs. The "No" button is an operator that allows the current user of the mobile terminal 4 to input an instruction not to confirm that the estimated attributes of the additional user are the attributes of a user in the group to which the current user belongs.

[0125] The user of the mobile terminal 4 operates the confirm button in accordance with the estimated information notification image displayed on the display device 44 to confirm the attributes of the estimated additional user as the attributes of a user in the group to which the current user belongs. The operation of the confirm button is also called a person confirmation operation.

[0126] The processing circuit 40 of the portable terminal 4 acquires a person confirmation instruction based on the person confirmation operation of the current user (ACT103). ACT103 may be processing by the input processing unit 404 realized by the processing circuit 40. In ACT103, for example, the processing circuit 40 acquires the person confirmation instruction based on the current user of the portable terminal 4 selecting the Confirm button or the "Yes" button. The processing circuit 40 outputs the person confirmation instruction to the server 1 via the communication interface 48.

[0127] The processing circuitry 40 of the portable terminal 4 may output a person non-confirmation instruction to the server 1 via the communication interface 48 based on the current user of the portable terminal 4 selecting the "No" button. The person non-confirmation instruction is an instruction not to confirm the attributes of the added user estimated by the server 1 as the attributes of the users in the group to which the current user belongs. The server 1 may end the processing based on receiving the person non-confirmation instruction.

[0128] The processing circuit 10 of the server 1 receives the person determination instruction via the communication interface 13. The processing circuit 10 updates the information indicating the group composition based on the person determination instruction (ACT112). ACT112 may be processing by the estimation processing unit 102 implemented by the processing circuit 10. In ACT112, for example, the processing circuit 10 determines the estimated attributes of the additional user based on the person determination instruction as the attributes of the users in the group to which the current user belongs. For example, the processing circuit 10 may add information indicating the attributes of user C to the information indicating the group composition of the transaction information of the mobile terminal 4.

[0129] User A uses the mobile terminal 4 to perform product registration operations for one or more trading products. Similar to ACT12, the processing circuit 40 of the mobile terminal 4 acquires product information of the transaction product based on the product registration operation by user A (ACT104). ACT104 may be processing by the acquisition unit 402 realized by the processing circuit 40. The processing circuit 40 outputs the product code to the server 1 via the communication interface 48.

[0130] The processing circuit 10 of the server 1 acquires the product code via the communication interface 13. The processing circuit 10 performs a product registration process (ACT113) similar to ACT13. ACT113 may be a process performed by the product registration unit 104 realized by the processing circuit 10.

[0131] The mobile terminal 4 may refer to the product information stored in the auxiliary storage device 42 and acquire trading product data for the product corresponding to the product code. In this case, the mobile terminal 4 may output the trading product data for the trading product to the server 1. The server 1 may perform product registration processing based on the trading product data.

[0132] Based on the completion of the product registration process, the server 1 outputs a registration completion notification to the mobile terminal 4 via the communication interface 13. The mobile terminal 4 receives the registration completion notification via the communication interface 48. The mobile terminal 4 may display a notification indicating that the product registration has been completed on the display device 44.

[0133] The processing circuit 10 performs recommendation processing (ACT114). ACT114 may be processing by the recommendation processing unit 103 realized by the processing circuit 10. The processing circuit 10 performs recommendation processing based on the fact that a trading product has been registered by the current user (user A) of the mobile terminal 4.

[0134] In one example, the processing circuit 10 performs recommendation processing based on the attributes of the added user. For example, the processing circuit 10 acquires recommendation information corresponding to the attributes of the added user based on the recommendation information stored in the auxiliary storage device 12. A case will be described where the attribute of the added user is "boy." For example, the processing circuit 10 acquires information on recommended products linked to "boy" as recommendation information.

[0135] In another example, the processing circuit 10 may perform the recommendation process based on the location information of the mobile terminal 4. For example, the processing circuit 10 may determine the location information of the mobile terminal 4 based on product information acquired immediately before performing the recommendation process. In this example, for example, the processing circuit 10 may determine the location information of the mobile terminal 4 based on the location information of the transaction product registered in ACT113. A case will be described in which the transaction product registered in ACT113 is a "rice cracker." The processing circuit 10 acquires the location information of the "rice cracker" based on the product information stored in the product information storage area 122. The processing circuit 10 may determine the location information of the "rice cracker" as the location information of the mobile terminal 4. For example, the processing circuit 10 acquires information on recommended products linked to the location information of the "rice cracker" as recommendation information. Based on the location information of the "rice cracker," the processing circuit 10 may acquire information on products displayed near the location of the "rice cracker" as information on recommended products. Note that the processing circuit 10 may determine the location information of the mobile terminal 4 based on location information acquired from the mobile terminal 4.

[0136] In yet another example, the processing circuit 10 may perform recommendation processing based on the estimated attribute of the added user and the location information of the mobile terminal 4. A case will be described in which the estimated attribute of the added user is "boy" and the transaction product registered in ACT113 is "rice crackers." For example, the processing circuit 10 may acquire, as recommendation information, information on a recommended product (e.g., snacks) that is linked to the location information of "rice crackers" from among the recommended products linked to "boy."

[0137] The processing circuit 10 may refer to the product information stored in the auxiliary storage device 12 to determine the recommendation information.

[0138] Note that the processing circuitry 10 may acquire at least one of a recommended service or a recommended event as recommendation information instead of or in addition to a recommended product.

[0139] The processing circuit 10 updates the recommendation information stored in the recommendation history information storage area 125. For example, the processing circuit 10 records information indicating that a recommendation has been made in the recommendation history information storage area 125. The processing circuit 10 records the detection of an additional user as a member of a shopping group as the event that triggered the recommendation. For example, the processing circuit 10 records "additional member detection" in the trigger field. The processing circuit 10 records the attribute "boy" of the additional user in the attribute field. The processing circuit 10 records information about the recommended product, "snacks," in the recommendation information field.

[0140] The processing circuitry 10 outputs the recommendation information to the mobile terminal 4 via the communication interface 13. The processing circuitry 40 of the mobile terminal 4 acquires the recommendation information via the communication interface .

[0141] Similar to ACT4, the processing circuit 40 of the mobile terminal 4 notifies the additional user of the recommendation information based on the recommendation information (ACT105). ACT105 may be processing by the notification processing unit 403 realized by the processing circuit 40. In ACT105, the processing circuit 40 displays a notification on the display device 44, for example. The notification may include a message such as "We recommend some snacks." The notification is not limited to text data, and may include image data or video data. The processing circuit 40 may output the notification as audio via the audio output device 47.

[0142] According to this example, the mobile terminal 4 acquires voice data and can notify the user of recommendation information regarding products, services, or stores based on at least one of the attributes of the added user estimated based on the voice data and the location information of the mobile terminal 4. Therefore, the mobile terminal 4 can notify other users, other than the user who registers the product using the mobile terminal 4, of recommendation information based on the attributes. This allows the mobile terminal 4 to provide optimal promotional information to any user in a shopping group consisting of multiple users who use the same mobile terminal 4 as the user who uses the mobile terminal 4. Furthermore, the mobile terminal 4 can notify the user of the mobile terminal 4 of recommendation information based on the location information of the mobile terminal 4. Therefore, the mobile terminal 4 can notify the user of the mobile terminal 4 of recommendation information regarding products, etc., displayed near the user. For example, the mobile terminal 4 can increase the user's desire to purchase by recommending products that are easily accessible to the user of the mobile terminal 4 as recommended products. In this way, the mobile terminal 4 can provide optimal promotional information for each user.

[0143] Furthermore, the mobile terminal 4 can notify the user of the mobile terminal 4 of recommended information based on the registration of a product by the user of the mobile terminal 4. Therefore, the mobile terminal 4 can recommend products that are displayed in a position close to the position of the registered product in real time. This allows the mobile terminal 4 to provide optimal sales promotion information for each user.

[0144] The mobile terminal 4 can notify the user of recommendation information that is estimated based on the voice data and is one of users in a group consisting of multiple users who use the same mobile terminal 4. For example, if the attributes of a user estimated based on the voice data are the attributes of a user in a group to which the user of the mobile terminal 4 belongs, the mobile terminal 4 estimates the attributes of the user as the attributes of the added user and notifies the recommended information to the added user. In one example, if the attributes of a user estimated based on the content of a conversation included in the voice data are the attributes of a user in a group to which the user of the mobile terminal 4 belongs, the mobile terminal 4 estimates the attributes of the user as the attributes of the added user and notifies the recommended information to the added user. In another example, if the attributes of a user estimated based on information indicating the family structure of the user of the mobile terminal 4 or information indicating the members of a shopping group are the attributes of a user in a group to which the user of the mobile terminal 4 belongs, the mobile terminal 4 estimates the attributes of the user as the attributes of the added user and notifies the recommended information to the added user. Therefore, the mobile terminal 4 can notify the user of recommendation information only if the estimated user attribute is the attribute of a member of the shopping group to which the user of the mobile terminal 4 belongs. This allows the mobile terminal 4 to reliably notify the users in the shopping group of recommendation information. In this way, the mobile terminal 4 can provide optimal sales promotion information for each user.

[0145] The mobile terminal 4 may acquire image data in addition to the voice data in ACT101. The processing circuit 40 of the mobile terminal 4 outputs the voice data and image data to the server 1 via the communication interface 48. The server 1 may estimate attributes of the added user based on the voice data and image data. According to this example, the server 1 can estimate the user's attributes based on the voice data and image data, thereby improving the accuracy of attribute estimation.

[0146] (Variation) In the above example, the processing circuit 10 of the server 1 performs the recommendation process based on the registration of a product in ACT113. However, this is not limited to this. The processing circuit 10 may perform the recommendation process in ACT114 based on the update of the group configuration in ACT112. In this example, the processing circuit 10 performs the recommendation process based on the estimation of attributes of another user (added user) different from the current user of the mobile terminal 4. The processing circuit 10 may perform the recommendation process based on the attributes of the added user. The processing circuit 10 may determine the location information of the mobile terminal 4 based on the product information acquired immediately before performing the recommendation process, and perform the recommendation process based on the location information of the mobile terminal 4. The processing circuit 10 may perform the recommendation process based on the attributes of the added user and the location information of the mobile terminal 4. According to this example, the mobile terminal 4 can notify the recommendation information based on the estimation of attributes of another user different from the user of the mobile terminal 4. Therefore, the mobile terminal 4 can make recommendations in real time when the attributes of different users are estimated. For example, the mobile terminal 4 can notify recommended information for an added user based on the estimated attributes of the added user. This allows the mobile terminal 4 to provide optimal promotional information for each user.

[0147] The processing circuit 10 of the server 1 may perform recommendation processing based on the user's entry into a specific area. For example, the processing circuit 10 determines whether the user of the mobile terminal 4 has entered a specific area based on the location information of the mobile terminal 4. The specific area may be set as appropriate by a store manager, etc. The specific area may be, for example, an area based on a product category. The specific area may be, for example, a candy section. For example, the processing circuit 10 performs recommendation processing based on the determination that the user of the mobile terminal 4 has entered the candy section. The processing circuit 10 may acquire information on recommended products linked to the candy section as recommendation information. Note that the processing circuit 10 may perform recommendation processing based on estimated user attributes and the user's entry into a specific area. The processing circuit 10 may acquire information on recommended products linked to the candy section as recommendation information. For example, when the estimated user attribute is "boy" and the specific area is "snack section," the processing circuit 10 may acquire information indicating "snacks" as recommendation information. According to this example, the mobile terminal 4 can notify the user of the mobile terminal 4 of the recommendation information based on the user's entry into the specific area. Therefore, the mobile terminal 4 can recommend products related to the location of the user of the mobile terminal 4 in real time. This allows the mobile terminal 4 to provide optimal promotional information for each user.

[0148] The processing circuit 10 of the server 1 may perform recommendation processing based on the user of the mobile terminal 4 moving to a different area. For example, the processing circuit 10 detects movement from a first area to a second area different from the first area based on the location information of the mobile terminal 4. The processing circuit 10 may acquire recommendation information corresponding to the second area based on the detection of the movement of the location from the first area to the second area.

[0149] (Other embodiments) The sales data processing device may be a checkout device 3 installed in the checkout area of ​​the store, instead of a mobile terminal 4 that accepts user operations to register products or services provided in the store. The sales data processing device may also be a manned register, self-checkout register, registration machine, or payment machine installed in the checkout area of ​​the store.

[0150] The sales data processing device may be realized by one device as explained using the mobile terminal 4 as an example, or may be realized by multiple devices with distributed functions. The server 1 may be realized by one device or may be realized by multiple devices with distributed functions.

[0151] In the above description, the server 1 and the mobile terminal 4 are exemplified, but the present invention is not limited to this. The mobile terminal 4 may be capable of realizing at least a part of the functions of the server 1 of this embodiment.

[0152] When the functions of the mobile terminal 4 are provided to a cloud server, the system may be one in which the functions of the mobile terminal 4 are realized by a system including a tablet terminal communicably connected to the cloud server.

[0153] The above-described embodiments may be applied to a method executed by an apparatus, a program that can cause a computer of the apparatus to execute each function, or a recording medium that stores the program.

[0154] Each of the one or more circuits constituting the processing circuit performs one or more of the multiple processes. When the processing circuit is composed of a single circuit, the single circuit performs all of the multiple processes. When the processing circuit is composed of multiple circuits, each of the multiple circuits performs a part of the multiple processes. The part of the multiple processes may be one of the multiple processes, or two or more of the multiple processes. When the processing circuit is composed of multiple circuits, the multiple circuits may be included in a single device or may be distributed across multiple devices.

[0155] The program may be transferred in a state where it is stored in the device according to the embodiment, or in a state where it is not stored in the device. In the latter case, the program may be transferred via a network or in a state where it is recorded on a recording medium. The recording medium is a non-transitory tangible medium. The recording medium is a computer-readable medium. The recording medium may be in any form, such as a CD-ROM or a memory card, as long as it is capable of storing the program and is computer-readable.

[0156] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, and are also included in the scope of the invention and its equivalents as defined in the claims.

[0157] The above embodiment may be expressed as follows. (1) A sales data processing device configured by a mobile terminal that accepts user operations to register products or services provided at a store, an acquisition unit that acquires at least one of image data including a face image of the user and voice data including a voice of the user; a notification processing unit that notifies recommendation information regarding the product, the service, or the store in accordance with at least one of an attribute of the user estimated based on at least one of the image data and the voice data acquired by the acquisition unit and location information of the user; A sales data processing device comprising: (2) The notification processing unit notifies the user of the recommendation information based on at least one of the following triggers: a product is registered by the user; an attribute of another user different from the user is estimated; and the user enters a specific area. A sales data processing device as described in (1). (3) The notification processing unit notifies the recommendation information to any user in a group of multiple users who use the same mobile terminal, the user being estimated based on the image data or the voice data. A sales data processing device as described in (1). (4) The notification processing unit notifies the recommendation information to any of the users in the group who belong to the same group estimated based on the conversation content included in the voice data. (3) A sales data processing device according to the present invention. (5) When the voice data includes a voice of a user using the mobile terminal and a voice of another user using a mobile terminal different from the mobile terminal, the notification processing unit notifies the user of the mobile terminal of the recommendation information estimated based on the directionality, intensity, or sound pressure of the voice. A sales data processing device as described in (1). (6) A computer configured with a mobile terminal that accepts user operations to register products or services provided at a store, a function of acquiring at least one of image data including a face image of the user and voice data including a voice of the user; a function of notifying the user of recommendation information related to the product, the service, or the store in accordance with at least one of the attributes of the user estimated based on at least one of the acquired image data and the acquired voice data and location information of the user; An information processing program capable of executing the above. (7) A sales data processing system including a sales data processing device configured by a mobile terminal that accepts user operations to register products or services provided at a store, an acquisition unit that acquires at least one of image data including a face image of the user and voice data including a voice of the user; an estimation processing unit that estimates at least one of an attribute of the user and location information of the user based on at least one of the image data and the voice data acquired by the acquisition unit; a notification processing unit that notifies recommendation information regarding the product, the service, or the store according to at least one of the estimated attributes of the user and location information of the user; A sales data processing system comprising: [Explanation of symbols]

[0158] 1...server, 2...access point, 3...accounting device, 4...mobile terminal, 10...processing circuit, 11...main memory, 12...auxiliary storage device, 13...communication interface, 40...processing circuit, 41...main memory, 42...auxiliary storage device, 43...input device, 44...display device, 45...capturing device, 46...audio input device, 47...audio output device, 48...communication interface, 49...connection interface, 101...communication processing unit, 102...estimation processing unit, 103...recommendation processing unit, 104...product registration unit, 121...user information storage area, 122...product information storage area, 123...transaction information storage area, 124...person estimation information storage area, 125...recommendation history information storage area, 401...communication processing unit, 402...acquisition unit, 403...notification processing unit, 404...input processing unit, CA...shopping cart, NW...network, S...store system, X...store.

Claims

1. A sales data processing device configured by a mobile terminal that accepts user operations to register products or services provided in a store, an acquisition unit that acquires at least one of image data including a face image of the user and voice data including a voice of the user; a notification processing unit that notifies recommendation information regarding the product, the service, or the store in accordance with at least one of an attribute of the user estimated based on at least one of the image data and the voice data acquired by the acquisition unit and location information of the user; A sales data processing device comprising:

2. the notification processing unit notifies the user of the recommendation information based on at least one of the following triggers: a product being registered by the user; an attribute of another user different from the user being estimated; and the user entering a specific area. The sales data processing device according to claim 1 .

3. the notification processing unit notifies the recommendation information to any user in a group made up of a plurality of users who use the same mobile terminal, the user being estimated based on the image data or the voice data; The sales data processing device according to claim 1 .

4. the notification processing unit notifies the recommendation information to any of the users in the group who belong to the same group estimated based on the conversation content included in the voice data; The sales data processing device according to claim 3 .

5. When the voice data includes a voice of a user using the mobile terminal and a voice of another user using a mobile terminal different from the mobile terminal, the notification processing unit notifies the user of the mobile terminal of the recommendation information estimated based on the directionality, intensity, or sound pressure of the voice. The sales data processing device according to claim 1 .

6. A computer configured with a mobile terminal that accepts user operations to register products or services provided at a store, a function of acquiring at least one of image data including a face image of the user and voice data including a voice of the user; a function of notifying the user of recommendation information related to the product, the service, or the store in accordance with at least one of the attributes of the user estimated based on at least one of the acquired image data and the acquired voice data and location information of the user; An information processing program capable of executing the above.

7. A sales data processing system including a sales data processing device configured by a mobile terminal that accepts user operations to register products or services provided in a store, an acquisition unit that acquires at least one of image data including a face image of the user and voice data including a voice of the user; an estimation processing unit that estimates at least one of an attribute of the user and location information of the user based on at least one of the image data and the voice data acquired by the acquisition unit; a notification processing unit that notifies recommendation information regarding the product, the service, or the store according to at least one of the estimated attributes of the user and location information of the user; A sales data processing system comprising:

Images