Information processing system, information processing device, information processing method, and program

Abstract

To efficiently manage a commodity inventory based on term information for each commodity.SOLUTION: An information processing system of on embodiment includes a user terminal owned by a user, and an information processing apparatus capable of communicating with the user terminal. The user terminal includes a first acquisition unit that acquires commodity information relating to a commodity and term information relating to an expiration date of the commodity, and a display control unit that causes a display unit to display commodity inventory information of the user acquired from the information processing apparatus. The information processing apparatus includes a second acquisition unit that acquires the commodity information and the term information acquired by the user terminal as commodity inventory information of the user, and a provision unit that provides the commodity inventory information of the user acquired by the second acquisition unit to the user terminal.SELECTED DRAWING: Figure 11

Description

[Technical Field]

[0001] The present invention relates to an information processing system, an information processing device, an information processing method, and a program. [Background technology]

[0002] BACKGROUND ART Conventionally, a system for managing food inventory in a home has been known in order to reduce food waste caused by discarding food such as fresh food that has passed its expiration date (see, for example, Patent Document 1). Patent document 1 describes a food management system that includes a POS system that transmits information on purchased products for each customer via a communication network, an external terminal that operates the home terminal from outside to obtain necessary information such as food inventory management information, and a home terminal that receives the product information sent from the POS system and transmits request information to the external terminal in cooperation with the operation of the external terminal. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2004-348445 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the food management system described in Patent Document 1 has the problem that it cannot efficiently manage food based on expiration dates and cannot ensure the effectiveness of reducing food waste.In this food management system, for example, expiration dates are uniformly determined based on the purchase date of the food, so the actual expiration dates of each food item are not reflected in the system, making it impossible to efficiently manage food.

[0005] Therefore, an object of the present invention is to efficiently manage product inventory based on expiration date information for each product. [Means for solving the problem]

[0006] One aspect of the present invention is an information processing system including a user terminal held by a user and an information processing device capable of communicating with the user terminal, wherein the user terminal has a first acquisition unit that acquires product information about a product and expiration date information about an expiration date of the product, a payment request unit that requests payment for the product from the information processing device based on the product information and expiration date information acquired by the first acquisition unit, and a display control unit that displays product inventory information of the user acquired from the information processing device on a display unit, and the information processing device displays the product information and expiration date information of the product that has been paid for in response to the payment request for the product from the user terminal. , for each user identification information that identifies the user who uses the user terminal, the product inventory information of the user is updated, and the updated Product inventory information of the said user of and a providing unit that provides the product inventory information of the user obtained by the second acquisition unit to the user terminal based on a request from the user. [Effects of the Invention]

[0007] According to one aspect of the present invention, product inventory can be efficiently managed based on expiration date information for each product. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a diagram illustrating an outline of a system configuration of a product inventory management system according to an embodiment. [Figure 2] FIG. 2 is a diagram illustrating an example of a data configuration of a store user database. [Figure 3] 10A to 10C are diagrams illustrating an example of screen transitions of a store application on a user terminal. [Figure 4] 1 is a sequence chart illustrating an operation of a product inventory management system according to an embodiment. [Figure 5] 10A to 10C are diagrams illustrating an example of screen transitions of a store application on a user terminal. [Figure 6] 1 is a sequence chart illustrating an operation of a product inventory management system according to an embodiment. [Figure 7] FIG. 10 is a diagram illustrating an example of a data configuration of a purchase record database. [Figure 8] FIG. 10 is a diagram illustrating an example of a data configuration of a user inventory database. [Figure 9] 1 is a sequence chart illustrating an operation of a product inventory management system according to an embodiment. [Figure 10] FIG. 10 is a diagram showing an example of a screen of an inventory management application on a user terminal. [Figure 11] 1 is a block diagram showing the internal configuration of each device of a product inventory management system according to an embodiment of the present invention; [Figure 12] FIG. 10 is a diagram illustrating an example of a data configuration of an inventory application user database. [Figure 13] 1 is a sequence chart illustrating an operation of a product inventory management system according to an embodiment. [Figure 14] FIG. 10 is a diagram illustrating a method for acquiring consumption information by a user. [Figure 15] FIG. 10 is a diagram illustrating a method for acquiring consumption information by a user. [Figure 16] 10A to 10C are diagrams illustrating an example of screen transitions of an inventory management application on a user terminal. [Figure 17] 1 is a sequence chart illustrating an operation of a product inventory management system according to an embodiment. [Figure 18] 10A to 10C are diagrams illustrating an example of screen transitions of an inventory management application on a user terminal. [Figure 19] 1 is a sequence chart illustrating an operation of a product inventory management system according to an embodiment. [Figure 20] FIG. 10 is a diagram showing an example of a screen of an inventory management application on a user terminal. DETAILED DESCRIPTION OF THE INVENTION

[0009] In this disclosure, "product information" of a product is information that identifies the product. For example, a product name, a product code, a product ID, a product model, etc. are examples of product information. A product ID is identification information that identifies a product. In this disclosure, "expiration date information" of a product refers to information about an expiration date that indicates whether the product can be used, enjoyed, or consumed by a user. Examples of expiration dates include use-by date, best-before date, expiration date, quality assurance date, etc.

[0010] In the present disclosure, the method for acquiring product information and expiration date information from a product is not limited, and various methods can be adopted. For example, if code information corresponding to product information and expiration date information is displayed on a product, shelf label, electronic shelf label, etc., the product information and expiration date information can be obtained by reading the code information. Furthermore, if text information (human-readable characters) corresponding to product information and expiration date information is displayed on a product, shelf label, electronic shelf label, etc., an image containing the text information can be captured and the text information can be obtained from the image using image recognition technology. Examples of ways in which code information or text information is displayed on a product include ways in which the code information or text information is printed on the product's packaging, and ways in which a print medium such as a label with the code information or text information printed thereon is affixed to the product itself or to the product's packaging. The code information may be a one-dimensional code (barcode) or a two-dimensional code. In the following, an example will be described in which product information and expiration date information are obtained by reading code information displayed on a product.

[0011] In the product inventory management system of the embodiment, inventory management of products held as inventory at home by a user is performed, for example, by a user terminal carried by the user. The product is not limited to any particular product, but may be any product that is associated with the expiration date information and that the user keeps in stock at home. Typical products include food products and seasonings purchased by the user at a retail store. For example, a user terminal acquires product information and expiration date information by reading code information displayed on a product at a store or the like. For example, if the user terminal has a cashierless function, payment for the product corresponding to the product information acquired by the user terminal is made by a store server that can communicate with the user terminal. In one embodiment of a product inventory management system, the inventory management server acquires product information and expiration date information corresponding to a paid product from the store server as the user's product inventory information and provides the product inventory information to, for example, a user terminal or the like. That is, according to this system, when a product has been paid for, the product information and expiration date information corresponding to the product acquired by the user terminal or the like at the time of purchase are used as product inventory information, allowing the user to manage the inventory of the product they have purchased based on the product information and expiration date information contained in the code information displayed on the product. In this case, the user does not need to enter product consumption information or expiration date information when managing the product after purchasing it.

[0012] (1) First embodiment The system configuration of a product inventory management system 1 of this embodiment will be described with reference to FIG. The product inventory management system 1 is configured to enable users to manage inventory of products purchased at stores and kept at home, for example. Food products are given as an example of products, but this is not limiting and any product with a best-before date (an example of expiration date information), such as seasonings, may be used. In the example of this embodiment, the store is a retailer such as a supermarket that handles food products with best-before dates. The system allows users to complete payment at each store without a cashier.

[0013] As shown in Figure 1, the product inventory management system 1 of this embodiment includes a user terminal 3 carried by a user CT who shops at a store, store servers 5-1, 5-2, 5-3, ..., a payment agent server 7, and an inventory management server 8, and is configured to enable the user CT to manage the inventory of products purchased at the store from home. In the product inventory management system 1, the user terminal 3 and the server group are configured to be able to communicate via a network NW. The network NW is not limited to, but may be, for example, the Internet, a LAN (Local Area Network), or a WAN (Wide Area Network).

[0014] Store servers 5-1, 5-2, 5-3, ... are provided to enable each of the multiple stores used by the user to realize cashierless payment. In the following, when referring to matters common to each store server, they will be simply referred to as "store server 5" as appropriate. The store server 5 can communicate with the payment agent server 7 and supports cashierless payment of products by users. A store application corresponding to each store is installed on the user terminal 3 possessed by the user CT. The store application is configured to communicate with a store server 5 corresponding to the store in order to perform cashierless payment at the corresponding store. An inventory management application for managing the user's product inventory is installed on the user terminal 3. The inventory management application communicates with the inventory management server 8 to manage the user's inventory. The inventory management server 8 is configured to acquire information about products for which payment has been made by the user from each of the store servers 5-1, 5-2, 5-3, ..., and to be able to provide the user's inventory data (described later) in response to a request from the inventory management application. In the following description and drawings, the store application and the inventory management application may be abbreviated as "store application" and "inventory application," respectively, as appropriate.

[0015] The store server 5 stores a store user database, an example of which is shown in FIG. Each record in the user database illustrated in FIG. 2 contains values in the fields "User ID," "User Name," and "Payment Method." Here, the value in the "User ID" field is identification information assigned to store users. The value in the "User Name" field is obtained based on the user's operational input when the user installs the store application on the user terminal 3, and is recorded in the user database. The value in the "Payment Method" field is obtained based on the user's operational input when the user installs the store application on the user terminal 3, or at any time after installation, and is recorded or updated in the user database. The value of the "payment method" field is data necessary for making payment for the product to the user, such as credit card number information and / or information related to electronic money (prepaid number, etc.). The value of the "payment method" field is provided to the payment agent server 7 when the user corresponding to the user ID makes a payment.

[0016] Next, a method for using the store application of the user terminal 3 will be described with reference to Fig. 3 and Fig. 4. Fig. 3 is a diagram showing an example of screen transitions of the store application of the user terminal 3. Fig. 4 is a sequence chart showing the processing of the store application of the user terminal 3. By running the store application, users can check the prices of each product in the store and make payment for the products they select. Screens G1 to G3 in Figure 2 show how to use the store application when a user checks product prices and adds products to their shopping cart.

[0017] When a user launches the store application on the user terminal 3, the imaging function of the user terminal 3 is activated, and the captured image is displayed in the window w1, as shown in screen G1 of FIG. 3. On screen G1, the window w1 contains an image of the product P, in which the user has picked up the product P from a store shelf and the code information C1 displayed on the product P is visible. When the code information C1 of the product P is displayed in the window w1 (i.e., the user performs a scanning operation), the store application reads (scans) the code information C1 (step S2 of FIG. 4). When multiple pieces of code information are displayed in the window w1, the imaging function of the user terminal 3 preferably includes a function to display a scan area 100 in the window w1 so that the desired code information can be reliably read. In this case, of the multiple pieces of code information in the window w1, only the code information C1 displayed in the scan area 100 is read.

[0018] For example, the code information C1 includes the product ID (an example of product information) and expiration date information (expiration date information; an example of expiration date information) of the corresponding product P. The code format of the code information C1 is not important as long as it includes the product ID and expiration date information, but if it is a barcode (one-dimensional code), for example, CODE128 such as GS1-128 can be used. CODE128 can convert all 128 ASCII characters into barcodes, so it can be configured to include the product ID and expiration date information.

[0019] In order to affix labels including GS1-128 to each product in a store, the labels may be affixed automatically in bulk using an affixing robot or the like at a logistics center, or a weighing label including GS1-128 may be affixed when prepared foods are produced in the store. This allows a label printed with GS1-128 including expiration date information to be affixed even to products that have a code (such as JAN13) printed on them that does not include expiration date information.

[0020] When the code information C1 is read, the store application sends an inquiry about the offered price of the product P to the user, including the product ID and expiration date information contained in the code information C1, to the store server 5 (step S4 in FIG. 4). Next, the store application receives price data including information about the regular price and offered price of the product P from the store server 5 (step S10) and displays it (step S12).

[0021] For example, referring to Figure 3, window w2 of screen G2 displayed in step S12 includes the product name ("Yogurt B 500ml") corresponding to the product ID, the regular price ("300 yen"), the offered price ("250 yen"), and the expiration date ("September 13, 2021"). On screen G2, the user can view the information contained in window w2 and choose whether or not to add product P to their wish list (basket). To add product P to their wish list, the user operates button b1 ("Add to basket") displayed on screen G2 (step S14: YES in FIG. 4), and screen G3 is displayed, notifying the user that product P has been added to their wish list (window w3). In this case, the user places the picked-up product P into the actual basket or shopping cart at the store. In response to the operation of button b1, the user terminal 3 updates the wish to buy list by adding information about the target product to the wish to buy list (step S16).

[0022] Next, a method of using a store application when paying for goods using the store application of the user terminal 3 will be described with reference to Fig. 5 and Fig. 6. Fig. 5 is a diagram showing an example of screen transitions in the store application of the user terminal 3. Fig. 6 is a sequence chart showing the processing of the store application of the user terminal 3.

[0023] After the user checks the offered prices of the products and adds them to the wish list (i.e., after repeatedly displaying screens G1 to G3 in FIG. 3), if the user wishes to make a payment, the user operates button b2 ("View Cart") on screen G4 to display screen G5, which contains the wish list BL. The wish list BL contains a list of the products added so far (product name, quantity, and price of each product) and the total price. Although not shown, if the user cancels the purchase of a particular item from the wish to buy list BL because, for example, the purchase is over budget, the user can delete the item from the wish to buy list BL. In this case, the user returns the canceled item from the store's basket or shopping cart to the store's shelves.

[0024] When the wish list BL is finalized on screen G5, the user operates button b3 (payment button) (step S20 in FIG. 6), and the store application sends a payment request including the wish list to the store server 5 (step S22). When the store server 5 receives a payment request from the store application, it reads the user name and payment method data from the user database and sends a payment request including the read user name and payment method data and the payment amount (total amount of the wish list) to the payment agent server 7 (step S24). The payment agent server 7 performs payment processing based on the data provided by the store server 5 (step S26), and when the payment processing is complete, it sends a payment completion notification to the store server 5 (step S28).

[0025] When the payment is completed, the store server 5 issues a new payment ID (step S30) and updates the purchase history database (described later) by creating a new record in the purchase history database (step S32).

[0026] Figure 7 shows an example of the configuration of the purchase record database. Each record in the purchase history database shown in Figure 7 contains values for the fields "User ID," "Payment ID," "Payment Date and Time," and "Purchase Details." Here, the value of the "Payment ID" field is data uniquely assigned to each individual payment for the corresponding user. The value of the "Payment Date and Time" field indicates the date and time when the payment identified by the payment ID occurred. The "Purchase Details" field contains the following subfields: "Product ID," "Product Name," "Price," "Quantity," and "Best Before Date." The value of each subfield indicates the details of the purchase that is the subject of the payment identified by the payment ID.

[0027] Referring again to FIG. 6, the store server 5 sends a payment completion notice corresponding to the payment request of step S22 to the store application (step S34). This payment completion notice includes the payment ID issued in step S30. The store application creates a payment completion code, which is a two-dimensional code including the payment ID included in the received payment completion notice (step S36), and displays it on the user terminal 3 (step S38). For example, as shown in FIG. 5, a screen G6 including code information C2 as the payment completion code is displayed. The payment completion code indicates that the payment for the product has been completed, and includes a payment ID (described later) that identifies the payment. Here, a two-dimensional code is shown as an example of the payment completion code, but a barcode or the like may also be used.

[0028] The payment completion code shown on screen G6 is used, for example, to notify the store or store staff that payment for the items in the basket has been completed. For example, the system may be configured so that customers can exit the store by showing the payment completion code to a store staff member, or so that a gate opens to allow customers to exit the store by having a specified device in the store read the payment completion code. In this case, customers do not have to wait in line at the cash register, and store cashiers do not have to pay for the products, which is beneficial to both the customer and the store.

[0029] After updating the purchase history database, the store server 5 transmits the purchase data to the inventory management server 8 (step S35). The purchase data indicates the updated contents of the purchase history database in step S32, and includes information about products for which payment has been completed by the user. Upon receiving the purchase data, the inventory management server 8 updates the user inventory database (described below) based on the purchase data (step S40).

[0030] FIG. 8 shows an example of the configuration of the user inventory database. The user inventory database is stored in the inventory management server 8 and is managed for each user ID. Each record in the user inventory database contains values for fields such as "product ID," "product name," "quantity / amount," and "best before date." The values in each field are the same type of data as the values in the corresponding fields contained in the purchase history database. The database is configured so that data added to the purchase history database when a product is purchased for a specific user is also reflected in the user inventory database. Hereinafter, the data for each user ID in the user inventory database will be referred to as "inventory data."

[0031] Next, a method for using the inventory management application will be described with reference to FIGS. Fig. 9 is a sequence chart showing the process of displaying product inventory in the user's home using the inventory management application of the user terminal 3. Fig. 10 shows an example of a screen displayed by the inventory management application.

[0032] 9, each time a payment process is performed (steps S42a, 42b, 42c), the store servers 5-1, 5-2, and 5-3 transmit purchase data to the inventory management server 8 (steps S44a, 44b, and 44c). The payment process in steps S42a, 42b, and 42c includes the series of steps S20 to S32 in FIG. 6. Each time the inventory management server 8 receives purchase data from a store server 5-1, 5-2, or 5-3, it updates the user inventory database using the received purchase data (steps S46a, 46b, and 46c). Therefore, products paid for by the same user at multiple store servers 5 are managed in a unified manner in the user inventory database of the inventory management server 8. The purchase data received by the inventory management server 8 includes the user ID in the purchase history database and information about the product for which the user has completed payment. In order to update the user inventory database using this purchase data, as will be described later, the user ID in the store user database and the user ID in the store app user database are associated in advance, or can be associated based on, for example, the user name.

[0033] The inventory management application transmits an inventory display request based on, for example, a predetermined operation by the user (step S48). Upon receiving the inventory display request, the inventory management server 8 reads out the inventory data corresponding to the requesting user ID and returns it to the inventory management application (step S50). The inventory management application displays the received inventory data (step S52). An example of the screen displayed in step S52 is screen G7 in Fig. 10. Screen G7 includes an inventory list IL consisting of information about each product, such as product ID, product name, quantity / amount, and expiration date.

[0034] Next, the configuration of each device in the product inventory management system 1 of this embodiment will be described with reference to the functional block diagram of FIG.

[0035] As shown in FIG. 11, the user terminal 3 includes a control unit 31, a storage 32, an operation input unit 33, a display unit 34, an imaging unit 35, a code reader 36, and a communication unit 37. The control unit 31 is mainly configured with a microprocessor, and controls the entire user terminal 3. For example, the microprocessor included in the control unit 31 loads and executes store application and inventory management application programs recorded in the storage 32, and displays the execution results on the display unit 34. The storage 32 is a non-volatile memory and may be, for example, a solid state drive (SSD) such as a flash memory. The storage 32 stores the store application and inventory management application programs, as well as data, files, etc. created by executing the store application and inventory management application.

[0036] By executing the store application, the control unit 31 realizes the following functions. (1-i) A function to obtain product information, expiration date information, etc. of the product from the code information displayed on the product. (1-ii) A function of sending a price inquiry to the store server 5 regarding information on the price of the product offered to the user (i.e., requesting information on the price of the product offered). (1-iii) A function of receiving (obtaining) information on the offered price of a product from the store server 5 and displaying the obtained information on the offered price of the product on the display unit 34 (1-iv) A function of requesting the store server 5 to settle the payment for each item included in the purchase wish list.

[0037] By executing the inventory management application, the control unit 31 realizes the following functions. (2-i) Function as a first acquisition unit that acquires a product ID (an example of product information) and expiration date information (an example of expiration date information related to the expiration date of a product) from code information C1 attached to the product via the code reader 36 (2-ii) A function as a display control unit that acquires user inventory data from the inventory management server 8 and displays product inventory information on the display unit 34

[0038] The operation input unit 33 is, for example, a touch panel type input device provided on the display panel of the user terminal 3. The display unit 34 includes, for example, a liquid crystal display panel or an organic EL panel, and displays the execution results of the store application and the inventory management application. The display unit 34 also displays the digital image signal generated by the imaging unit 35. The imaging unit 35 has, for example, an optical lens and an imaging element (image sensor) that converts incident light from the optical lens into an electrical signal, and sequentially generates digital images and outputs them to the display unit 34.

[0039] The code reader 36 analyzes the code information included in the image signal generated by the imaging unit 35, and extracts (obtains) data from the code information (that is, product information such as a product ID and expiration date information). The communication unit 37 is a communication interface for communicating with the store server 5 and the inventory management server 8. There are no limitations on the communication protocol, but examples include HTTP and HTTPS.

[0040] As shown in FIG. 11, the store server 5 includes a control unit 51, a storage 52, and a communication unit 53. The control unit 51 is mainly configured with a microprocessor, and controls the entire store server 5. For example, the microprocessor included in the control unit 51 loads and executes a server program recorded in the storage 52. Storage 52 is a large-capacity storage device such as an HDD (Hard Disk Drive), and stores a store user database (store user DB; see FIG. 2) and a purchase history database (purchase history DB; see FIG. 7) in addition to the server program. The store user database and purchase history database are accessed by control unit 51 as needed when the server program is executed. Although not shown, the storage 52 stores data on the offered price of each product sold in the store. The offered price data is referenced by the control unit 51 when a price inquiry is received from a user's store application. The communication unit 53 is a communication interface for communicating with the user terminal 3, the payment agent server 7, and the inventory management server 8.

[0041] By executing the server program, the control unit 51 realizes the functions of a price information providing unit 511 and a payment processing unit 512. The price information providing unit 511 is a function that provides information including the offered price of the inquired product to the store application of the user terminal 3. For example, the information included in the screens G2 and G3 in FIG. 3 is provided by the price information providing unit 511. The payment processing unit 512 has a function of working with the payment agent server 7 to process payments for products included in the wish list in response to an operation instruction (i.e., a payment request) made by pressing the payment button obtained from the user terminal 3. The payment processing unit 512 reads the user name and payment method data from the store user database and provides them to the payment agent server 7. The payment processing unit 512 also creates a new record in the purchase history database when it receives a payment request from the store application.

[0042] As shown in FIG. 11, the inventory management server 8 includes a control unit 81, a storage 82, and a communication unit 83. The control unit 81 is mainly configured with a microprocessor, and controls the entire inventory management server 8. For example, the microprocessor included in the control unit 81 loads and executes a server program recorded in the storage . Storage 82 is a large-capacity storage device such as an HDD, and stores a store application user database (store application user DB; described later) and a user inventory database (user inventory DB; see FIG. 8) in addition to the server program. The store application user database and the user inventory database are accessed by control unit 81 as needed when the server program is executed. The communication unit 83 is a communication interface for communicating between the user terminal 3 and the store server 5.

[0043] FIG. 12 shows an example of the structure of the store application user database. Each record in the store application user database illustrated in FIG. 12 includes values in the fields "user ID," "user name," "group ID," and "permission to view." The user ID is different from the user ID in the store user database stored in the store server 5 and is assigned by the inventory management application. 6, the inventory management server 8 obtains purchase data associated with the user ID in the store user database from the store application and updates the inventory data for the specific user ID in the user inventory database. At this time, the user ID in the store user database and the user ID in the store application user database are associated in advance, or can be associated based on, for example, the user name.

[0044] A group ID is an ID commonly assigned to multiple users. In a typical example, a single group ID is assigned to multiple users who share household income, such as family members, upon request from the users. Viewing permission means that a user is permitted to view the inventory data of another user. In the inventory app user database, the value of the "Viewing permission" field is the user ID of the user and / or the group ID of the group that has been granted viewing permission to the user with the target user ID. For example, in the example shown in FIG. 12, this means that the user with user ID: Z001 has been granted viewing permission to the inventory data of the group with group ID: G008. Group IDs and viewing permissions are further discussed in connection with later embodiments.

[0045] Referring again to FIG. 11, in the inventory management server 8, the control unit 81 functions as an information management unit 811, an information provision unit 812, a registration unit 813, and an analysis unit 814 by the microprocessor executing the server program.

[0046] The information management unit 811 (an example of a second acquisition unit) has a function of acquiring, when a product has been paid for by a user, the product ID and expiration date information acquired by the user terminal 3 as user inventory data (an example of product inventory information). As shown in step S35 of Fig. 6, the information management unit 811 acquires, via the store server 5, purchase data including the product ID and expiration date information acquired by the user terminal 3 after the product has been paid for. The information providing unit 812 is a function that provides the inventory data of the user obtained by the information management unit 811 to the inventory management application of the user terminal 3 based on the inventory display request of the user, as shown in step S50 of Figure 9. The registration unit 813 is a function for registering one or more users in one group. The analysis unit 814 is a function for analyzing the consumption status of a user or group based on inventory data. The registration unit 813 and the analysis unit 814 will be explained later.

[0047] As described above, according to the product inventory management system 1 of this embodiment, the user terminal 3 acquires the product ID and expiration date information of a product at a store and transmits them to the store server 5 for payment. When the product has been paid for by the user, the inventory management server 8 acquires the product ID and expiration date information acquired by the user terminal 3 from the store server 5 as the user's inventory data. When the inventory management server 8 provides the user terminal 3 with inventory data corresponding to the user ID based on an inventory display request from the user's inventory management application, the user terminal 3 displays the acquired user's inventory data on the display unit 34.

[0048] In the product inventory management system 1, the product ID and expiration date information that the user acquires by reading it with the user terminal 3 at the store are transferred from the store server 5 to the inventory management server 8 after payment for the product. This saves the user the trouble of manually inputting the product ID and expiration date information of the purchased product into the inventory management application, and has the advantage of enabling efficient inventory management based on the expiration date information. Although the above description concerns a case where a user acquires product ID and expiration date information from a product in order to make a cashierless payment at a store, this is not the only case. The product ID and expiration date information may also be acquired by the user terminal 3 when the user makes a payment at a regular cash register.

[0049] In the product inventory management system 1, purchase data including user IDs is sent from store servers 5-1, 5-2, 5-3, ... corresponding to multiple stores to the inventory management server 8, and is managed centrally as user inventory data in a user inventory database. Therefore, users can check the product inventory at home by viewing a single inventory data for products purchased at any store. In other words, this system is configured so that inventory information is not dependent on a specific store, making it highly convenient for managing product inventory when a user uses multiple stores.

[0050] (2) Second embodiment Next, a product inventory management system according to a second embodiment will be described with reference to FIGS. In this embodiment, when a user consumes food (product) at home, the user inventory database is updated based on the user's own operation. 13, in response to a predetermined operation input by the user (step S54), the inventory management application of the user terminal 3 acquires consumption information and transmits it to the inventory management server 8 (step S56). The inventory management server 8 updates the user inventory database based on the received consumption information (step S58). Here, the consumption information includes the product ID, the amount of the product consumed, the amount of the product after consumption (number and weight), and the like.

[0051] Although not shown, the consumption information from the inventory management application of the user terminal 3 can be obtained, for example, by the user selecting a product included in the inventory data on the inventory management application and inputting the consumption amount of the selected product. The product may be selected by selecting one of the products from a list of products based on the inventory data, or by reading code information such as a barcode if the product has such code information. The method of acquiring consumption information is not limited to this, and various embodiments are possible. For example, other methods of acquiring consumption information are shown in Figs. 14 and 15.

[0052] In the example shown in FIG. 14A, the inventory management application works in conjunction with the imaging function of the user terminal 3 to acquire an image of the product P, and then estimates the product information and weight of the product P based on the acquired image to acquire consumption information. AI technology can also be used to estimate the weight of the product P. As shown in window w5, the estimated product P and weight of the product P may be displayed. In the example shown in FIG. 14B, a wireless tag T (an example of a communication device) with a weight sensor is embedded near the bottom surface of the product P. In this example, the inventory management application acquires consumption information by receiving product information and weight data of the product P via wireless communication with the wireless tag T. As shown in window w6, the received weight data may be displayed. Note that the type of the wireless tag T is not limited, but it is preferable that it is, for example, an energy-harvesting tag that converts radio waves in a wide range of multiple different frequency bands into energy.

[0053] In one embodiment, the RFID tag T operates by obtaining energy from radio waves of one or more specific frequencies present in the surrounding area. The specific frequencies include any radio waves of any frequency that can be converted into energy by the RFID tag T. The specific frequencies may include one or more frequency bands, or may be specific frequencies assigned from among the frequency bands. In one embodiment, the specific frequency may be, for example, a specific frequency or frequency band specified by a wireless communication standard, or a specific frequency or frequency band designated by a business operator that provides the inventory management application related to this embodiment. Non-limiting examples of radio waves used for energy harvesting include radio waves generated by wireless communication in the frequency bands used in mobile communication systems such as 3G to 5G, radio waves generated by wireless communication in the frequency bands used in communication standards such as Bluetooth (registered trademark) and Wi-Fi (registered trademark), radio waves generated by wireless communication in the 2.4 GHz band represented by communication protocols such as ZigBee (registered trademark) and Thread, and radio waves generated by wireless communication in the frequency bands used in RFID (e.g., 900 MHz band, 13.56 MHz band). In one embodiment, the inventory management application may work in conjunction with the imaging function of the user terminal 3 to read barcode information and text information written on the packaging of product P, as shown in Figure 14B, estimate product information and the weight of product P based on the acquired image, obtain consumption information, and display the estimated product P and the weight of product P.

[0054] In the example shown in FIG. 15, it is assumed that products P1 to P4 are seasonings such as soy sauce, pepper, and salt. Products P1 to P4 are placed in the first to fourth slots of sheet-type weight sensor device 9, respectively. Weight sensors W1 to W4 are provided in each slot. Antenna 91 of sheet-type weight sensor device 9 transmits weight data for each slot to an inventory management application of user terminal 3. The inventory management application is capable of registering products to be placed in the first to fourth slots of the sheet-type weight sensor device 9. In the configuration example shown in Fig. 15, the inventory management application acquires consumption information of products P1 to P4 from the antenna 91 one by one.

[0055] Although not shown, if the products are stored in a refrigerator in the user's home, a wireless tag T with a weight sensor may be attached to each product in the refrigerator. In this case, every time the user opens the refrigerator, the user's user terminal 3 receives product ID and weight data from the wireless tag T of each product in the refrigerator, and the inventory management application of the user terminal 3 acquires consumption information for each product in the refrigerator all at once. The inventory management application of the user terminal 3 sends the acquired consumption information to the inventory management server 8, and the inventory management server 8 updates the user inventory database based on the received consumption information. Furthermore, if the RFID tag T can no longer be detected, it is understood that the product to which the RFID tag T was attached has been discarded, and the product may be deleted from the user inventory database. When an RFID tag with a weight sensor is used as the wireless tag T, an RFID reader may be installed in the refrigerator to acquire consumption information via the reader.

[0056] In this embodiment, the control unit 31 of the user terminal 3 functions as an acquisition unit (an example of a third acquisition unit) that acquires consumption information relating to the consumption amount of each product included in the inventory data. The control unit 81 of the inventory management server 8 also functions as an update unit that updates the inventory data of the corresponding user in the user inventory database based on the consumption information acquired from the inventory management application of the user terminal 3.

[0057] According to the product inventory management system of this embodiment, the user inventory database stored in the inventory management server 8 is updated in response to user operations, so that inventory data reflecting actual daily consumption can be visualized on the inventory management application. At that time, the expiration date and remaining quantity of each product can be displayed on the inventory management application, so that users can consume products efficiently or in a planned manner.

[0058] (3) Third embodiment Next, a product inventory management system according to a third embodiment will be described with reference to FIGS. The product inventory management system of this embodiment is configured so that a user can view inventory data of the group to which the user belongs, other users, and other groups. For example, by allowing multiple users who make up a family to view the inventory data of the entire family, inventory data can be visualized among users who share household income, which has the advantage of preventing waste or forgetting to buy items, such as purchasing the same item multiple times within the family. Another benefit is that users can view inventory data for other users or groups who do not live with them (for example, elderly parents and their families), allowing them to check whether family members who do not live with them are eating and spending their time as usual.

[0059] Figure 16 shows an example of screen transitions of the inventory management application on the user terminal 3 in the product inventory management system of this embodiment. As an example, Figure 16 assumes that the user TK is a member of the K family and has permission to view the inventory data of his parent, the C family, who lives separately. In this case, screen G10 of user TK's inventory management application displays a button b11 for viewing the inventory of his or her own home and a button b12 for viewing the inventory of the C family, who live separately. By operating button b11, the inventory data of the K family can be viewed, as shown on screen G11. This view data is created, for example, by merging the inventory data of multiple users who are previously associated with user TK as cohabiting family members.

[0060] The sequence chart in FIG. 17 shows a flow for a specific user to obtain permission from other users to view inventory data. In FIG. 17, it is assumed that a user who wishes to view inventory data of another user has a user terminal 3-1, and the other user has a user terminal 3-2.

[0061] First, based on the user's operation, the inventory management application of the user terminal 3-1 sends a viewing request to the inventory management server 8 (step S60). The viewing request includes the user ID of another user or the group ID of another group who wants to view the inventory data. When the inventory management server 8 receives the view request, it queries the inventory management application of the user ID pre-registered as the representative of the user ID or group ID included in the view request to determine whether or not to permit viewing of the inventory data (step S62). This query is displayed on the inventory management application of the user terminal 3-2 (step S64).

[0062] When the user of user terminal 3-2 performs a response operation on the inventory management application (step S66: YES), a response is returned to inventory management server 8 (step S68). This response includes information on whether or not viewing is permitted. If the response in step S68 is permission to view (step S70: YES), inventory management server 8 updates the inventory application user database (see FIG. 6) by writing the user ID of the user who made the viewing request in the "permission to view" field of the inventory application user database (step S72). If the response in step S68 is permission not to view (step S70: NO), the inventory application user database is not updated. When the inventory management server 8 returns a permission / denial response to the inventory management application of the user terminal 3-1 that made the viewing request (step S74), the permission / denial response result is displayed on the display unit 34 of the user terminal 3-1 (step S76).

[0063] As shown in the inventory application user database in Figure 12, when a user (viewer) with a certain user ID obtains permission to view inventory data corresponding to a user (viewee) with another user ID, the other user ID is associated and recorded. The viewed user may be, for example, the viewer's elderly parents or a child living alone. In this case, by viewing the viewed user's inventory data, the viewer can indirectly monitor whether the viewed user is living a normal life. The flow of grouping multiple users, such as a family, is omitted, but the flow can be generally similar to the sequence chart in FIG. 17. Alternatively, when a family starts using the inventory management application, multiple users included in the family may be grouped and recorded in the inventory app user database. Each of multiple user IDs in the same group is associated with a common group ID in the inventory app user database. When users are grouped, inventory data can be viewed on a group basis, which can prevent, for example, multiple family members from purchasing the same product multiple times, thereby enabling efficient product inventory management within the same group.

[0064] FIG. 18 shows the screen transitions on the inventory management application when user TK, who has been given permission to view inventory data for C family, views the inventory data for C family. Screen G15 in FIG. 18 is the same as screen G10 in FIG. 16. Here, selecting button b16 switches to screen G16, where, for example, inventory data for family C, who do not live together, can be viewed. This allows the health status of family members who do not live together to be indirectly monitored. Furthermore, if monitored regularly, it is possible to know what family members who do not live together are eating every day.

[0065] The inventory management server 8 of this embodiment is configured as follows to provide inventory data for a group to users who belong to one group, such as family members living together. The registration unit 813 of the control unit 81 registers the product ID and inventory data acquired from each user in the group by the information provision unit 812 as inventory data for the group. This is equivalent to writing a value into one of the "group ID" fields in the inventory app user database and associating the user ID with the group ID. Based on a request from any user in the group, the information providing unit 812 provides the group's inventory data to the inventory management application of the user terminal 3 of that user.

[0066] The inventory management server 8 of this embodiment is configured as follows to provide the user with inventory data of other users or other groups, such as family members who live separately. The control unit 81 includes an association unit that associates multiple groups registered by the registration unit 813. Here, each associated group may include only a single user. The association is performed by writing a value to the "viewing permission" field in the inventory application user database, as shown in FIG. 17. When the first group and the second group are associated by the associating unit, the information providing unit 812 provides the inventory data of the second group to the inventory management application of any of the users of the first group.

[0067] (4) Fourth embodiment Next, a product inventory management system according to a fourth embodiment will be described with reference to FIGS. This embodiment is characterized in that the inventory management server 8 analyzes the user's product consumption status. The user inventory database is updated every time the user purchases a product, and the user inventory database is updated every time the user consumes a product. By monitoring increases and decreases in the user's inventory data, it is possible to perform analyses related to maintaining the user's health.

[0068] An example of the operation of the product inventory management system of this embodiment is shown in FIG. The sequence chart in Figure 19 assumes that analysis processing is performed periodically, for example. When the time for analysis arrives (step S80: YES), the inventory management server 8 performs analysis processing (step S82). The analysis processing is not limited to, but may be, for example, as follows. Note that, for example, when determining whether the calorie consumption or salt intake is appropriate, it is preferable to use the average consumption or intake amount for people of the same age as the user as a standard. ·Whether you are a picky eater or not · Whether the calories consumed (or ingested) are appropriate Whether your salt intake is excessive ·Is there anything that has passed its expiration date?

[0069] The calorie consumption data can be obtained by accessing a database that contains the calorie value per unit weight of each product, for example. The salt intake can be calculated by accessing a database that contains the amount of salt contained per unit weight of each product, or by obtaining consumption information corresponding to the change in weight of a bottle containing salt, as shown in Figure 15.

[0070] The inventory management server 8 determines whether the analysis results of step S82 satisfy the notification conditions for notifying the user, and if the notification conditions are satisfied (step S84: YES), it sends the analysis results to the inventory management application of the user terminal 3 (step S86). Upon receiving the analysis results, the user terminal 3 displays them on the display unit 34 (step S88). The notification conditions in step S84 are not limited, but may include, for example, when there is an abnormal trend such as when the stock of a specific product is low, when there is no change in the stock, when there is a predetermined number or more of a certain type of product that has passed its expiration date, when the average calorie consumption or salt intake is outside the appropriate range, or when vegetable consumption is below a predetermined value. In this way, by notifying a specific user when the stock or consumption amount for that user is abnormal, it is possible to indirectly monitor the health of, for example, a remote user who does not live with the user (for example, an elderly parent or a child living alone).

[0071] 20A and 20B each show an example of a screen displayed in step S88 of FIG. The screen G20a in Fig. 20A includes analysis content C1a, which is displayed when the inventory of a specific product is low, such as "Egg inventory is low," or when the salt intake is higher than the average intake, such as "The amount of soy sauce being used up is higher than usual." Screen G20b in Fig. 20B includes analysis content C1b, which is displayed when the calorie intake has changed significantly, such as "Your calorie intake has decreased by 8% compared to last week."

[0072] In the product inventory management system of this embodiment, the control unit 81 of the inventory management server 8 functions as an update unit that updates the inventory data of a specific user in the user inventory database based on consumption information acquired from the user terminal 3. The analysis unit 814 of the control unit 81 analyzes the consumption status of the user based on the inventory data. This makes it possible to analyze the consumption status of each user based on the increase or decrease in the inventory data of each individual user. By acquiring the analysis results, users can use them as an opportunity to improve their daily diet.

[0073] Furthermore, in the product inventory management system of this embodiment, the control unit 81 of the inventory management server 8 functions as an update unit that updates inventory data for a group that includes a user who owns the user terminal 3, based on consumption information acquired from the user terminal 3. The analysis unit 814 of the control unit 81 analyzes the consumption status of the group based on the group's inventory data. This makes it possible to analyze the consumption status of each group from increases and decreases in inventory data for each group. A user can obtain the analysis results of the consumption status of, for example, a family, and use this as an opportunity to improve the daily meals of the family, for example.

[0074] 19, the control unit 81 of the inventory management server 8 may function as a notification unit that notifies the user terminal 3 when the analysis results of the analysis unit 814 satisfy predetermined conditions. By limiting the analysis results to be notified to those that satisfy predetermined conditions necessary for maintaining the user's health, it is possible to prevent the notification of analysis results from becoming cumbersome.

[0075] (5) Modifications of the embodiment Next, a product inventory management system according to a modified example of the embodiment will be described.

[0076] (5-1) First Modification Because the user inventory database contains expiration date information for each product owned by the user, the inventory management server 8 may suggest a menu of dishes that can be prepared using one or more products with an upcoming expiration date. For example, the inventory management server 8 stores a recipe database that indicates the correspondence between one or more products and recipes that use the one or more products as ingredients. The control unit 81 of the inventory management server 8 refers to the inventory data of the target user to identify one or more products with an upcoming expiration date, and then refers to the recipe database to determine a recipe that can be prepared using some or all of the identified one or more products, and notifies the inventory management application of the target user. The inventory management application may be configured to allow the user to order one or more products required for the determined menu that the user does not own from the store.

[0077] (5-2) Second Modification The inventory management application can be configured to work in conjunction with a wearable device such as a smartwatch carried by the user to provide suggestions for maintaining the user's health. The wearable device sequentially acquires data on the calories burned during the user's exercise and transmits it to the server for the wearable device. The server for the wearable device provides the data on the calories burned recorded in association with the user to the inventory management server 8. The inventory management server 8 notifies the user's inventory management application of the results of an analysis (e.g., excess calories, lack of exercise, etc.) based on the user's consumption information (information on calories gained) and the information on calories expended by the user. At that time, the inventory management server 8 may send a message suggesting the amount of exercise required to maintain health, etc., based on the analysis results, to the user's inventory management application.

[0078] (5-3) Third Modification Next, a third modified example will be described. In the above-described embodiments, the method of acquiring the product ID and expiration date information from the product is described as reading the code information of the product, but the present invention is not limited to this. Another method for acquiring product IDs and expiration date information from products is to receive the product IDs and expiration date information from a wireless tag attached to the product, shelf tag, or packaging of the product, or from a wireless tag placed near the product. In this case, the communication method (e.g., communication protocol, frequency used, etc.) used for receiving the information does not matter. Examples of communication methods include RFID (Radio Frequency Identification) such as NFC (Near Field Communication), Bluetooth (registered trademark), and BLE (Bluetooth (registered trademark) Low Energy). For example, assume that an NFC tag recording the product ID and expiration date information of the product is attached to a product or shelf label, and the user terminal 3 is equipped with an NFC reader. In this case, when a user brings their user terminal 3 close to a product, the NFC reader of the user terminal 3 receives the product ID and expiration date information of the product from the product's NFC tag. The store application of the user terminal 3 sends a price inquiry including the received product ID and expiration date information of the product to the store server 5. As in the above-described embodiment, the store server 5 that receives the price inquiry determines the offering price of the product and returns information indicating the offering price to the store application.

[0079] The product ID of a product can also be identified from an image of the product's exterior. For example, if the user terminal 3 has an imaging unit, the store application transmits the product image acquired by the imaging unit to the store server 5. The store server 5 identifies the product ID of the product from the acquired product image. Artificial intelligence using a trained model can be used to identify the product ID. In this case, the product image is an example of product information. In this case, the store server 5 can be configured to access a database in which product IDs are associated with product expiration date information, and acquire the expiration date information corresponding to the identified product ID. The product ID and expiration date information of a product may be obtained by combining multiple pieces of information that can be obtained from the product. For example, the product ID and expiration date information of a product can be obtained by combining at least two or more pieces of information from the code information, text information, information obtained from a wireless tag, an image of the product's exterior, and identification information that identifies an individual product (for example, a serial number) obtained from the product or shelf tag.

[0080] Although the embodiments of the information processing system, information processing device, information processing method, and program of the present invention have been described above, the present invention is not limited to the above embodiments. Furthermore, the above embodiments can be improved or modified in various ways without departing from the spirit of the present invention. For example, the individual technical features described in the above embodiments and modifications can be combined as appropriate as long as no technical contradiction occurs.

[0081] In the above-described embodiment and variations, at least some of the functions of the store server 5 and the inventory management server 8 may be realized by software on the user terminal 3, or at least some of the functions of the user terminal 3 may be realized by software on the store server 5 and the inventory management server 8. Furthermore, the functions of the user terminal 3 and the functions of the store server 5 and the inventory management server 8 may be distributed among the user terminal 3 and the store server 5 and the inventory management server 8 as necessary. The functions executed by the store server 5 and the inventory management server 8 may be distributed and executed by multiple devices.

[0082] The information processing system of the present invention can also be applied to online purchases based on product information and expiration date information, or to bulk purchases. For example, when a user purchases online, the inventory management server obtains purchase data for the user from a server that provides online sales services and updates the user inventory database. Also, when a user purchases products in a store through bulk purchases, payment can be made using a store application based on code information affixed to the product when it is sold by weight, and a system can be constructed in which the inventory management server updates the user inventory database, similar to the case shown in FIG. 6. [Explanation of symbols]

[0083] 1...Product inventory management system 3...User terminal 31...Control unit 32…Storage 33...Operation input section 34…Display section 35...imaging unit 36...Code reader 37…Communications Department 5...Store server 51...Control unit 511...Price Information Department 512: Payment processing unit 52…Storage 53…Communications Department 7...Payment agency server 8...Inventory management server 81...Control unit 811…Information Management Department 812…Information Department 813...Registration Department 814…Analysis Department 82…Storage 83…Communications Department 9...Sheet-type weight sensor device 91...Antenna 100...Scan area C1a,C1b…Analysis content C2...Code information CT…User NW...Network P…Product

Claims

1. An information processing system including a user terminal owned by a user and an information processing device capable of communicating with the user terminal, The user terminal a first acquisition unit that acquires product information related to a product and expiration date information related to an expiration date of the product; a payment request unit that requests payment for the product from the information processing device based on the product information and the expiration date information acquired by the first acquisition unit; a display control unit that displays the product inventory information of the user acquired from the information processing device on a display unit, The information processing device includes: a second acquisition unit that updates the product information and expiration date information of the product that has been paid for in response to a payment request for the product from the user terminal as product inventory information of the user for each user identification information that identifies the user using the user terminal, and acquires the updated product inventory information of the user; a providing unit that provides the product inventory information of the user obtained by the second obtaining unit to the user terminal based on a request from the user, Information processing system.

2. The information processing device includes: a registration unit for registering one or more users into one group; the registration unit registers the product information and expiration date information acquired from each user in the group by the second acquisition unit as product inventory information of the group; the providing unit provides the product inventory information of the group to the user terminal of any one of the users in the group based on a request from that user.

2. An information processing system according to claim 1.

3. an association unit that associates the plurality of groups registered by the registration unit; the providing unit provides product inventory information of the second group to any user of the first group when the first group and the second group are associated by the associating unit; 3. An information processing system according to claim 2.

4. the user terminal includes a third acquisition unit that acquires consumption information regarding the consumption amount of each commodity included in the commodity inventory information, The information processing device includes: an updating unit that updates the product inventory information based on the consumption information acquired from the user terminal; an analysis unit that analyzes the consumption status of the user based on the product inventory information, 2. An information processing system according to claim 1.

5. the user terminal includes a third acquisition unit that acquires consumption information regarding the consumption amount of each commodity included in the commodity inventory information, The information processing device includes: an updating unit that updates product inventory information of a group that includes the user who owns the user terminal, based on the consumption information acquired from the user terminal; and an analysis unit that analyzes the consumption status of the group based on the product inventory information of the group.

5. An information processing system according to claim 3 or 4.

6. The information processing device includes a notification unit that notifies the user terminal when the analysis result of the analysis unit satisfies a predetermined condition.

6. An information processing system according to claim 4 or 5.

7. a communication device that detects the weight of the product and communicates with the user terminal; the third acquisition unit acquires the consumption information based on a weight value detected by the communication device.

7. An information processing system according to claim 4.

8. An information processing device capable of communicating with a user terminal held by a user, an acquisition unit that acquires product information and expiration date information regarding the product acquired by the user terminal when the product has been paid for by the user; a storage unit that stores the product information and the expiration date information acquired by the acquisition unit as product inventory information of the user; a providing unit that provides the product inventory information of the user stored in the storage unit to the user terminal based on a request from the user; Equipped with An information processing device in which the product inventory information is updated for each user identification information that identifies the user using the user terminal in response to a payment request for the product from the user terminal.

9. An information processing method carried out between a user terminal owned by a user and an information processing device capable of communicating with the user terminal, The user terminal acquires product information regarding the product and expiration date information regarding the expiration date of the product, the user terminal requests the information processing device to settle the payment for the product based on the acquired product information and the expiration date information; the information processing device updates the product information and the expiration date information of the product that has been paid for in response to a payment request for the product from the user terminal as product inventory information of the user for each user identification information that identifies the user using the user terminal, and acquires the updated product inventory information of the user; the information processing device provides the acquired product inventory information of the user to the user terminal based on a request from the user; the user terminal displays the product inventory information of the user acquired from the information processing device on a display unit; Information processing methods.

10. A program that causes a computer to execute a predetermined method in an information processing device that can communicate with a user terminal owned by a user, The method comprises: If the product has been paid for by the user, acquiring product information and expiration date information regarding the product acquired by the user terminal; In response to a payment request for the product from the user terminal, the product information and the expiration date information for the product that has been paid for are updated as product inventory information for the user for each user identification information that identifies the user using the user terminal, and the updated product inventory information for the user is stored in a storage unit; and providing the product inventory information of the user stored in the storage unit to the user terminal based on a request from the user; program.

Images