Information processing device, information processing method, recording medium, and information processing system

Abstract

This information processing device includes: a user information acquisition unit for acquiring user information of a user; a first position information acquisition unit for acquiring first position information indicating position information of an accommodating container in a store at the time a commodity is placed in the accommodating container that accommodates a commodity to be settled for payment; a second position information acquisition unit for acquiring second position information indicating a display position of the commodity in the store; and a storage processing unit for determining whether or not to output information on the commodity to the user on the basis of the relative positions of the first position information and the second position information, and when determined to be outputted, causing a storage device to store information indicating it is determined that notification information on the commodity be outputted, in association with the user information of the user.

Description

Information processing device, information processing method, recording medium, and information processing system

[0001] The present invention relates to an information processing device, an information processing method, a recording medium, and an information processing system.

[0002] Various devices have been proposed to prevent users from forgetting to buy products in stores. One example of a device for preventing users from forgetting to buy products is described in Patent Document 1. The device described in Patent Document 1 notifies a user that there are products that have not been purchased if the user forgets to purchase a product that was written in a shopping memo.

[0003] Japanese Patent Application Laid-Open No. 2015-55977

[0004] In the above-mentioned Patent Document 1, it is assumed that the user creates a shopping memo in advance, so if the user does not create a shopping memo, it is not possible to prevent forgetting to buy something.

[0005] The information processing device of the present disclosure comprises: a user information acquisition means for acquiring user information of a user; a first location information acquisition means for acquiring first location information indicating the location information of a storage container containing the product to be checked out in the store when the product is placed in the storage container; a second location information acquisition means for acquiring second location information indicating the display position of the product in the store; and a storage processing means for determining whether or not information regarding the product should be output to the user based on the relative positions of the first location information and the second location information, and if it is determined that information should be output, storing information indicating that it has been determined that notification information regarding the product should be output in a storage means in association with the user information of the user.

[0006] The information processing system of the present disclosure comprises a communication device used by a user and an information processing device, wherein the information processing device has: a user information acquisition means for acquiring user information of the user; a first location information acquisition means for acquiring first location information indicating the location information of a storage container containing the product to be checked out in the store when the product is placed in the storage container; a second location information acquisition means for acquiring second location information indicating the display location of the product in the store; and a storage processing means for determining whether or not information about the product should be output to the user based on the relative positions of the first location information and the second location information, and if it is determined that information about the product should be output, storing information indicating that it has been determined that information about the product should be output in a storage means in association with the user information of the user, wherein the storage means is at least one of a storage device of the communication device and a storage device of the information processing device.

[0007] The information processing method of the present disclosure includes one or more computers acquiring user information of a user, acquiring first location information indicating the location information of a storage container in the store when the product was placed in a storage container that holds the product to be checked out, acquiring second location information indicating the display location of the product in the store, and determining whether or not information about the product should be output to the user based on the relative positions of the first location information and the second location information, and if it is determined that information should be output, storing information indicating that it has been determined that notification information about the product should be output in a storage means, in association with the user information of the user.

[0008] The recording medium in the present disclosure is a computer-readable recording medium having recorded thereon a program for causing a computer to execute: a user information acquisition process for acquiring user information of a user; a first location information acquisition process for acquiring first location information indicating the location information of a storage container in the store when the product is placed in a storage container that holds the product to be checked out; a second location information acquisition process for acquiring second location information indicating the display location of the product in the store; and a storage process for determining whether or not information about the product should be output to the user based on the relative positions of the first location information and the second location information, and if it is determined that information should be output, storing information indicating that it has been determined that notification information about the product should be output in a storage means in association with the user information of the user.

[0009] According to the present disclosure, it is possible to obtain an information processing device, an information processing method, a recording medium, and an information processing system that can identify products that a user is likely to forget to buy.

[0010] 1 is a block diagram showing a configuration of an information processing device according to the present disclosure. FIG. 2 is a diagram showing an example of the data structure of recommendation information. FIG. 3 is a flowchart showing the processing operation of an information processing device according to the present disclosure. FIG. 4 is a conceptual diagram showing an example of the configuration of an information processing system according to the present disclosure. FIG. 5 is a diagram for explaining an example of use of an information processing system in a store. FIG. 6 is a block diagram showing an example of the configuration of a computer realizing the information processing device according to the present disclosure. FIG. 7 is a diagram showing an example of the data structure of product registration information. FIG. 8 is a diagram showing an example of the data structure of display position information. FIG. 9 is a diagram showing an example of the data structure of beacon information. FIG. 10 is a diagram showing an example of the data structure of position information. FIG. 11 is a block diagram showing a configuration of a second information processing device according to the present disclosure. FIG. 12 is a flowchart showing the processing operation of an information processing device according to the present disclosure. FIG. 13 is a block diagram showing a configuration of a third information processing device according to the present disclosure. FIG. 14 is a flowchart showing the processing operation of an information processing device according to the present disclosure. FIG. 15 is a block diagram showing a configuration of a fourth information processing device according to the present disclosure. FIG. 16 is a diagram showing an example of the data structure of product information. FIG. 17 is a conceptual diagram showing an example of the configuration of a second information processing system according to the present disclosure. FIG. 18 is a conceptual diagram showing an example of the configuration of a third information processing system according to the present disclosure.

[0011] Hereinafter, in this disclosure, the drawings relate to one or more embodiments. In all drawings, similar components are denoted by similar reference numerals, and descriptions thereof will be omitted as appropriate. In each of the following drawings, configurations of parts that are not related to the essence of this disclosure are omitted and are not shown.

[0012] In the present disclosure, "acquisition" includes at least one of the following: a device going to retrieve data or information stored in another device or storage medium (active acquisition); and a device inputting data or information output from another device (passive acquisition). Examples of active acquisition include making a request or inquiry to another device and receiving a response, and accessing and reading information from another device or storage medium. Examples of passive acquisition include receiving information that is distributed (or transmitted, push notification, etc.). Furthermore, "acquisition" may also mean selecting and acquiring data or information from received data or information, or selecting and receiving distributed data or information.

[0013] <Example of Functional Configuration> As shown in FIG. 1 , the information processing device 100 includes a user information acquisition unit 102, a first location information acquisition unit 104, a second location information acquisition unit 106, and a storage processing unit 108. The user information acquisition unit 102 acquires user information of a user. A user is a customer who visits a store. The first location information acquisition unit 104 acquires first location information indicating the location of a storage container in the store when the product to be checked out was placed in the storage container. The storage container is, for example, a shopping cart. The second location information acquisition unit 106 acquires second location information indicating the display position of the product in the store. The storage processing unit 108 determines whether information about the product should be output to the user based on the relative positions of the first location information and the second location information. If the storage processing unit 108 determines that information should be output, it associates information indicating that notification information about the product should be output with the user information of the user and stores the information in a storage unit (e.g., the storage device 120 described below).

[0014] The storage processing unit 108 stores, for example, information about the product to be notified as recommendation information 130 (Figure 2) in the memory 1030 or storage device 1040 of at least one computer 1000 among the storage device 120, the information processing device 100, the first communication device 200, and the second communication device 300, as notification information about the product.

[0015] Similarly, various pieces of information described below may be stored in memory 1030 or storage device 1040 of at least one computer 1000 among storage device 120, information processing device 100, first communication device 200, and second communication device 300. In the following description, "stored in storage device 120" is used, but this description is intended to mean "stored in memory 1030 or storage device 1040 of at least one computer 1000 among storage device 120, information processing device 100, first communication device 200, and second communication device 300."

[0016] 2, the recommendation information 130 stores information that can identify a user (e.g., identification information, hereinafter also referred to as a user ID) in association with information about a product to be notified (referred to as product information in the figure). The product information may be information that can identify a product that has been identified as one for which information should be output (e.g., a product code, etc.), or may be information such as a product name.

[0017] <Operation Example> As shown in Fig. 3, the information processing device 100 operates as follows. The user information acquisition unit 102 acquires user information of a user (step S101). For example, this process begins after the user enters a store. Then, the processes from step S103 onward are repeated, for example, until the user completes the payment process for the purchased items. The first location information acquisition unit 104 acquires first location information indicating the location information of a storage container in the store when the item to be checked out was placed in the storage container (step S103). Then, the second location information acquisition unit 106 acquires second location information indicating the display position of the item in the store (step S105).

[0018] The storage processing unit 108 determines whether or not information about the product should be output to the user based on the relative positions of the first location information and the second location information (step S107). If it is determined that information should be output (YES in step S109), the storage processing unit 108 associates information indicating that notification information about the product should be output with the user information of the user and stores the information in the storage unit (step S111), and returns to step S103. If it is not determined that notification information should be output (NO in step S109), step S111 is bypassed and the process returns to step S103.

[0019] According to this information processing device 100, the storage processing unit 108 determines whether or not to output information about the product to the user based on the relative position between the first location information acquired by the first location information acquisition unit 104 when the product was added to the cart and the second location information acquired by the second location information acquisition unit 106, which indicates the display position of the product. If the storage processing unit 108 determines that information should be output, it can associate information indicating that notification information about the product should be output with the user information of the user and store it in storage means (storage device 120). In this way, according to the present disclosure, it is possible to obtain an information processing device, information processing method, recording medium, and information processing system that can identify products that users are likely to forget to buy.

[0020] A detailed example of the information processing device 100 will be described below.

[0021] First Embodiment <System Overview> In the information processing system 1, the information processing device 100 identifies and records products that are likely to have been previously forgotten to be purchased by a user in a store. The information processing device 100 uses this recorded information to notify the user about the product so that they do not forget to buy it, and by presenting this information to employees or managers of the store 50, it can be used to improve the display method and sales promotion method of the product.

[0022] 4, the information processing system 1 includes an information processing device 100, a first communication device 200, a second communication device 300, and a beacon transmitter 10. The information processing device 100, the first communication device 200, and the second communication device 300 are connected to each other via a communication network 3. However, the communication network 3 connecting the devices does not have to be a single network. The communication network 3 may be a combination of multiple different networks.

[0023] The information processing device 100 includes a storage device 120. The storage device 120 may be provided inside or outside the information processing device 100. In other words, the storage device 120 may be hardware that is integrated with the information processing device 100, or may be hardware that is separate from the information processing device 100.

[0024] The information processing device 100 is a computer such as a personal computer or a server computer. The information processing device 100 may be a computer (standalone type) installed in a store. Alternatively, the information processing device 100 may be a server computer installed separately from the store and connected to the first communication device 200 and the second communication device 300 via a communication network 3. Alternatively, the information processing device 100 may be a web server that cooperates with the server computer to provide a website that provides the services of the information processing system 1.

[0025] When the information processing device 100 is a stand-alone computer, an application program that realizes the information processing device 100 of the information processing system 1 is installed on the computer. Then, the computer is made to execute the application program, thereby realizing the functions of the information processing device 100.

[0026] The first communication device 200 is a terminal device provided in a cart 20, which is a container for storing products to be paid for at the store, and operated by a customer of the store. The first communication device 200 is, for example, a computer such as a smartphone or a tablet terminal. Alternatively, the first communication device 200 may be a device dedicated to the cart 20, or may be realized as a chip or terminal device incorporated in a dedicated device. A predetermined program is installed in the first communication device 200. Then, by having the first communication device 200 execute the program, the first communication device 200 cooperates with the information processing device 100 to realize some of the functions of the information processing device 100.

[0027] Alternatively, a browser may be launched on the first communication device 200, causing the user U to access a predetermined website provided by the information processing system 1, and allowing the user to use the service provided by the information processing system 1 on the first communication device 200. In either the application or the website, the user can use the service of the information processing system 1 on the first communication device 200 by logging in to the information processing system 1 using a predetermined account using the first communication device 200. Here, the predetermined account is an account for the store 50 that is registered in advance at the store 50. It is assumed that the launch of the application or access to the website on the first communication device 200 has been completed by an operator of the store 50 before the user U uses the cart 20.

[0028] The second communication device 300 is a portable terminal device used by a user. The second communication device 300 is, for example, a computer such as a smartphone, a tablet terminal, or a personal computer. A predetermined program is installed in the second communication device 300. Then, by causing the second communication device 300 to execute the program, the second communication device 300 cooperates with the information processing device 100 to realize some of the functions of the information processing device 100.

[0029] The second communication device 300 may also realize the functions of the first communication device 200 (for example, the process of detecting and identifying products placed in the cart 20) by installing a program that realizes the functions of the first communication device 200. The second communication device 300 may be attached to a predetermined position on the cart 20 in place of the first communication device 200, and may perform the process of detecting and identifying products placed in the cart 20 using the camera of the first communication device 200.

[0030] A predetermined program is installed in the second communication device 300. Then, by having the second communication device 300 execute the program, the user can use the service provided by the information processing system 1. Alternatively, a browser may be started in the second communication device 300, and the user may access a predetermined website provided by the information processing system 1, thereby using the service provided by the information processing system 1. In either the application or the website, the user may use the service of the information processing system 1 by logging in to the information processing system 1 using a predetermined account using the second communication device 300. Furthermore, the information processing system 1 may register biometric authentication information of the user U in advance and perform authentication processing using the biometric authentication information.

[0031] The beacon transmitter 10 may be, for example, one that transmits a beacon through communication conforming to the Bluetooth (registered trademark) standard, or one that is included in an access point (not shown) for wireless LAN (Local Area Network) communication, so-called Wi-Fi (Wireless Fidelity) communication, and transmits a beacon.

[0032] As shown in FIG. 5 , a plurality of beacon transmitters 10 are installed in a store 50. Each beacon transmitter 10 transmits a beacon within a predetermined range of communication range. It is preferable to adjust the predetermined range so that the communication ranges of each beacon transmitter 10 do not overlap as much as possible. However, the communication ranges of each beacon transmitter 10 may overlap. In the overlapping area, the first communication device 200 or the second communication device 300 (hereinafter also referred to as a communication device) may receive multiple beacons. The beacons are used to identify the location information of each communication device. A method for identifying location information will be described later.

[0033] User U enters store 50 through entrance 52, moves through the store with cart 20 from position P1 to position P6, places the products 30 to be purchased in cart 20, and heads to checkout area 54. While moving through store 50, the communication device receives beacons transmitted by beacon transmitters 10. Using the beacons received by the communication device, information processing device 100 can identify the location of user U as he moves through store 50.

[0034] When shopping at a supermarket or other location, a user may pass by an area where a product they intended to purchase is displayed, only to realize they forgot it and ask a companion to go to the display location to retrieve it. For example, assume that user U arrives at location P6 in FIG. 5 and asks a companion to retrieve product 30 that they realized they forgot. The information processing device 100 identifies the location where product 30 was placed in the cart 20 (first location information) and the location where product 30 is displayed (second location information). If the distance between the first location information and the second location information is greater than or equal to a reference value, product 30 is likely to be a product that user U forgot to purchase. Therefore, the information processing device 100 records information about product 30 as a product 30 that user U is likely to forget to purchase so that it can be output, for example, the next time the user visits the store. To this end, the information processing device 100 determines whether or not to output information about the product to user U. If it determines that information should be output, it stores information indicating that notification information about the product should be output.

[0035] <Hardware Configuration Example> Fig. 6 is a block diagram illustrating a hardware configuration of a computer 1000 that realizes the information processing device 100 according to the present disclosure. The first communication device 200 and the second communication device 300 in Fig. 4 are also realized by the computer 1000. The beacon transmitter 10 in Fig. 4 is also realized by a computer. The functions of the information processing device 100 may be shared and realized by the computers 1000 of the first communication device 200 and the second communication device 300 and the computer 1000 of the information processing device 100. Furthermore, a third communication device 400, which will be described later, is also realized by the computer 1000.

[0036] The computer 1000 has a bus 1010 , a processor 1020 , a memory 1030 , a storage device 1040 , an input / output interface 1050 , and a network interface 1060 .

[0037] The bus 1010 is a data transmission path for transmitting and receiving data among the processor 1020, memory 1030, storage device 1040, input / output interface 1050, and network interface 1060. However, the method of connecting the processor 1020 and the like to each other is not limited to bus connection.

[0038] The processor 1020 is implemented by a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or the like.

[0039] The memory 1030 is a main storage device realized by a RAM (Random Access Memory) or the like.

[0040] The storage device 1040 is an auxiliary storage device realized by a hard disk drive (HDD), a solid state drive (SSD), a memory card, a read-only memory (ROM), or the like. The storage device 1040 stores program modules that realize each function of the information processing device 100 (e.g., the user information acquisition unit 102, the first location information acquisition unit 104, the second location information acquisition unit 106, the storage processing unit 108, the output unit 110, the determination unit 112, the product information acquisition unit 114, etc.). The processor 1020 loads each of these program modules into the memory 1030 and executes them, thereby realizing each function corresponding to the program module. The storage device 1040 may also store each data of the storage device 120 of the information processing device 100.

[0041] The program module may be recorded on a recording medium. The recording medium on which the program module is recorded may include a non-transitory, tangible medium usable by the computer 1000, and the program code readable by the computer 1000 (processor 1020) may be embedded in the medium.

[0042] The input / output interface 1050 is an interface for connecting the computer 1000 with various input / output devices. The input / output interface 1050 also functions as a communication interface for performing short-range wireless communication such as Bluetooth (registered trademark) and NFC (Near Field Communication).

[0043] The network interface 1060 is an interface for connecting the computer 1000 to a communication network 3. This communication network 3 is, for example, a local area network (LAN) or a wide area network (WAN). Furthermore, the communication network 3 may include a mobile communication network. The method for connecting the network interface 1060 to the communication network 3 may be a wireless connection or a wired connection.

[0044] The computer 1000 is then connected to necessary devices (e.g., a display, touch panel, operation buttons, touchpad, keyboard, mouse, speaker, microphone, camera, printer, etc. of the information processing device 100, a display, touch panel, touchpad, operation buttons, keyboard, mouse, speaker, microphone, camera, printer, etc. of the second communication device 300 and the third communication device 400, and a display, touch panel, touchpad, operation buttons, keyboard, speaker, microphone, camera, code reader, printer, etc. of the first communication device 200) via the input / output interface 1050 or the network interface 1060.

[0045] Each component of the information processing device 100 according to the present disclosure in each figure is realized by any combination of hardware and software of the computer 1000 in Figure 6. Those skilled in the art will understand that there are various variations in the realization method and device. The functional block diagrams showing the information processing device 100 according to the present disclosure in each figure show blocks of logical functional units, rather than a configuration of hardware units.

[0046] <Example of Functional Configuration> The following will be described with reference to Fig. 1. The information processing device 100 includes a user information acquisition unit 102, a first location information acquisition unit 104, a second location information acquisition unit 106, and a storage processing unit 108. The user information acquisition unit 102 acquires user information of a user U. When the user information acquisition unit 102 detects that the user U is in the store 50, it acquires the user information of the user U.

[0047] As described above, the user U registers in advance to use the services provided by the information processing system 1. The user U's account information (e.g., a username (user ID) and password) is registered in the information processing device 100 and stored in the storage device 120. Alternatively, the account information may be linked to account information of an existing SNS (Social Networking Service) so that the account information can be used in the information processing system 1. The user U installs and launches a dedicated application on the second communication device 300, and then logs in to the information processing system 1 using the user-registered account information, thereby becoming able to use the services provided by the information processing system 1. If the user U successfully logs in after installing the dedicated application for the information processing system 1, the user U's account information (user ID) is preferably registered in the application. The registered user ID is also stored in the memory 1030 or the storage device 1040 of the second communication device 300.

[0048] The user information acquisition unit 102 acquires the user ID (hereinafter referred to as the user ID) registered in the application from the second communication device 300 as user information.

[0049] The user ID is registered in an application installed on the second communication device 300 of the user U. The registered user ID of the user U is recorded, for example, in at least one of a code image (a barcode, a two-dimensional code, etc.), an RFID (Radio Frequency Identification), a magnetic card, etc. A code image recording the user ID is displayed on the display of the second communication device 300 (for example, a smartphone, etc.) used by the user U. The first communication device 200 installed on the cart 20 may read and obtain the user ID from the displayed code image using a code reader or a camera.

[0050] The display is, for example, a liquid crystal display, an organic EL (Electro-Luminescence) display, etc. The display may be a touch panel having an operation reception function.

[0051] Furthermore, the user ID may be recorded on a recording medium such as a membership card distributed by store 50. The membership card may have alphanumeric characters (which may include symbols and letters) indicating the user ID printed on one side, or may have a code image recording the user ID printed on it, or the user ID may be recorded on a magnetic stripe or IC chip. The first communication device 200 can read and acquire the user ID from the recording medium using a reader or camera.

[0052] The user information acquisition unit 102 acquires the user ID read by the first communication device 200 from the first communication device 200 .

[0053] Alternatively, when user U enters store 50, he or she may perform an operation indicating that he or she has entered the store in the operation menu of first communication device 200 or second communication device 300. In response to receiving this operation, first communication device 200 or second communication device 300 may transmit the ID of the user who entered store 50 to information processing device 100. When transmitting the user ID from second communication device 300 to information processing device 100, it is preferable to transmit information indicating the store 50 in which user U is currently located together with the user ID. Note that the information indicating the store 50 in which user U is currently located may be included, for example, in a beacon transmitted from beacon transmitter 10 installed at entrance 52. Second communication device 300 acquires information capable of identifying store 50, which is included in the beacon received from beacon transmitter 10, and transmits the information to information processing device 100.

[0054] The user information acquisition unit 102 acquires the user information transmitted from the first communication device 200 or the second communication device 300 .

[0055] The first location information acquisition unit 104 acquires first location information indicating the location of a storage container in the store when the product is placed in the storage container that holds the product to be checked out. The storage container is a cart 20. The first location information acquisition unit 104 acquires the first location information each time a product is placed in the cart 20. A method for detecting that a product has been placed in the cart 20 will be described later.

[0056] There are various possible methods for the first location information acquisition unit 104 to acquire the first location information, including, but not limited to, the following examples: (a1) Acquire location information using a GPS (Global Positioning System) receiver of the first communication device 200 or the second communication device 300; (a2) Acquire location information from a beacon signal received from the beacon transmitter 10; (a3) ​​After detecting the entry of user U using a camera 5 (described in an embodiment below) in the store 50, identify the location by tracking the movement of user U within the store 50 by processing images captured by the camera 5; (a4) Identify the location of user U by processing images captured by a camera (not shown) installed in the cart 20. For example, information indicating the sales area or location (such as characters or code information) displayed on the display shelf 40 is acquired by image processing.

[0057] The following describes the case where the method (a2) is used. The first location information acquisition unit 104 acquires the first location information using information received from a plurality of beacon transmitters 10 (information transmission means) installed in the store 50, the communication device of which is moving with the user U.

[0058] The beacon includes location information, and the first communication device 200 or the second communication device 300 (hereinafter also simply referred to as a communication device) acquires the location information from the received beacon and transmits it to the information processing device 100. Alternatively, the beacon may include identification information such as an IP (Internet Protocol) address instead of location information.

[0059] The information processing device 100 associates the identification information (hereinafter also referred to as a beacon ID) of the beacon transmitter 10 with the location information, and stores the associated information as beacon information 160 in the storage device 120. The beacon information 160 stores the beacon ID and the location information of the beacon transmitter 10 for each beacon transmitter 10 in association with each other.

[0060] The location information of the beacon transmitter 10 is exemplified below, but is not limited to these. In addition, a combination of the following location information may be used. (b1) Information that can identify the display shelf 40 included in the communication range of the beacon transmitter 10 (for example, identification information of the display shelf 40 (which may be an entire fixture including multiple display shelves)) (b2) Information that can identify the area where the display shelf 40 of (b1) is installed (for example, identification information of the sales floor)

[0061] The communication device may transmit the beacon ID acquired from the beacon to the information processing device 100, and the information processing device 100 may identify the location information from the beacon ID. In other words, the beacon transmitter 10 transmits a beacon including information that can identify the location information of its surroundings.

[0062] Furthermore, the beacon may not include either location information or identification information. The communication device may acquire location information using a Global Positioning System (GPS) receiving function of the communication device upon receiving a beacon, and transmit the location information of the communication device to the information processing device 100. Alternatively, the communication device may notify the information processing device 100 of the reception of the beacon upon receiving the beacon. Upon receiving the notification, the information processing device 100 may identify the location information of the communication device based on, for example, information on the location registration of the communication device in a mobile communication network (not shown). In this case, the information processing device 100 accepts in advance registration of the telephone number of the smartphone, which is the second communication device 300 used by the user, and stores the telephone number as user information in the storage device 120. The first location information acquisition unit 104 acquires the telephone number corresponding to the user information acquired by the user information acquisition unit 102, and identifies the location information of the communication device based on the location registration information of the communication device.

[0063] The second location information acquisition unit 106 acquires second location information indicating the display position of the product in the store. Specifically, the product information acquisition unit 114, which will be described in an embodiment later, detects that the product has been placed in the cart 20.

[0064] Each time it is detected that a product has been placed in the cart 20, the second location information acquisition unit 106 acquires second location information indicating the display location of the product. The information processing device 100 stores display location information 150 of FIG. 8 indicating the display location of the product in the storage device 120. The display location information 150 stores, for each product, a product code and location information indicating the display location in association with each other. Various location information indicating the display location are possible, and examples are shown below, but are not limited to these. Multiple pieces of location information below may be used in combination. (c1) Information that can identify the display shelf 40 on which the product is displayed (for example, identification information of the display shelf 40 (which may be an entire fixture including multiple display shelves)) (c2) Information that can identify the area in which the display shelf 40 is installed (for example, identification information of the sales floor) (c3) Information that can identify the beacon transmitter 10 whose communication range is the location where the product is displayed (for example, identification information of the beacon transmitter 10)

[0065] The first location information acquired by the first location information acquisition unit 104 and the second location information acquired by the second location information acquisition unit 106 are each stored in the storage device 120 as location information 170 in FIG. 10 . The location information 170 in FIG. 10 stores, for each user U, a user ID, date and time, information capable of identifying a product (e.g., a product code), first location information, and second location information in association with each other. Furthermore, the location information 170 may store the distance between the first location information and the second location information identified from the first location information and the second location information. The date and time may be the time of entry into the store 50, or may be information indicating the time the product code was read each time the product code was read. The product code, each piece of location information, and the distance are stored in the location information 170 for each product added to the cart 20.

[0066] The storage processing unit 108 determines whether or not to output information about the product to the user based on the relative positions of the first location information and the second location information. If the storage processing unit 108 determines that the product should be output, the storage processing unit 108 stores information indicating that it has determined that notification information about the product should be output in a storage unit (for example, the storage device 120 described below) in association with the user information of the user.

[0067] <Operation Example> The following will be described with reference to FIG. 3. The user information acquisition unit 102 acquires user information of a user (step S101). For example, this process begins after user U enters the store. Then, the process from step S103 onward is repeated, for example, until user U completes the payment process for the purchased items in the checkout area 54. The first location information acquisition unit 104 acquires first location information indicating the location information of a container in the store when the items were placed in the container (step S103). Then, the second location information acquisition unit 106 acquires second location information indicating the display position of the items in the store (step S105).

[0068] The storage processing unit 108 determines whether or not information about the product should be output to the user based on the relative positions of the first location information and the second location information (step S107). If it is determined that information should be output (YES in step S109), the storage processing unit 108 associates information indicating that notification information about the product should be output with the user information of the user and stores the information in the storage unit (step S111), and returns to step S103. If it is not determined that notification information should be output (NO in step S109), step S111 is bypassed and the process returns to step S103.

[0069] In the information processing device 100 according to the present disclosure, the storage processing unit 108 determines whether or not to output information about the product to the user based on the relative positions of the first location information acquired by the first location information acquisition unit 104 when the product was added to the cart and the second location information indicating the display position of the product acquired by the second location information acquisition unit 106. If the storage processing unit 108 determines that information should be output, it associates information indicating that notification information about the product should be output with the user information of the user and stores it in storage means (storage device 120). In this way, according to the present disclosure, it is possible to obtain an information processing device, information processing method, recording medium, and information processing system that can identify products that users are likely to forget to buy.

[0070] Second Embodiment A second information processing device 100 according to the present disclosure shown in Fig. 11 is the same as the information processing device 100 shown in Fig. 1 except that it further includes a determination unit 112. Note that the elements shown in Fig. 11 may be combined with the elements of one or more embodiments to the extent that no contradiction occurs.

[0071] <Example of functional configuration> As shown in Figure 11, the information processing device 100 has the same user information acquisition unit 102, first location information acquisition unit 104, second location information acquisition unit 106, and memory processing unit 108 as in Figure 1, and further has a determination unit 112.

[0072] The determination unit 112 determines whether the distance between the first location information and the second location information is equal to or greater than a reference value. If the determination unit 112 determines that the distance between the first location information and the second location information is equal to or greater than the reference value, the storage processing unit 108 determines that information about the product should be output.

[0073] <Operation Example> As shown in Fig. 12, the information processing device 100 operates as follows. The flow in Fig. 12 is executed in step S107 in Fig. 3. The determination unit 112 determines whether the distance between the first location information acquired by the first location information acquisition unit 104 and the second location information acquired by the second location information acquisition unit 106 is equal to or greater than a reference value (step S131).

[0074] If the distance is equal to or greater than the reference value (YES in step S131), the process proceeds to step S133. If the distance is less than the reference value (NO in step S131), the process bypasses step S133 and returns to step S109 in Fig. 3. In step S133, the storage processing unit 108 determines, based on the determination result of the determination unit 112, that information about the product should be output.

[0075] As described above, in the information processing device 100 of this embodiment, the determination unit 112 determines whether the distance between the first location information acquired by the first location information acquisition unit 104 and the second location information acquired by the second location information acquisition unit 106 is equal to or greater than a reference value. Then, when the determination unit 112 determines that the distance between the first location information and the second location information is equal to or greater than the reference value, the storage processing unit 108 determines that information about the product should be output. Thus, the information processing device 100 of this embodiment not only achieves the same effects as the above-described embodiment, but also determines that the product is likely to have been forgotten to be purchased when it is determined that the distance between the first location information when the product was added to the cart and the second location information indicating the display position of the product is equal to or greater than a reference value, thereby enabling accurate identification of products that are likely to have been forgotten to be purchased.

[0076] (Third embodiment) A third information processing device 100 in Fig. 13 according to the present disclosure is the same as the information processing device 100 in Fig. 1 except that it further includes an output unit 110. Note that each element in Fig. 13 may be combined with each element in one or more embodiments to the extent that no contradiction occurs.

[0077] <Example of functional configuration> As shown in FIG. 13, the information processing device 100 has the same user information acquisition unit 102, first location information acquisition unit 104, second location information acquisition unit 106, and memory processing unit 108 as in FIG. 1, and further has an output unit 110.

[0078] When information indicating that it has been determined that information regarding a product should be output is stored in the memory device 120, the output unit 110 outputs notification information regarding the product for which it has been determined that information should be output to the communication device used by the user U (the first communication device 200 or the second communication device 300).

[0079] The communication device to which the output unit 110 outputs is the first communication device 200 attached to the container (store 50) containing the product to be settled, or the second communication device 300 carried by the user U.

[0080] The output unit 110 displays the notification information on the display of the first communication device 200 or the second communication device 300, for example. In the case of the first communication device 200, the notification information is displayed, for example, as a pop-up. In the case of the second communication device 300, the notification information is notified by a display indicating that an application has a notification, a display on the standby screen, a display on the notification screen (banner display, list display, etc.), or the like.

[0081] The notification information includes information recommending the purchase of a product indicated by the product information stored in the recommendation information 130, based on the product information stored in the recommendation information 130. The product information stored in the recommendation information 130 is information indicating a product that the user U is likely to have forgotten to purchase the last time they visited the store.

[0082] The notification information includes at least the product name of the recommended product. Furthermore, the notification information preferably includes information indicating the display location of the product. The notification information may also include the selling price of the product, promotional information for the product (such as sale prices, discounts, and campaigns), the number of units purchased the previous time, and information indicating the date and time of the last check (which may be the date or information indicating how many days ago). Furthermore, the notification information may include information regarding other products recommended for purchase together with the product. For example, the notification information may include information regarding other products purchased together with the product by the user U or other people, identified using purchase history information.

[0083] The recommendation information 130 may further include information indicating the date and time, and may be accumulated as history information. The output unit 110 may output the recommendation information 130 by including product information recorded a predetermined number of times or more within a predetermined period in the notification information. This allows the user U to recommend products that are particularly likely to be forgotten to purchase. The output unit 110 may also include information indicating that the product is particularly likely to be forgotten to purchase (such as by adding a comment or an emphasis mark, or by highlighting the product) in the notification information.

[0084] The output unit 110 outputs the notification information when the user U enters the store 50. Furthermore, the output unit 110 may output the communication information at a predetermined timing while the user U is shopping in the store 50. The predetermined timing is when the user U approaches the display location of the product that is the subject of the notification, as described below.

[0085] In addition, the output unit 110 outputs notification information to a communication device (first communication device 200 or second communication device 300) traveling with the user U when the positional relationship between the display location in the store of the product for which information should be output and the cart 20 (storage container) meets a criterion.

[0086] At this time, the output unit 110 may output an alert as notification information to the user U informing him or her that the user U is near a product display location.

[0087] As another example, the output unit 110 may accept an operation instructing the user to view information about a product for which information should be output, via an operation menu of the first communication device 200 or the second communication device 300. In response to accepting the operation, the output unit 110 may display the notification information on the display of the first communication device 200 or the second communication device 300. The notification information may include information indicating that the product for which information should be output is a product that the user forgot to buy last time. Furthermore, the notification information may include a message recommending the purchase of the product for which information should be output. For example, the notification information may include messages such as "It seems you forgot to buy this product last time," "Did you forget to buy this product?", or "Would you like to purchase this product?" along with information about the product for which information should be output. The product information included in the notification information may include, for example, the product name, information indicating the product's display location, the product price, and promotional information for the day (e.g., discount amount (discount percentage), bargain information, whether or not a campaign is running, etc.).

[0088] <Operation Example> <<Processing Upon Entering a Store>> As shown in FIG. 14 , the information processing device 100 operates as follows. This process is initiated when the user U enters the store 50. First, the user information acquisition unit 102 acquires the user information of the user (step S101). Then, the output unit 110 references the recommendation information 130 in the storage device 120 and determines whether information indicating that it has been determined that information related to a product should be output is stored (step S121). If information indicating that it has been determined that information related to a product should be output is stored (YES in step S121), the process proceeds to step S123. If information indicating that it has been determined that information related to a product should be output is not stored (NO in step S121), step S123 is bypassed and the information processing device 100 ends this process.

[0089] In step S123, the output unit 110 outputs notification information about the product for which it has been determined that information should be output to the communication device (first communication device 200 or second communication device 300) used by the user U. Then, the information processing device 100 ends this process.

[0090] <<Processing During Shopping>> Next, the flow of FIG. 15 is executed while the user U is shopping at the store 50. This process includes steps S141 to S145 instead of step S123 of FIG. 14. First, the user information acquisition unit 102 acquires user information about the user (step S101). Then, the output unit 110 references the recommendation information 130 in the storage device 120 and determines whether information indicating that it has been determined that information related to a product should be output is stored (step S121).

[0091] If information indicating that it has been determined that product-related information should be output is stored (YES in step S121), the process proceeds to step S141. If information indicating that it has been determined that product-related information should be output is not stored (NO in step S121), step S141 is bypassed, and the information processing device 100 ends this process.

[0092] The processes from step S141 onwards are periodically repeated. The first position information acquisition unit 104 acquires the position information of the cart 20. The method of acquiring the position information is the same as that for the first position information.

[0093] The output unit 110 determines whether the positional relationship between the display location in the store of the product for which information should be output and the cart 20 satisfies a criterion (step S143). Specifically, the output unit 110 reads and acquires location information indicating the display location of the product information (product code) stored in the recommendation information 130 from the display location information 150. If the location information and the location information acquired in step S141 are included within a predetermined range, for example, the output unit 110 determines that the criterion is met. If the criterion is met (YES in step S143), the process proceeds to step S145. If the criterion is not met (NO in step S143), step S145 is bypassed, and the information processing device 100 ends this process.

[0094] In step S145, the output unit 110 outputs the notification information to the communication device (first communication device 200 or second communication device 300) that is traveling with the user U.

[0095] As described above, in the information processing device 100 of this embodiment, when information indicating that it has been determined that information about a product should be output is stored in the storage device 120, the output unit 110 outputs notification information about the product for which it has been determined that information should be output to the communication device (first communication device 200 or second communication device 300) used by the user U. As described above, the information processing device 100 of this embodiment achieves the same effects as the above-mentioned embodiments, and further, since the information stored in the storage device 120 is output, the user U can purchase the product by viewing the output information. This reduces the number of times the user U forgets to buy a product. Furthermore, the store 50 can reduce lost sales opportunities due to customers forgetting to buy a product.

[0096] Furthermore, in the information processing device 100, when the positional relationship between the display location in the store of a product for which information should be output and the cart 20 (container) satisfies a criterion, the information processing device 100 outputs notification information to a communication device (first communication device 200 or second communication device 300) traveling with the user U. In this way, the information processing device 100 of this embodiment achieves the same effects as the above-described embodiment, and further, while shopping, notification information regarding a product that the user may have previously forgotten to purchase is output near the display location of the product, so that the user U can purchase the product by viewing the output information. This allows the user U to reduce the number of products they forget to buy. Furthermore, the store 50 can reduce lost sales opportunities due to customers forgetting to buy products.

[0097] (Fourth embodiment) A fourth information processing device 100 in Fig. 16 according to the present disclosure is the same as the information processing device 100 in Fig. 1 except that it further includes a product information acquisition unit 114. Note that each element in Fig. 16 may be combined with each element in one or more embodiments to the extent that no contradiction occurs.

[0098] <Example of functional configuration> As shown in FIG. 16 , the information processing device 100 has the same user information acquisition unit 102, first location information acquisition unit 104, second location information acquisition unit 106, and memory processing unit 108 as in FIG. 1 , and further has a product information acquisition unit 114.

[0099] The product information acquisition unit 114 acquires product information for a product. Product information is information that can identify a product, such as a product code. The product information acquisition unit 114 detects that a product has been placed in the cart 20 using the camera or code reader of the first communication device 200. The product information acquisition unit 114 then identifies the product code of the product by reading code information that indicates the product code, such as a barcode or two-dimensional code, attached to the detected product, or by identifying the product by image analysis of the product image.

[0100] The product information acquisition unit 114 passes the product information for which the product code has been identified to a product registration processing unit (not shown) as a product to be settled. The product registration processing unit of the information processing device 100 performs product registration processing on the product code of the product to be settled.

[0101] Furthermore, the product information acquisition unit 114 acquires product information for a product corresponding to the identified product code. The information processing device 100 stores product information 180 shown in FIG. 17 in the storage device 120. The product information 180 stores a product code, a product name, and a price in association with each other for each product. The product information acquisition unit 114 references the product information 180 and acquires information such as the product name and price stored in association with the product code.

[0102] The product information acquisition unit 114 also acquires product information of the product to be settled from a communication device traveling with the user U. This communication device is, for example, the first communication device 200 attached to the cart 20.

[0103] The product information acquisition unit 114 also acquires product information of the product to be paid for by processing an image generated by an imaging unit (camera 5) installed in the store 50.

[0104] As shown in FIG. 18 , the information processing system 1 includes a camera 5 in addition to the components of the information processing system 1 shown in FIG. 4 . The camera 5 includes an imaging element such as a lens and a charge-coupled device (CCD) image sensor, and is, for example, a network camera such as an Internet Protocol (IP) camera. The network camera has, for example, a wireless local area network (LAN) communication function and is connected to the information processing device 100 via a communication network 3, i.e., a relay device (not shown) such as a router. These cameras 5 may be so-called surveillance cameras, with multiple cameras installed in a store 50. The camera 5 may also include a mechanism for controlling the orientation of the camera body and lens, zooming, focusing, etc., in accordance with the movement of a person.

[0105] The images generated by the camera 5 are preferably taken in real time and transmitted to the information processing device 100. However, the images transmitted to the information processing device 100 do not have to be transmitted directly from the camera 5, but may be images delayed by a predetermined time. The images taken by the camera 5 may be temporarily stored in another storage device, and the information processing device 100 may read them out from the storage device sequentially or at predetermined intervals. Furthermore, the images transmitted to the information processing device 100 are preferably moving images, but may also be frame images taken at predetermined intervals or still images.

[0106] The camera 5 generates an image of the inside of the store 50. The image generated by the camera 5 is transmitted to the information processing device 100. Returning to Fig. 16 , first, the product information acquisition unit 114 acquires the image generated by the camera 5 and performs image recognition processing to detect the user U. For example, the product information acquisition unit 114 uses registered feature information in which facial features of the user U are registered in advance to perform a matching process with the features extracted from the image, thereby identifying the user U.

[0107] Representative algorithms for deriving feature amounts through image recognition include, but are not limited to, SIFT (Scale-Invariant Feature Transform) and HOG (Histograms of Oriented Gradients). These algorithms detect feature points from an image, and the feature amounts are calculated and described from the pixel values ​​and differential values ​​of the points.

[0108] The image processing unit may be included in the information processing device 100, or an image processing device external to the information processing device 100 may perform image processing. In this case, the image generated by the camera 5 may be transmitted from the information processing device 100 to the image processing device, or may be transmitted directly from the camera 5 to the image processing device. Then, the information processing device 100 may receive the result of image processing performed by the image processing device from the image processing device.

[0109] Note that the feature for identifying user U may be other than face, and may include, for example, at least one feature from the group consisting of irises, veins, ears, fingerprints, gait, and physique (height, shoulder width, body length, bone structure, etc.). The product information acquisition unit 114 extracts the feature of biometric authentication information from the image captured by the camera 5 and performs a matching process with registered feature information to identify user U. Then, the product information acquisition unit 114 tracks the movement of user U by identifying user U in multiple images generated successively.

[0110] Next, the product information acquisition unit 114 performs image recognition processing on the image generated by the camera 5 to identify the cart 20 that is moving with the user U. For example, identification information (hereinafter also referred to as a cart ID) that can identify the cart 20 is displayed on the cart 20 at a position that appears in the image captured by the camera 5. The cart ID is recorded in a code image such as a barcode or a two-dimensional code. The code image of the cart 20 may be detected by processing the image generated by the camera 5 to identify the cart ID of the cart 20. The product information acquisition unit 114 links the user ID of the identified user U with the cart ID.

[0111] The product information acquisition unit 114 then processes the image generated by the camera 5 to further identify the product placed in the cart 20. The product information acquisition unit 114 detects the product placed in the cart 20 in the image and extracts feature quantities of the detected product from the image. The product information acquisition unit 114 compares the extracted product feature quantities with registered feature information in which the feature quantities of each product are registered in advance, thereby identifying the product. The product information acquisition unit 114 associates the product code of the identified product with the user U and registers it in the product registration information 140.

[0112] 7, the product registration information 140 includes, for each user U, a user ID, information indicating a date and time, and at least one product code, all of which are associated with each other. The date and time may be the time of entry into the store 50, or may be information indicating the time at which the product code was read each time the product code was read.

[0113] Furthermore, the product information acquisition unit 114 may refer to the product information 180, acquire information about the product, and display the information as registered product information on the display of the first communication device 200 or the second communication device 300. This allows the user U to confirm whether the product added to the cart has been correctly recognized.

[0114] The storage processing unit 108 may store the product information acquired by the product information acquisition unit 114 as part of the recommendation information 130. For example, the recommendation information 130 may store information such as the product name and price of the product as product information.

[0115] As described above, in the information processing device 100 of this embodiment, the product information acquisition unit 114 acquires product information of products. The product information acquisition unit 114 acquires product information of the products to be settled from a communication device traveling with the user U. The product information acquisition unit 114 may also acquire product information of the products to be settled by processing images generated by an imaging unit (camera 5) installed in the store 50. In this way, the information processing device 100 of this embodiment not only achieves the same effects as the above embodiment, but also can acquire product information of products added to the cart. The acquired product information is stored in the product registration information 140 and can be used in the product registration process.

[0116] Furthermore, the acquired product information can be included in the recommendation information 130, so that information such as the product name and sales price can also be recorded as information on products that the user U may have forgotten to buy. When combined with a configuration having the output unit 110, the output unit 110 can include the product information in the notification information, so that the user U can view the product information on products that the user U may have forgotten to buy.

[0117] (Fifth Embodiment) A third information processing system 1 of FIG. 19 according to the present disclosure is the same as the information processing system 1 of FIG. 4 except that it further includes a third communication device 400. Note that the elements of FIG. 19 may be combined with the elements of one or more embodiments to the extent that no contradiction occurs. Furthermore, the information processing device 100 according to the present disclosure has the same configuration as the information processing device 100 of FIG. 13. The following description will be given using FIG. 13.

[0118] <System Overview> As shown in Fig. 19 , the information processing system 1 includes a third communication device 400 in addition to the configuration of the information processing system 1 in Fig. 4 . The third communication device 400 is a terminal device used by an employee or a store manager of the store 50. The third communication device 400 is, for example, a computer such as a smartphone, a tablet terminal, or a personal computer. A predetermined program is installed in the third communication device 400. Then, by causing the third communication device 400 to execute the program, the third communication device 400 cooperates with the information processing device 100 to realize some of the functions of the information processing device 100.

[0119] 13 , the information processing device 100 according to the present disclosure includes a user information acquisition unit 102, a first location information acquisition unit 104, a second location information acquisition unit 106, a storage processing unit 108, and an output unit 110. When information indicating that it has been determined that information about the storage device 120 should be output is stored, the output unit 110 outputs information about the product for which it has been determined that information should be output to a communication device (third communication device 400) used by an employee or store manager (hereinafter also referred to as a store clerk) of the store 50.

[0120] The information output by the output unit 110 is stored in the storage device 120 as forgotten purchase product information 190. As shown in FIG. 20 , each time it is determined that information should be output, the forgotten purchase product information 190 stores at least information indicating the date and time of the determination and information capable of identifying the determined product (e.g., a product code) in association with each other. Furthermore, the forgotten purchase product information 190 may include first location information indicating the location where the product was placed in the cart 20. Although not shown, the forgotten purchase product information 190 may also include second location information indicating the location where the product is displayed. Furthermore, the forgotten purchase product information 190 may include information indicating the display status of the product, such as the display means, the presence or absence of promotional notices (POP (Point of Purchase Advertising)), and promotional information.

[0121] The display means includes information indicating, for example, whether the display is a normal display in a normal location, a display with an increased number of faces, a display on the golden line, or a display in a special display location for sales promotion. Furthermore, the display means may include information indicating the type of display method. The types of display methods include, for example, island display, protruding display, slot display, jumble display, end display, concentrated display, upper wall display, and spatial display. This information may be stored in the display position information 150 of FIG. 8 in association with the product code. The output unit 110 obtains the display means and the presence or absence of POP corresponding to the product code from the display position information 150 and stores the information in the forgotten purchase product information 190.

[0122] The sales promotion information also includes information indicating whether the product is on sale or not, and whether a campaign is currently running. This information can be obtained from the sales and campaign schedule information for each product. The output unit 110 obtains the corresponding product information from the schedule information and stores it in the forgotten purchase product information 190.

[0123] The output unit 110 displays the forgotten purchase product information 190 on the display of the third communication device 400. By viewing the forgotten purchase product information 190, a salesperson at the store 50 can identify problems with product placement in the store 50 and take measures to address them. The output unit 110 may display the forgotten purchase product information 190 as a list, or may use history information to plot and superimpose at least one of the location of the forgotten product and the location where the product was added to the cart on a layout diagram of the store 50 (showing the display locations) in an identifiable form (for example, with a different color, a different mark, etc.).

[0124] Furthermore, the output unit 110 may superimpose an image element (for example, a shading display) that allows the sales promotion area to be identified on the layout diagram.

[0125] As described above, in the information processing device 100 of this embodiment, when information indicating that information should be output from the storage device 120 is stored, the output unit 110 outputs information about the product for which output was determined to be necessary to the communication device (third communication device 400) used by the store clerk. Thus, the information processing device 100 of this embodiment achieves the same effects as the above-described embodiment. Furthermore, the store clerk can view information about products that customers may have forgotten to purchase on the third communication device 400, thereby identifying products that have issues with the current product display method or sales promotion method. For example, if many customers forget to purchase a particular sale item, it can be inferred that there are problems with the product placement, display method, or POP display method. This allows the store 50 to take measures to address issues with the product display method or sales promotion plan, potentially reducing lost sales opportunities. Furthermore, improved sales promotion effectiveness can be expected.

[0126] Although the embodiments of the present invention have been described above with reference to the drawings, these are merely examples of the present invention, and various other configurations may be adopted. (Other Embodiments) In the above embodiment, the storage container is a shopping cart. However, the storage container is not limited to a shopping cart. The storage container may be a bag, shopping bag, or plastic shopping bag brought by the user U, or a shopping basket installed in the store 50.

[0127] In this case, the user information acquisition unit 102, the first location information acquisition unit 104, and the second location information acquisition unit 106 acquire each piece of information using the camera 5 or the second communication device 300 described in the fifth embodiment. For example, the user information acquisition unit 102 acquires user information transmitted from the second communication device 300. Alternatively, the user information acquisition unit 102 identifies the user U who has entered the store by processing an image generated by the camera 5, and acquires the user information.

[0128] After identifying the user U, the first location information acquisition unit 104 processes the image captured by the camera 5 to track the movement of the user U in the store 50 and thereby identify the location. Alternatively, the first location information acquisition unit 104 may acquire the first location information by using information received by the second communication device 300 moving with the user U from a plurality of beacon transmitters 10 (information transmission means) installed in the store 50.

[0129] The second position information acquisition unit 106 processes the image captured by the camera 5 to acquire second position information indicating the display position of the product each time it is detected that the product has been placed in the cart 20. Alternatively, the second position information acquisition unit 106 may identify the product by having the camera of the second communication device 300 capture an image of the product before the user U places the product in the storage container, and processing the generated image. Then, the second position information acquisition unit 106 may read the display position corresponding to the product code of the identified product from the display position information 150 to acquire second position information indicating the display position of the product.

[0130] According to this configuration, the user U can obtain the same effect as that of the present disclosure even when shopping using a container other than a shopping cart.

[0131] Another example of the present disclosure may be a program that causes at least one computer to execute the above-disclosed method, or a computer-readable recording medium on which such a program is recorded. This recording medium includes a non-transitory tangible medium. This computer program includes computer program code that, when executed by a computer, causes the computer to perform the information processing method on an information processing device.

[0132] Any combination of the above components, and conversion of the present disclosure into a method, device, system, recording medium, computer program, etc., are also valid aspects of the present disclosure.

[0133] Furthermore, the various components of the present disclosure do not necessarily have to be independent entities, but may be formed as a single member by multiple components, one component may be formed from multiple components, one component may be a part of another component, or part of one component may overlap with part of another component, etc.

[0134] Furthermore, although the methods and computer programs disclosed herein describe a plurality of processing steps in a sequential order, the order in which the processing steps are performed does not limit the order in which the processing steps are performed. Therefore, when implementing the methods and computer programs disclosed herein, the order of the processing steps can be changed as long as it does not cause any problems in terms of the content.

[0135] Furthermore, the multiple processing steps of the method and computer program disclosed herein are not limited to being executed at different times, and may be executed while one processing step is being executed, or may be executed partially or entirely overlapping with another processing step, etc.

[0136] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate. Note that when information about users is acquired and used in the present disclosure, this must be done lawfully.

[0137] Some or all of the above embodiments may be described as, but are not limited to, the following supplementary notes. 1. An information processing device comprising: a user information acquisition means for acquiring user information of a user; a first location information acquisition means for acquiring first location information indicating the location information of a storage container that holds the product to be checked out in the store when the product is placed in the storage container; a second location information acquisition means for acquiring second location information indicating the display position of the product in the store; and a storage processing means for determining whether or not information about the product should be output to the user based on the relative positions of the first location information and the second location information, and, if it is determined that information should be output, causing a storage means to store information indicating that it has been determined that notification information about the product should be output in association with the user information of the user. 2. The information processing device described in 1., further comprising: an output means for outputting the notification information of the product for which it has been determined that the information should be output to a communication device used by the user, if the storage means stores information indicating that it has been determined that information about the product should be output. 3.2. 3. The information processing device described in any one of items 1. to 4., wherein the output means outputs the notification information to a communication device traveling with the user when the positional relationship between the display location in the store of the product for which it has been determined that the information should be output and the storage container satisfies a criterion. 4. The information processing device described in item 2. or 3., wherein the communication device is attached to the storage container of the product to be settled or is carried by the user. 5. The information processing device described in any one of items 1. to 4., wherein the first location information acquisition means acquires the first location information using information received by a communication device traveling with the user from a plurality of information transmission means installed in the store. 6. The information processing device described in any one of items 1. to 4., wherein the first location information acquisition means acquires the first location information using an image generated by an imaging means installed in the store.7. The information processing device described in any one of 1. to 5., further comprising a determination means for determining whether the distance between the first location information and the second location information is equal to or greater than a reference value, and the storage processing means determines that information related to the product should be output if the determination means determines that the distance between the first location information and the second location information is equal to or greater than a reference value. 8. The information processing device described in any one of 1. to 7., further comprising a product information acquisition means for acquiring product information about the product. 9. The information processing device described in 8., wherein the product information acquisition means acquires product information of the product to be settled from a communication device traveling with the user. 10. The information processing device described in 8., wherein the product information acquisition means acquires product information of the product to be settled by processing an image generated by an imaging means installed in the store. 11. The information processing device described in 1. to 10. The information processing device according to any one of the above, further comprising an output means for outputting information about the product that has been determined to be output to a communication device used by an employee of the store when information indicating that the information about the product should be output is stored in the storage means.

[0138] 12. An information processing device comprising: a user information acquisition means for acquiring user information of a user; a first location information acquisition means for acquiring first location information indicating the location of a container in a store when the container contains the products to be checked out; a second location information acquisition means for acquiring second location information indicating the display location of the products in the store; a storage processing means for determining whether or not information related to the products should be output to the user based on the relative positions of the first location information and the second location information, and, if it is determined that information should be output, causing a storage means to store information indicating that it has been determined that notification information related to the products should be output in association with the user information of the user; and, if the storage means has stored information indicating that it has been determined that information related to the products should be output, outputting the information related to the products for which it has been determined that the information should be output to a communication device used by an employee of the store.

[0139] 13. An information processing system comprising: a communication device used by a user; and an information processing device, wherein the information processing device has: user information acquisition means for acquiring user information of the user; first location information acquisition means for acquiring first location information indicating the location information of a storage container that holds the product to be checked out in the store when the product is placed in the storage container; second location information acquisition means for acquiring second location information indicating the display position of the product in the store; and storage processing means for determining whether or not information about the product should be output to the user based on the relative positions of the first location information and the second location information, and if it is determined that information should be output, for storing information indicating that it has been determined that information about the product should be output in storage means in association with the user information of the user, wherein the storage means is at least one of a storage device of the communication device and a storage device of the information processing device. 15. An information processing method in which one or more computers acquire user information of a user, acquire first location information indicating the location information of a storage container in the store when the product was placed in the storage container containing the product to be checked out, acquire second location information indicating the display position of the product in the store, and determine whether or not information about the product should be output to the user based on the relative positions of the first location information and the second location information, and if it is determined that information should be output, store information indicating that it has been determined that notification information about the product should be output in a storage means in association with the user information of the user. A program for causing a computer to execute the following processes: a user information acquisition process for acquiring user information of a user; a first location information acquisition process for acquiring first location information indicating the location information of a storage container in the store when the product is placed in a storage container that holds the product to be checked out; a second location information acquisition process for acquiring second location information indicating the display location of the product in the store; and a storage process for determining whether or not information about the product should be output to the user based on the relative positions of the first location information and the second location information, and if it is determined that information should be output, storing information indicating that it has been determined that notification information about the product should be output in a storage means, in association with the user information of the user.16. A computer-readable recording medium having recorded thereon a program for causing a computer to execute: a user information acquisition process for acquiring user information of a user; a first location information acquisition process for acquiring first location information indicating the location information of a storage container that contains the products to be checked out in the store when the products were placed in the storage container; a second location information acquisition process for acquiring second location information indicating the display location of the products in the store; and a storage process for determining whether or not information related to the product should be output to the user based on the relative positions of the first location information and the second location information, and, if it is determined that information should be output, storing information indicating that it has been determined that notification information related to the product should be output in storage means, in association with the user information of the user.

[0140] 17. An information processing system comprising: a first communications device used by a user; a second communications device used by a store employee; and an information processing device, wherein the information processing device has: user information acquisition means for acquiring user information of the user; first location information acquisition means for acquiring first location information indicating location information of a storage container in the store when the product was placed in a storage container that holds the product to be settled; second location information acquisition means for acquiring second location information indicating the display location of the product in the store; storage processing means for determining whether or not information about the product should be output to the user based on the relative positions of the first location information and the second location information, and if it is determined that information should be output, causing information indicating that it has been determined that information about the product should be output to be stored in storage means in association with the user information of the user; and output means for, if information indicating that it has been determined that information about the product should be output, outputting information about the product for which it has been determined that the information should be output to the second communications device, when the storage means has stored therein information indicating that it has been determined that information about the product should be output, wherein the storage means is at least one of a storage device of the first communications device and a storage device of the information processing device. 18. An information processing method in which one or more computers acquire user information of a user, acquire first location information indicating the location of a storage container in the store when the product was placed in the storage container, acquire second location information indicating the display location of the product in the store, determine whether or not information about the product should be output to the user based on the relative positions of the first location information and the second location information, and if it is determined that information should be output, store information indicating that it has been determined that notification information about the product should be output in storage means in association with the user information of the user, and if the storage means has stored information indicating that it has been determined that information about the product should be output, output the information about the product for which it has been determined that the information should be output to a communication device used by an employee of the store.19. A program for causing a computer to execute: a user information acquisition process for acquiring user information of a user; a first location information acquisition process for acquiring first location information indicating the location information of a storage container in the store when the product to be checked out was placed in the storage container; a second location information acquisition process for acquiring second location information indicating the display location of the product in the store; a storage process for determining whether or not information about the product should be output to the user based on the relative positions of the first location information and the second location information, and if it is determined that information should be output, storing information indicating that it has been determined that notification information about the product should be output in storage means in association with the user information of the user; and if information indicating that it has been determined that information about the product should be output is stored in the storage means, outputting information about the product for which it has been determined that the information should be output to a communication device used by an employee of the store. 20. A computer-readable recording medium having recorded thereon a program for causing a computer to execute the following: a user information acquisition process for acquiring user information of a user; a first location information acquisition process for acquiring first location information indicating the location information of a storage container in the store when the product is placed in the storage container that holds the product to be checked out; a second location information acquisition process for acquiring second location information indicating the display location of the product in the store; a storage process for determining whether or not information about the product should be output to the user based on the relative positions of the first location information and the second location information, and if it is determined that information should be output, storing information indicating that it has been determined that notification information about the product should be output in a storage means in association with the user information of the user; and, if information indicating that it has been determined that information about the product should be output is stored in the storage means, an output process for outputting information about the product for which it has been determined that the information should be output to a communication device used by an employee of the store.

[0141] Furthermore, some or all of the configurations described in Supplementary Notes 2 to 11 that are subordinate to Supplementary Note 1 (information processing device) may also be subordinate to Supplementary Note 13 (information processing system), Supplementary Note 14 (information processing method), Supplementary Note 15 (program), and Supplementary Note 16 (recording medium) in the same subordinate relationship as Supplementary Note 2 to 11. Furthermore, some or all of the configurations described in Supplementary Notes 2 to 10 that are subordinate to Supplementary Note 12 (information processing device), Supplementary Note 17 (information processing system), Supplementary Note 18 (information processing method), Supplementary Note 19 (program), and Supplementary Note 20 (recording medium) in the same subordinate relationship as Supplementary Note 2 to 10. Furthermore, not limited to Supplementary Notes 12 to 20, some or all of the configurations described as Supplements may be subordinate to various hardware, software, various recording means for recording software, or systems, within the scope of each of the above-mentioned embodiments.

[0142] REFERENCE SIGNS LIST 1 Information processing system 3 Communication network 5 Camera 10 Beacon transmitter 20 Cart 30 Product 40 Display shelf 50 Store 52 Entrance 54 Checkout area 100 Information processing device 102 User information acquisition unit 104 First position information acquisition unit 106 Second position information acquisition unit 108 Storage processing unit 110 Output unit 112 Determination unit 114 Product information acquisition unit 120 Storage device 130 Recommendation information 140 Product registration information 150 Display position information 160 Beacon information 170 Position information 180 Product information 190 Forgotten product information 200 First communication device 300 Second communication device 400 Third communication device 1000 Computer 1010 Bus 1020 Processor 1030 Memory 1040 Storage device 1050 Input / Output Interface 1060 Network Interface

Claims

1. A user information acquisition means for acquiring user information of a user, a first position information acquisition means for acquiring first position information indicating the position information of the storage container in the store when the product is placed in a storage container that stores the product to be settled, a second position information acquisition means for acquiring second position information indicating the display position of the product in the store, and based on the relative positions of the first position information and the second position information, determining whether information regarding the product should be output to the user, and when it is determined that the information should be output, a storage processing means for storing information indicating that it has been determined that the notification information regarding the product should be output, in association with the user information of the user, in a storage means.

2. The information processing apparatus according to claim 1, further comprising an output means for outputting the notification information of the product determined to be output to a communication device used by the user when information indicating that it has been determined that information regarding the product should be output is stored in the storage means.

3. The information processing apparatus according to claim 2, wherein the output means outputs the notification information to a communication device that is moving with the user when the positional relationship between the display location of the product in the store determined to be output and the storage container satisfies a standard.

4. The information processing apparatus according to claim 2 or 3, wherein the communication device is attached to the storage container of the product to be settled or is carried by the user.

5. The information processing apparatus according to any one of claims 1 to 4, wherein the first position information acquisition means acquires the first position information using information received from an information transmission means in which a plurality of communication devices moving with the user are installed in the store.

6. The information processing apparatus according to any one of claims 1 to 4, wherein the first position information acquisition means acquires the first position information using an image generated by an imaging means installed in the store.

7. The information processing apparatus according to any one of claims 1 to 5, further comprising determination means for determining whether the distance between the first position information and the second position information is greater than or equal to a reference value, wherein the storage processing means determines that when the determination means determines that the distance between the first position information and the second position information is greater than or equal to the reference value, information regarding the product should be output.

8. The information processing apparatus according to any one of claims 1 to 7, further comprising product information acquisition means for acquiring product information of the product.

9. The information processing apparatus according to claim 8, wherein the product information acquisition means acquires the product information of the product to be settled from a communication device that is moving with the user.

10. The information processing apparatus according to claim 8, wherein the product information acquisition means acquires the product information of the product to be settled by processing an image generated by imaging means installed in the store.

11. The information processing apparatus according to any one of claims 1 to 10, further comprising output means for outputting information regarding the product, which is determined to be output, to a communication device used by a store employee when information indicating that it has been determined that the information regarding the product should be output is stored in the storage means.

12. An information processing system comprising a communication device used by a user and an information processing apparatus, wherein the information processing apparatus includes user information acquisition means for acquiring user information of the user, first position information acquisition means for acquiring first position information indicating the position of a storage container in a store when a product, which is a product to be settled, is placed in the storage container, second position information acquisition means for acquiring second position information indicating the display position of the product in the store, storage processing means for determining, based on the relative positions of the first position information and the second position information, whether information regarding the product should be output to the user, and when it is determined that the information should be output, associating information indicating that it has been determined that the information regarding the product should be output with the user information of the user and storing the associated information in storage means, and the storage means is at least one of a storage device of the communication device and a storage device of the information processing apparatus.

13. An information processing method, wherein a computer having a value of 1 or more acquires user information of a user, acquires first position information indicating position information of a storage container in a store when a product is placed in a storage container that stores a product to be settled, acquires second position information indicating a display position of the product in the store, determines whether information regarding the product should be output to the user based on a relative position between the first position information and the second position information, and when it is determined that the information should be output, stores information indicating that it has been determined that notification information regarding the product should be output, in a storage means in association with the user information of the user.

14. A computer-readable recording medium having recorded thereon a program for causing a computer to execute a user information acquisition process for acquiring user information of a user, a first position information acquisition process for acquiring first position information indicating position information of a storage container in a store when a product is placed in a storage container that stores a product to be settled, a second position information acquisition process for acquiring second position information indicating a display position of the product in the store, and a storage process for storing, in a storage means in association with the user information of the user, information indicating that it has been determined that notification information regarding the product should be output when it is determined that information regarding the product should be output to the user based on a relative position between the first position information and the second position information.

Images