Pickup guide method, pickup guide program, and pickup guide system
The pickup guidance system dynamically sets item priorities and projects navigational images to guide users within a store, enhancing the efficiency and safety of product retrieval.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- CASIO COMPUTER CO LTD
- Filing Date
- 2024-12-19
- Publication Date
- 2026-07-01
AI Technical Summary
Existing methods for guiding users to pick up products in a store lack flexibility in presenting information, as the display position of images is fixed to a display panel, limiting dynamic interaction with moving users.
A pickup guidance system that sets priorities for items based on user location and display locations, projects images including routes and items onto a projection device, and uses portable devices for real-time navigation within the store.
Enables dynamic guidance for users moving within a store, ensuring they can easily locate and pick up items while minimizing travel distance and maintaining safety, even in crowded conditions.
Smart Images

Figure 2026108926000001_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to a pickup guidance method, a pickup guidance program, and a pickup guidance system.
Background Art
[0002] Patent Document 1 describes a method of notifying a user of the position of a product that the user wishes to purchase by projecting an image onto a display panel installed on a product display shelf.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] In Patent Document 1, the display position of the image is fixed to the display panel. Therefore, there is room for improvement from the viewpoint of presenting information for guiding shopping to a user moving inside a store or the like.
[0005] In view of the above circumstances, embodiments of the present disclosure aim to provide a pickup guidance method, a pickup guidance program, and a pickup guidance system that can present information for guiding pickup to a user moving within a certain site or the like.
Means for Solving the Problems
[0006] A pickup guide method according to one embodiment of the present disclosure is a method of causing a computer to perform the following processes: setting a priority for individual items included in item data which includes information on multiple items and their display locations; selecting a first item based on the set priority; obtaining the user's current location; obtaining a route to the first item based on the display location of the selected first item and the obtained user's current location; and projecting an image including the obtained route and the first item onto a projection device. [Effects of the Invention]
[0007] According to one embodiment of the present disclosure, a pickup guide method, a pickup guide program, and a pickup guide system are provided that can present information to guide a user moving within a premises or the like in order to pick up their vehicle. [Brief explanation of the drawing]
[0008] [Figure 1] This is a schematic diagram illustrating a pickup guide system according to one embodiment of the present disclosure. [Figure 2] This is a block diagram of a pickup guide system according to one embodiment of the present disclosure. [Figure 3] This figure illustrates an example of a pickup guide process performed by a pickup guide system according to one embodiment of this disclosure. [Figure 4] This is a sequence of pickup guide processing performed by a pickup guide system according to one embodiment of the present disclosure. [Modes for carrying out the invention]
[0009] The following description relates to a pickup guide method, a pickup guide program, and a pickup guide system according to one embodiment of the present disclosure. Common or corresponding elements are denoted by the same or similar reference numerals, and redundant descriptions are omitted or simplified as appropriate. In each figure, the configuration is shown enlarged, reduced, or omitted as appropriate for the sake of explanation. To improve the visibility of the drawings, elements in the figures are shown with lines other than solid lines (such as dashed lines or dotted lines) as necessary.
[0010] The pickup guide system 1 shown in Figures 1 and 2 is a system that guides user U in picking up (shopping). The pickup guide system 1 includes a server 10, an information processing device 20, and a projector 30. The server 10 is connected to the information processing device 20 for mutual communication via a wide-area computer network such as the Internet. The information processing device 20 is connected to the projector 30 for mutual communication via wireless communication standards such as Wi-Fi, Bluetooth®, and IR (infrared) communication. The server 10 and the projector 30 may communicate directly without using the information processing device 20 as an intermediary. Thus, there is a degree of flexibility in the connection configuration of each part of the pickup guide system 1, and various design changes are possible. The server 10 is an example of a computer. As shown in Figure 2, the server 10 includes an MCU (Micro Controller Unit) 12, storage 14, and a communication interface 16. The MCU 12 includes, for example, a CPU (Central Processing Unit), a DSP (Digital Signal Processor), RAM (Random Access Memory), and ROM (Read-only memory). The MCU12 may be, for example, a single-processor or multi-processor configuration and may include at least one processor. In the case of a configuration including multiple processors, the MCU12 may be packaged as a single unit, or it may consist of multiple physically separated units within the server 10. The MCU12 may also be called a control unit, an MPU (Micro Processor Unit), or the like.
[0011] The storage 14 is, for example, a non-volatile semiconductor memory such as flash memory, EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), HDD (Hard Disk Drive), or SSD (Solid State Drive). The storage 14 stores various programs and various data. For example, the storage 14 stores a control program 142, a store database 144, a map database 146, and a product database 148. When the MCU 12 executes the control program 142, various processes according to one embodiment of this disclosure (such as image data generation and path calculation) are performed.
[0012] The communication interface 16 is an interface that enables mutual communication between the MCU 12 and various external devices. For example, the communication interface 16 enables mutual communication between the MCU 12 and the information processing device 20. The information processing device 20 is an example of a portable client for user U. The information processing device 20 is, for example, a smartphone, a notebook PC (Personal Computer), or a tablet terminal.
[0013] The information processing device 20 has a guide application 22 installed, which is an example of a program (application). The information processing device 20 includes a position acquisition unit 24. The position acquisition unit 24 includes, for example, a GPS (Global Positioning System) module. The position acquisition unit 24 acquires the current position CP of user U. In this embodiment, user U does shopping while pushing a cart 40. Therefore, the current position CP of user U may be appropriately read as "the current position CP of the cart 40". The position acquisition unit 24 may include a DR (Dead Reckoning) sensor that performs positioning by autonomous navigation using a gyro sensor, acceleration sensor, etc., instead of or in addition to the GPS module. The position acquisition unit 24 can also estimate the orientation of the cart 40 from the positioning result.
[0014] The pickup guide system 1 performs the pickup guide processing. In this embodiment, the server 10 is the main entity that performs the pickup guide processing. In this embodiment, the guide application 22 may perform some or all of the pickup guide processing that the server 10 performs. Depending on how the pickup guide system 1 is constructed, the entity that performs each processing step may change as appropriate.
[0015] In Figure 3, symbol S1 indicates the store where user U makes a purchase. Symbols E1 and E2 indicate the entrance and exit to store S1. Symbol P0 indicates user U's position before entering store S1. Symbols P1 to P7 indicate the display locations of the planned purchase items PR (described later). Symbol P8 indicates user U's position at checkout. Symbols A1 to A14 indicate the shelves where the listed items (vegetables, fruits, etc.) are displayed. Symbols C1 to C3 indicate the checkout counter. In Figure 3, the checkout counter is abbreviated as "counter".
[0016] In the example shown in Figure 3, when user U is at location P0 (i.e., before entering store S1), they operate the information processing device 20 to launch the guide application 22. After launching, the guide application 22 periodically acquires the current location CP from the location acquisition unit 24. The guide application 22 periodically sends the current location CP to the server 10, for example, until it is stopped. The MCU 12 of the server 10 periodically receives (acquires) the current location CP from the guide application 22 during the period from when the guide application 22 is launched until it is stopped.
[0017] The MCU12 searches the store database 144 based on the current location CP received immediately after launching the guide app 22. The store database 144 contains information on stores operated by the business that provides the guide app 22, or by businesses that use the services provided by that business. The store information includes the store name, location information, etc. The MCU12 searches the store database 144 for the store closest to the current location CP received from the guide app 22. In the example in Figure 3, store S1 is found in the search. The MCU12 may also search for multiple candidate stores (for example, the top 3 stores closest to the current location CP) based on the current location CP received from the guide app 22 and present them to the user U through the guide app 22. In this case, the user U can select any one store from the presented candidate stores.
[0018] Map DB146 contains map data for each store registered in Store DB144. The map data includes a map of the entire store site, including the parking lot, and floor maps of the store. The floor map data includes data for various symbols such as store entrances, shelves, and checkout counters, as well as pathway data in the form of a road network represented by nodes and links. MCU12 retrieves the map data for the searched store or the store selected by user U (store S1 in the example in Figure 3) from Map DB146.
[0019] Product DB148 contains product data for each store registered in Store DB144. The product data includes information about the products sold in the store and their display locations. MCU12 retrieves product data from Product DB148 for the store that was searched for or selected by user U (store S1 in the example in Figure 3).
[0020] User U inputs information about the product to be purchased, for example, into the input screen of the launched guide app 22. The guide app 22 transmits this input information to the server 10. The input screen of the guide app 22 may be in a form that allows User U to input the name of the product in text, or in a form that allows User U to select a product from a product list. In the former case, it is possible that the product with the text-input name is not sold in the store. In this case, for example, the MCU 12 of the server 10 notifies User U through the guide app 22 that there is no stock of the product. In the latter case, the guide app 22 receives, for example, product data called from the product DB 148 from the server 10, creates a product list based on the received product data, and displays it on the screen of the information processing device 20.
[0021] User U may input abstract information (e.g., the name of a dish such as hamburger) instead of specific product information. The MCU 12 of the server 10 predicts the product that User U wants to purchase from the input abstract information. For example, when “hamburger (ingredients)” is input, the MCU 12 obtains, as its prediction result, the ingredients of the hamburger (products such as minced meat, onions, and eggs). For purchase prediction, a program operating with a simple algorithm may be used, or a learned model may be used. This learned model is an AI (Artificial Intelligence) program incorporated with parameters for purchase prediction and is realized, for example, by a neural network. User U can save the trouble of individually inputting specific product information. The burden of User U's input operation is reduced.
[0022] User U does not have to input product information to the input screen of the guide app 22. When the guide app 22 detects an operation to skip the input to the input screen, for example, it notifies the server 10 of this. The MCU 12 of the server 10 that receives this notification gives various input data such as the attributes of User U, weather, day of the week, season, time zone, and region to a learned model to predict the product that User U wants to purchase. In this case, the burden of User U's input operation is further reduced.
[0023] Products corresponding to the input information by the user U and products predicted by a learned model or the like are conveniently referred to as "products scheduled for purchase PR". The MCU 12 extracts information on the products scheduled for purchase PR and their display positions from the product data called from the product DB 148. The data including the extracted information on the products scheduled for purchase PR and their display positions is conveniently referred to as "product data PD". Thus, the MCU 12 acquires product data PD (an example of product data) including information on the products scheduled for purchase PR (an example of products) and their display positions.
[0024] The MCU 12 sets priorities for the individual products scheduled for purchase PR included in the product data PD. The MCU 12 sets priorities, for example, based on at least one of the distance from the position of the user U to the display position of the product scheduled for purchase PR, the storage temperature, weight, size, price, inventory quantity, popularity of the product scheduled for purchase PR. In the example shown in FIG. 3, the MCU 12 sets priorities for the individual products scheduled for purchase PR included in the product data PD based on the distance from the position of the user U to the display position of the product scheduled for purchase PR and the storage temperature of the product scheduled for purchase PR.
[0025] As a more concrete example, the MCU12 sets user U's current location P0 as the starting point, the display locations of each planned purchase item PR (locations P1-P7) and one of the checkout counters as intermediate points, and location P0 as the destination point. The MCU12 calculates user U's travel path using an algorithm such as Dijkstra's algorithm so that the total travel distance from the set starting point to the destination point (in other words, the time it takes to shop) is minimized. However, to avoid spoilage and unintended thawing, it is desirable to minimize the time that fresh foods (meat, fish, etc.) and frozen foods are exposed to room temperature. Therefore, the MCU12 calculates the path so that user U passes through the shelves of fresh foods and frozen foods in the latter half of the shopping trip while minimizing user U's total travel distance. The guide app 22 may also allow user U to select between a time-saving mode to shorten the time it takes to shop and a quality-prioritizing mode to avoid spoilage and unintended thawing. In time-saving mode, even if you plan to buy frozen foods, the system will guide you along the shortest route in terms of total travel distance. In quality-priority mode, the system will guide you along a route that leads to the purchase of frozen foods last, regardless of the length of the route.
[0026] In the example shown in Figure 3, the priority is set in the following order: vegetables on shelf A1, fruits on shelf A4, processed foods on shelf A6, processed foods on shelf A5, fish on shelf A10, bread on shelf A13, and frozen foods on shelf A12. Additionally, the intermediate points are set in the following order: entrance / exit E1 of store S1, vegetable shelf A1 (location P1), fruit shelf A4 (location P2), processed food shelf A6 (location P3), processed food shelf A5 (location P4), fish shelf A10 (location P5), bread shelf A13 (location P6), frozen food shelf A12 (location P7), checkout counter C3 (location 8), and entrance / exit E2 of store S1.
[0027] Several carts 40 are placed near entrances E1 and E2 of store S1. A cart 40 is an example of a trolley used to load items that user U intends to purchase. As shown in Figure 1, a projector 30 is installed on a cart 40. A projector 30 is an example of a projection device. Instead of a cart 40, the projector 30 may be attached to a shopping basket into which user U intends to purchase items.
[0028] Cart 40 has, for example, an NFC (Near Field Communication) tag attached to it. When user U brings the information processing device 20 close to the NFC tag, the information processing device 20 and the NFC tag communicate wirelessly via near-field communication (NFC communication), and the information processing device 20 and the projector 30 are paired. This establishes a wireless connection between the information processing device 20 and the projector 30. The NFC tag has, for example, a message or illustration printed on it that prompts pairing with the projector 30. The NFC tag may be replaced with a QR code (registered trademark).
[0029] User U walks through store S1 while pushing cart 40 and makes purchases. Even after User U enters store S1, the guide app 22 periodically sends the current location CP obtained from the location acquisition unit 24 to the server 10.
[0030] If the positioning means included in the position acquisition unit 24 is a GPS module alone, it may be difficult to accurately determine the current position CP after the user U enters the store S1. Therefore, the MCU 12 may acquire the current position CP (including the orientation of the cart 40) within the store S1 from equipment installed in the store S1. For example, images of the user U are periodically captured by ceiling cameras installed in various locations within the store S1. Each ceiling camera transmits the captured images to a computer PC (not shown) installed in the store S1. The computer PC performs image analysis to estimate the current position CP and transmits the estimated current position CP to the server 10. The current position CP may be acquired using a SLAM (Simultaneous Localization and Mapping) system. The current position CP may also be acquired using beacons installed in various locations within the store S1. The current position CP may also be detected using a 6-axis sensor (not shown) built into the projector 30 or installed on the cart 40. In this way, there is flexibility in the method of acquiring the current position CP within the store S1, and various design changes are possible.
[0031] The MCU12 generates image data including the next product PR to be purchased and the route from the current location CP to the display location of the next product PR, according to the set priority, and transmits it to the information processing device 20. The guide app 22 of the information processing device 20 transmits the received image data to the projector 30. Based on the image data received from the guide app 22, the projector 30 projects an image onto the floor surface (an example of a road surface) of the store S1. In this way, the projector 30 installed on each cart 40 projects the image appropriately to a position that is easily visible near the user U pushing the cart 40. Therefore, if there are multiple users in the store S1, it is easy to recognize that the projected image is not for another user. If the ceiling camera in the store S1 detects that the store S1 is too crowded and there is not enough area to project onto the floor, the computer PC transmits this information to the information processing device 20, and the information processing device 20 notifies the user U by display or voice and sends an instruction signal to the projector 30 to temporarily stop projecting the image.
[0032] In Figure 1, symbol IMG1 represents an example of an image projected by the projector 30 after user U has reached position P1 and purchased vegetables from shelf A1. The projected image IMG1 includes an image of the fruit on shelf A4, which is the next item to be purchased (PR) (information INF1), and an image showing the route from the current position CP to the display location of the next item to be purchased (position P2) (information INF2). Information INF1 includes, for example, an image of the product. Information INF1 may also include the product name in place of or in addition to the image of the product. Information INF2 includes, for example, the distance from the current position CP to the item to be purchased (PR) and information on the direction user U should move. The direction user U should move is indicated, for example, by an arrow. This arrow reflects the current orientation of the cart 40. Information INF2 is updated as appropriate according to the current position CP (i.e., user U's movement). By viewing the projected image IMG1, user U can easily navigate to the display location of the fruit they wish to purchase, preventing them from forgetting to buy it.
[0033] The projected image IMG1 is projected onto the floor in front of user U. Furthermore, the projected image IMG1 is projected onto the floor in front of a cart 40, which is an example of a trolley. In other words, the projected image IMG1 is projected in a position that is easily visible to user U. Because user U can view the projected image IMG1 while being mindful of their surroundings, they can move safely within the store S1.
[0034] While the information processing device 20 is highly portable, its screen is small. Therefore, when the projected image IMG1 is displayed on the screen of the information processing device 20, the field of view of user U viewing it is narrowed, making it difficult for user U to pay attention to their surroundings. In addition, it is difficult to determine the orientation of the screen of the information processing device 20 within the store S1, making it difficult to decide, for example, whether to guide the user to turn right or left. In this embodiment, the current orientation of the cart 40, and consequently the position and direction in which the projector 30 should project the image IMG1, can be determined from the position and direction of the cart 40, and the projector 30 can display the image IMG1 on the floor in a large size. Because the projected image IMG1 is displayed in a large size, user U can easily grasp the PR for the next product they plan to purchase and the route to get there without having to stare at the projected image IMG1. User U can view the projected image IMG1 while paying attention to their surroundings, and can move safely within the store S1.
[0035] If user U arrives by car, the MCU12 may, for example, set the parking location as the destination. In this case, while user U is paying and returning to their car, the route to the parking location is projected onto the parking lot surface by the projector 30. Even in a large parking lot, user U can return to their car without getting lost.
[0036] Figure 4 illustrates the sequence of pickup guide processing performed by the pickup guide system 1 according to one embodiment of this disclosure. For example, when the guide application 22 is launched, the execution of the sequence shown in Figure 4 begins. For example, when the guide application 22 is closed, the execution of the sequence shown in Figure 4 ends.
[0037] The steps in the sequences shown in the embodiments of this disclosure may be reordered, to the extent that they do not contradict each other. For example, the embodiments of this disclosure present the processing of various steps in an exemplary order, but are not limited to this order. Furthermore, the steps in the sequences shown in the embodiments of this disclosure may be performed in parallel or concurrently, to the extent that they do not contradict each other.
[0038] As shown in Figure 4, the information processing device 20 (guide app 22) transmits the current location CP to the server 10 (step S101). The server 10 (MCU 12) searches the store DB 144 based on the received current location CP and sets the store visited by user U (step S102). The MCU 12 may automatically set the store closest to the current location CP as the visited store, or the user U may set the visited store through the guide app 22.
[0039] The MCU12 retrieves various data corresponding to the visited store (step S103). Specifically, the MCU12 retrieves map data of the visited store from the map DB146 and product data of the visited store from the product DB148. The guide application 22 displays a product information input screen (step S104). The guide application 22 sends the input information from the user U to the input screen to the server 10 (step S105).
[0040] The guide app 22 displays a message prompting pairing with the projector 30 installed on the cart 40 (step S106). For example, when user U, having seen the notification, brings the information processing device 20 close to the NFC tag attached to the cart 40, the information processing device 20 and the projector 30 are paired, and a wireless connection between the information processing device 20 and the projector 30 is established (step S107). The guide app 22 notifies the server 10 that a wireless connection with the projector 30 has been established (step S108). This notification includes, for example, a command to request image data to be projected by the projector 30.
[0041] Based on a request from the guide app 22, the MCU 12 extracts information about the product PRs and display locations (i.e., product data PDs) of the product that user U intends to purchase from the product data retrieved from the product DB 148 (step S109). The MCU 12 sets a priority for each of the product PRs that user U intends to purchase included in the extracted product data PD (step S110).
[0042] The MCU12 selects the next planned purchase PR (an example of the first item, for example, the planned purchase PR with the highest priority at this time) from the product data PD (step S111). The MCU12 obtains the route from the display location and current location CP of the selected planned purchase PR to the said planned purchase PR (step S112). The MCU12 recalculates the route to the planned purchase PR each time it obtains the current location CP from, for example, the information processing device 20 or the store's equipment.
[0043] Any reference to elements using designations such as “First,” “Second,” etc., as used in this disclosure, does not generally limit the quantity or order of those elements. These designations are used for convenience to distinguish between two or more elements. Therefore, references to the First and Second elements do not imply, for example, that only two elements are adopted, or that the First element must precede the Second element.
[0044] The MCU 12 transmits the PR for the product to be purchased selected in step S111 and the image data including the route acquired in step S112 to the information processing device 20 (step S113). The guide app 22 transmits the received image data to the projector 30 (step S114). Based on the image data received from the guide app 22, the projector 30 projects an image (for example, the projected image IMG1 shown in Figure 1) onto the floor of the store (step S115).
[0045] The guide app 22 determines whether the product PR selected in step S111 has been added to the cart 40 (step S116). For example, the guide app 22 displays a purchase confirmation button for the product PR on the screen of the information processing device 20. When the guide app 22 detects a touch operation on the purchase confirmation button, it determines that the product PR has been added to the cart 40 and requests information for the next product PR from the server 10 (step S117).
[0046] Upon receiving the request, the MCU 12 of the server 10 returns to processing step S111. The server 10, the information processing device 20, and the projector 30 each sequentially execute steps S111 to S117 for subsequent product promotions intended for purchase. By viewing the images projected sequentially by the projector 30, user U can move around the store without getting lost and sequentially add the product promotions intended for purchase to the cart 40, thus preventing them from forgetting to purchase anything.
[0047] The guide app 22 may display a skip button along with a purchase confirmation button on the screen of the information processing device 20. When the guide app 22 detects a touch operation on the skip button, it sends a notification to the server 10 to remove the planned purchase product PR currently being projected by the projector 30 from the planned purchase. In this case, the MCU 12 of the server 10 returns to the processing of step S111. The server 10, the information processing device 20, and the projector 30 each sequentially execute the processing of steps S111 to S117 for subsequent planned purchase product PRs following the planned purchase product PR that was removed from the planned purchase.
[0048] This section describes a case where, even after a predetermined time has elapsed since user U arrived at the display location of the next planned purchase PR, no touch operation on the purchase confirmation button is detected. In this case, the guide app 22 may send a notification to the server 10 to remove the planned purchase PR from the purchase schedule. In this case as well, the server 10, information processing device 20, and projector 30 will sequentially execute steps S111 to S117 for subsequent planned purchase PRs following the excluded planned purchase PR.
[0049] The above is a description of exemplary embodiments of the present disclosure. Embodiments of the present disclosure are not limited to those described above, and various modifications are possible within the scope of the technical idea of the present disclosure. For example, embodiments of the present application include combinations of embodiments explicitly shown in the specification or obvious embodiments as appropriate.
[0050] The priority of products to be promoted for purchase may be updated as needed depending on the situation. For example, stores may sell certain products (an example of a second product) at a lower price than usual for a limited time. This type of sales method is called a time sale or limited-time sale.
[0051] In the example shown in Figure 3, we will explain a case where user U is moving from fish shelf A10 (location P5) to bread shelf A13 (location P6) when the start time for a time sale item (for example, processed food on shelf A7) approaches (for example, 3 minutes before the start time). In this case, MCU12 sends a notification of the time sale item to guide app 22. Upon receiving the notification, guide app 22 asks user U whether or not they wish to purchase the time sale item. If user U performs an action indicating they wish to purchase, guide app 22 sends a request to server 10. Upon receiving the request, server 10's MCU12 changes the purchase priority PR, which currently has the highest priority, from bread on shelf A13 (an example of the first item) to the time sale item (an example of the second item). MCU12 obtains the route from the current location CP to the display location of the time sale item and sends image data including the time sale item and the route to guide app 22. The guide app 22 sends image data to the projector 30, which projects an image including the time-sale items and their routes onto the floor of store S1. The projected image may include a message or icon informing user U that information about the time-sale items is being displayed.
[0052] For example, when user U touches the purchase confirmation button after purchasing a time-sale item, the projected image by projector 30 reverts to the image before the time-sale item was projected (however, the displayed path is the most recent one). By viewing the projected image by projector 30, user U can be sure to purchase the time-sale item.
[0053] For example, if user U stops for a while while moving around the store, it is possible that they have become interested in a product near where they stopped. In this case, the MCU 12 sends image data to the guide app 22 recommending that user U purchase a product near where they stopped. The guide app 22 sends the image data to the projector 30, which projects the image recommending that user U purchase a product near where they stopped onto the store floor.
[0054] For example, if the current location CP does not change for a certain period of time, the MCU 12 detects that user U has stopped moving. A sensor that detects wheel rotation may be installed on the cart 40. If the sensor does not detect wheel rotation for a certain period of time, the guide app 22 may notify the server 10 that user U is stopped. In this way, when the MCU 12 detects that user U has stopped moving, it projects an image including products displayed near the detected stopping position onto the projector 30. The store operator can effectively present product information to user U.
[0055] The MCU12 may project advertising images onto the projector 30, superimposed on images containing PR for products to be purchased and their routes. This allows, for example, the operator of the server 10 to earn advertising revenue.
[0056] Guide app 22 may award shopping points to user U based on user U's shopping habits (purchase amount, frequency of visits, frequency of use of guide app 22, distance traveled during use, etc.). User U can receive various benefits with the awarded shopping points. Awarding such shopping points to user U can help promote customer acquisition. [Explanation of Symbols]
[0057] 1: Pickup guide system 10: Server, 14: Storage, 16: Communication interface, 20: Information processing device, 22: Guide application, 24: Position acquisition unit, 30: Projector, 40: Cart, 142: Control program
Claims
1. Priorities are set for each of the aforementioned items included in the item data, which includes information on multiple items and their display locations. Select the first item based on the set priority order. Get the user's current location, Based on the display position of the selected first item and the acquired current position, a route to the first item is obtained. The acquired route and the image including the first item are projected onto the projection device. To have the computer perform the process. Pickup guide method.
2. The image is projected onto the road surface in front of the user using the projection device. The pickup guide method according to claim 1.
3. The projection device is installed on a trolley on which the aforementioned items that the user intends to purchase are loaded. The image is projected onto the road surface in front of the trolley using the projection device. The pickup guide method according to claim 1.
4. The priority is set based on at least one of the following: the distance from the user's location to the display location, the storage temperature, weight, size, price, inventory quantity, and popularity of the product. The pickup guide method according to claim 1.
5. When the time approaches when the second item will be sold at a lower price than usual, the first item will be replaced with the second item. Based on the display position and current position of the second item, a path to the second item is obtained. The image including the acquired route and the second item is projected onto the projection device. The pickup guide method according to claim 1.
6. When the user's movement is detected to have stopped, the projection device is made to project an image of the items displayed near the detected stopping position. The pickup guide method according to claim 1.
7. Priorities are set for each of the aforementioned items included in the item data, which includes information on multiple items and their display locations. Select the first item based on the set priority order. Get the user's current location, Based on the display position of the selected first item and the acquired current position, a route to the first item is obtained. The acquired route and the image including the first item are projected onto the projection device. To have the computer perform the process. Pickup guide program.
8. Server and A portable client for the user, Includes a projection device installed on a trolley on which the items the user intends to purchase are loaded, The aforementioned client, Send a request to the aforementioned server, The aforementioned server, Based on the aforementioned request, product data including information about the product and its display location is obtained. A priority is set for each of the items included in the acquired item data. Select the first item based on the set priority order. The current location of the aforementioned user is obtained, Based on the display position of the selected first item and the acquired current position, a route to the first item is obtained. The acquired route and image data including the first item are transmitted to the client. The aforementioned client, The received image data is transmitted to the projection device. The projection device, Based on the image data, an image including the route and the first item is projected. Pickup guide system.