Smart Grip

Abstract

This technology provides a way to reduce user effort in at least one of the following situations: when guiding a vehicle to a designated area, and when avoiding a designated area. [Solution] A smart grip according to one aspect of this disclosure comprises a haptic feedback module, a positioning sensor, and a control device. The control device is configured to acquire the current position measured by the positioning sensor, and, if the acquired current position belongs to or is approaching a predetermined area, to output haptic feedback to the user via the haptic feedback module. The feedback is configured to indicate instructions to guide the user into the predetermined area or to avoid the predetermined area.

Description

Technical Field

[0001] The present disclosure relates to a smart grip and a basket.

Background Art

[0002] In facilities such as stores (commercial facilities) and airports, there are systems for guiding the route to a destination. For example, Patent Document 1 proposes a product guidance device that acquires the current position of a customer in a store, calculates a purchase route based on the acquired current position and the product position, and transmits guidance information based on the obtained purchase route to a user terminal (terminal device).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] According to conventional systems such as Patent Document 1, based on the information displayed on the user terminal, a user can be guided to a predetermined area (for example, the location of products, etc.) within the facility. However, the inventor of the present case has found that the conventional systems have the following problems.

[0005] That is, within the facility, a user may move while holding a basket (including a cart). When guiding the user to a predetermined area based on the information given to the user terminal, the user has to hold both the basket and the user terminal while checking the visual information displayed on the user terminal. It may be troublesome to check the visual information displayed on the user terminal while holding a basket.

[0006] Furthermore, this problem is not limited to situations where users are guided to a designated area. When users are instructed to avoid a designated area based on information displayed on their terminal, the process of checking the visual information displayed on the terminal while holding the basket may occur, just as when guiding users to a designated area. Therefore, even when instructing users to avoid a designated area, the process of checking the information may still be time-consuming.

[0007] This disclosure is made in part in light of these circumstances, and one of its purposes is to provide a technology that reduces the effort required of the user in at least one of the situations in which the user is guided to a predetermined area or in which the user is guided to avoid a predetermined area. [Means for solving the problem]

[0008] This disclosure adopts the following configuration to solve the aforementioned problems. Note that the following configurations can be combined as appropriate.

[0009] A smart grip relating to one aspect of this disclosure comprises a haptic feedback module, a positioning sensor, and a control device. The control device is configured to acquire the current location measured by the positioning sensor, and, if the acquired current location belongs to or is approaching a predetermined area, to output haptic feedback to the user via the haptic feedback module. The feedback is configured to indicate instructions to guide the user into the predetermined area or to avoid the predetermined area.

[0010] In this configuration, the grip allows it to be held in common with the basket. For example, When the smart grip can be used as a handle for the basket, the basket can be held by grasping the smart grip. Therefore, this configuration can at least partially reduce the effort required to grasp the user terminal separately from the basket. In addition, in this configuration, instructions to guide the user to a predetermined area or to avoid a predetermined area are given as tactile feedback. This can at least partially reduce the effort required to confirm visual information. Therefore, this configuration can be expected to reduce the effort required of the user in at least one of the situations in which the user is guided to a predetermined area or in which the user is instructed to avoid a predetermined area.

[0011] In the smart grip relating to the above aspect, the predetermined area may include a viewing area in which the target product can be seen. Outputting feedback may include outputting feedback configured to indicate the direction in which the target product is located. With this configuration, it is expected that the effort required of the user will be reduced when guiding the user to the area in which the target product can be seen.

[0012] In the smart grip relating to the above aspect, the product shelf may have a first side on which the target product is placed, and a second side opposite to the first side. The viewing area may be set on the first side rather than the second side. On the second side of the product shelf, opposite to the first side on which the target product is placed, the user is close to the target product, but it is difficult to pick it up. With this configuration, by performing feedback on the first side where it is easy to pick up the target product, and omitting the performance of feedback on the second side where it is difficult to pick up the target product, the location of the target product can be accurately indicated.

[0013] In the smart grip relating to the above aspect, the predetermined area may include the promotion area of ​​the target product. Outputting feedback may include outputting feedback configured to indicate the direction in which the promotion area is located when the user's current location is approaching the promotion area. With this configuration, it is expected that the user's effort will be reduced when guiding the user to the area where the target product is being promoted.

[0014] In the smart grip relating to the above aspect, the designated area may include the checkout area. Outputting feedback may include outputting feedback configured to guide the user back away from the checkout area when the acquired current location is within or near the checkout area, even though it has not been determined that all intended purchase items have been placed in the basket. This can be expected to reduce user effort by preventing the user from having to perform payment processing at the checkout (register) when not all intended purchase items have been placed in the basket.

[0015] In the smart grip relating to the above aspect, the predetermined area may include a congested area. Outputting feedback may include outputting feedback configured to indicate an instruction to avoid the congested area. With this configuration, it is expected that the user's effort will be reduced when avoiding congested areas.

[0016] In the smart grip relating to the above aspect, the congested area may include crowded checkout counters. Instructions to avoid the congested area may include instructions to guide the user to checkout counters other than the crowded ones. With this configuration, it is expected that the user's effort will be reduced when avoiding crowded checkout counters.

[0017] In the smart grip relating to the above aspect, the predetermined area may include a non-crowded area. Outputting feedback may include outputting feedback configured to indicate instructions to guide the user to a non-crowded area. According to this configuration, the non-crowded area This can be expected to reduce the effort required from the user when guiding them to the rear.

[0018] In the smart grip relating to the above aspect, the predetermined area may include the store area where the store staff are located. Outputting feedback may include outputting feedback configured to indicate the direction in which the store staff are located. With this configuration, it is expected that the user's effort will be reduced when guiding them towards the store staff.

[0019] In the smart grip relating to the above aspect, the predetermined area may include a recommended product area where products recommended to the user are located. Outputting feedback may include outputting feedback configured to indicate instructions to guide the user to the recommended product area. With this configuration, it is expected that the user's effort will be reduced when guiding them to the area where recommended products are displayed.

[0020] In the smart grip relating to the above aspect, the predetermined area may include a non-recommended product area where products not recommended to the user are located. Outputting feedback may include outputting feedback configured to indicate an instruction to avoid the non-recommended product area. With this configuration, it is expected that the user's effort will be reduced when avoiding areas where non-recommended products are displayed.

[0021] Note that the embodiments of the present disclosure are not limited to the above smart grip. One aspect of the present disclosure may be a component of the basket. One aspect of the present disclosure may be the basket (including the cart) itself. Also, one aspect of the present disclosure may be an information processing method for realizing all or part of the above control device (computer), or a program, or a machine-readable storage medium such as a computer that stores such a program. Here, the machine-readable storage medium may be a non-temporary medium that stores information such as a program by an electrical, magnetic, optical, mechanical or chemical action. The non-temporary storage medium may include a storage medium (CD, DVD, semiconductor memory, etc.), an auxiliary storage device of a computer, an external storage device connected to the computer, and the like.

[0022] For example, a basket according to one aspect of the present disclosure may include a basket body, a tactile feedback module, a positioning sensor, and a control device. The control device is configured to acquire the current position measured by the positioning sensor, and when the acquired current position belongs to or approaches a predetermined area, output tactile feedback to the user via the tactile feedback module. The feedback may be configured to indicate an instruction to guide to or avoid a predetermined area.

[0023] The basket according to the above aspect may be configured as a cart by further including one or more wheels. According to this configuration, it is possible to expect a reduction in the user's labor in the form of a cart.

Advantages of the Invention

[0024] According to one aspect of the present disclosure, it is possible to expect a reduction in the user's labor in at least one of the scenes of guiding to a predetermined area and avoiding a predetermined area.

Brief Description of the Drawings

[0025] [Figure 1] FIG. 1 schematically shows an example of a scene to which the present disclosure is applied. [Figure 2] Figure 2 schematically shows an example of a designated area (first example). [Figure 3] Figure 3 schematically shows an example of a designated area (second example). [Figure 4] Figure 4 schematically shows an example of a designated area (third example). [Figure 5] Figure 5 schematically shows an example of a designated area (Case 4). [Figure 6] Figure 6 schematically shows an example of a designated area (Case 5). [Figure 7] Figure 7 schematically shows an example of a designated area (Case 6). [Figure 8] Figure 8 schematically shows an example of a designated area (Case 7). [Figure 9] Figure 9 schematically shows an example of a designated area (Case 8). [Figure 10] Figure 10 is a schematic side view showing an example of the structure of a smart grip. [Figure 11] Figure 11 is a schematic plan view showing an example of the structure of a smart grip. [Figure 12] Figure 12 is a schematic plan view showing another example of the structure of the smart grip. [Figure 13] Figure 13 schematically shows an example of the software configuration of the smart grip (control device). [Figure 14] Figure 14 is a flowchart showing an example of the processing procedure of a control device. [Figure 15] Figure 15 schematically illustrates another example of a scenario in which this disclosure applies. [Figure 16] Figure 16 schematically illustrates another example of a scenario in which this disclosure applies. [Modes for carrying out the invention]

[0026] Hereinafter, embodiments relating to one aspect of this disclosure will be described with reference to the drawings. However, the embodiments described below are merely illustrative in all respects of this disclosure. Various improvements or modifications may be made without departing from the scope of this disclosure. In implementing this disclosure, specific configurations may be adopted as appropriate depending on the embodiment. In this embodiment, the data appearing is described in natural language, but more specifically, it is specified in pseudo-language, commands, parameters, machine code, electrical signals, etc., that can be recognized by machines such as computers.

[0027] §1 Examples of Application Figure 1 schematically shows an example of a scenario to which this disclosure applies. The smart grip 1 according to this embodiment comprises a haptic feedback module 13, a positioning sensor 14, and a control device 11. The control device 11 is configured to acquire the current position 20 measured by the positioning sensor 14, and, if the acquired current position 20 belongs to or is approaching a predetermined area AZ, to output haptic feedback 25 to the user TU via the haptic feedback module 13. The feedback 25 is configured to indicate an instruction to guide to the predetermined area AZ or to avoid the predetermined area AZ.

[0028] According to this embodiment, the device that outputs feedback 25 (smart grip 1) is a grip, so it can be grasped in common with the basket B1. For example, if the smart grip 1 can be used as a handle for the basket B1, the basket B1 can be held by grasping the smart grip 1. Therefore, according to this embodiment, the effort of grasping the user terminal separately from the basket B1 can be reduced, at least partially. The smart grip 1 may be used together with the user terminal, but by providing feedback 25 via the smart grip 1, it is possible to reduce the frequency of using the user terminal. Furthermore, according to this embodiment, instructions to guide to a predetermined area AZ or to avoid a predetermined area AZ are given as tactile feedback 25. This makes it possible to reduce, at least partially, the work of confirming visual information. The smart grip 1 may be used together with the output of visual information, but by providing tactile feedback 25 via the smart grip 1, it is possible to reduce the frequency of confirming visual information. Therefore, according to this embodiment, it is possible to reduce the effort of the user TU in at least one of the situations in which the user is guided to a predetermined area AZ and in which the user is instructed to avoid a predetermined area AZ.

[0029] [Basket] In one example of this embodiment, the smart grip 1 may be configured to be usable as a handle for basket B1. The configuration of basket B1 is not particularly limited and may be determined as appropriate depending on the embodiment.

[0030] As shown in Figure 1, in a typical example, the basket B1 may comprise a basket body B10 and a pair of handles B11. The configuration of the basket body B10 and each handle B11 may be determined as appropriate depending on the embodiment. For example, the basket body B10 may be configured to receive luggage TP from the upper end, with the upper end open and the lower end closed at the bottom. The basket body B10 may have any shape, such as a roughly rectangular parallelepiped or a roughly truncated square pyramid. The pair of handles B11 may be arranged separately along the longitudinal direction of the basket body B10. Each end of the handles B11 may be connected to each side of the basket body B10 in the short direction so that the handles B11 can rotate around an axis in the short direction. As a result, each handle B11 may be configured to change its angle by rotating at the connection point with the basket body B10 and to be gripped along the short direction. If basket B1 includes a basket body B10, then placing luggage TP (goods, etc.) into basket body B10 may be considered equivalent to placing luggage TP into basket B1.

[0031] The configuration of the basket B1 is not limited to the example in Figure 1 and may be modified as appropriate depending on the embodiment. For example, the number of handles B11 is not limited to two. There may be one handle or three or more. Furthermore, each end of one handle B11 may be connected to one side of the basket body B10 in the short direction in the longitudinal direction, and each end of the other handle B11 may be connected to the other side of the basket body B10 in the short direction in the longitudinal direction. In this way, each handle B11 may be configured to be gripped along the longitudinal direction.

[0032] Furthermore, the type of basket B1 is not limited to the example in Figure 1 and may be appropriately changed depending on the embodiment. The type of basket B1 is not particularly limited as long as it can be used to carry any object and may be appropriately selected depending on the embodiment. Basket B1 may include a cart equipped with one or more wheels. For example, basket B1 may include a shopping basket, a shopping cart, a luggage cart used at an airport, etc. Basket B1 may include bags that can be used for shopping, such as plastic bags and paper bags. Basket B1 may also include a device that can hold objects by hanging them, such as a hanger. Known baskets may be used for basket B1.

[0033] [Must be usable as a basket handle] The ability to be used as a handle for a basket (basket B1, etc.) means that the smart grip 1 may be configured in any way in which it is positioned as at least a part of the handle that the user grasps when carrying luggage (luggage TP). In one example, the ability to be used as a handle for a basket may be configured by hanging the basket's handle portion (handle portion B11, etc.) on the smart grip 1, thereby replacing the existing handle provided on the basket. The basket's handle portion may include any component that can be hung on the smart grip 1, such as the handle portion of a bag or the hook of a hanger. In another example, the ability to be used as a handle for a basket may be configured by being attached to the basket's handle portion. In yet another example, the ability to be used as a handle for a basket may be configured by being attached to the basket body (basket body B10, etc.) as a handle portion. That is, the smart grip 1 may be configured as the basket's handle portion itself. Note that the smart grip 1 is not limited to these examples and may have any configuration that allows it to be grasped together with the basket (basket B1).

[0034] [Usage scene] The Smart Grip 1 according to this embodiment may be used in any setting within any facility such as a store or airport to guide a person to a predetermined location (predetermined area AZ) or to avoid movement to a predetermined location. A store may include a commercial facility that sells goods. The sales method of goods in the store may be either unmanned or manned. Luggage TP may include all kinds of items that are carried. For example, when the Smart Grip 1 is used in a store (commercial facility), luggage TP may include goods sold in the store. Also, when the Smart Grip 1 is used in an airport, luggage TP may include the user TU's hand luggage (carry-on bag, etc.).

[0035] Furthermore, Smart Grip 1 may be configured to monitor the behavior of users TU within a facility by further equipping it with optional sensors. For example, the behavior to be monitored may include purchasing behavior such as placing items into a shopping basket. The sensors used for monitoring and the behavior of users TU to be monitored are not particularly limited and may be appropriately selected depending on the embodiment. For example, when Smart Grip 1 is used in a store, Smart Grip 1 may be configured to detect the placement of items into a shopping basket (basket B1) and identify the detected items placed in the basket, based on the observation results of the sensors. Any sensor may be used for detecting the placement of items and identifying the items.

[0036] In one example, the smart grip 1 may further include a detection sensor and an imaging device. The imaging device may be appropriately positioned in a location where it can observe the products being placed in the basket B1 (basket body B10) when the products are being placed in it. The type of imaging device is not particularly limited and may be appropriately selected depending on the embodiment. The imaging device may include any sensor that acquires data in the form of an image or image representation, such as an RGB camera, depth sensor, infrared sensor, radar, or LiDAR (light detection and ranging). The imaging device may be used to obtain an image used for product identification.

[0037] The detection sensor may be configured as appropriate to detect when an item is placed into basket B1. The type of detection sensor may be selected as appropriate depending on the embodiment. For example, the detection sensor may consist of one or more load sensors (weight sensors). In this case, the detection sensor can detect the placement of an item by detecting the change (increase) in weight caused by the placement of the item. The detection sensor may be placed at any location where the change in weight caused by the placement of an item can be observed.

[0038] Furthermore, for example, the detection sensor may consist of one or more imaging devices. In this case, the detection sensor may be the same as the imaging device used to obtain the image used for product identification, or it may be provided separately. The detection sensor can detect the placement of a product by capturing the product in the image captured by the imaging device. The detection sensor may be placed at any location where the product is within its imaging range at least either between the time the user picks up the product and places it in basket B1, or after it has been placed in basket B1.

[0039] Furthermore, for example, the detection sensor may consist of one or more contact sensors. In this case, the detection sensor can detect the insertion of a product when it comes into contact with the product being inserted or with other objects (such as switch members) that have been displaced by the insertion of the product. The detection sensor may be placed at any location where the inserted product comes into direct or indirect contact with it. Indirect contact may include contact with other objects that have been displaced by the insertion of the product. The detection sensor may consist of multiple types of sensors.

[0040] If the smart grip 1 (control device 11) is further equipped with a detection sensor and an imaging device, the smart grip 1 (control device 11) may detect whether or not a product has been inserted based on the observation results of the detection sensor. When the detection sensor detects that a product has been inserted, the smart grip 1 (control device 11) may acquire an image from the imaging device. The timing of imaging by the imaging device is not particularly limited, as long as the inserted product can be captured in the image, and may be appropriately defined depending on the embodiment. For example, if the imaging device is positioned in a location where it can capture the product after insertion detection, the control device 11 may activate the imaging device in response to the detection sensor detecting that a product has been inserted, and control the operation of the imaging device to capture the inserted product. The control device 11 may control the imaging device to capture the product at any timing after detecting that a product has been inserted. For example, the control device 11 may control the imaging device to capture the product immediately after detecting that a product has been inserted. The control device 11 may appropriately acquire one or more images generated by this imaging from the imaging device. After generating one or more images, the control device 11 may capture The device may be stopped or switched to a standby state. In this example, the period during which the imaging device is activated can be narrowed, which is expected to reduce the processing load and power consumption of the smart grip 1. In another example, the imaging device may be controlled to continuously generate captured images. The generated captured images may be stored in a memory area (storage unit 12, etc.) for at least a certain period of time. Captured images generated at or around the time the detection sensor detects the insertion of an item are likely to show the inserted item. Therefore, the control device 11 may acquire one or more captured images from the captured images stored in the memory area that were generated at or around the time the detection sensor detected the insertion of an item.

[0041] The Smart Grip 1 (control device 11) may identify the product in the captured image by performing image analysis on the captured image. The identification method by image analysis may be determined as appropriate depending on the embodiment. In one example, if a code generated by encoding product identification information is assigned to the product, analyzing the captured image may include decoding the code assigned to the product. The type of code may be arbitrarily selected. The code may be, for example, a one-dimensional code, a two-dimensional code, etc. In another example, the control device 11 may identify the product based on its characteristics (appearance, etc.) rather than the code during image analysis.

[0042] The image analysis method is not particularly limited and may be appropriately selected depending on the embodiment. In one example, the smart grip 1 (control device 11) may analyze the captured image using general image analysis techniques such as edge detection and pattern matching. In another example, the smart grip 1 (control device 11) may analyze the captured image using a trained machine learning model that has acquired the ability to analyze images. The machine learning model is configured to include one or more computational parameters that can be adjusted by machine learning. One or more computational parameters are used for the calculation of the desired inference (such as image analysis). The machine learning model may consist of, for example, a neural network, a support vector machine, or other functional equations (computational models). The machine learning method may be appropriately selected depending on the machine learning model to be adopted (for example, backpropagation). Training a machine learning model involves adjusting (optimizing) the values ​​of the computational parameters using training samples. The machine learning model may be appropriately trained to derive the true value of the corresponding analysis result when given images of training samples. A large-scale model such as a Vision Language Model (VLM) may be used as the trained machine learning model.

[0043] The Smart Grip 1 (control device 11) may output the product identification result as appropriate. The product identification result may be used for any purpose. For example, the product identification result may be used to determine whether or not the product intended for purchase (described later) has been placed in basket B1. The Smart Grip 1 may also be further equipped with a communication module 15. The Smart Grip 1 (control device 11) may output the product identification result to an external computer (store terminal, user terminal, server device, etc.).

[0044] The process of identifying products does not necessarily have to be performed on Smart Grip 1. The process of identifying products may be performed on a computer other than Smart Grip 1 (e.g., a store terminal, a user terminal, a server device, etc.). The other computer may identify products in any way it chooses. For example, the other computer may acquire information from Smart Grip 1 and identify products based on the acquired information. The information acquired from Smart Grip 1 may include sensing data such as the captured images mentioned above. The other computer may identify products in the same way as Smart Grip 1. In another example, the other computer may not acquire information from Smart Grip 1, but instead acquire sensing data from sensors (one or more sensors) installed in the facility and identify products based on the acquired sensing data.

[0045] The sensors used may be selected arbitrarily. For example, the sensors may include an imaging device installed so that the product shelves are included in the imaging range. In this case, the other computer may identify the products that have been placed in the system by performing image analysis on the images obtained by the imaging device. Alternatively, for example, the sensors may include a load sensor (weight sensor) installed to measure the weight of the products displayed on the product shelves. In this case, the other computer may identify the products that have been placed in the system by identifying the product shelves whose weight has changed (decreased) based on the measurement data from the load sensor.

[0046] Furthermore, Smart Grip 1 may be linked with external systems such as systems deployed in the facility and user terminals, or it may be used independently without linking with external systems. In one example, sensors such as imaging devices and load sensors may not be installed in the facility, and the user TU's behavior may be monitored by Smart Grip 1 alone. In another example, sensors may be installed in the facility, and Smart Grip 1 may monitor the user TU's behavior in conjunction with sensors installed in the store, or independently of sensors installed in the store (i.e., without linking with store sensors).

[0047] [Loading luggage] Placing luggage (luggage TP) into the basket (basket B1) may include any form of carrying the luggage. As illustrated in Figure 1, in a typical example, placing luggage into the basket may mean placing luggage TP into the basket body B10 of basket B1, which includes the smart grip 1. In addition, placing luggage into the basket may include any action similar to placing luggage into the basket, such as hanging the handle of the basket containing the luggage onto the smart grip 1. Hanging the handle of the basket containing the luggage may include hanging the handle of the plastic bag containing the luggage, or hanging the hook of the hanger from which the luggage is suspended.

[0048] [Designated area] The predetermined area AZ serves as a criterion for controlling whether or not to output feedback 25. The predetermined area AZ may be set as appropriate depending on the embodiment. The predetermined area AZ may be set manually by operator input, or it may be generated at least partially automatically by computer processing. If there is an object to be guided or avoided (such as the target product PA in the first example described later), the predetermined area AZ may be defined based on that object. In one example, the predetermined area AZ may be set to encompass the object. In another example, the predetermined area AZ may not encompass the object, but may be set as at least a part of the area around the object. The number of predetermined areas AZ set within the target facility is not particularly limited and may be determined as appropriate depending on the embodiment.

[0049] The representation format of the predetermined area AZ is not particularly limited, and can be appropriately selected depending on the embodiment, as long as the positional relationship with the current position 20 can be evaluated. In one example, the predetermined area AZ may be configured to indicate the coordinate range of the predetermined area AZ on a map of the facility. The coordinate range may be specified by a single point (coordinate value). The attribute values ​​(shape, size, etc.) of the predetermined area AZ may be arbitrarily defined. When the control device 11 determines whether the current position 20 belongs to the predetermined area AZ or whether the current position 20 is approaching the predetermined area AZ, it may appropriately refer to the area information 125 configured to indicate the predetermined area AZ. The area information 125 may be stored in any storage area. In one example, the smart grip 1 may further include a storage unit 12. The area information 125 may be stored in the storage unit 12. In another example, the area information 125 may be stored in an external computer 5.

[0050] The source of area information 125 may be determined as appropriate depending on the embodiment. In one example, area information 125 may be pre-built into the storage unit 12. In another example, the smart grip 1 may further include a communication module 15. If a route 15 is provided, the area information 125 may be provided by an external computer 5. That is, the smart grip 1 may use the communication module 15 to obtain the area information 125 from the external computer 5 via a network. The external computer 5 is any computer other than the smart grip 1. For example, the external computer 5 may be a facility terminal (store terminal), a user terminal, a server device, etc. The area information 125 may be generated on the smart grip 1 (control device 11) or on another computer such as the external computer 5.

[0051] (Current location) The current location 20 may be appropriately derived from the measurements of the positioning sensor 14. For example, the measurements of the positioning sensor 14 may be used directly as the current location 20. Alternatively, for example, the current location 20 may be calculated from the measurements of the positioning sensor 14 by applying arbitrary calculation processing to one or more of the measurements of the positioning sensor 14. The representation format of the current location 20 is not particularly limited, as long as the positional relationship with a predetermined area AZ can be evaluated, and may be appropriately selected depending on the embodiment. In one example, the current location 20 may be configured to indicate the position using two-dimensional or three-dimensional coordinate values ​​on a map of the facility.

[0052] (Judgment method) The conditions for outputting feedback 25 include at least one of the following: whether the current position 20 belongs to a predetermined area AZ (first condition) and whether the current position 20 is approaching the predetermined area AZ (second condition). The conditions to be adopted may be selected as appropriate.

[0053] If the first condition is adopted, the control device 11 may determine in any way whether the acquired current position 20 belongs to a predetermined area AZ. For example, the control device 11 may determine whether the current position 20 belongs to a predetermined area AZ depending on whether the current position 20 is within the range of the predetermined area AZ. If the current position 20 is within the range of the predetermined area AZ, the control device 11 may determine that the current position 20 belongs to the predetermined area AZ. If the current position 20 is outside the range of the predetermined area AZ, the control device 11 may determine that the current position 20 does not belong to the predetermined area AZ. A position on the boundary of the predetermined area AZ may be determined to belong to the predetermined area AZ, or it may be determined not to belong to the predetermined area AZ.

[0054] Similarly, if the second condition is adopted, the control device 11 may determine by any means whether the acquired current position 20 is approaching a predetermined area AZ.

[0055] For example, the proximity area may be set based on a predetermined area AZ. The control device 11 may determine whether the current position 20 is approaching the predetermined area AZ depending on whether the acquired current position 20 belongs to the proximity area. Whether or not it belongs to the proximity area may be determined in the same way as the method described above for determining whether or not it belongs to the predetermined area AZ, by replacing the predetermined area AZ with the proximity area. If the current position 20 belongs to the proximity area, the control device 11 may determine that the current position 20 is approaching the predetermined area AZ. If the current position 20 does not belong to the proximity area, the control device 11 may determine that the current position 20 is not approaching the predetermined area AZ. A position on the boundary of the proximity area may be determined to be approaching the predetermined area AZ, or it may be determined to be not approaching the predetermined area AZ.

[0056] The proximity area defines the range that is determined to be in proximity to a predetermined area AZ. The proximity area may be set to include at least a portion of the area surrounding the predetermined area AZ. The proximity area may be set manually by operator input or may be automatically generated at least partially by computer processing. The attribute values ​​of the proximity area (shape, size, etc.) may be arbitrarily defined. The proximity area may be derived from the predetermined area AZ by calculation processing such as scaling. In a simple example, the proximity area may be determined by expanding the predetermined area AZ. The area may be configured to include a predetermined area AZ. The amount by which the predetermined area AZ is extended may be the same in all directions, or it may differ in at least some directions. The shape of the approaching area may be the same as the predetermined area AZ, or it may be different. In one example, the approaching area may be predetermined, and information indicating the approaching area may be included in the area information 125. In another example, the approaching area may be calculated from the predetermined area AZ each time.

[0057] Furthermore, for example, the control device 11 may calculate the distance between the acquired current position 20 and the predetermined area AZ. The distance may be calculated by any method. In a simple example, the control device 11 may calculate the distance (straight-line distance, etc.) between the current position 20 and the boundary of the predetermined area AZ without considering impassable areas such as the area of ​​product shelves. In another example, the control device 11 may exclude impassable areas, search for a path (shortest path, etc.) from the current position 20 to the boundary of the predetermined area AZ within the passable area, and calculate the distance of the searched path. The method for searching for a path may be appropriately selected depending on the embodiment. Known methods may be used for searching for a path. When there are obstacles such as product shelves, the straight-line distance to the target area may be short, but the travel distance to the target area may be long. According to this example, it is possible to determine whether or not the user is approaching the predetermined area AZ based on the actual travel distance.

[0058] After calculating the distance between the current position 20 and the predetermined area AZ, the control device 11 may determine whether the current position 20 is approaching the predetermined area AZ depending on whether the calculated distance is less than a threshold. If the calculated distance is less than the threshold, the control device 11 may determine that the current position 20 is approaching the predetermined area AZ. If the calculated distance exceeds the threshold, the control device 11 may determine that the current position 20 is not approaching the predetermined area AZ. If the calculated distance is equal to the threshold, the control device 11 may determine that the current position 20 is approaching the predetermined area AZ, or it may determine that the current position 20 is not approaching the predetermined area AZ. The threshold may be arbitrarily defined.

[0059] In one example, if the first condition is adopted, the control device 11 may output tactile feedback 25 if it determines that the current position 20 belongs to a predetermined area AZ. On the other hand, if it determines that the current position 20 does not belong to a predetermined area AZ, the control device 11 may omit outputting the feedback 25. Also in one example, if the second condition is adopted, the control device 11 may output feedback 25 if it determines that the current position 20 is approaching a predetermined area AZ. On the other hand, if it determines that the current position 20 is not approaching a predetermined area AZ, the control device 11 may omit outputting the feedback 25.

[0060] The conditions to be adopted for a designated area AZ may be defined as appropriate. Within the same facility, designated area AZs that adopt the first condition and designated area AZs that adopt the second condition may coexist. When the first condition is adopted, the output of feedback 25 can be started at a position closer to the designated area AZ compared to when the second condition is adopted. On the other hand, when the second condition is adopted, the output of feedback 25 can be started at a position slightly further away from the designated area AZ. The conditions adopted for the same designated area AZ may be switched as appropriate according to user specifications, requests from the facility (facility terminal), etc. The conditions to be adopted may be defined for each designated area AZ, for each type of designated area AZ, or collectively for a store / arbitrary area. Furthermore, the conditions to be adopted may be defined on the control device 11 side.

[0061] Note that the determination of the first and second conditions does not necessarily have to be performed by the control device 11. In another example, the determination processes for the first and second conditions may be performed by an external computer (store terminal, user terminal, server device, etc.). For example, the smart grip 1 may further include a communication module 15. The control device 11 performs the determination process for at least one of the first and second conditions by transmitting the acquired current location 20 to the external computer. The system may request the rows from an external computer. The external computer may, in response to this request, perform a determination process for at least one of the first and second conditions and return the obtained determination result to the Smart Grip 1 (control device 11). The control device 11 may acquire the determination result by receiving it.

[0062] [feedback] The configuration of the feedback 25 is not particularly limited, as long as it can be perceived through touch, and may be appropriately determined depending on the embodiment. The feedback 25 may consist of actions involving physical motion such as vibration or contact. The tactile feedback module 13 may consist of any device capable of performing actions that generate such physical motion. For example, the tactile feedback module 13 may consist of actuators such as a servo motor or a vibration motor. The type of actuator may be arbitrarily selected. The tactile feedback module 13 may consist of multiple types of actuators. For example, the tactile feedback module 13 may consist of a servo motor, a vibration motor, or a combination thereof. In the smart grip 1, the tactile feedback module 13 may be appropriately placed in a location where motion can be transmitted to the part grasped by the user TU (for example, the internal space within the range that can be grasped by the user TU).

[0063] Guiding to a designated area AZ may include bringing the user closer to the designated area AZ, bringing the user into the designated area AZ, bringing the user closer to a designated location within the designated area AZ, etc. Avoiding a designated area AZ may include making the user leave the designated area AZ, moving the user away from the designated area AZ, preventing the user from entering the designated area AZ, etc. Feedback 25 may be determined as appropriate in accordance with the instructions transmitted to the user TU when guiding to or avoiding a designated area AZ. Feedback 25 may be generated according to given rules. The rules for generating feedback 25 may be defined as appropriate depending on the embodiment.

[0064] (First feedback) In one example, at least one of the instructions to guide to a predetermined area AZ and the instructions to avoid the predetermined area AZ may be expressed by a change in vibration corresponding to the positional relationship between the current position 20 and the predetermined area AZ. Accordingly, the feedback 25 may include a first feedback consisting of vibration that changes according to the positional relationship between the current position 20 and the predetermined area AZ. The tactile feedback module 13 may include an actuator capable of outputting vibration, such as a vibration motor.

[0065] Changes in vibration may be defined by arbitrary rules. For example, the rules for vibration change may include increasing the vibration as the current position 20 approaches a designated area AZ. That is, the rules for vibration change may include decreasing the vibration as the current position 20 moves away from a designated area AZ. Moving closer to a designated area AZ may include, for example, approaching the boundary of the designated area AZ from outside the area AZ, entering the designated area AZ from outside the area AZ, or approaching a designated location within the designated area AZ (such as the location of the target product PA in the first example described later). Moving away from a designated area AZ may be the opposite of moving closer to a designated area AZ. Furthermore, increasing vibration may consist of increasing the intensity of vibration, increasing the period of vibration, or a combination of these. Decreasing vibration may be the opposite of increasing vibration. In another example, contrary to the above example, the rule for vibration change may include increasing the vibration as the current position 20 moves away from a predetermined area AZ. Moving away from a predetermined area AZ may include, for example, moving away from a predetermined position within the predetermined area AZ, leaving the predetermined area AZ, or moving away from the boundary of the predetermined area AZ outside the predetermined area AZ. The increase and decrease of vibration may be performed in stages. It may be broken up or performed continuously.

[0066] (Second feedback) In one example, at least one of the instructions to guide to a predetermined area AZ and the instructions to avoid the predetermined area AZ may include an instruction to point in a predetermined direction. Accordingly, the feedback 25 may include a second feedback consisting of an action to point in a predetermined direction, either together with or in place of the first feedback. The second feedback may be configured to precisely point in the direction of the target, or to roughly point in the direction of the target. The method of pointing in a predetermined direction may be determined as appropriate depending on the embodiment.

[0067] For example, the second feedback may include an action that logically points to a predetermined direction. The action that logically points to a predetermined direction may consist of an action that can identify the direction being pointed to by understanding its meaning in relation to a rule, such as indicating the right direction with one vibration, or indicating the left direction with two vibrations. The second feedback may also include an action that intuitively points to a predetermined direction together with, or in place of, the above logical action. The action that intuitively points to a predetermined direction may be an action that can directly sense the predetermined direction, such as swinging the arm of a servo motor in a predetermined direction, or increasing the vibration of a vibration motor corresponding to a predetermined direction.

[0068] If the second feedback action involves intuitively pointing in a predetermined direction, the haptic feedback module 13 may be configured to perform such an action. The configuration for intuitively pointing in a predetermined direction may be determined as appropriate depending on the embodiment.

[0069] For example, the haptic feedback module 13 may include a servo motor with an arm. In this case, the action of intuitively indicating a predetermined direction may include swinging the servo motor's arm in the predetermined direction. That is, the haptic feedback module 13 may intuitively indicate the direction of an object by the direction in which the servo motor's arm swings.

[0070] Furthermore, for example, the haptic feedback module 13 may include multiple vibration motors. The multiple vibration motors may be arranged separately in any direction (forward / backward, left / right, etc.). In this way, each vibration motor may be arranged in a different direction. In this case, the action of intuitively indicating a predetermined direction may include vibrating the vibration motor corresponding to the predetermined direction more strongly than the other vibration motors. That is, the haptic feedback module 13 may intuitively indicate the direction of the target by the vibration of the vibration motor corresponding to the target direction. Note that corresponding to a predetermined direction means being arranged in a predetermined direction.

[0071] As an example, the haptic feedback module 13 may be equipped with two vibration motors. The two vibration motors may be positioned separately in the left and right directions. The haptic feedback module 13 may indicate the left direction by vibrating the vibration motor positioned on the left direction more strongly than the vibration motor positioned on the right direction. Alternatively, the haptic feedback module 13 may indicate the right direction by vibrating the vibration motor positioned on the right direction more strongly than the vibration motor positioned on the left direction.

[0072] Increasing the vibration intensity, similar to increasing the vibration described above, may be achieved by increasing the vibration strength, increasing the vibration period, or a combination thereof. Other vibration motors may or may not be vibrated. In the latter case, vibrating a vibration motor corresponding to a given direction more strongly than other vibration motors may include operating only the corresponding vibration motor and not operating the other vibration motors.

[0073] Furthermore, for example, similar to the above, the haptic feedback module 13 may include multiple vibration motors. In this case, the operation of intuitively indicating a predetermined direction may include vibrating at least two or more of the multiple vibration motors in an order corresponding to the predetermined direction. That is, the haptic feedback module 13 may intuitively indicate the direction of the object by vibrating in that order.

[0074] If the direction of the target can be identified, the order in which the vibrations are performed may be appropriately defined depending on the embodiment. In one example, two or more vibration motors located along the direction of the target may be selected from a plurality of vibration motors. The control device 11 may determine the order in which the vibration motors located at the rear end (opposite direction to the direction of the target) of the two or more selected vibration motors are vibrated first, and the vibration motors located at the front end (leading end) of the direction of the target are vibrated later. Vibrating two or more vibration motors in the determined order may be performed by gradually switching which vibration motor is vibrated from the first vibration motor to the next, or by stopping the vibration of the first vibration motor and then starting the vibration of the next vibration motor. The vibration in the determined order may be performed repeatedly multiple times.

[0075] As an example, the haptic feedback module 13 may be equipped with two vibration motors, similar to the above. In this case, the haptic feedback module 13 may indicate the right direction by vibrating the vibration motor positioned to the left, followed by the vibration motor positioned to the right. Alternatively, the haptic feedback module 13 may indicate the left direction by vibrating the vibration motor positioned to the right, followed by the vibration motor positioned to the left.

[0076] [Specific example] The predetermined area AZ may be set as appropriate depending on the purpose of providing feedback 25. The purpose of feedback 25 is not particularly limited as long as it relates to guiding to or avoiding the predetermined area AZ, and may be determined as appropriate depending on the embodiment. In one example of this embodiment, the predetermined area AZ may include at least one of the following first to eighth examples.

[0077] (1) Case 1 Figure 2 schematically shows an example (first example) of a predetermined area AZ according to this embodiment. In one example, the purpose of providing feedback 25 may include guiding the user TU toward the target product PA when the smart grip 1 is used in a store. Accordingly, the predetermined area AZ may include a visibility area AA where the target product PA is visible. Outputting feedback 25 may include outputting feedback 25A configured to indicate the direction in which the target product PA is located. An indication of the direction in which the target product PA is located is an example of an instruction to guide to the predetermined area AZ. Feedback 25A is an example of feedback 25.

[0078] Visibility area AA is an example of a predetermined area AZ. Visibility area AA may be set appropriately based on the location of the target product PA. Visibility area AA may be set to encompass the location of the target product PA, or it may not encompass the location of the target product PA, but may be set as at least a part of the area surrounding the target product PA. The target product PA may be appropriately selected from the products PZ sold in the store.

[0079] The feedback 25A may be configured as appropriate to communicate to the user TU the direction in which the target product PA is located. For example, the feedback 25A may include the first feedback described above. For instance, the feedback 25A may be configured such that the vibration output by the haptic feedback module 13 increases as the user approaches the location of the target product PA. Furthermore, feedback 25A may include the second feedback together with or in place of the first feedback. For example, feedback 25A may be configured to indicate, logically and intuitively, at least one of the directions in which the target product PA is located relative to the current position 20. The direction in which the target product PA is located may be derived from the current position 20 and the location of the target product PA. The source of information indicating the location of the target product PA may be determined as appropriate depending on the embodiment. For example, information indicating the location of the target product PA may be included in area information 125.

[0080] The control device 11 may output feedback 25A to the user TU when the current position 20 belongs to the viewing area AA, or when the current position 20 is approaching the viewing area AA. According to one example of this embodiment, it is possible to reduce the effort required of the user TU when guiding the user TU to the location of the target product PA.

[0081] As illustrated in Figure 2, the product shelf PS is configured to display products PZ on both the left and right sides, and the target product PA may be placed on one of the sides (first side S1). When the user TU is located on the other side (second side S2), the straight-line distance to the target product PA is short, but it is difficult to see and pick up the target product PA because it is obstructed by the product shelf PS.

[0082] Therefore, in one example, the product shelf PS may have a first side S1 on which the target product PA is placed, and a second side S2 opposite to the first side S1. The target product PA does not have to be placed on the second side S2. In this case, the viewing area AA may be set on the first side S1 rather than the second side S2. According to this example, by providing feedback 25 on the first side S1 where it is easy to take the target product PA, and omitting the execution of feedback 25 on the second side S2 where it is difficult to take the target product PA, the position of the target product PA can be accurately indicated.

[0083] (2) Case 2 Figure 3 schematically shows an example of a predetermined area AZ (second example) according to this embodiment. In one example, the purpose of providing feedback 25 may include guiding the user TU towards the target product PB that is being promoted when the Smart Grip 1 is used in a store. Accordingly, the predetermined area AZ may include the promotion area AB of the target product PB. Outputting feedback 25 may include outputting feedback 25B, which is configured to indicate the direction in which the promotion area AB is located when the current position 20 is approaching the promotion area AB. An indication of the direction in which the promotion area AB is located is an example of an instruction to guide to the predetermined area AZ. Feedback 25B is an example of feedback 25.

[0084] Promotion Area AB is an example of a designated Area A and B. Promotion Area AB may be set as appropriate based on the location of the target product's private brand (PB). Promotion Area AB may be set to encompass the location of the target product's PB, or it may not encompass the location of the target product's PB, but may be set as at least a part of the area surrounding the target product's PB. The target product's PB may be appropriately selected from the products sold in the store. The promotion may include any activities to promote the sale of the target product's PB.

[0085] Feedback 25B may be configured as appropriate to communicate to the user TU the direction in which the promotion area AB is located. For example, feedback 25B may include the first feedback described above. For example, feedback 25B may be configured such that the vibration output by the haptic feedback module 13 increases as the user approaches the promotion area AB. Feedback 25B may also include the second feedback described above, either together with or in place of the first feedback. For example, feedback 25B may be configured to point logically and intuitively to the direction in which the promotion area AB is located relative to the current position 20. The direction in which the promotion area AB is located may be derived from the current position 20 and the range of the promotion area AB.

[0086] According to one example of this embodiment, it is possible to reduce the effort required of the user TU when guiding the user TU to the area where the target product PB is being promoted. Note that the timing of outputting feedback 25B is not limited to this example and may be changed as appropriate depending on the embodiment. In another example, outputting feedback 25 may include outputting feedback that indicates the direction in which the promoted target product PB is located, when the current position 20 is located in the promotion area AB, either together with or instead of outputting feedback 25B. This feedback may be configured in the same way as feedback 25A by replacing the target product PA with the target product PB.

[0087] (3) Third case Figure 4 schematically shows an example of a predetermined area AZ (third example) according to this embodiment. In one example, the purpose of providing feedback 25 may include discouraging payment at the register RC when using the Smart Grip 1 in a store and there are items that have been forgotten among the items to be purchased. Accordingly, the predetermined area AZ may include the register area AC. Outputting feedback 25 may include outputting feedback 25C, which is configured to indicate an instruction to turn back from the register area AC when the acquired current position 20 belongs to or is approaching the register area AC, and it has not been determined that all items to be purchased have been placed in the basket B1. An instruction to turn back from the register area AC is an example of an instruction to avoid the predetermined area AZ. Feedback 25C is an example of feedback 25.

[0088] The checkout area AC is an example of a designated area AZ. The checkout area AC may be set appropriately based on the location of the register RC. The checkout area AC may be set to encompass the location of the register RC, or it may not encompass the location of the checkout area AC but be set as at least a part of the area surrounding the register RC. The checkout area AC may be set appropriately based on the flow of customers who take selected items from the sales floor and head towards the register RC. For example, the checkout area AC may be set to extend from the register RC towards the sales floor. The checkout area AC may be set to include the entrance to the register RC.

[0089] Feedback 25C may be configured as appropriate to communicate instructions to the user TU to return from the checkout area AC. In one example, feedback 25C may include the first feedback described above. For example, feedback 25C may be configured such that the vibration output by the haptic feedback module 13 increases as the user approaches the checkout area AC. This feedback 25C may be used as a warning to notify the user that there is an item that has been forgotten to be selected. Feedback 25C may also include the second feedback described above, either together with or in place of the first feedback. For example, feedback 25C may be configured to indicate, logically and intuitively, at least one direction away from the checkout area AC at the current position 20. The direction away from the checkout area AC is one example of a direction to return from the checkout area AC. The direction away from the checkout area AC may include a direction opposite to the direction in which the checkout area AC is located, as viewed from the current position 20. The direction away from the checkout area AC may be derived from the current position 20 and the range of the checkout area AC.

[0090] The control device 11 may determine, by any means, whether or not all items intended for purchase have been placed in basket B1. For example, the control device 11 may further include an input device 17. The control device 11 may determine whether all items to be purchased have been placed in basket B1 based on the input from the user TU via the input device 17. For example, the control device 11 may accept input indicating whether all items to be purchased have been placed in basket B1 all at once, such as by turning a switch on or off. Upon receiving the input that all items to be purchased have been placed in basket B1, the control device 11 may determine that all items to be purchased have been placed in basket B1. On the other hand, while no such input operation is received, the control device 11 may determine that not all items to be purchased have been placed in basket B1.

[0091] Furthermore, for example, the control device 11 may also be equipped with an output device 16 and may have a shopping list 32 stored in advance. The control device 11 may output the shopping list 32 to the output device 16 and individually receive input from the user TU whether or not they have placed the planned purchase items into the shopping cart B1 (i.e., selected the items). Whether or not a planned purchase item has been placed into the shopping cart B1 may be received by any user interface component (UI component), such as a checkbox provided for each planned purchase item. When input that all planned purchase items have been placed into the shopping cart B1 has been completed, the control device 11 may determine that all planned purchase items have been placed into the shopping cart B1. If there are still planned purchase items for which input that they have been placed into the shopping cart B1 has not been completed, the control device 11 may determine that not all planned purchase items have been placed into the shopping cart B1 yet.

[0092] The shopping list 32 may be configured as appropriate to show a list of items to be purchased. The shopping list 32 may be generated by input from an operator (user TU, user TU's family, etc.) or may be generated at least partially automatically by computer processing. The shopping list 32 may be generated on the smart grip 1 (control device 11) or on an external computer (user terminal, etc.). The control device 11 may obtain the shopping list 32 from an external computer.

[0093] In one example, the control device 11 may determine whether all planned purchase items have been placed in basket B1 based on the identification results of the placed items 30. For example, the control device 11 may compare the list of placed items 30 shown in the identification results with the list of planned purchase items shown in the shopping list 32. In this comparison, if all planned purchase items are identified as placed items 30, and the list of planned purchase items is included in the list of placed items 30 (i.e., the shopping list 32 is included in the identification results), the control device 11 may determine that all planned purchase items have been placed in basket B1. On the other hand, if there are planned purchase items remaining in the shopping list 32 that have not been identified as placed items 30 due to items being forgotten, the control device 11 may determine that not all planned purchase items have been placed in basket B1 yet. In another example, the control device 11 may determine whether all planned purchase items have been placed in basket B1 based on at least one of the user TU's input and the identification results of the placed items 30.

[0094] The identification of product 30 may be performed by any method. For example, the above method using a detection sensor and an imaging device may be used as the method for identifying product 30. A known method may also be used for identifying product 30. Furthermore, the identification process for product 30 may be performed on the smart grip 1 or on another computer other than the smart grip 1. In the former case, the control device 11 may obtain the identification result of product 30 by performing the identification process for product 30. In the latter case, the control device 11 may obtain the identification result of product 30 from another computer.

[0095] The output processing of feedback 25C may be controlled in any way. For example, the control device 11 may set the output to allow the output of feedback 25C at initial points such as startup or when entering the store. All items intended for purchase have not yet been placed in basket B1. While it is determined that there are no items to be purchased, the control device 11 may maintain the setting that allows the output of feedback 25C. This allows the control device 11 to output the above feedback 25C until it is determined that all items to be purchased have been placed in shopping cart B1. Then, the control device 11 may change the output setting to prohibit the output of feedback 25C when it is determined that all items to be purchased have been placed in shopping cart B1. This allows the control device 11 to stop the output of the above feedback 25C once it is determined that all items to be purchased have been placed in shopping cart B1.

[0096] According to one example of this embodiment, in situations where not all intended purchases have been placed in basket B1 (i.e., some items have been forgotten), it is possible to avoid paying at the register (RC), thereby reducing the effort required of the user (TU).

[0097] (4) Case Study 4 Figure 5 schematically shows an example of a predetermined area AZ (fourth example) according to this embodiment. In one example, the purpose of providing feedback 25 may include avoiding crowded areas when using the Smart Grip 1 at a facility. Accordingly, the predetermined area AZ may include a crowded area AD. Outputting feedback 25 may include outputting feedback 25D which is configured to indicate an instruction to avoid the crowded area AD. An instruction to avoid the crowded area AD is an example of an instruction to avoid the predetermined area AZ. Feedback 25D is an example of feedback 25.

[0098] The congested area AD is an example of a designated area AZ. The congested area AD is an area that is congested due to a high volume of people, robotic devices, etc. The indicator for evaluating congestion may be arbitrarily defined. The extent of congestion may be measured by any method. For example, the congested area AD may be measured by sensors installed in the facility, such as pedestrian flow sensors and imaging devices. Alternatively, for example, the congested area AD may be measured by information obtained from people present in the facility, such as location information of user terminals. Known methods may be used for measuring the congested area AD. The congested area AD may be measured in real time. The congested area AD may be measured periodically. The area where congestion is detected by measurement may be used as is as the congested area AD. The congested area AD may be calculated from the area where congestion is detected by measurement using any calculation process. The control device 11 may appropriately acquire information indicating the congested area AD from an external computer (facility terminal, user terminal, server device, etc.).

[0099] Feedback 25D may be configured as appropriate to communicate instructions to the user TU to avoid the congested area AD. For example, Feedback 25D may include the first feedback described above. For example, Feedback 25D may be configured so that the vibration output by the haptic feedback module 13 increases as the user approaches the congested area AD. Feedback 25D may also include the second feedback described above, either together with or in place of the first feedback. For example, Feedback 25D may be configured to indicate, at least logically and intuitively, the direction in which the congested area AD is located relative to the current position 20. In this case, the user TU can avoid the congested area AD by moving in a direction other than the direction indicated by Feedback 25D. Alternatively, for example, Feedback 25D may be configured to indicate, at least logically and intuitively, a direction away from the congested area AD or a direction not to enter the congested area AD from the current position 20. The direction away from the congested area AD may at least partially overlap with the direction not to enter the congested area AD. In this case, the user TU can avoid the congested area AD by moving in the direction indicated by the feedback 25D. The direction in which the congested area AD exists, the direction away from the congested area AD, and the direction not to enter the congested area AD may be derived from the current position 20 and the range of the congested area AD.

[0100] The control device 11 may output feedback 25D to the user TU if the current position 20 belongs to a congested area AD, or if the current position 20 is approaching a congested area AD. According to one example of this embodiment, it is possible to reduce the effort required of the user TU when avoiding a congested area.

[0101] Furthermore, when using Smart Grip 1 in a store, the congested area AD may include the congested cash register RD. The inclusion of a congested cash register RD in the congested area AD may include the congested cash register RD belonging to the congested area AD, and the congested cash register RD being outside the scope of the congested area AD, but the aisle following the congested cash register RD belonging to the congested area AD.

[0102] Furthermore, instructions to avoid the congested area AD may include instructions to guide the user to other registers OD besides the congested register RD. For example, the feedback 25D may be configured such that the vibration output by the haptic feedback module 13 increases as the user approaches the congested register RD or other registers OD. Alternatively, for example, the feedback 25D may be configured to indicate, logically and intuitively, the direction in which the congested register RD or other registers OD are located relative to the current position 20. The direction in which the congested register RD is located may be derived from the current position 20 and the location of the congested register RD. The direction in which the other registers OD are located may be derived from the current position 20 and the location of the other registers OD. Information indicating the location of each register (RD, OD) may be acquired as appropriate.

[0103] According to one example of this embodiment, it is possible to reduce the effort required of the user TU when avoiding crowded register RDs.

[0104] (5) Case Study 5 Figure 6 schematically shows an example of a predetermined area AZ (Fifth Example) according to this embodiment. In one example, the purpose of providing feedback 25 may include guiding the user to an uncongested area when using the Smart Grip 1 at the facility. Accordingly, the predetermined area AZ may include an uncongested area AE. Outputting feedback 25 may include outputting feedback 25E configured to indicate an instruction to guide the user to the uncongested area AE. An instruction to guide the user to the uncongested area AE is an example of an instruction to guide the user to the predetermined area AZ. Feedback 25E is an example of feedback 25.

[0105] An uncongested area AE is an example of a designated area AZ. An uncongested area AE is an area that is not congested due to low traffic volume of people, robots, etc. The indicator for evaluating uncongestedness may be arbitrarily defined. The range of uncongested areas may be measured by any method. For example, as in the fourth example above, an uncongested area AE may be measured by sensors installed in the facility. An uncongested area AE may be measured directly or derived from a congested area AD (i.e., measured indirectly). As an example of a method of deriving from a congested area AD, an uncongested area AE may be identified as at least a part of the range other than the congested area AD. A known method may be used for measuring an uncongested area AE. An uncongested area AE may be measured in real time. An uncongested area AE may be measured periodically. The control device 11 may appropriately acquire information indicating an uncongested area AE from an external computer (facility terminal, user terminal, server device, etc.). The control device 11 may acquire information indicating a congested area AD and derive a non-congested area AE from the congested area AD indicated by the acquired information each time.

[0106] The feedback 25E may be configured as appropriate to transmit instructions to the user TU to guide them to an uncrowded area AE. In one example, the feedback 25E may include the first feedback described above. For example, the feedback 25E may be vibrations output by the haptic feedback module 13 as the user approaches or moves away from the uncrowded area AE. It may be configured to increase. The feedback 25E may also include the second feedback together with or in place of the first feedback. For example, the feedback 25E may be configured to indicate, logically and intuitively, at least one of the directions in which the uncongested area AE exists from the current position 20, or a direction in which the current position 20 does not move away from the uncongested area AE (including directions in which it is possible to stay in the uncongested area AE). The direction in which the uncongested area AE does not move away may be any direction in which the user does not leave the uncongested area AE. In this case, the user TU can be guided to the uncongested area AE by moving in the direction indicated by the feedback 25E. The direction in which the uncongested area AE exists and the direction in which the user does not move away from the uncongested area AE may be derived from the current position 20 and the range of the uncongested area AE.

[0107] The control device 11 may output feedback 25E to the user TU when the current position 20 belongs to an uncongested area AE, or when the current position 20 is approaching an uncongested area AE. According to one example of this embodiment, it is possible to reduce the effort required of the user TU when guiding them to an area that is not crowded with people.

[0108] (6) Case 6 Figure 7 schematically shows an example of a predetermined area AZ (sixth example) according to this embodiment. In one example, the purpose of providing feedback 25 may include informing the user of the direction in which the store employee CF is located when the smart grip 1 is used in a store. Accordingly, the predetermined area AZ may include the store area AF in which the store employee CF is located. Outputting feedback 25 may include outputting feedback 25F configured to indicate the direction in which the store employee CF is located. An indication of the direction in which the store employee CF is located is an example of an instruction to guide the user to the predetermined area AZ. Feedback 25F is an example of feedback 25.

[0109] The store area AF is an example of a predetermined area AZ. The store area AF may be set arbitrarily within the store. For example, the store area AF may be set to include the entire store, or to include only a part of the store. The store area AF may be set to include the range in which an employee CF may be present in a state where they can respond to customers. The location where the employee CF is present may be appropriately specified depending on the embodiment. In one example, the location where the employee CF is present may be specified by a fixed value (for example, a predetermined location such as a general information counter). In another example, the location of the employee CF may be detected in real time by a sensor installed in the store. For detecting the location of the employee CF, any sensor may be used, for example, an imaging device, a human presence sensor, etc. In this case, the control device 11 may obtain information indicating the location of the employee CF from an external computer such as a store terminal. The store area AF may be set fixedly. If the location where the employee CF is present may change, the store area AF may be set dynamically according to the location where the employee CF is present. In this case, the store area AF may be set to encompass the location where the employee CF is located, or it may not encompass the location where the employee CF is located, but rather be set as at least a portion of the area surrounding the location where the employee CF is located.

[0110] The feedback 25F may be configured as appropriate to indicate to the user TU the direction in which the employee CF is located. In one example, the feedback 25F may include the first feedback described above. For example, the feedback 25F may be configured such that the vibration output by the haptic feedback module 13 increases as the user approaches the location of the employee CF. The feedback 25F may also include the second feedback described above, either together with or in place of the first feedback. For example, the feedback 25F may be configured to indicate, at least logically and intuitively, the direction in which the employee CF is located relative to the current position 20. The direction in which the employee CF is located may be derived from the current position 20 and the location of the employee CF.

[0111] The control device 11 may output feedback 25F to the user TU when the current position 20 belongs to the store area AF, or when the current position 20 is approaching the store area AF. According to one example of this embodiment, it is possible to reduce the effort required of the user TU when guiding them towards the location of a store employee CF. In addition, by guiding the customer (user TU) towards the store employee CF, it is possible to reduce the effort required for the store employee CF to go towards the customer. As a result, it is possible to reduce the number of store employee CFs that need to be placed in the store.

[0112] (7) Case 7 Figure 8 schematically shows an example of a predetermined area AZ (7th example) according to this embodiment. In one example, the purpose of providing feedback 25 may include guiding the user TU to a product PG (recommended product) recommended to the user TU. Accordingly, the predetermined area AZ may include a recommended product area AG where the product PG recommended to the user TU is located. Outputting feedback 25 may include outputting feedback 25G configured to indicate an instruction to guide to the recommended product area AG. An instruction to guide to the recommended product area AG is an example of an instruction to guide to the predetermined area AZ. Feedback 25G is an example of feedback 25.

[0113] The Recommended Product Area AG is an example of a predetermined Area AZ. The Recommended Product Area AG may be set appropriately based on the location of the recommended product PG. The Recommended Product Area AG may be set to encompass the location of the recommended product PG, or it may not encompass the location of the recommended product PG, but may be set as at least a part of the area surrounding the recommended product PG. The Recommended Product Area AG may consist of the location (point) of the recommended product PG. The recommended product PG may be appropriately selected from the product PZ sold in the store. The recommended product PG may be selected according to the user TU. A known method may be used for selecting the recommended product PG.

[0114] Feedback 25G may be configured as appropriate to communicate the presence of a recommended product PG to the user TU. For example, Feedback 25G may include the first feedback described above. For example, Feedback 25G may be configured such that the vibration output by the haptic feedback module 13 increases as the user approaches the recommended product area AG. Feedback 25G may also include the second feedback described above together with or in place of the first feedback. For example, Feedback 25G may be configured to indicate, logically and intuitively, at least one of the directions in which the recommended product area AG is located relative to the current position 20. The direction in which the recommended product area AG is located may be derived from the current position 20 and the location of the recommended product PG. Information indicating the location of the recommended product PG may be acquired as appropriate.

[0115] The control device 11 may output feedback 25G to the user TU when the current position 20 belongs to the recommended product area AG, or when the current position 20 is approaching the recommended product area AG. According to one example of this embodiment, it is possible to reduce the effort required of the user TU when guiding them to the area where the recommended product PG is displayed.

[0116] (8) Case 8 Figure 9 schematically shows an example of a predetermined area AZ (8th example) according to this embodiment. In one example, the purpose of providing feedback 25 may include avoiding the purchase of product PH (non-recommended product) that is not recommended to the user TU. Accordingly, the predetermined area AZ may include a non-recommended product area AH where product PH that is not recommended to the user TU exists. Outputting feedback 25 may include outputting feedback 25H configured to indicate an instruction to avoid the non-recommended product area AH. An instruction to avoid the non-recommended product area AH is an example of an instruction to avoid the predetermined area AZ. Feedback 25H is feedback 2 This is an example of number 5.

[0117] The non-recommended product area AH is an example of a designated area AZ. The non-recommended product area AH may be set appropriately based on the location of the non-recommended product PH. The non-recommended product area AH may be set to encompass the location of the product PH, or it may not encompass the location of the product PH, but may be set as at least a part of the area surrounding the product PH. The non-recommended product area AH may consist of the location (point) of the product PH. The non-recommended product PH may be appropriately selected from the products PZ sold in the store. For example, if the user TU is a minor, the non-recommended product PH may be products with age restrictions on purchase, such as alcoholic beverages.

[0118] Feedback 25H may be configured as appropriate to communicate instructions to the user TU to avoid unrecommended product PH. For example, Feedback 25H may include the first feedback described above. For example, Feedback 25H may be configured so that the vibration output by the haptic feedback module 13 increases as the user approaches the unrecommended product area AH. Feedback 25H may also include the second feedback described above, either together with or in place of the first feedback. For example, Feedback 25H may be configured to indicate, logically and intuitively, at least one of the directions in which the unrecommended product area AH is located, relative to the current position 20. In this case, the user TU can avoid the unrecommended product area AH by moving in a direction other than the direction indicated by Feedback 25H. Alternatively, for example, Feedback 25H may be configured to indicate, logically and intuitively, at least one of the directions in which the user moves away from the unrecommended product area AH or does not enter the unrecommended product area AH, relative to the current position 20. The direction away from the unrecommended product area AH may at least partially overlap with the direction not to enter the unrecommended product area AH. In this case, the user TU can avoid the unrecommended product area AH by moving in the direction indicated by feedback 25H. The direction in which the unrecommended product area AH exists, the direction away from the unrecommended product area AH, and the direction not to enter the unrecommended product area AH may be derived from the current position 20 and the range of the unrecommended product area AH.

[0119] The control device 11 may output feedback 25H to the user TU if the current position 20 belongs to the unrecommended product area AH, or if the current position 20 is approaching the unrecommended product area AH. According to one example of this embodiment, it is possible to reduce the effort required of the user TU when they need to avoid areas where unrecommended products PH are displayed.

[0120] §2 Example Configuration [Hardware configuration] As shown in Figure 1, the smart grip 1 includes a computer to which a control unit 11, a memory unit 12, a haptic feedback module 13, a positioning sensor 14, a communication module 15, an output device 16, and an input device 17 are electrically connected. In the smart grip 1, at least a part of this computer may be housed in a box.

[0121] The control device 11 is configured to perform information processing based on a program and various data, including a processor P. The processor P is a hardware processor and is an example of a processor resource. The type of processor P may be appropriately selected depending on the embodiment. For example, the processor P may be a CPU (Central Processing Unit), a microcontroller, etc. It may consist of a cross-processor, FPGA (field-programmable gate array), DSP (digital signal processor), GPU (graphics processing unit), ASIC (application-specific integrated circuit), etc.

[0122] The storage unit 12 may consist of a hard disk drive, a solid-state drive, semiconductor memory, etc. The storage unit 12 is an example of a memory resource. In this embodiment, The memory unit 12 stores various information, such as the program 81 and area information 125. The program 81 is a program that causes the control device 11 to perform information processing (Figure 14, described later) related to the output of the feedback 25 by the haptic feedback module 13. The program 81 includes a series of instructions for said information processing. The area information 125 may be held independently of the program 81 or may be included within the program 81.

[0123] At least one of the program 81 and the area information 125 may be stored in the storage medium SR1 instead of or together with the storage unit 12. The storage medium SR1 is configured to store various types of information (stored programs, etc.) by electrical, magnetic, optical, mechanical, or chemical means so that a machine such as a computer can read the information. The storage unit 12 and the storage medium SR1 are examples of non-temporary storage media. The Smart Grip 1 (computer) may retrieve at least one of the program 81 and the area information 125 from the storage medium SR1. The storage medium SR1 may be a disk-type storage medium (CD, DVD, etc.) or a non-disk-type storage medium such as semiconductor memory (flash memory, etc.). Any drive device may be used to read the information stored in the storage medium SR1. The type of drive device may be appropriately selected according to the storage medium SR1.

[0124] The positioning sensor 14 is configured to measure position. The type of positioning sensor 14 is not particularly limited as long as it can measure position, and may be appropriately selected depending on the embodiment. For example, the positioning sensor 14 may consist of a GPS (Global Positioning System) sensor, a GNSS (Global Navigation Satellite System) sensor, etc. Also, for example, The positioning sensor 14 may consist of a beacon receiver. In this case, the facility may be equipped with multiple beacon transmitters. The position of the smart grip 1 may be appropriately measured (estimated) from the strength of the beacon signal received by the positioning sensor 14 (beacon receiver). For example, the positioning sensor 14 may estimate the distance to each beacon transmitter according to the strength of the signal received by the beacon receiver. The positioning sensor 14 may measure the position of the smart grip 1 from the estimated distance to each beacon transmitter by tripointal surveying. At least a part of this position measurement process may be performed by the control device 11.

[0125] The communication module 15 is configured to perform wired or wireless communication over a network. The communication module 15 may consist of, for example, a wired LAN (Local Area Network) module, a wireless LAN module, etc. The type (standard) of network is not particularly limited and may be appropriately selected depending on the embodiment. The type of network may be appropriately selected from, for example, the Internet, wireless communication network, mobile communication network, telephone network, dedicated network, etc. The smart grip 1 (control device 11) can perform data exchange with other computers (for example, external computer 5, etc.) via the communication module 15.

[0126] The output device 16 is configured to output information. The output device 16 may consist of, for example, a display, a speaker, an indicator light, etc. The format of the information output may be appropriately selected from text, images, sound, etc. If the output device 16 includes a display, it is preferable that the display be placed in a location where the output information can be seen while the user is holding the smart grip 1. This allows the user to check the information displayed on the display while using the smart grip 1.

[0127] The output device 16 may be used to output any information. For example, as described above, the output device 16 may be used to output the shopping list 32. Also, for example, if the smart grip 1 is further equipped with a detection sensor that detects when an item is placed in the machine, the output device 16 may be used to output information related to the item being placed in the machine in response to the detection of the item being placed in the machine by the detection sensor. The information to be output may be stored in the storage unit 12 in advance, or it may be obtained from an external computer.

[0128] The input device 17 is configured to accept information input. The input device 17 may consist of, for example, a keyboard, a touch panel, an operator, a microphone, etc. The input device 17 may be used for any operation on the smart grip 1. For example, as described above, the input device 17 may be used to input that all planned purchase items have been placed in basket B1, or to input each item that has been placed in basket B1. The output device 16 and the input device 17 may be at least partially integrated by a touch panel display or the like.

[0129] Regarding the specific hardware configuration of Smart Grip 1 (computer), components can be omitted, replaced, and added as appropriate depending on the embodiment. For example, the control device 11 may include multiple hardware processors (processor P). At least one of the communication module 15, output device 16, and input device 17 may be omitted. At least one of the program 81 and area information 125 may be stored in an external storage device such as a NAS. An external storage device is also an example of a non-temporary storage medium. Smart Grip 1 may include multiple computers. The hardware configuration of each computer may or may not be the same. In addition, the computers included in Smart Grip 1 may be a specially designed computer, a general-purpose PC (Personal Computer), a tablet, etc. It may consist of a PC, terminal device (including a smartphone), etc. For example, the computer included in Smart Grip 1 may consist of a smartphone. Smart Grip 1 may be constructed by mounting a smartphone on a housing (attachment).

[0130] [Structure of Smart Grip] Figures 10 and 11 are schematic side and top views showing an example of the structure of the smart grip 1 according to this embodiment. In one example, the smart grip 1 may further include a housing 90 that houses a haptic feedback module 13, a positioning sensor 14, and a control device 11. The housing 90 may be provided with one or more grooves (grooves 915, grooves 935, etc.) for hooking the handle portion B11 provided on the basket B1. According to this example, a smart grip 1 that can be used as a basket handle can be provided by replacing the existing basket handle portion (handle portion B11).

[0131] The structure of the smart grip 1, including the shape of the housing 90, the size of the housing 90, the arrangement of each component (control device 11, etc.) within the housing 90, the number of grooves, the shape of the grooves, and the arrangement of the grooves, may be appropriately determined according to the embodiment. In the example shown in Figures 10 and 11, it is assumed that the tactile feedback module 13 is composed of a vibration motor 130 and a servo motor 135. It is assumed that the output device 16 and input device 17 are composed of a touch panel display 167. It is assumed that the housing 90 has a pair of grooves (915, 935). It is assumed that the smart grip 1 further includes a detection sensor composed of a pair of load sensors 180 and an imaging device 19 provided separately from the detection sensor.

[0132] For the sake of explanation, in the following, the left-right direction in Figures 10 and 11 will be referred to as the "front-back direction." The left direction in Figures 10 and 11 will be referred to as the "front direction," and the right direction in Figures 10 and 11 will be referred to as the "back direction." The direction perpendicular to the plane of the paper in Figure 10 and the up-down direction in Figure 11 will be referred to as the "left-right direction." The up direction in Figure 11 will be referred to as the "right direction," and the down direction in Figure 11 will be referred to as the "left direction." The up-down direction in Figure 10 and the direction perpendicular to the plane of the paper in Figure 11 will be referred to as the "up direction." The up direction in Figure 10 will be referred to as the "up direction," and the down direction in Figure 10 will be referred to as the "down direction."

[0133] In one example, the housing 90 may comprise a first part 91, a second part 92, and a third part 93. In the example shown in each figure, the first part 91, the second part 92, and the third part 93 are arranged in a line from rear to front in the front-to-back direction. Each part (91, 92, 93) is formed in the shape of a rectangular parallelepiped. The first part 91 and the third part 93 may have substantially similar shapes. The width (length in the left-right direction) of the second part 92 may be shorter than that of the first part 91 and the third part 93. This allows the second part 92 to constitute the portion that the user grasps. In the example shown in each figure, the second part 92 extends along the front-rear direction. Therefore, the user can hold the smart grip 1 by grasping the second part 92 with their hand along the front-rear direction. The total length of the second part 92 around the front-rear axis may be determined within a range of a length that can be grasped by hand.

[0134] Side walls may be provided at the horizontal (left-right and front-back) ends of each section (91, 92, 93). A bottom surface may also be provided at the lower end of each section (91, 92, 93). This allows each section (91, 92, 93) to have an internal space enclosed by its side walls, which houses the computer portion of the Smart Grip 1. The internal spaces of the first section 91 and the second section 92 may be at least partially continuous. The internal spaces of the second section 92 and the third section 93 may also be at least partially continuous. The upper ends of each section (91, 92, 93) may be closed with a lid or the like, or they may be open.

[0135] A groove 915 may be provided on the rear end side of the first portion 91. In the example shown in each figure, the groove 915 is formed by recesses provided on the left-right opposing side walls of the first portion 91. Each recess is rectangular in shape. The groove 915 is formed by aligning the recesses in the front-rear direction. Even when the upper end of the first portion 91 is closed, the portion of the groove 915 on the upper end surface of the first portion 91 may be left open.

[0136] Similarly, a groove 935 may be provided on the front end side of the third portion 93. In the example shown in each figure, the groove 935 is formed by recesses provided on the left-right opposing side walls of the third portion 93. Each recess is rectangular in shape. The groove 935 is formed by aligning the recesses in the front-rear direction. Even when the upper end of the third portion 93 is closed, the portion of the groove 935 on the upper end surface of the third portion 93 may be open. The width (length in the front-rear direction) of each groove (915, 935) may be the same as or slightly larger than the width of the handle portion B11 of the corresponding basket B1. This allows each groove (915, 935) to be configured to receive each handle portion B11 of the basket B1.

[0137] (Load sensor) Each pair of load sensors 180 may be positioned in the internal space of the first section 91 and the third section 93, respectively, aligned with the positions of the pair of grooves (915, 935). If the portion of the handle B11 that hooks onto the smart grip 1 is formed in a straight line, in one example, the recesses constituting each groove (915, 935) may be formed such that the lower end of the recess is located slightly below the measuring portion (contact surface with the handle B11) of the load sensor 180. This ensures that when each handle B11 is hooked onto each groove (915, 935), each handle B11 contacts the measuring portion of each load sensor 180. As a result, each load sensor 180 can observe the weight change when luggage TP (goods, etc.) is placed in the basket B1 (basket body B10). The placement of the load sensors 180 is an example of a location where a change in load occurs due to the loading of luggage TP. However, the positional relationship between each groove (915, 935) and each load sensor 180 is not limited to this example and may be appropriately changed depending on the embodiment, such as the shape of the handle portion B11. For example, each handle portion B11 may be formed so that the portion located in the internal space of each portion (91, 93) when placed on the smart grip 1 curves downward. In this case, the recesses constituting each groove (915, 935) may be formed so that the lower end of the recess is located above the measuring portion of the load sensor 180.

[0138] (Imaging device) In the example shown in each figure, the imaging device 19 is located in the internal space of the first part 91. For example, the bottom surface of the first part 91 is positioned in accordance with the position of the imaging unit 191 (light receiving unit, etc.) of the imaging device 19. An opening may be provided. The imaging device 19 may be positioned such that the imaging unit 161 is exposed from the bottom surface of the first part 91 by fitting the imaging unit 191 into the opening on its bottom surface. This allows the imaging device 19 to image the area below the smart grip 1. Therefore, when the smart grip 1 is attached to the basket B1 by hooking each handle B11 of the basket B1 into the grooves (915, 935), the imaging device 19 can include the storage area of ​​the basket body B10 in its imaging range. As a result, when luggage TP is placed into the basket body B10, the imaging device 19 can observe the luggage TP being placed. This placement of the imaging device 19 is just one example of a location where the luggage TP being placed can be observed. The pair of load sensors 180 and the imaging device 19 may be used for any purpose. For example, the pair of load sensors 180 and the imaging device 19 may be used for product identification by the method described above.

[0139] (Haptic feedback module) In the example shown in each figure, the tactile feedback module 13 comprises a vibration motor 130 and a servo motor 135. The vibration motor 130 and the servo motor 135 are located in the internal space of the second section 92. In this example, the second section 92 constitutes the part that the user TU grips. Therefore, by being located in the second section 92, the vibration motor 130 and the servo motor 135 can provide tactile feedback 25 to the user TU using the smart grip 1. This location of the vibration motor 130 and the servo motor 135 is an example of a location where motion can be transmitted to the part that the user TU grips. The types of vibration motor 130 and the servo motor 135 are not particularly limited and may be appropriately selected depending on the embodiment.

[0140] The vibration motor 130 is configured to generate vibrations that enable tactile feedback to be output to the user TU. In one example, the vibration feedback 25 in each of the above cases may be realized by controlling the operation of the vibration motor 130.

[0141] The servo motor 135 may include a shaft 1351 and an arm 1352. The shaft 1351 constitutes the axis of rotation. The arm 1352 is attached to the shaft 1351 and rotates around the axis of the shaft 1351 in accordance with the rotation of the shaft 1351. The arm 1352 may be configured to rotate clockwise or counterclockwise so that a part of the arm 1352 (e.g., the tip) comes into contact with the hand of a user TU grasping the second part 92. Alternatively, the arm 1352 may be configured so that, by rotating clockwise or counterclockwise, the tip of the arm 1352 strikes the side wall of the second part 92, and the resulting vibration is transmitted to the hand of a user TU grasping the second part 92. With these configurations, the servo motor 135 can output feedback that intuitively points in the direction of the object by swinging the arm 1352 in the direction of the object. In the example shown in each figure, by rotating the arm 1352 clockwise (swinging the arm 1352 clockwise) and transmitting an impact from the arm 1352 to the left side of the user TU's hand grasping the second part 92, feedback indicating a leftward direction can be provided. On the other hand, by rotating the arm 1352 counterclockwise (swinging the arm 1352 counterclockwise) and transmitting an impact from the arm 1352 to the right side of the user TU's hand grasping the second part 92, feedback indicating a rightward direction can be provided. In one example, the feedback 25 that intuitively indicates a predetermined direction in each of the above cases may be realized by such operation of the servo motor 135. This configuration including the servo motor 135 is an example of a configuration that intuitively indicates a predetermined direction. In the example shown in each figure, the arm 1352 is formed in a flat plate shape. However, the shape of the arm 1352 is not limited to this example. The shape of the arm 1352 is not particularly limited and can be appropriately selected depending on the embodiment, as long as it can output tactile feedback in a specific direction by rotating.

[0142] (Box / Display) In addition, in the example shown in each figure, the control device 11, memory unit 12, positioning sensor 14, and communication module 15 are housed in a box 1100. The box 1100 is formed in the shape of a rectangular parallelepiped and is located in the internal space of the third part 93. A touch panel display 167 is located on the top surface of the box 1100. When the upper end of the third part 93 is closed, the touch panel display 167 may be positioned so that its screen is exposed from the upper end surface of the third part 93. In this example, when the user TU properly grasps the smart grip 1, the third part 93 is located in front of the second part 92. Therefore, while using the smart grip 1, the screen of the touch panel display 167 is positioned slightly in front of the user TU's gripping hand. This allows the user TU to easily view the screen of the touch panel display 167 without it being obstructed by body parts while using the smart grip 1.

[0143] (others) The structure of the smart grip 1 is not limited to the examples shown in Figures 10 and 11, and may be modified as appropriate depending on the embodiment. For example, the shape of the housing 90 may be modified as appropriate. In another example, the housing of the smart grip 1 may be formed in the shape of a ring, and a part of the ring may be made openable and closable by attaching and detaching the ends together. In this way, the housing of the smart grip 1 may be configured to replace the handle by receiving the handle portion B11 of the basket B1 inside the ring formed by the housing. In yet another example, the housing of the smart grip 1 may be formed to receive a terminal device such as a smartphone. In this case, the smart grip 1 may be constructed by attaching the terminal device to the housing.

[0144] Furthermore, the positions of each groove (915, 935) may be changed as appropriate. The number of grooves provided in the housing (housing 90) is not limited to two; it may be one or three or more. Also, the arrangement of each component may be changed as appropriate. The arrangement of the load sensor 180 may be changed as appropriate depending on the structure of the housing (housing 90). When a sensor other than the load sensor 180 is used as a detection sensor, the detection sensor may be placed in a location where it can detect the loading of luggage TP. The arrangement of the imaging device 19 may be changed as appropriate depending on the embodiment. The imaging device 19 may be placed in a location other than the internal space of the first part 91. At least one of the detection sensor and the imaging device 19 may be omitted.

[0145] The output device 16 may be accompanied by or replace the display with other output devices (speakers, indicator lights, etc.). The arrangement of other output devices may be determined as appropriate depending on the embodiment. The input device 17 may be accompanied by or replace the touch panel with other input devices (keyboard, controls, etc.). The arrangement of other input devices may be determined as appropriate depending on the embodiment. The components housed in the box 1100 may be changed as appropriate. The box 1100 may be located in a place other than the internal space of the third part 93. The box 1100 may be omitted.

[0146] Furthermore, the configuration for intuitively indicating a predetermined direction in the haptic feedback module 13 is not limited to a configuration including a servo motor 135 with a shaft 1351 and an arm 1352. The configuration of the servo motor 135 may be appropriately changed depending on the embodiment. In addition, the haptic feedback module 13 may include other configurations for intuitively indicating a predetermined direction, either in place of or together with the servo motor 135.

[0147] Figure 12 is a schematic plan view showing another example of the structure of the smart grip 1 according to this embodiment. In another example, the haptic feedback module 13 may be equipped with four vibration motors (131, 132, 133, 134) instead of the vibration motor 130 and servo motor 135. The four vibration motors (131, 132, 133, 134) are arranged separately in the front-rear and left-right directions with the center of the second part 92 as the reference point PO. The first vibration motor 131 is positioned in front of the reference point PO. The second vibration motor 132 is positioned in front of the reference point P The third vibration motor 133 is located to the right of point O. The fourth vibration motor 134 is located behind point PO. The four vibration motors (131, 132, 133, 134) are an example of multiple vibration motors.

[0148] Each vibration motor (131, 132, 133, 134) is located away from the reference point PO, allowing its vibration to intuitively convey the direction from the reference point PO. For example, the haptic feedback module 13 can output feedback that intuitively points to the direction of the target by vibrating the vibration motor corresponding to the target direction more strongly than the other vibration motors. For instance, the control device 11 can provide feedback to the user TU indicating the forward direction by vibrating the first vibration motor 131 more strongly than the other vibration motors (132, 133, 134). The control device 11 can also provide feedback to the user TU indicating the backward direction by vibrating the fourth vibration motor 134 more strongly than the other vibration motors (131, 132, 133). The same applies to the left and right directions. In one example, the feedback 25 that intuitively indicates a predetermined direction in each of the above cases may be configured by driving the vibration motor corresponding to the predetermined direction among the four vibration motors (131, 132, 133, 134) to vibrate more strongly than the remaining vibration motors.

[0149] The number of vibration motors that are vibrated more strongly than other vibration motors is not limited to one, but may be multiple. For example, the haptic feedback module 13 may indicate a direction between forward and right by vibrating the first vibration motor 131 and the second vibration motor 132 more strongly than the other vibration motors (133, 134). Alternatively, the haptic feedback module 13 may indicate a direction closer to the front by vibrating the first vibration motor 131 more strongly than the second vibration motor 132. As in these examples, the haptic feedback module 13 may indicate a direction between the positions where the vibration motors are located by vibrating multiple vibration motors more strongly than the remaining vibration motors. Furthermore, the haptic feedback module 13 may continuously indicate the direction of the target by varying the intensity of vibration among the multiple vibration motors that are vibrated more strongly.

[0150] In another example, the haptic feedback module 13 can output feedback that intuitively points to the direction of an object by vibrating at least two of the four vibration motors (131, 132, 133, 134) in an order corresponding to the direction of the object. The order of vibration can be arbitrarily defined. In one example, determining the order in which two or more vibration motors are vibrated may consist of selecting at least two or more vibration motors located along the direction of the object from the four vibration motors (131, 132, 133, 134), and then vibrating the vibration motors located towards the rear end of the direction of the object first, and the vibration motors located towards the front end of the direction of the object later.

[0151] For example, the control device 11 may output feedback indicating a rightward direction to the user TU by vibrating the third vibration motor 133 and then the second vibration motor 132. Conversely, the control device 11 may output feedback indicating a leftward direction to the user TU by vibrating the second vibration motor 132 and then the third vibration motor 133. Alternatively, the control device 11 may output feedback indicating a direction between forward and right by vibrating the first vibration motor 131 after vibrating the third vibration motor 133. The same applies to other directions.

[0152] In one example, the feedback 25 that intuitively indicates a predetermined direction in each of the above cases is used by at least two or more of the four vibration motors (131, 132, 133, 134). This operation may consist of driving the motors in a sequence corresponding to a predetermined direction. The vibration strength (intensity, period, etc.) of at least two vibration motors indicating the direction may be the same or different. In one example, the control device 11 may vibrate the vibration motors located towards the rear end of the direction of the target more weakly, and the vibration motors located towards the front end of the direction of the target more strongly. This makes it possible to output feedback that emphasizes the front end of the direction being indicated.

[0153] Furthermore, if two or more vibration motors are provided, it is possible to compare directions. Therefore, when the haptic feedback module 13 is configured to output feedback that intuitively points to the direction of the object, the number of vibration motors included in the haptic feedback module 13 is not limited to four, but may be two, three, or five or more. At least one of the four vibration motors (131, 132, 133, 134) may be omitted. For example, by omitting the first vibration motor 131 and the fourth vibration motor 134, the haptic feedback module 13 may be configured to point in the left and right directions.

[0154] Furthermore, the position of the reference point PO for each vibration motor (131, 132, 133, 134) is not limited to the center of the second section 92, but may be determined as appropriate depending on the embodiment. The position of the reference point PO may be defined as appropriate depending on the number and arrangement of vibration motors. To make it easier to sense the direction indicated by the vibration of the vibration motor, it is preferable that the reference point PO be set to the center or near the center of the part that the user TU normally grips. This allows the user TU to easily sense the direction indicated by the tactile feedback module 13 in accordance with the deviation of the vibration from the part being gripped. In yet another example, the tactile feedback module 13 may include both a servo motor and multiple vibration motors. Accordingly, the tactile feedback module 13 may be configured to output feedback indicating a specific direction from both the servo motor and the vibration motor.

[0155] [Software Configuration] Figure 13 schematically shows an example of the software configuration of the smart grip 1 (control device 11) according to this embodiment. The control device 11 of the smart grip 1 executes instructions contained in the program 81 stored in the storage unit 12 using the processor P. As a result, the smart grip 1 (control device 11) operates as a computer equipped with a position acquisition unit 111, a determination unit 112, and a feedback unit 113 as software modules. In other words, in this embodiment, each software module of the smart grip 1 is realized by the control device 11 (processor P).

[0156] The position acquisition unit 111 is configured to acquire the current position 20 measured by the positioning sensor 14. The determination unit 112 is configured to determine at least one of the following: whether the current position 20 belongs to a predetermined area AZ (first condition), and whether the current position 20 is approaching the predetermined area AZ (second condition). The feedback unit 113 is configured to output tactile feedback 25 to the user TU via the tactile feedback module 13 if the acquired current position 20 belongs to or is approaching the predetermined area AZ. The feedback 25 is configured to indicate an instruction to guide the user to the predetermined area AZ or to avoid the predetermined area AZ.

[0157] In this embodiment, an example is described in which each software module of the Smart Grip 1 is implemented by a general-purpose processor (processor P). However, some or all of the above software modules may be implemented by one or more dedicated processors or chipsets. Each of the above modules may also be implemented as a hardware module. Regarding the software configuration of the Smart Grip 1, in this embodiment... Modules may be omitted, replaced, and added as appropriate.

[0158] §3 Example of Operation Figure 14 is a flowchart showing an example of the processing procedure for the output of feedback 25 by the control device 11 of the smart grip 1 according to this embodiment. The following processing procedure is an example of a control method (information processing method) executed by the computer (control device 11). However, the following processing procedure is merely an example, and each step may be changed as much as possible. In addition, steps in the following processing procedure can be omitted, replaced, and added as appropriate, depending on the embodiment.

[0159] In step S101, the control device 11 operates as a position acquisition unit 111. The control device 11 acquires the current position 20 measured by the positioning sensor 14. Once the current position 20 is acquired, the control device 11 proceeds to the next step S102.

[0160] In step S102, the control device 11 operates as a determination unit 112. The control device 11 determines whether the positional relationship between the acquired current position 20 and the predetermined area AZ satisfies predetermined conditions. The predetermined conditions include at least one of the first and second conditions described above.

[0161] If the first condition is adopted, the control device 11 determines whether the current position 20 belongs to a predetermined area AZ. If it is determined that the current position 20 belongs to the predetermined area AZ, the control device 11 proceeds to the next step S103. On the other hand, if it is determined that the current position 20 does not belong to the predetermined area AZ, the control device 11 skips the processing in step S103 and proceeds to the next step S104.

[0162] If the second condition is adopted, the control device 11 determines whether the current position 20 is approaching the predetermined area AZ. If it determines that the current position 20 is approaching the predetermined area AZ, the control device 11 proceeds to the next step S103. On the other hand, if it determines that the current position 20 is not approaching the predetermined area AZ, the control device 11 skips the processing in step S103 and proceeds to the next step S104.

[0163] In step S103, the control device 11 operates as a feedback unit 113. The control device 11 outputs tactile feedback 25 to the user TU via the tactile feedback module 13. The feedback 25 is configured to indicate an instruction to guide to a predetermined area AZ or to avoid the predetermined area AZ. In one example, the predetermined area AZ and the feedback 25 may be at least one of the first to eighth examples described above. After outputting the feedback 25, the control device 11 proceeds to the next step S104.

[0164] In step S104, the control device 11 determines whether or not to terminate the process. The determination criteria can be set arbitrarily. For example, the control device 11 may decide not to terminate the process until a termination instruction is given. On the other hand, once a termination instruction is given, the control device 11 may decide to terminate the process. The termination instruction can be given in any way. In another example, if the target user (user TU) is present within the facility, the control device 11 may decide not to terminate the process. On the other hand, if the target user is not present within the facility (has left the facility), the control device 11 may decide to terminate the process. Whether or not the user is present within the facility may be determined appropriately based on the measurement results of the positioning sensor 14, etc.

[0165] If the control device 11 determines that it is not going to terminate the process, it returns to step S101 and executes the process again from step S101. If the control device 11 determines that it is going to terminate the process, it terminates the processing procedure related to the output of feedback 25 in this example of operation. The timing for terminating the process is not limited to this example. The control device 11 may terminate the processing procedure related to the output of the feedback 25 at any time. In one example, the control device 11 may execute the series of processes from step S101 to step S104 in real time.

[0166] According to this embodiment, since the smart grip 1 can be grasped in common with the basket B1, the effort required to grasp the user terminal separately from the basket B1 can be reduced, at least partially. Furthermore, according to this embodiment, the processing in step S103 provides tactile feedback 25 instructing the user to either guide them to a predetermined area AZ or to avoid the predetermined area AZ. This reduces, at least partially, the effort required to confirm visual information. Therefore, according to this embodiment, a reduction in the user TU's effort can be expected in at least one of the situations in which the user is guided to a predetermined area AZ or in which the user is instructed to avoid the predetermined area AZ.

[0167] §4 Variant While embodiments of this disclosure have been described in detail above, the above description is merely illustrative in all respects. The processes and means described in this disclosure can be freely combined and implemented as long as no technical inconsistencies arise. Furthermore, various improvements or modifications may be made to the above embodiments as appropriate. For example, the following modifications are possible. In the following, the same reference numerals are used for components similar to those in the above embodiments, and explanations of points similar to those in the above embodiments have been omitted as appropriate.

[0168] <4.1> The above embodiment is configured as Smart Grip 1. However, the embodiments of this disclosure are not limited to Smart Grip 1. The embodiments of this disclosure may be components of a basket or the basket (including carts) itself. The type of basket is not particularly limited and may be appropriately selected depending on the embodiment. For example, the basket may include shopping baskets, shopping carts, baggage carts used at airports, etc.

[0169] (First variation) Figure 15 schematically illustrates another example of a scenario to which this disclosure applies. In the example in Figure 15, the embodiment of this disclosure is a cage 1A. The cage 1A comprises a cage body 102A, a tactile feedback module 13, a positioning sensor 14, and a control device 11. The tactile feedback module 13, the positioning sensor 14, and the control device 11 may be configured in the same manner as in the above embodiment. That is, the control device 11 may be configured to acquire the current position 20 measured by the positioning sensor 14, and, if the acquired current position 20 belongs to or is approaching a predetermined area AZ, to output tactile feedback 25 to the user TU via the tactile feedback module 13. The feedback 25 may be configured to indicate an instruction to guide to the predetermined area AZ or to avoid the predetermined area AZ.

[0170] Other configurations of basket 1A are not particularly limited and may be determined as appropriate depending on the embodiment. In one example, basket 1A may include a pair of handles 101A attached to the basket body 102A, and a grip 100A that spans the pair of handles 101A. Each handle 101A may be configured in the same way as each handle B11 of basket B1. When these configurations are adopted, in one example, basket 1A may be constructed by using the smart grip 1 for the grip 100A. However, the method of constructing basket 1A is not limited to such examples.

[0171] Similar to the Smart Grip 1 described above, the basket 1A may further include a storage unit 12. The basket 1A may further include at least one of the communication module 15, output device 16, and input device 17. It may also be equipped with a detection sensor and an imaging device 19. If a detection sensor and an imaging device 19 are provided, the control device 11 may, when it detects the insertion of a product by the detection sensor, acquire an image captured by the imaging device 19 and identify the product placed in the basket body 102A by performing image analysis on the acquired image.

[0172] The computer components of the cage 1A (control devices 11 to input devices 17, detection sensors, and imaging device 19) are not limited to the grip 100A. At least a portion of the computer components of the cage 1A may be placed anywhere other than the grip 100A. In another example, if a load sensor is used as the detection sensor, the detection sensor may be placed on the bottom surface of the housing section of the cage body 102A. The imaging device 19 may be placed on the edge of the opening of the cage body 102A with the imaging unit 191 facing the housing section of the cage body 102A. The tactile feedback module 13 may be placed anywhere that can transmit motion to the part grasped by the user TU (in this modified example, the grip 100A). The tactile feedback module 13 may be placed anywhere other than the grip 100A as long as motion can be transmitted. However, from the viewpoint of motion transmission, it is preferable that the tactile feedback module 13 be placed on the grip 100A.

[0173] The basket 1A according to this modified example can provide feedback 25 to the user TU, similar to the smart grip 1 described above. Therefore, according to this modified example, it is possible to reduce the effort required of the user TU in at least one of the situations in which the user is guided to a predetermined area AZ and in the situation in which the user is guided to avoid the predetermined area AZ. The configuration of the basket 1A may be changed as appropriate depending on the embodiment. In another example, the grip 100A may be omitted. In this case, the user may hold the basket 1A by grasping the pair of handles 101A. The tactile feedback module 13 may be placed at any location that can transmit motion to at least one of the pair of handles 101A.

[0174] (Second variation) Figure 16 schematically illustrates another example of a scenario to which this disclosure applies. In the example in Figure 16, the embodiment of this disclosure is a basket 1B. Basket 1B corresponds to a configuration in which basket 1A is further equipped with one or more wheels 103B to form a cart. That is, basket 1B comprises a basket body 102B, a tactile feedback module 13, a positioning sensor 14, a control device 11, and one or more wheels 103B. The basket body 102B may be the same as the basket body 102A of the first modified example. The control device 11 may be configured to acquire the current position 20 measured by the positioning sensor 14, and, if the acquired current position 20 belongs to or is approaching a predetermined area AZ, to output tactile feedback 25 to the user TU via the tactile feedback module 13. The feedback 25 may be configured to indicate an instruction to guide to the predetermined area AZ or to avoid the predetermined area AZ. The number of wheels 103B may be appropriately selected depending on the embodiment. In a typical example, the basket 1B may be equipped with four wheels 103B. The basket 1B may be used as a shopping cart, luggage cart, etc.

[0175] The arrangement of each wheel 103B and the configuration for supporting the basket body 102B may be determined as appropriate depending on the embodiment. In one example, the basket 1B may be equipped with a grip 100B and a base 101B. The base 101B may be equipped with a leg 1011B and a support column 1012B. The leg 1011B may be positioned below the basket body 102B. Each wheel 103B may be attached to the leg 1011B. The support column 1012B may be configured to extend vertically upward from one end of the leg 1011B. The basket body 102B may be fixed to the support column 1012B. The grip 100B may be attached to the upper end of the support column 1012B.

[0176] Therefore, basket 1B may have a configuration similar to that of a typical shopping cart. However, the configuration of basket 1B is not limited to this example and may be modified as appropriate depending on the embodiment. For example, basket 1B may have a configuration similar to other types of carts such as silver carts. Also, when adopting these configurations, in one example, basket 1B may be constructed by using the smart grip 1 described above for the grip 100B. However, the method of constructing basket 1B is not limited to this example.

[0177] Similar to the Smart Grip 1 described above, the basket 1B may further include a storage unit 12. The basket 1B may further include at least one of a communication module 15, an output device 16, and an input device 17. The basket 1B may also further include a detection sensor and an imaging device 19. Similar to the first modified example described above, if the basket 1B includes a detection sensor and an imaging device 19, the control device 11 may perform product identification processing by image analysis.

[0178] The computer components of the basket 1B (control devices 11 to input devices 17, detection sensors, and imaging device 19) are not limited to the grip 100B. At least a portion of the computer components of the basket 1B may be placed anywhere other than the grip 100B. In another example, if a load sensor is used as the detection sensor, the detection sensor may be placed on the bottom surface of the housing section of the basket body 102B. The imaging device 19 may be placed with its imaging unit 191 facing the housing section of the basket body 102B, on the edge of the opening of the basket body 102B or in the area of ​​the support column 1012B from the upper end of the basket body 102B to the grip 100B. The tactile feedback module 13 may be placed anywhere that can transmit motion to the part grasped by the user TU (in this modified example, the grip 100B). The tactile feedback module 13 may be placed anywhere other than the grip 100B as long as motion can be transmitted. However, from the standpoint of motion transmission, it is preferable that the tactile feedback module 13 be located on the grip 100B.

[0179] The basket 1B according to this modified version can provide feedback 25 to the user TU, similar to the smart grip 1 described above. Therefore, according to this modified version, it is possible to reduce the effort required of the user TU in at least one of the situations in which the user is guided to a predetermined area AZ and in the situation in which the user is guided to avoid the predetermined area AZ. The basket body 102B may also be used as a basket receiver. In this case, other baskets may be placed in the basket body 102B, and the luggage TP (goods, etc.) may be placed in the other baskets. The detection sensor may be appropriately positioned to detect when goods are placed in other baskets. Detecting when goods are placed in the basket body 102B may include detecting when goods are placed in other baskets placed in the basket body 102B. The legs 1011B may also be configured to receive luggage. In this case, detection sensors may also be placed in the legs 1011B. If product identification by image analysis is also performed in the legs 1011B, the imaging device 19 may also be placed in the legs 1011B. Furthermore, the basket body 102B may be omitted. In this case, the leg portion 1011B may be used as the basket body. [Explanation of Symbols]

[0180] 1…Smart Grip, 1A・1B…Basket, 102A・102B…Basket body, 11...Control device, 13...Haptic feedback module, 14…Positioning sensor, 20...Current location, 25...Feedback, TU...User, AZ...Designated Area

Claims

1. Haptic feedback module, Positioning sensor, and control device Equipped with, The control device is To obtain the current location measured by the positioning sensor, and If the acquired current location belongs to or is approaching a predetermined area, haptic feedback is output to the user via the haptic feedback module. It is configured to perform, The feedback is configured to indicate an instruction to guide the user to the predetermined area or to avoid the predetermined area. Smart Grip.

2. The aforementioned designated area includes a viewing area where the target product can be seen, Outputting the aforementioned feedback includes outputting the feedback configured to indicate the direction in which the target product is located. The smart grip according to claim 1.

3. The product shelf has a first surface on which the target product is placed, and a second surface opposite to the first surface. The aforementioned viewing area is set on the first surface side, not the second surface side. The smart grip according to claim 2.

4. The aforementioned designated area includes the promotion area for the target product. Outputting the aforementioned feedback includes outputting the feedback configured to indicate the direction in which the promotion area is located when the current location is approaching the promotion area. The smart grip according to claim 1.

5. The aforementioned designated area includes the cash register area. Outputting the aforementioned feedback includes outputting the feedback configured to indicate an instruction to return away from the checkout area when the acquired current location is located within or near the checkout area, while it has not been determined that all items intended for purchase have been placed in the shopping cart. The smart grip according to claim 1.

6. The aforementioned designated area includes the congested area, Outputting the aforementioned feedback includes outputting the feedback configured to indicate instructions to avoid the congested area. The smart grip according to claim 1.

7. The aforementioned congested area includes crowded checkout counters. The Smart Grip according to claim 6, wherein the instruction to avoid the crowded area includes an instruction to guide the user to another register other than the crowded register.

8. The aforementioned designated area includes a non-congested area, Outputting the aforementioned feedback is configured to indicate instructions to guide the user to the non-congested area. This includes outputting the feedback that is generated. The smart grip according to claim 1.

9. The aforementioned designated area includes the store area where store employees are present. Outputting the aforementioned feedback includes outputting the feedback configured to indicate the direction in which the store clerk is located. The smart grip according to claim 1.

10. The aforementioned predetermined area includes the recommended product area where the product recommended to the user is located. Outputting the aforementioned feedback includes outputting the feedback configured to indicate instructions that guide the user to the recommended product area. The smart grip according to claim 1.

11. The aforementioned designated area includes a non-recommended product area where products not recommended to the user exist. Outputting the aforementioned feedback includes outputting the feedback configured to indicate instructions to avoid the unrecommended product area, The smart grip according to claim 1.

12. Basket body, Haptic feedback module, Positioning sensor, and control device Equipped with, The control device is To obtain the current location measured by the positioning sensor, and If the acquired current location belongs to or is approaching a predetermined area, haptic feedback is output to the user via the haptic feedback module. It is configured to perform, The feedback is configured to indicate an instruction to guide the user to the predetermined area or to avoid the predetermined area. Basket.

13. By adding one or more wheels, it is configured as a cart. The basket according to claim 12.

Images