Smart Grip

Abstract

To provide a technique for reducing the effort required of a user in at least one of situations where the user is guided to a specified area and situations where the user is made to avoid the specified area. [Solution] A smart grip according to one aspect of the present disclosure includes a haptic feedback module, a positioning sensor, and a control device. The control device is configured to acquire a current location measured by the positioning sensor, and, when the acquired current location belongs to or approaches a predetermined area, output haptic feedback to a user via the haptic feedback module. The feedback is configured to indicate an instruction to guide the user to the predetermined area or to avoid the predetermined area.

Description

[Technical field]

[0001] This disclosure relates to a smart grip P Regarding. [Background technology]

[0002] There are systems that provide route guidance to a destination in facilities such as stores (commercial facilities), airports, etc. For example, Patent Document 1 proposes a product guidance device that acquires the current location of a customer in a store, calculates a shopping route based on the acquired current location and product locations, and transmits guidance information based on the acquired shopping route to a user terminal (terminal device). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2015-230236 A Summary of the Invention [Problem to be solved by the invention]

[0004] According to the conventional system of Patent Document 1 and the like, the user can be guided to a predetermined area (e.g., the location of a product) within a facility based on information displayed on the user terminal. However, the present inventor has found that the conventional system has the following problems.

[0005] That is, within a facility, a user may move around while holding a basket (including a cart). When guiding a user to a specific area by information provided to the user terminal, the user will check visual information displayed on the user terminal while holding both the basket and the user terminal. Checking visual information displayed on the user terminal while holding a basket can be time-consuming.

[0006] This problem occurs not only when guiding a user to a specific area. When making a user avoid a specific area based on information displayed on the user terminal, the user may have to check visual information displayed on the user terminal while holding a basket, just as in the case of guiding a user to a specific area. Therefore, even when making a user avoid a specific area, checking the information may be time-consuming.

[0007] In one aspect, the present disclosure has been made in consideration of such circumstances, and one of its objectives is to provide technology for reducing the effort required of a user in at least one of situations in which the user is guided to a specified area and situations in which the user is caused to avoid a specified area. [Means for solving the problem]

[0008] In order to solve the above-mentioned problems, the present disclosure employs the following configurations. Note that the following configurations can be appropriately combined.

[0009] A smart grip according to an aspect of the present disclosure includes a haptic feedback module, a positioning sensor, and a control device. The control device is configured to acquire a current location measured by the positioning sensor, and, when the acquired current location belongs to or approaches a predetermined area, output haptic feedback to a user via the haptic feedback module. The feedback is configured to indicate an instruction to guide the user to the predetermined area or to avoid the predetermined area.

[0010] In this configuration, the grip allows the user to hold the basket together with the handle. When the smart grip can be used as a handle for the basket, the basket can be held by gripping the smart grip. Therefore, according to this configuration, it is possible to at least partially reduce the effort of holding a user terminal separately from the basket. Also, in this configuration, an instruction to guide to a specified area or to avoid a specified area is given as tactile feedback. This makes it possible to at least partially reduce the work of checking visual information. Therefore, according to this configuration, it is expected that the effort of the user will be reduced at least in either a scene of guiding to a specified area or a scene of avoiding a specified area.

[0011] In the smart grip according to the above aspect, the predetermined area may include a viewing area where the target product is visible. Outputting the feedback may include outputting feedback configured to indicate a direction in which the target product is located. This configuration is expected to reduce the effort required of the user when guiding the user to an area where the target product is visible.

[0012] In the smart grip according to the above aspect, the product shelf may have a first surface on which the target product is placed, and a second surface opposite the first surface. The viewing area may be set on the first surface side, not on the second surface side. On the second surface of the product shelf opposite the first surface on which the target product is placed, the user is close to the target product but has difficulty picking up the target product. With this configuration, feedback is provided on the first surface side where it is easy to pick up the target product, and feedback is omitted on the second surface side where it is difficult to pick up the target product, making it possible to accurately indicate the position of the target product.

[0013] In the smart grip according to the above aspect, the predetermined area may include a promotion area for the target product. Outputting the feedback may include outputting feedback configured to indicate a direction to the promotion area when the current location is approaching the promotion area. This configuration is expected to reduce the effort required of the user when guiding the user to an area where the target product is being promoted.

[0014] In the smart grip according to the above aspect, the predetermined area may include a cash register area. Outputting the feedback may include outputting feedback configured to indicate an instruction to guide the user to turn back from the cash register area when it is not recognized that all the products to be purchased have been added to the basket and the acquired current position belongs to or is approaching the cash register area. This is expected to reduce the user's efforts in situations where payment processing at the cash register is avoided when all the products to be purchased have not been added to the basket.

[0015] In the smart grip according to the above aspect, the predetermined area may include a crowded area. Outputting the feedback may include outputting feedback configured to indicate an instruction to avoid the crowded area. This configuration is expected to reduce the effort of the user in avoiding the crowded area.

[0016] In the smart grip according to the above aspect, the crowded area may include a crowded register. The instruction to avoid the crowded area may include an instruction to guide the user to another register other than the crowded register. This configuration is expected to reduce the effort required of the user when avoiding the crowded register.

[0017] In the smart grip according to the above aspect, the predetermined area may include a non-crowded area. Outputting the feedback may include outputting feedback configured to indicate an instruction to guide the user to the non-crowded area. According to this configuration, the non-crowded area may be a region that is not congested. It is expected that this will reduce the amount of work required for users when guiding them to the rear.

[0018] In the smart grip according to the above aspect, the predetermined area may include a store area where a store clerk is present. Outputting the feedback may include outputting feedback configured to indicate a direction in which the store clerk is present. This configuration is expected to reduce the effort of the user in guiding the user to the direction in which the store clerk is present.

[0019] In the smart grip according to the above aspect, the predetermined area may include a recommended product area where products recommended to the user are present. Outputting the feedback may include outputting feedback configured to indicate an instruction to guide the user to the recommended product area. This configuration is expected to reduce the effort required of the user when guiding the user to an area where the recommended products are displayed.

[0020] In the smart grip according to the above aspect, the predetermined area may include a non-recommended product area where products not recommended to the user are present. Outputting the feedback may include outputting feedback configured to indicate an instruction to avoid the non-recommended product area. This configuration is expected to reduce the effort of the user in avoiding the area where the non-recommended products are displayed.

[0021] The embodiment of the present disclosure may not be limited to the smart grip. An aspect of the present disclosure may be a component of a basket. An aspect of the present disclosure may be a basket (including a cart) itself. In addition, an aspect of the present disclosure may be an information processing method for realizing all or part of the control device (computer), a program, or a storage medium readable by a machine such as a computer that stores such a program. Here, the machine-readable storage medium may be a non-transient medium that accumulates information such as a program by electrical, magnetic, optical, mechanical, or chemical action. The non-transient storage medium may include a storage medium (CD, DVD, semiconductor memory, etc.), an auxiliary storage device of a computer, an external storage device connected to a computer, etc.

[0022] For example, a basket according to an aspect of the present disclosure may include a basket body, a haptic feedback module, a positioning sensor, and a control device. The control device may be configured to acquire a current location measured by the positioning sensor, and, when the acquired current location belongs to or approaches a predetermined area, output haptic feedback to a user via the haptic feedback module. The feedback may be configured to indicate an instruction to guide the user to the predetermined area or to avoid the predetermined area.

[0023] The basket according to the above aspect may be configured as a cart by further including one or more wheels. With this configuration, the cart form is expected to reduce the effort required by the user. Effect of the Invention

[0024] According to one aspect of the present disclosure, it is expected that the effort required of a user can be reduced in at least one of situations in which the user is guided to a specified area and situations in which the user is guided to avoid a specified area. [Brief description of the drawings]

[0025] [Figure 1] FIG. 1 illustrates an example of a situation to which the present disclosure is applied. [Diagram 2] FIG. 2 shows a schematic diagram of an example (first example) of a predetermined area. [Diagram 3] FIG. 3 shows a schematic diagram of an example (second example) of the predetermined area. [Figure 4] FIG. 4 shows a schematic diagram of an example (third example) of the predetermined area. [Diagram 5] FIG. 5 illustrates a schematic example (fourth example) of the predetermined area. [Figure 6] FIG. 6 illustrates a schematic example (fifth example) of the predetermined area. [Figure 7] FIG. 7 shows a schematic diagram of an example (sixth case) of the predetermined area. [Figure 8] FIG. 8 shows a schematic diagram of an example (seventh example) of the predetermined area. [Figure 9] FIG. 9 illustrates a schematic example (eighth example) of the predetermined area. [Figure 10] FIG. 10 is a side view that illustrates an example of the structure of a smart grip. [Figure 11] FIG. 11 is a plan view that illustrates an example of the structure of a smart grip. [Figure 12] FIG. 12 is a plan view that illustrates a schematic diagram of another example of the structure of the smart grip. [Figure 13] FIG. 13 illustrates an example of a software configuration of the smart grip (control device). [Figure 14] FIG. 14 is a flowchart illustrating an example of a processing procedure of the control device. [Figure 15] FIG. 15 illustrates another example of a situation to which the present disclosure is applied. [Figure 16] FIG. 16 illustrates another example of a situation to which the present disclosure is applied. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0026] Hereinafter, an embodiment according to one aspect of the present disclosure will be described with reference to the drawings. However, the embodiment described below is merely an example of the present disclosure in all respects. Various improvements or modifications may be made without departing from the scope of the present disclosure. In implementing the present disclosure, a specific configuration according to the embodiment may be appropriately adopted. Note that, although the data appearing in this embodiment is described in natural language, more specifically, it is specified by pseudo-language, commands, parameters, machine language, electrical signals, etc. that can be recognized by a machine such as a computer.

[0027] §1 Examples of application 1 is a schematic diagram showing an example of a situation to which the present disclosure is applied. The smart grip 1 according to this embodiment includes a haptic feedback module 13, a positioning sensor 14, and a control device 11. The control device 11 is configured to acquire a current position 20 measured by the positioning sensor 14, and, when the acquired current position 20 belongs to or approaches a predetermined area AZ, output haptic feedback 25 to the user TU via the haptic feedback module 13. The feedback 25 is configured to indicate an instruction to guide the user to the predetermined area AZ or to avoid the predetermined area AZ.

[0028] According to this embodiment, the device (smart grip 1) that outputs the feedback 25 is a grip, and thus can be held in common with the basket B1. For example, if the smart grip 1 can be used as a handle for the basket B1, the basket B1 can be held by holding the smart grip 1. Therefore, according to this embodiment, the effort of holding a user terminal separately from the basket B1 can be at least partially reduced. The smart grip 1 may be used together with the user terminal, but by providing the feedback 25 via the smart grip 1, it is expected that the frequency of use of the user terminal can be reduced. Also, according to this embodiment, an instruction to guide to a predetermined area AZ or to avoid the predetermined area AZ is given as tactile feedback 25. This makes it possible to at least partially reduce the work of checking visual information. The smart grip 1 may be used together with the output of visual information, but by providing the tactile feedback 25 via the smart grip 1, it is expected that the frequency of checking visual information can be reduced. Therefore, according to this embodiment, it is expected that the effort of the user TU can be reduced at least in either a scene of guiding to a predetermined area AZ or a scene of avoiding the predetermined area AZ.

[0029] [Basket] In one example of this embodiment, the smart grip 1 may be configured to be usable as a handle for the basket B1. The configuration of the basket B1 is not particularly limited, and may be appropriately determined depending on the embodiment.

[0030] As shown in FIG. 1, in a typical example, the basket B1 may include a basket body B10 and a pair of handle parts B11. The configuration of the basket body B10 and each handle part B11 may be appropriately determined according to the embodiment. For example, the basket body B10 may be configured to receive luggage TP from the upper end side by having an open upper end and a closed lower end at the bottom. The basket body B10 may have any shape such as a substantially rectangular parallelepiped shape or a substantially truncated pyramid shape. The pair of handle parts B11 may be arranged separately in the longitudinal direction of the basket body B10. Each end of the handle part B11 may be connected to each side surface in the short side direction of the basket body B10 so that the handle part B11 can be rotated around an axis in the short side direction. As a result, each handle part B11 may be configured to be rotated at the connection part with the basket body B10 to change the angle and be gripped along the short side direction. When the basket B1 includes a basket body B10, putting luggage TP (goods, etc.) into the basket body B10 may correspond to putting the luggage TP into the basket B1.

[0031] The configuration of the basket B1 is not limited to the example of FIG. 1, and may be changed as appropriate depending on the embodiment. For example, the number of handles B11 is not limited to two. The number of handles B11 may be one, or three or more. In addition, each end of one handle B11 may be separated and connected to one side surface in the short direction of the basket body B10 in the longitudinal direction, and each end of the other handle B11 may be separated and connected to the other side surface in the short direction of the basket body B10 in the longitudinal direction. In this way, each handle B11 may be configured to be gripped along the longitudinal direction.

[0032] In addition, the type of the basket B1 is not limited to the example of FIG. 1, and may be changed as appropriate depending on the embodiment. As long as it can be used to carry any object, the type of the basket B1 is not particularly limited, and may be selected as appropriate depending on the embodiment. The basket B1 may include a cart having one or more wheels. For example, the basket B1 may include a shopping basket, a shopping cart, a baggage cart used at airports, etc. The basket B1 may include a bag that can be used for shopping, such as a plastic bag or a paper bag. The basket B1 may also include a device that can hold an object by hanging it, such as a hanger. A known basket may be used for the basket B1.

[0033] [Can be used as a basket handle] The ability to be used as a handle of a basket (such as basket B1) may be configured in any form in which the smart grip 1 is arranged as at least a part of a handle to be gripped by a user when carrying a baggage (baggage TP). In one example, the ability to be used as a handle of a basket may be configured by replacing an existing handle provided on the basket by hanging a handle part of the basket (such as handle part B11) on the smart grip 1. The handle part of the basket may include any component that can be hung on the smart grip 1, such as a handle part of a bag or a hook of a hanger. In another example, the ability to be used as a handle of a basket may be configured by being attached to the handle part of the basket. In yet another example, the ability to be used as a handle of a basket may be configured by being attached to the basket main body (such as basket main body B10) as a handle part. In other words, the smart grip 1 may be configured as the handle part of the basket itself. Note that the smart grip 1 is not limited to such an example, and may have any configuration that can be gripped together with the basket (basket B1).

[0034] [Usage scene] The smart grip 1 according to this embodiment may be used in any situation in any facility such as a store or airport to guide a user to a predetermined location (predetermined area AZ) or to avoid moving to a predetermined location. The store may include a commercial facility that sells products. Products may be sold in a store either unmanned or manned. The luggage TP may include any type of item that is carried. For example, when the smart grip 1 is used in a store (commercial facility), the luggage TP may include products sold in the store. Also, when the smart grip 1 is used in an airport, the luggage TP may include the user TU's hand luggage (such as a carry bag).

[0035] The smart grip 1 may be further equipped with any sensor so as to be capable of monitoring the behavior of the user TU within the facility. For example, the behavior to be monitored may include purchasing behavior such as putting a product into a basket. The sensor used for monitoring and the behavior of the user TU to be monitored are not particularly limited and may be appropriately selected according to the embodiment. For example, when the smart grip 1 is used in a store, the smart grip 1 may be configured to detect the putting of a product into a basket (basket B1) and identify the detected put-in product according to the observation result of the sensor. Any sensor may be used to detect the putting of a product into the basket and identify the product.

[0036] In one example, the smart grip 1 may further include a detection sensor and an imaging device. The imaging device may be appropriately arranged at a location where the inserted commodity can be observed when the commodity is inserted into the basket B1 (basket body B10). The type of the imaging device is not particularly limited and may be appropriately selected depending on the embodiment. The imaging device may include any sensor that acquires data in the form of an image or an image representation, such as, for example, an RGB camera, a depth sensor, an infrared sensor, a radar, a LiDAR (light detection and ranging), etc. The imaging device may be used to obtain an image used for identifying the commodity.

[0037] The detection sensor may be appropriately configured to detect the insertion of a product into the basket B1. The type of detection sensor may be appropriately selected depending on the embodiment. For example, the detection sensor may be configured with one or more load sensors (weight sensors). In this case, the detection sensor can detect the insertion of a product by detecting a change (increase) in weight due to the insertion of the product. The detection sensor may be disposed at any location where a change in weight due to the insertion of the product can be observed.

[0038] Also, for example, the detection sensor may be composed of one or more imaging devices. In this case, the detection sensor may be the same as the imaging device for obtaining an image used to identify the product, or may be provided separately. The detection sensor can detect the insertion of the product by capturing the product in an image obtained by the imaging device. The detection sensor may be disposed at any location where the product falls within the imaging range at least during the period from when the user picks up the product to when the product is placed in the basket B1 and / or after the product is placed in the basket B1.

[0039] Also, for example, the detection sensor may be composed of one or more contact sensors. In this case, the detection sensor can detect the insertion of a product by contacting the inserted product or another object (such as a switch member) displaced by the insertion of the product. The detection sensor may be disposed at any location where the inserted product comes into direct or indirect contact. Indirect contact may include contact by another object displaced by the insertion of the product. The detection sensor may be composed of multiple types of sensors.

[0040] In the case where the smart grip 1 (control device 11) further includes a detection sensor and an imaging device, the smart grip 1 (control device 11) may detect whether or not a product has been inserted according to the observation result of the detection sensor. When the detection sensor detects the insertion of a product, the smart grip 1 (control device 11) may obtain an image from the imaging device. As long as the inserted product can be captured in the captured image, the timing of capturing an image by the imaging device is not particularly limited and may be appropriately specified according to the embodiment. In one example, when the imaging device is disposed in a position where an image of the product can be captured after the insertion is detected, the control device 11 may start the imaging device in response to the detection of the insertion of the product by the detection sensor, and control the operation of the imaging device to capture an image of the inserted product. The control device 11 may control the imaging device to capture an image of the product at any timing after the insertion of the product is detected. For example, the control device 11 may control the imaging device to capture an image of the product immediately after the insertion of the product is detected. The control device 11 may appropriately obtain one or more captured images generated by this imaging from the imaging device. After generating one or more captured images, the control device 11 may start the imaging device. The operation of the device may be stopped or switched to a standby state. According to this example, the period during which the imaging device is activated can be narrowed down, so that the processing load and power consumption in the smart grip 1 can be reduced. In another example, the imaging device may be controlled to continuously generate captured images. The generated captured images may be stored in a memory area (such as the memory unit 12) for at least a certain period of time. The captured images generated at or around the time when the detection sensor detects the insertion of the product are highly likely to include the inserted product. Therefore, the control device 11 may acquire one or more captured images generated at or around the time when the detection sensor detects the insertion of the product from among the captured images stored in the memory area.

[0041] Then, the smart grip 1 (control device 11) may identify the product shown in the captured image by performing image analysis on the acquired captured image. The method of identification by image analysis may be appropriately determined depending on the embodiment. In one example, when a code generated by encoding identification information of the product is attached to the product, analyzing the captured image may include decoding the code attached to the product. The type of code may be selected arbitrarily. The code may be, for example, a one-dimensional code, a two-dimensional code, etc. In another example, the control device 11 may identify the product from the characteristics (appearance, etc.) of the product in the image analysis, without relying on the code.

[0042] The method of image analysis is not particularly limited and may be appropriately selected depending on the embodiment. In one example, the smart grip 1 (control device 11) may analyze the captured image by a general image analysis method such as edge detection and pattern matching. In another example, the smart grip 1 (control device 11) may analyze the captured image using a trained machine learning model that has acquired the ability to analyze images. The machine learning model is configured to include one or more calculation parameters that can be adjusted by machine learning. The one or more calculation parameters are used for the calculation of the target inference (image analysis, etc.). The machine learning model may be configured, for example, by a neural network, a support vector machine, or other function formula (calculation model). The machine learning method may be appropriately selected depending on the machine learning model to be adopted (for example, backpropagation method, etc.). Training the machine learning model is to adjust (optimize) the value of the calculation parameter using a training sample. The machine learning model may be appropriately trained so that when an image of a training sample is given, the machine learning model derives a true value of the corresponding analysis result. A large-scale model such as a large-scale visual language model (VLM) may be used as the trained machine learning model.

[0043] The smart grip 1 (control device 11) may output the product identification result as appropriate. The product identification result may be used for any purpose. In one example, the product identification result may be used to determine whether or not a product to be purchased, which will be described later, has been placed in the basket B1. The smart grip 1 may further include a communication module 15. The smart grip 1 (control device 11) may output the product identification result to an external computer (a store terminal, a user terminal, a server device, etc.).

[0044] The process of identifying the product does not necessarily have to be executed on the smart grip 1. The process of identifying the product may be executed on another computer (e.g., a store terminal, a user terminal, a server device, etc.) other than the smart grip 1. The other computer may identify the product in any manner. In one example, the other computer may acquire information from the smart grip 1 and identify the product based on the acquired information. The information acquired from the smart grip 1 may include sensing data such as the captured image. The other computer may identify the product in the same manner as the smart grip 1. In another example, the other computer may not acquire information from the smart grip 1, but may acquire sensing data from sensors (one or more sensors) installed in the facility and identify the product based on the acquired sensing data.

[0045] The sensor to be used may be selected arbitrarily. For example, the sensor may include an imaging device installed so that the product shelf is included in the imaging range. In this case, the other computer may identify the inserted product by performing image analysis on the image captured by the imaging device. Also, for example, the sensor may include a load sensor (weight sensor) installed so as to measure the weight of the product displayed on the product shelf. In this case, the other computer may identify the inserted product by specifying the product shelf whose weight has changed (decreased) based on the measurement data of the load sensor.

[0046] The smart grip 1 may be linked to an external system such as a system installed in the facility or a user terminal, or may be used alone without linking to an external system. In one example, sensors such as an imaging device and a load sensor may not be installed in the facility, and the behavior of the user TU may be monitored only by the smart grip 1. In another example, sensors may be installed in the facility, and the smart grip 1 may monitor the behavior of the user TU in cooperation with sensors installed in the store or independently of the sensors installed in the store (i.e., without linking with the sensors in the store).

[0047] [Loading luggage] Putting a load (load TP) into a basket (basket B1) may include any form of carrying a load. As illustrated in FIG. 1, in a typical example, putting a load into a basket may be putting a new load TP into a basket body B10 of a basket B1 including a smart grip 1. Putting a load into a basket may also include any action similar to putting a load into a basket, such as hanging a handle of a basket containing a load on a smart grip 1. Hanging the handle of a basket containing a load may include hanging the handle of a plastic bag containing the load, hanging the hook of a hanger that is suspending the load, etc.

[0048] [Designated area] The predetermined area AZ is a criterion for controlling whether or not to output the feedback 25. The predetermined area AZ may be set appropriately depending on the embodiment. The predetermined area AZ may be set manually by an operator's input, or may be generated at least partially automatically by computer processing. When there is an object to be guided or avoided (such as the target product PA in the first example described later), the predetermined area AZ may be defined based on the object. In one example, the predetermined area AZ may be set so as to include the object. In another example, the predetermined area AZ may be set as at least a part of the area around the object without including the object. The number of predetermined areas AZ set in the target facility may not be particularly limited, and may be determined appropriately depending on the embodiment.

[0049] As long as the positional relationship with the current position 20 can be evaluated, the expression format of the predetermined area AZ is not particularly limited and may be appropriately selected according to the embodiment. In one example, the predetermined area AZ may be configured to indicate the coordinate range of the predetermined area AZ on a map of the facility. The coordinate range may be specified by one point (coordinate value). The attribute value (shape, size, etc.) of the predetermined area AZ may be arbitrarily defined. When determining whether the current position 20 belongs to the predetermined area AZ or not, or whether the current position 20 is approaching the predetermined area AZ or not, the control device 11 may appropriately refer to the area information 125 configured to indicate the predetermined area AZ. The area information 125 may be held in any memory area. In one example, the smart grip 1 may further include a memory unit 12. The area information 125 may be held in the memory unit 12. In another example, the area information 125 may be held in the external computer 5.

[0050] The source of the area information 125 may be appropriately determined depending on the embodiment. In one example, the area information 125 may be pre-installed in the storage unit 12. In another example, the smart grip 1 may further include a communication module 15. When the smart grip 1 includes the communication module 15, the area information 125 may be provided from the external computer 5. That is, the smart grip 1 may obtain the area information 125 from the external computer 5 via a network using the communication module 15. The external computer 5 is any computer other than the smart grip 1. For example, the external computer 5 may be a facility terminal (store terminal), a user terminal, a server device, or the like. The area information 125 may be generated on the smart grip 1 (control device 11) or may be generated by another computer such as the external computer 5.

[0051] (Current location) The current position 20 may be derived as appropriate from the measurement values ​​of the positioning sensor 14. For example, the measurement values ​​of the positioning sensor 14 may be used as the current position 20 as is. Also, for example, the current position 20 may be calculated from the measurement values ​​of the positioning sensor 14 by applying any arithmetic processing to one or more measurement values ​​of the positioning sensor 14. As long as the positional relationship with the predetermined area AZ can be evaluated, the expression format of the current position 20 is not particularly limited and may be appropriately selected depending on the embodiment. In one example, the current position 20 may be configured to indicate the position on a map of the facility using two-dimensional or three-dimensional coordinate values.

[0052] (Judgment method) The conditions for outputting the feedback 25 include at least one of whether the current position 20 belongs to a predetermined area AZ (first condition) and whether the current position 20 is approaching the predetermined area AZ (second condition). The conditions to be adopted may be appropriately selected.

[0053] When the first condition is adopted, the control device 11 may determine whether the acquired current position 20 belongs to the predetermined area AZ by any method. For example, the control device 11 may determine whether the current position 20 belongs to the predetermined area AZ depending on whether the current position 20 is within the range of the predetermined area AZ. If the current position 20 is within the range of the predetermined area AZ, the control device 11 may determine that the current position 20 belongs to the predetermined area AZ. If the current position 20 is outside the range of the predetermined area AZ, the control device 11 may determine that the current position 20 does not belong to the predetermined area AZ. A position on the boundary of the predetermined area AZ may be determined to belong to the predetermined area AZ or not to belong to the predetermined area AZ.

[0054] Similarly, when the second condition is adopted, the control device 11 may use any method to determine whether or not the acquired current position 20 is approaching the predetermined area AZ.

[0055] For example, the approach area may be set based on the predetermined area AZ. The control device 11 may determine whether the current position 20 is approaching the predetermined area AZ depending on whether the acquired current position 20 belongs to the approach area. Whether the current position 20 belongs to the approach area may be determined in a manner similar to the above-mentioned method of determining whether the current position 20 belongs to the predetermined area AZ by replacing the predetermined area AZ with the approach area. If the current position 20 belongs to the approach area, the control device 11 may determine that the current position 20 is approaching the predetermined area AZ. If the current position 20 does not belong to the approach area, the control device 11 may determine that the current position 20 is not approaching the predetermined area AZ. A position on the boundary of the approach area may be determined to be approaching the predetermined area AZ or not approaching the predetermined area AZ.

[0056] The approach area defines a range within which it is determined that the vehicle is approaching the predetermined area AZ. The approach area may be set to include at least a portion of the area surrounding the predetermined area AZ. The approach area may be set manually by an operator's input, or may be at least partially automatically generated by computer processing. The attribute values ​​(shape, size, etc.) of the approach area may be defined arbitrarily. The approach area may be derived from the predetermined area AZ by calculation processing such as enlargement. In a simple example, the approach area is determined by enlarging the predetermined area AZ to include the predetermined area AZ. The approach area may be set to include the predetermined area AZ. The amount of expansion of the predetermined area AZ may be the same in all directions, or may be different in at least some directions. The shape of the approach area may be the same as the predetermined area AZ, or may be different. In one example, the approach area may be predefined, and information indicating the approach area may be included in the area information 125. In another example, the approach area may be calculated each time from the predetermined area AZ.

[0057] Also, for example, the control device 11 may calculate the distance between the acquired current position 20 and the predetermined area AZ. The distance may be calculated by any method. In a simple example, the control device 11 may calculate the distance (straight-line distance, etc.) between the current position 20 and the boundary of the predetermined area AZ without considering impassable areas such as product shelf areas. In another example, the control device 11 may exclude impassable areas, search for a route (shortest route, etc.) from the current position 20 to the boundary of the predetermined area AZ within a passable area, and calculate the distance of the searched route. The method of searching for the route may be appropriately selected according to the embodiment. A known method may be adopted for searching the route. When an obstruction such as a product shelf exists, the straight-line distance to the target area is short, but the travel distance to the target area may be long. According to this example, it is possible to determine whether or not the predetermined area AZ is approached according to the substantial travel distance.

[0058] After calculating the distance between the current position 20 and the predetermined area AZ, the control device 11 may determine whether the current position 20 is approaching the predetermined area AZ depending on whether the calculated distance is less than a threshold. If the calculated distance is less than the threshold, the control device 11 may determine that the current position 20 is approaching the predetermined area AZ. If the calculated distance exceeds the threshold, the control device 11 may determine that the current position 20 is not approaching the predetermined area AZ. If the calculated distance is equal to the threshold, the control device 11 may determine that the current position 20 is approaching the predetermined area AZ, or may determine that the current position 20 is not approaching the predetermined area AZ. The threshold may be defined arbitrarily.

[0059] In one example, when the first condition is adopted, the control device 11 may output tactile feedback 25 when it is determined that the current location 20 belongs to the predetermined area AZ. On the other hand, when it is determined that the current location 20 does not belong to the predetermined area AZ, the control device 11 may omit outputting the feedback 25. Also, in one example, when the second condition is adopted, the control device 11 may output feedback 25 when it is determined that the current location 20 is approaching the predetermined area AZ. On the other hand, when it is determined that the current location 20 is not approaching the predetermined area AZ, the control device 11 may omit outputting the feedback 25.

[0060] The conditions to be adopted for the target predetermined area AZ may be appropriately specified. In the same facility, the predetermined area AZ adopting the first condition and the predetermined area AZ adopting the second condition may be mixed. When the first condition is adopted, the output of the feedback 25 can be started at a position closer to the predetermined area AZ than when the second condition is adopted. On the other hand, when the second condition is adopted, the output of the feedback 25 can be started from a position slightly away from the predetermined area AZ. The conditions to be adopted for the same predetermined area AZ may be appropriately switched according to the user's designation, a request from the facility (facility terminal), etc. The conditions to be adopted may be specified for each predetermined area AZ, may be specified for each type of the predetermined area AZ, or may be specified collectively within the store / any area. The conditions to be adopted may also be specified on the control device 11 side.

[0061] The determination of the first condition and the second condition does not necessarily have to be executed by the control device 11. In another example, the determination process of the first condition and the second condition may be executed by an external computer (a store terminal, a user terminal, a server device, etc.). For example, the smart grip 1 may further include a communication module 15. The control device 11 transmits the acquired current position 20 to the external computer, thereby executing the determination process of at least one of the first condition and the second condition. The external computer may request the execution of the first condition and / or the second condition to the external computer in response to the request. The external computer may execute a determination process for at least one of the first condition and the second condition, and may return the obtained determination result to the smart grip 1 (control device 11). The control device 11 may obtain the determination result by receiving the result.

[0062] [feedback] As long as the feedback 25 can be sensed through touch, the configuration of the feedback 25 is not particularly limited and may be appropriately determined according to the embodiment. The feedback 25 may be configured by an operation involving physical motion such as vibration or contact. The haptic feedback module 13 may be configured by any device capable of executing an operation that generates such physical motion. For example, the haptic feedback module 13 may be configured by an actuator such as a servo motor or a vibration motor. The type of actuator may be selected arbitrarily. The haptic feedback module 13 may be configured by multiple types of actuators. For example, the haptic feedback module 13 may be configured by a servo motor, a vibration motor, or a combination thereof. In the smart grip 1, the haptic feedback module 13 may be appropriately disposed in a location where motion can be transmitted to a part held by the user TU (for example, an internal space within a range that can be held by the user TU, etc.).

[0063] Guiding to the predetermined area AZ may include approaching the predetermined area AZ, entering the predetermined area AZ, approaching a predetermined position within the predetermined area AZ, etc. Avoiding the predetermined area AZ may include moving the user TU away from the predetermined area AZ, moving the user TU away from the predetermined area AZ, not allowing the user TU to enter the predetermined area AZ, etc. The feedback 25 may be appropriately determined according to an instruction transmitted to the user TU when guiding the user TU to the predetermined area AZ or avoiding the predetermined area AZ. The feedback 25 may be generated according to a given rule. The generation rule for the feedback 25 may be appropriately specified according to the embodiment.

[0064] (First feedback) In one example, at least one of an instruction to guide to the predetermined area AZ and an instruction to avoid the predetermined area AZ may be expressed by a change in vibration according to the positional relationship between the current position 20 and the predetermined area AZ. In response to this, the feedback 25 may include a first feedback configured by a vibration that changes according to the positional relationship between the current position 20 and the predetermined area AZ. The haptic feedback module 13 may include an actuator capable of outputting vibration, such as a vibration motor.

[0065] The change in vibration may be stipulated by any rule. In one example, the rule for the vibration change may include increasing the vibration as the current position 20 approaches a location in the predetermined area AZ. That is, the rule for the vibration change may include decreasing the vibration as the current position 20 moves away from a location in the predetermined area AZ. Approaching the current position 20 to a location in the predetermined area AZ may include, for example, approaching the boundary of the predetermined area AZ outside the predetermined area AZ, entering the predetermined area AZ from outside the predetermined area AZ, approaching a predetermined position within the predetermined area AZ (such as the position of the target product PA in the first example described later), and the like. Moving away from a location in the predetermined area AZ may be the opposite of approaching a location in the predetermined area AZ. Increasing the vibration may be configured by increasing the intensity of the vibration, speeding up the period of the vibration, or a combination of these. Reducing the vibration may be the opposite of increasing the vibration. In another example, contrary to the above example, the rule for changing the vibration may include increasing the vibration as the current position 20 moves farther from the location of the predetermined area AZ. Moving the current position 20 farther from the location of the predetermined area AZ may include, for example, moving away from a predetermined position within the predetermined area AZ, leaving the predetermined area AZ, moving away from the boundary of the predetermined area AZ outside the predetermined area AZ, etc. The increase and decrease of the vibration is performed in a stepwise manner. The steps may be repeated several times or may be performed continuously.

[0066] (Second Feedback) In addition, in one example, at least one of the instruction to guide to the predetermined area AZ and the instruction to avoid the predetermined area AZ may include an instruction to point to a predetermined direction. In response to this, the feedback 25 may include a second feedback configured by an action of pointing to the predetermined direction together with or instead of the first feedback. The second feedback may be configured to precisely point to the direction of the target, or may be configured to roughly point to the direction of the target. The method of pointing to the predetermined direction may be appropriately determined depending on the embodiment.

[0067] For example, the second feedback may include an action that logically indicates a predetermined direction. The action that logically indicates a predetermined direction may be configured with an action that can specify the direction to be pointed to by understanding the meaning by checking against a rule, such as indicating the right direction with one vibration and indicating the left direction with two vibrations. Furthermore, the second feedback may include an action that intuitively indicates a predetermined direction together with the above logical action or instead of the logical action. The action that intuitively indicates a predetermined direction may be an action that can directly sense the predetermined direction, such as swinging an arm of a servo motor in a predetermined direction or increasing the vibration of a vibration motor corresponding to the predetermined direction.

[0068] When an action of intuitively pointing to a predetermined direction is adopted as the second feedback action, the haptic feedback module 13 may be configured to be capable of performing such an action of intuitively pointing to a predetermined direction. The configuration of intuitively pointing to a predetermined direction may be appropriately determined depending on the embodiment.

[0069] For example, the haptic feedback module 13 may include a servo motor with an arm. In this case, the action of intuitively pointing to a predetermined direction may include swinging the arm of the servo motor in the predetermined direction. That is, the haptic feedback module 13 may intuitively point to the direction of the target by the direction in which the arm of the servo motor is swung.

[0070] Also, for example, the haptic feedback module 13 may include a plurality of vibration motors. The plurality of vibration motors may be arranged separately in any direction (front-back direction, left-right direction, etc.). As a result, each vibration motor may be arranged in a different direction. In this case, the operation of intuitively pointing to a predetermined direction may include vibrating a vibration motor corresponding to the predetermined direction more strongly than other vibration motors. That is, the haptic feedback module 13 may intuitively point to the direction of a target by vibration of a vibration motor corresponding to the target direction. Note that, to correspond to a predetermined direction means to be arranged in a predetermined direction.

[0071] As an example, the haptic feedback module 13 may include two vibration motors. The two vibration motors may be arranged separately in the left and right directions. The haptic feedback module 13 may indicate the left direction by vibrating the vibration motor arranged in the left direction more strongly than the vibration motor arranged in the right direction. The haptic feedback module 13 may also indicate the right direction by vibrating the vibration motor arranged in the right direction more strongly than the vibration motor arranged in the left direction.

[0072] The stronger vibration may be constituted by increasing the vibration intensity, shortening the vibration period, or a combination of these, similar to the above-mentioned increasing vibration. The other vibration motors may or may not be vibrated. In the latter case, vibrating the vibration motor corresponding to a predetermined direction more strongly than the other vibration motors may include operating only the corresponding vibration motor without operating the other vibration motors.

[0073] Also, for example, similar to the above, the haptic feedback module 13 may include multiple vibration motors. In this case, the operation of intuitively indicating the predetermined direction may include vibrating at least two or more vibration motors among the multiple vibration motors in an order corresponding to the predetermined direction. That is, the haptic feedback module 13 may intuitively indicate the direction of the target by the order of vibration.

[0074] If the direction of the target can be identified, the order of vibration may be appropriately determined according to the embodiment. In one example, two or more vibration motors located along the direction of the target may be selected from the multiple vibration motors. The control device 11 may determine the order so that, among the two or more selected vibration motors, the vibration motor located on the rear end side of the target direction (opposite the direction of the target) is vibrated first, and the vibration motor located on the front end side of the target direction is vibrated later. Vibrating two or more vibration motors in the determined order may be configured by gradually switching the vibration motor to be vibrated from the previous vibration motor to the next vibration motor, or may be configured by stopping the vibration of the previous vibration motor and then starting the vibration of the next vibration motor. The vibration in the determined order may be executed repeatedly multiple times.

[0075] As an example, similar to the above, the haptic feedback module 13 may include two vibration motors. In this case, the haptic feedback module 13 may indicate the right direction by vibrating the vibration motor arranged in the left direction and then vibrating the vibration motor arranged in the right direction. The haptic feedback module 13 may also indicate the left direction by vibrating the vibration motor arranged in the right direction and then vibrating the vibration motor arranged in the left direction.

[0076] [Specific example] The predetermined area AZ may be set appropriately depending on the purpose of providing the feedback 25. As long as it is related to guiding to the predetermined area AZ or avoiding the predetermined area AZ, the purpose of the feedback 25 is not particularly limited and may be appropriately determined depending on the embodiment. In one example of this embodiment, the predetermined area AZ may include at least one of the following first to eighth cases.

[0077] (1) First Case FIG. 2 is a schematic diagram showing an example (first example) of the predetermined area AZ according to the present embodiment. In one example, the purpose of providing the feedback 25 may include guiding the user TU toward the target product PA when the smart grip 1 is used in a store. Accordingly, the predetermined area AZ may include a visual recognition area AA in which the target product PA is visible. Outputting the feedback 25 may include outputting feedback 25A configured to indicate an indication of the direction in which the target product PA is located. The indication of the direction in which the target product PA is located is an example of an indication to guide to the predetermined area AZ. The feedback 25A is an example of the feedback 25.

[0078] The visual identification area AA is an example of a predetermined area AZ. The visual identification area AA may be set appropriately based on the position of the target product PA. The visual identification area AA may be set to include the position of the target product PA, or may be set as at least a part of the area around the target product PA without including the position of the target product PA. The target product PA may be appropriately selected from the products PZ sold in the store.

[0079] The feedback 25A may be appropriately configured to convey the direction in which the target product PA is located to the user TU. In one example, the feedback 25A may include the above-mentioned first feedback. For example, the feedback 25A may be configured such that the closer to the position of the target product PA, the greater the vibration output by the haptic feedback module 13. Furthermore, the feedback 25A may include the above-mentioned second feedback together with or instead of the first feedback. For example, the feedback 25A may be configured to indicate at least one of logically and intuitively the direction in which the target product PA is located as viewed from the current location 20. The direction in which the target product PA is located may be derived from the current location 20 and the position of the target product PA. The source of the information indicating the position of the target product PA may be appropriately determined depending on the embodiment. For example, the information indicating the position of the target product PA may be included in the area information 125.

[0080] The control device 11 may output the feedback 25A to the user TU when the current position 20 belongs to the visual recognition area AA or when the current position 20 is approaching the visual recognition area AA. According to one example of the present embodiment, it is expected that the effort of the user TU can be reduced in a scene where the user TU is guided to the position of the target product PA.

[0081] 2, the product shelf PS is configured to be able to display products PZ on both the left and right sides, and the target product PA may be placed on one of the sides (first side S1). When the user TU is located on the other side (second side S2), the straight-line distance to the target product PA is short, but since the product shelf PS blocks the view of the target product PA, it is difficult for the user TU to visually recognize the target product PA and pick it up.

[0082] Therefore, in one example, the product shelf PS may have a first surface S1 on which the target product PA is arranged, and a second surface S2 opposite to the first surface S1. The target product PA does not need to be arranged on the second surface S2. In this case, the visual recognition area AA may be set on the first surface S1 side, not on the second surface S2 side. According to one example of the present embodiment, the feedback 25 is given on the first surface S1 side, where it is easy to pick up the target product PA, and the execution of the feedback 25 is omitted on the second surface S2 side, where it is difficult to pick up the target product PA, so that the position of the target product PA can be accurately indicated.

[0083] (2) Second Case FIG. 3 is a schematic diagram showing an example (second example) of the predetermined area AZ according to the present embodiment. In one example, the purpose of providing the feedback 25 may include guiding the user TU toward the promoted target product PB when the smart grip 1 is used in a store. Accordingly, the predetermined area AZ may include a promotion area AB of the target product PB. Outputting the feedback 25 may include outputting feedback 25B configured to indicate an indication of the direction in which the promotion area AB exists when the current position 20 is approaching the promotion area AB. The indication of the direction in which the promotion area AB exists is an example of an indication to guide to the predetermined area AZ. The feedback 25B is an example of the feedback 25.

[0084] The promotion area AB is an example of a predetermined area AZ. The promotion area AB may be set appropriately based on the position of the target product PB. The promotion area AB may be set to encompass the position of the target product PB, or may be set as at least a part of the area around the target product PB without encompassing the position of the target product PB. The target product PB may be appropriately selected from products sold in the store. The promotion may include any activity for promoting the sales of the target product PB.

[0085] The feedback 25B may be appropriately configured to convey the direction in which the promotional area AB is located to the user TU. In one example, the feedback 25B may include the above-mentioned first feedback. For example, the feedback 25B may be configured such that the closer to the promotional area AB, the greater the vibrations output by the haptic feedback module 13. The feedback 25B may also include the above-mentioned second feedback together with or instead of the first feedback. For example, the feedback 25B may be configured to logically and / or intuitively indicate the direction in which the promotion area AB is located from the current location 20. The direction in which the promotion area AB is located may be derived from the current location 20 and the extent of the promotion area AB.

[0086] According to one example of the present embodiment, it is expected that the effort of the user TU can be reduced when the user TU is guided to an area where the target product PB is promoted. The timing of outputting the feedback 25B is not limited to this example, and may be changed as appropriate depending on the embodiment. In another example, outputting the feedback 25 may include outputting feedback configured to indicate the direction in which the promoted target product PB is located when the current location 20 belongs to the promotion area AB, together with or instead of outputting the feedback 25B. This feedback may be configured similarly to the feedback 25A, by replacing the target product PA with the target product PB.

[0087] (3) Third Case FIG. 4 is a schematic diagram showing an example (third example) of the predetermined area AZ according to the present embodiment. In one example, the purpose of providing the feedback 25 may include suppressing payment at the register RC when the smart grip 1 is used in a store and there is a product that has been forgotten to be selected among the products to be purchased. Accordingly, the predetermined area AZ may include the register area AC. Outputting the feedback 25 may include outputting feedback 25C configured to indicate an instruction to guide the user in a direction to turn back from the register area AC when the acquired current position 20 belongs to or is approaching the register area AC in a state in which it has not been determined that all the products to be purchased have been put into the basket B1. The instruction to guide the user in a direction to turn back from the register area AC is an example of an instruction to avoid the predetermined area AZ. The feedback 25C is an example of the feedback 25.

[0088] The cash register area AC is an example of a predetermined area AZ. The cash register area AC may be set appropriately based on the position of the cash register RC (register). The cash register area AC may be set so as to encompass the position of the cash register RC, or may be set as at least a portion of the area around the cash register RC without encompassing the position of the cash register area AC. The cash register area AC may be set appropriately based on the flow of customers who carry products selected in the sales floor toward the cash register RC. For example, the cash register area AC may be set so as to extend from the cash register RC toward the sales floor. The cash register area AC may be set so as to include an entrance to the cash register RC.

[0089] The feedback 25C may be appropriately configured to convey an instruction to the user TU to turn back from the cash register area AC. In one example, the feedback 25C may include the first feedback. For example, the feedback 25C may be configured such that the closer to the cash register area AC, the greater the vibration output by the haptic feedback module 13. This feedback 25C may be used as a warning to notify the user TU that a product that was left unselected is present. The feedback 25C may also include the second feedback in addition to or instead of the first feedback. For example, the feedback 25C may be configured to indicate at least one of a logical and intuitive direction away from the cash register area AC at the current position 20. The direction away from the cash register area AC is an example of a direction to turn back from the cash register area AC. The direction away from the cash register area AC may include a direction opposite to the direction in which the cash register area AC exists as viewed from the current position 20. The direction away from the cash register area AC may be derived from the range of the current position 20 and the cash register area AC.

[0090] The control device 11 may determine whether all the products to be purchased have been placed in the basket B1 in any manner. In one example, the control device 11 may further include an input device 17. The control device 11 may determine whether all of the products to be purchased have been added to the basket B1 in response to an input from the user TU via the input device 17. For example, the control device 11 may receive an input indicating whether all of the products to be purchased have been added to the basket B1 all at once, such as turning a switch on / off. In response to receiving an input operation indicating that all of the products to be purchased have been added to the basket B1, the control device 11 may determine that all of the products to be purchased have been added to the basket B1. On the other hand, while not receiving such an input operation, the control device 11 may determine that all of the products to be purchased have not yet been added to the basket B1.

[0091] Also, for example, the control device 11 may further include an output device 16 and may store a shopping list 32 in advance. The control device 11 may output the shopping list 32 to the output device 16 and may receive input from the user TU as to whether or not the product to be purchased has been added to the basket B1 (i.e., the product has been selected) for each product to be purchased. Whether or not the product to be purchased has been added to the basket B1 may be received by, for example, any user interface component (UI component) such as a check box provided for each product to be purchased. When the input of the addition of all the products to be purchased to the basket B1 is completed, the control device 11 may determine that all the products to be purchased have been added to the basket B1. When there are any products to be purchased for which the input of the addition of the products to the basket B1 has not been made, the control device 11 may determine that all the products to be purchased have not yet been added to the basket B1.

[0092] The shopping list 32 may be appropriately configured to show a list of products to be purchased. The shopping list 32 may be generated by input from an operator (user TU, a family member of user TU, etc.), or may be generated at least partially automatically by computer processing. The shopping list 32 may be generated on the smart grip 1 (control device 11), or may be generated by an external computer (user terminal, etc.). The control device 11 may obtain the shopping list 32 from the external computer.

[0093] In addition, in one example, the control device 11 may determine whether all the products to be purchased have been added to the basket B1 according to the identification result of the added products 30. For example, the control device 11 may compare the list of the added products 30 shown in the identification result with the list of the products to be purchased shown in the shopping list 32. In this comparison, if all the products to be purchased are identified as the added products 30, and the list of the products to be purchased is included in the list of the added products 30 (i.e., the shopping list 32 is included in the identification result), the control device 11 may determine that all the products to be purchased have been added to the basket B1. On the other hand, if there are products left unselected and there are products to be purchased that are not identified as the added products 30 remaining in the shopping list 32, the control device 11 may determine that all the products to be purchased have not yet been added to the basket B1. In one example, the control device 11 may determine whether all the products to be purchased have been added to the basket B1 according to at least one of the input of the user TU and the identification result of the added products 30.

[0094] The identification of the product 30 may be performed by any method. In one example, the above-mentioned method using a detection sensor and an imaging device may be adopted as the method of identifying the product 30. A known method may be adopted as the method of identifying the product 30. Furthermore, the identification process of the product 30 may be executed on the smart grip 1, or may be executed on another computer other than the smart grip 1. In the former case, the control device 11 may acquire the identification result of the product 30 by executing the identification process of the product 30. In the latter case, the control device 11 may acquire the identification result of the product 30 from the other computer.

[0095] The output process of the feedback 25C may be controlled by any method. For example, the control device 11 may set the output to permit the output of the feedback 25C at an initial point in time, such as at the time of startup or at the time of entering the store. While it is determined that all the products to be purchased have not been put into the basket B1, the control device 11 may maintain the setting that permits the output of the feedback 25C. Thus, the control device 11 may execute the output of the feedback 25C at a stage where it is not determined that all the products to be purchased have been put into the basket B1. Then, the control device 11 may change the output setting to prohibit the output of the feedback 25C in response to determining that all the products to be purchased have been put into the basket B1. Thus, the control device 11 may stop the output of the feedback 25C at a stage where it is determined that all the products to be purchased have been put into the basket B1.

[0096] According to one example of this embodiment, it is expected that the effort of user TU can be reduced in situations where not all of the items to be purchased have been added to basket B1 (there are items that were forgotten to be selected) and payment is to be avoided at register RC (cash register).

[0097] (4) Fourth Case FIG. 5 is a schematic diagram showing an example (fourth example) of the predetermined area AZ according to the present embodiment. In one example, the purpose of providing the feedback 25 may include avoiding crowded places when the smart grip 1 is used at any facility. Accordingly, the predetermined area AZ may include the crowded area AD. Outputting the feedback 25 may include outputting feedback 25D configured to indicate an instruction to avoid the crowded area AD. The instruction to avoid the crowded area AD is an example of an instruction to avoid the predetermined area AZ. The feedback 25D is an example of the feedback 25.

[0098] The congested area AD is an example of a predetermined area AZ. The congested area AD is an area that is congested due to a large amount of people, robot devices, and the like. The index for evaluating that the area is congested may be arbitrarily defined. The congested range may be measured by an arbitrary method. For example, the congested area AD may be measured by a sensor installed in the facility, such as a people flow sensor or an imaging device. Also, for example, the congested area AD may be measured by information obtained from people present in the facility, such as the location information of a user terminal. A known method may be adopted for measuring the congested area AD. The congested area AD may be measured in real time. The congested area AD may be measured periodically. An area where congestion is detected by measurement may be used as it is as the congested area AD. The congested area AD may be calculated by an arbitrary arithmetic process from the area where congestion is detected by measurement. The control device 11 may appropriately acquire information indicating the congested area AD from an external computer (a facility terminal, a user terminal, a server device, etc.).

[0099] The feedback 25D may be appropriately configured to transmit an instruction to the user TU to avoid the congested area AD. In one example, the feedback 25D may include the above-mentioned first feedback. For example, the feedback 25D may be configured to increase the vibration output by the haptic feedback module 13 as the user TU approaches the congested area AD. The feedback 25D may also include the above-mentioned second feedback together with or instead of the first feedback. For example, the feedback 25D may be configured to logically and / or intuitively indicate the direction in which the congested area AD exists as viewed from the current position 20. In this case, the user TU can avoid the congested area AD by moving in a direction other than the direction indicated by the feedback 25D. For example, the feedback 25D may also be configured to logically and / or intuitively indicate a direction away from the congested area AD or a direction not entering the congested area AD at the current position 20. The direction away from the congested area AD may at least partially overlap with the direction not entering the congested area AD. In this case, the user TU can avoid the congested area AD by moving in the direction indicated by the feedback 25D. The direction into the congested area AD, the direction away from the congested area AD, and the direction not into the congested area AD may be derived from the current location 20 and the range of the congested area AD.

[0100] The control device 11 may output the feedback 25D to the user TU when the current location 20 belongs to the congested area AD or is approaching the congested area AD. According to one example of the present embodiment, it is expected that the effort of the user TU can be reduced in a situation where the user TU needs to avoid a congested area.

[0101] When the smart grip 1 is used in a store, the crowded area AD may include the crowded cash register RD. Including the crowded cash register RD in the crowded area AD may include the case where the crowded cash register RD belongs to the crowded area AD, and the case where the crowded cash register RD is outside the crowded area AD but the passageway leading to the crowded cash register RD belongs to the crowded area AD.

[0102] The instruction to avoid the crowded area AD may include an instruction to guide to another cash register OD other than the crowded cash register RD. For example, the feedback 25D may be configured such that the vibration output by the haptic feedback module 13 increases as the user approaches the crowded cash register RD or another cash register OD. Also, for example, the feedback 25D may be configured to indicate at least one of logically and intuitively the direction in which the crowded cash register RD or another cash register OD is located as viewed from the current position 20. The direction in which the crowded cash register RD is located may be derived from the current position 20 and the position of the crowded cash register RD. The direction in which the other cash register OD is located may be derived from the current position 20 and the position of the other cash register OD. Information indicating the position of each cash register (RD, OD) may be acquired as appropriate.

[0103] According to one example of this embodiment, it is expected that the effort of the user TU can be reduced in a situation where the user TU needs to avoid a crowded cash register RD.

[0104] (5) Fifth Case FIG. 6 is a schematic diagram showing an example (fifth example) of a predetermined area AZ according to the present embodiment. In one example, a purpose of providing the feedback 25 may include guiding the smart grip 1 to an uncrowded area when the smart grip 1 is used at an optional facility. Accordingly, the predetermined area AZ may include an uncrowded area AE. Outputting the feedback 25 may include outputting feedback 25E configured to indicate an instruction to guide the smart grip 1 to the uncrowded area AE. The instruction to guide the smart grip 1 to the uncrowded area AE is an example of an instruction to guide the smart grip 1 to the predetermined area AZ. The feedback 25E is an example of the feedback 25.

[0105] The non-congested area AE is an example of a predetermined area AZ. The non-congested area AE is an area that is not congested due to a small amount of traffic of people, robotic devices, etc. An index for evaluating that the area is not congested may be defined arbitrarily. The non-congested range may be measured by an arbitrary method. For example, similar to the above fourth example, the non-congested area AE may be measured by a sensor installed in the facility. The non-congested area AE may be measured directly or may be derived from the congested area AD (i.e., may be measured indirectly). As an example of a method for deriving the non-congested area AD, the non-congested area AE may be specified as at least a part of a range other than the congested area AD. A known method may be adopted for the measurement method of the non-congested area AE. The non-congested area AE may be measured in real time. The non-congested area AE may be measured periodically. The control device 11 may appropriately acquire information indicating the non-congested area AE from an external computer (a facility terminal, a user terminal, a server device, etc.). The control device 11 may acquire information indicating the congested area AD, and derive the non-congested area AE from the congested area AD indicated by the acquired information each time.

[0106] The feedback 25E may be appropriately configured to transmit an instruction to the user TU to guide the user to the non-crowded area AE. In one example, the feedback 25E may include the above-mentioned first feedback. For example, the feedback 25E may include a vibration output by the haptic feedback module 13 that increases as the user approaches the non-crowded area AE or moves away from the non-crowded area AE. may be configured to increase. The feedback 25E may include the second feedback together with or instead of the first feedback. For example, the feedback 25E may be configured to logically and / or intuitively indicate a direction in which the uncongested area AE exists as viewed from the current position 20, or a direction in which the user does not leave the uncongested area AE at the current position 20 (including a direction in which the user can stay in the uncongested area AE). The direction in which the user does not leave the uncongested area AE may be any direction in which the user does not leave the uncongested area AE. In this case, the user TU can be guided to the uncongested area AE by moving in the direction indicated by the feedback 25E. The direction in which the uncongested area AE exists and the direction in which the user does not leave the uncongested area AE may be derived from the range of the current position 20 and the uncongested area AE.

[0107] The control device 11 may output the feedback 25E to the user TU when the current position 20 belongs to the non-congested area AE or when the current position 20 is approaching the non-congested area AE. According to one example of the present embodiment, it is expected that the effort of the user TU can be reduced in a scene where the user TU is guided to an area that is not crowded with people.

[0108] (6) Sixth Case FIG. 7 is a schematic diagram showing an example (sixth example) of a predetermined area AZ according to the present embodiment. In one example, the purpose of providing feedback 25 may include informing the user of the direction in which a store clerk CF is present when the smart grip 1 is used in a store. Accordingly, the predetermined area AZ may include a store area AF in which the store clerk CF is present. Outputting feedback 25 may include outputting feedback 25F configured to indicate an indication of the direction in which the store clerk CF is present. The indication of the direction in which the store clerk CF is present is an example of an instruction to guide the user to the predetermined area AZ. Feedback 25F is an example of feedback 25.

[0109] The store area AF is an example of a predetermined area AZ. The store area AF may be arbitrarily set within the store. For example, the store area AF may be set to include the entire store, or may be set to include only a part of the store. The store area AF may be set to include a range where the store clerk CF can be present in a state where the store clerk CF can respond. The location where the store clerk CF is present may be specified as appropriate depending on the embodiment. In one example, the location where the store clerk CF is present may be specified by a fixed value (for example, a predefined location such as a general information counter). In another example, the location of the store clerk CF may be detected in real time by a sensor installed in the store. For example, an imaging device, a human sensor, or other arbitrary sensor may be used to detect the location of the store clerk CF. In this case, the control device 11 may acquire information indicating the location where the store clerk CF is present from an external computer such as a store terminal. The store area AF may be set fixedly. If the location where the store clerk CF is present may be changed, the store area AF may be dynamically set according to the location where the store clerk CF is present. In this case, the store area AF may be set to include the location where the sales clerk CF is present, or may be set to not include the location where the sales clerk CF is present, but to be at least a portion of the area surrounding the location where the sales clerk CF is present.

[0110] The feedback 25F may be appropriately configured to transmit an indication of the direction in which the store clerk CF is present to the user TU. In one example, the feedback 25F may include the above-mentioned first feedback. For example, the feedback 25F may be configured such that the closer to the location where the store clerk CF is present, the greater the vibration output by the haptic feedback module 13. The feedback 25F may also include the above-mentioned second feedback together with or instead of the first feedback. For example, the feedback 25F may be configured to indicate at least one of the logical and intuitive directions in which the store clerk CF is present as viewed from the current position 20. The direction in which the store clerk CF is present may be derived from the current position 20 and the location where the store clerk CF is present.

[0111] The control device 11 may output feedback 25F to the user TU when the current location 20 belongs to the store area AF or when the current location 20 is approaching the store area AF. According to one example of this embodiment, it is expected that the effort of the user TU will be reduced when guiding the user TU toward the location of a store clerk CF. Furthermore, by guiding a customer (user TU) toward the store clerk CF, it is possible to reduce the amount of work required for the store clerk CF to move toward the customer. This is expected to reduce the number of store clerks CF to be placed in a store.

[0112] (7) Seventh Case FIG. 8 illustrates an example (seventh example) of a predetermined area AZ according to the present embodiment. In one example, the purpose of providing feedback 25 may include guiding user TU toward a product PG (recommended product) recommended to user TU. Accordingly, the predetermined area AZ may include a recommended product area AG in which the product PG recommended to user TU is present. Outputting feedback 25 may include outputting feedback 25G configured to indicate an instruction to guide to the recommended product area AG. The instruction to guide to the recommended product area AG is an example of an instruction to guide to the predetermined area AZ. Feedback 25G is an example of feedback 25.

[0113] The recommended product area AG is an example of a predetermined area AZ. The recommended product area AG may be set appropriately based on the position of the recommended product PG. The recommended product area AG may be set to include the position of the recommended product PG, or may not include the position of the recommended product PG and may be set as at least a part of the area around the recommended product PG. The recommended product area AG may be configured with the position (point) of the recommended product PG. The recommended product PG may be appropriately selected from products PZ sold in a store. The recommended product PG may be selected according to the user TU. A publicly known method may be adopted for selecting the recommended product PG.

[0114] The feedback 25G may be appropriately configured to convey the presence of the recommended product PG to the user TU. In one example, the feedback 25G may include the above-mentioned first feedback. For example, the feedback 25G may be configured such that the closer to the recommended product area AG, the greater the vibration output by the haptic feedback module 13. The feedback 25G may also include the above-mentioned second feedback together with or instead of the first feedback. For example, the feedback 25G may be configured to indicate at least one of logically and intuitively the direction in which the recommended product area AG exists as viewed from the current position 20. The direction in which the recommended product area AG exists may be derived from the current position 20 and the position of the recommended product PG. Information indicating the position of the recommended product PG may be appropriately acquired.

[0115] The control device 11 may output the feedback 25G to the user TU when the current location 20 belongs to the recommended product area AG or when the current location 20 is approaching the recommended product area AG. According to one example of the present embodiment, it is expected that the effort of the user TU can be reduced in a scene where the user TU is guided to an area where the recommended product PG is displayed.

[0116] (8) Case No. 8 FIG. 9 illustrates an example (eighth case) of the predetermined area AZ according to the present embodiment. In one example, the purpose of providing the feedback 25 may include avoiding the purchase of a product PH (non-recommended product) that is not recommended to the user TU. Accordingly, the predetermined area AZ may include a non-recommended product area AH in which the product PH that is not recommended to the user TU exists. Outputting the feedback 25 may include outputting feedback 25H configured to indicate an instruction to avoid the non-recommended product area AH. The instruction to avoid the non-recommended product area AH is an example of an instruction to avoid the predetermined area AZ. The feedback 25H may include outputting feedback 25H configured to indicate an instruction to avoid the non-recommended product area AH. This is an example of 5.

[0117] The non-recommended product area AH is an example of a predetermined area AZ. The non-recommended product area AH may be set appropriately based on the position of the non-recommended product PH. The non-recommended product area AH may be set to include the position of the product PH, or may not include the position of the product PH and may be set as at least a part of the area around the product PH. The non-recommended product area AH may be configured by the position (point) of the product PH. The non-recommended product PH may be appropriately selected from the products PZ sold in the store. For example, if the user TU is a minor, the non-recommended product PH may be a product with an age restriction for purchasing alcoholic beverages, etc.

[0118] The feedback 25H may be appropriately configured to transmit an instruction to the user TU to avoid the non-recommended product PH. In one example, the feedback 25H may include the above-mentioned first feedback. For example, the feedback 25H may be configured to increase the vibration output by the haptic feedback module 13 as the user TU approaches the non-recommended product area AH. The feedback 25H may also include the above-mentioned second feedback together with or instead of the first feedback. For example, the feedback 25H may be configured to logically and / or intuitively indicate the direction in which the non-recommended product area AH exists as viewed from the current position 20. In this case, the user TU can avoid the non-recommended product area AH by moving in a direction other than the direction indicated by the feedback 25H. For example, the feedback 25H may be configured to logically and / or intuitively indicate the direction away from the non-recommended product area AH or the direction not entering the non-recommended product area AH at the current position 20. The direction away from the non-recommended product area AH may at least partially overlap with the direction not entering the non-recommended product area AH. In this case, the user TU can avoid the non-recommended product area AH by moving according to the direction indicated by the feedback 25H. The direction into which the non-recommended product area AH exists, the direction away from the non-recommended product area AH, and the direction not entering the non-recommended product area AH may be derived from the current position 20 and the range of the non-recommended product area AH.

[0119] The control device 11 may output the feedback 25H to the user TU when the current location 20 belongs to the non-recommended product area AH or when the current location 20 is approaching the non-recommended product area AH. According to one example of the present embodiment, it is expected that the effort of the user TU can be reduced in a situation where the user TU avoids an area where the non-recommended product PH is displayed.

[0120] §2 Configuration example [Hardware configuration] 1, the smart grip 1 includes a computer to which a control device 11, a memory unit 12, a haptic feedback module 13, a positioning sensor 14, a communication module 15, an output device 16, and an input device 17 are electrically connected. In the smart grip 1, at least a part of the computer may be housed in a box.

[0121] The control device 11 includes a processor P and is configured to execute information processing based on a program and various data. The processor P is a hardware processor and is an example of a processor resource. The type of the processor P may be appropriately selected depending on the embodiment. For example, the processor P may be a CPU (Central Processing Unit), a microcomputer, or the like. The microprocessor may be composed of a microprocessor, a field-programmable gate array (FPGA), a digital signal processor (DSP), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), etc.

[0122] The storage unit 12 may be configured with a hard disk drive, a solid state drive, a semiconductor memory, or the like. The storage unit 12 is an example of a memory resource. In this embodiment, The memory unit 12 stores various information such as a program 81 and area information 125. The program 81 is a program for causing the control device 11 to execute information processing (see FIG. 14 described below) related to the output of feedback 25 by the haptic feedback module 13. The program 81 includes a series of instructions for the information processing. The area information 125 may be held independently of the program 81, or may be included within the program 81.

[0123] At least one of the program 81 and the area information 125 may be stored in the storage medium SR1 instead of the storage unit 12 or together with the storage unit 12. The storage medium SR1 is configured to accumulate various information (stored programs, etc.) by electrical, magnetic, optical, mechanical, or chemical action so that a machine such as a computer can read the information. The storage unit 12 and the storage medium SR1 are examples of non-transient storage media. The smart grip 1 (computer) may acquire at least one of the program 81 and the area information 125 from the storage medium SR1. The storage medium SR1 may be a disk-type storage medium (CD, DVD, etc.) or a non-disk type storage medium such as a semiconductor memory (flash memory, etc.). Any drive device may be used to read the information stored in the storage medium SR1. The type of drive device may be appropriately selected according to the storage medium SR1.

[0124] The positioning sensor 14 is configured to measure a position. As long as the position can be measured, the type of the positioning sensor 14 is not particularly limited and may be appropriately selected depending on the embodiment. For example, the positioning sensor 14 may be configured with a GPS (Global Positioning System) sensor, a GNSS (Global Navigation Satellite System) sensor, or the like. In addition, for example, The positioning sensor 14 may be configured with a beacon receiver. In this case, a plurality of beacon transmitters may be installed in the facility. The position of the smart grip 1 may be appropriately measured (estimated) from the strength of the beacon signal received by the positioning sensor 14 (beacon receiver). For example, the positioning sensor 14 may estimate the distance to each beacon transmitter according to the strength of the signal received by the beacon receiver. The positioning sensor 14 may measure the position of the smart grip 1 from the estimated distance to each beacon transmitter by triangulation. At least a part of the process of measuring this position may be executed by the control device 11.

[0125] The communication module 15 is configured to execute wired or wireless communication via a network. The communication module 15 may be configured, for example, by a wired LAN (Local Area Network) module, a wireless LAN module, or the like. The type (standard) of the network is not particularly limited and may be appropriately selected according to the embodiment. The type of the network may be appropriately selected from, for example, the Internet, a wireless communication network, a mobile communication network, a telephone network, a dedicated network, or the like. The smart grip 1 (control device 11) can execute data exchange with another computer (for example, an external computer 5, etc.) via the communication module 15.

[0126] The output device 16 is configured to output information. The output device 16 may be configured with, for example, a display, a speaker, an indicator light, etc. The output format of the information may be appropriately selected from text, images, sounds, etc. When the output device 16 includes a display, the display is preferably disposed in a location where the output information can be viewed while the user is holding the smart grip 1. This allows the user to check the information displayed on the display while using the smart grip 1.

[0127] The output device 16 may be used to output any information. For example, as described above, the output device 16 may be used to output the shopping list 32. Also, for example, if the smart grip 1 further includes a detection sensor that detects the insertion of a product, the output device 16 may be used to output information related to the insertion of the product in response to the detection of the insertion of the product by the detection sensor. The information to be output may be stored in advance in the storage unit 12, or may be obtained from an external computer.

[0128] The input device 17 is configured to receive input of information. The input device 17 may be configured, for example, by a keyboard, a touch panel, an operator, a microphone, etc. The input device 17 may be used for any operation on the smart grip 1. For example, as described above, the input device 17 may be used for inputting that all products to be purchased have been placed in the basket B1, or for inputting that each product has been placed in the basket B1. The output device 16 and the input device 17 may be at least partially integrated with a touch panel display or the like.

[0129] Regarding the specific hardware configuration of the smart grip 1 (computer), components can be omitted, replaced, or added as appropriate depending on the embodiment. For example, the control device 11 may include multiple hardware processors (processor P). At least one of the communication module 15, the output device 16, and the input device 17 may be omitted. At least one of the program 81 and the area information 125 may be stored in an external storage device such as a NAS. The external storage device is also an example of a non-transitory storage medium. The smart grip 1 may include multiple computers. The hardware configuration of each computer may or may not be the same. Furthermore, the computer included in the smart grip 1 may be a dedicated computer, a general-purpose PC (Personal Computer), a tablet, etc. The computer included in the smart grip 1 may be configured by a laptop PC, a terminal device (including a smartphone), etc. For example, the computer included in the smart grip 1 may be configured by a smartphone. The smart grip 1 may be constructed by mounting a smartphone on a housing (attachment).

[0130] [Smart Grip Structure] 10 and 11 are a side view and a plan view showing an example of the structure of the smart grip 1 according to this embodiment. In one example, the smart grip 1 may further include a housing 90 that houses the haptic feedback module 13, the positioning sensor 14, and the control device 11. The housing 90 may include one or more grooves (groove 915, groove 935, etc.) for hooking the handle B11 provided on the basket B1. According to this example of the present embodiment, it is possible to provide a smart grip 1 that can be used as a handle for a basket by replacing the handle (handle B11) of an existing basket.

[0131] The structure of the smart grip 1, such as the shape of the housing 90, the size of the housing 90, the arrangement of each component (such as the control device 11) in the housing 90, the number of grooves, the shape of the grooves, and the arrangement of the grooves, may be appropriately determined depending on the embodiment. In the example of Fig. 10 and Fig. 11, a situation is assumed in which the haptic feedback module 13 is configured by a vibration motor 130 and a servo motor 135. A situation is assumed in which the output device 16 and the input device 17 are configured by a touch panel display 167. A situation is assumed in which the housing 90 has a pair of grooves (915, 935). A situation is assumed in which the smart grip 1 further includes a detection sensor configured by a pair of load sensors 180 and an imaging device 19 provided separately from the detection sensor.

[0132] For ease of explanation, the left-right direction in Figs. 10 and 11 will be referred to as the "front-rear direction". The left direction in Figs. 10 and 11 will be referred to as the "front direction", and the right direction in Figs. 10 and 11 will be referred to as the "rear direction". The direction perpendicular to the paper surface of Fig. 10 and the up-down direction in Fig. 11 will be referred to as the "left-right direction". The upward direction in Fig. 11 will be referred to as the "right direction", and the downward direction in Fig. 11 will be referred to as the "left direction". The upward-down direction in Fig. 10 and the direction perpendicular to the paper surface of Fig. 11 will be referred to as the "up-down direction". The upward direction in Fig. 10 will be referred to as the "upper direction", and the downward direction in Fig. 10 will be referred to as the "lower direction".

[0133] In one example, the housing 90 may include a first portion 91, a second portion 92, and a third portion 93. In one example shown in each figure, the first portion 91, the second portion 92, and the third portion 93 are aligned in a line in the front-rear direction from the rear. Each portion (91, 92, 93) is formed in a rectangular parallelepiped shape. The first portion 91 and the third portion 93 may have substantially the same shape. The width (length in the left-right direction) of the second portion 92 may be formed to be shorter than the first portion 91 and the third portion 93. As a result, the second portion 92 may constitute a portion to be held by the user. In one example of each figure, the second portion 92 extends along the front-rear direction. Therefore, the user can hold the smart grip 1 by holding the second portion 92 with his / her hand along the front-rear direction. The total length of the circumference of the second portion 92 around the axis in the front-rear direction may be determined within a range of a length that can be held by hand.

[0134] Side walls may be provided at the ends of each part (91, 92, 93) in the horizontal direction (left-right direction and front-back direction). A bottom surface may be provided at the lower end of each part (91, 92, 93). As a result, an internal space may be formed in each part (91, 92, 93) that is surrounded by each side wall and that houses the computer part of the smart grip 1. The internal spaces of the first part 91 and the second part 92 may be at least partially continuous. The internal spaces of the second part 92 and the third part 93 may also be at least partially continuous. The upper end of each part (91, 92, 93) may be closed by a lid or the like, or may be open.

[0135] A groove 915 may be provided on the rear end side of the first portion 91. In one example of each figure, the groove 915 is formed by recesses provided on side walls opposing each other in the left-right direction of the first portion 91. Each recess is formed in a rectangular shape. The recesses are aligned in the front-rear direction to form the groove 915. Even when the upper end of the first portion 91 is closed, the portion of the groove 915 on the upper end surface of the first portion 91 may be open.

[0136] Similarly, a groove 935 may be provided on the front end side of the third portion 93. In one example of each figure, the groove 935 is formed by recesses provided on side walls opposing each other in the left-right direction of the third portion 93. Each recess is formed in a rectangular shape. The recesses are aligned in the front-rear direction to form the groove 935. Even when the upper end of the third portion 93 is closed, the portion of the groove 935 on the upper end surface of the third portion 93 may be open. The width (length in the front-rear direction) of each groove (915, 935) may be formed to be the same as or slightly larger than the width of the corresponding handle portion B11 of the basket B1. In this way, each groove (915, 935) may be configured to be able to receive each handle portion B11 of the basket B1.

[0137] (Load sensor) The pair of load sensors 180 may be disposed in the internal space of each of the first and third parts 91 and 93 in accordance with the positions of the pair of grooves (915, 935). When the portion of the handle B11 that is to be hooked onto the smart grip 1 is formed in a straight line, in one example, the recesses constituting each groove (915, 935) may be formed so that the lower end of the recess is positioned slightly lower than the measurement portion (contact surface with the handle B11) of the load sensor 180. In this way, when each handle B11 is hooked onto each groove (915, 935), each handle B11 comes into contact with the measurement portion of each load sensor 180. As a result, each load sensor 180 can observe the change in weight when a baggage TP (goods, etc.) is put into the basket B1 (basket body B10). The location of the load sensor 180 is an example of a location where a change in load occurs when a baggage TP is put into the basket B1 (basket body B10). However, the positional relationship between each groove (915, 935) and each load sensor 180 is not limited to this example, and may be changed as appropriate depending on the embodiment, such as the shape of the handle part B11. For example, each handle part B11 may be formed so that the part located in the internal space of each part (91, 93) when hung on the smart grip 1 is curved downward. In this case, the recess constituting each groove (915, 935) may be formed so that the lower end of the recess is located above the measuring part of the load sensor 180.

[0138] (Imaging device) In one example of each figure, the imaging device 19 is disposed in the internal space of the first portion 91. For example, a bottom surface of the first portion 91 is provided with a , an opening may be provided. The imaging device 19 may be arranged so that the imaging unit 161 is exposed from the bottom surface of the first portion 91 by fitting the imaging unit 191 into the opening on the bottom surface. This allows the imaging device 19 to capture an image of the area below the smart grip 1. Therefore, when the smart grip 1 is attached to the basket B1 by hooking each handle portion B11 of the basket B1 into each groove (915, 935), the imaging device 19 can include the storage portion of the basket body B10 in the imaging range. As a result, when the luggage TP is inserted into the basket body B10, the imaging device 19 can observe the luggage TP being inserted. The location where the imaging device 19 is disposed is an example of a location where the luggage TP being inserted can be observed. The pair of load sensors 180 and the imaging device 19 may be used for any purpose. For example, the pair of load sensors 180 and the imaging device 19 may be used to identify products by the above method.

[0139] (Haptic feedback module) In one example of each figure, the haptic feedback module 13 includes a vibration motor 130 and a servo motor 135. The vibration motor 130 and the servo motor 135 are disposed in the internal space of the second part 92. In this example, the second part 92 constitutes a part that is held by the user TU. Therefore, by disposing the vibration motor 130 and the servo motor 135 in the second part 92, the user TU using the smart grip 1 can be given haptic feedback 25. This location of the vibration motor 130 and the servo motor 135 is an example of a location where motion can be transmitted to a part that is held by the user TU. The types of the vibration motor 130 and the servo motor 135 are not particularly limited, and may be appropriately selected according to the embodiment.

[0140] The vibration motor 130 is configured to generate vibrations to output haptic feedback to the user TU. In one example, the vibration feedback 25 in each of the above cases may be realized by controlling the operation of the vibration motor 130.

[0141] The servo motor 135 may include a shaft 1351 and an arm 1352. The shaft 1351 constitutes a rotation axis. The arm 1352 is attached to the shaft 1351 and rotates around the axis of the shaft 1351 in response to the rotation of the shaft 1351. The arm 1352 may be configured so that a part (for example, a tip) of the arm 1352 comes into contact with the hand of the user TU holding the second part 92 by rotating clockwise or counterclockwise. Alternatively, the arm 1352 may be configured so that the tip of the arm 1352 hits the side wall of the second part 92 by rotating clockwise or counterclockwise, and vibrations generated by this are transmitted to the hand of the user TU holding the second part 92. With these configurations, the servo motor 135 can output feedback intuitively indicating the direction of the target by swinging the arm 1352 in the direction of the target. In one example of each figure, feedback pointing to the left direction can be given by rotating the arm 1352 clockwise (swinging the arm 1352 clockwise) and transmitting an impact from the arm 1352 to the left side of the hand of the user TU holding the second part 92. On the other hand, feedback pointing to the right direction can be given by rotating the arm 1352 counterclockwise (swinging the arm 1352 counterclockwise) and transmitting an impact from the arm 1352 to the right side of the hand of the user TU holding the second part 92. In one example, the feedback 25 intuitively indicating a predetermined direction in each of the above examples may be realized by such an operation of the servo motor 135. The configuration including this servo motor 135 is one example of a configuration intuitively indicating a predetermined direction. In one example of each figure, the arm 1352 is formed in a flat plate shape. However, the shape of the arm 1352 is not limited to such an example. As long as tactile feedback can be output in a specific direction by rotating, the shape of arm 1352 is not particularly limited and may be appropriately selected depending on the embodiment.

[0142] (Box / Display) In addition, in one example of each figure, the control device 11, the storage unit 12, the positioning sensor 14, and the communication module 15 are housed in a box 1100. The box 1100 is formed in a rectangular parallelepiped shape and is disposed in the internal space of the third portion 93. A touch panel display 167 is disposed on the upper surface of the box 1100. When the upper end of the third portion 93 is closed, the touch panel display 167 may be disposed so that the screen is exposed from the upper end surface of the third portion 93. In this example, when the user TU properly holds the smart grip 1, the third portion 93 is located in front of the second portion 92. Therefore, while using the smart grip 1, the screen of the touch panel display 167 is disposed slightly in front of the hand of the user TU that holds the smart grip 1. As a result, while using the smart grip 1, the user TU can easily view the screen of the touch panel display 167 without being blocked by any body part.

[0143] (others) The structure of the smart grip 1 is not limited to the examples shown in Figs. 10 and 11, and may be modified as appropriate depending on the embodiment. For example, the shape of the housing 90 may be modified as appropriate. In another example, the housing of the smart grip 1 may be formed in a ring shape, and a part of the ring may be configured to be openable and closable by attaching and detaching the ends. As a result, the housing of the smart grip 1 may be configured to replace the handle by receiving the handle portion B11 of the basket B1 in the ring formed by the housing. In yet another example, the housing of the smart grip 1 may be formed to receive a terminal device such as a smartphone. In this case, the smart grip 1 may be constructed by attaching the terminal device to the housing.

[0144] In addition, the position of each groove (915, 935) may be changed as appropriate. The number of grooves provided in the housing (housing 90) is not limited to two, and may be one, or three or more. In addition, the arrangement of each component may be changed as appropriate. The arrangement of the load sensor 180 may be changed as appropriate depending on the structure of the housing (housing 90). When a sensor other than the load sensor 180 is used as the detection sensor, the detection sensor may be arranged as appropriate in a location where it can detect the insertion of the luggage TP. The arrangement of the imaging device 19 may be changed as appropriate depending on the embodiment. The imaging device 19 may be arranged in a location other than the internal space of the first portion 91. At least one of the detection sensor and the imaging device 19 may be omitted.

[0145] The output device 16 may include other output devices (speakers, indicator lights, etc.) in addition to or instead of the display. The arrangement of the other output devices may be determined appropriately depending on the embodiment. The input device 17 may include other input devices (keyboard, controls, etc.) in addition to or instead of the touch panel. The arrangement of the other input devices may be determined appropriately depending on the embodiment. The components housed in the box 1100 may be changed appropriately. The box 1100 may be placed in a location other than the internal space of the third portion 93. The box 1100 may be omitted.

[0146] Furthermore, in the haptic feedback module 13, the configuration for intuitively indicating a predetermined direction does not need to be limited to the configuration including the servo motor 135 having the shaft 1351 and the arm 1352. The configuration of the servo motor 135 may be appropriately changed depending on the embodiment. Furthermore, the haptic feedback module 13 may include another configuration for intuitively indicating a predetermined direction instead of or together with the servo motor 135.

[0147] 12 is a plan view showing a schematic diagram of another example of the structure of the smart grip 1 according to this embodiment. In another example, the haptic feedback module 13 may include four vibration motors (131, 132, 133, 134) instead of the vibration motor 130 and the servo motor 135. The four vibration motors (131, 132, 133, 134) are arranged separately in the front-rear and left-right directions with the center of the second portion 92 as a reference point PO. The first vibration motor 131 is arranged forward of the reference point PO. The second vibration motor 132 is arranged forward of the reference point P The third vibration motor 133 is disposed to the left of the reference point PO. The fourth vibration motor 134 is disposed rearward of the reference point PO. The four vibration motors (131, 132, 133, 134) are an example of a plurality of vibration motors.

[0148] Since each vibration motor (131, 132, 133, 134) is away from the reference point PO, the vibration of the vibration motor can intuitively convey the direction from the reference point PO. In one example, the haptic feedback module 13 can output feedback that intuitively indicates the direction of the target by vibrating the vibration motor corresponding to the target direction among the four vibration motors (131, 132, 133, 134) more strongly than the other vibration motors. For example, the control device 11 can provide the user TU with feedback that indicates the forward direction by vibrating the first vibration motor 131 more strongly than the other vibration motors (132, 133, 134). The control device 11 can provide the user TU with feedback that indicates the backward direction by vibrating the fourth vibration motor 134 more strongly than the other vibration motors (131, 132, 133). The same applies to the left and right directions. In one example, the feedback 25 intuitively indicating a specific direction in each of the above cases may be constituted by this action of driving one of the four vibration motors (131, 132, 133, 134) corresponding to the specific direction to vibrate more strongly than the remaining vibration motors.

[0149] The number of vibration motors that vibrate more strongly than the other vibration motors may not be limited to one, and may be more than one. For example, the haptic feedback module 13 may indicate a direction between the front and the right by vibrating the first vibration motor 131 and the second vibration motor 132 more strongly than the other vibration motors (133, 134). Also, for example, the haptic feedback module 13 may indicate a direction closer to the front by vibrating the first vibration motor 131 more strongly than the second vibration motor 132, among the first vibration motor 131 and the second vibration motor 132 that are vibrated strongly. As in these examples, the haptic feedback module 13 may indicate a direction between the positions where the vibration motors are arranged by vibrating the multiple vibration motors more strongly than the remaining vibration motors. Also, the haptic feedback module 13 may continuously indicate the direction of the target by varying the strength of vibration among the multiple vibration motors that are vibrated strongly.

[0150] In another example, the haptic feedback module 13 can output feedback intuitively indicating the direction of the target by vibrating at least two or more of the four vibration motors (131, 132, 133, 134) in an order corresponding to the direction of the target. The order of vibration may be arbitrarily defined. In one example, determining the order of vibration of the two or more vibration motors may be configured to select at least two or more vibration motors located along the direction of the target from among the four vibration motors (131, 132, 133, 134), and vibrate the vibration motors located closer to the rear end in the direction of the target earlier than the selected two or more vibration motors, and vibrate the vibration motors located closer to the front end in the direction of the target later than the selected two or more vibration motors.

[0151] For example, the control device 11 may output feedback indicating the right direction to the user TU by vibrating the third vibration motor 133 and then vibrating the second vibration motor 132. Conversely, the control device 11 may output feedback indicating the left direction to the user TU by vibrating the second vibration motor 132 and then vibrating the third vibration motor 133. The control device 11 may also output feedback indicating a direction between the front and the right by vibrating the third vibration motor 133 and then vibrating the first vibration motor 131. The same applies to other directions.

[0152] In one example, the feedback 25 intuitively indicating a predetermined direction in each of the above cases is generated by vibration of at least two of the four vibration motors (131, 132, 133, 134). The vibration motor may be driven in a sequence corresponding to a predetermined direction. The strength (intensity, period, etc.) of vibration of at least two or more vibration motors that indicate a direction may be the same or different. In one example, the control device 11 may vibrate a vibration motor located closer to the rear end of the target direction more weakly and vibrate a vibration motor located closer to the tip end of the target direction more strongly. This makes it possible to output feedback that emphasizes the tip end of the pointing direction.

[0153] In addition, if two or more vibration motors are provided, comparison of directions is possible. Therefore, when the haptic feedback module 13 is configured to be able to output feedback that intuitively indicates the direction of a target, the number of vibration motors included in the haptic feedback module 13 is not limited to four, and may be two, three, or five or more. At least one of the four vibration motors (131, 132, 133, 134) may be omitted. For example, by omitting the first vibration motor 131 and the fourth vibration motor 134, the haptic feedback module 13 may be configured to be able to indicate the left and right directions.

[0154] In addition, the position of the reference point PO of each vibration motor (131, 132, 133, 134) may not be limited to the center of the second portion 92, and may be appropriately determined according to the embodiment. The position of the reference point PO may be appropriately defined according to the number and arrangement of the vibration motors. In order to easily sense the direction indicated by the vibration of the vibration motor, it is preferable that the reference point PO is set at or near the center of the part that the user TU normally holds. This allows the user TU to easily sense the direction indicated by the haptic feedback module 13 according to the deviation of the vibration from the part that is held. In yet another example, the haptic feedback module 13 may include both a servo motor and a plurality of vibration motors. Accordingly, the haptic feedback module 13 may be configured to output feedback indicating a specific direction by both the servo motor and the vibration motor.

[0155] [Software configuration] 13 is a schematic diagram showing an example of a software configuration of the smart grip 1 (control device 11) according to this embodiment. The control device 11 of the smart grip 1 executes instructions included in a program 81 stored in the storage unit 12 by the processor P. As a result, the smart grip 1 (control device 11) operates as a computer including a position acquisition unit 111, a determination unit 112, and a feedback unit 113 as software modules. That is, in this embodiment, each software module of the smart grip 1 is realized by the control device 11 (processor P).

[0156] The position acquisition unit 111 is configured to acquire a current position 20 measured by the positioning sensor 14. The determination unit 112 is configured to determine at least one of whether or not the current position 20 belongs to a predetermined area AZ (first condition) and whether or not the current position 20 is approaching the predetermined area AZ (second condition). The feedback unit 113 is configured to output haptic feedback 25 to the user TU via the haptic feedback module 13 when the acquired current position 20 belongs to or is approaching the predetermined area AZ. The feedback 25 is configured to indicate an instruction to guide the user TU to the predetermined area AZ or to avoid the predetermined area AZ.

[0157] In this embodiment, an example is described in which each software module of the smart grip 1 is realized by a general-purpose processor (processor P). However, some or all of the above software modules may be realized by one or more dedicated processors or chipsets. Each of the above modules may be realized as a hardware module. Accordingly, modules may be omitted, replaced, and added as appropriate.

[0158] §3 Example of operation FIG. 14 is a flowchart showing an example of a processing procedure for outputting feedback 25 by the control device 11 of the smart grip 1 according to this embodiment. The following processing procedure is an example of a control method (information processing method) executed by a computer (control device 11). However, the following processing procedure is merely an example, and each step may be modified as much as possible. Furthermore, steps in the following processing procedure may be omitted, replaced, or added as appropriate depending on the embodiment.

[0159] In step S101, the control device 11 operates as the position acquisition unit 111. The control device 11 acquires the current position 20 measured by the positioning sensor 14. When the current position 20 is acquired, the control device 11 advances the process to the next step S102.

[0160] In step S102, the control device 11 operates as the determination unit 112. The control device 11 determines whether or not the positional relationship between the acquired current position 20 and the predetermined area AZ satisfies a predetermined condition. The predetermined condition includes at least one of the first condition and the second condition.

[0161] When the first condition is adopted, the control device 11 judges whether or not the current location 20 belongs to the predetermined area AZ. If it is judged that the current location 20 belongs to the predetermined area AZ, the control device 11 advances the process to the next step S103. On the other hand, if it is judged that the current location 20 does not belong to the predetermined area AZ, the control device 11 skips the process of step S103 and advances the process to the next step S104.

[0162] When the second condition is adopted, the control device 11 judges whether or not the current location 20 is approaching the predetermined area AZ. If it is judged that the current location 20 is approaching the predetermined area AZ, the control device 11 advances the process to the next step S103. On the other hand, if it is judged that the current location 20 is not approaching the predetermined area AZ, the control device 11 skips the process of step S103 and advances the process to the next step S104.

[0163] In step S103, the control device 11 operates as the feedback unit 113. The control device 11 outputs haptic feedback 25 to the user TU via the haptic feedback module 13. The feedback 25 is configured to guide the user TU to the predetermined area AZ or to instruct the user TU to avoid the predetermined area AZ. In one example, at least one of the above first to eighth cases may be adopted for the predetermined area AZ and the feedback 25. After outputting the feedback 25, the control device 11 advances the process to the next step S104.

[0164] In step S104, the control device 11 judges whether or not to end the process. The judgment criteria may be set arbitrarily. In one example, the control device 11 may judge not to end the process until an end instruction is given. On the other hand, when an end instruction is given, the control device 11 may judge to end the process. The end instruction may be given by any method. In another example, when the target user (user TU) is present in the facility, the control device 11 may judge not to end the process. On the other hand, when the target user is not present in the facility (has left the facility), the control device 11 may judge to end the process. Whether or not the target user is present in the facility may be appropriately judged according to the measurement result of the positioning sensor 14, etc.

[0165] When it is determined that the process should not be ended, the control device 11 returns the process to step S101 and executes the process again from step S101. When it is determined that the process should be ended, the control device 11 ends the process procedure related to the output of the feedback 25 according to this operation example. The timing for ending the process is not limited to this example. The control device 11 may end the processing procedure related to the output of the feedback 25 at any timing. In one example, the control device 11 may execute a series of processes from step S101 to step S104 in real time.

[0166] According to this embodiment, the smart grip 1 can be held together with the basket B1, so that the effort of holding the user terminal separately from the basket B1 can be at least partially reduced. Also, according to this embodiment, the processing in step S103 provides an instruction to guide to the predetermined area AZ or to avoid the predetermined area AZ as tactile feedback 25. This can at least partially reduce the work of checking visual information. Therefore, according to this embodiment, it is expected that the effort of the user TU can be reduced at least in either a scene of guiding to the predetermined area AZ or a scene of avoiding the predetermined area AZ.

[0167] § 4 Variations Although the embodiment of the present disclosure has been described in detail above, the above description is merely an example of the present disclosure in every respect. The processes and means described in the present disclosure can be freely combined and implemented as long as no technical contradiction occurs. In addition, various improvements or modifications may be made to the above embodiment as appropriate. For example, the following modifications are possible. In the following, the same reference numerals are used for components similar to those in the above embodiment, and the description of the same points as those in the above embodiment is omitted as appropriate.

[0168] <4.1> The above embodiment is configured as a smart grip 1. However, the embodiment of the present disclosure may not be limited to the above smart grip 1. The embodiment of the present disclosure may be a component of a basket, or may be a basket (including a cart) itself. The type of basket is not particularly limited and may be appropriately selected depending on the embodiment. For example, the basket may include a shopping basket, a shopping cart, a baggage cart used at an airport, etc.

[0169] (First Modification) FIG. 15 is a schematic diagram showing another example of a scene to which the present disclosure is applied. In the example of FIG. 15, the embodiment of the present disclosure is a cage 1A. The cage 1A includes a cage body 102A, a haptic feedback module 13, a positioning sensor 14, and a control device 11. The haptic feedback module 13, the positioning sensor 14, and the control device 11 may be configured in the same manner as in the above embodiment. That is, the control device 11 may be configured to acquire a current position 20 measured by the positioning sensor 14, and, when the acquired current position 20 belongs to or is approaching a predetermined area AZ, output haptic feedback 25 to the user TU via the haptic feedback module 13. The feedback 25 may be configured to guide the user TU to the predetermined area AZ or to indicate an instruction to avoid the predetermined area AZ.

[0170] Other configurations of the basket 1A are not particularly limited and may be appropriately determined depending on the embodiment. In one example, the basket 1A may include a pair of handle parts 101A attached to the basket body 102A, and a grip 100A spanning the pair of handle parts 101A. Each handle part 101A may be configured similarly to each handle part B11 of the basket B1. When these configurations are adopted, in one example, the basket 1A may be constructed by using the smart grip 1 for the grip 100A. However, the method of constructing the basket 1A is not limited to such an example.

[0171] Like the smart grip 1, the basket 1A may further include a memory unit 12. The basket 1A may further include at least one of a communication module 15, an output device 16, and an input device 17. The basket 1A may further include a detection sensor and an imaging device 19. In the case where the detection sensor and the imaging device 19 are provided, the control device 11 may acquire an image captured by the imaging device 19 when the detection sensor detects the insertion of a commodity, and identify the commodity inserted into the basket body 102A by performing image analysis on the acquired image.

[0172] The location where the computer part of the basket 1A (the control device 11 to the input device 17, the detection sensor and the imaging device 19) is arranged is not limited to the grip 100A. At least a part of the computer part of the basket 1A may be arranged at any location other than the grip 100A. In another example, when a load sensor is used as the detection sensor, the detection sensor may be arranged on the bottom surface of the storage part of the basket body 102A. The imaging device 19 may be arranged on the edge of the opening of the basket body 102A with the imaging unit 191 facing toward the storage part of the basket body 102A. The haptic feedback module 13 may be arranged at any location where the motion can be transmitted to the part held by the user TU (the grip 100A in this modified example). If the motion can be transmitted, the haptic feedback module 13 may be arranged at a location other than the grip 100A. However, from the viewpoint of the transmission of the motion, it is preferable that the haptic feedback module 13 is provided in the grip 100A.

[0173] The basket 1A according to this modification can provide the user TU with feedback 25, similar to the smart grip 1. Therefore, according to this modification, it is expected that the effort of the user TU can be reduced at least in either a scene of guiding the user to the predetermined area AZ or a scene of making the user avoid the predetermined area AZ. The configuration of the basket 1A may be appropriately changed depending on the embodiment. In another example, the grip 100A may be omitted. In this case, the user may hold the basket 1A by grasping the pair of handle parts 101A. The haptic feedback module 13 may be disposed at any location where the motion can be transmitted to at least one of the pair of handle parts 101A.

[0174] (Second Modification) FIG. 16 is a schematic diagram showing another example of a scene to which the present disclosure is applied. In the example of FIG. 16, the embodiment of the present disclosure is a basket 1B. The basket 1B corresponds to an embodiment in which the above-mentioned basket 1A is further provided with one or more wheels 103B, thereby forming a cart. That is, the basket 1B includes a basket body 102B, a haptic feedback module 13, a positioning sensor 14, a control device 11, and one or more wheels 103B. The basket body 102B may be the same as the basket body 102A of the first modified example. The control device 11 may be configured to acquire a current position 20 measured by the positioning sensor 14, and, when the acquired current position 20 belongs to or approaches a predetermined area AZ, to output haptic feedback 25 to the user TU via the haptic feedback module 13. The feedback 25 may be configured to guide the user TU to the predetermined area AZ or to indicate an instruction to avoid the predetermined area AZ. The number of wheels 103B may be appropriately selected according to the embodiment. In a typical example, the basket 1B may include four wheels 103B. The basket 1B may be used as a shopping cart, a luggage cart, and the like.

[0175] The arrangement of each wheel 103B and the configuration for supporting the basket body 102B may be appropriately determined according to the embodiment. In one example, the basket 1B may include a grip 100B and a base 101B. The base 101B may include a leg 1011B and a support 1012B. The leg 1011B may be disposed below the basket body 102B. Each wheel 103B may be attached to the leg 1011B. The support 1012B may be configured to extend vertically upward from one end of the leg 1011B. The basket body 102B may be fixed to the support 1012B. The grip 100B may be attached to the upper end of the support 1012B.

[0176] As a result, the basket 1B may have the same configuration as a general shopping cart. However, the configuration of the basket 1B is not limited to this example, and may be changed as appropriate depending on the embodiment. For example, the basket 1B may have a configuration similar to that of other types of carts, such as a silver cart. In addition, when adopting these configurations, in one example, the basket 1B may be constructed by using the above-mentioned smart grip 1 for the grip 100B. However, the method of constructing the basket 1B is not limited to this example.

[0177] Similar to the smart grip 1, the basket 1B may further include a memory unit 12. The basket 1B may further include at least one of a communication module 15, an output device 16, and an input device 17. The basket 1B may further include a detection sensor and an imaging device 19. Similar to the first modified example, when the basket 1B includes the detection sensor and the imaging device 19, the control device 11 may execute a product identification process by image analysis.

[0178] The location where the computer part of the basket 1B (the control device 11 to the input device 17, the detection sensor, and the imaging device 19) are arranged is not limited to the grip 100B. At least a part of the computer part of the basket 1B may be arranged at any location other than the grip 100B. In another example, when a load sensor is used as the detection sensor, the detection sensor may be arranged on the bottom surface of the storage part of the basket body 102B. The imaging device 19 may be arranged on the edge of the opening of the basket body 102B or in the area of ​​the support part 1012B from the upper end of the basket body 102B to the grip 100B, with the imaging unit 191 facing toward the storage part of the basket body 102B. The haptic feedback module 13 may be arranged at any location where it can transmit motion to the part held by the user TU (the grip 100B in this modified example). As long as it is possible to transmit motion, the haptic feedback module 13 may be arranged at a location other than the grip 100B. However, from the viewpoint of motion transmission, it is preferable that the haptic feedback module 13 is provided in the grip 100B.

[0179] The basket 1B according to this modification can provide the user TU with feedback 25, similar to the smart grip 1. Therefore, according to this modification, it is expected that the effort of the user TU can be reduced at least in either a scene of guiding the user to the predetermined area AZ or a scene of avoiding the predetermined area AZ. The basket body 102B may be used as a basket receiver. In this case, other baskets may be placed in the basket body 102B, and luggage TP (products, etc.) may be put into the other baskets. The detection sensor may be appropriately placed so as to be able to detect the putting of products into the other baskets. Detecting the putting of products into the basket body 102B may include detecting the putting of products into the other baskets placed in the basket body 102B. Furthermore, the leg 1011B may be configured to receive luggage. In this case, the detection sensor may be further placed in the leg 1011B. When the identification of products by image analysis is also performed in the leg 1011B, the imaging device 19 may be further placed in the leg 1011B. Also, the basket body 102B may be omitted. In this case, the legs 1011B may be used as the basket body. [Explanation of symbols]

[0180] 1. Smart Grip, 1A·1B…Basket, 102A·102B…Basket body, 11...control device, 13...haptic feedback module, 14...positioning sensor, 20…current location, 25…feedback, TU: user, AZ: designated area

Claims

1. Haptic feedback module, Positioning sensor, A control device, and Chassis Equipped with The control device includes: Obtaining a current location measured by the positioning sensor; and outputting haptic feedback to a user via the haptic feedback module when the acquired current location belongs to a predetermined area or is approaching a predetermined area; configured to run The feedback is configured to indicate instructions to guide the user into or avoid the predetermined area; The housing accommodates the haptic feedback module, the positioning sensor, and the control device, and has one or more grooves for hooking a handle provided on a basket. Smart grip.

2. The predetermined area includes a viewing area in which the target product can be viewed, Outputting the feedback includes outputting the feedback configured to indicate an indication of a direction in which the target product is located. The smart grip according to claim 1.

3. The product shelf has a first surface on which the target product is arranged and a second surface opposite the first surface, The visual recognition area is set on the first surface side, not on the second surface side. The smart grip according to claim 2.

4. The predetermined area includes a promotion area for the target product, The output of the feedback may include, when the current position is close to the promotion area, indicating a direction in which the promotion area is located. outputting the feedback configured as follows: The smart grip according to claim 1.

5. The predetermined area includes a cash register area, outputting the feedback includes outputting the feedback configured to indicate an instruction to guide the user to turn back from the cash register area when it is not determined that all of the products to be purchased have been put into the basket and the acquired current location belongs to or is approaching the cash register area. The smart grip according to claim 1.

6. The predetermined area includes a congested area, and outputting the feedback including outputting the feedback configured to indicate an instruction to avoid the congested area. The smart grip according to claim 1.

7. The crowded area includes a crowded cash register, The smart grip of claim 6 , wherein the instruction to avoid a crowded area includes an instruction to guide the user to a cash register other than the crowded cash register.

8. The predetermined area includes a non-crowded area, and outputting the feedback includes outputting the feedback configured to indicate an instruction to guide the user to the non-congested area. The smart grip according to claim 1.

9. The predetermined area includes a store area where a store clerk is present, and outputting the feedback includes outputting the feedback configured to indicate an indication of a direction in which the store clerk is present. The smart grip according to claim 1.

10. The predetermined area includes a recommended product area in which products recommended to the user exist, outputting the feedback includes outputting the feedback configured to show an instruction to guide the user to the recommended product area. The smart grip according to claim 1.

11. The predetermined area includes a non-recommended product area in which products not recommended to the user exist, and outputting the feedback includes outputting the feedback configured to indicate instructions to avoid the non-recommended product area. The smart grip according to claim 1.

Images