Smart Grip and Shopping Basket

Abstract

This technology reduces the possibility of overlooking items being placed in the shopping basket. [Solution] A smart grip according to one aspect of the present disclosure is configured to be usable as a handle for a shopping basket. The smart grip comprises a detection sensor, a feedback module, and a control device. The detection sensor is configured to detect when an item is placed in the basket. The control device is configured to respond to the detection of the item being placed in the basket by the detection sensor, to determine the content of the feedback according to the attributes of the detected item being placed in the basket, and to output the determined content of the feedback to the user via the feedback module.

Description

Technical Field

[0004] ,

[0006] , , , , , ,

[0005] , , ,

[0007] , , ,

[0001] The present disclosure relates to a smart grip and a shopping basket.

Background Art

[0002] In recent years, various technologies for monitoring the purchasing behavior of users in stores have been developed. For example, Patent Document 1 proposes a product storage device including a storage unit for storing products, an imaging unit for imaging an image inside the storage unit, and a transmission unit for transmitting the identified information of the self-device together with the captured image to a product registration device. According to this product storage device, the work load of store clerks can be reduced.

Prior Art Documents

Patent Documents

[0008] In this configuration, when a detection sensor detects the insertion of an item, feedback is provided according to the attributes of the item being inserted. This feedback allows for the notification of the item being inserted. However, if the same feedback is given repeatedly, familiarity can lead to a loss of awareness of receiving the feedback (forgetting, overlooking, etc.). In contrast, this configuration is expected to suppress the loss of awareness due to familiarity by switching the feedback provided according to the attributes of the item being inserted. Therefore, with this configuration, by providing such feedback in response to the detection of item insertion, it is expected that the possibility of overlooking the insertion of an item into the basket can be reduced.

[0009] In the smart grip relating to the above aspect, the attribute of product input is the input product The number may be included. With this configuration, by providing feedback that switches according to the number of products that have been introduced, it is possible to reduce the possibility of overlooking the introduction of products.

[0010] In the Smart Grip relating to the above aspect, determining the content of the feedback according to the attributes of the product being introduced may include determining the content of the feedback so that the output feedback becomes closer to complete content as the number of introduced products approaches the target number. With this configuration, it is possible to stimulate purchasing intent by encouraging the introduction of products toward complete feedback.

[0011] In the smart grip relating to the above aspect, the attributes of product input may include at least one of the identification information and type of the product that has been input. With this configuration, by providing feedback that switches according to at least one of the identification information and type of the product that has been input, it is possible to reduce the possibility of overlooking product input.

[0012] The smart grip relating to the above aspect may further include a positioning sensor configured to measure location. The attributes of product insertion may include the event location where the product was inserted, which is measured by the positioning sensor when the product insertion is detected by the detection sensor. With this configuration, by providing feedback that switches according to the event location where the product was inserted, it is possible to reduce the possibility of overlooking product insertion.

[0013] In the smart grip relating to the above aspect, determining the content of the feedback according to the attributes of product placement may include determining the content of the feedback so that the output feedback approaches complete content as the total number of areas to which the event location where the product is placed belongs approaches the target number. With this configuration, it is possible to stimulate purchasing intent by encouraging product placement toward complete feedback.

[0014] In the smart grip relating to the above aspect, the feedback module may be configured to output feedback through at least one of visual, auditory, and tactile means. With this configuration, by providing feedback through at least one of visual, auditory, and tactile means, it is expected that the possibility of overlooking product placement can be reduced.

[0015] The form of this disclosure is not limited to the smart grip described above. One aspect of this disclosure may be a component of a shopping basket. Another aspect of this disclosure may be the basket (including the cart) itself. Furthermore, one aspect of this disclosure may be an information processing method that implements all or part of the control device (computer) described above, or a program, or a machine-readable storage medium that stores such a program. Here, a machine-readable storage medium may be a non-temporary medium that stores information such as programs by electrical, magnetic, optical, mechanical, or chemical action. A non-temporary storage medium may include storage media (CDs, DVDs, semiconductor memory, etc.), auxiliary storage devices of a computer, external storage devices connected to a computer, etc.

[0016] For example, a shopping cart relating to one aspect of this disclosure may comprise a cart body, a detection sensor, a feedback module, and a control device. The detection sensor may be configured to detect when an item is placed into the cart body. The control device may be configured to respond to the detection of an item being placed into the cart by the detection sensor, determine the content of the feedback according to the attributes of the detected item being placed, and output the determined feedback to the user via the feedback module.

[0017] The shopping basket relating to the above aspect may be configured as a cart by further equipping it with one or more wheels. With this configuration, the possibility of overlooking an item when placing it in the cart is reduced. A reduction can be expected. [Effects of the Invention]

[0018] According to one aspect of the present disclosure, it is possible to expect a reduction in the possibility of overlooking the input of goods into the basket.

Brief Description of the Drawings

[0019] [Figure 1] FIG. 1 schematically shows an example of a scene to which the present disclosure is applied. [Figure 2] FIG. 2 schematically shows an example of an attribute (first attribute) of goods input. [Figure 3] FIG. 3 schematically shows an example of an attribute (second attribute) of goods input. [Figure 4] FIG. 4 schematically shows an example of an attribute (third attribute) of goods input. [Figure 5] FIG. 5 is a side view schematically showing an example of the structure of a smart grip. [Figure 6] FIG. 6 is a plan view schematically showing an example of the structure of a smart grip. [Figure 7] FIG. 7 is a plan view schematically showing another example of the structure of a smart grip. <000009​​​​​​​​​​​​​​​​​​​​​​​ [Modes for carrying out the invention]

[0020] Hereinafter, embodiments relating to one aspect of this disclosure will be described with reference to the drawings. However, the embodiments described below are merely illustrative in all respects of this disclosure. Various improvements or modifications may be made without departing from the scope of this disclosure. In implementing this disclosure, specific configurations may be adopted as appropriate depending on the embodiment. In this embodiment, the data appearing is described in natural language, but more specifically, it is specified in pseudo-language, commands, parameters, machine code, electrical signals, etc., that can be recognized by machines such as computers.

[0021] §1 Examples of Application Figure 1 schematically shows an example of a scenario to which this disclosure applies. The smart grip 1 according to this embodiment is configured to be usable as a handle for a basket B1. The smart grip 1 comprises a control device 11, a feedback module 13, and a detection sensor 14. The detection sensor 14 is configured to detect when goods 40 are placed into the basket B1. The control device 11 is configured to respond to the detection of goods 40 being placed into the basket B1 by the detection sensor 14 by determining the content of feedback 25 according to the attributes 20 of the detected goods 40 being placed, and to output the determined content of feedback 25 to the user TU via the feedback module 13.

[0022] According to this embodiment, in response to the detection of product 40 being placed in the basket by the detection sensor 14, feedback 25 corresponding to the attribute 20 of product 40 placement is provided. The provided feedback 25 allows the placement of product 40 to be communicated. Furthermore, by switching the provided feedback 25 according to the attribute 20 of placement, it is expected that cognitive lapses due to familiarity will be suppressed. Therefore, according to this embodiment, by providing such feedback 25 in response to the detection of product 40 placement, it is expected that the possibility of overlooking the placement of product 40 into basket B1 will be reduced. In addition, according to this embodiment, the presence of a reaction (feedback 25) to the placement of product 40 will change behavior. It can also be expected to act as a nudge to encourage behavior (for example, to stimulate purchasing intent).

[0023] [Basket] As shown in Figure 1, in a typical example, the basket B1 may be a shopping basket comprising a basket body B10 and a pair of handles B11. The configuration of the basket body B10 and each handle B11 may be determined as appropriate depending on the embodiment. For example, the basket body B10 may be configured to receive luggage TP from the upper end side by having an open upper end and a closed lower end that is the bottom surface. The basket body B10 may have any shape, such as a roughly rectangular parallelepiped or a roughly truncated square pyramid. The pair of handles B11 may be arranged separately along the longitudinal direction of the basket body B10. Each end of the handles B11 may be connected to each side of the basket body B10 in the short direction so that the handles B11 can rotate around an axis in the short direction. In this way, each handle B11 may be configured to change its angle by rotating at the connection point with the basket body B10 and to be gripped along the short direction. If basket B1 includes a basket body B10, then placing product 40 into basket body B10 may be equivalent to placing product 40 into basket B1.

[0024] The configuration of the basket B1 is not limited to the example in Figure 1 and may be modified as appropriate depending on the embodiment. For example, the number of handles B11 is not limited to two. There may be one handle or three or more. Furthermore, each end of one handle B11 may be connected to one side of the basket body B10 in the short direction in the longitudinal direction, and each end of the other handle B11 may be connected to the other side of the basket body B10 in the short direction in the longitudinal direction. In this way, each handle B11 may be configured to be gripped along the longitudinal direction.

[0025] Furthermore, the type of basket B1 is not limited to the example in Figure 1 and may be appropriately changed depending on the embodiment. The type of basket B1 is not particularly limited as long as it can be used to carry the goods 40 and may be appropriately selected depending on the embodiment. Basket B1 may include a cart equipped with one or more wheels. Basket B1 may include bags that can be used for shopping, such as plastic bags and paper bags. Basket B1 may also include devices that can hold items by hanging them, such as hangers. Known baskets may be used for basket B1.

[0026] [Must be usable as a basket handle] The ability to be used as a handle for a basket (basket B1, etc.) can be configured in any form in which the smart grip 1 is positioned as at least a part of the handle that is grasped by the user when carrying the product (product 40). In one example, the ability to be used as a handle for a basket can be configured by hanging the basket's handle portion (handle portion B11, etc.) on the smart grip 1, thereby replacing the existing handle provided on the basket. The basket's handle portion may include any component that can be hung on the smart grip 1, such as the handle portion of a bag or the hook of a hanger. In another example, the ability to be used as a handle for a basket can be configured by being attached to the basket's handle portion. In yet another example, the ability to be used as a handle for a basket can be configured by being attached to the basket body (basket body B10, etc.) as a handle portion. That is, the smart grip 1 may be configured as the basket's handle portion itself.

[0027] [Product / Store] Product 40 may include all kinds of items that are carried. Product 40 may also be called the target product. Smart Grip 1 may be used in any store. The store configuration is not particularly limited and may be determined as appropriate depending on the embodiment. The store may be either unmanned or manned. Sensors such as imaging devices and load sensors may or may not be installed in the store. If sensors are installed in the store, the sensors of Smart Grip 1 (detection sensor 14, etc.) and the sensors installed in the store The purchasing behavior of the target user may be monitored through this collaboration. Alternatively, Smart Grip 1 may monitor the purchasing behavior of the target user (User TU) independently of the sensors installed in the store (i.e., without collaborating with the store's sensors).

[0028] [Product launch] Placing a product (product 40) into a basket (basket B1) may include any method of carrying the product from the sales floor. As illustrated in Figure 1, in a typical example, placing a product into a basket may mean placing the product 40 into the basket body B10 of basket B1, which includes the smart grip 1. In addition, placing a product into a basket may include any action similar to placing a product into a basket, such as hanging the handle of the basket containing the product onto the smart grip 1. Hanging the handle of the basket containing the product may include hanging the handle of the plastic bag containing the product, or hanging the hook of the hanger from which the product is hanging, etc.

[0029] [feedback] The feedback 25 may consist of information from any modality. The feedback module 13 may be configured to transmit information in any modality. For example, the feedback module 13 may be configured to output feedback 25 in at least one of visual, auditory, and tactile senses. The feedback module 13 may consist of one or more arbitrary devices each capable of outputting feedback 25 in at least one of the modalities. For example, the feedback module 13 may include at least one of a tactile feedback module 30 and an output device 33.

[0030] The haptic feedback module 30 may be composed of any device capable of performing actions that generate physical motion such as vibration or contact. For example, the haptic feedback module 30 may be composed of actuators such as a servo motor or a vibration motor. The type of actuator may be arbitrarily selected. The haptic feedback module 30 may be composed of multiple types of actuators. For example, the haptic feedback module 30 may be composed of a servo motor, a vibration motor, or a combination thereof. In the smart grip 1, the haptic feedback module 30 may be appropriately placed in a location where motion can be transmitted to the part grasped by the user TU (for example, the internal space within the range that can be grasped by the user TU).

[0031] The output device 33 may include at least one of a display 331 (including indicator lights) and a speaker 333. If the output device 33 includes a display 331, it is preferable that the display 331 be positioned in a location where the output information can be seen while the user TU is holding the smart grip 1. This allows the user TU to check the information displayed on the display 331 while using the smart grip 1.

[0032] As described above, the feedback module 13 may be configured to output visual, auditory, and tactile feedback 25 by including at least one of the display 331, speaker 333, and haptic feedback module 30. According to one example of this embodiment, by providing visual, auditory, and tactile feedback 25, it is possible to reduce the possibility of overlooking the introduction of product 40.

[0033] Furthermore, the components of the feedback 25 for each modality may be appropriately selected depending on the embodiment, as long as information (input of product 40) can be transmitted. In one example, the visual feedback 25 may consist of an image. The image may include text, pictures, etc. The image may include the illumination of one or more indicator lights. The illumination may include flashing. In one example, auditory feedback may be provided. The feedback 25 may consist of sound. The sound may include simple sounds (such as beeps), music, voices, etc. For example, the tactile feedback 25 may consist of physical movement. The physical movement may include vibration, touch, etc.

[0034] The source of the feedback 25 may be determined as appropriate depending on the embodiment. In one example, the smart grip 1 may further include a storage unit 12. The storage unit 12 may store content data 121 that indicates the content of the feedback 25. The content data 121 may include, for example, sound data, image data, signal data, etc. The sound data may include voice data, music data, etc. The signal data may include data indicating the drive pattern of an actuator (motor, etc.). In one example, the content data 121 may be prepared in advance for each candidate feedback 25. The control device 11 may output the feedback 25 by playing back the content data 121 stored in the storage unit 12. The content data 121 may be played back as is, or it may be played back after modifications such as adjustment of attribute values.

[0035] The acquisition path for the content data 121 is not particularly limited and may be appropriately selected depending on the embodiment. In one example, the content data 121 may be pre-installed in the storage unit 12. In another example, the smart grip 1 may further include a communication module 16. The control device 11 may use the communication module 16 to acquire the content data 121 from an external computer OC via a network. That is, the content data 121 may be provided by the external computer OC. The content data 121 may be provided each time or provided all at once. The external computer OC is any computer other than the smart grip 1. The external computer OC may be, for example, a store terminal, a user terminal, a server device, etc.

[0036] Furthermore, the origin of feedback 25 is not limited to pre-prepared data (content data 121). In another example, the control device 11 may generate feedback 25 by performing arithmetic processing. That is, determining the content of feedback 25 may include generating feedback 25. Performing arithmetic processing may include using generative models such as variational autoencoders, generative adversarial networks, diffusion models, and large-scale models. Large-scale models include, for example, large-scale language models (LLM) and large-scale vision language models (VLM). This is acceptable. Furthermore, performing calculation processing may include using application programs such as a speech synthesis engine. The control device 11 may output the feedback 25 generated as a result of the calculation processing to the user TU. Note that the calculation processing that generates the feedback 25 does not necessarily have to be performed on the smart grip 1 (control device 11). In another example, the calculation processing that generates the feedback 25 may be performed on an external computer OC. In this case, the control device 11 may acquire the generated data from the external computer OC via the network. The control device 11 may output the feedback 25 by playing back the acquired data. If the feedback 25 is generated each time, the content data 121 may be omitted.

[0037] In one example, all processing to determine the content of feedback 25 may be performed within the control device 11. In another example, as in the above example, where content data 121 is provided by an external computer OC, and the external computer OC performs calculation processing to generate feedback 25, at least part of the processing to determine the content of feedback 25 may be performed by the external computer OC. In this case, determining the content of feedback 25 may include requesting the external computer OC to determine the content of feedback 25 via the network. In response to this request, the external computer OC may determine the content of feedback 25 and return the determined result to the control device 11. Your device 11 may obtain the contents of the feedback 25 upon receiving this reply.

[0038] [Determine the content of the feedback based on the attributes of the input.] Determining the content of feedback (feedback 25) according to the input attributes (attribute 20) can be equivalent to switching the output feedback according to the input attributes. If the output feedback switches once or more according to the input attributes, it can be interpreted that the content of the feedback has been determined according to the input attributes. A switch in feedback may occur if at least a part of the content differs between at least two of several feedbacks output at different points in time. In cases where there is some overlap in content between two feedbacks but they do not completely match, it can be interpreted that at least a part of the content of the feedback differs (i.e., the feedback has switched). For example, feedback that presents a part of the content described later may be interpreted as different from feedback that presents the entire content. That is, even if the content is the same, feedback that presents a part of it and feedback that presents the entire content may be interpreted as different from each other. Therefore, expanding the scope of the output content according to the input attributes (bringing the output feedback closer to the complete content) can be interpreted as the feedback switching.

[0039] The correspondence between the input attribute 20 and the content of the feedback 25 may be defined as appropriate depending on the embodiment. Determining the content of the feedback 25 may consist of, for example, determining the attribute value of the feedback 25, determining the output time of the feedback 25, and selecting one or more feedback 25 to be used from among multiple candidates. Determining the attribute value may include adjusting the attribute value from a default value. If content data 121 is provided, the attribute value specified in the content data 121 may be an example of a default value. The attributes to which the value is to be determined may be selected as appropriate for each modality. For example, if the feedback 25 includes an image, the attributes to which the value is to be determined may include image attributes such as text content, color attributes (hue, brightness, saturation, etc.), and display patterns (including indicator light lighting patterns). If the feedback 25 includes sound, the attributes to which the value is to be determined may include sound attributes such as sound content, volume (intensity), pitch (sound level), timbre, and number of plays. If the feedback 25 includes physical motion (vibration, contact, etc.), the attributes used to determine the value may include motion attributes such as the number of motions, intensity, period, direction, and pattern. The output time of the feedback 25 may include the image display time, sound playback time, motion playback time, etc.

[0040] [Attributes of input] The attributes 20 of product 40 placement may include all kinds of features that characterize the act of placing product 40, such as the number of product 40 placed in basket B1, the location where product 40 was placed, and the characteristics derived from the placed product 40. For example, characteristics derived from product 40 may include the identification information and type of product 40. Characteristics derived from product 40 may also include the external characteristics and physical characteristics of product 40. External characteristics may include the design (package design, etc.), shape, color, etc. of product 40. Physical characteristics may include weight, etc. In one example, the attributes 20 of product 40 placement may include at least one of the following first to third attributes.

[0041] (1) First attribute Figure 2 schematically shows an example of the attribute 20 (first attribute) of product 40. In this example, the attribute 20 of product 40 may include the number of products 40 that were put in, 201 (quantity).

[0042] The correspondence between the number of items 40 inserted (201) and the content of the feedback 25 may be defined as appropriate depending on the embodiment. For example, outputting feedback 25 corresponding to the number of items 40 inserted (201) means playing a sound a number of times corresponding to the number 201. This may include notifying the number 201 with at least one of an image and sound, outputting at least one of an image and sound of content selected according to the number 201, generating motion a number of times corresponding to the number 201, generating motion with at least one of an intensity and period corresponding to the number 201, etc. Outputting at least one of an image and sound of content selected according to the number 201 may include outputting target information when the number 201 reaches the target number, and outputting information other than target information before the number 201 reaches the target number. For example, outputting target information may include outputting coupon information. Outputting information other than target information may include notifying the remaining number of items to be put in until coupon information is output (i.e., the target number is reached). According to one example of this embodiment, by providing feedback 25 that switches according to the number 201 of the put-in product 40, it is possible to reduce the possibility of overlooking the put-in of product 40.

[0043] (Output format according to progress) Furthermore, in one example, if the input attribute 20 includes the number of products 40 input (201), determining the content of the feedback 25 according to the input attribute 20 of product 40 may include determining the content of the feedback 25 such that as the number of products 40 input (201, total number) approaches the target number, the output feedback 25 approaches the complete content 255. When adopting this progress-dependent output format for feedback 25, in the initial stage when product 40 input begins, the control device 11 may decide to present only a portion of the content of the feedback 25. The control device 11 may output feedback 25 that presents a portion of the determined content. Subsequently, each time product 40 input is detected, the control device 11 may expand the range presented in the content of the feedback 25. That is, each time the number of products 40 input (number 201) increases, the content of the output feedback 25 may be supplemented. Finally, in the last stage when the target number is reached, the control device 11 may decide to present the entire content of the feedback 25. In response, the control device 11 may output a feedback 25 that presents the entire content (complete content 255).

[0044] In the example shown in Figure 2, the complete content 255 is "Do Re Mi Fa Sol La Ti Do," and the target number is "4 times (4 items)." The complete content 255 and the target number are not limited to this example and may be determined as appropriate depending on the embodiment. The target number may be a fixed value or a variable value. The target number may be determined from the user TU's past purchase history, for example, the average number of items purchased per shopping trip (actual value). Also, a part of the content presented in the initial stage (initial value) is "Do Re," and the amount of compensation per input of product 40 (1 product input) is a fixed value of 2 tones. The initial value and compensation amount are also not limited to this example and may be determined as appropriate depending on the embodiment. The amount of compensation per input may be a fixed value or a variable value. A part of the content presented in the initial stage (initial value) may be appropriately selected from the content of the feedback 25 used. For example, if the feedback 25 consists of content with a time series, such as sound (example in Figure 2) or physical motion, then some of the content presented in the initial stage may be a portion of the beginning of the time series. However, some of the content presented in the initial stage is not limited to this example and may be determined as appropriate depending on the embodiment.

[0045] In one example, the feedback 25 output in this format may consist of at least one of an image, sound, and physical motion. Figure 2 illustrates a scenario where the feedback 25 in this format consists of sound. As mentioned above, the sound may include simple sounds, music, voice, etc. If the feedback 25 includes an image, the image may also include coupon information. This allows coupon information to be provided to the user TU when the number of products 40 introduced reaches the target number. The coupon information includes information indicating a discount on the products. The products eligible for the discount through the coupon information may be arbitrarily selected. The products eligible for the discount may include at least a portion of the introduced products 40, or products other than the introduced products 40. It may also be any other product. According to one example of this embodiment, by encouraging the introduction of product 40 in response to complete content feedback 255, it is possible to stimulate purchasing intent.

[0046] In the example above, the content of feedback 25 is gradually filled in, so that feedback 25 approaches the complete content 255. However, the output format that brings the content of feedback 25 closer to the complete content 255 is not limited to this example and may include any format that transitions from an incomplete state to a complete state. Making it incomplete may include limiting the playback range as described above, blurring, adding obstructions (noise, objects, etc.), etc.

[0047] In another example, if the feedback 25 includes an image (hereinafter also referred to as the "target image"), the control device 11 may blur the target image by image processing such as blurring the focus or applying a mosaic effect during the initial stages of product 40 input. The control device 11 may output the resulting blurred target image as feedback 25. Each time product 40 is input, the control device 11 may reduce the degree of blurring of the target image. Then, when the number of input products 40 (201) reaches the target number, the control device 11 may output the target image before the blurring process was applied (i.e., the original image) as feedback 25.

[0048] In another example, if the feedback 25 includes the target image, in the initial stages of introducing the product 40, the control device 11 may overlay an object on top of the target image, thereby obscuring at least a portion of the target image with the object. The control device 11 may output the resulting target image as feedback 25. The object may be arbitrarily selected. For example, the object may include the silhouette of some character. Each time product 40 is introduced, the control device 11 may narrow the area of ​​the target image obscured by the object by methods such as reducing the size of the object without decreasing the number of objects. Then, when the number of introduced products 40 201 reaches the target number, the control device 11 may output the target image that is not obscured by the object as feedback 25.

[0049] In another example, in the initial stages of introducing product 40, the control device 11 may add noise to the content of the feedback 25. The control device 11 may output the feedback 25 with this added noise. The noise may be added in any way. Each time product 40 is introduced, the control device 11 may reduce the amount of noise added to the feedback 25 by narrowing the range to which the noise is added or reducing the intensity of the added noise. Then, when the number of introduced products 40 (201) reaches the target number, the control device 11 may output the feedback 25 without added noise.

[0050] (Count of items) The number of items 40 (201) that have been inserted may be counted as appropriate. For example, the control device 11 may increment the number of items 40 (201) by one each time the detection sensor 14 detects the insertion of an item 40. The control device 11 may continue to count the number of items 40 (201) indefinitely. Alternatively, the control device 11 may reset the count of the number of items 40 (201) at any time. For example, the control device 11 may reset the count of the number of items 40 (201) when the number of items 40 (201) reaches the upper limit. The upper limit may be arbitrarily defined. Also, for example, the smart grip 1 may be further equipped with an input device. The control device 11 may reset the count of the number of items 40 (201) in response to the operation of the input device by the user TU. Also, for example, the control device 11 may reset the count of the number of items 40 (201) in response to the occurrence of an event such as entering or leaving a store. Whether or not an event has occurred may be determined as appropriate depending on the embodiment. For example, before the user starts using Smart Grip 1 inside the store (for example, upon entering the store), the control device 11 will... The TU may perform authentication processing. The authentication method is not particularly limited and may be appropriately selected depending on the embodiment. Known methods may be used for authentication. The authentication processing may be performed by the smart grip 1 (control device 11) alone, or it may be performed in cooperation with an external computer (store terminal, user terminal, server device, etc.). The control device 11 may reset the count of the number of products 40 (201) in response to the successful completion of this authentication processing. In addition, for example, the smart grip 1 may further be equipped with a positioning sensor 15 configured to measure location. The control device 11 may detect the occurrence of events such as entering or leaving a store in response to the location measurement result from the positioning sensor 15. The control device 11 may reset the count of the number of products 40 (201) in response to the detection of the occurrence of an event.

[0051] In one example, the control device 11 may count the number of items 40 placed in basket B1, 201 in total, without distinguishing between items displayed in the store. The control device 11 may output feedback 25 corresponding to the counted number 201, without distinguishing between items. According to this example, feedback 25 can be provided according to the total number of items 40 (number 201) placed in basket B1. This makes it possible to monitor the placement of items into basket B1 without distinguishing between items.

[0052] In another example, the control device 11 may count only specific items that meet predetermined conditions among the items placed in basket B1. The control device 11 may output feedback 25 corresponding to the count of specific items. According to this example, feedback 25 corresponding to the number of specific items can be provided. This makes it possible to focus on specific items and monitor their placement into basket B1.

[0053] The specified conditions may be arbitrarily defined. For example, a list of designated products may be provided by the user TU or the store. The designated products may be determined for any purpose. For example, if provided by the user TU, the list may be a shopping list showing products intended for purchase. Products intended for purchase are an example of designated products. The shopping list may be generated as appropriate.

[0054] The specified conditions may include the fact that the added product 40 belongs to the list as a designated product. In this example, the designated product is an example of a specific product. That is, if the added product belongs to the list, the control device 11 may count the product (product 40) and output feedback (feedback 25) according to the number of counted products (number 201). On the other hand, if the added product does not belong to the list, the control device 11 may omit counting the product. In this case, the control device 11 may also omit outputting feedback according to the number of products. According to this example, it is possible to monitor the placement of designated products into basket B1. For example, if a shopping list is given as the list of designated products, it is possible to monitor the placement of products intended for purchase into basket B1.

[0055] Alternatively, the specified conditions may include the case where the added product 40 does not belong to the list as a designated product. In this example, a product other than the designated product is an example of a specific product. That is, if the added product does not belong to the list, the control device 11 may count that product (product 40) and output feedback (feedback 25) according to the number of counted products (number 201). On the other hand, if the added product belongs to the list, the control device 11 may omit counting that product. In this case, the control device 11 may also omit outputting feedback according to the number of products. According to this example, it is possible to monitor the addition of products other than designated products to basket B1. For example, if a shopping list is provided as the list of designated products, it is possible to monitor the addition of products other than those intended for purchase to basket B1.

[0056] Whether or not an inserted product belongs to the list can be determined by any method. For example, the control device 11 may obtain the identification result of the inserted product (product 40). The control device 11 may determine whether or not the inserted product belongs to the list by comparing the obtained identification result with the list. The inserted product can be identified by any method. A known method may be used for product identification. Any sensor may be used for product identification. The detection sensor 14 may be used for product identification, or a sensor other than the detection sensor 14 may be used. The product identification method may be appropriately selected depending on the sensor used.

[0057] In one example, the smart grip 1 may further include an imaging device 17. The imaging device 17 may be positioned appropriately so as to capture the product being placed in the basket B1 (basket body B10) when the product is placed in the basket. For example, the imaging device 17 may be positioned so that the basket B1 (basket body B10, etc.) is within its imaging range. The type of imaging device 17 is not particularly limited as long as it can generate an image in which the product can be identified, and may be appropriately selected depending on the embodiment. The imaging device 17 may include any sensor that acquires data in the form of an image or image representation, such as an RGB camera, depth sensor, infrared sensor, radar, LiDAR (light detection and ranging), etc.

[0058] The control device 11 may acquire an image captured by the imaging device 17 when it detects the insertion of a product using the detection sensor 14. The timing of imaging (generation of captured images) by the imaging device 17 may be appropriately defined depending on the embodiment. In one example, if the imaging device 17 is positioned to capture images of a product after it has been detected being inserted, the control device 11 may activate the imaging device 17 in response to the detection of product insertion by the detection sensor 14 and control the operation of the imaging device 17 to capture images of the inserted product. The control device 11 may control the imaging device 17 to capture images of the product at any timing after detecting product insertion. For example, the control device 11 may control the imaging device 17 to capture images of the product immediately after detecting product insertion. The control device 11 may appropriately acquire one or more captured images generated by this imaging from the imaging device 17. After generating one or more captured images, the control device 11 may stop the operation of the imaging device 17 or switch to a standby state. According to this example, the period during which the imaging device 17 is activated can be narrowed, and a reduction in processing load and power consumption in the smart grip 1 can be expected. In another example, the imaging device 17 may be controlled to continuously generate captured images. The generated captured images may be stored in a storage area such as the memory unit 12 for at least a certain period of time. Captured images generated at or around the time the detection sensor 14 detects the insertion of a product are likely to show the inserted product. Therefore, the control device 11 may acquire one or more captured images from the captured images stored in the storage area that were generated at or around the time the detection sensor 14 detected the insertion of a product.

[0059] After acquiring an image, the control device 11 may identify the product in the image by performing image analysis on the acquired image. The identification method by image analysis may be determined as appropriate depending on the embodiment. In one example, if a code generated by encoding product identification information is assigned to the product, analyzing the image may include decoding the code assigned to the product. The type of code may be arbitrarily selected. The code may be, for example, a one-dimensional code, a two-dimensional code, etc. In another example, the control device 11 may identify the product based on its characteristics (appearance, etc.) rather than the code during image analysis.

[0060] The image analysis method is not particularly limited and may be appropriately selected depending on the embodiment. In one example, the control device 11 may analyze the captured image using general image analysis techniques such as edge detection and pattern matching. In another example, the control device 11 may analyze the captured image using a trained machine learning model that has acquired the ability to analyze images. The machine learning model is configured to include one or more computational parameters that can be adjusted by machine learning. One or more computational parameters are used for the calculation of the desired inference (such as image analysis). The machine learning model may consist of, for example, a neural network, a support vector machine, or other functional equations (computational models). The machine learning method may be appropriately selected depending on the machine learning model adopted (for example, backpropagation). Training a machine learning model involves adjusting (optimizing) the values ​​of the computational parameters using training samples. The machine learning model may be appropriately trained to derive the true value of the corresponding analysis result when given images of training samples. Large-scale models such as large-scale visual language models may be used as the trained machine learning model.

[0061] The process of identifying products does not necessarily have to be performed on Smart Grip 1. The process of identifying products may be performed on a computer other than Smart Grip 1. Other computers may include, for example, external computers such as store terminals, user terminals, and server devices. Other computers may identify products in any way they like. For example, another computer may obtain information about the observation results of products from Smart Grip 1. Information about the observation results of products may include, for example, sensing data such as the captured images. Other computers may identify products based on the acquired information. Other computers may identify products in the same way as Smart Grip 1. In another example, another computer may not obtain information from Smart Grip 1, but instead obtain sensing data from sensors (one or more sensors) installed in the store, and identify products based on the acquired sensing data. The sensors used may be selected arbitrarily. For example, the sensors may include an imaging device installed so that the product shelves are included in the imaging range. In this case, other computers may identify the products that have been placed in the store by performing image analysis on the captured images obtained by the imaging device. Furthermore, for example, the sensor may include a load sensor (weight sensor) installed to measure the weight of products displayed on a shelf. In this case, another computer may identify the product that has been placed in the store by identifying the shelf where the weight has changed (decreased) based on the measurement data from the load sensor. The control device 11 may, as appropriate, obtain the identification result of the placed product from the other computer and determine whether or not the placed product belongs to the list based on the obtained identification result.

[0062] Similarly, at least one of the processes for determining whether an inserted product belongs to the list and counting the number of products 40 (201) does not necessarily have to be performed on Smart Grip 1. These processes may also be performed on a computer other than Smart Grip 1. The control device 11 may obtain the result of determining whether an inserted product belongs to the list or the result of counting the number of products 40 (201) from the other computer as appropriate.

[0063] (2)Second attribute Figure 3 schematically shows an example of the attributes 20 (second attribute) of product 40. In this example, the attributes 20 of product 40 may include at least one of the identification information 203 and type 205 of the product 40 that was put into the input.

[0064] Identification information 203 indicates information (such as an identifier) ​​for identifying product 40. Category 205 indicates a category for classifying product 40. Identification information 203 and category 205 may be obtained from the input product 40 as appropriate. In one example, the control device 11 may obtain at least one of identification information 203 and category 205 from the identification result of product 40. Identification of product 40 may be performed by any method. For example, as described above, the method of identifying product 40 may be the method using the detection sensor 14 and the imaging device 17. The control device 11 may also obtain the identification result of product 40 from another computer.

[0065] The correspondence between the identification information 203 / type 205 of product 40 and the content of the feedback 25 may be defined as appropriate depending on the embodiment. As a specific example, the identification of the product 40 that has been put in Outputting feedback 25 corresponding to at least one of the information 203 and type 205 may include notifying at least one of the name and description of the product 40 in at least one of the image and sound, notifying information related to the product 40 in at least one of the image and sound, generating motion in a driving pattern corresponding to at least one of the identification information 203 and type 205, and so on.

[0066] Information related to product 40 may include all information about product 40 and other products that may be related to product 40 (related products). Related products may include, for example, products displayed around product 40 in stores, products likely to be purchased together with product 40, products used together with product 40, and products recommended to users who purchase product 40. In one example, information related to product 40 may include at least one of advertising information, coupon information, and attribute information for at least one of product 40 and related products. Attribute information may include expiration date, release date, allergy information, reviews, etc. According to one example of this embodiment, by providing feedback 25 that switches according to at least one of the identification information 203 and type 205 of product 40, it is possible to reduce the possibility of overlooking the introduction of product 40.

[0067] The identification information 203 and type 205 of product 40 are examples of features derived from product 40. The features derived from product 40 used to determine the content of feedback 25 are not limited to the identification information 203 and type 205. In another example, the input attribute 20 of product 40 may include at least one of the external features and physical features of the input product 40. The external features and physical features may be obtained from product 40 as appropriate. For example, external features may be obtained from the results of image analysis on the captured image obtained by the imaging device 17. Also, for example, if the detection sensor 14 includes a load sensor, the weight of product 40 may be measured by the load sensor, and the measurement result of that weight may be obtained as an example of a physical feature.

[0068] The correspondence between the external / physical characteristics of product 40 and the content of feedback 25 may be defined as appropriate depending on the embodiment. For example, feedback 25 corresponding to at least one of the external and physical characteristics of the introduced product 40 may include notifying at least one of the external and physical characteristics of product 40 with at least one of an image and sound, and generating motion with attribute values ​​corresponding to at least one of the external and physical characteristics. Notifying of external characteristics may include notifying a message about external characteristics such as, "A white, square object has been introduced." Similarly, notifying of physical characteristics may include notifying a message about physical characteristics such as, "A heavy object has been introduced," or "It's light."

[0069] (3) Third attribute Figure 4 schematically shows an example of the attribute 20 (third attribute) of product 40 being placed in the basket. In one example, the smart grip 1 may further include a positioning sensor 15 configured to measure its location. The attribute 20 of product 40 being placed in the basket is the event position 207 measured by the positioning sensor 15 when the detection sensor 14 detects the placement of product 40, and may include the event position 207 where product 40 was placed. The event position 207 may correspond to the current position of the user TU when product 40 was placed in basket B1. In one example, in response to the detection sensor 14 detecting the placement of product 40, the event position 207 may be measured in real time by the positioning sensor 15.

[0070] The correspondence between the event location 207 to which product 40 is introduced and the content of the feedback 25 may be defined as appropriate depending on the embodiment. Specifically, outputting feedback 25 corresponding to event location 207 means notifying at least one of event location 207 and the area to which event location 207 belongs with at least one of image and sound, and selecting according to at least one of event location 207 and the area to which event location 207 belongs This may include outputting at least one of an image and sound of the content, and generating motion in a drive pattern corresponding to at least one of the event location 207 and the area to which the event location 207 belongs. This may also include outputting at least one of an image and sound of content selected according to the area to which the event location 207 belongs, for example, outputting first coupon information in the first area and second coupon information in the second area, or outputting coupon information selected according to the area to which the event location 207 belongs. In this example, an area in which no coupon information is output may be set among the multiple areas. According to this example, by providing feedback 25 that switches according to the event location 207 of the product 40, it is possible to reduce the possibility of overlooking the product 40 being put into service.

[0071] The area to which event location 207 belongs may be determined by any method. For example, the area within a store may be divided into multiple areas. Each area may be set arbitrarily. For example, each area may be set according to the division of sales areas such as vegetables, fruits, fish, meat, and daily necessities. Of the multiple areas set, two adjacent areas may overlap at least partially, or they may not overlap at all. Also, two adjacent areas may be placed adjacent to each other, or they may be placed at least partially apart. Within the area of ​​the store, there may be areas that are not set as areas. Area information 123 indicating the definition of each area set within the store may be stored in any memory area.

[0072] The source of area information 123 may be determined as appropriate depending on the embodiment. In one example, the smart grip 1 may further include a storage unit 12. The area information 123 may be pre-installed in the storage unit 12. In another example, the smart grip 1 may further include a communication module 16. The area information 123 may be stored in an external computer. The smart grip 1 may use the communication module 16 to obtain the area information 123 from the external computer via a network. The external computer is any computer other than the smart grip 1. Similar to the external computer OC described above, the external computer may be, for example, a store terminal, a user terminal, a server device, etc.

[0073] The control device 11 may determine which of the multiple areas set up within the store the event location 207 belongs to by referring to the area information 123. Note that, similar to the process for identifying the product, the process for determining which area the event location 207 belongs to does not necessarily have to be performed on the smart grip 1. The process for determining which area the event location 207 belongs to may also be performed on a computer other than the smart grip 1. For example, the control device 11 may request another computer to perform the process of determining which area the event location 207 belongs to by transmitting the event location 207 measured by the positioning sensor 15. The other computer may respond to this request by determining which area the event location 207 belongs to. The other computer may then return the result of the determination of the area to which the event location 207 belongs to to the control device 11. The control device 11 may receive this and obtain the result of the determination of the area to which the event location 207 belongs.

[0074] (Output format according to progress) Furthermore, in one example, if the input attribute 20 includes the event location 207 where product 40 was input, determining the content of the feedback 25 according to the input attribute 20 of product 40 may include determining the content of the feedback 25 such that as the total number of areas to which the event location 207 where product 40 was input belongs approaches the target number, the output feedback 25 approaches the complete content 255. The configuration of this output format may be the same as the configuration of the output format based on the number of products 40 201 described above, except that the indicator for evaluating progress is replaced from the number of products 40 201 to the total number of areas.

[0075] The total number of areas to which event location 207 belongs may be counted in any way. In a pure example, one area may be counted only once. That is, if multiple event locations 207 belong to the same area, the total number of areas may be counted as 1. However, the method of counting the total number of areas is not limited to this example. At least one of the multiple areas set up in the store may be counted two or more times. Each area may be given an upper limit on the number of counts. According to this example, it is possible to encourage the introduction of products 40 toward the feedback 25 of the complete content 255. In particular, it is possible to encourage the introduction of products 40 in multiple areas. This can be expected to stimulate purchasing intent.

[0076] (4) Others The information used to determine the content of the feedback 25 is not limited to the attributes 20 of the product 40. In another example, the control device 11 may use any additional information other than the attributes 20 of the product 40 to determine the content of the feedback 25. For example, determining the content of the feedback 25 according to the attributes 20 of the product 40 may be done by determining the content of the feedback 25 according to the attributes 20 of the product 40 and reference information 125. The reference information 125 may include at least one of the user TU's attribute information and environmental information about the environment surrounding the user TU. The attribute information may include, for example, gender, age, family structure, etc. The environmental information may include, for example, weather, temperature, humidity, etc. According to one example of this embodiment, it can be expected that feedback 25 will be provided that is suitable for at least one of the user TU's attributes and environment, such as outputting child-friendly feedback if the user TU's family structure includes children.

[0077] §2 Example Configuration [Hardware configuration] As shown in Figure 1, the smart grip 1 includes a computer to which a control device 11, a memory unit 12, a feedback module 13, a detection sensor 14, a positioning sensor 15, a communication module 16, and an imaging device 17 are electrically connected. In the smart grip 1, at least a part of this computer may be housed in a box.

[0078] The control device 11 is configured to perform information processing based on a program and various data, including a processor P. The processor P is a hardware processor and is an example of a processor resource. The type of processor P may be appropriately selected depending on the embodiment. For example, the processor P may be a CPU (Central Processing Unit), a microcontroller, etc. It may consist of a cross-processor, FPGA (field-programmable gate array), DSP (digital signal processor), GPU (graphics processing unit), ASIC (application-specific integrated circuit), etc.

[0079] The storage unit 12 may consist of a hard disk drive, a solid-state drive, a semiconductor memory, etc. The storage unit 12 is an example of a memory resource. In this embodiment, the storage unit 12 stores various information such as a program 81, content data 121, area information 123, and reference information 125. The program 81 is a program that causes the control device 11 to perform information processing (Figure 9, described later) regarding the output of feedback 25 according to the input attribute 20. The program 81 includes a series of instructions for said information processing. At least one of the content data 121, area information 123, and reference information 125 may be omitted. At least one of the content data 121, area information 123, and reference information 125 may be held independently of the program 81 or may be included within the program 81.

[0080] At least one of the program 81, content data 121, area information 123, and reference information 125 is stored in the storage medium SR1 in place of or together with the storage unit 12. It is permissible to do so. The storage medium SR1 is configured to store various types of information (stored programs, etc.) by electrical, magnetic, optical, mechanical, or chemical means so that a machine such as a computer can read the information. The storage unit 12 and the storage medium SR1 are examples of non-temporary storage media. The Smart Grip 1 (computer) may obtain at least one of the program 81, content data 121, area information 123, and reference information 125 from the storage medium SR1. The storage medium SR1 may be a disk-type storage medium (CD, DVD, etc.) or a non-disk-type storage medium such as semiconductor memory (flash memory, etc.). Any drive device may be used to read the information stored in the storage medium SR1. The type of drive device may be selected according to the storage medium SR1.

[0081] The detection sensor 14 is configured to detect when product 40 is placed into basket B1. The type of detection sensor 14 is not particularly limited, as long as it can detect when product 40 is placed in basket B1, and can be appropriately selected depending on the embodiment. For example, the detection sensor 14 may consist of one or more load sensors (weight sensors). In this case, the detection sensor 14 can detect when product 40 is placed in basket B1 by detecting the change (increase) in weight caused by the placement of product 40. The detection sensor 14 may be placed in any location where a change in load occurs due to the placement of product 40 (i.e., where the change in weight due to the placement of product 40 can be observed).

[0082] Furthermore, for example, the detection sensor 14 may be composed of one or more imaging devices. The imaging devices include RGB cameras, depth sensors, infrared sensors, radar, LiDAR, etc., which capture images or image representations. The system may include any sensors that acquire data. In this case, the detection sensor 14 may be the same as the imaging device 17, or it may be provided separately from the imaging device 17. The detection sensor 14 can detect the placement of the product 40 by capturing the product 40 in the image captured by the imaging device. The detection sensor 14 may be placed at any location where the product 40 is within the imaging range at least at one of the following times: from when the user picks up the product 40 until they place it in the basket B1, and after it has been placed in the basket B1. When reducing the processing load and power consumption by limiting the period during which the imaging device 17 is activated as described above, it is preferable to use a different type of sensor for the detection sensor 14 that has a lower processing load and power consumption than the imaging device 17.

[0083] Furthermore, for example, the detection sensor 14 may be composed of one or more contact sensors. In this case, the detection sensor 14 can detect the insertion of the product 40 when it comes into contact with the product being inserted or with other objects (such as a switch member) that have been displaced by the insertion of the product 40. The detection sensor 14 may be placed at any location where the inserted product 40 comes into direct or indirect contact with it. Indirect contact may include contact with other objects that have been displaced by the insertion of the product 40. The detection sensor 14 may be composed of multiple types of sensors.

[0084] The positioning sensor 15 is configured to measure position. The type of positioning sensor 15 is not particularly limited as long as it can measure position, and may be appropriately selected depending on the embodiment. For example, the positioning sensor 15 may consist of a GPS (Global Positioning System) sensor, a GNSS (Global Navigation Satellite System) sensor, etc. Also, for example, The positioning sensor 15 may consist of a beacon receiver. In this case, multiple beacon transmitters may be installed in the store. The position of the smart grip 1 may be appropriately measured (estimated) from the strength of the beacon signal received by the positioning sensor 15 (beacon receiver). For example, the positioning sensor 15 may estimate the distance to each beacon transmitter according to the strength of the signal received by the beacon receiver. The positioning sensor 15 may measure the position of the smart grip 1 from the estimated distance to each beacon transmitter by triangulation. At least a part of this position measurement process may be performed in the control device 11.

[0085] The communication module 16 is configured to perform wired or wireless communication over a network. The communication module 16 may consist of, for example, a wired LAN (Local Area Network) module, a wireless LAN module, etc. The communication module 16 may also include a proximity wireless communication module. The network standard is not particularly limited and may be appropriately selected depending on the embodiment. For example, the type of network may be appropriately selected from the Internet, wireless communication network, mobile communication network, telephone network, dedicated network, etc. The smart grip 1 (control device 11) can perform data exchange with other computers (for example, external computer OC, etc.) via the communication module 16.

[0086] Regarding the specific hardware configuration of the Smart Grip 1 (computer), components can be omitted, replaced, and added as appropriate depending on the embodiment. For example, the control device 11 may include multiple hardware processors (processor P). At least one of the positioning sensor 15, communication module 16, and imaging device 17 may be omitted. At least one of the program 81, content data 121, area information 123, and reference information 125 may be stored in an external storage device such as a NAS (Network Attached Storage). An external storage device is also an example of a non-temporary storage medium. The Smart Grip 1 may be configured to be operable by further including an input device. The input device may be configured to accept information input. The input device may consist of, for example, a keyboard, touch panel, operator, microphone, etc. If the input device includes a microphone, the operation of the input device may include voice input. If the feedback module 13 includes an output device 33, the input device and output device 33 may be integrally configured by a touch panel display, etc. The Smart Grip 1 may include multiple computers. The hardware configurations of each computer may or may not match. Furthermore, the computers included in Smart Grip 1 may be specially designed computers as well as general-purpose PCs (Personal It consists of computers, tablet PCs, terminal devices (including smartphones), etc. That's fine. For example, the computer included in Smart Grip 1 may be comprised of a smartphone. Smart Grip 1 may be constructed by mounting a smartphone in a housing (attachment).

[0087] [Structure of Smart Grip] Figures 5 and 6 are schematic side and top views showing an example of the structure of the smart grip 1 according to this embodiment. In one example, the smart grip 1 may further include a housing 90 that houses a detection sensor 14, a feedback module 13, and a control device 11. The housing 90 may be provided with one or more grooves (grooves 915, grooves 935, etc.) for hooking the handle portion B11 provided on the basket B1. According to this example, a smart grip 1 that can be used as a basket handle can be provided by replacing the existing basket handle portion (handle portion B11).

[0088] The structure of the smart grip 1, including the shape of the housing 90, the size of the housing 90, the arrangement of each component (control device 11, etc.) within the housing 90, the number of grooves, the shape of the grooves, and the arrangement of the grooves, may be appropriately determined according to the embodiment. In the example shown in Figures 5 and 6, it is assumed that the feedback module 13 is equipped with a vibration motor 300 and a servo motor 305 as a tactile feedback module 30. It is assumed that the feedback module 13 further includes a display 331 and a speaker 333. It is assumed that the detection sensor 14 is composed of a pair of load sensors 140, and the imaging device 17 is provided separately from the detection sensor 14. It is assumed that the housing 90 is equipped with a pair of grooves (915, 935).

[0089] For the sake of explanation, the left-right direction in Figures 5 and 6 will be referred to as the "front-back direction" below. The left direction in Figures 5 and 6 will be referred to as the "front direction," and the right direction in Figures 5 and 6 will be referred to as the "back direction." The direction perpendicular to the plane of the paper in Figure 5 and the up-down direction in Figure 6 will be referred to as the "left-right direction." The top of Figure 6 The direction to the right is referred to as the "right direction," and the downward direction in Figure 6 is referred to as the "left direction." The vertical direction in Figure 5 and the direction perpendicular to the plane of the paper in Figure 6 are referred to as the "upward direction." The upward direction in Figure 5 is referred to as the "upward direction," and the downward direction in Figure 5 is referred to as the "downward direction."

[0090] In one example, the housing 90 may comprise a first part 91, a second part 92, and a third part 93. In the example shown in each figure, the first part 91, the second part 92, and the third part 93 are arranged in a line in the front-to-back direction from rear to front. Each part (91, 92, 93) is formed in the shape of a rectangular parallelepiped. The first part 91 and the third part 93 may have substantially the same shape. The width (length in the left-to-right direction) of the second part 92 may be shorter than that of the first part 91 and the third part 93. This allows the second part 92 to constitute the part that the user grasps. In the example shown in each figure, the second part 92 extends along the front-to-back direction. Therefore, the user can hold the smart grip 1 by grasping the second part 92 with their hand along the front-to-back direction. The total length of the circumference of the second part 92 around the front-to-back axis may be determined within a range of a length that can be grasped by hand.

[0091] Side walls may be provided at the horizontal (left-right and front-back) ends of each section (91, 92, 93). A bottom surface may also be provided at the lower end of each section (91, 92, 93). This allows each section (91, 92, 93) to have an internal space enclosed by its side walls, which houses the computer portion of the Smart Grip 1. The internal spaces of the first section 91 and the second section 92 may be at least partially continuous. The internal spaces of the second section 92 and the third section 93 may also be at least partially continuous. The upper ends of each section (91, 92, 93) may be closed with a lid or the like, or they may be open.

[0092] A groove 915 may be provided on the rear end side of the first portion 91. In the example shown in each figure, the groove 915 is formed by recesses provided on the left-right opposing side walls of the first portion 91. Each recess is rectangular in shape. The groove 915 is formed by aligning the recesses in the front-rear direction. Even when the upper end of the first portion 91 is closed, the portion of the groove 915 on the upper end surface of the first portion 91 may be left open.

[0093] Similarly, a groove 935 may be provided on the front end side of the third portion 93. In the example shown in each figure, the groove 935 is formed by recesses provided on the left-right opposing side walls of the third portion 93. Each recess is rectangular in shape. The groove 935 is formed by aligning the recesses in the front-rear direction. Even when the upper end of the third portion 93 is closed, the portion of the groove 935 on the upper end surface of the third portion 93 may be open. The width (length in the front-rear direction) of each groove (915, 935) may be the same as or slightly larger than the width of the handle portion B11 of the corresponding basket B1. This allows each groove (915, 935) to be configured to receive each handle portion B11 of the basket B1.

[0094] (Detection sensor) Each pair of load sensors 140 may be positioned in the internal space of the first part 91 and the third part 93, respectively, aligned with the positions of the pair of grooves (915, 935). If the portion of the handle B11 that hooks onto the smart grip 1 is formed in a straight line, in one example, the recesses constituting each groove (915, 935) may be formed such that the lower end of the recess is located slightly below the measuring portion (contact surface with the handle B11) of the load sensor 140. This ensures that when each handle B11 is hooked onto each groove (915, 935), each handle B11 contacts the measuring portion of each load sensor 140. As a result, each load sensor 140 can observe the weight change when the product 40 is placed in the basket B1 (basket body B10). The placement of the load sensors 140 is an example of a location where a change in load occurs due to the placement of the product 40. However, the positional relationship between each groove (915, 935) and each load sensor 140 is not limited to this example and may be appropriately changed depending on the embodiment, such as the shape of the handle portion B11. For example, when each handle portion B11 is placed on the smart grip 1, the respective parts (91, 93) The portion located in the internal space may be formed to curve downward. In this case, the recesses constituting each groove (915, 935) may be formed such that the lower end of the recess is located above the measuring portion of the load sensor 140.

[0095] (Imaging device) In the example shown in each figure, the imaging device 17 is positioned within the internal space of the first part 91. For example, an opening may be provided in the bottom surface of the first part 91 to match the position of the imaging unit 171 (light-receiving unit, etc.) of the imaging device 17. The imaging device 17 may be positioned so that the imaging unit 171 is exposed from the bottom surface of the first part 91 by fitting the imaging unit 171 into the opening in its bottom surface. This allows the imaging device 17 to image the area below the smart grip 1. Therefore, when the smart grip 1 is attached to the basket B1 by hooking each handle B11 of the basket B1 into the respective grooves (915, 935), the imaging device 17 can include the storage area of ​​the basket body B10 in its imaging range. As a result, when placing goods 40 into the basket body B10, the imaging device 17 can observe the goods 40 being placed. This placement of the imaging device 17 is just one example of a location where the goods 40 being placed can be observed.

[0096] (Box / Output device) In each example shown in the figures, the control device 11, memory unit 12, positioning sensor 15, communication module 16, and speaker 333 are housed in a box 1100. The box 1100 is formed in the shape of a rectangular parallelepiped and is located in the internal space of the third section 93. One or more openings may be provided in the box 1100 where the speaker 333 is located. The speaker 333 is used to output auditory feedback 25. A display 331 is located on the top surface of the box 1100. When the upper end of the third section 93 is closed, the display 331 may be positioned so that its screen is exposed from the upper end surface of the third section 93. In this example, when the user TU properly grasps the smart grip 1, the third section 93 is located in front of the second section 92. Therefore, while using the smart grip 1, the screen of the display 331 is positioned slightly in front of the user TU's gripping hand. This allows the user TU to easily view the screen of the display 331 without it being obstructed by body parts while using the smart grip 1. The display 331 is used for outputting visual feedback 25.

[0097] (Haptic feedback module) In one example shown in the figure, the tactile feedback module 30 includes a vibration motor 300 and a servo motor 305. The vibration motor 300 and the servo motor 305 are located in the internal space of the second section 92. In this example, the second section 92 constitutes the part that the user TU grips. Therefore, by being located in the second section 92, the vibration motor 300 and the servo motor 305 can provide tactile feedback 25 to the user TU using the smart grip 1. This location of the vibration motor 300 and the servo motor 305 is an example of a location where motion can be transmitted to the part that the user TU grips. The types of the vibration motor 300 and the servo motor 305 are not particularly limited and may be appropriately selected depending on the embodiment.

[0098] The vibration motor 300 is configured to output feedback by generating vibration. The servo motor 305 may include a shaft 3051 and an arm 3052. The shaft 3051 constitutes the axis of rotation. The arm 3052 is attached to the shaft 3051. For example, the arm 3052 may be attached to the end of the shaft 3051. The arm 3052 rotates around the axis of the shaft 3051 in accordance with the rotation of the shaft 3051. The arm 3052 may be configured to rotate clockwise or counterclockwise so that a part of the arm 3052 (e.g., the end) comes into direct contact with the hand of the user TU that grasps the second part 92. Alternatively, the arm 3052 may rotate clockwise or counterclockwise The tip of the arm 3052 may contact the side wall of the second portion 92, and the resulting vibration (indirect contact) may be transmitted to the hand of the user TU gripping the second portion 92. With these configurations, the servo motor 305 is configured to output feedback by linear or indirect contact. In the example shown in each figure, the arm 3052 is formed in a flat plate shape. However, the shape of the arm 3052 is not limited to this example. As long as it is possible to output direct or indirect contact by rotating, the shape of the arm 3052 is not particularly limited and may be appropriately selected depending on the embodiment.

[0099] In the example shown in each figure, the smart grip 1 is equipped with a vibration motor 300, and the attributes whose values ​​are determined according to the input attribute 20 may include at least one of the number of vibrations, intensity, and period of the vibration motor 300. Also, the smart grip 1 is equipped with a servo motor 305, and the attributes whose values ​​are determined according to the input attribute 20 may include at least one of the number of times (number of contacts), intensity, period, and direction of the arm 3052 of the servo motor 305. By driving at least one of the vibration motor 300 and the servo motor 305, tactile feedback 25 can be generated.

[0100] In one example, by rotating the arm 3052 clockwise (swinging the arm 3052 clockwise) and transmitting an impact from the arm 3052 to the left side of the user TU's hand grasping the second part 92, feedback indicating a leftward direction can be provided. On the other hand, by rotating the arm 3052 counterclockwise (swinging the arm 3052 counterclockwise) and transmitting an impact from the arm 3052 to the right side of the user TU's hand grasping the second part 92, feedback indicating a rightward direction can be provided. As in these examples, the servo motor 305 can output feedback that intuitively indicates the direction of the target by swinging the arm 3052 in the direction of the target. Therefore, the output feedback 25 may be configured to intuitively indicate the direction of the target by including the direction in which the servo motor 3055 swings the arm 3052, which is the target attribute whose value is determined according to the input attribute 20.

[0101] (others) The structure of the smart grip 1 is not limited to the examples shown in Figures 5 and 6, and may be modified as appropriate depending on the embodiment. For example, the shape of the housing 90 may be modified as appropriate. In another example, the housing of the smart grip 1 may be formed in the shape of a ring, and a part of the ring may be made openable and closable by attaching and detaching the ends together. In this way, the housing of the smart grip 1 may be configured to replace the handle by receiving the handle portion B11 of the basket B1 inside the ring formed by the housing. In yet another example, the housing of the smart grip 1 may be formed to receive a terminal device such as a smartphone. In this case, the smart grip 1 may be constructed by attaching the terminal device to the housing.

[0102] Furthermore, the positions of each groove (915, 935) may be changed as appropriate. The number of grooves provided in the housing (housing 90) is not limited to two; it may be one or three or more. Also, the arrangement of each component may be changed as appropriate. The arrangement of the load sensor 140 may be changed as appropriate depending on the structure of the housing (housing 90). If a sensor other than the load sensor 140 is used as the detection sensor 14, the detection sensor 14 may be appropriately placed in a location where it can detect the insertion of the product 40. The arrangement of the imaging device 17 may be changed as appropriate depending on the embodiment. The imaging device 17 may be placed in a location other than the internal space of the first part 91. The components housed in the box 1100 may be changed as appropriate. The box 1100 may be placed in a location other than the internal space of the third part 93. The box 1100 may be omitted.

[0103] In the haptic feedback module 30, at least one of the vibration motor 300 and the servo motor 305 may be omitted. The number of vibration motors 300 is not limited to one, but may be two or more. Similarly, the number of servo motors 305 is not limited to one, but may be two or more. You may have more than one.

[0104] Figure 7 is a schematic plan view showing another example of the structure of the smart grip 1 according to this embodiment. In this other example, the haptic feedback module 30 may be equipped with four vibration motors (301, 302, 303, 304) instead of the vibration motor 300 and servo motor 305 in the structural examples of Figures 5 and 6. The four vibration motors (301, 302, 303, 304) may be arranged separately in the front-rear and left-right directions with the center of the second part 92 as the reference point PO. The first vibration motor 301 may be positioned in front of the reference point PO. The second vibration motor 302 may be positioned to the right of the reference point PO. The third vibration motor 303 may be positioned to the left of the reference point PO. The fourth vibration motor 304 may be positioned behind the reference point PO. Except for these points, the structural example in Figure 7 may be configured in the same way as the structural examples in Figures 5 and 6. The four vibration motors (301, 302, 303, 304) are an example of multiple vibration motors.

[0105] In one example, if the smart grip 1 is equipped with four vibration motors (301, 302, 303, 304), the attributes whose values ​​are determined according to the input attribute 20 may include at least one of the number of vibrations, intensity, and period of vibrations of at least one of the four vibration motors (301, 302, 303, 304). Furthermore, the attributes whose values ​​are determined according to the input attribute 20 may also include the drive pattern (vibration pattern) of the four vibration motors (301, 302, 303, 304).

[0106] The drive pattern may include a drive pattern that intuitively communicates the direction of the object. The drive pattern that intuitively communicates the direction of the object may be determined as appropriate depending on the embodiment. In one example, the drive pattern that intuitively communicates the direction of the object may include at least one of the following: vibrating the vibration motor corresponding to the direction of the object more strongly than the remaining vibration motors among the four vibration motors (301, 302, 303, 304), and vibrating at least two or more of the four vibration motors (301, 302, 303, 304) in an order corresponding to the direction of the object.

[0107] For example, the control device 11 can provide feedback to the user TU indicating the forward direction by vibrating the first vibration motor 301 more strongly than the remaining vibration motors (302, 303, 304). The control device 11 can also provide feedback to the user TU indicating the backward direction by vibrating the fourth vibration motor 304 more strongly than the remaining vibration motors (301, 302, 303). The same applies to the left and right directions. In one example, the drive pattern to which a value is determined according to the input attribute 20 may include vibrating the vibration motor corresponding to the target direction among the four vibration motors (301, 302, 303, 304) as in these examples more strongly than the remaining vibration motors. As a result, the control device 11 may output feedback 25 that intuitively conveys the target direction.

[0108] The number of vibration motors that are vibrated more strongly than the remaining vibration motors is not limited to one, but may be multiple. For example, the control device 11 may indicate a direction between forward and right by vibrating the first vibration motor 301 and the second vibration motor 302 more strongly than the other vibration motors (303, 304). Alternatively, the control device 11 may indicate a direction closer to the front by vibrating the first vibration motor 301 more strongly than the second vibration motor 302. As in these examples, the control device 11 may indicate a direction between the positions where the vibration motors are located by vibrating multiple vibration motors more strongly than the remaining vibration motors. Furthermore, the tactile feedback module 30 may continuously indicate the direction of the target by varying the intensity of vibration among the multiple vibration motors that are vibrated more strongly.

[0109] Furthermore, for example, the control device 11 may output feedback indicating a rightward direction to the user TU by vibrating the third vibration motor 303 and then the second vibration motor 302. Conversely, the control device 11 may output feedback indicating a leftward direction to the user TU by vibrating the second vibration motor 302 and then the third vibration motor 303. Alternatively, the control device 11 may output feedback indicating a direction between forward and right by vibrating the third vibration motor 303 and then the first vibration motor 301. The same applies to other directions. In one example, the drive pattern to which the value is determined according to the input attribute 20 may include vibrating at least two of the four vibration motors (301, 302, 303, 304) in an order corresponding to the target direction. This allows the control device 11 to output feedback 25 that intuitively conveys the target direction.

[0110] The order in which the vibrations are made can be arbitrarily determined. For example, determining the order in which two or more vibration motors are made to vibrate can be done by selecting at least two or more vibration motors located along the direction of the object from among the four vibration motors (301, 302, 303, 304), and then vibrating the vibration motors located towards the rear end of the direction of the object first, and vibrating the vibration motors located towards the front end of the direction of the object later, as in the example above. The vibration strength (intensity, period, etc.) of the at least two or more vibration motors indicating the direction may be the same or different. For example, the control device 11 may vibrate the vibration motors located towards the rear end of the direction of the object more weakly, and the vibration motors located towards the front end of the direction of the object more strongly. This makes it possible to output feedback that emphasizes the front end of the indicated direction.

[0111] Furthermore, if two or more vibration motors are provided, it is possible to compare directions. Therefore, when the haptic feedback module 30 is configured to output feedback that intuitively points to the direction of the object, the number of vibration motors included in the haptic feedback module 30 is not limited to four, but may be two, three, or five or more. At least one of the four vibration motors (301, 302, 303, 304) may be omitted. For example, by omitting the first vibration motor 301 and the fourth vibration motor 304, the haptic feedback module 30 may be configured to point in the left and right directions.

[0112] Furthermore, the position of the reference point PO for each vibration motor (301, 302, 303, 304) is not limited to the center of the second section 92, but may be determined as appropriate depending on the embodiment. The position of the reference point PO may be defined as appropriate depending on the number and arrangement of vibration motors. To make it easier to sense the direction indicated by the vibration of the vibration motor, it is preferable that the reference point PO be set to the center or near the center of the part that the user TU normally grips. This allows the user TU to easily sense the direction indicated by the tactile feedback module 30 in accordance with the deviation of the vibration from the gripped part. In yet another example, the tactile feedback module 30 may include both a servo motor and a plurality of vibration motors. Accordingly, the tactile feedback module 30 may be configured to output feedback indicating a specific direction from both the servo motor and the vibration motor.

[0113] [Software Configuration] Figure 8 schematically shows an example of the software configuration of the smart grip 1 (control device 11) according to this embodiment. The control device 11 of the smart grip 1 executes instructions contained in the program 81 stored in the storage unit 12 using the processor P. As a result, the smart grip 1 (control device 11) operates as a computer equipped with a detection unit 111, a determination unit 112, and a feedback unit 113 as software modules. That is, in this embodiment, each software module of the smart grip 1 is controlled by the control device 11 (processor This is achieved by P).

[0114] The detection unit 111 is configured to detect the insertion of product 40 according to the measurement result of the detection sensor 14. The determination unit 112 is configured to respond to the detection of product 40 being inserted into basket B1 by the detection sensor 14 and to determine the content of the feedback 25 according to the attribute 20 of the detected product 40 insertion. The feedback unit 113 is configured to respond to the detection of product 40 being inserted into basket B1 by the detection sensor 14 and to output the determined feedback 25 to the user TU via the feedback module 13.

[0115] In this embodiment, an example is described in which each software module of the Smart Grip 1 is implemented by a general-purpose processor (processor P). However, some or all of the above software modules may be implemented by one or more dedicated processors or chipsets. Each of the above modules may also be implemented as a hardware module. Regarding the software configuration of the Smart Grip 1, modules may be omitted, replaced, and added as appropriate, depending on the embodiment.

[0116] §3 Example of Operation Figure 9 is a flowchart showing an example of the processing procedure for the output of feedback 25 by the control device 11 of the smart grip 1 according to this embodiment. The following processing procedure is an example of a control method (information processing method) executed by the computer (control device 11). However, the following processing procedure is merely an example, and each step may be changed as much as possible. In addition, steps in the following processing procedure can be omitted, replaced, and added as appropriate, depending on the embodiment.

[0117] In step S101, the control device 11 operates as a detection unit 111. The control device 11 acquires measurement results from the detection sensor 14. Based on the measurement results from the detection sensor 14, it detects the input of product 40. If the input of product 40 is detected, the control device 11 proceeds to the next step S102. If the input of product 40 is not detected, the control device 11 repeatedly executes the process in step S101 and waits until the input of product 40 is detected.

[0118] In step S102, the control device 11 operates as a determination unit 112. In response to the detection of product 40 input in step S101, the control device 11 determines the content of the feedback 25 according to the detected attributes 20 of product 40 input. In one example, the attributes 20 of product 40 input may include at least one of the number 201 of products 40 input, identification information 203, type 205, and event location 207. Thus, the feedback 25 may be generated according to at least one of the number 201 of products 40 input, identification information 203, type 205, and event location 207. Once the content of the feedback 25 is determined, the control device 11 proceeds to the next step S103.

[0119] In step S103, the control device 11 operates as a feedback unit 113. The control device 11 outputs feedback 25 of the determined content to the user TU via the feedback module 13. In one example, the output feedback 25 may include feedback from at least one of visual, auditory, and tactile senses. After outputting the feedback 25, the control device 11 proceeds to the next step S104.

[0120] In step S104, the control device 11 determines whether or not to terminate the process. The determination criteria can be set arbitrarily. For example, the control device 11 may determine not to terminate the process until a termination instruction is given. On the other hand, when a termination instruction is given, the control device 11 may determine to terminate the process. The termination instruction can be given in any way. In another example, If the target user (user TU) is present in the store, the control device 11 may decide not to terminate the process. On the other hand, if the target user is not present in the store (has left the store), the control device 11 may decide to terminate the process. Whether or not the user is present in the store may be determined as appropriate based on the measurement results of the positioning sensor 15, etc.

[0121] If the control device 11 determines that the process should not be terminated, it returns the process to step S101 and executes the process again from step S101. In one example, during the process of repeatedly executing the processes from step S101 to step S103, the control device 11 may output feedback 25 whose content is determined so that as the number of inserted items 40 (total number) approaches the target number, the output feedback 25 approaches the complete content 255. In another example, during the process of repeatedly executing the processes from step S101 to step S103, the control device 11 may output feedback 25 whose content is determined so that as the total number of items in the area to which the event position 207 where the items 40 are inserted belongs approaches the target number, the output feedback 25 approaches the complete content 255.

[0122] If the control device 11 determines that it is time to terminate the process, it terminates the processing procedure related to the output of the feedback 25 in this example of operation. Note that the timing of terminating the process is not limited to this example. The control device 11 may terminate the processing procedure related to the output of the feedback 25 at any time. In one example, the control device 11 may execute the series of processes from step S101 to step S104 in real time.

[0123] According to this embodiment, in response to the detection of the product 40 being placed in the basket by the detection sensor 14 through the processing of steps S102 and S103, feedback 25 corresponding to the attribute 20 of the product 40 being placed is provided. As a result, according to this embodiment, it is expected that the possibility of overlooking the placement of product 40 into the basket B1 will be reduced. Furthermore, the presence of a reaction (feedback 25) to the placement of product 40 can also be expected to act as a nudge to encourage behavioral change (for example, to stimulate the desire to purchase).

[0124] §4 Variant While embodiments of this disclosure have been described in detail above, the above description is merely illustrative in all respects. The processes and means described in this disclosure can be freely combined and implemented as long as no technical inconsistencies arise. Furthermore, various improvements or modifications may be made to the above embodiments as appropriate. For example, the following modifications are possible. In the following, the same reference numerals are used for components similar to those in the above embodiments, and explanations of points similar to those in the above embodiments have been omitted as appropriate.

[0125] <4.1> The above embodiment is configured as a smart grip 1. However, the embodiments of this disclosure are not limited to the smart grip 1. The embodiments of this disclosure may be components of a shopping basket, or the basket (including a cart) itself. The type of basket is not particularly limited and may be appropriately selected depending on the embodiment.

[0126] (First variation) Figure 10 schematically illustrates another example of a scenario to which this disclosure applies. In the example in Figure 10, the embodiment of this disclosure is a shopping basket 1A. The shopping basket 1A comprises a basket body 102A, a detection sensor 14, a feedback module 13, and a control device 11. The basket body 102A may be configured in the same way as the basket body B10 of the basket B1 described above. The detection sensor 14, feedback module 13, and control device 11 may be configured in the same way as in the above embodiment, except that the basket body B10 is replaced with the basket body 102A. That is, the detection sensor 14 may be configured to detect when goods 40 are placed into the basket body 102A. The device 11 may be configured to respond to the detection of the placement of goods 40 into the basket body 102A by the detection sensor 14, to determine the content of the feedback 25 according to the attributes 20 of the detected placement of goods 40, and to output the determined feedback 25 to the user TU via the feedback module 13.

[0127] Other configurations of the shopping basket 1A are not particularly limited and may be determined as appropriate depending on the embodiment. In one example, the shopping basket 1A may include a pair of handles 101A attached to the basket body 102A, and a grip 100A that spans the pair of handles 101A. Each handle 101A may be configured in the same way as each handle B11 of the basket B1. When these configurations are adopted, in one example, the shopping basket 1A may be constructed by using the smart grip 1 for the grip 100A. However, the method of constructing the shopping basket 1A is not limited to such examples.

[0128] Similar to the smart grip 1 described above, the shopping basket 1A may further include a storage unit 12. The shopping basket 1A may also further include at least one of a positioning sensor 15, a communication module 16, and an imaging device 17. If the shopping basket 1A includes a positioning sensor 15, the attributes 20 of the product 40 being placed may include the event location 207 where the product 40 was placed. If the shopping basket 1A further includes an imaging device 17, the control device 11 may, when it detects the placement of the product 40 by the detection sensor 14, acquire an image captured by the imaging device 17 and identify the product 40 by performing image analysis on the acquired image.

[0129] The location of the computer components (control devices 11 to imaging device 17) of the shopping basket 1A is not limited to the grip 100A. At least a portion of the computer components of the shopping basket 1A may be placed anywhere other than the grip 100A. In another example, if a load sensor is used for the detection sensor 14, the detection sensor 14 may be placed on the bottom surface of the storage compartment of the basket body 102A. The imaging device 17 may be placed on the edge of the opening of the basket body 102A with the imaging unit 171 facing the storage compartment of the basket body 102A.

[0130] The shopping basket 1A according to this modified example can provide feedback 25 to the user TU, similar to the smart grip 1 described above. Therefore, this modified example can be expected to reduce the possibility of overlooking the placement of items 40. It can also be expected to act as a nudge to encourage behavioral change. The configuration of the shopping basket 1A may be changed as appropriate depending on the embodiment. In another example, the grip 100A may be omitted. In this case, the user may hold the shopping basket 1A by grasping the pair of handles 101A. If the feedback module 13 includes a haptic feedback module 30, the haptic feedback module 30 may be placed at any location that can transmit movement to at least one of the pair of handles 101A.

[0131] (Second variation) Figure 11 schematically illustrates another example of a scenario to which this disclosure applies. In the example in Figure 11, the form of this disclosure is a shopping basket 1B. Shopping basket 1B corresponds to a form in which the shopping basket 1A is further equipped with one or more wheels 103B to form a cart. That is, shopping basket 1B comprises a basket body 102B, a detection sensor 14, a feedback module 13, a control device 11, and one or more wheels 103B. The basket body 102B may be the same as the basket body 102A of the first modified example. The detection sensor 14 may be configured to detect when goods 40 are placed into the basket body 102B. The control device 11 may be configured to respond to the detection of goods 40 being placed into the basket body 102B by the detection sensor 14, to determine the content of feedback 25 according to the attribute 20 of the detected goods 40 being placed, and to output the determined content of feedback 25 to the user TU via the feedback module 13. The number may be appropriately selected depending on the embodiment. In a typical example, the shopping basket 1B may be equipped with four wheels 103B. The shopping basket 1B may also be called a shopping cart.

[0132] The arrangement of each wheel 103B and the configuration for supporting the basket body 102B may be determined as appropriate depending on the embodiment. In one example, the shopping basket 1B may be equipped with a grip 100B and a base 101B. The base 101B may be equipped with legs 1011B and a support column 1012B. The legs 1011B may be positioned below the basket body 102B. Each wheel 103B may be attached to the legs 1011B. The support column 1012B may be configured to extend vertically upward from one end of the legs 1011B. The basket body 102B may be fixed to the support column 1012B. The grip 100B may be attached to the upper end of the support column 1012B.

[0133] As a result, the shopping basket 1B may have a configuration similar to that of a typical shopping cart. However, the configuration of the shopping basket 1B is not limited to this example. The shopping basket 1B may have a configuration similar to that of other types of carts, such as a silver cart. Furthermore, in the case of adopting these configurations, one example is that the shopping basket 1B may be constructed by using the above-mentioned smart grip 1 for the grip 100B. However, the method of constructing the shopping basket 1B is not limited to this example.

[0134] Similar to the smart grip 1 described above, the shopping basket 1B may further include a storage unit 12. The shopping basket 1B may also further include at least one of a positioning sensor 15, a communication module 16, and an imaging device 17. Similar to the first modified example described above, if the shopping basket 1B includes a positioning sensor 15, the attributes 20 of the product 40 being placed may include the event location 207 in which the product 40 was placed. If the shopping basket 1B further includes an imaging device 17, the control device 11 may perform product identification processing by image analysis.

[0135] The location of the computer components (control devices 11 to imaging device 17) of the shopping basket 1B is not limited to the grip 100B. At least a portion of the computer components of the shopping basket 1B may be placed anywhere other than the grip 100B. In another example, if a load sensor is used for the detection sensor 14, the detection sensor 14 may be placed on the bottom surface of the storage compartment of the basket body 102B. The imaging device 17 may be placed with its imaging unit 171 facing the storage compartment of the basket body 102B, in the area of ​​the support column 1012B from the edge of the opening of the basket body 102B or from the upper end of the basket body 102B to the grip 100B.

[0136] The shopping basket 1B according to this modified version can also provide feedback 25 to the user TU, similar to the smart grip 1 described above. Therefore, this modified version can be expected to reduce the possibility of overlooking the placement of goods 40. It can also be expected to act as a nudge to encourage behavioral change. The basket body 102B may also be used as a basket holder. In this case, other baskets may be placed in the basket body 102B, and goods 40 may be placed in the other baskets. The detection sensor 14 may be appropriately positioned to detect the placement of goods 40 into other baskets. Detecting the placement of goods 40 into the basket body 102B may include detecting the placement of goods 40 into other baskets placed in the basket body 102B. The legs 1011B may also be configured to receive luggage. In this case, the detection sensor 14 may also be placed in the legs 1011B. If the identification of product 40 by image analysis is also performed on the leg portion 1011B, the imaging device 17 may be further positioned on the leg portion 1011B.

[0137] <4.2> In the above embodiments and modifications, the smart grip 1 and each shopping basket (1A, 1B) exist in real space, and the feedback 25 is output in relation to purchasing behavior in real space. However, purchasing behavior is not limited to real space. For example, Purchasing behavior can also occur in virtual spaces such as e-commerce (EC) sites and VR (Virtual Reality) environments. The aforementioned overlooked problems can also arise in purchasing behavior within virtual spaces.

[0138] Therefore, the above embodiment may also be applied to purchasing behavior in a virtual space. That is, one embodiment of this disclosure may be an information processing device (computer) configured to output feedback 25 similar to that of the Smart Grip 1 and each shopping cart (1A, 1B) for purchasing behavior in a virtual space. Furthermore, one embodiment of this disclosure may be an information processing method, a program, or a machine-readable storage medium that stores such a program.

[0139] [Examples of application] Figure 12 schematically illustrates another example of a scenario to which this disclosure applies. In the example in Figure 12, it is assumed that the information processing device 5 is a user terminal. In one example, the information processing device 5 may include a control unit 51. The control unit 51 may be configured to accept the selection of product 40A by the user TU in the virtual store C0, to put the selected product 40A into the cart C1, and in response to the product 40A being put into the cart C1, to determine the content of feedback 25A according to the attribute 20A of the product 40A being put in, and to output the determined feedback 25A to the user TU via the feedback module 53. This information processing device 5 is an example of the information processing device of this disclosure. According to this modification, it is possible to expect a reduction in the possibility of overlooking the putting in product 40A in the virtual space, similar to the above embodiment. It is also possible to expect it to act as a nudge to encourage behavioral change.

[0140] Each component of the above embodiment and modified example may be replaced with an entity in virtual space from an entity in real space and applied to the modified example as appropriate. Placing product 40 into basket B1 (shopping basket 1A, shopping basket 1B) in a store in real space is replaced by selecting product 40A in virtual store C0 and placing the selected product 40A into cart C1. Virtual store C0 may correspond to the above store. Cart C1 may correspond to basket B1 and each shopping basket (1A, 1B). Any system may be used for virtual store C0 and cart C1. A system of a known e-commerce site may be used for virtual store C0 and cart C1.

[0141] In a typical example, the e-commerce site system may be deployed on an external server ES. This allows the external server ES to construct a virtual store C0 and a shopping cart C1 in a virtual space such as a VR space or website. The information processing device 5 may further include an output device 59 (display 591), an input device 54, and a communication module 55. The information processing device 5 may access the external server ES via a network using the communication module 55. This allows the user TU to enter the virtual store C0. Entering the virtual store C0 may include, for example, browsing a website or entering a VR space.

[0142] The information processing device 5 may accept the selection of product 40A by displaying the virtual store C0 on the display 591. The user TU may select product 40A by operating the input device 54. Operation of the input device 54 may include voice input. For example, in the virtual store C0, a button C5 for adding to the cart C1 may be provided for each product 40A. The user TU can select product 40A by operating the button C5 using the input device 54. When product 40A is selected, the information processing device 5 may notify the external server ES of the selection result of product 40A and request that the selected product 40A be registered in the cart C1. In response to this request, the external server ES may register the selected product 40A in the cart C1. This allows product 40A to be added to the cart C1. In other words, the user TU can perform purchasing actions in the virtual space. Adding items to cart C1 can be equivalent to registering information in the user TU's cart C1 to reserve the selected items 40A. After selecting all items 40A, the user TU may request payment processing from the external server ES via the information processing device 5. Once the payment processing is complete, the user TU can purchase the items 40A. Note that purchasing behavior in the virtual space is not limited to this example and may be modified as appropriate depending on the embodiment. The information processing device 5 may output feedback 25A to the user TU in response to such purchasing behavior, which is configured in the same way as in the above embodiment.

[0143] (feedback) Feedback 25A corresponds to feedback 25 in the above embodiment. Feedback module 53 may be configured similarly to feedback module 13 in the above embodiment. That is, feedback module 53 may be configured to output feedback 25A in at least one of visual, auditory, and tactile senses. For example, feedback module 53 may include at least one of a tactile feedback module 58 and an output device 59. The tactile feedback module 58 may be composed of actuators such as a servo motor or a vibration motor. The output device 59 may include at least one of a display 591 and a speaker 593. Accordingly, feedback 25A may be output via feedback module 53 in the same configuration as feedback 25 in the above embodiment. Similar to the above embodiment, feedback 25A may be obtained from content data 121 or generated by performing calculation processing. Determining the content of the feedback (feedback 25A) according to the input attribute (attribute 20A) may be configured similarly to the above embodiment. The feedback module 53 may be appropriately deployed within the range used by the user TU. As shown in Figure 12, in one example, the feedback module 53 may be deployed in the information processing device 5.

[0144] (Attributes of input) The attribute 20A for the input of product 40A may be the same as the attribute 20 in the above embodiment. In one example, the attribute 20A for the input of product 40A may include the number of products 40A that have been input, 201A (number of products). The number of products 40A, 201A, may be the same as the number of products 40, 201 in the above embodiment, except that the input of product 40 in a physical store is replaced by the input of product 40A into cart C1 in virtual store C0. In one example, determining the content of the feedback 25A according to the attribute 20A for the input of product 40A may include determining the content of the feedback 25A such that the output feedback 25A approaches a complete content as the number of products 40A, 201A (total number), approaches the target number. In one example, all products in cart C1 may be counted as the number of products 40A, 201A, without distinguishing between products. In another example, only specific products that meet predetermined conditions may be counted as the number of products 40A, 201A. Whether or not a submitted product meets the specified conditions can be determined by any method. The product information managed on the e-commerce site can be used to determine whether or not a submitted product meets the specified conditions.

[0145] In one example, the attribute 20A of product 40A input may include at least one of the identification information 203A and type 205A of the input product 40A. The identification information 203A and type 205A of product 40A may be the same as the identification information 203 and type 205 of product 40 according to the above embodiment. The identification information 203A and type 205A may be obtained by any method. For example, the identification information 203A and type 205A may be obtained from product information of product 40A managed on the EC site. The identification information 203A and type 205A of product 40A are examples of features derived from product 40A. The features derived from product 40A used to determine the content of feedback 25A are not limited to the identification information 203A and type 205A. In another example, the attribute 20A of product 40A input may include the external characteristics and physical characteristics of the input product 40A. It may include at least one of the features. The external and physical features may be appropriately obtained from the product information of product 40A.

[0146] In one example, the attribute 20A for the introduction of product 40A may include the event location 207A where product 40A was introduced. The event location 207A may be, for example, a web page address (Uniform Resource Locator, etc.), the location where product 40A is listed, or a location in a virtual space such as a VR space. Areas may be set as appropriate within the virtual store C0. For example, each area may be set according to the category of product 40A. Except for these points, the event location 207A may be the same as the event location 207 according to the above embodiment. In one example, determining the content of the feedback 25A according to the attribute 20A for the introduction of product 40A may include determining the content of the feedback 25A such that the output feedback 25A approaches complete content as the total number of areas to which the event location 207A where product 40A was introduced belongs approaches the target number.

[0147] In one example, additional arbitrary information other than the attribute 20A of product 40A may be used to determine the content of feedback 25A. Determining the content of feedback 25A according to the attribute 20A of product 40A may be configured by determining the content of feedback 25A according to the attribute 20A of product 40A and reference information 125A. Reference information 125A may be the same as reference information 125 according to the above embodiment. That is, reference information 125A may include at least one of the user TU attribute information and environmental information.

[0148] [Example Configuration] (Hardware configuration) As shown in Figure 12, the information processing device 5 according to this modified example is a computer in which a control unit 51, a storage unit 52, a feedback module 53, an input device 54, and a communication module 55 are electrically connected.

[0149] The control unit 51 is configured to perform information processing based on programs and various data, by including hardware processors such as a CPU, RAM (Random Access Memory), and ROM (Read Only Memory). The control unit 51 (CPU) is an example of processor resources.

[0150] The storage unit 52 may consist of a hard disk drive, a solid-state drive, semiconductor memory, etc. The storage unit 52, RAM, and ROM are examples of memory resources. In this modified example, the storage unit 52 stores various information such as the program 85, content data 121, and reference information 125. The program 85 is a program that causes the information processing device 5 to perform information processing related to the output of the feedback 25A (Figure 14, described later). The program 85 includes a series of instructions for said information processing. At least one of the content data 121 and the reference information 125 may be omitted. At least one of the content data 121 and the reference information 125 may be held independently of the program 85 or may be included within the program 85.

[0151] At least one of the program 85, content data 121, and reference information 125 may be stored in the storage medium SR5 in place of or together with the storage unit 52. The information processing device 5 may retrieve at least one of the program 85, content data 121, and reference information 125 from the storage medium SR5. The storage medium SR5 may be configured in the same way as the storage medium SR1. The storage unit 52 and the storage medium SR5 are examples of non-temporary storage media. Any drive device may be used to read the information stored in the storage medium SR5. The type of drive device may be selected according to the storage medium SR5.

[0152] The input device 54 is configured to accept information input. The input device 54 may consist of, for example, a keyboard, touch panel, control, microphone, etc. If the feedback module 53 includes an output device 59, the input device 54 and the output device 59 may be integrally configured by a touch panel display or the like. The operator can operate the information processing device 5 by using the input device 54 and the output device 59. The input device 54 and the output device 59 may be connected via an external interface. The external interface may be appropriately configured to connect to an external device via wired or wireless connection, for example, a USB (Universal Serial Bus) port, a dedicated port, etc.

[0153] The communication module 55 is configured to perform wired or wireless communication over a network. The communication module 55 may consist of, for example, a wired LAN module, a wireless LAN module, etc. The information processing device 5 may exchange data with other computers (for example, an external server ES, etc.) via the communication module 55.

[0154] Regarding the specific hardware configuration of the information processing device 5, components can be omitted, replaced, and added as appropriate depending on the embodiment. For example, the control unit 51 may include multiple hardware processors. Hardware processors may consist of microprocessors, FPGAs, DSPs, GPUs, ASICs, etc. At least one of the input device 54 and the communication module 55 may be omitted. The program 85 may be stored in an external storage device such as a NAS. An external storage device is also an example of a non-temporary storage medium. The information processing device 5 may consist of multiple computers. In this case, the hardware configuration of each computer may or may not be the same. Furthermore, the information processing device 5 may be a computer specifically designed for this purpose, as well as a general-purpose server device, a general-purpose PC, a tablet PC, a terminal device, etc.

[0155] (Software configuration) Figure 13 schematically shows an example of the software configuration of the information processing device 5 (control unit 51) according to this modified example. The control unit 51 of the information processing device 5 executes instructions contained in the program 85 stored in the storage unit 52 using the CPU. As a result, the information processing device 5 operates as a computer equipped with a selection reception unit 511, an input unit 512, a decision unit 513, and a feedback unit 514 as software modules. In other words, in this modified example, each software module of the information processing device 5 is realized by the control unit 51 (CPU).

[0156] The selection reception unit 511 is configured to accept the selection of product 40A by the user TU in the virtual store C0. The input unit 512 is configured to input the selected product 40A into the cart C1. The decision unit 513 is configured to respond to the input of product 40A into the cart C1 and to determine the content of the feedback 25A according to the attribute 20A of the input of product 40A. The feedback unit 514 is configured to respond to the input of product 40A into the cart C1 and to output the determined feedback 25A to the user TU via the feedback module 53.

[0157] In this modified example, an example is described in which each software module of the information processing device 5 is implemented by a general-purpose processor (CPU). However, some or all of the above software modules may be implemented by one or more dedicated processors or chipsets. Each of the above modules may also be implemented as a hardware module. Regarding the software configuration of the information processing device 5, modules may be omitted, replaced, and added as appropriate, depending on the embodiment.

[0158] [Example of operation] Figure 14 is a flowchart showing an example of the processing procedure for the output of feedback 25 by the information processing device 5 according to this modified example. The following processing procedure is an example of a control method (information processing method) executed by a computer (information processing device 5). However, the following processing procedure is merely an example, and each step may be changed as much as possible. Furthermore, depending on the embodiment, steps in the following processing procedure can be omitted, replaced, and added as appropriate.

[0159] In step S501, the control unit 51 operates as a selection reception unit 511. The control unit 51 accepts the selection of product 40A by the user TU in the virtual store C0. In step S502, the control unit 51 determines the branch destination of the process depending on whether or not it has accepted the selection of product 40A by the user TU. If the user TU has not accepted the selection of product 40A, the control unit 51 returns to step S501 and waits by repeatedly executing the process of step S501 until it accepts the selection of product 40A. On the other hand, if the selection of product 40A has been accepted, the control unit 51 proceeds to the next step S503.

[0160] In step S503, the control unit 51 operates as the input unit 512. The control unit 51 inputs the selected product 40A into the cart C1. In one example, the control unit 51 may request the external server ES to register the selected product 40A in the cart C1. Once the product 40A is input into the cart C1, the control unit 51 proceeds to the next step S504.

[0161] In step S504, the control unit 51 operates as a determination unit 513. In response to the fact that product 40A was placed in cart C1 in step S503, the control unit 51 determines the content of feedback 25A according to the attributes 20A of product 40A being placed. The processing in step S504 may be the same as in step S102 above. For example, the attributes 20A of product 40A being placed may include at least one of the number of product 40A placed 201A, identification information 203A, type 205A, and event location 207A. Thus, feedback 25A may be generated according to at least one of the number of product 40A placed 201A, identification information 203A, type 205A, and event location 207A. Once the content of feedback 25A is determined, the control unit 51 proceeds to the next step S505.

[0162] In step S505, the control unit 51 operates as a feedback unit 514. The control unit 51 outputs feedback 25A of the determined content to the user TU via the feedback module 53. The processing in step S505 may be the same as in step S103. In one example, the output feedback 25A may include feedback from at least one of visual, auditory, and tactile senses. Note that the processing order of steps S503 to S505 is not limited to this example and may be changed as appropriate depending on the embodiment. In another example, the processing in step S503 may overlap at least partially with the processing in steps S504 to S505. Once the processing in step S505 is completed, the process proceeds to the next step S506.

[0163] In step S506, the control unit 51 determines whether or not to terminate the process. The criteria for this determination can be set arbitrarily. For example, the control unit 51 may decide not to terminate the process until a termination instruction is given. On the other hand, once a termination instruction is given, the control unit 51 may decide to terminate the process. The termination instruction can be given in any way. For example, the control unit 51 may decide not to terminate the process while it is not accepting a transition to settlement processing. On the other hand, once a transition to settlement processing is accepted, the control unit 51 may decide to terminate the process.

[0164] If the control unit 51 determines that the process should not be terminated, it returns the process to step S501 and executes the process again from step S501. In one example, during the process of repeatedly executing the processes from step S501 to step S505, the control unit 51 determines that as the number of input items 40A 201A (total number) approaches the target number, the output feedback 25A will be complete. The control unit 51 may output feedback 25A whose content is determined to approach the target number. In one example, during the process of repeatedly executing the processes in steps S501 to S505, the control unit 51 may output feedback 25A whose content is determined to approach the complete content as the total number of areas to which the event positions 207A to which the product 40A is placed belong approaches the target number.

[0165] If the control unit 51 determines that it is time to terminate the process, it terminates the processing procedure related to the output of feedback 25A according to this modified example. If it accepts a request to proceed to settlement processing, the control unit 51 may proceed to settlement processing. Note that the timing of terminating the process is not limited to this example. The control unit 51 may terminate the processing procedure related to the output of feedback 25A at any time. In one example, the control unit 51 may execute the series of processes from step S501 to step S506 in real time.

[0166] According to this modified version, in response to the processing in steps S504 and S505, a feedback 25A is provided according to the attribute 20A of the product 40A being placed in the virtual store C0. As a result, according to this modified version, it is expected that the possibility of overlooking the placement of product 40A into the cart C1 will be reduced. Furthermore, the presence of a reaction (feedback 25A) to the placement of product 40A can also be expected to act as a nudge to encourage behavioral change (for example, to stimulate purchasing intent).

[0167] [others] In the example shown in Figure 12, the feedback module 53 is deployed within the information processing device 5. However, the deployment location of the feedback module 53 is not limited to this example and may be changed as appropriate depending on the embodiment. In another example, the feedback module 53 may be deployed in a computer other than the information processing device 5. For example, if the information processing device 5 is a server device, the feedback module may be deployed in a user terminal.

[0168] Figure 15 schematically illustrates another example of a scenario to which this disclosure applies. In the example in Figure 15, the information processing device 5 is a server device, and a user TU accesses the information processing device 5 using a user terminal 6. The information processing device 5 may operate as an external server ES, or as an intermediate server between the external server ES and the user terminal 6. In this case, the user terminal 6 may be equipped with a feedback module 63 and an input device 64. Accordingly, the feedback module 53 and input device 54 may be omitted from the information processing device 5. The feedback module 63 and input device 64 may be configured in the same manner as the feedback module 53 and input device 54 described above.

[0169] In this modified example, user TU may select product 40A by accessing the information processing device 5 using user terminal 6 and operating input device 64 on user terminal 6. The information processing device 5 may accept the selection of product 40A upon receiving the result of this operation. In response to accepting the selection of product 40A, the information processing device 5 may perform the process from placing product 40A into cart C1 to outputting feedback 25A. Outputting feedback 25A of the selected content may be configured by instructing user terminal 6 to output feedback 25A of the selected content via feedback module 63. That is, as the process of step S505 above, the information processing device 5 may send a command to user terminal 6 to output feedback 25A of the selected content. In response to this instruction, user terminal 6 may output feedback 25A via feedback module 63. This modified example can also be expected to reduce the possibility of overlooking the placement of product 40A into cart C1. Furthermore, it can be expected to act as a nudge to encourage behavioral change. [Explanation of Symbols]

[0170] 1...Smart Grip, B1...Basket, 1A・1B…Shopping cart, 102A・102B…Basket body, 11...Control device, 13...Feedback module, 13...Detection sensor, 20...Attributes, 25...Feedback, 40...Product, TU...User

Claims

1. A smart grip that can be used as a basket handle, Detection sensor, Feedback module, and control device Equipped with, The detection sensor is configured to detect when an item is placed into the basket. The control device is configured to respond to the detection of the placement of an item into the basket by the detection sensor, determine the content of the feedback according to the attributes of the detected item placement, and output the determined content as feedback to the user via the feedback module. Smart Grip.

2. The attributes of the input of the aforementioned product include the number of the aforementioned product that was input. The smart grip according to claim 1.

3. Determining the content of the feedback according to the attributes of the introduction of the said product includes determining the content of the feedback such that the output feedback approaches complete content as the number of introduced products approaches the target number. The smart grip according to claim 2.

4. The attributes of the input of the said product include at least one of the identification information and type of the said product that was input. The smart grip according to claim 1.

5. It further comprises a positioning sensor configured to measure location, The attribute of the product being placed is the event location measured by the positioning sensor when the product is detected being placed by the detection sensor, and includes the event location where the product was placed. The smart grip according to claim 1.

6. Determining the content of the feedback according to the attributes of the product's introduction includes determining the content of the feedback such that the output feedback approaches complete content as the total number of areas to which the event locations where the product is introduced belong approaches the target number. The smart grip according to claim 5.

7. The feedback module is configured to output feedback in at least one of visual, auditory, and tactile senses. The smart grip according to any one of claims 1 to 6.

8. Basket body, Detection sensor, Feedback module, and control device Equipped with, The detection sensor is configured to detect when an item is placed into the basket body. The control device, in response to the detection of the placement of an item into the basket body by the detection sensor, determines the content of the feedback according to the attributes of the detected item placement. And, configured to output feedback of the determined content to the user via the feedback module, Shopping cart.

9. By adding one or more wheels, it is configured as a cart. The shopping cart according to claim 8.

Images