Smart grip and shopping basket

Abstract

To provide a technology for reducing the possibility of overlooking putting an item into a basket. [Solution] A smart grip according to one aspect of the present disclosure is configured to be usable as a handle for a basket. The smart grip includes a detection sensor, a feedback module, and a control device. The detection sensor is configured to detect the insertion of a product into the basket. In response to the detection sensor detecting the insertion of the product into the basket, the control device is configured to determine feedback content according to attributes of the detected insertion of the product, and output the determined feedback content to a user via the feedback module.

Description

[Technical field]

[0001] The present disclosure relates to a smart grip and a shopping basket. [Background technology]

[0002] In recent years, various technologies for monitoring the purchasing behavior of users in a store have been developed. For example, Patent Document 1 proposes a product storage device that includes a storage unit for storing products, an imaging unit for capturing images of the inside of the storage unit, and a transmission unit for transmitting the captured images and the device's identification information to a product registration device. This product storage device can reduce the workload of store clerks. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2013-041465 A Summary of the Invention [Problem to be solved by the invention]

[0004] For example, when shopping with family, products may be put into the basket while the user is not paying attention to the basket, such as a child putting a product into the basket while the user is distracted by the product shelves, or a product that has fallen off the product shelves may end up in the basket, etc. This may result in the user overlooking the putting of a product into the basket.

[0005] In one aspect, the present disclosure has been made in consideration of the above circumstances, and one of its objectives is to provide a technology that reduces the possibility of overlooking putting a product into a basket. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems, the present disclosure employs the following configurations. Note that the following configurations can be appropriately combined.

[0007] A smart grip according to one aspect of the present disclosure is configured to be usable as a handle for a basket. The smart grip includes a detection sensor, a feedback module, and a control device. The detection sensor is configured to detect the insertion of a product into the basket. In response to the detection sensor detecting the insertion of the product into the basket, the control device is configured to determine the content of feedback according to attributes of the detected insertion of the product, and output the determined feedback content to a user via the feedback module.

[0008] In this configuration, in response to the detection of the insertion of a product by the detection sensor, feedback according to the attributes of the insertion of the product is given. The insertion of the product can be communicated by the given feedback. Furthermore, if the same feedback is given repeatedly, the user may become accustomed to it and lose recognition of the receipt of the feedback (forgetting, overlooking, etc.). In contrast, in this configuration, the given feedback is switched according to the attributes of the insertion of the product, which is expected to suppress the occurrence of loss of recognition due to accustoming to it. Therefore, according to this configuration, by giving such feedback in response to the detection of the insertion of a product, it is expected to reduce the possibility of overlooking the insertion of a product into the basket.

[0009] In the smart grip according to the above aspect, the attribute of the inserted product is According to this configuration, by providing feedback that switches depending on the number of inserted products, it is expected that the possibility of overlooking insertion of products can be reduced.

[0010] In the smart grip according to the above aspect, determining the content of the feedback according to the attributes of the inserted products may include determining the content of the feedback such that the output feedback approaches completeness as the number of inserted products approaches a target number. According to this configuration, by encouraging the insertion of products in order to provide complete feedback, it is expected that purchasing motivation will be stimulated.

[0011] In the smart grip according to the above aspect, the attributes of the inserted product may include at least one of the identification information and the type of the inserted product. According to this configuration, by providing feedback that switches depending on at least one of the identification information and the type of the inserted product, it is expected that the possibility of overlooking the insertion of the product can be reduced.

[0012] The smart grip according to the above aspect may further include a positioning sensor configured to measure a position. The attribute of the insertion of the product may be an event position measured by the positioning sensor when the detection sensor detects the insertion of the product, and may include the event position where the product is inserted. According to this configuration, by providing feedback that switches depending on the event position where the product is inserted, it is expected that the possibility of overlooking the insertion of the product can be reduced.

[0013] In the smart grip according to the above aspect, determining the content of the feedback according to the attribute of the insertion of the product may include determining the content of the feedback such that the output feedback approaches completeness as the total number of areas to which the event positions where the products are inserted belong approaches a target number. According to this configuration, by encouraging the insertion of products in order to provide complete feedback, it is expected that purchasing motivation will be stimulated.

[0014] In the smart grip according to the above aspect, the feedback module may be configured to output at least one of visual, auditory, and tactile feedback. With this configuration, by providing at least one of visual, auditory, and tactile feedback, it is expected that the possibility of overlooking insertion of a product will be reduced.

[0015] The embodiment of the present disclosure may not be limited to the smart grip. An aspect of the present disclosure may be a component of a basket used for shopping. An aspect of the present disclosure may be a basket (including a cart) itself. In addition, an aspect of the present disclosure may be an information processing method for realizing all or part of the control device (computer), a program, or a storage medium readable by a machine such as a computer that stores such a program. Here, the machine-readable storage medium may be a non-transitory medium that accumulates information such as a program by electrical, magnetic, optical, mechanical, or chemical action. The non-transitory storage medium may include a storage medium (CD, DVD, semiconductor memory, etc.), an auxiliary storage device of a computer, an external storage device connected to a computer, etc.

[0016] For example, a shopping basket according to one aspect of the present disclosure may include a basket body, a detection sensor, a feedback module, and a control device. The detection sensor may be configured to detect the insertion of a commodity into the basket body. In response to the detection sensor detecting the insertion of the commodity into the basket, the control device may be configured to determine the content of the feedback according to an attribute of the detected insertion of the commodity, and output the determined feedback content to a user via the feedback module.

[0017] The shopping basket according to the above aspect may be configured as a cart by further including one or more wheels. With this configuration, the shopping basket in the form of a cart reduces the possibility of overlooking the insertion of an item. A reduction can be expected. Effect of the Invention

[0018] According to one aspect of the present disclosure, it is expected that the possibility of overlooking putting an item into a basket can be reduced. [Brief description of the drawings]

[0019] [Figure 1] FIG. 1 illustrates an example of a situation to which the present disclosure is applied. [Diagram 2] FIG. 2 illustrates an example of a product introduction attribute (first attribute). [Diagram 3] FIG. 3 illustrates an example of a product introduction attribute (second attribute). [Figure 4] FIG. 4 illustrates an example of a product introduction attribute (third attribute). [Diagram 5] FIG. 5 is a side view that illustrates an example of the structure of a smart grip. [Figure 6] FIG. 6 is a plan view illustrating an example of the structure of a smart grip. [Figure 7] FIG. 7 is a plan view illustrating another example of the structure of the smart grip. [Figure 8] FIG. 8 illustrates an example of a software configuration of the smart grip (control device). [Figure 9] FIG. 9 is a flowchart illustrating an example of a processing procedure of the control device. [Figure 10] FIG. 10 illustrates another example of a situation to which the present disclosure is applied. [Figure 11] FIG. 11 illustrates another example of a situation to which the present disclosure is applied. [Figure 12] FIG. 12 illustrates another example of a situation to which the present disclosure is applied. [Figure 13] FIG. 13 illustrates an example of a software configuration of an information processing device. [Figure 14] FIG. 14 is a flowchart illustrating an example of a processing procedure of the information processing device. [Figure 15] FIG. 15 illustrates another example of a situation to which the present disclosure is applied. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0020] Hereinafter, an embodiment according to one aspect of the present disclosure will be described with reference to the drawings. However, the embodiment described below is merely an example of the present disclosure in all respects. Various improvements or modifications may be made without departing from the scope of the present disclosure. In implementing the present disclosure, a specific configuration according to the embodiment may be appropriately adopted. Note that, although the data appearing in this embodiment is described in natural language, more specifically, it is specified by pseudo-language, commands, parameters, machine language, electrical signals, etc. that can be recognized by a machine such as a computer.

[0021] §1 Examples of application FIG. 1 is a schematic diagram showing an example of a situation to which the present disclosure is applied. The smart grip 1 according to this embodiment is configured to be usable as a handle for a basket B1. The smart grip 1 includes a control device 11, a feedback module 13, and a detection sensor 14. The detection sensor 14 is configured to detect the insertion of a product 40 into the basket B1. In response to the detection of the insertion of the product 40 into the basket B1 by the detection sensor 14, the control device 11 is configured to determine the content of the feedback 25 according to the attribute 20 of the detected insertion of the product 40, and to output the determined feedback 25 to the user TU via the feedback module 13.

[0022] According to this embodiment, in response to the detection of the insertion of the product 40 by the detection sensor 14, feedback 25 according to the attribute 20 of the insertion of the product 40 is given. The insertion of the product 40 can be communicated by the given feedback 25. Furthermore, by switching the given feedback 25 according to the attribute 20 of the insertion, it is expected that the occurrence of a lack of recognition due to habituation can be suppressed. Therefore, according to this embodiment, by giving such feedback 25 in response to the detection of the insertion of the product 40, it is expected that the possibility of overlooking the insertion of the product 40 into the basket B1 will be reduced. Furthermore, according to this embodiment, by providing a reaction (feedback 25) to the insertion of the product 40, a behavioral change can be expected. It is also expected to act as a nudge to encourage behavior (e.g., stimulating purchasing desire).

[0023] [Basket] As shown in FIG. 1, in a typical example, the basket B1 may be a shopping basket including a basket body B10 and a pair of handles B11. The configuration of the basket body B10 and each handle B11 may be appropriately determined according to the embodiment. For example, the basket body B10 may be configured to receive luggage TP from the upper end side by having an open upper end and a closed lower end at the bottom. The basket body B10 may have any shape, such as a substantially rectangular parallelepiped shape or a substantially truncated pyramid shape. The pair of handles B11 may be arranged separately in the longitudinal direction of the basket body B10. Each end of the handle B11 may be connected to each side surface in the short direction of the basket body B10 so that the handle B11 can be rotated around an axis in the short direction. As a result, each handle B11 may be configured to be rotated at the connection part with the basket body B10 to change the angle and to be gripped along the short direction. When the basket B1 includes a basket body B10, putting the product 40 into the basket body B10 may correspond to putting the product 40 into the basket B1.

[0024] The configuration of the basket B1 is not limited to the example of FIG. 1, and may be changed as appropriate depending on the embodiment. For example, the number of handles B11 is not limited to two. The number of handles B11 may be one, or three or more. In addition, each end of one handle B11 may be separated and connected to one side surface in the short direction of the basket body B10 in the longitudinal direction, and each end of the other handle B11 may be separated and connected to the other side surface in the short direction of the basket body B10 in the longitudinal direction. In this way, each handle B11 may be configured to be gripped along the longitudinal direction.

[0025] In addition, the type of basket B1 is not limited to the example in FIG. 1 and may be changed as appropriate depending on the embodiment. As long as it can be used to carry the product 40, the type of basket B1 is not particularly limited and may be selected as appropriate depending on the embodiment. The basket B1 may include a cart with one or more wheels. The basket B1 may include a bag that can be used for shopping, such as a plastic bag or a paper bag. The basket B1 may also include a device that can hold an object by hanging it, such as a hanger. A known basket may be used for the basket B1.

[0026] [Can be used as a basket handle] The ability to be used as a handle of a basket (such as basket B1) may be achieved by any form in which the smart grip 1 is disposed as at least a part of a handle to be gripped by a user when carrying a product (such as product 40). In one example, the ability to be used as a handle of a basket may be achieved by replacing an existing handle provided on the basket by hanging a handle portion of the basket (such as handle portion B11) on the smart grip 1. The handle portion of the basket may include any component that can be hung on the smart grip 1, such as a handle portion of a bag or a hook of a hanger. In another example, the ability to be used as a handle of a basket may be achieved by being attached to the handle portion of the basket. In yet another example, the ability to be used as a handle of a basket may be achieved by being attached to the basket body (such as basket body B10) as a handle portion. In other words, the smart grip 1 may be configured as the handle portion of the basket itself.

[0027] [Product / Store] The product 40 may include any kind of item that is carried. The product 40 may be referred to as a target product. The smart grip 1 may be used in any store. The configuration of the store is not particularly limited and may be determined appropriately depending on the embodiment. The sales format of the store may be either unmanned or manned. The store may or may not be equipped with sensors such as an imaging device and a load sensor. When sensors are installed in the store, the sensors of the smart grip 1 (detection sensor 14, etc.) and the sensors installed in the store may be By linking, the purchasing behavior of the target user may be monitored. Alternatively, the smart grip 1 may monitor the purchasing behavior of the target user (user TU) independently of sensors installed in the store (i.e., without linking with sensors in the store).

[0028] [Product introduction] Putting a product (product 40) into a basket (basket B1) may include any form of carrying a product from a sales floor. As illustrated in FIG. 1, in a typical example, putting a product into a basket may be putting a new product 40 into a basket body B10 of a basket B1 including a smart grip 1. In addition, putting a product into a basket may include any action similar to putting a product into a basket, such as hanging a handle of a basket containing a product on a smart grip 1. Hanging the handle of a basket containing a product may include hanging the handle of a plastic bag containing the product, hanging the hook of a hanger that is hanging the product, etc.

[0029] [feedback] The feedback 25 may comprise information of any modality. The feedback module 13 may be configured to convey information in any modality. In one example, the feedback module 13 may be configured to output visual, auditory and / or tactile feedback 25. The feedback module 13 may comprise any one or more devices each capable of outputting feedback 25 of at least one modality. For example, the feedback module 13 may include a haptic feedback module 30 and / or an output device 33.

[0030] The haptic feedback module 30 may be configured by any device capable of performing an operation of generating a physical motion such as vibration or contact. For example, the haptic feedback module 30 may be configured by an actuator such as a servo motor or a vibration motor. The type of actuator may be selected arbitrarily. The haptic feedback module 30 may be configured by a plurality of types of actuators. For example, the haptic feedback module 30 may be configured by a servo motor, a vibration motor, or a combination thereof. In the smart grip 1, the haptic feedback module 30 may be appropriately disposed in a location capable of transmitting motion to a portion held by the user TU (for example, an internal space within a range that can be held by the user TU, etc.).

[0031] The output device 33 may include at least one of a display 331 (including an indicator light) and a speaker 333. When the output device 33 includes the display 331, the display 331 is preferably disposed in a location where the information outputted can be viewed while the user TU is holding the smart grip 1. This allows the user TU to check the information displayed on the display 331 while using the smart grip 1.

[0032] As described above, the feedback module 13 may be configured to output at least one of visual, auditory, and tactile feedback 25 by including at least one of the display 331, the speaker 333, and the tactile feedback module 30. According to one example of the present embodiment, by providing at least one of visual, auditory, and tactile feedback 25, it is expected that the possibility of overlooking insertion of the product 40 can be reduced.

[0033] In addition, as long as the information (insertion of the product 40) can be transmitted, the components of the feedback 25 of each modality may be appropriately selected depending on the embodiment. In one example, the visual feedback 25 may be composed of an image. The image may include text, pictures, etc. The image may include the illumination of one or more indicator lights. The illumination may include blinking. In one example, the audio feedback 25 may be composed of an image. The image may include text, pictures, etc. The image may include the illumination of one or more indicator lights. The illumination may include blinking. The tactile feedback 25 may consist of sound. Sound may include simple sounds (such as beeps), music, voice, etc. In one example, the tactile feedback 25 may consist of physical movements. Physical movements may include vibrations, touch, etc.

[0034] The source of the feedback 25 may be appropriately determined depending on the embodiment. In one example, the smart grip 1 may further include a storage unit 12. The storage unit 12 may store content data 121 indicating the content of the feedback 25. The content data 121 may include, for example, sound data, image data, signal data, etc. The sound data may include voice data, music data, etc. The signal data may include data indicating a drive pattern of an actuator (motor, etc.). In one example, the content data 121 may be prepared in advance for each candidate of the feedback 25. The control device 11 may output the feedback 25 by reproducing the content data 121 stored in the storage unit 12. The content data 121 may be reproduced as is, or may be reproduced after modification such as adjustment of an attribute value is added.

[0035] The acquisition path of the content data 121 is not particularly limited and may be appropriately selected according to the embodiment. In one example, the content data 121 may be pre-installed in the storage unit 12. In another example, the smart grip 1 may further include a communication module 16. The control device 11 may use the communication module 16 to acquire the content data 121 from the external computer OC via a network. That is, the content data 121 may be provided from the external computer OC. The content data 121 may be provided each time or all at once. The external computer OC is any computer other than the smart grip 1. The external computer OC may be, for example, a store terminal, a user terminal, a server device, or the like.

[0036] Furthermore, the origin of the feedback 25 does not need to be limited to data (content data 121) prepared in advance. In another example, the control device 11 may generate the feedback 25 by executing a calculation process. That is, determining the content of the feedback 25 may include generating the feedback 25. Executing the calculation process may include using a generative model such as a variational autoencoder, a generative adversarial network, a diffusion model, or a large-scale model. The large-scale model may include, for example, a large-scale language model (LLM), a large-scale visual language model (VLM), etc. The control device 11 may execute the arithmetic processing. Also, executing the arithmetic processing may include using an application program such as a voice synthesis engine. The control device 11 may output the feedback 25 generated as a result of executing the arithmetic processing to the user TU. The arithmetic processing for generating the feedback 25 does not necessarily have to be executed on the smart grip 1 (control device 11). In another example, the arithmetic processing for generating the feedback 25 may be executed on an external computer OC. In this case, the control device 11 may acquire the generated data from the external computer OC via a network. The control device 11 may output the feedback 25 by reproducing the acquired data. When the feedback 25 is generated each time, the content data 121 may be omitted.

[0037] Also, in one example, all of the processing for determining the content of the feedback 25 may be executed within the control device 11. In another example, as in the above example where the content data 121 is provided from the external computer OC and the external computer OC executes the arithmetic processing for generating the feedback 25, at least a part of the processing for determining the content of the feedback 25 may be executed by the external computer OC. In this case, determining the content of the feedback 25 may include requesting the external computer OC to determine the content of the feedback 25 via a network. In response to this request, the external computer OC may determine the content of the feedback 25 and return the determined result to the control device 11. Control By receiving this reply, the control device 11 may obtain the contents of the feedback 25.

[0038] [Determine the content of feedback according to the attributes of input] Determining the content of the feedback (feedback 25) according to the attribute of the input (attribute 20) may correspond to switching the feedback to be output according to the attribute of the input. If switching of the feedback to be output according to the attribute of the input occurs at least once, it may be interpreted that the content of the feedback is determined according to the attribute of the input. Switching of the feedback may mean that at least a part of the content is different between at least two of the multiple feedbacks output at different times. In a case where there is a partial overlap of the content between the two feedbacks but they do not completely match, it may be interpreted that at least a part of the content of the feedback is different (i.e., the feedback is switched). For example, feedback that presents a part of the content described below may be interpreted as being different from feedback that presents the entire content. In other words, even if the content is the same, feedback that presents a part of the content and feedback that presents the entire content may be interpreted as being different from each other. Therefore, expanding the range of the content to be output according to the attribute of the input (bringing the output feedback closer to the complete content) may be interpreted as feedback being switched.

[0039] The correspondence between the input attribute 20 and the content of the feedback 25 may be appropriately defined depending on the embodiment. Determining the content of the feedback 25 may be configured by, for example, determining the attribute value of the feedback 25, determining the output time of the feedback 25, selecting one or more feedbacks 25 to be used from a plurality of candidates, and the like. Determining the attribute value may include adjusting the attribute value from a default value. When the content data 121 is given, the attribute value specified in the content data 121 may be an example of the default value. The attribute for which the value is determined may be appropriately selected for each modality. In one example, when the feedback 25 includes an image, the attribute for which the value is determined may include image attributes such as text content, color attributes (hue, brightness, saturation, etc.), and display patterns (including the lighting patterns of indicator lights). When the feedback 25 includes sound, the attribute for which the value is determined may include sound attributes such as audio content, sound volume (intensity), pitch (sound pitch), tone, and number of times played. When the feedback 25 includes physical motion (vibration, contact, etc.), the attributes for which the value is determined may include motion attributes such as the number of motions, intensity, period, direction, pattern, etc. The output time of the feedback 25 may include the display time of an image, the playback time of a sound, the playback time of a motion, etc.

[0040] [Input Attributes] The attribute 20 of the insertion of the product 40 may include any kind of feature that characterizes the act of inserting the product 40, such as the number of products 40 inserted into the basket B1, the location where the products 40 were inserted, and features originating from the inserted products 40. For example, the features originating from the product 40 may include the identification information and type of the product 40. The features originating from the product 40 may include the appearance features and physical features of the product 40. The appearance features may include the design (package design, etc.) of the product 40, the shape, the color, etc. of the product 40. The physical features may include the weight, etc. In one example, the attribute 20 of the insertion of the product 40 may include at least one of the following first to third attributes.

[0041] (1) First attribute 2 is a schematic diagram showing an example of an attribute 20 (first attribute) of the input of the product 40. In one example, the attribute 20 of the input of the product 40 may include the number 201 of the input products 40 (input number).

[0042] The correspondence between the number 201 of inserted products 40 and the content of the feedback 25 may be appropriately defined depending on the embodiment. As a specific example, outputting the feedback 25 according to the number 201 of inserted products 40 may include sounding a number of times according to the number 201, It may include notifying the number 201 by at least one of an image and a sound, outputting at least one of an image and a sound of the content selected according to the number 201, generating a movement a number of times according to the number 201, generating a movement with at least one of an intensity and a period according to the number 201, and the like. Outputting at least one of an image and a sound of the content selected according to the number 201 may include outputting target information when the number 201 reaches a target number, and outputting information other than the target information before the number 201 reaches the target number. For example, outputting the target information may include outputting coupon information. Outputting information other than the target information may include notifying the remaining number of inputs until the coupon information is output (i.e., the target number is reached). According to one example of the present embodiment, by providing feedback 25 that switches according to the number 201 of the input products 40, it is expected that the possibility of overlooking the input of the products 40 can be reduced.

[0043] (Progress-dependent output format) Also, in one example, when the input attribute 20 includes the number 201 of the input products 40, determining the content of the feedback 25 according to the input attribute 20 of the products 40 may include determining the content of the feedback 25 such that the output feedback 25 approaches the complete content 255 as the number 201 (total number) of the input products 40 approaches the target number. When using the feedback 25 in the output format according to this progress status, in the initial stage when the input of the products 40 starts, the control device 11 may determine to present a part of the content of the feedback 25. The control device 11 may output the feedback 25 presenting a part of the determined content. Thereafter, each time the input of the products 40 is detected, the control device 11 may expand the range to be presented in the content of the feedback 25. That is, each time the number of input products 40 (number 201) increases, the content of the output feedback 25 may be supplemented. Then, in the final stage when the target number is reached, the control device 11 may determine to present the entire content of the feedback 25. In response, the controller 11 may output feedback 25 presenting the content in its entirety (complete content 255).

[0044] In the example of FIG. 2, the complete content 255 is "Do Re Mi Fa So La Si Do" and the target number is "4 times (4 pieces)". The complete content 255 and the target number are not limited to this example and may be appropriately determined according to the embodiment. The target number may be a fixed value or a variable value. The target number may be determined from the past purchase history of the user TU, such as the average number of products purchased per shopping (actual value). In addition, a part of the content presented at the initial stage (initial value) is "Do Re", and the compensation amount per one insertion of the product 40 (one inserted product) is a fixed value of two notes. The initial value and the compensation amount are also not limited to this example and may be appropriately determined according to the embodiment. The compensation amount per one insertion may be a fixed value or a variable value. The part of the content presented at the initial stage (initial value) may be appropriately selected from the content of the feedback 25 to be used. In one example, when the feedback 25 is composed of content having a time series, such as sound (example of FIG. 2), physical movement, etc., a part of the content presented at the initial stage may be a part from the beginning of the time series. However, the part of the content presented at the initial stage is not limited to such an example, and may be appropriately determined depending on the embodiment.

[0045] In one example, the feedback 25 output in this form may be composed of at least one of an image, a sound, and a physical movement. FIG. 2 illustrates an example of a situation in which the feedback 25 in this form is composed of a sound. As described above, the sound may include simple sounds, music, voice, and the like. When the feedback 25 includes an image, the image may include coupon information. This makes it possible to provide the coupon information to the user TU when the number 201 of inserted products 40 reaches a target number. The coupon information includes information indicating a discount on the product. The product that is the subject of the discount based on the coupon information may be selected arbitrarily. The product that is the subject of the discount may include at least a portion of the inserted product 40, or may include products other than the inserted product 40. According to one example of the present embodiment, by encouraging the introduction of the product 40 toward the feedback 25 of the complete content 255, it is expected that a desire to purchase the product will be stimulated.

[0046] In the above example, the feedback 25 is gradually filled in so that the feedback 25 approaches the complete content 255. However, the output format for making the feedback 25 approach the complete content 255 is not limited to this example, and may include any format for transitioning from an incomplete state to a complete state. Making the feedback 25 incomplete may include, in addition to limiting the range to be played back, making the feedback 25 blurry, adding obstructions (noise, objects, etc.), and the like.

[0047] In another example, when the feedback 25 includes an image (hereinafter also referred to as a "target image"), in the initial stage when the introduction of the products 40 starts, the control device 11 may blur the target image by image processing such as defocusing or pixelating. The control device 11 may output the obtained blurred target image as the feedback 25. Each time a product 40 is introduced, the control device 11 may reduce the degree of blurring of the target image. Then, in response to the number 201 of introduced products 40 reaching a target number, the control device 11 may output the target image before the blurring process is applied (i.e., the original image) as the feedback 25.

[0048] In another example, when the feedback 25 includes a target image, in an initial stage when the introduction of the products 40 starts, the control device 11 may overlay an object on the target image to cover at least a part of the target image with the object. The control device 11 may output the obtained target image as the feedback 25. The object may be selected arbitrarily. For example, the object may include a silhouette of some character. Each time a product 40 is introduced, the control device 11 may narrow the range of the target image that is covered by the object by a method such as making the object smaller without reducing the number of objects. Then, in response to the number 201 of introduced products 40 reaching the target number, the control device 11 may output the target image that is not covered by the object as the feedback 25.

[0049] In another example, in the initial stage when the introduction of the products 40 starts, the control device 11 may add noise to the content of the feedback 25. The control device 11 may output the feedback 25 with this noise added. The noise may be added by any method. Each time a product 40 is introduced, the control device 11 may reduce the degree to which noise is added to the feedback 25 by narrowing the range to which the noise is added, reducing the intensity of the added noise, or the like. Then, in response to the number 201 of introduced products 40 reaching the target number, the control device 11 may output the feedback 25 without noise added.

[0050] (Counting the number of items) The number 201 of the inserted products 40 may be counted appropriately. In one example, the control device 11 may increase the number 201 of the products 40 by one each time the detection sensor 14 detects the insertion of the product 40 once. The control device 11 may continue to count the number 201 of the products 40 indefinitely. Alternatively, the control device 11 may reset the count of the number 201 of the products 40 at any timing. For example, the control device 11 may reset the count of the number 201 of the products 40 in response to the number 201 of the products 40 reaching an upper limit number. The upper limit number may be defined arbitrarily. Also, for example, the smart grip 1 may further include an input device. The control device 11 may reset the count of the number 201 of the products 40 in response to the operation of the input device by the user TU. Also, for example, the control device 11 may reset the count of the number 201 of the products 40 in response to the occurrence of an event such as entering a store or leaving a store. Whether or not an event has occurred may be determined appropriately depending on the embodiment. For example, before starting to use the smart grip 1 in a store (for example, when entering the store), the control device 11 The control device 11 may execute an authentication process of the TU. The authentication method is not particularly limited and may be appropriately selected according to the embodiment. A known method may be adopted as the authentication method. The authentication process may be executed by the smart grip 1 (control device 11) alone, or may be executed in cooperation with an external computer (store terminal, user terminal, server device, etc.). The control device 11 may reset the count of the number 201 of the products 40 in response to the establishment of this authentication process. In addition, for example, the smart grip 1 may further include a positioning sensor 15 configured to measure the position. The control device 11 may detect the occurrence of an event such as entering or leaving the store in response to the measurement result of the position by the positioning sensor 15. The control device 11 may reset the count of the number 201 of the products 40 in response to the detection of the occurrence of the event.

[0051] In one example, the control device 11 may count the number 201 of products 40 added to the basket B1 without distinguishing between products displayed in the store. The control device 11 may output feedback 25 according to the counted number 201 without distinguishing between the products. According to this example, it is possible to provide feedback 25 according to the total number (number 201) of products 40 added to the basket B1. This makes it possible to monitor the addition of products to the basket B1 without distinguishing between the products.

[0052] In another example, the control device 11 may count the number 201 of only specific products that satisfy a predetermined condition among the products added to the basket B1. The control device 11 may output feedback 25 according to the counted number 201 of only the specific products. According to this example, feedback 25 according to the number of specific products can be provided. This makes it possible to focus on a specific product and monitor the addition of the specific product to the basket B1.

[0053] The predetermined condition may be arbitrarily defined. As an example, a list of designated products may be provided by the user TU or a store. The designated products may be determined for any purpose. For example, when provided by the user TU, the list may be a shopping list indicating products to be purchased. The products to be purchased are an example of designated products. The shopping list may be generated as appropriate.

[0054] The predetermined condition may include that the inserted product 40 belongs to the list as a designated product. In this example, the designated product is an example of a specific product. That is, if the inserted product belongs to the list, the control device 11 may count the product (product 40) and output feedback (feedback 25) according to the number of counted products (number 201). On the other hand, if the inserted product does not belong to the list, the control device 11 may omit counting the product. In this case, the control device 11 may also omit outputting feedback according to the number of products. According to this example, the insertion of the designated product into the basket B1 can be monitored. For example, when a shopping list is given as a list of designated products, the insertion of products to be purchased into the basket B1 can be monitored.

[0055] Alternatively, the predetermined condition may include that the inserted product 40 does not belong to the list as a designated product. In this example, a product other than the designated product is an example of a specific product. That is, when the inserted product does not belong to the list, the control device 11 may count the product (product 40) and output feedback (feedback 25) according to the number of counted products (number 201). On the other hand, when the inserted product belongs to the list, the control device 11 may omit counting the product. In this case, the control device 11 may also omit outputting feedback according to the number of products. According to this example, the insertion of products other than the designated product into the basket B1 can be monitored. For example, when a shopping list is given as a list of designated products, the insertion of products other than the product to be purchased into the basket B1 can be monitored.

[0056] It should be noted that whether or not the inserted product belongs to the list may be determined by any method. As an example, the control device 11 may acquire an identification result of the inserted product (product 40). The control device 11 may determine whether or not the inserted product belongs to the list by comparing the acquired identification result with the list. The inserted product may be identified by any method. A publicly known method may be adopted as the product identification method. Any sensor may be used to identify the product. The detection sensor 14 may be used to identify the product, or a sensor other than the detection sensor 14 may be used. The product identification method may be appropriately selected depending on the sensor to be used.

[0057] In one example, the smart grip 1 may further include an imaging device 17. The imaging device 17 may be appropriately arranged so as to capture a commodity when the commodity is put into the basket B1 (basket body B10). For example, the imaging device 17 may be arranged so that the basket B1 (basket body B10, etc.) is within the imaging range. As long as it is possible to generate an imaged image that can identify the commodity, the type of the imaging device 17 is not particularly limited and may be appropriately selected depending on the embodiment. The imaging device 17 may include any sensor that acquires data in the form of an image or an image representation, such as, for example, an RGB camera, a depth sensor, an infrared sensor, a radar, a LiDAR (light detection and ranging), etc.

[0058] The control device 11 may obtain an image captured by the imaging device 17 when the detection sensor 14 detects the insertion of a commodity. The timing of imaging (generation of an image) by the imaging device 17 may be appropriately specified according to the embodiment. In one example, when the imaging device 17 is disposed in a position where it can capture an image of a commodity after the insertion is detected, the control device 11 may start the imaging device 17 in response to the detection of the insertion of the commodity by the detection sensor 14, and control the operation of the imaging device 17 so as to capture an image of the inserted commodity. The control device 11 may control the imaging device 17 to capture an image of the commodity at any timing after the insertion of the commodity is detected. For example, the control device 11 may control the imaging device 17 to capture an image of the commodity immediately after the insertion of the commodity is detected. The control device 11 may appropriately obtain one or more images generated by this imaging from the imaging device 17. After generating one or more images, the control device 11 may stop the operation of the imaging device 17 or switch it to a standby state. According to this example, the period during which the imaging device 17 is activated can be narrowed down, and therefore a reduction in the processing load and power consumption in the smart grip 1 can be expected. In another example, the imaging device 17 may be controlled to continuously generate captured images. The generated captured images may be stored in a storage area such as the storage unit 12 for at least a certain period of time. The captured images generated at or around the time when the detection sensor 14 detects the insertion of the product are likely to include the inserted product. Therefore, the control device 11 may acquire one or more captured images generated at or around the time when the detection sensor 14 detects the insertion of the product from among the captured images stored in the storage area.

[0059] After acquiring the captured image, the control device 11 may identify the product shown in the captured image by performing image analysis on the acquired captured image. The method of identification by image analysis may be appropriately determined depending on the embodiment. In one example, when a code generated by encoding identification information of the product is assigned to the product, analyzing the captured image may include decoding the code assigned to the product. The type of code may be selected arbitrarily. The code may be, for example, a one-dimensional code, a two-dimensional code, etc. In another example, the control device 11 may identify the product from the characteristics (appearance, etc.) of the product in the image analysis, without relying on the code.

[0060] The method of image analysis is not particularly limited and may be appropriately selected depending on the embodiment. In one example, the control device 11 may analyze the captured image using a general image analysis method such as edge detection, pattern matching, etc. In another example, the control device 11 may analyze the captured image using a trained machine learning model that has acquired the ability to analyze images. The machine learning model is configured to include one or more calculation parameters that can be adjusted by machine learning. 1 The one or more calculation parameters are used for the calculation of the desired inference (such as image analysis). The machine learning model may be configured, for example, by a neural network, a support vector machine, or other functional formulas (calculation models). The machine learning method may be appropriately selected according to the machine learning model to be adopted (for example, backpropagation method, etc.). Training the machine learning model means adjusting (optimizing) the values ​​of the calculation parameters using training samples. The machine learning model may be appropriately trained so that when images of the training samples are given, it derives the true value of the corresponding analysis result. A large-scale model such as a large-scale visual language model may be used as the trained machine learning model.

[0061] The process of identifying the product does not necessarily have to be executed on the smart grip 1. The process of identifying the product may be executed on a computer other than the smart grip 1. The other computer may include, for example, an external computer such as a store terminal, a user terminal, or a server device. The other computer may identify the product by any method. In one example, the other computer may acquire information on the observation result of the product from the smart grip 1. The information on the observation result of the product may include, for example, sensing data such as the above-mentioned captured image. The other computer may identify the product based on the acquired information. The other computer may identify the product by a method similar to that of the smart grip 1. In another example, the other computer may not acquire information from the smart grip 1, but may acquire sensing data from sensors (one or more sensors) installed in the store and identify the product based on the acquired sensing data. The sensor to be used may be selected arbitrarily. For example, the sensor may include an imaging device installed so that the product shelf is included in the imaging range. In this case, the other computer may identify the inserted product by image analysis of the captured image obtained by the imaging device. Also, for example, the sensor may include a load sensor (weight sensor) installed to measure the weight of the product displayed on the product shelf. In this case, the other computer may identify the product shelf where the weight has changed (decreased) based on the measurement data of the load sensor, thereby identifying the added product. The control device 11 may appropriately acquire the identification result of the added product from the other computer, and may determine whether the added product belongs to the list or not according to the acquired identification result.

[0062] Similarly, at least one of the process of determining whether or not the inserted product belongs to the list and the process of counting the number 201 of products 40 does not necessarily have to be executed on the smart grip 1. These processes may also be executed on a computer other than the smart grip 1. The control device 11 may appropriately obtain the result of determining whether or not the inserted product belongs to the list or the result of counting the number 201 of products 40 from another computer.

[0063] (2)Second attribute 3 is a schematic diagram showing an example of the attribute 20 (second attribute) of the input of the product 40. In one example, the attribute 20 of the input of the product 40 may include at least one of the identification information 203 and the type 205 of the input product 40.

[0064] The identification information 203 indicates information (such as an identifier) ​​for identifying the product 40. The type 205 indicates a category for classifying the product 40. The identification information 203 and the type 205 may be appropriately acquired from the inserted product 40. In one example, the control device 11 may acquire at least one of the identification information 203 and the type 205 from the identification result of the product 40. The identification of the product 40 may be performed by any method. For example, as described above, the method of identifying the product 40 using the detection sensor 14 and the imaging device 17 may be adopted. The control device 11 may also acquire the identification result of the product 40 from another computer.

[0065] The correspondence between the identification information 203 / type 205 of the product 40 and the content of the feedback 25 may be appropriately defined depending on the embodiment. Outputting feedback 25 according to at least one of the information 203 and type 205 may include notifying at least one of the name and description of the product 40 using at least one of an image and an audio, notifying information related to the product 40 using at least one of an image and an audio, generating movement with a drive pattern according to at least one of the identification information 203 and type 205, etc.

[0066] The information related to the product 40 may include any information on the product 40 and other products (related products) that may be related to the product 40. The related products may include, for example, products displayed around the product 40 in a store, products that are likely to be purchased at the same time as the product 40, products that are used at the same time as the product 40, products recommended to users who purchase the product 40, and the like. In one example, the information related to the product 40 may include at least one of advertisement information, coupon information, and attribute information of at least one of the product 40 and the related products. The attribute information may include an expiration date, a release date, an allergy indication, a review, and the like. According to one example of the present embodiment, by providing feedback 25 that switches according to at least one of the identification information 203 and the type 205 of the product 40, it is expected that the possibility of overlooking the insertion of the product 40 can be reduced.

[0067] The identification information 203 and type 205 of the product 40 are examples of features derived from the product 40. Features derived from the product 40 used to determine the content of the feedback 25 may not be limited to the identification information 203 and type 205. In another example, the attribute 20 of the insertion of the product 40 may include at least one of the appearance feature and the physical feature of the inserted product 40. The appearance feature and the physical feature may be appropriately acquired from the product 40. For example, the appearance feature may be acquired from the result of image analysis of the captured image obtained by the imaging device 17. Also, for example, when the detection sensor 14 includes a load sensor, the weight of the product 40 may be measured by the load sensor, and the measurement result of the weight may be acquired as an example of a physical feature.

[0068] The correspondence between the appearance feature / physical feature of the product 40 and the content of the feedback 25 may be appropriately defined depending on the embodiment. As a specific example, the feedback 25 according to at least one of the appearance feature and the physical feature of the inserted product 40 may include notifying at least one of the appearance feature and the physical feature of the product 40 by at least one of an image and a sound, generating a movement with an attribute value according to at least one of the appearance feature and the physical feature, etc. Notifying the appearance feature may include notifying a message related to the appearance feature, such as "A white rectangular object has been inserted." Similarly, notifying the physical feature may include notifying a message related to the physical feature, such as "A heavy object has been inserted," "It's light," etc.

[0069] (3) Third attribute FIG. 4 illustrates an example of the attribute 20 (third attribute) of the insertion of the product 40. In one example, the smart grip 1 may further include a positioning sensor 15 configured to measure a position. The attribute 20 of the insertion of the product 40 may include an event position 207 measured by the positioning sensor 15 when the detection sensor 14 detects the insertion of the product 40, which is the event position 207 where the product 40 is inserted. The event position 207 may correspond to the current position of the user TU when the product 40 is inserted into the basket B1. In one example, the event position 207 may be measured in real time by the positioning sensor 15 in response to the detection sensor 14 detecting the insertion of the product 40.

[0070] The correspondence between the event position 207 where the product 40 is inserted and the content of the feedback 25 may be appropriately defined depending on the embodiment. As a specific example, outputting the feedback 25 according to the event position 207 includes notifying at least one of the event position 207 and the area to which the event position 207 belongs by at least one of an image and a sound, and displaying a feedback selected according to at least one of the event position 207 and the area to which the event position 207 belongs. The control may include outputting at least one of an image and a sound of the content selected according to the event location 207, generating a movement in a drive pattern according to at least one of the event location 207 and the area to which the event location 207 belongs, etc. The control may include outputting at least one of an image and a sound of the content selected according to the area to which the event location 207 belongs, for example, outputting the first coupon information in the first area and the second coupon information in the second area, etc. In one example of this case, an area to which the coupon information is not output may be set among the multiple areas. According to one example of the present embodiment, by providing the feedback 25 that switches according to the event location 207 of the product 40, it is expected that the possibility of overlooking the insertion of the product 40 can be reduced.

[0071] The area to which the event position 207 belongs may be determined by any method. In one example, the area in the store may be divided into a plurality of areas. Each area may be set arbitrarily. For example, each area may be set according to the classification of sales floors such as vegetables, fruits, fish, meat, daily necessities, etc. Among the plurality of areas set, two adjacent areas may at least partially overlap, or may not overlap. In addition, two adjacent areas may be arranged so as to be in contact with each other, or may be arranged so as to be at least partially separated from each other. There may be a range in the area in the store where no area is set. Area information 123 indicating the definition of each area set in the store may be stored in any storage area.

[0072] The source of the area information 123 may be appropriately determined depending on the embodiment. In one example, the smart grip 1 may further include a memory unit 12. The area information 123 may be pre-installed in the memory unit 12. In another example, the smart grip 1 may further include a communication module 16. The area information 123 may be stored in an external computer. The smart grip 1 may obtain the area information 123 from the external computer via a network using the communication module 16. The external computer is any computer other than the smart grip 1. As with the above-mentioned external computer OC, the external computer may be, for example, a store terminal, a user terminal, a server device, or the like.

[0073] The control device 11 may refer to the area information 123 to determine the area to which the event position 207 belongs among a plurality of areas set in the store. Note that, like the above-mentioned process of identifying the product, the process of determining the area to which the event position 207 belongs may not necessarily be executed on the smart grip 1. The process of determining the area to which the event position 207 belongs may also be executed on a computer other than the smart grip 1. For example, the control device 11 may request the other computer to execute a process of determining the area to which the event position 207 belongs by transmitting the event position 207 measured by the positioning sensor 15. In response to this request, the other computer may determine the area to which the event position 207 belongs. Then, the other computer may return the result of determining the area to which the event position 207 belongs to the control device 11. The control device 11 may receive this to obtain the result of determining the area to which the event position 207 belongs.

[0074] (Progress-dependent output format) Also, in one example, when the input attributes 20 include the event positions 207 into which the products 40 were input, determining the content of the feedback 25 according to the attributes 20 of the input of the products 40 may include determining the content of the feedback 25 such that the output feedback 25 approaches complete content 255 as the total number of areas to which the event positions 207 into which the products 40 were input belong approaches the target number. The configuration of this output format may be similar to the configuration of the output format based on the number 201 of products 40 described above, except that the indicator for evaluating the progress is replaced from the number 201 of input products 40 to the total number of areas.

[0075] The total number of areas to which the event location 207 belongs may be counted in any manner. In a simple example, one area may be counted only once. That is, if multiple event positions 207 belong to the same area, the total number of areas may be counted as 1. However, the method of counting the total number of areas is not limited to this example. At least one of multiple areas set in a store may be counted two or more times. An upper limit number of counts may be set for each area. According to one example of the present embodiment, it is possible to encourage the introduction of products 40 toward feedback 25 of complete content 255. In particular, it is possible to encourage the introduction of products 40 in multiple areas. This is expected to stimulate purchasing desire.

[0076] (4)Other The information used to determine the content of the feedback 25 may not be limited to only the attribute 20 of the input of the product 40. In another example, the control device 11 may further use any information other than the attribute 20 of the input of the product 40 to determine the content of the feedback 25. For example, determining the content of the feedback 25 according to the attribute 20 of the input of the product 40 may be configured by determining the content of the feedback 25 according to the attribute 20 of the input of the product 40 and the reference information 125. The reference information 125 may include at least one of attribute information of the user TU and environmental information related to the environment around the user TU. The attribute information may include, for example, gender, age, family structure, etc. The environmental information may include, for example, weather, temperature, humidity, etc. According to one example of the present embodiment, it is possible to expect the provision of feedback 25 that is suited to at least one of the attributes and environment of the user TU, such as outputting feedback for children when the family structure of the user TU includes children.

[0077] §2 Configuration example [Hardware configuration] 1, the smart grip 1 includes a computer to which a control device 11, a memory unit 12, a feedback module 13, a detection sensor 14, a positioning sensor 15, a communication module 16, and an imaging device 17 are electrically connected. In the smart grip 1, at least a part of the computer may be housed in a box.

[0078] The control device 11 includes a processor P and is configured to execute information processing based on a program and various data. The processor P is a hardware processor and is an example of a processor resource. The type of the processor P may be appropriately selected depending on the embodiment. For example, the processor P may be a CPU (Central Processing Unit), a microcomputer, or the like. The microprocessor may be composed of a microprocessor, a field-programmable gate array (FPGA), a digital signal processor (DSP), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), etc.

[0079] The storage unit 12 may be configured with a hard disk drive, a solid state drive, a semiconductor memory, or the like. The storage unit 12 is an example of a memory resource. In this embodiment, the storage unit 12 stores various information such as a program 81, content data 121, area information 123, and reference information 125. The program 81 is a program for causing the control device 11 to execute information processing (FIG. 9 described later) regarding the output of feedback 25 according to the input attribute 20. The program 81 includes a series of instructions for the information processing. At least one of the content data 121, the area information 123, and the reference information 125 may be omitted. At least one of the content data 121, the area information 123, and the reference information 125 may be held independently of the program 81, or may be included in the program 81.

[0080] At least one of the program 81, the content data 121, the area information 123, and the reference information 125 is stored in a storage medium SR1 instead of or together with the storage unit 12. The storage medium SR1 is configured to store various information (stored programs, etc.) by electrical, magnetic, optical, mechanical, or chemical action so that a machine such as a computer can read the information. The storage unit 12 and the storage medium SR1 are examples of non-transitory storage media. The smart grip 1 (computer) may obtain at least one of the program 81, the content data 121, the area information 123, and the reference information 125 from the storage medium SR1. The storage medium SR1 may be a disk-type storage medium (CD, DVD, etc.) or a non-disk type storage medium such as a semiconductor memory (flash memory, etc.). Any drive device may be used to read the information stored in the storage medium SR1. The type of drive device may be selected according to the storage medium SR1.

[0081] The detection sensor 14 is configured to detect the insertion of the product 40 into the basket B1. As long as the detection sensor 14 can detect the insertion of the product 40, the type of the detection sensor 14 is not particularly limited and may be appropriately selected depending on the embodiment. For example, the detection sensor 14 may be configured with one or more load sensors (weight sensors). In this case, the detection sensor 14 can detect the insertion of the product 40 by detecting a change (increase) in weight due to the insertion of the product 40. The detection sensor 14 may be disposed at any location where a change in load occurs due to the insertion of the product 40 (i.e., where a change in weight due to the insertion of the product 40 can be observed).

[0082] Also, for example, the detection sensor 14 may be composed of one or more imaging devices. The imaging device may be a device that captures an image or an image representation, such as an RGB camera, a depth sensor, an infrared sensor, a radar, or a LiDAR. The detection sensor 14 may include any sensor that acquires data by a sensor. In this case, the detection sensor 14 may be the same as the imaging device 17, or may be provided separately from the imaging device 17. The detection sensor 14 can detect the insertion of the product 40 by capturing the product 40 in an image captured by the imaging device. The detection sensor 14 may be disposed at any location where the product 40 is within the imaging range at least during the period from when the user picks up the product 40 to when the product 40 is placed in the basket B1 and after the product 40 is placed in the basket B1. When reducing the processing load and power consumption by narrowing the period during which the imaging device 17 is activated as described above, it is preferable to use, as the detection sensor 14, a sensor of a different type from the imaging device 17 and having a lower processing load and power consumption than the imaging device 17.

[0083] Furthermore, for example, the detection sensor 14 may be composed of one or more contact sensors. In this case, the detection sensor 14 can detect the insertion of the product 40 by contacting the detection sensor 14 with the inserted product 40 or with another object (such as a switch member) displaced by the insertion of the product 40. The detection sensor 14 may be disposed at any location where the inserted product 40 comes into direct or indirect contact with the detection sensor 14. Indirect contact may include contact with another object displaced by the insertion of the product 40. The detection sensor 14 may be composed of multiple types of sensors.

[0084] The positioning sensor 15 is configured to measure a position. As long as the position can be measured, the type of the positioning sensor 15 is not particularly limited and may be appropriately selected depending on the embodiment. For example, the positioning sensor 15 may be configured with a GPS (Global Positioning System) sensor, a GNSS (Global Navigation Satellite System) sensor, or the like. In addition, for example, The positioning sensor 15 may be configured with a beacon receiver. In this case, a plurality of beacon transmitters may be installed in the store. The position of the smart grip 1 may be appropriately measured (estimated) from the strength of the beacon signal received by the positioning sensor 15 (beacon receiver). For example, the positioning sensor 15 may estimate the distance to each beacon transmitter according to the strength of the signal received by the beacon receiver. The positioning sensor 15 may measure the position of the smart grip 1 from the estimated distance to each beacon transmitter by triangulation. At least a part of the process of measuring this position may be executed by the control device 11.

[0085] The communication module 16 is configured to perform wired or wireless communication over a network. The communication module 16 may be configured, for example, by a wired LAN (Local Area Network) module, a wireless LAN module, or the like. The communication module 16 may include a close-proximity wireless communication module. The network standard is not particularly limited and may be appropriately selected depending on the embodiment. For example, the type of network may be appropriately selected from the Internet, a wireless communication network, a mobile communication network, a telephone network, a dedicated network, or the like. The smart grip 1 (control device 11) can exchange data with another computer (for example, an external computer OC, etc.) via the communication module 16.

[0086] In addition, regarding the specific hardware configuration of the smart grip 1 (computer), components can be omitted, replaced, and added as appropriate depending on the embodiment. For example, the control device 11 may include multiple hardware processors (processor P). At least one of the positioning sensor 15, the communication module 16, and the imaging device 17 may be omitted. At least one of the program 81, the content data 121, the area information 123, and the reference information 125 may be stored in an external storage device such as a NAS (Network Attached Storage). The external storage device is also an example of a non-transitory storage medium. The smart grip 1 may be configured to be operable by further including an input device. The input device may be configured to accept input of information. The input device may be configured, for example, by a keyboard, a touch panel, an operator, a microphone, etc. When the input device includes a microphone, the operation of the input device may include voice input. When the feedback module 13 includes the output device 33, the input device and the output device 33 may be integrally configured by a touch panel display, etc. The smart grip 1 may include multiple computers. The hardware configurations of the computers may or may not be the same. The computer included in the smart grip 1 may be a dedicated computer or a general-purpose PC (Personal Computer). It is composed of a tablet PC, a terminal device (including a smartphone), etc. For example, the computer included in the smart grip 1 may be configured by a smartphone. The smart grip 1 may be constructed by mounting the smartphone on a housing (attachment).

[0087] [Smart Grip Structure] 5 and 6 are a side view and a plan view showing an example of the structure of the smart grip 1 according to this embodiment. In one example, the smart grip 1 may further include a housing 90 that houses the detection sensor 14, the feedback module 13, and the control device 11. The housing 90 may include one or more grooves (groove 915, groove 935, etc.) for hooking the handle B11 provided on the basket B1. According to this example of the present embodiment, it is possible to provide a smart grip 1 that can be used as a handle for a basket by replacing the handle (handle B11) of an existing basket.

[0088] The structure of the smart grip 1, such as the shape of the housing 90, the size of the housing 90, the arrangement of each component (such as the control device 11) in the housing 90, the number of grooves, the shape of the grooves, and the arrangement of the grooves, may be appropriately determined depending on the embodiment. In the example of Fig. 5 and Fig. 6, a situation is assumed in which the feedback module 13 includes a vibration motor 300 and a servo motor 305 as the haptic feedback module 30. A situation is assumed in which the feedback module 13 further includes a display 331 and a speaker 333. A situation is assumed in which the detection sensor 14 is configured by a pair of load sensors 140, and the imaging device 17 is provided separately from the detection sensor 14. A situation is assumed in which the housing 90 includes a pair of grooves (915, 935).

[0089] For the sake of convenience, the left-right direction in Fig. 5 and Fig. 6 will be referred to as the "front-rear direction". The left direction in Fig. 5 and Fig. 6 will be referred to as the "front direction", and the right direction in Fig. 5 and Fig. 6 will be referred to as the "rear direction". The direction perpendicular to the paper surface of Fig. 5 and the up-down direction in Fig. 6 will be referred to as the "left-right direction". 6 is referred to as the "right direction", and the downward direction in Fig. 6 is referred to as the "left direction". The up and down directions in Fig. 5 and the direction perpendicular to the paper surface of Fig. 6 are referred to as the "up and down directions". The upward direction in Fig. 5 is referred to as the "upward direction", and the downward direction in Fig. 5 is referred to as the "downward direction".

[0090] In one example, the housing 90 may include a first portion 91, a second portion 92, and a third portion 93. In one example of each figure, the first portion 91, the second portion 92, and the third portion 93 are arranged in a line in the front-rear direction from the rear. Each portion (91, 92, 93) is formed in a rectangular parallelepiped shape. The first portion 91 and the third portion 93 may have substantially the same shape. The width (length in the left-right direction) of the second portion 92 may be formed shorter than the first portion 91 and the third portion 93. As a result, the second portion 92 may constitute a portion to be held by the user. In one example of each figure, the second portion 92 extends along the front-rear direction. Therefore, the user can hold the smart grip 1 by holding the second portion 92 with his / her hand along the front-rear direction. The total length of the circumference of the second portion 92 around the axis in the front-rear direction may be determined within a range of a length that can be held by hand.

[0091] Side walls may be provided at the ends of each part (91, 92, 93) in the horizontal direction (left-right direction and front-back direction). A bottom surface may be provided at the lower end of each part (91, 92, 93). As a result, an internal space may be formed in each part (91, 92, 93) that is surrounded by each side wall and that houses the computer part of the smart grip 1. The internal spaces of the first part 91 and the second part 92 may be at least partially continuous. The internal spaces of the second part 92 and the third part 93 may also be at least partially continuous. The upper end of each part (91, 92, 93) may be closed by a lid or the like, or may be open.

[0092] A groove 915 may be provided on the rear end side of the first portion 91. In one example of each figure, the groove 915 is formed by recesses provided on side walls opposing each other in the left-right direction of the first portion 91. Each recess is formed in a rectangular shape. The recesses are aligned in the front-rear direction to form the groove 915. Even when the upper end of the first portion 91 is closed, the portion of the groove 915 on the upper end surface of the first portion 91 may be open.

[0093] Similarly, a groove 935 may be provided on the front end side of the third portion 93. In one example of each figure, the groove 935 is formed by recesses provided on side walls opposing each other in the left-right direction of the third portion 93. Each recess is formed in a rectangular shape. The recesses are aligned in the front-rear direction to form the groove 935. Even when the upper end of the third portion 93 is closed, the portion of the groove 935 on the upper end surface of the third portion 93 may be open. The width (length in the front-rear direction) of each groove (915, 935) may be formed to be the same as or slightly larger than the width of the corresponding handle portion B11 of the basket B1. In this way, each groove (915, 935) may be configured to be able to receive each handle portion B11 of the basket B1.

[0094] (Detection sensor) The pair of load sensors 140 may be disposed in the internal space of each of the first and third parts 91 and 93 in accordance with the positions of the pair of grooves (915, 935). When the portion of the handle B11 that is to be hooked onto the smart grip 1 is formed in a straight line, in one example, the recesses constituting each groove (915, 935) may be formed so that the lower end of the recess is located slightly lower than the measurement portion (contact surface with the handle B11) of the load sensor 140. In this way, when each handle B11 is hooked onto each groove (915, 935), each handle B11 comes into contact with the measurement portion of each load sensor 140. As a result, each load sensor 140 can observe the change in weight when the product 40 is put into the basket B1 (basket body B10). The location of the load sensor 140 is an example of a location where a change in load occurs when the product 40 is put into the basket B1. However, the positional relationship between the grooves (915, 935) and the load sensors 140 is not limited to this example, and may be changed as appropriate depending on the embodiment, such as the shape of the handle portion B11. For example, when the handle portion B11 is hung on the smart grip 1, the portions (91, 93) The portion located in the internal space may be curved downward. In this case, the recess constituting each groove (915, 935) may be formed so that the lower end of the recess is located above the measurement portion of the load sensor 140.

[0095] (Imaging device) In one example of each figure, the imaging device 17 is disposed in the internal space of the first part 91. For example, an opening may be provided on the bottom surface of the first part 91 in accordance with the position of the imaging section 171 (light receiving section, etc.) of the imaging device 17. The imaging device 17 may be disposed so that the imaging section 171 is exposed from the bottom surface of the first part 91 by fitting the imaging section 171 into the opening on the bottom surface. This allows the imaging device 17 to capture an image of the area below the smart grip 1. Therefore, by hooking each handle part B11 of the basket B1 into each groove (915, 935), when the smart grip 1 is attached to the basket B1, the imaging device 17 can include the storage section of the basket body B10 in the imaging range. As a result, when the product 40 is inserted into the basket body B10, the imaging device 17 can observe the inserted product 40. The location where the imaging device 17 is disposed is one example of a location where the inserted product 40 can be observed.

[0096] (Box / Output Device) In addition, in one example of each figure, the control device 11, the memory unit 12, the positioning sensor 15, the communication module 16, and the speaker 333 are housed in a box 1100. The box 1100 is formed in a rectangular parallelepiped shape and is arranged in the internal space of the third part 93. In the box 1100, one or more openings may be provided in the arrangement part of the speaker 333. The speaker 333 is used to output the auditory feedback 25. A display 331 is arranged on the upper surface of the box 1100. When the upper end of the third part 93 is closed, the display 331 may be arranged so that the screen is exposed from the upper end surface of the third part 93. In this example, when the user TU normally holds the smart grip 1, the third part 93 is located in front of the second part 92. Therefore, while using the smart grip 1, the screen of the display 331 is located slightly in front of the hand of the user TU. This allows the user TU to easily view the screen of the display 331 without being obstructed by body parts while using the smart grip 1. The display 331 is used to output visual feedback 25.

[0097] (Haptic feedback module) In one example of each figure, the haptic feedback module 30 includes a vibration motor 300 and a servo motor 305. The vibration motor 300 and the servo motor 305 are disposed in the internal space of the second part 92. In this example, the second part 92 constitutes the part that is held by the user TU. Therefore, by disposing the vibration motor 300 and the servo motor 305 in the second part 92, the user TU using the smart grip 1 can be given haptic feedback 25. This location of the vibration motor 300 and the servo motor 305 is an example of a location where motion can be transmitted to the part that is held by the user TU. The types of the vibration motor 300 and the servo motor 305 are not particularly limited, and may be appropriately selected according to the embodiment.

[0098] The vibration motor 300 is configured to be able to output feedback by generating vibration. The servo motor 305 may include a shaft 3051 and an arm 3052. The shaft 3051 constitutes a rotation axis. The arm 3052 is attached to the shaft 3051. For example, the arm 3052 may be attached to the tip of the shaft 3051. The arm 3052 rotates around the axis of the shaft 3051 in response to the rotation of the shaft 3051. The arm 3052 may be configured so that a part of the arm 3052 (for example, the tip) directly contacts the hand of the user TU holding the second part 92 by rotating clockwise or counterclockwise. Alternatively, the arm 3052 may be configured so that a part of the arm 3052 (for example, the tip) directly contacts the hand of the user TU holding the second part 92 by rotating clockwise or counterclockwise. The arm 3052 may be configured so that the tip of the arm 3052 hits the side wall of the second portion 92, and vibrations (indirect contact) generated thereby are transmitted to the hand of the user TU holding the second portion 92. With these configurations, the servo motor 305 is configured to be able to output feedback by linear or indirect contact. In one example of each figure, the arm 3052 is formed in a flat plate shape. However, the shape of the arm 3052 is not limited to this example. As long as the arm 3052 can output direct or indirect contact by rotating, the shape of the arm 3052 is not particularly limited, and may be appropriately selected depending on the embodiment.

[0099] In one example of each figure, the smart grip 1 includes a vibration motor 300, and the attributes whose values ​​are determined according to the input attribute 20 may include at least one of the number of vibrations, intensity, and period of the vibration motor 300. Also, the smart grip 1 includes a servo motor 305, and the attributes whose values ​​are determined according to the input attribute 20 may include at least one of the number of vibrations (number of contacts), intensity, period, and direction of the swinging of the arm 3052 of the servo motor 305. By driving at least one of the vibration motor 300 and the servo motor 305, haptic feedback 25 can be generated.

[0100] In one example, feedback pointing to the left can be given by rotating the arm 3052 clockwise (swinging the arm 3052 clockwise) and transmitting an impact from the arm 3052 to the left side of the hand of the user TU holding the second part 92. On the other hand, feedback pointing to the right can be given by rotating the arm 3052 counterclockwise (swinging the arm 3052 counterclockwise) and transmitting an impact from the arm 3052 to the right side of the hand of the user TU holding the second part 92. As in these examples, the servo motor 305 can output feedback intuitively indicating the direction of the target by swinging the arm 3052 in the direction of the target. Therefore, the attribute whose value is determined according to the input attribute 20 may be configured to include the direction of swinging the arm 3052 of the servo motor 305, so that the output feedback 25 intuitively indicates the direction of the target.

[0101] (others) The structure of the smart grip 1 is not limited to the examples shown in Figs. 5 and 6, and may be modified as appropriate depending on the embodiment. For example, the shape of the housing 90 may be modified as appropriate. In another example, the housing of the smart grip 1 may be formed in a ring shape, and a part of the ring may be configured to be openable and closable by attaching and detaching the ends. As a result, the housing of the smart grip 1 may be configured to replace the handle by receiving the handle portion B11 of the basket B1 in the ring formed by the housing. In yet another example, the housing of the smart grip 1 may be formed to receive a terminal device such as a smartphone. In this case, the smart grip 1 may be constructed by attaching the terminal device to the housing.

[0102] In addition, the position of each groove (915, 935) may be changed as appropriate. The number of grooves provided in the housing (housing 90) is not limited to two, and may be one, or may be three or more. In addition, the arrangement of each component may be changed as appropriate. The arrangement of the load sensor 140 may be changed as appropriate depending on the structure of the housing (housing 90). When a sensor other than the load sensor 140 is used as the detection sensor 14, the detection sensor 14 may be appropriately arranged in a location where the insertion of the product 40 can be detected. The arrangement of the imaging device 17 may be changed as appropriate depending on the embodiment. The imaging device 17 may be arranged in a location other than the internal space of the first portion 91. The components housed in the box 1100 may be changed as appropriate. The box 1100 may be arranged in a location other than the internal space of the third portion 93. The box 1100 may be omitted.

[0103] In the haptic feedback module 30, at least one of the vibration motor 300 and the servo motor 305 may be omitted. The number of the vibration motor 300 is not limited to one, and may be two or more. The number of the servo motor 305 is also not limited to one, and may be two or more. There may be more than one.

[0104] FIG. 7 is a plan view showing another example of the structure of the smart grip 1 according to the present embodiment. In another example, the haptic feedback module 30 may include four vibration motors (301, 302, 303, 304) instead of the vibration motor 300 and the servo motor 305 in the structural examples of FIGS. 5 and 6. The four vibration motors (301, 302, 303, 304) may be arranged separately in the front-rear direction and the left-right direction with the center of the second portion 92 as the reference point PO. The first vibration motor 301 may be arranged forward from the reference point PO. The second vibration motor 302 may be arranged right from the reference point PO. The third vibration motor 303 may be arranged left from the reference point PO. The fourth vibration motor 304 may be arranged rearward from the reference point PO. Except for these points, the structural example of FIG. 7 may be configured similarly to the structural examples of FIG. 5 and FIG. 6. The four vibration motors (301, 302, 303, 304) are an example of a plurality of vibration motors.

[0105] In one example, the smart grip 1 includes four vibration motors (301, 302, 303, 304), and the attributes whose values ​​are determined according to the input attribute 20 may include at least any one of the number of vibrations, the intensity, and the period of vibration of at least any one of the four vibration motors (301, 302, 303, 304). In addition, the attributes whose values ​​are determined according to the input attribute 20 may include the drive pattern (vibration pattern) of the four vibration motors (301, 302, 303, 304).

[0106] The drive pattern may include a drive pattern that intuitively conveys the direction of the target. The drive pattern that intuitively conveys the direction of the target may be appropriately determined according to the embodiment. In one example, the drive pattern that intuitively conveys the direction of the target may include at least one of vibrating a vibration motor among the four vibration motors (301, 302, 303, 304) that corresponds to the direction of the target more strongly than the remaining vibration motors, and vibrating at least two or more vibration motors among the four vibration motors (301, 302, 303, 304) in an order that corresponds to the direction of the target.

[0107] For example, the control device 11 can provide the user TU with feedback indicating the forward direction by vibrating the first vibration motor 301 more strongly than the remaining vibration motors (302, 303, 304). The control device 11 can provide the user TU with feedback indicating the backward direction by vibrating the fourth vibration motor 304 more strongly than the remaining vibration motors (301, 302, 303). The same applies to the left and right directions. In one example, the drive pattern for which the value is determined according to the input attribute 20 may include vibrating the vibration motor corresponding to the target direction among the four vibration motors (301, 302, 303, 304) as in these examples more strongly than the remaining vibration motors. In this way, the control device 11 may output feedback 25 that intuitively conveys the target direction.

[0108] The number of vibration motors that are vibrated more strongly than the remaining vibration motors may not be limited to one, and may be more than one. For example, the control device 11 may indicate a direction between the front and the right by vibrating the first vibration motor 301 and the second vibration motor 302 more strongly than the other vibration motors (303, 304). Also, for example, the control device 11 may indicate a direction closer to the front by vibrating the first vibration motor 301 more strongly than the second vibration motor 302, among the first vibration motor 301 and the second vibration motor 302 that are vibrated strongly. As in these examples, the control device 11 may indicate a direction between the positions where the vibration motors are arranged by vibrating the multiple vibration motors more strongly than the remaining vibration motors. Also, the haptic feedback module 30 may continuously indicate the direction of the target by varying the strength of vibration among the multiple vibration motors that are vibrated strongly.

[0109] Also, for example, the control device 11 may output feedback indicating the right direction to the user TU by vibrating the third vibration motor 303 and then vibrating the second vibration motor 302. Conversely, the control device 11 may output feedback indicating the left direction to the user TU by vibrating the second vibration motor 302 and then vibrating the third vibration motor 303. Also, the control device 11 may output feedback indicating a direction between forward and right by vibrating the third vibration motor 303 and then vibrating the first vibration motor 301. The same applies to other directions. In one example, the drive pattern for which the value is determined according to the input attribute 20 may include vibrating at least two or more of the four vibration motors (301, 302, 303, 304) as in these examples in an order corresponding to the target direction. In this way, the control device 11 may output feedback 25 that intuitively conveys the target direction.

[0110] The order of vibration may be arbitrarily defined. In one example, determining the order of vibration of two or more vibration motors may be configured by selecting at least two or more vibration motors located along the direction of the target from among the four vibration motors (301, 302, 303, 304) as in the above example, and vibrating the vibration motors located closer to the rear end in the direction of the target first among the two or more selected vibration motors, and vibrating the vibration motors located closer to the tip end in the direction of the target last. Note that the strength of vibration (intensity, period, etc.) of at least two or more vibration motors pointing to a direction may be the same or different. In one example, the control device 11 may vibrate the vibration motors located closer to the rear end in the direction of the target more weakly and vibrate the vibration motors located closer to the tip end in the direction of the target more strongly. This makes it possible to output feedback that emphasizes the tip end side of the pointing direction.

[0111] In addition, if two or more vibration motors are provided, comparison of directions is possible. Therefore, when the haptic feedback module 30 is configured to be able to output feedback that intuitively indicates the direction of a target, the number of vibration motors included in the haptic feedback module 30 is not limited to four, and may be two, three, or five or more. At least one of the four vibration motors (301, 302, 303, 304) may be omitted. For example, the haptic feedback module 30 may be configured to be able to indicate the left and right directions by omitting the first vibration motor 301 and the fourth vibration motor 304.

[0112] In addition, the position of the reference point PO of each vibration motor (301, 302, 303, 304) may not be limited to the center of the second portion 92, and may be appropriately determined according to the embodiment. The position of the reference point PO may be appropriately defined according to the number and arrangement of the vibration motors. In order to easily sense the direction indicated by the vibration of the vibration motor, it is preferable that the reference point PO is set at or near the center of the part that the user TU normally holds. This allows the user TU to easily sense the direction indicated by the haptic feedback module 30 according to the deviation of the vibration from the part that is held. In yet another example, the haptic feedback module 30 may include both a servo motor and a plurality of vibration motors. Accordingly, the haptic feedback module 30 may be configured to output feedback indicating a specific direction by both the servo motor and the vibration motor.

[0113] [Software configuration] FIG. 8 shows a schematic diagram of an example of the software configuration of the smart grip 1 (control device 11) according to this embodiment. The control device 11 of the smart grip 1 executes instructions contained in a program 81 stored in the storage unit 12 by the processor P. As a result, the smart grip 1 (control device 11) operates as a computer equipped with a detection unit 111, a determination unit 112, and a feedback unit 113 as software modules. That is, in this embodiment, each software module of the smart grip 1 is controlled by the control device 11 (processor This is achieved by

[0114] The detection unit 111 is configured to detect the insertion of the product 40 in accordance with the measurement result of the detection sensor 14. The determination unit 112 is configured to determine the content of the feedback 25 in accordance with the attribute 20 of the detected insertion of the product 40 in the basket B1 in response to the detection sensor 14 detecting the insertion of the product 40 in the basket B1. The feedback unit 113 is configured to output the feedback 25 of the determined content to the user TU via the feedback module 13 in response to the detection sensor 14 detecting the insertion of the product 40 in the basket B1.

[0115] In this embodiment, an example is described in which each software module of the smart grip 1 is realized by a general-purpose processor (processor P). However, some or all of the above software modules may be realized by one or more dedicated processors or chipsets. Each of the above modules may be realized as a hardware module. With regard to the software configuration of the smart grip 1, modules may be omitted, replaced, or added as appropriate depending on the embodiment.

[0116] §3 Example of operation FIG. 9 is a flowchart showing an example of a processing procedure for outputting the feedback 25 by the control device 11 of the smart grip 1 according to this embodiment. The following processing procedure is an example of a control method (information processing method) executed by a computer (control device 11). However, the following processing procedure is merely an example, and each step may be modified as much as possible. Furthermore, steps in the following processing procedure may be omitted, replaced, or added as appropriate depending on the embodiment.

[0117] In step S101, the control device 11 operates as the detection unit 111. The control device 11 acquires a measurement result from the detection sensor 14. The control device 11 detects the insertion of the product 40 according to the measurement result of the detection sensor 14. If the insertion of the product 40 is detected, the control device 11 proceeds to the next step S102. If the insertion of the product 40 is not detected, the control device 11 repeatedly executes the process of step S101 and waits until the insertion of the product 40 is detected.

[0118] In step S102, the control device 11 operates as the determination unit 112. In response to the detection of the insertion of the product 40 in step S101, the control device 11 determines the content of the feedback 25 according to the attributes 20 of the detected insertion of the product 40. In one example, the attributes 20 of the insertion of the product 40 may include at least one of the number 201 of the inserted products 40, the identification information 203, the type 205, and the event position 207. Thereby, the feedback 25 may be generated according to at least one of the number 201 of the inserted products 40, the identification information 203, the type 205, and the event position 207. After determining the content of the feedback 25, the control device 11 proceeds to the next step S103.

[0119] In step S103, the control device 11 operates as the feedback unit 113. The control device 11 outputs feedback 25 of the determined content to the user TU via the feedback module 13. In one example, the output feedback 25 may include at least one of visual, auditory, and tactile feedback. After outputting the feedback 25, the control device 11 proceeds to the next step S104.

[0120] In step S104, the control device 11 judges whether or not to end the process. The judgment criteria may be set arbitrarily. In one example, the control device 11 may judge not to end the process until an end instruction is given. On the other hand, when an end instruction is given, the control device 11 may judge to end the process. The end instruction may be given by any method. In another example, If the target user (user TU) is present in the store, the control device 11 may determine not to end the process. On the other hand, if the target user is not present in the store (has left the store), the control device 11 may determine to end the process. Whether the target user is present in the store may be appropriately determined based on the measurement results of the positioning sensor 15, etc.

[0121] When it is determined not to end the process, the control device 11 returns the process to step S101 and executes the process again from step S101. In one example, in the process of repeatedly executing the processes of steps S101 to S103, the control device 11 may output feedback 25 whose content is determined so that the output feedback 25 approaches the complete content 255 as the number 201 (total number) of inserted products 40 approaches the target number. Also, in one example, in the process of repeatedly executing the processes of steps S101 to S103, the control device 11 may output feedback 25 whose content is determined so that the output feedback 25 approaches the complete content 255 as the total number of areas to which the event positions 207 into which the products 40 are inserted belong approaches the target number.

[0122] When it is determined that the process is to be ended, the control device 11 ends the process procedure related to the output of the feedback 25 according to this operation example. The timing of ending the process is not limited to this example. The control device 11 may end the process procedure related to the output of the feedback 25 at any timing. In one example, the control device 11 may execute a series of processes from step S101 to step S104 in real time.

[0123] According to this embodiment, in response to the detection of the insertion of the product 40 by the detection sensor 14 through the processes of steps S102 and S103, feedback 25 according to the attribute 20 of the insertion of the product 40 is given. As a result, according to this embodiment, it is expected that the possibility of overlooking the insertion of the product 40 into the basket B1 will be reduced. In addition, since there is a reaction (feedback 25) to the insertion of the product 40, it is also expected to act as a nudge that encourages behavioral change (for example, stimulating purchasing motivation, etc.).

[0124] § 4 Variations Although the embodiment of the present disclosure has been described in detail above, the above description is merely an example of the present disclosure in every respect. The processes and means described in the present disclosure can be freely combined and implemented as long as no technical contradiction occurs. In addition, various improvements or modifications may be made to the above embodiment as appropriate. For example, the following modifications are possible. In the following, the same reference numerals are used for components similar to those in the above embodiment, and the description of the same points as those in the above embodiment is omitted as appropriate.

[0125] <4.1> The above embodiment is configured as a smart grip 1. However, the embodiment of the present disclosure may not be limited to the above smart grip 1. The embodiment of the present disclosure may be a component of a basket used for shopping, or may be a basket (including a cart) itself. The type of basket is not particularly limited, and may be appropriately selected depending on the embodiment.

[0126] (First Modification) FIG. 10 is a schematic diagram showing another example of a situation to which the present disclosure is applied. In the example shown in FIG. 10, the embodiment of the present disclosure is a shopping basket 1A. The shopping basket 1A includes a basket body 102A, a detection sensor 14, a feedback module 13, and a control device 11. The basket body 102A may be configured similarly to the basket body B10 of the basket B1 described above. Except for replacing the basket body B10 with the basket body 102A, the detection sensor 14, the feedback module 13, and the control device 11 may be configured similarly to the above embodiment. That is, the detection sensor 14 may be configured to detect the insertion of a commodity 40 into the basket body 102A. The control device The device 11 may be configured to, in response to detection by the detection sensor 14 of the insertion of a product 40 into the basket body 102A, determine the content of feedback 25 in accordance with the attributes 20 of the detected insertion of the product 40, and output the determined feedback 25 to the user TU via the feedback module 13.

[0127] Other configurations of the shopping basket 1A are not particularly limited and may be appropriately determined depending on the embodiment. In one example, the shopping basket 1A may include a pair of handles 101A attached to the basket body 102A, and a grip 100A spanning the pair of handles 101A. Each handle 101A may be configured similarly to each handle B11 of the basket B1. When adopting these configurations, in one example, the shopping basket 1A may be constructed by using the above-mentioned smart grip 1 for the grip 100A. However, the method of constructing the shopping basket 1A is not limited to such an example.

[0128] Like the smart grip 1, the shopping basket 1A may further include a memory unit 12. The shopping basket 1A may further include at least one of a positioning sensor 15, a communication module 16, and an imaging device 17. When the shopping basket 1A includes the positioning sensor 15, the attribute 20 of the insertion of the product 40 may include an event position 207 where the product 40 was inserted. When the shopping basket 1A further includes the imaging device 17, the control device 11 may acquire an image captured by the imaging device 17 when the detection sensor 14 detects the insertion of the product 40, and identify the product 40 by performing image analysis on the acquired image.

[0129] The location where the computer portion of the shopping basket 1A (control device 11 to imaging device 17) is arranged does not have to be limited to the grip 100A. At least a part of the computer portion of the shopping basket 1A may be arranged at any location other than the grip 100A. In another example, when a load sensor is used as the detection sensor 14, the detection sensor 14 may be arranged on the bottom surface of the storage section of the basket body 102A. The imaging device 17 may be arranged on the edge of the opening of the basket body 102A with the imaging unit 171 facing toward the storage section of the basket body 102A.

[0130] The shopping basket 1A according to this modification can provide the user TU with feedback 25, similar to the smart grip 1. Therefore, according to this modification, it is expected that the possibility of overlooking the insertion of the product 40 can be reduced. In addition, it is expected that the shopping basket 1A acts as a nudge to encourage behavioral change. The configuration of the shopping basket 1A may be appropriately changed depending on the embodiment. In another example, the grip 100A may be omitted. In this case, the user may hold the shopping basket 1A by grasping the pair of handle parts 101A. When the feedback module 13 includes the haptic feedback module 30, the haptic feedback module 30 may be disposed at any position where the motion can be transmitted to at least one of the pair of handle parts 101A.

[0131] (Second Modification) FIG. 11 is a schematic diagram of another example of a scene to which the present disclosure is applied. In the example of FIG. 11, the embodiment of the present disclosure is a shopping basket 1B. The shopping basket 1B corresponds to an embodiment in which the shopping basket 1A is further provided with one or more wheels 103B, thereby forming a cart. That is, the shopping basket 1B includes a basket body 102B, a detection sensor 14, a feedback module 13, a control device 11, and one or more wheels 103B. The basket body 102B may be the same as the basket body 102A of the first modified example. The detection sensor 14 may be configured to detect the insertion of the product 40 into the basket body 102B. In response to the detection of the insertion of the product 40 into the basket body 102B by the detection sensor 14, the control device 11 may be configured to determine the content of the feedback 25 according to the attribute 20 of the detected insertion of the product 40, and to output the determined content of the feedback 25 to the user TU via the feedback module 13. The wheel 103B The number may be appropriately selected depending on the embodiment. In a typical example, the shopping basket 1B may include four wheels 103B. The shopping basket 1B may be called a shopping cart.

[0132] The arrangement of the wheels 103B and the configuration for supporting the basket body 102B may be appropriately determined according to the embodiment. In one example, the shopping basket 1B may include a grip 100B and a base 101B. The base 101B may include a leg 1011B and a support 1012B. The leg 1011B may be disposed below the basket body 102B. Each wheel 103B may be attached to the leg 1011B. The support 1012B may be configured to extend vertically upward from one end of the leg 1011B. The basket body 102B may be fixed to the support 1012B. The grip 100B may be attached to the upper end of the support 1012B.

[0133] As a result, the shopping basket 1B may have a configuration similar to that of a general shopping cart. However, the configuration of the shopping basket 1B need not be limited to this example. The shopping basket 1B may have a configuration similar to that of other types of carts, such as a silver cart. Furthermore, when these configurations are adopted, in one example, the shopping basket 1B may be constructed by using the above-mentioned smart grip 1 for the grip 100B. However, the method of constructing the shopping basket 1B need not be limited to this example.

[0134] Like the smart grip 1, the shopping basket 1B may further include a memory unit 12. The shopping basket 1B may further include at least one of a positioning sensor 15, a communication module 16, and an imaging device 17. Like the first modified example, when the shopping basket 1B includes the positioning sensor 15, the attribute 20 of the insertion of the product 40 may include an event position 207 where the product 40 was inserted. When the shopping basket 1B further includes the imaging device 17, the control device 11 may execute an identification process of the product 40 by image analysis.

[0135] The location where the computer part of the shopping basket 1B (control device 11 to imaging device 17) is arranged does not have to be limited to the grip 100B. At least a part of the computer part of the shopping basket 1B may be arranged at any location other than the grip 100B. In another example, when a load sensor is used for the detection sensor 14, the detection sensor 14 may be arranged on the bottom surface of the storage part of the basket body 102B. The imaging device 17 may be arranged on the edge of the opening of the basket body 102B or in the area of ​​the support part 1012B from the upper end of the basket body 102B to the grip 100B, with the imaging part 171 facing toward the storage part of the basket body 102B.

[0136] The shopping basket 1B according to this modification can also provide the user TU with feedback 25, similar to the smart grip 1. Therefore, according to this modification, it is expected that the possibility of overlooking the insertion of the product 40 can be reduced. In addition, it is also expected to act as a nudge to encourage behavioral change. The basket body 102B may be used as a basket receiver. In this case, other baskets may be placed in the basket body 102B, and the product 40 may be inserted into the other baskets. The detection sensor 14 may be appropriately placed so as to be able to detect the insertion of the product 40 into the other baskets. Detecting the insertion of the product 40 into the basket body 102B may include detecting the insertion of the product 40 into the other baskets placed in the basket body 102B. In addition, the leg 1011B may be configured to receive luggage. In this case, the detection sensor 14 may also be placed in the leg 1011B. When identification of the product 40 by image analysis is also performed on the leg portion 1011B, the imaging device 17 may be further disposed on the leg portion 1011B.

[0137] <4.2> In the above embodiment and modified example, the smart grip 1 and each shopping basket (1A, 1B) exist in the real space, and the feedback 25 is output for purchasing behavior in the real space. However, purchasing behavior is not limited to being performed in the real space. For example, Purchasing behavior can also occur in virtual spaces such as EC (Electronic Commerce) sites and VR (Virtual Reality) spaces. The above-mentioned oversight problems can also occur in purchasing behavior in virtual spaces.

[0138] Therefore, the above embodiment may be applied to purchasing behavior in a virtual space. That is, one embodiment of the present disclosure may be an information processing device (computer) configured to be able to output feedback 25 similar to the smart grip 1 and each shopping basket (1A, 1B) for purchasing behavior in a virtual space. In addition, one embodiment of the present disclosure may be an information processing method for realizing all or a part of such an information processing device, a program, or a storage medium that stores such a program and is readable by a machine such as a computer.

[0139] [Example of application] FIG. 12 is a schematic diagram showing another example of a scene to which the present disclosure is applied. In the example of FIG. 12, a scene is assumed in which the information processing device 5 is a user terminal. In one example, the information processing device 5 may include a control unit 51. The control unit 51 may be configured to receive the selection of a product 40A by a user TU in a virtual store C0, to put the selected product 40A into a cart C1, and to determine the content of a feedback 25A according to the attribute 20A of the put-in of the product 40A in response to the put-in of the product 40A into the cart C1, and to output the determined content of the feedback 25A to the user TU via a feedback module 53. This information processing device 5 is an example of an information processing device of the present disclosure. According to this modified example, it is expected that the possibility of overlooking the put-in of the product 40A can be reduced for purchasing behavior in a virtual space, as in the above embodiment. It is also expected to act as a nudge to encourage behavioral change.

[0140] Each component of the above embodiment and modified example may be replaced from an entity in real space to an entity in virtual space and applied to this modified example as appropriate. Putting product 40 into basket B1 (shopping basket 1A, shopping basket 1B) in a store in real space is replaced by selecting product 40A in virtual store C0 and putting the selected product 40A into cart C1. The virtual store C0 may correspond to the above store. The cart C1 may correspond to the above basket B1 and each shopping basket (1A, 1B). Any system may be used for the virtual store C0 and cart C1. A known EC site system may be used for the virtual store C0 and cart C1.

[0141] In a typical example, the EC site system may be deployed in an external server ES. As a result, the external server ES may build a virtual store C0 and a cart C1 in a virtual space such as a VR space or a website. The information processing device 5 may further include an output device 59 (display 591), an input device 54, and a communication module 55. The information processing device 5 may access the external server ES via a network using the communication module 55. As a result, the user TU can enter the virtual store C0. Entering the virtual store C0 may include, for example, browsing a website, entering the VR space, etc.

[0142] The information processing device 5 may receive the selection of the product 40A by displaying the virtual store C0 on the display 591. The user TU may select the product 40A by operating the input device 54. The operation of the input device 54 may include voice input. For example, in the virtual store C0, a button C5 for adding the product 40A to the cart C1 may be provided for each product 40A. The user TU can select the product 40A by operating the button C5 with the input device 54. When the product 40A is selected, the information processing device 5 may request the external server ES to register the selected product 40A in the cart C1 by notifying the external server ES of the selection result of the product 40A. In response to this request, the external server ES may register the selected product 40A in the cart C1. This allows the product 40A to be added to the cart C1. In other words, the user TU can perform purchasing behavior in the virtual space. The user TU can add the selected product 40A to the cart C1 by operating the button C5 with the input device 54. Putting the items into the cart C1 may correspond to registering information in the cart C1 of the user TU so as to secure the selected items 40A. After selecting all the items 40A, the user TU may request a payment process from the external server ES via the information processing device 5. Completion of the payment process allows the user TU to purchase the items 40A. Note that purchasing behavior in the virtual space is not limited to this example, and may be appropriately changed depending on the embodiment. In response to such purchasing behavior, the information processing device 5 may output feedback 25A configured in the same manner as in the above embodiment to the user TU.

[0143] (feedback) The feedback 25A corresponds to the feedback 25 according to the above embodiment. The feedback module 53 may be configured similarly to the feedback module 13 according to the above embodiment. That is, the feedback module 53 may be configured to output the feedback 25A by at least one of the visual, auditory, and tactile senses. For example, the feedback module 53 may include at least one of a haptic feedback module 58 and an output device 59. The haptic feedback module 58 may be configured by an actuator such as a servo motor or a vibration motor. The output device 59 may include at least one of a display 591 and a speaker 593. Accordingly, the feedback 25A may be output via the feedback module 53 in a configuration similar to that of the feedback 25 according to the above embodiment. As in the above embodiment, the feedback 25A may be obtained from the content data 121 or may be generated by executing a calculation process. The content of the feedback (feedback 25A) may be determined according to the input attribute (attribute 20A) in the same manner as in the above embodiment. The feedback module 53 may be appropriately arranged in a range used by the user TU. As shown in FIG. 12, in one example, the feedback module 53 may be disposed in the information processing device 5.

[0144] (Input Attributes) The attribute 20A of the input of the product 40A may be the same as the attribute 20 according to the above embodiment. In one example, the attribute 20A of the input of the product 40A may include the number 201A of the input products 40A (the number of input products). The number 201A of the products 40A may be the same as the number 201 of the products 40 according to the above embodiment, except that the input of the product 40 in the actual store is replaced by the input of the product 40A into the cart C1 in the virtual store C0. In one example, determining the content of the feedback 25A according to the attribute 20A of the input of the product 40A may include determining the content of the feedback 25A so that the feedback 25A output approaches the complete content as the number 201A of the input products 40A (the total number) approaches the target number. In one example, all the products in the cart C1 may be counted as the number 201A of the products 40A without distinguishing the products. In another example, only certain products that satisfy a predetermined condition may be counted as the number 201A of the products 40A. Whether or not the introduced product satisfies the predetermined condition may be determined by any method. Whether or not the introduced product satisfies the predetermined condition may be determined by using product information managed on the EC site.

[0145] In addition, in one example, the attribute 20A of the input of the product 40A may include at least one of the identification information 203A and the type 205A of the input product 40A. The identification information 203A and the type 205A of the product 40A may be similar to the identification information 203 and the type 205 of the product 40 according to the above embodiment. The identification information 203A and the type 205A may be acquired by any method. For example, the identification information 203A and the type 205A may be acquired from the product information of the product 40A managed on the EC site. The identification information 203A and the type 205A of the product 40A are an example of characteristics derived from the product 40A. The characteristics derived from the product 40A used to determine the content of the feedback 25A may not be limited to the identification information 203A and the type 205A. In another example, the attribute 20A of the input of the product 40A may include the appearance characteristics and physical characteristics of the input product 40A. The appearance characteristics and physical characteristics may be appropriately acquired from the product information of the product 40A.

[0146] In one example, the attribute 20A of the insertion of the product 40A may include the event location 207A where the product 40A is inserted. The event location 207A may be a location in a virtual space, such as a web page address (Uniform Resource Locator, etc.), a location where the product 40A is posted, or a location in a VR space. The area may be appropriately set in the virtual store C0. For example, each area may be set according to the category of the product 40A. Except for these points, the event location 207A may be similar to the event location 207 according to the above embodiment. In one example, determining the content of the feedback 25A according to the attribute 20A of the insertion of the product 40A may include determining the content of the feedback 25A so that the feedback 25A to be output approaches complete content as the total number of areas to which the event locations 207A where the products 40A are inserted belong approaches a target number.

[0147] Also, in one example, any information other than the attribute 20A of the input of the product 40A may be further used to determine the content of the feedback 25A. Determining the content of the feedback 25A according to the attribute 20A of the input of the product 40A may be configured by determining the content of the feedback 25A according to the attribute 20A of the input of the product 40A and the reference information 125A. The reference information 125A may be similar to the reference information 125 according to the above embodiment. That is, the reference information 125A may include at least one of the attribute information and the environmental information of the user TU.

[0148] [Configuration example] (Hardware configuration) As shown in FIG. 12, the information processing device 5 according to this modification is a computer in which a control unit 51, a storage unit 52, a feedback module 53, an input device 54, and a communication module 55 are electrically connected.

[0149] The control unit 51 is configured to execute information processing based on programs and various data by including a CPU, which is a hardware processor, a RAM (Random Access Memory), a ROM (Read Only Memory), etc. The control unit 51 (CPU) is an example of a processor resource.

[0150] The storage unit 52 may be configured with a hard disk drive, a solid state drive, a semiconductor memory, or the like. The storage unit 52, the RAM, and the ROM are examples of memory resources. In this modification, the storage unit 52 stores various information such as a program 85, content data 121, and reference information 125. The program 85 is a program for causing the information processing device 5 to execute information processing (FIG. 14 described later) related to the output of the feedback 25A. The program 85 includes a series of instructions for the information processing. At least one of the content data 121 and the reference information 125 may be omitted. At least one of the content data 121 and the reference information 125 may be held independently of the program 85, or may be included in the program 85.

[0151] At least one of the program 85, the content data 121, and the reference information 125 may be stored in the storage medium SR5 instead of or together with the storage unit 52. The information processing device 5 may acquire at least one of the program 85, the content data 121, and the reference information 125 from the storage medium SR5. The storage medium SR5 may be configured similarly to the storage medium SR1. The storage unit 52 and the storage medium SR5 are examples of non-transitory storage media. Any drive device may be used to read the information stored in the storage medium SR5. The type of drive device may be selected according to the storage medium SR5.

[0152] The input device 54 is configured to receive input of information. The input device 54 may be configured, for example, by a keyboard, a touch panel, an operator, a microphone, etc. When the feedback module 53 includes an output device 59, the input device 54 and the output device 59 may be integrally configured by a touch panel display or the like. An operator can operate the information processing device 5 by using the input device 54 and the output device 59. The input device 54 and the output device 59 may be connected via an external interface. The external interface may be appropriately configured to connect to an external device by wire or wirelessly, for example, by a Universal Serial Bus (USB) port, a dedicated port, etc.

[0153] The communication module 55 is configured to execute wired or wireless communication via a network. The communication module 55 may be configured, for example, by a wired LAN module, a wireless LAN module, etc. The information processing device 5 may execute data exchange with another computer (for example, an external server ES, etc.) via the communication module 55.

[0154] Regarding the specific hardware configuration of the information processing device 5, components can be omitted, replaced, and added as appropriate depending on the embodiment. For example, the control unit 51 may include multiple hardware processors. The hardware processor may be configured with a microprocessor, FPGA, DSP, GPU, ASIC, etc. At least one of the input device 54 and the communication module 55 may be omitted. The program 85 may be stored in an external storage device such as a NAS. The external storage device is also an example of a non-transitory storage medium. The information processing device 5 may be configured with multiple computers. In this case, the hardware configurations of the computers may or may not be the same. In addition, the information processing device 5 may be a general-purpose server device, a general-purpose PC, a tablet PC, a terminal device, etc., in addition to a computer designed for a special purpose.

[0155] (Software configuration) 13 shows an example of a software configuration of the information processing device 5 (control unit 51) according to this modification. The control unit 51 of the information processing device 5 executes instructions included in the program 85 stored in the storage unit 52 by means of the CPU. As a result, the information processing device 5 operates as a computer including a selection receiving unit 511, an input unit 512, a determination unit 513, and a feedback unit 514 as software modules. That is, in this modification, each software module of the information processing device 5 is realized by the control unit 51 (CPU).

[0156] The selection receiving unit 511 is configured to receive a selection of a product 40A by the user TU in the virtual store C0. The input unit 512 is configured to input the selected product 40A into the cart C1. The determination unit 513 is configured to determine the content of the feedback 25A in response to the input of the product 40A into the cart C1, according to the input attribute 20A of the product 40A. The feedback unit 514 is configured to output the feedback 25A of the determined content to the user TU via the feedback module 53 in response to the input of the product 40A into the cart C1.

[0157] In this modification, an example is described in which each software module of the information processing device 5 is realized by a general-purpose processor (CPU). However, some or all of the above software modules may be realized by one or more dedicated processors or chipsets. Each of the above modules may be realized as a hardware module. With regard to the software configuration of the information processing device 5, modules may be omitted, replaced, or added as appropriate depending on the embodiment.

[0158] [Example] 14 is a flowchart showing an example of a processing procedure for outputting feedback 25 by the information processing device 5 according to this modified example. The following processing procedure is an example of a control method (information processing method) executed by a computer (information processing device 5). However, the following processing procedure is merely an example, and each step may be modified as much as possible. Furthermore, steps in the following processing procedure may be omitted, replaced, or added as appropriate depending on the embodiment.

[0159] In step S501, the control unit 51 operates as a selection receiving unit 511. The control unit 51 receives the selection of the product 40A by the user TU in the virtual store C0. In step S502, the control unit 51 determines the branch destination of the process depending on whether the selection of the product 40A by the user TU has been received. If the selection of the product 40A by the user TU has not been received, the control unit 51 returns the process to step S501 and waits until the selection of the product 40A is received by repeatedly executing the process of step S501. On the other hand, if the selection of the product 40A is received, the control unit 51 advances the process to the next step S503.

[0160] In step S503, the control unit 51 operates as the insertion unit 512. The control unit 51 inserts the selected product 40A into the cart C1. In one example, the control unit 51 may request the external server ES to register the selected product 40A in the cart C1. After inserting the product 40A into the cart C1, the control unit 51 proceeds to the next step S504.

[0161] In step S504, the control unit 51 operates as the determination unit 513. In response to the introduction of the product 40A into the cart C1 in step S503, the control unit 51 determines the content of the feedback 25A according to the attribute 20A of the introduction of the product 40A. The process of step S504 may be the same as that of step S102. In one example, the attribute 20A of the introduction of the product 40A may include at least one of the number 201A, identification information 203A, type 205A, and event position 207A of the introduced products 40A. Thus, the feedback 25A may be generated according to at least one of the number 201A, identification information 203A, type 205A, and event position 207A of the introduced products 40A. After determining the content of the feedback 25A, the control unit 51 proceeds to the next step S505.

[0162] In step S505, the control unit 51 operates as the feedback unit 514. The control unit 51 outputs the feedback 25A of the determined content to the user TU via the feedback module 53. The process of step S505 may be the same as that of step S103. In one example, the output feedback 25A may include at least one of visual, auditory, and tactile feedback. The order of the processes of steps S503 to S505 is not limited to this example, and may be changed as appropriate depending on the embodiment. In another example, the process of step S503 may at least partially overlap with the processes of steps S504 to S505. When the process of step S505 is completed, the process proceeds to the next step S506.

[0163] In step S506, the control unit 51 determines whether or not to end the process. The criteria for the determination may be set arbitrarily. In one example, the control unit 51 may determine not to end the process until an end instruction is given. On the other hand, when an end instruction is given, the control unit 51 may determine to end the process. The end instruction may be given by any method. For example, while a transition to payment processing has not been accepted, the control unit 51 may determine not to end the process. On the other hand, when a transition to payment processing has been accepted, the control unit 51 may determine to end the process.

[0164] When it is determined that the process should not be ended, the control unit 51 returns the process to step S501 and executes the process again from step S501. In one example, in the process of repeatedly executing the processes from step S501 to step S505, the control unit 51 adjusts the output feedback 25A so that the feedback 25A is complete as the number 201A (total number) of inserted products 40A approaches the target number. In one example, in the process of repeatedly executing the processes of steps S501 to S505, control unit 51 may output feedback 25A whose content is determined so that as the total number of areas to which event positions 207A into which products 40A are inserted belong approaches the target number, the output feedback 25A whose content is determined so that the output feedback 25A approaches the complete content.

[0165] When it is determined that the process is to be ended, the control unit 51 ends the process procedure related to the output of the feedback 25A according to this modified example. When a transition to the payment process is accepted, the control unit 51 may transition to the payment process. Note that the timing of ending the process is not limited to this example. The control unit 51 may end the process procedure related to the output of the feedback 25A at any timing. In one example, the control unit 51 may execute a series of processes from step S501 to step S506 in real time.

[0166] According to this modification, in response to the introduction of the product 40A in the virtual store C0 by the processes of steps S504 and S505, feedback 25A according to the attribute 20A of the introduction of the product 40A is given. As a result, according to this modification, it is expected that the possibility of overlooking the introduction of the product 40A into the cart C1 will be reduced. In addition, since there is a reaction (feedback 25A) to the introduction of the product 40A, it is expected that it will also act as a nudge to encourage behavioral change (for example, stimulating purchasing motivation, etc.).

[0167] [others] In one example of FIG. 12, the feedback module 53 is deployed in the information processing device 5. However, the deployment destination of the feedback module 53 is not limited to this example, and may be changed as appropriate depending on the embodiment. In another example, the feedback module 53 may be deployed in a computer other than the information processing device 5. For example, when the information processing device 5 is a server device, the feedback module may be deployed in a user terminal.

[0168] FIG. 15 illustrates another example of a scene to which the present disclosure is applied. In the example of FIG. 15, it is assumed that the information processing device 5 is a server device, and a user TU accesses the information processing device 5 using a user terminal 6. The information processing device 5 may operate as an external server ES, or may operate as an intermediate server between the external server ES and the user terminal 6. In this case, the user terminal 6 may include a feedback module 63 and an input device 64. Accordingly, the feedback module 53 and the input device 54 may be omitted from the information processing device 5. The feedback module 63 and the input device 64 may be configured in the same manner as the feedback module 53 and the input device 54 described above.

[0169] In this modification, the user TU may use the user terminal 6 to access the information processing device 5 and select the product 40A by operating the input device 64 on the user terminal 6. The information processing device 5 may receive the operation result to accept the selection of the product 40A. In response to receiving the selection of the product 40A, the information processing device 5 may execute processing from putting the product 40A into the cart C1 to outputting the feedback 25A. Outputting the feedback 25A of the determined content may be configured by instructing the user terminal 6 to output the feedback 25A of the determined content via the feedback module 63. That is, the information processing device 5 may transmit a command to the user terminal 6 to output the feedback 25A of the determined content as the processing of the above step S505. In response to this instruction, the user terminal 6 may output the feedback 25A via the feedback module 63. This modification can also be expected to reduce the possibility of overlooking the putting of the product 40A into the cart C1. In addition, it can be expected to act as a nudge to encourage behavioral change. [Explanation of symbols]

[0170] 1...Smart grip, B1...Basket, 1A·1B…Shopping basket, 102A·102B…Basket body, 11...control device, 13...feedback module, 13...detection sensor, 20…Attributes, 25…Feedback, 40…Product, TU…User

Claims

1. A smart grip that can be used as a handle for a basket, Detection sensor, A feedback module, and Control device Equipped with The detection sensor is configured to detect the insertion of a commodity into the basket, The control device is configured to, in response to the detection of the insertion of a commodity into the basket by the detection sensor, determine the content of feedback according to an attribute of the detected insertion of the commodity, and output the determined feedback content to a user via the feedback module; The attributes of the input of the product include the number of the input products; Determining the content of the feedback according to the attributes of the introduction of the products includes determining the content of the feedback such that the feedback to be output approaches complete content as the number of the introduced products approaches a target number. Smart grip.

2. A smart grip that can be used as a handle for a basket, Detection sensor, Positioning sensor, A feedback module, and Control device Equipped with The detection sensor is configured to detect the insertion of a commodity into the basket, The positioning sensor is configured to measure a position; The control device is configured to, in response to the detection of the insertion of a commodity into the basket by the detection sensor, determine the content of feedback according to an attribute of the detected insertion of the commodity, and output the determined feedback content to a user via the feedback module; The attribute of the insertion of the product is an event position measured by the positioning sensor when the detection sensor detects the insertion of the product, and the event position where the product is inserted is Including, Smart grip.

3. determining the content of the feedback according to the attribute of the introduction of the product includes determining the content of the feedback such that the feedback to be output approaches complete content as the total number of areas to which the event positions into which the products are introduced belong approaches a target number. The smart grip according to claim 2.

4. The attributes of the input of the product include at least one of identification information and a type of the input product. The smart grip according to any one of claims 1 to 3.

5. Basket body, Detection sensor, A feedback module, and Control device Equipped with The detection sensor is configured to detect the insertion of a commodity into the basket body, The control device is configured to, in response to the detection of the insertion of a commodity into the basket body by the detection sensor, determine the content of the feedback according to the attributes of the detected insertion of the commodity, and output the determined feedback of the content to a user via the feedback module; The attributes of the input of the product include the number of the input products; Determining the content of the feedback according to the attributes of the introduction of the products includes determining the content of the feedback such that the feedback to be output approaches complete content as the number of the introduced products approaches a target number. Shopping cart.

6. A basket body, Detection sensor, Positioning sensor, A feedback module, and Control device Equipped with The detection sensor is configured to detect the insertion of a commodity into the basket body, The positioning sensor is configured to measure a position; The control device is configured to, in response to the detection of the insertion of a commodity into the basket body by the detection sensor, determine the content of the feedback according to the attributes of the detected insertion of the commodity, and output the determined feedback of the content to a user via the feedback module; The attribute of the insertion of the product is an event position measured by the positioning sensor when the detection sensor detects the insertion of the product, and includes an event position where the product is inserted. Shopping cart.

7. Determining the content of the feedback in accordance with the attributes of the product insertion includes determining the content of the feedback such that the output feedback approaches complete content as the total number of areas to which the event locations to which the products are inserted belong approaches a target number.

7. The shopping basket of claim 6.

8. The attributes of the input of the product include at least one of identification information and type of the input product. A shopping basket according to any one of claims 5 to 7.

9. By further providing one or more wheels, it is configured as a cart. A shopping basket according to any one of claims 5 to 7.

Images