shopping cart

Abstract

The shopping cart (1) is equipped with a basket (2) in which products are stored, front wheels (5) and rear wheels (6), handles (7, 8), a front camera (9) and a rear camera (10), a weight sensor (12) arranged as the floor of the basket (2) for measuring the weight of the stored products, a display device (13), a database matching unit (23) that matches the stored products against product information stored in a database (22), a product determination unit (24) that determines the stored products as matched products, a price calculation unit (25) that calculates the prices of the matched products, and a display unit (26) that displays the matched products and their prices on the display device (13).

Description

[Technical field]

[0001] The present invention relates to a shopping cart for use in grocery stores and the like. [Background technology]

[0002] Currently, shopping carts continue to evolve, and various types have been devised, such as those that store products in the cart by reading the products' barcodes, those that store products in the cart using RFID, etc. There are also carts that recognize products in the cart by taking into account the weight of the products in the cart (for example, see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Special Publication No. 2019-528537 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in recent years, there has been a demand for the ability to process payments using the cart, and in such cases, payments are basically made without the presence of a store clerk, so it is extremely important to accurately identify the products in the cart. Various shopping carts, including that described in Patent Document 1, aim to accurately obtain product information in the cart, but further ingenuity is needed to complete all procedures using a single cart.

[0005] The present invention has been made in consideration of the above-mentioned conventional technology, and aims to provide a shopping cart that allows accurate tracking of product information in the cart and can complete all functions required for shopping with just one cart. [Means for solving the problem]

[0006] In order to achieve the above-mentioned object, the present invention provides a shopping cart comprising: a basket in which products are stored, front and rear wheels arranged below the basket, a handle arranged above the rear side of the basket, a front camera and a rear camera arranged at the front and rear of the basket for capturing images of the products stored in the basket, a weight sensor arranged as the floor of the basket for measuring the weight of the stored products which are the products stored in the basket, a display device arranged above the rear side of the basket, and a computer that handles information regarding the stored products, the computer including a database matching unit that matches the stored products captured by the front camera or the rear camera against product information stored in a database, a product determination unit that determines the stored products matched by the database matching unit as matched products, a price calculation unit that calculates the prices of the matched products using information from the weight sensor of the matched products, and a display unit that displays the matched products and their prices on the display device.

[0007] Preferably, the database comparison unit compares the contained product, which is the product imaged by the front camera or the rear camera and removed from the basket, against product information stored in the database, the product determination unit determines the removed product matched by the database comparison unit as a already-removed product, the price calculation unit calculates the price of the already-removed product using information from the weight sensor, and the display unit deletes the matched product that matches the already-removed product and its price from the display of the display device.

[0008] Preferably, the vehicle further includes a battery that powers the computer and the display device, a charger that charges the battery, and a conversion device connected to the charger for converting the rotational energy of the front wheel or the rear wheel into electrical energy.

[0009] Preferably, the front or side of the basket has an object detection sensor for detecting nearby objects.

[0010] Preferably, the front surface of the basket is provided with a radio receiver for receiving radio waves transmitted from a radio transmitter, and the front wheel or the rear wheel rotates so as to automatically move in the direction of the radio transmitter using the battery. Effect of the Invention

[0011] According to the present invention, the front or rear camera recognizes the products contained in the basket, the database comparison unit checks the type of product, and the product determination unit determines the product. Furthermore, the price calculation unit can derive the price of the contained product based on the information from the weight sensor. The price is then displayed on the display device, allowing the user to know the accurate information and price of the contained product. In addition, since the front camera and rear camera are arranged on the front and rear sides of the basket to capture the images of the products, the products contained in the basket can be captured reliably.

[0012] Also, when stored products are taken out of the basket using the front or rear camera, the database collation unit can collate these products to determine what kind of products they are, and the product determination unit can determine them as taken out products. The price of the taken out product is calculated by the price calculation unit from the information from the weight sensor, and the taken out product and its price are deleted from the display device, so the user can know the accurate information and price of the stored products.

[0013] In addition, by converting the rotational energy of the front and rear wheels into electrical energy using a converter and connecting this to a battery charger for the computer and display device, the trouble of having to move the cart to a charging station or similar location to charge it is eliminated, which contributes to the fact that a single cart can complete all of its functions.

[0014] In addition, by equipping the basket with an object detection sensor, the cart can detect if it bumps into something unexpectedly or if a person is approaching, and prompt the user to avoid it. This also contributes to the fact that the cart can complete all of its functions with just one unit.

[0015] In addition, by having the user carry a wireless transmitter, the cart equipped with a wireless receiver will automatically move toward the user. This means that even if the cart becomes heavy, the user does not need to push it. Also, the user can concentrate on shopping. This also contributes to the fact that the cart can complete its functions with just one unit. [Brief description of the drawings]

[0016] [Figure 1] 1 is a schematic perspective view of a shopping cart according to the present invention; [Diagram 2] 2 is a schematic perspective view of the shopping cart according to the present invention, seen from a different direction from that of FIG. 1. [Diagram 3] 1 is a schematic side view of a shopping cart according to the present invention. [Figure 4] 1 is a schematic front view of a shopping cart according to the present invention; FIG. [Diagram 5] 1 is a schematic view of a shopping cart according to the present invention as seen from the rear. [Figure 6] 1 is a schematic diagram of a shopping system using a shopping cart according to the present invention. [Figure 7] 4 is a flowchart showing a process for shopping using the shopping cart according to the present invention. [Figure 8] 13 is a flowchart showing a process when a product is removed from a basket. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0017] As shown in Figs. 1 to 6, a shopping cart 1 according to the present invention includes a basket 2 in which products are to be stored. The basket 2 is in the shape of a container with an open top. Support columns 3 are arranged on the left and right rear sides of the basket 2 over the entire vertical range, and these support columns 3 extend further downward. A receiving portion 4 that can be used as a loading platform extends from the lower end of the support column 3 toward the front of the shopping cart 1. A front wheel 5 is arranged on the lower front side of this receiving portion 4. In addition, a rear wheel 6 is arranged on the lower end of the support column 3 (in the example of the figure, a bearing portion 3a extends rearward from the lower end of the support column 3, and a rear wheel is attached to this bearing portion 3a). That is, the front wheel 5 and the rear wheel 6 are arranged below the basket 2. On the other hand, a first handle 7 extends forward from the upper end of the support column 3. In addition, a second handle 8 is bridged between the left and right support columns 3 on the upper sides of the left and right support columns 3. That is, the handles (first handle 7 and second handle 8) are disposed above the rear side of the basket 2. In addition, a receiving base 11 extends forward from the support pillar 3, and this receiving base 11 supports the floor surface of the basket 2.

[0018] A front camera 9 is disposed on the upper front side of the basket 2. A rear camera 10 is disposed on the upper rear side of the basket 2. The front camera 9 and the rear camera 10 are for capturing images of products contained in the basket 2. The imaging units (lenses) of the front camera 9 and the rear camera 10 are disposed in the center of the basket 2 in the left-right direction. A weight sensor 12 is disposed on the floor of the basket 2. The weight sensor 12 may be disposed on the entire floor of the basket 2, or may be incorporated in the receiving base 11 and measure the weight of the products in conjunction with the floor of the basket 2. In short, the weight sensor 12 is disposed as the floor of the basket 2 and measures the weight of the products contained in the basket 2. Here, products sold in stores such as supermarkets become contained products when they are contained in the basket 2. A display device 13, typically a tablet or the like, for displaying shopping information and the like is disposed in the approximate center of the second handle 8. That is, the display device 13 is disposed on the upper rear side of the basket 2.

[0019] A box-shaped component box 14 is disposed contiguous to the support column 3 and constitutes part of the receiving stand 11. A computer 15 that handles information about the stored products is disposed within the component box 14. The computer 15 is equipped with a CPU. Also housed within the component box 14 are a battery 16 that serves as the power source for the computer 15 and the display device 13, a charger 17 that charges the battery 16, and a converter 18 that is connected to the charger 17 and converts the rotational energy of the front wheels 5 or the rear wheels 6 into electrical energy.

[0020] An object detection sensor 19 is disposed on the front or side of the basket 2 (the front or side of the receiving stand 11 connected to the basket 2). This object detection sensor 19 is for detecting nearby objects. For example, an ultrasonic sensor can be used. When the object detection sensor 19 detects an object (including a human body) nearby, it emits a beep, such as a buzzer. In addition, wireless receivers 20 are provided on the front of the basket 2, on both the left and right sides of the upper front of the basket 2 in the example shown in the figure. These wireless receivers 20 are for receiving radio signals transmitted from a wireless transmitter 21.

[0021] When shopping using the shopping cart 1 having the above-mentioned configuration, the process is as follows. First, the user obtains the shopping cart 1 from the cart storage area at the store. After that, the user places the desired product in the basket 2 and starts shopping. As shown in FIG. 7, when the user places a product in the basket 2, the camera (front camera 9 or rear camera 10) captures an image of the product (step S1). That is, the front camera 9 or rear camera 10 detects that a product has been placed in the basket 2, and the camera 9 or 10 captures the image. Then, the captured image of the stored product is collated against the product information stored in the database 22 (step S2). Specifically, the stored product captured by the camera 9 or 10 is compared with the appearance images of various products stored in the database 22 and collated. This collation is performed by the database collation unit 23 in the computer 15. The database 22 may be disposed in a place where the database collation unit 23 can obtain the database 22 through an electric communication line, or may be stored in the component box 14 of each cart. The computer 15 includes a product determination unit 24 that determines the stored products that have been matched by the database matching unit 23 as matched products.

[0022] Next, the weight of the matched product is confirmed by the weight sensor 12 (step S3). Then, the price of the matched product is calculated (step S4). This calculation is performed by the price calculation unit 25 in the computer 15. Once the price has been calculated, the matched product and its price are displayed on the display device 13 (step S5). This display is performed on the display unit 26 in the computer 15. After shopping is completed, the user uses the display unit 26 to make payment for the products in the basket 2. This is processed by the payment unit 27 in the computer 15. Shopping can be performed in this manner, so that the user can obtain the cart 1, place the products they wish to purchase in the basket 2, and finally make payment for the products to be purchased in the cart 1 before leaving the store. Therefore, when shopping, the user can perform all the steps required for shopping using only the cart 1.

[0023] Furthermore, the front camera 9 or rear camera 10 recognizes the products contained in the basket 2, and the database comparison unit 23 compares them to determine the type of product, which is then determined by the product determination unit 24. Furthermore, the price calculation unit 25 can derive the price of the contained products based on the information from the weight sensor 12. The price is then displayed on the display device 13, allowing the user to know accurate information and price of the contained products. This means that the camera 9 or 10, the database comparison unit 23, and the product determination unit 24 can accurately grasp the information of the contained products, and this, combined with the information from the weight sensor 12, makes it possible to accurately grasp the product information, even if the products are of the same package but have different weights.

[0024] In particular, if the camera 9 or 10 is an AI camera, the product can be extracted from the big data and the contained product can be identified no matter what angle the product is placed in the basket 2 at. This is particularly suitable for products sold by weight, such as chicken or beef. Products sold by weight change shape depending on their weight. Therefore, by using an AI camera, it is possible to deal with products whose shape has changed. And because the weight can be measured by the weight sensor 12, the product and its price can be accurately derived even if the product is sold by weight.

[0025] In addition, since the front camera 9 and the rear camera 10 are arranged on the front and rear sides of the basket 2 as cameras for capturing images of the products, the products stored in the basket 2 can be captured reliably. In particular, it is preferable that the viewing angles of the front camera 9 and the rear camera 10 can cover the entire area of ​​the opposite side of the basket 2 from one side of the basket 2 on which the front camera 9 and the rear camera 10 are arranged. This makes it possible to capture the entire area of ​​the open top surface of the basket 2 (viewing angle A of the front camera 9 and viewing angle B of the rear camera 10 shown in FIG. 1), and eliminates blind spots on the open top surface of the basket 2 when storing products. Therefore, the storage of the products can be captured reliably. The viewing angles A and B should be set so that the entire area of ​​the open top surface of the basket 2 is covered within the ranges of both A and B.

[0026] As described above, the rotational energy of the front wheels 5 and the rear wheels 6 is converted into electrical energy by the converter 18 and then connected to the charger 17 for the battery 16 used in the computer 15 and the display device 26, eliminating the need to transport the cart 1 to a charging station or similar to separately charge the battery 16. This contributes to the fact that the cart 1 can complete all of its functions with just one unit.

[0027] In addition, as described above, by providing the object detection sensor 19 on the basket 2, it is possible to detect if the cart 1 bumps into something unexpectedly or if a person approaches, and to prompt the user to avoid the collision. This also contributes to the cart 1 being able to complete its functions with just one unit.

[0028] Furthermore, the front wheel 5 or rear wheel 6 rotates by the battery 16 to automatically move in the direction of the wireless transmitter 21, and by having the wireless receiver 20 on both the left and right sides at the top of the front of the basket 2, if the user carries the wireless transmitter 21, the cart 1 equipped with the wireless receiver 20 will automatically move in the direction of the user. This eliminates the need for the user to push the cart 1, even if it becomes heavy, for example, by containing a large amount of merchandise. Also, the user can concentrate on shopping. This also contributes to the fact that the cart 1 can complete all its functions with just one unit.

[0029] As shown in FIG. 8, products are often taken out of the basket 2 during shopping. The shopping cart 1 according to the present invention also supports this operation. This also contributes to the fact that the cart 1 can complete its functions with a single unit. First, the front camera 9 or rear camera 10 confirms that a product has been taken out of the basket 2 (step T1). At this time, the database comparison unit 23 compares the product taken out of the basket 2 against the product information stored in the database 22. Next, the product determination unit 24 determines the product taken out as compared by the database comparison unit 23 as a product that has been taken out. When the product that has been taken out is determined, the weight sensor 12 checks the weight in the cart 1 (basket 2) (step T2). Then, the price calculation unit 25 calculates the price of the product that has been taken out using the information from the weight sensor 12. That is, it is recognized which product has been taken out based on the reduced weight in the basket 2. This is suitable when there are products in the same package and the products are sold by weight. Next, the display unit 26 recognizes the matched products and their price information displayed as contained products in the basket 2 and the products that have been removed, and deletes these matching products from the display on the display device 13 (step T3).

[0030] In this way, even when stored products are removed from the basket 2 using the front camera 9 or rear camera 10, the type of product these products are compared by the database comparison unit 23, and the product determination unit 24 can determine that the product has been removed. The price of the removed product is calculated by the price calculation unit 25 from information from the weight sensor 12, and the removed product and its price are deleted from the display device 13, so that the user can know more accurate information and price of the stored product. In other words, even if a stored product is removed from the basket 2, the removed product can be accurately recognized, and the information about that product can be deleted from the display device.

[0031] A light or an infrared ray emitting device may be provided near the front camera 9 or the rear camera 10 (for example, next to the camera 9 or 10). The light can illuminate the products, improving their visibility by the camera. In addition, by combining an infrared ray emitting device, even if products are placed in the basket 2 overlapping with each other, the products can be recognized.

[0032] As described above, the entire upper opening surface of the basket 2 is covered by the viewing angles A and B of the front camera 9 and the rear camera 10. For this reason, the front camera 9 and the rear camera 10 are arranged in opposing horizontal positions. That is, the cameras 9 and 10 are not simply arranged on the front and rear sides of the basket 2. This makes it possible to eliminate blind spots on the upper opening surface of the basket 2 when storing products as described above. Therefore, the storage of products can be reliably captured. In addition to reliably capturing the storage of products in this way, the processing by the database collation unit 23, the product determination unit 24, the price calculation unit 25, and the display unit 26 is reliably performed, and accurate product information in the basket 2 can be provided to the user. The present invention is not only intended to accurately detect the storage of products in the basket 2, but also to provide the user with the subsequent final product information, so the series of configurations from the storage of products to the identification of products described above are essential. In order to completely cover the entire upper opening surface of the basket 2 with the viewing angles of the cameras, side cameras may be provided not only on the front and rear sides of the upper part of the basket 2, but also on both the left and right sides. The front camera 9 and rear camera 10 have lenses facing horizontally, so they are not used to recognize products in the basket 2, but rather have the role of ensuring that no products are missed when they are placed in the basket 2. [Explanation of symbols]

[0033] 1: shopping cart, 2: basket, 3: support column, 3a: bearing section, 4: receiving section, 5: front wheel, 6: rear wheel, 7: first handle, 8: second handle, 9: front camera, 10: rear camera, 11: receiving stand, 12: weight sensor, 13: display device, 14: component box, 15: computer, 16: battery, 17: charger, 18: conversion device, 19: object detection sensor, 20: wireless receiver, 21: wireless transmitter, 22: database, 23: database matching section, 24: product determination section, 25: price calculation section, 26: display section, 27: payment section, 28: product removal recognition section

Claims

1. A basket in which the goods are placed, The front wheel and rear wheel are located below the basket, The handle located above the rear of the basket, A front camera and a rear camera are positioned at the front and rear of the basket and are used to photograph the products contained within the basket. A weight sensor is provided on the floor of the basket and is used to measure the weight of the stored goods, which are the goods contained within the basket. A display device located above the rear of the basket, A computer that handles information regarding the aforementioned stored goods, A database matching unit that compares the captured images of the stored items taken by the front camera or rear camera with the product information stored in the database, A product determination unit determines the stored products that have been verified by the database verification unit as verified products, A price calculation unit that calculates the price of the verified product using information from the weight sensor, The system includes a computer which includes a display unit that displays the verified product and its price on the display device, The entire upper surface of the basket opening is covered by the field of view of the front camera and the rear camera. The shopping cart is characterized in that the front camera and rear camera have lenses that are oriented horizontally and are positioned at opposing horizontal positions.

2. The database matching unit compares the retrieved items, which are the stored items, captured by the front camera or the rear camera and taken out of the basket, with the item information stored in the database. The product determination unit determines the retrieved product, which has been verified by the database verification unit, as a retrieved product. The price calculation unit calculates the price of the removed product using the information from the weight sensor. The shopping cart according to claim 1, characterized in that the display unit removes the matched product and its price that match the retrieved product from the display of the display device.

3. A battery that provides power to the computer and the display device, A charger for charging the aforementioned battery, The shopping cart according to claim 1, further comprising a conversion device connected to the charger for converting the rotational energy of the front wheel or the rear wheel into electrical energy.

4. The shopping cart according to claim 1, characterized in that the front or side of the basket has an object detection sensor for detecting nearby objects.

5. The front of the basket is equipped with a wireless receiver that receives wireless signals transmitted from a wireless transmitter. The shopping cart according to claim 1, characterized in that the front wheel or the rear wheel rotates automatically by the battery to move in the direction of the wireless transmitter.

6. The shopping cart according to claim 1, further comprising side cameras on both the left and right sides of the basket for imaging the products contained within the basket.

Images