Unmanned product checkout device

Abstract

An unmanned product checkout device for achieving the objective of the present invention comprises: a transfer unit that transfers a product requiring checkout; a product recognition unit provided on one side of the transfer unit to recognize whether the product is seated on the transfer unit; a scan unit provided on one side of the rear end of the transfer unit relative to the product recognition unit to scan a barcode and image of the product transferred through the transfer unit; an external scan unit provided outside the transfer unit or the scan unit to recognize a product having a volume greater than the width of the transfer unit or greater than the arrangement height of the scan unit; and a calculation unit including a payment unit that displays the prices of products recognized through the scan unit and the external scan unit, and performs payment.

Description

unmanned product checkout device

[0001] The present invention relates to an unmanned product checkout device, and more specifically, to an unmanned product checkout device that not only eliminates the need for a cashier to be stationed there, but also automatically recognizes the product when a buyer places it on the counter to facilitate calculation, and can perform calculations quickly and accurately with a high product recognition rate through artificial intelligence learning data.

[0002] Generally, a checkout counter is a counter located near the soccer side of a supermarket or convenience store where purchased products are verified and payment is made. These checkout counters can be broadly classified into manned checkout counters and unmanned checkout counters depending on the presence or absence of a cashier.

[0003] At manned checkout counters, products are typically placed on a fixed counter or on a conveyor belt and moved toward the cashier. The cashier then holds a scanner to locate and recognize the barcode of each product to verify the item. The scanned information recognized in this way displays product and price information based on the data entered into the checkout, and prompts the user to make a payment through a payment terminal.

[0004] These manned checkout counters have the advantage of preventing recognition errors, as cashiers identify products one by one and scan their barcodes, and allowing for quick responses even if errors occur because a cashier is present. However, there are issues regarding labor costs, as cashiers must always be on standby at the counter regardless of customer presence; payment times increase because cashiers must scan products individually; errors may occur due to cashier mistakes; and customer privacy issues may arise.

[0005] A self-checkout counter is a device that eliminates cashiers and uses a scanner fixed near a conveyor belt to automatically recognize products moving along the belt, thereby facilitating payment. While such self-checkout counters protect customer privacy and eliminate labor costs, various errors can occur depending on how the consumer places the product on the conveyor belt. Specifically, proper recognition may fail if products move while overlapping or if they are placed on the edges of the conveyor belt, causing them to pass through the scanner's blind spots. Furthermore, depending on the type of scanner equipped, if the scanner only recognizes barcodes, product recognition may fail even if the product is placed correctly on the conveyor belt, provided the printed barcode surface does not align with the scanner's recognition direction.

[0006] The present invention aims to solve conventional problems by providing an unmanned product checkout device that not only eliminates the need for a cashier to be stationed but also facilitates calculation by automatically recognizing products when a buyer places them on the counter, and enables rapid and accurate calculation with a high product recognition rate through artificial intelligence learning data.

[0007] The objectives of the present invention are not limited thereto, and other unmentioned objectives will be clearly understood by those skilled in the art from the description below.

[0008] An unmanned product checkout device for achieving the objectives of the present invention as described above comprises: a conveying unit for conveying a product requiring calculation; a product recognition unit provided on one side of the conveying unit for recognizing whether the product is placed on the conveying unit; a scanning unit provided on one side of the rear end of the conveying unit relative to the product recognition unit for scanning at least one of the barcode and image of the product being conveyed through the conveying unit; an external scanning unit provided on the outside of the conveying unit or the scanning unit for recognizing a product having a volume that is wider than the width of the conveying unit or larger than the height of the scanning unit; and a calculation unit including a payment unit that displays the prices of products recognized by passing through the scanning unit and the external scanning unit and performs payment.

[0009] Additionally, the calculation unit may further include a processor that identifies the product based on the barcode or image of the product scanned through the scanning unit or the external scanning unit.

[0010] In addition, the above processor can utilize artificial intelligence training data.

[0011] In addition, it may further include an auxiliary transfer unit provided on one side corresponding to the external scanning unit to easily place or transfer a product recognized by the external scanning unit.

[0012] In addition, one side of the above auxiliary conveying unit may further include a conveying roller to assist in the conveying of the product.

[0013] In addition, the above auxiliary conveying unit may be made of a conveyor belt.

[0014] In addition, it may further include an auxiliary recognition unit provided on one side of the auxiliary transfer unit to recognize whether a product is seated and to drive the auxiliary transfer unit.

[0015] In addition, it may further include a weight sensor provided on one side of the lower part of the transfer unit to measure the weight of the product scanned by the scanning unit for verification of the product.

[0016] The unmanned product checkout device according to the present invention has the following effects.

[0017] First, it has the effect of enabling easy, quick, and accurate calculation by automatically identifying the product when the buyer places it on the conveyor, without the need for the cashier or the buyer to scan the product's barcode.

[0018] Second, in addition to general products, it also has the effect of automatically identifying products by automatically recognizing bulky box-shaped products sold in large stores through the external scanning unit.

[0019] Third, the scanning unit, external scanning unit, and calculation unit have the effect of enabling faster and more accurate product calculation by improving the product recognition rate through artificial intelligence training data.

[0020] Fifth, adding a product sorting unit has the effect of significantly improving the product recognition rate by recognizing in real time and separating the overlapping products, even if some products are placed overlappingly when a buyer places them on the conveyor.

[0021] Sixth, since there is no need for a cashier to be stationed there, it has the effect of reducing store operating and management costs.

[0022] The effects of the present invention are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art from the description in the claims.

[0023] The following drawings attached to this specification illustrate preferred embodiments of the present invention and serve to further enhance understanding of the technical concept of the present invention together with the detailed description of the invention; therefore, the present invention should not be interpreted as being limited only to the matters described in such drawings.

[0024] FIG. 1 is a perspective view of an unmanned product checkout device according to the present invention;

[0025] FIG. 2 is a side view of an unmanned product checkout device according to the present invention;

[0026] FIG. 3 is a side view of an unmanned product checkout device according to the present invention in another direction; and

[0027] FIG. 4 is a perspective view showing the internal configuration of a scanning unit according to the present invention.

[0028] The advantages and features of the present invention and the methods for achieving them will become clear by referring to the embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below but may be implemented in various different forms. These embodiments are provided merely to ensure that the disclosure of the present invention is complete and to fully inform those skilled in the art of the scope of the present invention, and the present invention is defined only by the scope of the claims.

[0029] The terms used in this specification are for describing embodiments and are not intended to limit the invention. In this specification, the singular form includes the plural form unless specifically stated otherwise in the text. The terms "comprises" and / or "comprising" used in this specification do not exclude the presence or addition of one or more other components in addition to the components mentioned. Throughout the specification, the same reference numerals refer to the same components, and "and / or" includes each of the mentioned components and all combinations of one or more. Although terms such as "first," "second," etc., are used to describe various components, these components are not limited by these terms. These terms are used merely to distinguish them from a single component. Therefore, the first component mentioned below may be the second component within the technical scope of the invention.

[0030] Unless otherwise defined, all terms used herein (including technical and scientific terms) may be used in a meaning commonly understood by those skilled in the art to which the present invention pertains. Furthermore, terms defined in commonly used dictionaries are not to be interpreted ideally or excessively unless explicitly and specifically defined otherwise.

[0031]

[0032] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the attached drawings.

[0033]

[0034] Configuration of an unmanned product checkout device

[0035]

[0036] FIG. 1 is a perspective view of an unmanned product checkout device according to the present invention, FIG. 2 is a side view of an unmanned product checkout device according to the present invention, FIG. 3 is a side view of an unmanned product checkout device according to the present invention in another direction, and FIG. 4 is a perspective view showing the internal configuration of a scanning unit according to the present invention.

[0037] As shown in FIGS. 1 to 4, the unmanned product calculation device (10) according to the present invention may be largely composed of a transfer unit (100), a product recognition unit, a scanning unit (200), a weight sensor, an external scanning unit (300), and a calculation unit (500).

[0038] The conveying unit (100) is a device for conveying goods for calculation. Any device capable of stably conveying goods for a subsequent process for calculation once the goods are placed on the conveying unit (100) may be used. In one embodiment, the conveying unit (100) may be composed of a conveyor belt or a roller device driven by a motor.

[0039] Depending on the mode of use, the conveying unit (100) may further include a product sorting device (not shown). This product sorting device is a device that separates unrecognized products separately when the product is not properly recognized as a result of the scan recognition of the scanning unit (200) described later. This product sorting device may be configured such that one side of the conveying unit (100) is branched so that properly recognized products and unrecognized products can be sorted, or that a multi-directional roller is used on one side of the conveying unit (100) so that properly recognized products and unrecognized products can be discharged through separate paths.

[0040] The product recognition unit is a device provided on one side of the transfer unit (100), preferably on one side of one end of the transfer unit (100), and generates a control signal to control whether the transfer unit (100) is driven by determining whether a product is placed on the transfer unit (100). Since operating the transfer unit (100) at all times regardless of whether a product is placed increases maintenance costs and can increase the load on the transfer unit (100), the device recognizes whether a product is placed so that the transfer unit (100) is driven only when a product is placed, thereby enabling stable operation. Any device capable of accurately verifying whether a product is placed may be provided as such, provided that the product recognition unit is provided on one side of the transfer unit (100), preferably on the side of the transfer unit (100) where the buyer places the product. In one embodiment, the product recognition unit may be composed of a sensor device such as a proximity sensor, an infrared sensor, a vision sensor, or a pressure sensor. In addition to such sensor devices, any device capable of quickly and easily recognizing whether a product is placed on the conveying unit (100) may be used.

[0041] The unmanned product checker (10) according to the present invention may further be provided with a product sorting unit on one side of the transfer unit (100) or on one side adjacent to the transfer unit (100) to organize products placed on the transfer unit (100) so that the products placed on the transfer unit (100) are not transported in an overlapping state depending on the mode of use. Any device capable of organizing products placed on the transfer unit (100) so that they do not overlap so that they can be easily scanned by the scanning unit (200) may be used for this product sorting unit. In one embodiment, a robot arm may be used for the product sorting unit, and preferably, a multi-joint robot arm is used so that the work can be performed over the entire surface area of ​​the transfer unit (100). More preferably, a vision sensor for checking the seating state of products placed on the transfer unit (100) is provided on one side of the robot arm. Depending on the mode of use, the product sorting unit having such a configuration may be configured not only to simply sort products placed on the transport unit (100), but also to allow a robot arm to transport products contained in a shopping cart to the transport unit (100). In this way, when the product sorting unit made of a robot arm directly moves products to the transport unit (100), a recognition sensor for recognizing the approach of a buyer, a shopping cart, or a shopping basket may be further provided on one side of the transport unit (100).

[0042] The scanning unit (200) is a device provided on one side of the transport unit (100), preferably on the rear side of one end of the transport unit (100) where the product is placed, to scan the barcode and image of the product being transported through the transport unit (100) to identify what kind of product it is. Any scanning device may be used for this scanning unit (200) as long as it is capable of clearly identifying what kind of product the product being transported is by scanning the product being transported by the transport unit (100) and comparing it with previously registered information. Preferably, it is preferable to use a device capable of scanning at least one of the product's barcode or image, and more preferably, as shown in FIG. 4, it is preferable to use a scanning device equipped with a plurality of scanning units (210) to scan the product from multiple directions. In this case, when a plurality of scanning units (210) are provided, the barcode scanning unit and the image scanning unit are each configured to include at least one of each.

[0043] As such, the scanning unit (200) is equipped with both a barcode scanning unit and an image scanning unit, thereby enabling the transmission of the product's barcode and images of the product captured from multiple angles to the calculation unit (500). Accordingly, if the product's barcode is not recognized, the product can be clearly identified through information such as the product name, string, logo, and packaging design displayed in the image scan information.

[0044] This scanning unit (200) can gradually improve the accuracy of scan information, particularly image scan information, through deep learning. That is, as the number of image scans of a product increases, the accuracy of the image scan improves.

[0045] The weight sensor is provided on one side of the lower portion of the transport unit (100) and is a device for measuring the weight of a product, used to verify the product scanned by the scan unit (200) in duplicate with the scan unit (200). At this time, based on the weight measurement information of the product being measured, the weight of the product identified by the scan unit (200) is compared with the actual weight of the product to verify whether the scan information of the scan unit (200) is clear, thereby enabling a more accurate calculation. Accordingly, any weight measuring device may be used as long as it is a device capable of accurately measuring the weight of a product being transported regardless of the position of the product placed on the transport unit (100), provided that at least one weight sensor is provided on one side of the transport unit (100).

[0046] The external scanning unit (300) is a scanning device for the barcode or image of a product, which is separately provided on the outside of the transport unit (100) or the scanning unit (200) to recognize products that are difficult to transport in the transport unit (100) or difficult to pass through the scanning unit (200). In one embodiment, when purchasing a product, particularly a box containing multiple products with a large volume, the volume of the box may be considerably large. In such cases, if the width of the box is wider than the width of the transport unit (100) or the height of the box is higher than the height of the scanning unit (200), smooth scanning of the product may not be possible. To scan such large products, a separate external scanning unit (300) may be provided on the outside of the transport unit (100). As such, with the external scanning unit (300) provided, large products can also be scanned smoothly and the products can be verified.

[0047] On one side corresponding to the external scanning unit (300), an auxiliary transport unit (400) may be further provided to allow the product being scanned through the external scanning unit (300) to easily pass through the external scanning unit (300). This auxiliary transport unit (400) may simply be made of a flat plate having a predetermined area to allow at least one side of the product to be placed. In another embodiment, the auxiliary transport unit (400) may be equipped with a transport roller so that the buyer can easily move the product when the product is placed and transported. In yet another embodiment, the auxiliary transport unit (400) may be composed of a conveyor belt so that the product can be automatically transported with at least one side of the product placed thereon. In this case, if the auxiliary transport unit (400) is composed of a conveyor belt, an auxiliary recognition unit that recognizes whether the product is placed on the auxiliary transport unit (400) may be further included, and this auxiliary recognition unit may be composed of the same or similar configuration as the product recognition unit described above.

[0048] The calculation unit (500) is a device that collects information on the types and quantities of products recognized by the scanning unit (200) and the external scanning unit (300), calculates and displays price information thereof, induces payment from the buyer, and performs payment by including a payment unit (520) where payment is made. Any device capable of displaying the types and quantities of recognized products to the buyer and allowing the buyer to proceed with payment may be used for this calculation unit (500). However, it is preferable to use a calculation device that includes a display unit (510) that displays calculated information such as the price and quantity of products to the user, and a payment unit (520) where payment is made.

[0049] At this time, the calculation unit (500) may include a control unit that is electrically connected to at least one of the aforementioned transfer unit (100), product recognition unit, scan unit (200), weight sensor, external scan unit (300), auxiliary transfer unit (400), and auxiliary recognition unit to control each of them. Of course, it is obvious that depending on the mode of use, the control unit may not be included in the calculation unit (500) but may be provided in a separate location.

[0050] The control unit may include a processor for calculating products, and the processor has price information and weight information for products being sold input, and controls the identification of products based on the barcode, image, and weight of the product measured through a weight sensor of the product scanned through the scan unit (200) and the external scan unit (300). At this time, the processor can perform product identification using artificial intelligence learning data.

[0051]

[0052] Usage patterns of unmanned product checkout devices

[0053]

[0054] The usage mode of the unmanned product checkout device (10) having the above-described configuration is explained in more detail as follows.

[0055] First, the buyer places at least one product in a shopping cart or shopping basket and moves to an unmanned product checkout device (10) according to the present invention.

[0056] Next, the buyer places the product on the transfer unit (100) for payment of the product they wish to purchase.

[0057] Next, the product sorting unit checks the seating state of the products placed on the conveying unit (100), and if the products are placed in an overlapping state, it recognizes this through a vision sensor or the like and automatically sorts the products so that they do not overlap in order to facilitate smooth scanning.

[0058] Depending on the usage pattern, when a buyer, shopping cart, or shopping basket is recognized, a product sorting unit made of a robot arm may automatically transfer the products contained in the shopping cart or shopping basket to a transfer unit (100) so that they do not overlap each other.

[0059] When a buyer moves the product directly or the product transfer unit (100) moves the product, if the products are transferred to the scanning unit (200) in a stacked state, scanning may not be easily performed. Therefore, the product transfer unit (100) recognizes the arrangement state of the products and arranges them so that they do not overlap, thereby facilitating the subsequent process of scanning the products.

[0060] Next, when a product is placed on the transfer unit (100), a product recognition unit provided on one side of the transfer unit (100) recognizes the placement of the product and drives the transfer unit (100). That is, when the product recognition unit transmits product recognition information to the control unit, the control unit drives the transfer unit (100). When the product recognition unit recognizes the initial placement of a product, the control unit drives the transfer unit (100), and when it recognizes the placement of an additional product, it continues to drive the transfer unit (100). If, during the operation of the transfer unit (100), an additional recognition signal is not recognized by the product recognition unit for a period of time, the operation of the transfer unit (100) is stopped.

[0061] Next, the product placed on the transfer unit (100) is transferred to the scanning unit (200) according to the operation of the transfer unit (100), and the scanning unit (200) acquires at least one of the product's barcode and image information and transmits it to the control unit. Since the scanning unit (200) according to the present invention does not simply scan the product's barcode to identify the product, but acquires information such as the product name, string, logo, and packaging design from various angles as image information and transmits it to the control unit, the scanning unit (200) can easily and clearly recognize the product even if the barcode is not recognized in the scanning direction of the scanning unit (200).

[0062] Next, to cross-verify whether the scan result of a product passing through the scanning unit (200) is accurate, the weight of the product is measured using a weight sensor, and the measured weight information of the product is transmitted to the control unit. At this time, the control unit determines whether there is an error in product recognition by comparing the previously entered weight information of the product scanned by the scanning unit (200) with the weight information transmitted from the weight sensor. In this way, since the product is identified twice through the scanning unit (200) and the weight sensor in the present invention, errors in product recognition can be significantly reduced.

[0063] In the present invention, for the convenience of explanation, it is described that weight measurement by a weight sensor is performed after scanning; however, depending on the mode of use, a weight sensor may be provided on one side of the lower portion of the transfer unit (100) equipped with a scanning unit (200) to measure the weight of the product simultaneously with scanning the product and cross-verify the product.

[0064] The aforementioned product identification process is repeated until no additional product recognition is performed in the product recognition unit, and the calculation unit (500) and the control unit can display product information, such as the type and quantity of products identified through the scan unit (200) and the weight sensor, and price information for each product individually or summed and displayed in the calculation unit (500).

[0065] During the aforementioned product identification process, if the product is bulky, or if the product is not transported smoothly when placed on the transport unit (100) in one embodiment, or if the product is a box product with a volume larger than the placement position or width of the scan unit (200), it may be difficult to perform the aforementioned process smoothly. In such cases, the product can be identified by recognizing it through an external scan unit (300).

[0066] At this time, depending on whether the external scanning unit (300) is equipped with and configured with the auxiliary transport unit (400), the user can directly transport boxes, etc. to the external scanning unit (300) for recognition, or supply goods to the external scanning unit (300) more easily through the auxiliary transport unit (400).

[0067] The auxiliary transfer unit (400) can be configured in various ways, and depending on the configuration, there are some differences in the method of operation.

[0068] In one embodiment, if the auxiliary transfer unit (400) includes a transfer roller without a separate driving device, after placing the product on the auxiliary transfer unit (400), the buyer can apply a predetermined force to the product to transfer it, thereby making it easier to transfer the product to the external scanning unit (300).

[0069] In another embodiment, when the auxiliary transfer unit (400) is configured as a conveyor belt or as a transfer roller equipped with a drive motor, the auxiliary transfer unit (400) is automatically driven and the product can be transferred to an external scanning unit (300) when the product is placed on the auxiliary transfer unit (400) as in the aforementioned transfer unit. At this time, an auxiliary recognition unit is provided on one side of the auxiliary transfer unit (400) to check whether the product is placed on the auxiliary transfer unit (400) and to automatically drive the auxiliary transfer unit (400). The recognition of the product and the driving state of the auxiliary transfer unit (400) can be driven in the same or similar manner as the driving of the product recognition unit and the transfer unit (100) described above.

[0070] In the present invention, for the convenience of explanation, the external scanning unit (300) is shown attached to the side of the scanning unit, but it is obvious that depending on the mode of use, the external scanning unit (300) may be provided at a position relatively higher than the scanning unit or spaced apart by a predetermined distance through a connecting member such as a connecting arm.

[0071] If no more products are recognized by the product recognition unit and auxiliary recognition unit through the aforementioned process, the calculation unit (500) can comprehensively calculate the types and quantities of products identified through the scanning unit (200) and external scanning unit (300), display overall information about the purchased products to the buyer on the display unit (510), and induce payment.

[0072] Finally, the user can check the information displayed on the display unit (510) of the calculation unit (500), perform payment through the payment unit (520), and complete the purchase of the product.

[0073]

[0074] As explained above, those skilled in the art to which the present invention pertains will understand that the present invention may be implemented in other specific forms without altering its technical concept or essential features. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive. The scope of the present invention is defined by the claims set forth below rather than by the detailed description, and all modifications or variations derived from the meaning and scope of the claims and equivalent concepts should be interpreted as being included within the scope of the present invention.

Claims

1. A conveying unit for conveying goods requiring calculation; A product recognition unit provided on one side of the above-mentioned transfer unit for recognizing whether the product is seated on the above-mentioned transfer unit; A scanning unit provided at one side of the rear end of the transfer unit relative to the product recognition unit, for scanning at least one of the barcode and image of the product being transferred through the transfer unit; An external scanning unit provided on the outside of the above-mentioned transfer unit or scanning unit for recognizing a product having a volume that is wider than the width of the transfer unit or larger than the placement height of the scanning unit; and A calculation unit including a payment unit that displays the prices of products recognized by passing through the above-mentioned scanning unit and external scanning unit and performs payment; An unmanned product checkout device including 2. In Paragraph 1, The above calculation unit is an unmanned product checkout device further comprising a processor that identifies the product based on the barcode and image of the product scanned through the above scanning unit or the above external scanning unit.

3. In Paragraph 2, The above processor is an unmanned product checkout device characterized by using artificial intelligence learning data.

4. In Paragraph 1, An unmanned product checkout device further comprising an auxiliary transfer unit provided on one side corresponding to the external scanning unit to easily place or transfer a product recognized by the external scanning unit.

5. In Paragraph 4, An unmanned product counting device further comprising a transfer roller on one side of the above-mentioned auxiliary transfer unit to assist in the transfer of products.

6. In Paragraph 4, The above auxiliary transfer unit is an unmanned product counting device consisting of a conveyor belt.

7. In Paragraph 6, An unmanned product checkout device further comprising an auxiliary recognition unit provided on one side of the above-mentioned auxiliary transfer unit to recognize whether a product is seated and to drive the above-mentioned auxiliary transfer unit.

8. In Paragraph 1, An unmanned product checkout device further comprising a weight sensor provided on one side of the lower portion of the above transfer unit to measure the weight of the product scanned by the above scanning unit for verification of the product.

Images