Product image acquisition device and unmanned product registration and calculation device using same

Abstract

To achieve the purpose of the present invention, the product image acquisition device comprises: a base unit having a predetermined area to provide a space in which a product is seated, and provided to be rotatable in at least one direction; a scan housing provided to surround the base unit, and having at least one open side to supply the product to the base unit; a scan unit provided on one inner side of the scan housing and disposed toward the base unit to photograph the product seated in the base unit; and a control unit for controlling the base unit and the scan unit and processing images acquired by the scan unit.

Description

Product image acquisition device and unmanned product registration and calculation device using the same

[0001] The present invention relates to a product image acquisition device and an unmanned product registration and calculation device using the same. More specifically, the invention relates to a product image acquisition device and an unmanned product registration and calculation device using the same, wherein the functions are combined to enable the simultaneous acquisition of product images and unmanned calculation, and wherein the stored product images can be utilized as one of the recognition methods together with the product barcodes, so as to enable rapid and accurate recognition of products for smooth unmanned product calculation.

[0002] Generally, a checkout counter is a counter located near the soccer side of a supermarket or convenience store where purchased products are verified and payment is made. These checkout counters can be broadly classified into manned checkout counters and unmanned checkout counters depending on the presence or absence of a cashier.

[0003] At manned checkout counters, products are typically placed on a fixed counter or on a conveyor belt and moved toward the cashier. The cashier then holds a scanner to locate and recognize the barcode of each product to verify the item. The scanned information recognized in this way displays product and price information based on the data entered into the checkout, and prompts the user to make a payment through a payment terminal.

[0004] These manned checkout counters have the advantage of preventing recognition errors, as cashiers identify products one by one and scan their barcodes, and allowing for quick responses even if errors occur because a cashier is present. However, there are issues regarding labor costs, as cashiers must always be on standby at the counter regardless of customer presence; payment times increase because cashiers must scan products individually; errors may occur due to cashier mistakes; and customer privacy issues may arise.

[0005] A self-checkout counter is a device that eliminates cashiers and uses a scanner fixed near a conveyor belt to automatically recognize products moving along the belt, thereby facilitating payment. While such self-checkout counters protect customer privacy and eliminate labor costs, various errors can occur depending on how the consumer places the product on the conveyor belt. Specifically, proper recognition may fail if products move while overlapping or if they are placed on the edges of the conveyor belt, causing them to pass through the scanner's blind spots. Furthermore, depending on the type of scanner equipped, if the scanner only recognizes barcodes, product recognition may fail even if the product is placed correctly on the conveyor belt, provided the printed barcode surface does not align with the scanner's recognition direction.

[0006] The present invention aims to solve conventional problems by providing a product image acquisition device and an unmanned product registration and calculation device using the same, wherein the functions are combined to enable the simultaneous acquisition of product images and unmanned calculation, and to enable rapid and accurate recognition of products for smooth unmanned product calculation by easily acquiring and storing product images and utilizing the stored product images as one of the recognition methods together with the product barcode.

[0007] The objectives of the present invention are not limited thereto, and other unmentioned objectives will be clearly understood by those skilled in the art from the description below.

[0008] A product image acquisition device for achieving the objective of the present invention as described above comprises: a base portion having a predetermined area to provide a space for a product to be placed and configured to be rotatable in at least one direction; a scan housing configured to surround the base portion and having at least one side open to supply the product to the base portion; a scan unit configured on one side inside the scan housing and positioned toward the base portion to photograph the product placed on the base portion; and a control unit that controls the base portion and the scan unit and processes the image acquired from the scan unit.

[0009] At this time, in order to acquire various images of the product, a plurality of scan units may be provided on one side inside the scan housing.

[0010] In addition, the control unit can learn the product image data using artificial intelligence learning data.

[0011] An unmanned product registration and calculation device for achieving the purpose of the present invention in another category comprises: a space for a product requiring calculation or a product requiring new registration to be placed, a transfer unit for transporting the placed product, a scanning unit provided on one side of the transfer unit for acquiring a new image of the product being transported or scanning at least one of a barcode and an image of a previously registered product, a calculation unit including a payment unit that displays information and prices of products passing through the scanning unit and performs payment, and a control unit that controls the transfer unit, the scanning unit, and the calculation unit.

[0012] At this time, the scanning unit may include a scanning housing provided to surround one side of the transfer unit and a scanning unit provided on one side inside the scanning housing to acquire a new image of the product or to scan at least one of the barcode and image of the product.

[0013] In addition, one side of the transfer unit corresponding to the scanning unit may further include a rotation unit for rotating the product.

[0014] In addition, the device may further include a product sorting unit provided on one side of the conveying unit or on one side adjacent to the conveying unit to sort products that are seated on the conveying unit and being conveyed, or to flip or change the direction of the products in order to acquire an image of the other side of the products for which a first image has been acquired in the scanning unit.

[0015] In addition, it may further include a product recognition unit provided on one side of the transfer unit to recognize whether the product is seated on the transfer unit.

[0016] In addition, it may further include a weight sensor provided on one side of the lower part of the above transfer unit to measure the weight of the product newly registered or scanned by the above scanning unit.

[0017] In addition, the control unit may further include a processor that identifies the product based on the barcode or image of the product scanned through the scan unit or the external scan unit.

[0018] In addition, the above processor can utilize artificial intelligence training data.

[0019] The product image acquisition device according to the present invention and the unmanned product registration and calculation device using the same have the following effects.

[0020] First, instead of the manager having to manually capture images of products requiring new registration, images are automatically captured and saved through a product image acquisition machine or an unmanned product registration and checkout device, which has the effect of enabling the rapid and easy acquisition of a large amount of image data necessary for new product registration.

[0021] Second, as product registration is automated, anyone, even those without expertise, can easily register new products for product identification.

[0022] Third, since product registration and calculation can be performed on a single device, it has the effect of maximizing store space utilization.

[0023] Fourth, as product registration is automated, the number of managers can be minimized, and store management efficiency can be maximized, such as by reducing management costs, because cashiers are not needed when customers purchase products.

[0024] Fifth, even without the cashier or the buyer scanning the product's barcode, the system automatically and accurately identifies the product when the buyer places it on the conveyor, thereby enabling easy, quick, and accurate calculation.

[0025] Sixth, the product sorting unit not only ensures that products are stably placed and transported to the transport unit through sorting, but also has the effect of maximizing product scanning efficiency.

[0026] Seventh, since the product sorting unit can directly transfer products contained in shopping carts or shopping baskets to the transfer unit, it has the effect of maximizing the buyer's purchasing efficiency.

[0027] Eighth, the product sorting unit sequentially delivers products to the transfer unit according to usage patterns to adjust the product supply interval, thereby preventing subsequently supplied products from being supplied to the scanning unit when a previously supplied product is scanned, which has the effect of maximizing the product recognition rate.

[0028] Ninth, the scanning and calculation units have the effect of enabling faster and more accurate product calculations by improving the product recognition rate through artificial intelligence training data.

[0029] Tenth, when calculating products, the product image data obtained is also compared with the previously entered basic image data, and by selectively adding basic data, the product recognition rate is maximized with repeated use.

[0030] The effects of the present invention are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art from the description in the claims.

[0031] The following drawings attached to this specification illustrate preferred embodiments of the present invention and serve to further enhance understanding of the technical concept of the present invention together with the detailed description of the invention; therefore, the present invention should not be interpreted as being limited only to the matters described in such drawings.

[0032] FIG. 1 is a perspective view of a product image acquisition device according to the present invention;

[0033] FIG. 2 is a perspective view showing a scan housing of a product image acquisition device according to the present invention in a partially open state;

[0034] FIG. 3 is a perspective view of an unmanned product registration and calculation device according to the present invention;

[0035] FIG. 4 is a perspective view of an unmanned product registration and calculation device according to the present invention in a different direction;

[0036] FIG. 5 is a perspective view showing the internal configuration of the scanning unit of an unmanned product registration and calculation device according to the present invention; and

[0037] FIG. 6 is a plan view showing the internal configuration of the scanning unit of an unmanned product registration and calculation device according to the present invention.

[0038] The advantages and features of the present invention and the methods for achieving them will become clear by referring to the embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below but may be implemented in various different forms. These embodiments are provided merely to ensure that the disclosure of the present invention is complete and to fully inform those skilled in the art of the scope of the present invention, and the present invention is defined only by the scope of the claims.

[0039] The terms used in this specification are for describing embodiments and are not intended to limit the invention. In this specification, the singular form includes the plural form unless specifically stated otherwise in the text. The terms "comprises" and / or "comprising" used in this specification do not exclude the presence or addition of one or more other components in addition to the components mentioned. Throughout the specification, the same reference numerals refer to the same components, and "and / or" includes each of the mentioned components and all combinations of one or more. Although terms such as "first," "second," etc., are used to describe various components, these components are not limited by these terms. These terms are used merely to distinguish them from a single component. Therefore, the first component mentioned below may be the second component within the technical scope of the invention.

[0040] Unless otherwise defined, all terms used herein (including technical and scientific terms) may be used in a meaning commonly understood by those skilled in the art to which the present invention pertains. Furthermore, terms defined in commonly used dictionaries are not to be interpreted ideally or excessively unless explicitly and specifically defined otherwise.

[0041]

[0042] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the attached drawings.

[0043]

[0044] Configuration of a product image acquisition device

[0045]

[0046] FIG. 1 is a perspective view of a product image acquisition device according to the present invention, and FIG. 2 is a perspective view showing a scan housing of a product image acquisition device according to the present invention partially opened. The product image acquisition device (10) according to the present invention is a device that acquires various images of a product so that, when using an unmanned checkout device, the product's appearance image in addition to the product's barcode can be utilized as basic data to more easily and quickly identify the product. Thus, by storing and utilizing various image information of the product, when the product's barcode is recognized during identification, the product is identified using the barcode; however, even if the product's barcode is not quickly recognized due to the product's arrangement state or crumpled state, the product can be quickly identified by comparing the stored image data with the product's image.

[0047] As shown in FIGS. 1 and 2, the product image acquisition device (10) according to the present invention may be largely composed of a base part (11), a scan housing (12), and a scan unit (13).

[0048] The base portion (11) is a device that provides a space for the product to be placed and rotates the product so that the scan unit (13) can acquire images of the product from various directions. The base portion (11) is made of a plate-shaped member having a predetermined area, and any device capable of rotating the product placed on the base portion (11) by rotating the plate-shaped member in at least one direction may be used.

[0049] The scan housing (12) is provided to surround the base part (11) and the product placed on the base part (11), and is a device that allows the scan unit (13) provided on one side inside to acquire an image of the product without being obstructed by surrounding light or objects. The scan housing (12) may be formed in any structure as long as it provides space so that the scan unit (13) can easily acquire an image of the product without obstructing the rotation of the base part (11) and the product. In one embodiment, the scan housing (12) may be formed in various structures such as a cuboid, a sphere, or a hemisphere, and it is preferable to have a door that is open or can be opened and closed on at least one side so that the product can be inserted and removed inside.

[0050] Although the present invention is described with a focus on a structure in which the base part (11) provided inside the scan housing (12) is rotatable, it is obvious that depending on the mode of use, the base part (11) may be fixed and the scan housing (12) may rotate, or both the base part (11) and the scan housing (12) may be provided to be rotatable.

[0051] The scan unit (13) is a device that is provided inside the scan housing (12) and captures a product mounted on the base part (11) to obtain an image of the product. Any device capable of scanning a product mounted on the base part (11) and obtaining an image of the product may be used for this scan unit (13), provided on one side inside the scan housing (12). However, as shown in FIG. 2, it is preferable to have a plurality of scan units (13) to quickly scan images of the product from various angles. At this time, any device capable of scanning a product and transmitting an image of the product to a control unit may be used for the scan unit (13), but it is preferable to use an image sensor or a vision sensor.

[0052] The control unit is a device that is electrically connected to the base unit (11) and the scan unit (13) to control them respectively and process images acquired from the scan unit (13). Any device capable of easily controlling the base unit (11) and the scan unit (13), and registering and organizing images acquired from the scan unit (13) by product to store and organize data for product identification thereafter, may be used for this control unit. In one embodiment, the control unit may consist of a computer provided externally and electrically connected, or a separate control device provided on one side of the scan unit (13). Additionally, the control unit includes a processor capable of identifying the corresponding product based on images acquired from the scan unit (13), and this processor may use artificial intelligence learning data to learn as product images accumulate, thereby further improving the efficiency of product identification.

[0053]

[0054] Configuration of unmanned product registration and checkout devices

[0055]

[0056] FIG. 3 is a perspective view of an unmanned product registration and calculation device according to the present invention, FIG. 4 is a perspective view of an unmanned product registration and calculation device according to the present invention in a different direction, FIG. 5 is a perspective view showing the internal configuration of the scanning unit of an unmanned product registration and calculation device according to the present invention, and FIG. 6 is a plan view showing the internal configuration of the scanning unit of an unmanned product registration and calculation device according to the present invention.

[0057] The unmanned product registration and calculation device (20) according to the present invention is a device capable of selectively performing product registration and calculation so that products can be registered and unmanned calculation can be performed in a single device without separately configuring the product image acquisition device (10) as described above. As shown in FIGS. 3 to 6, this unmanned product registration and calculation device (20) may be largely composed of a transfer unit (100), a product sorting unit (300), a scanning unit (200), a calculation unit (400), and a control unit.

[0058] The transfer unit (100) is a device for transferring new products for product registration or products requiring calculation. Any device capable of stably transferring products for subsequent processes for product registration or calculation once the products are placed in the transfer unit (100) may be used. In one embodiment, the transfer unit (100) may be composed of a conveyor belt or a roller moving device driven by a motor, and depending on the mode of use, a wider variety of transfer devices may be used.

[0059] At this time, one side of the transfer unit (100), preferably the side of the transfer unit (100) corresponding to the location where the scan unit (200) is provided, may further include a rotation unit (110) for rotating a product being transferred, as shown in FIGS. 5 and 6. This rotation unit (110) is a device for rotating a product to make identification easier by rotating the product at a predetermined angle when the scan unit (200) obtains images of the product in various directions to obtain various images of the product for the registration of a new product, or when product identification by the scan unit (200) is not easy. Any device capable of performing smooth transfer of the product along the length direction of the transfer unit (100) as well as selectively rotating the product may be used for this rotation unit (110). In one embodiment, the rotation unit (110) may be composed of a rotary rotation device, a rotation table, a spinner, a belt rotation device, etc. That is, as long as the device can rotate the product at a predetermined angle like the base part (11) of the product image acquisition device (10) described above, and can perform both rotation and transport so that the product can easily pass through the scanning part (200) and be transported, there are no special restrictions on the device, and any rotation device may be used. The rotation unit (110) of such a transport part (100) can perform the function of the base part (11) of the product image acquisition device (10) described above.

[0060] Additionally, a product recognition unit (not shown) may be further provided on one side of the transfer unit (100), preferably on one side of the end portion of the transfer unit (100) where the buyer places the product, to determine whether the product is placed on the transfer unit (100) and to transmit a control signal to the control unit to control whether the transfer unit (100) is driven. If the transfer unit (100) is always driven regardless of whether the product is placed, the maintenance cost for driving the transfer unit (100) increases and the load on the transfer unit (100) may increase. Therefore, the product recognition unit is provided to recognize whether the product is placed so that the transfer unit (100) is driven only when the product is placed, that is, when the product for product registration or product purchase is placed, thereby enabling stable operation. Any device capable of accurately verifying whether the product is placed on the transfer unit (100) may be provided for this product recognition unit. In one embodiment, the product recognition unit may be composed of a sensor device such as a proximity sensor, an infrared sensor, a vision sensor, or a pressure sensor. In addition to such sensor devices, any device capable of quickly and accurately recognizing whether a product is placed on the transport unit (100) may be used.

[0061] The product sorting unit (300) is provided on one side of the transport unit (100), preferably on one side of the transport unit (100) that is relatively ahead of the scan unit (200) or on one side adjacent thereto, and may sort products such as separating products being transported in an overlapping state to facilitate smooth scanning of products supplied to the scan unit (200), or adjusting the placement position of products to make transport easier, or any device capable of changing the direction of products, particularly in the up and down direction, after the first scan operation is completed at the scan unit (200) when registering new products. In one embodiment, as shown in the drawing, a robot arm may be utilized as the product sorting unit (300). A device provided at the end of such a robot arm to sort products or to pick up products for changing direction may utilize various units such as a gripping unit or a suction unit. In addition, it is preferable to provide a vision sensor on one side of the product sorting section (300), preferably on one side of the end portion of the product sorting section (300) adjacent to the product, for checking the transfer status and placement position of the product.

[0062] As described above, the product sorting unit (300), which is composed of a robot arm, may not only sort products being transported to the transport unit (100) according to the mode of use, but may also be configured to be provided on one side of the end portion of the transport unit (100) where the products are first placed, so as to directly transfer products contained in a shopping cart (1000) or a shopping basket to the transport unit (100). In this way, when the product sorting unit (300) directly transfers products to the transport unit (100), a recognition sensor for recognizing the approach of a buyer, the shopping cart (1000), or the shopping basket may be further provided on one side of the transport unit (100) or the product sorting unit (300), or a button or switch for the buyer to input a command to transfer products may be provided.

[0063] The scanning unit (200) is provided on one side of the conveying unit (100), preferably on one side of the middle part of the conveying unit (100), and more preferably on one side corresponding to the side where the rotating unit (110) of the conveying unit (100) is provided, and is a device for identifying a product by obtaining an image of a new product according to the purpose of use, or by obtaining an image that can be compared with the barcode of a product to be purchased or a previously registered product image. This scanning unit (200) scans the product conveyed by the conveying unit (100) to obtain an image for a new product, obtains an image for identifying a product by comparing it with a previously registered product image, or scans the product barcode to identify the product, and any device capable of clearly verifying and obtaining the image or barcode of a product may be used. As shown in FIGS. 5 and 6 according to one embodiment, this scanning unit (200) may be composed of a scanning housing (210) and a scanning unit (220).

[0064] The scan housing (210) is a device that provides a space for a scan unit (220) to be seated inside. This scan housing (210) is provided on one side of the transfer unit (100), preferably on the side where the rotation unit (110) of the transfer unit (100) is provided, and may be formed as a cuboid, spherical, or hemispherical structure with both sides open along the direction of travel of the transfer unit (100). However, it is preferable that it be formed as a cuboid structure.

[0065] The scan unit (220) is a device provided on one side of the inside of the scan housing (210) to acquire an image of a product being transported through the transport unit (100) or to scan a barcode printed on one side of the product. Any device capable of easily acquiring an image of a product or scanning a barcode may be used as the scan unit (220). Preferably, it is preferable to use a device capable of scanning at least one of a barcode or an image and transmitting such scan information to a control unit. More preferably, to facilitate product registration and product identification, it is preferable to have multiple scan units (220) provided on one side of the inside of the scan housing (210) so that the product can be scanned from multiple directions. At this time, the multiple scan units (220) may each include at least one barcode scan unit (220) and an image scan unit (220), or all scan units (220) may be equipped as devices capable of barcode scanning and image scanning. As such, the scan unit (220) according to the present invention is provided in multiple units inside the scan housing (210) and scans products from various directions, thereby acquiring various product images at once and maximizing product identification efficiency.

[0066] As such, since the scanning unit (200) captures and scans images from multiple angles along with the barcode and transmits them, even if the barcode of the product is not accurately recognized, the product can be accurately identified by using various information such as the product name, string, logo, and packaging design displayed on the surface of the product, which is an image already input into the control unit.

[0067] The image information of a product transmitted to the control unit through this scanning unit (200) can be compared with the image information transmitted during calculation in addition to the initial registered image of the product, and duplicate images are deleted and new images are accumulated. This allows for the accuracy of the scan information, particularly the image scan information, to be gradually improved through deep learning and artificial intelligence learning data. That is, as the purchase of the same product increases, the number of image scans increases, and accordingly, the accuracy of the image scan improves.

[0068] Additionally, a weight sensor may be further provided on one side of the conveying unit (100), preferably on the lower side of the conveying unit (100), more preferably on the side corresponding to the scanning unit (200) or on the rear side of the scanning unit (200), to measure the weight of a product for comparison with the previously entered weight of a product to verify the product identified by the scanning unit (200), and to transmit the weight measurement information to the control unit. At this time, based on the measured weight information of the product, product identification verification can be performed by comparing the previously entered weight information of the product identified by the scanning unit (200) with the actual weight of the product measured by the weight sensor to determine whether the scan information of the scanning unit (200) is clear or whether the product is not in a stacked state. Accordingly, any weight measuring device may be used as long as it is a device capable of accurately measuring the weight of a product regardless of the position of the product being conveyed and placed on the conveying unit (100), provided that at least one weight sensor is provided on one side of the conveying unit (100).

[0069] The calculation unit (400) is a device that collects information on the types and quantities of products recognized by the scanning unit (200), calculates and displays their price information, induces payment from the buyer, and facilitates payment. Any payment device may be used for this calculation unit (400) as long as it provides comprehensive and diverse information about the purchased products to the buyer and enables the buyer to proceed with payment. However, it is preferable to use a device that includes a display unit (410) that displays information about the purchased products, such as price information and quantity, to the user, and a payment unit (420) through which payment is made.

[0070] The control unit is a device that controls the aforementioned configurations and records information for product registration and calculation. It is obvious that, depending on the mode of use, only one such control unit may be provided to control the aforementioned configurations overall, or multiple control units may be provided to control at least a part of them. This control unit may include a processor for product registration and calculation, and this processor has input of price information, weight information, and image information for identification regarding products sold through product registration, and controls the identification of products based on the barcode and image of the product scanned through the scan unit (200) and the weight sensor of the product measured through the weight sensor. At this time, the processor can perform product identification through artificial intelligence learning data and deep learning.

[0071]

[0072] Usage mode of a product image acquisition device

[0073]

[0074] First, the manager places the product that he / she wants to register on the base section (11).

[0075] Next, the scanning unit (200) is driven through the control unit to obtain multiple images of the product mounted on the base unit (11).

[0076] At this time, the base unit (11) rotates at a predetermined angle or speed according to the control of the control unit, and the scan unit (13) repeatedly scans the product to obtain product images in various directions. At this time, since the scan unit (13) is provided in multiple locations inside the scan housing (12), images of various products are obtained at once.

[0077] Next, the control unit receives the scanned image from the scan unit (13), deletes duplicate images by the previously input processor, and stores various images of the corresponding product so that they can be used as basic data for product identification.

[0078] Next, the manager takes the product for which the first image acquisition is completed out of the base unit (11) and places the product so that it is changed to a predetermined angle. Since the front and back images of bagged products such as snacks may be different, if the first image acquisition is completed with the front facing upward, the product is placed on the base unit (11) with the back facing upward. In the case of a box, the aforementioned process can be repeated by simply having the front and back faces as well as the side face upward.

[0079] In the aforementioned scanning process, approximately 60 to 120 images are acquired when the back of the product is placed facing the floor as an example, and approximately 60 to 120 images are acquired when the front of the product is placed facing the floor, and the acquired images are used as data for identifying the product. The number of product images acquired is according to the example, and a smaller number of images may be acquired when the appearance of the product is simple, and a larger number of images may be acquired and used as identification data when the appearance of the product is complex.

[0080]

[0081] Usage patterns of unmanned product registration and checkout devices

[0082]

[0083] The unmanned product registration and calculation device (20) having the above-described configuration is a device capable of acquiring an image of a new product, registering basic image data for calculation, and performing all product identification for calculation when a buyer purchases a product.

[0084] Accordingly, the new product registration process and the product purchasing process are distinguished and explained in more detail as follows.

[0085] First, the method for registering a new product is explained in more detail as follows.

[0086] First, the administrator sets the new product registration mode through the control unit.

[0087] Next, the manager places the product for new registration onto the transfer unit (100). At this time, the manager may perform the placement of the product onto the transfer unit (100) directly, or, depending on the usage method, if the product to be newly registered is placed in a shopping cart (1000) or shopping basket, the product manager may transfer the product one by one to the transfer unit (100) to place it.

[0088] Next, when the product recognition unit recognizes a product placed on the transfer unit (100), the transfer unit (100) starts operating by a driving signal from the control unit generated according to the recognition signal of the product recognition unit, and the transfer unit (100) transfers the product.

[0089] Next, the transfer unit (100) transfers the newly registered product to a position corresponding to the scanning unit (200), that is, to the rotating unit (110) of the transfer unit (100), so that the product can be placed thereon.

[0090] Next, the scanning unit (200) scans the newly registered product from multiple angles to acquire various images of the newly registered product. At this time, the rotation unit (110) of the transport unit (100) rotates simultaneously or sequentially with the scanning of the scanning unit (220) to rotate the product. In this way, since the rotation unit (110) of the transport unit (100) rotates the product while the scanning unit (220) acquires images of the product, images of the newly registered product from various directions can be acquired even at the same location. Additionally, since multiple scanning units (220) are provided inside the scanning housing (210), images of the product from multiple angles can be acquired at once. At this time, the control unit can control the number of scanning units (220), the rotation angle or speed of the rotation unit (110), and the number of times the scanning unit (220) acquires images.

[0091] Next, when the first image acquisition is completed through the first scan, the transfer unit (100) is restarted depending on whether additional image acquisition is required.

[0092] If additional image acquisition is not required, the transfer unit (100) is driven in the discharge direction to discharge the product from the scanning unit (200).

[0093] However, if additional image acquisition is required, the transfer unit (100) is operated in the opposite direction to the entry direction of the scan unit (200) to move the newly registered product back to the direction where the first product was placed.

[0094] Next, the buyer or the product sorting unit (300) changes the seating direction of the product. At this time, since the rotation around a virtual vertical central axis is performed by the rotation unit (110) of the conveying unit (100), the direction change of the product is rotated around a virtual horizontal central axis. That is, the position of the top and bottom surfaces of the product is changed, or the seating direction of the product is changed so that the side wall surface faces downward.

[0095] Next, the transfer unit (100) re-enters the scanning unit (200) with the product whose landing position has been changed, and the aforementioned product image acquisition process is repeated.

[0096] Next, when the second image acquisition is completed through the second scan, the product is ejected or withdrawn based on whether additional image acquisition is required, and the aforementioned additional image acquisition process is repeated as many times as necessary.

[0097] Depending on the usage mode, a newly registered product may be placed or continuously supplied to the transfer unit (100) in multiple locations, and if each is placed in a position where it is seated in a different direction, the process of retracting and changing the direction of the product can be replaced by scanning the same product multiple times. In this case, the subsequent process of weight measurement may also be measured by measuring the same product multiple times, and the control unit may automatically calculate and determine the weight error range of the product.

[0098] Next, the control unit collects scanned image information of the newly registered product from the scanning unit (200), deletes duplicate images, similar images, unclear image information, etc. for data management, and stores non-duplicate images to be used as basic purchase data for the newly registered product.

[0099] Next, the weight of the product that has passed through the scanning unit (200) is measured through a weight sensor, and the weight information of the newly registered product is also transmitted to the control unit, and the control unit stores the weight information of the newly registered product so that it can be used as basic data for identification when purchasing the product.

[0100] Next, if there is additional information regarding the newly registered product, the administrator can input it into the control unit and complete the new product registration. At this time, the administrator can also input information such as the error margin regarding the weight of the newly registered product.

[0101]

[0102] If there are multiple newly registered products, the manager may supply the products sequentially. However, if a shopping cart (1000) or shopping basket accommodating multiple products is placed on one side adjacent to the product sorting unit (300), the product sorting unit (300), which is in the process of completing or proceeding with the new registration of a preceding product, can transfer additional newly registered products to the transfer unit (100) by means of a control signal from the control unit, thereby allowing the new product registration process to be performed continuously. Accordingly, a large number of newly registered products can be registered conveniently and quickly.

[0103]

[0104] A method for purchasing goods using an unmanned product registration and calculation device (20) according to the present invention is described in more detail as follows. This product purchasing process is described on the premise that the state is set to product purchasing mode by a manager.

[0105] First, the buyer walks around the store, selects the product they wish to purchase, places it in a shopping basket or shopping cart (1000), etc., and moves to the unmanned product registration and checkout device (20) according to the present invention.

[0106] Next, the buyer may place the product directly onto the transfer unit (100), or place the shopping basket or shopping cart (1000), etc., at a designated location adjacent to the unmanned product registration and calculation device (20) according to the present invention as described above, and the product sorting unit (300) may recognize this and sequentially transfer the products contained in the shopping basket or shopping cart (1000) one by one to the transfer unit (100).

[0107] Next, when a product recognition unit provided on one side of the transfer unit (100) recognizes the placement of a product, it transmits a product placement signal to the control unit, and the control unit drives the transfer unit (100).

[0108] Next, as the transfer unit (100) is driven, the product is transferred toward the scanning unit (200).

[0109] At this time, if the buyer manually performs the aforementioned settling process, the products are transported in a stacked state or are set in a state where it is difficult to transport the products smoothly, the product transport unit (100) separates the stacked products or adjusts the position of the products to organize the products so that scanning of the products to be purchased is easy.

[0110] Next, when a product transported by the transport unit (100) enters the scan housing (210) of the scan unit (200), the scan unit (220) acquires information of at least one of the product's barcode or image and transmits it to the control unit.

[0111] At this time, the control unit compares the information transmitted from the scanning unit (200) with the previously entered product information to recognize what kind of product it is, and displays the name and price information of the product, etc., on the display unit (410) of the calculation unit (400).

[0112] If the product is not identified through the image obtained from the scanning unit (200) during product calculation, the entire operation of the transfer unit (100) may be temporarily paused, and the product may be identified by rotating the product by a predetermined angle through the rotation unit (110) and then obtaining the image again. That is, although product identification may not be easy because the initially registered multiple product images do not match the image scanned for calculation, the product may be identified by obtaining a product image through rotation by a predetermined angle and obtaining an image corresponding to the previously registered image. At this time, the additionally obtained image may be stored and used as basic data for identifying the product, thereby reducing identification errors of the product and maximizing identification efficiency.

[0113] In addition, when calculating a product, the acquired image is compared with the basic image data of the product already stored in the control unit; duplicate images are deleted, and if a new image is recognized, it is stored in the control unit. The control unit then adds the corresponding image information to the artificial intelligence training data and adds it to the previously inputted product identification images, thereby expanding the product identification data and maximizing product identification efficiency.

[0114] Next, to cross-verify whether the scan result of a product passing through the scanning unit (200) is accurate, the weight of the product is measured using a weight sensor, and the measured weight information of the product is transmitted to the control unit. At this time, the control unit determines whether there is an error in product recognition by comparing the previously entered weight information of the product scanned by the scanning unit (200) with the weight information transmitted from the weight sensor. In this way, since the product is identified twice through the scanning unit (200) and the weight sensor in the present invention, errors in product recognition can be significantly reduced.

[0115] In the present invention, for the convenience of explanation, it is described that weight measurement by a weight sensor is performed after scanning; however, depending on the mode of use, a weight sensor may be provided on one side of the lower portion of the transfer unit (100) equipped with a scanning unit (200) to measure the weight of the product simultaneously with scanning the product and cross-verify the product, and it is obvious that the product may be configured to measure its weight first before entering the scanning unit (200).

[0116] The aforementioned product identification process is repeated until no additional product recognition is performed in the product recognition unit, and the calculation unit (400) and the control unit can display product information, such as the type and quantity of products identified through the scan unit (200) and the weight sensor, and price information for each product individually or summed and displayed in the calculation unit (400).

[0117] Next, if additional product recognition does not occur during the time previously entered by the product recognition unit, the control unit may send a guidance message to the buyer confirming whether there is an additional product through the display unit (410), etc., or provide a screen to induce payment.

[0118] Finally, the user can check the information displayed on the display unit (410) of the calculation unit (400), perform payment through the payment unit (420), and complete the purchase of the product.

[0119]

[0120] As described above, the unmanned product registration and payment device (20) according to the present invention can maximize the space efficiency of the store by utilizing a single device to allow an administrator to register new products and a buyer to purchase products through a payment counter.

[0121]

[0122] As explained above, those skilled in the art to which the present invention pertains will understand that the present invention may be implemented in other specific forms without altering its technical concept or essential features. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive. The scope of the present invention is defined by the claims set forth below rather than by the detailed description, and all modifications or variations derived from the meaning and scope of the claims and equivalent concepts should be interpreted as being included within the scope of the present invention.

Claims

1. A base portion having a predetermined area to provide a space for a product to be placed, and configured to be rotatable in at least one direction; A scan housing provided to surround the base portion and having at least one side open to supply the product to the base portion; A scan unit provided on one side inside the scan housing and positioned toward the base portion to photograph the product mounted on the base portion; and A control unit that controls the base unit and the scan unit and processes an image acquired from the scan unit; A product image acquisition device including 2. In Paragraph 1, The above-described scan unit is a product image acquisition device in which a plurality of scan units are provided on one side inside the scan housing to acquire various images of the product.

3. In Paragraph 1 A product image acquisition device characterized by the above-described control unit learning the product image data using artificial intelligence learning data.

4. A transfer unit that provides a space for a product requiring calculation or a product requiring new registration to be placed, and transfers the placed product; A scanning unit provided on one side of the above-mentioned transfer unit for acquiring a new image of the product being transferred or scanning at least one of the barcode and image of a previously registered product; A calculation unit including a payment unit that displays information and prices of products that have passed through the above-mentioned scanning unit and performs payment; A control unit that controls the above-mentioned transfer unit, scan unit, and calculation unit An unmanned product registration and calculation device including 5. In Paragraph 4, The above scanning unit is, A scan housing provided to surround one side of the above-mentioned transfer unit; and A scan unit provided on one side inside the scan housing to acquire a new image of the product or to scan at least one of the barcode and image of the product; An unmanned product registration and calculation device including 6. In Paragraph 4, An unmanned product registration and calculation device, wherein one side of the transfer unit corresponding to the above-mentioned scanning unit further includes a rotation unit for rotating the product.

7. In Paragraph 4, An unmanned product registration and calculation device further comprising a product sorting unit provided on one side of the conveying unit or on one side adjacent to the conveying unit to sort a product that is seated on the conveying unit and conveyed, or to flip or change the direction of the product to acquire an image of the other side of the product for which a primary image acquisition has been completed in the scanning unit.

8. In Paragraph 4, An unmanned product checkout device further comprising a product recognition unit provided on one side of the above-mentioned transfer unit and recognizing whether the product is seated on the above-mentioned transfer unit.

9. In Paragraph 1, An unmanned product checkout device further comprising a weight sensor provided on one side of the lower portion of the above transfer unit to measure the weight of the product newly registered or scanned by the above scanning unit.

10. In Paragraph 1, The above control unit further includes a processor that identifies the product based on the barcode and image of the product scanned through the scanning unit or the external scanning unit.

11. In Paragraph 10 The above processor is an unmanned product checkout device characterized by using artificial intelligence learning data.

Images