Unmanned store product checkout method and apparatus

Abstract

An unmanned store product checkout method and apparatus are disclosed. The unmanned store product checkout apparatus according to one embodiment of the present invention may comprise: a transfer unit for transferring a product to be purchased by a user in order to scan the product; a first product recognition unit which is provided at a first point at which transferring of the product by the transfer unit begins, and which recognizes that the product has been placed on the transfer unit; a product identification unit, which scans the barcode and image of the product transferred by the transfer unit so as to identify the product; a second product recognition unit which is provided at a second point above the entrance of the product identification unit on the path through which the product is transferred by the transfer unit, and which uses a vision sensor to recognizes the width and position of the product transferred by the transfer unit; a product alignment unit which is provided at a third point that is a first preset distance ahead of the second point on the path through which the product is transferred by the transfer unit, and which aligns the product so that the recognition rate of the product identification unit is increased; and a control unit for controlling operations of the transfer unit and the product alignment unit on the basis of a first product recognition result obtained by the first product recognition unit and the width of the product measured by the second product recognition unit.

Description

Method and device for calculating products in an unmanned store

[0001] The present invention relates to a method and device for calculating products in an unmanned store.

[0002] The content described below merely provides background information related to one embodiment of the present invention and does not constitute prior art.

[0003] Efforts are being made to automate the entire logistics process—from product production, shipping, transportation, unloading, packaging, storage, and accounting—to reduce human resources and improve accuracy. Automating logistics can reduce costs through reduced manpower and prevent safety accidents. It also shortens logistics time and facilitates systematic management.

[0004] In particular, when calculating products in a store, there is a problem that the time required for calculating products increases as store employees perform barcode scanning on each product using a barcode scanning device, which increases unnecessary waiting time for malicious customers, increases store congestion, and increases store operation management costs due to hiring employees for calculating products.

[0005] Accordingly, there is a demand for technology that can quickly and accurately perform calculations for products that customers wish to purchase without human intervention.

[0006] The purpose of the present invention is to provide a method for calculating products in an unmanned store.

[0007] In addition, the present invention aims to perform product calculations quickly and accurately by increasing the product recognition rate through artificial intelligence learning data.

[0008] In addition, the present invention aims to increase the recognition rate by product scanning through product alignment.

[0009] In order to achieve the above object, an unmanned store product checkout device according to one embodiment of the present invention may include a transfer unit that transfers a product that a user wishes to purchase so as to scan the product, a first product recognition unit that is installed at a first point where the transfer of the product by the transfer unit starts and recognizes that the product has been placed on the transfer unit, a product identification unit that scans a barcode and an image of the product transferred by the transfer unit to identify what the product is, a second product recognition unit that is installed at a second point above the entrance of the product identification unit on a path along which the product is transferred through the transfer unit and recognizes the width and position of the product transferred through the transfer unit using a vision sensor, a product alignment unit that is installed at a third point ahead of the second point by a first preset distance on the path along which the product is transferred through the transfer unit and arranges the product so as to increase the recognition rate of the product identification unit, and a control unit that controls operations of the transfer unit and the product alignment unit based on a result of the first product recognition by the first product recognition unit and a width of the product measured by the second product recognition unit.

[0010] The above product alignment unit includes a first product alignment unit arranged on the left side of the moving direction of the conveyance unit at the third point and a second product alignment unit arranged on the right side of the moving direction of the conveyance unit at the third point, and the control unit can control the product alignment unit to adjust the position of the product so that the center of the product is located within a preset second distance from the center of the conveyance unit based on the width and position of the product measured through the second product recognition unit.

[0011] The product identification unit may further include a weight sensor installed on the lower side of the transport unit and measuring the weight of the product, and the product identification unit may be installed at a predetermined third distance from the transport unit and include a scanning unit that scans a barcode and an image of a product transported by the transport unit, and a processor that identifies what the product is using artificial intelligence learning data based on the barcode and image of the product scanned through the scanning unit and the weight of the product measured through the weight sensor.

[0012] The above scanning unit includes a barcode scanner that recognizes a barcode of the product and an image scanner that scans an image of the product to obtain image information, and the processor, when the barcode is recognized, identifies the product as a scanned product corresponding to identification information included in the barcode, and when the barcode is not recognized, obtains a product name and a character string from the image information, and identifies the product as a scanned product based on the image information, the product name, and the character string using artificial intelligence learning data, and compares the weight of the product measured using the weight sensor with weight information included in the product information corresponding to the scanned product, and when the product is verified as the scanned product as a result of the comparison, transmits a first signal indicating that the product has been normally identified to the control unit, and when the product is not identified as the scanned product or when the product is verified as not the scanned product as a result of the comparison, transmits a second signal indicating that the product has not been normally identified to the control unit.

[0013] The device further includes a third product recognition unit installed at a fourth point where scanning of the product by the scanning unit ends and recognizing that the product has arrived at the fourth point, and a product classification unit installed at the fourth point and classifying the product based on the product identification result, wherein the control unit, when receiving the first signal from the processor, controls the product classification unit to not operate while the product is transported to the first zone through the transport unit, and when receiving the second signal from the processor, controls the transport unit to stop after recognizing that the product has arrived at the fourth point through the third product recognition unit, and controls the operation of the product classification unit to push the product out of the transport unit so that the product is classified to the second zone.

[0014] In addition, an unmanned store product calculation method according to one embodiment of the present invention may include a step of receiving user information from a user terminal, a step of recognizing a product placed on a conveyance unit through a first product recognition unit, a step of controlling the conveyance unit to operate when the product is recognized as placed on the conveyance unit through the first product recognition unit, a step of recognizing the width and position of the product transported by the conveyance unit through a second product recognition unit, and a step of controlling the position of the product arrangement unit based on the width and position of the product to adjust the position of the product.

[0015] The step of adjusting the position of the product may include a step of calculating a position adjustment path of the product to align the position of the product so that the center of the product is located within a preset second distance from the center of the conveying unit based on the width and position of the product measured through the second product recognition unit, and a step of controlling the product alignment unit so that the position of the product is adjusted along the position adjustment path.

[0016] The method further includes a step of measuring the weight of the product using a weight sensor when the product is recognized as being placed on the conveying unit through the first product recognition unit, a step of scanning the product conveyed by the conveying unit through a scanning unit, a step of identifying the product through a processor based on the scan result of the product and the weight of the product, a step of classifying the product so that the product is classified into a first zone or a second zone according to the identification result, a step of calculating a first price by adding up the prices of the products, and a step of providing the first price to the user terminal, wherein the step of scanning the product further includes a step of obtaining scanned product information corresponding to the barcode by scanning the barcode when the barcode of the product is recognized, a step of obtaining image information by scanning the entire image of the product when the barcode of the product is not recognized, and a step of designating the product as an unidentified product and, after the step of scanning the product, obtaining a product name of the product from the image information when the barcode of the product is not recognized, and a step of obtaining image information based on the image information and the product name using artificial intelligence learning data. It includes a step of acquiring scanned product information corresponding to the acquired product, and the artificial intelligence learning data may include data learned about the size of the product sold in the unmanned store, the shape of the product, the name of the product, and the weight of the product.

[0017] The step of classifying the above product may include a step of comparing the weight information of the scanned product included in the scanned product information with the measured weight of the product, and a step of transporting the product through the transport unit and classifying it into the first zone if the product is verified as the scanned product as a result of the comparison.

[0018] The step of classifying the above product may include a step of comparing the weight information of the scanned product included in the scanned product information with the measured weight of the product, a step of recognizing whether the product has arrived at a fourth location where the third product recognition unit is installed through a third product recognition unit if the comparison result is verified as a different product or the product is an unconfirmed product, a step of controlling the operation of the transport unit to stop if the third product recognition unit recognizes that the product has arrived at the fourth location, a step of controlling the operation of the product classification unit so that the product is classified into a second zone by pushing the product out of the transport unit, and a step of providing a notification to the user terminal indicating that the product has been classified into the second zone.

[0019] According to the present invention, a method for calculating products in an unmanned store can be provided.

[0020] In addition, according to the present invention, product recognition rate can be increased through artificial intelligence learning data, enabling product calculation to be performed quickly and accurately.

[0021] In addition, according to the present invention, the recognition rate by product scanning can be increased through product alignment.

[0022] FIG. 1 and FIG. 2 are drawings showing the form of an unmanned store product calculation device according to one embodiment of the present invention.

[0023] Figure 3 is a block diagram showing the configuration of an unmanned store product calculation device according to one embodiment of the present invention.

[0024] FIG. 4 is a block diagram showing entities for calculating products in an unmanned store according to one embodiment of the present invention.

[0025] Figure 5 is a flowchart illustrating an unmanned store product calculation method according to one embodiment of the present invention.

[0026] Figure 6 is a flowchart illustrating an unmanned store product calculation method according to one embodiment of the present invention.

[0027] The present invention will be described in detail with reference to the attached drawings. Herein, repetitive descriptions, well-known functions that may unnecessarily obscure the gist of the present invention, and detailed descriptions of configurations are omitted. The embodiments of the present invention are provided to more fully explain the present invention to those of ordinary skill in the art. Accordingly, the shapes and sizes of elements in the drawings may be exaggerated for clarity.

[0028] Throughout the specification, whenever a part is said to "include" a component, this does not mean that it excludes other components, but rather that it may include other components, unless otherwise stated.

[0029] Hereinafter, a preferred embodiment according to the present invention will be described in detail with reference to the attached drawings.

[0030] FIG. 1 and FIG. 2 are drawings showing the form of an unmanned store product calculation device according to one embodiment of the present invention.

[0031] Referring to FIGS. 1 and 2, an unmanned store product device (1) according to one embodiment of the present invention may include a product transfer device (11), a product recognition device (12), a product sorting device (13), a product scanning device (14), a calculation result display device (15), a product holder (16), a QR code recognition unit (17), a product classification device (not shown), a normal calculation product discharge outlet (18), and an abnormal calculation product discharge outlet (19).

[0032] The product transport device (11) may include a conveyor belt through which products are transported for calculation.

[0033] The product recognition device (12) may include a device such as a camera or vision sensor that recognizes the width and position of the product being transported by the product transport device (11).

[0034] The product alignment device (13) may be a device that aligns products by adjusting the position of the products so as to increase the product recognition rate.

[0035] The product alignment device (13) may include a first product alignment device (21) arranged on the left side of the product transport device (11) in the direction of travel and a second product alignment device (22) arranged on the right side of the transport unit in the direction of travel.

[0036] When adjusting the position of a product, the product alignment device (13) can adjust the position of the product so that the center of the product is located within a certain distance from the center of the conveying section by using at least one of the first product alignment device (21) and the second product alignment device (22).

[0037] The first product alignment device (21) and the second product alignment device (22) may include a first connecting portion (211, 221) that moves left and right in a direction perpendicular to the direction of movement of the conveying portion, and a second connecting portion (212, 222) that moves back and forth in the direction of movement of the conveying portion from the side of the conveying portion. The position of the product can be adjusted as the first connecting portion (211, 221) moves left and right.

[0038] The product scanning device (14) may include multiple image scanners to scan products transported by the product transport device (11). Here, the multiple image scanners are arranged separately on the upper and lower portions of the conveyor belt included in the product transport device (11) and can image scan products from various directions. Products that have been accurately recognized upon completion of the image scan can be discharged through the normal checkout product discharge port (18).

[0039] The product sorting device (not shown) can operate to discharge scanned products to either a normal checkout product discharge outlet (18) or an abnormal checkout product discharge outlet (19). If the product is correctly recognized, the product sorting device does not operate and the product can be discharged to the normal checkout product discharge outlet (18) via the product transfer device (11). Conversely, if the product is not correctly recognized, the product sorting device can operate to push the product so that it is discharged to the abnormal checkout product discharge outlet (19). The product discharged to the abnormal checkout product discharge outlet can be confirmed by the user and then fed back into the unmanned store checkout device.

[0040] The product scanning device (14) can gradually increase the accuracy of image scanning through deep learning. As the number of image scans of a product increases, the accuracy of the image scanning can increase.

[0041] The calculation result display device (15) can include a list of all products and can separately display products discharged through a normal calculation product discharge outlet (18) and products discharged through an abnormal calculation product discharge outlet (19).

[0042] Figure 3 is a block diagram showing the configuration of an unmanned store product calculation device according to one embodiment of the present invention.

[0043] Referring to FIG. 3, an unmanned store product device according to one embodiment of the present invention may include a transfer unit (310), a first product recognition unit (320), a product identification unit (330), a second product recognition unit (340), a product sorting unit (350), and a control unit (360).

[0044] The transport unit (310) can transport the product that the user wishes to purchase so that the user can scan the product.

[0045] The first product recognition unit (320) is installed at the first point where the product is transferred by the transfer unit, and can recognize that the product has been placed on the transfer unit.

[0046] The product identification unit (330) can identify the product by scanning the barcode and image of the product being transported by the transport unit.

[0047] The second product recognition unit (340) is installed at a second point above the entrance of the product identification unit in the path through which the product is transferred through the transfer unit, and can recognize the width and position of the product transferred through the transfer unit using a vision sensor.

[0048] The product sorting unit (350) is installed at a third point that is a first distance ahead of the second point in the path along which the product is transported through the transport unit, and can sort the product so that the recognition rate of the product identification unit increases.

[0049] The control unit (360) can control the operation of the transfer unit and the product sorting unit based on the first product recognition result by the first product recognition unit and the width of the product measured by the second product recognition unit.

[0050] Here, the transport unit does not operate if it does not recognize that a product has been placed through the first product recognition unit, operates to transport the product if it recognizes that a product has been placed, and can stop operating if it does not recognize that another product has been placed through the first product recognition unit until a preset time has elapsed after the classification of the product is completed.

[0051] According to one embodiment, the product sorting unit may include a first product sorting unit arranged on the left side of the moving direction of the transport unit at the third point, and a second product sorting unit arranged on the right side of the moving direction of the transport unit at the third point.

[0052] At this time, the control unit can control the product alignment unit to adjust the position of the product so that the center of the product is located within a preset second distance from the center of the transport unit based on the width and position of the product measured through the second product recognition unit.

[0053] At this time, the control unit can adjust the position of the product by controlling at least one of the first product sorting unit and the second product sorting unit.

[0054] For example, if a product is placed to the left of the center of the conveyor in the direction of movement of the conveyor, the control unit can adjust the position of the product by controlling the first product alignment unit arranged to the left of the direction of movement of the conveyor. Conversely, if a product is placed to the right of the center of the conveyor in the direction of movement of the conveyor, the control unit can adjust the position of the product by controlling the second product alignment unit arranged to the right of the direction of movement of the conveyor.

[0055] According to one embodiment, the unmanned store product checkout device is installed on a lower side of the conveying section and may further include a weight sensor that measures the weight of the product.

[0056] Here, a weight sensor is installed on the lower side of the conveyor and can measure the weight of the product.

[0057] In addition, the product identification unit may be installed at a predetermined third distance from the transport unit, and may include a scanning unit that scans a barcode and an image of a product transported by the transport unit, and a processor that identifies what the product is using artificial intelligence learning data based on the barcode and image of the product scanned by the scanning unit and the weight of the product measured by the weight sensor.

[0058] In addition, the device may further include a third product recognition unit installed at a fourth point where scanning of the product by the scanning unit ends and recognizes that the product has arrived at the fourth point, and a product classification unit installed at the fourth point and classifies the product based on the product identification result.

[0059] Here, the scanning unit may include a barcode scanner that recognizes the barcode of the product and an image scanner that scans an image of the product to obtain image information.

[0060] The above barcode scanner can recognize the barcode of the product, and the above image scanner can scan the image of the product to obtain image information.

[0061] If the barcode is recognized, the processor identifies the product as a scanned product corresponding to the identification information included in the barcode, and if the barcode is not recognized, the processor obtains a product name and a string from the image information, and identifies the product as a scanned product based on the image information, product name, and string using artificial intelligence learning data.

[0062] In addition, the weight of the product measured using the weight sensor may be compared with the weight information included in the product information corresponding to the scanned product, and if the product is verified as the scanned product as a result of the comparison, a first signal indicating that the product has been properly identified may be transmitted to the control unit, and if the product is not identified as the scanned product or if the product is verified as not the scanned product as a result of the comparison, a second signal indicating that the product has not been properly identified may be transmitted to the control unit.

[0063] At this time, when the control unit receives the first signal from the processor, it controls the product classification unit to not operate while the product is transferred to the first zone through the transfer unit, and when the control unit receives the second signal from the processor, it controls the transfer unit to stop after recognizing that the product has arrived at the fourth point through the third product recognition unit, and it controls the operation of the product classification unit to push the product out of the transfer unit so that the product is classified to the second zone.

[0064] As an optional embodiment, the height of the products can be measured and used to align the products to increase their recognition rate.

[0065] Specifically, the unmanned store product checkout device may be installed at a first location and include a height sensor that measures the height of the product.

[0066] In addition, a third product alignment unit may be installed at a fifth point where scanning of products begins by the scanning unit, and may be included to align products so as to increase the recognition rate of products through scanning of products.

[0067] Here, the third product alignment unit is installed above the conveyance unit at the fifth point, and the position can be adjusted so that the distance between the conveyance unit and the third product alignment unit is equal to or less than the height of the product based on the height of the product measured by the height sensor.

[0068] At this time, the third product sorting unit may include at least one roller to allow the product to pass smoothly between the spaced distances.

[0069] Additionally, the control unit can control the position of the third product alignment unit so that the distance between the transport unit and the third product alignment unit is equal to or lower than the height of the product based on the height of the product measured by the height sensor.

[0070] As an optional embodiment, the unmanned store product checkout device may include a fourth product recognition unit installed at a sixth point where products enter the first zone, and recognizing products classified to be sent to the first zone.

[0071] Specifically, the fourth product recognition unit can recognize products moving to the first zone and count the number of products moving to the first zone.

[0072] At this time, the unmanned store product calculation device compares the number of times the first signal is transmitted to be sent to the first zone through the processor with the number of products counted through the fourth product recognition unit, and if the comparison results are different, creates a list of products classified to be sent to the first zone and transmits the list to the administrator terminal.

[0073] Here, the administrator can check the above list through the administrator terminal and check whether the products included in the above list are classified incorrectly.

[0074] Through this, if a product verified as a scanned product is incorrectly classified into the second zone, the issue can be resolved through a verification process.

[0075] FIG. 4 is a block diagram showing entities for calculating products in an unmanned store according to one embodiment of the present invention.

[0076] Referring to FIG. 4, the entities for calculating unmanned store products according to one embodiment of the present invention include an unmanned store product calculation device (1) and a user terminal (410).

[0077] An unmanned store product calculation device (1) may refer to a device that recognizes scanned products as being purchased by a user and calculates the total price.

[0078] The unmanned store product calculation device (1) may be a device that provides the calculated total price to a user terminal (410).

[0079] The user terminal (410) may be a device that receives the total price from the unmanned store product calculation device (1).

[0080] The unmanned store product calculation device (1) and the user terminal (410) can be interconnected through a communication network.

[0081] A communications network refers to a connection path that enables data to be transmitted and received between the above entities. For example, a communications network may encompass wired networks such as LANs (Local Area Networks), WANs (Wide Area Networks), MANs (Metropolitan Area Networks), and ISDNs (Integrated Service Digital Networks), or wireless networks such as wireless LANs, CDMA, Bluetooth, and satellite communications. However, the scope of communications networks applicable to the present invention is not limited thereto.

[0082] Figure 5 is a flowchart illustrating an unmanned store product calculation method according to another embodiment of the present invention.

[0083] Referring to FIG. 5, the unmanned store product calculation method according to one embodiment of the present invention can first recognize a product placed on a conveying unit through a first product recognition unit (S510).

[0084] Next, if the product is recognized as being placed on the transport unit through the first product recognition unit, the transport unit can be controlled to operate (S520).

[0085] Here, the transport unit does not operate if it does not recognize that a product has been placed through the first product recognition unit, operates to transport the product if it recognizes that a product has been placed, and can stop operating if it does not recognize that another product has been placed through the first product recognition unit until a preset time has elapsed after the classification of the product is completed.

[0086] Next, the width and position of the product transported by the transport unit can be recognized through the second product recognition unit (S530).

[0087] Next, the position of the product can be adjusted by controlling the position of the product alignment section based on the width and position of the product (S540).

[0088] Figure 6 is a flowchart illustrating an unmanned store product calculation method according to one embodiment of the present invention.

[0089] Referring to FIG. 6, the unmanned store product calculation method according to one embodiment of the present invention first calculates a position adjustment path of the product to align the position of the product so that the center of the product is located within a preset second distance from the center of the transfer unit, based on the width and position of the product measured through the second product recognition unit (S610).

[0090] Next, the product alignment unit can be controlled so that the product is positioned along the position adjustment path (S620).

[0091] At this time, the control unit can control the product alignment unit to adjust the position of the product so that the center of the product is located within a preset second distance from the center of the transport unit based on the width and position of the product measured through the second product recognition unit.

[0092] According to one embodiment, the method for calculating product information in an unmanned store may further include, when the first product recognition unit recognizes that the product is placed on the conveyance unit, a step of measuring the weight of the product using a weight sensor, a step of scanning the product conveyed by the conveyance unit through a scanning unit, a step of identifying the product through a processor based on a scan result of the product and the weight of the product, a step of classifying the product so that the product is classified into a first zone or a second zone based on an identification result according to the identification, a step of calculating a first price by adding up the prices of the products, and a step of providing the first price to a user terminal.

[0093] At this time, the step of scanning the product may include, if the product's barcode is recognized, scanning the barcode to obtain scanned product information corresponding to the barcode. If the product's barcode is not recognized, scanning the entire image of the product may obtain image information. If the barcode is not recognized, the product name and character string may be obtained from the image information, and the product may be identified as a scanned product based on the image information, product name, and character string using artificial intelligence learning data.

[0094] Additionally, if the product's barcode is not recognized or the product's image information is not obtained, the product may be designated as an unconfirmed product.

[0095] According to one embodiment, the method for calculating product information in an unmanned store can obtain the product name of the product from the image information if the barcode of the product is not recognized after the step of scanning the product.

[0096] Next, using artificial intelligence learning data, scanned product information corresponding to a product whose image information was obtained based on the image information and the product name can be obtained.

[0097] Here, the artificial intelligence learning data may include data learned about the size, shape, name, and weight of products sold in an unmanned store.

[0098] According to one embodiment, in the method for calculating products in an unmanned store, the step of classifying the products may include comparing the weight information of the scanned product included in the scanned product information with the measured weight of the product.

[0099] Next, if the product is verified as the scanned product as a result of the comparison, the product can be transported through the transport section and classified into the first zone.

[0100] According to one embodiment, in the method for calculating products in an unmanned store, the step of classifying the products may include comparing the weight information of the scanned product included in the scanned product information with the measured weight of the product.

[0101] Next, if the product is verified as another product as a result of the comparison or if the product is an unconfirmed product, it can be recognized through the third product recognition unit whether the product has arrived at the fourth branch where the third product recognition unit is installed.

[0102] Next, when the third product recognition unit recognizes that the product has arrived at the fourth point, the operation of the transport unit can be controlled to stop.

[0103] Next, the product classification unit can control the operation of the product classification unit so that the product is pushed out of the conveyance unit and the product is classified into the second zone.

[0104] Next, a notification may be provided to the user terminal indicating that the product has been classified into the second zone.

[0105] As an optional embodiment, the height of the products can be measured and used to align the products to increase their recognition rate.

[0106] Specifically, the unmanned store product checkout device can measure the height of a product using a height sensor installed at the first point.

[0107] Next, based on the height of the product measured by the height sensor, the position of the third product alignment unit can be controlled so that the distance between the third product alignment unit installed at the fifth point where scanning of the product begins by the scanning unit and the transfer unit becomes equal to or less than the height of the product.

[0108] Next, you can sort products using the third product sorting section.

[0109] For example, if a product placed on a conveyor belt is upright, it can be toppled over as it passes through the product sorting section, thereby increasing the recognition rate through product scanning. Furthermore, if the upper portion of a product placed on a conveyor belt is crumpled, it can be unfolded as it passes through the product sorting section, thereby increasing the recognition rate through product scanning.

[0110] Here, the third product sorting unit can be installed above the transport unit at the fifth point.

[0111] At this time, the third product sorting unit may include at least one roller to allow the product to pass smoothly between the spaced distances.

[0112] As an optional embodiment, the number of products can be counted by recognizing products classified to be sent to the first zone through the fourth product recognition unit installed at the sixth point where the products enter the first zone.

[0113] Specifically, the unmanned store product checkout device can recognize products moving to the first zone using the fourth product recognition unit and count the number of products moving to the first zone.

[0114] Next, the number of times the first signal was transmitted to be sent to the first zone through the processor can be compared with the number of products counted through the fourth product recognition unit.

[0115] Next, if the comparison results are different, a list of products classified to be sent to Zone 1 can be created and the list can be transmitted to the administrator terminal.

[0116] Next, the administrator can check the list through the administrator terminal and check whether any products included in the list are classified incorrectly.

[0117] Through this, if a product verified as a scanned product is incorrectly classified into the second zone, the issue can be resolved through a verification process.

[0118] As an optional embodiment, purchase points may be accumulated based on the user's payment.

[0119] Specifically, the unmanned store product checkout device can receive user information from a user terminal.

[0120] At this time, the user's membership information generated using the user information can be received together.

[0121] Next, if the first price is provided and payment for the user's product is completed, the purchase points corresponding to the first price can be accumulated in the membership points included in the member information.

[0122] At this time, additional purchase points can be awarded at a preset first ratio corresponding to the ratio of the number of products whose barcodes are recognized through the scanning unit to the number of products purchased by the user.

[0123] As an optional embodiment, products can be purchased at a discounted price based on the user's accumulated purchase points.

[0124] Specifically, when providing a first price to a user, a second price with a preset second discount rate corresponding to a section including membership points in the first price can be provided to the user terminal.

[0125] As an optional embodiment, before the step of providing the first price, a first product list for products classified into the first zone at one time and a second product list for products classified into the second zone at least once can be created, and the created first product list and second product list can be provided to the user terminal.

[0126] Specifically, the unmanned store product checkout device can first generate a first product list for products classified into the first zone at a time.

[0127] At this time, a preset first mark or second mark can be displayed next to each product name included in the first product list.

[0128] Here, the first preset mark may mean that the barcode has been scanned using a barcode scanner to obtain scanned product information, and that the obtained scanned product information has been verified to match.

[0129] Additionally, the preset second mark may mean that image information of the product is acquired through an image scanner, scanned product information is acquired based on the image information, and the acquired scanned product information is verified to match.

[0130] Next, the unmanned store product checkout device can generate a second product list for products classified into the second zone at least once.

[0131] At this time, a preset third mark can be displayed next to each product name included in the second product list.

[0132] Here, the third pre-defined mark may mean that the product is an unconfirmed product or a product that has been verified as different from the scanned product information and has been classified into the second zone at least once.

[0133] As an optional embodiment, the step of providing the first price may provide the user terminal with a first product list and a second product list when providing the entire price to the user terminal.

[0134] At this time, the first product list and the second product list may include the prices of each product in the list.

[0135] This allows users to verify scanned barcodes using the barcode scanner. Furthermore, the higher the percentage of scanned items, the higher the member's score. Since higher member scores lead to higher discounts, users are encouraged to place items on the conveyor belt so that the barcodes can be easily scanned. Consequently, as the number of scanned items increases, they are sorted into a secondary section, reducing the number of items requiring rescanning, thus reducing the time required for checkout.

[0136] The specific implementations described in the present invention are merely exemplary embodiments and do not limit the scope of the present invention in any way. For the sake of brevity, descriptions of conventional electronic components, control systems, software, and other functional aspects of the systems may be omitted. In addition, the lines connecting or connecting members between components depicted in the drawings are merely exemplary functional connections and / or physical or circuit connections, and may be replaced or represented as various additional functional connections, physical connections, or circuit connections in an actual device. In addition, unless specifically mentioned as “essential,” “important,” etc., a component may not be absolutely necessary for the application of the present invention.

[0137] Therefore, the idea of ​​the present invention should not be limited to the embodiments described above, and not only the scope of the patent claims described below but also all scopes equivalent to or equivalently modified from the scope of the patent claims are considered to fall within the scope of the idea of ​​the present invention.

Claims

1. A transport unit that transports products to allow users to scan products they wish to purchase; A first product recognition unit installed at a first point where the transport of a product begins by the above-mentioned transport unit and recognizing that a product has been placed on the above-mentioned transport unit; A product identification unit that scans the barcode and image of the product transported by the above transport unit to identify what the product is; A second product recognition unit installed at a second point above the entrance of the product identification unit in the path through which the product is transferred through the transfer unit, and using a vision sensor to recognize the width and position of the product transferred through the transfer unit; A product alignment unit installed at a third point that is a first distance ahead of the second point on the route through which the product is transferred through the transfer unit, and aligns the product so that the recognition rate of the product identification unit is increased; and A control unit that controls the operation of the transfer unit and the product alignment unit based on the result of the first product recognition by the first product recognition unit and the width of the product measured by the second product recognition unit. Including, The above product sorting section is, A first product sorting unit arranged on the left side of the direction of travel of the transport unit at the third point; and The second product sorting section is arranged on the right side of the direction of travel of the transport section at the third point above. Including, The above control unit, Based on the width and position of the product measured through the second product recognition unit, the product alignment unit is controlled to adjust the position of the product so that the center of the product is located within a preset second distance from the center of the transport unit. The above control unit, An unmanned store product calculation device that controls at least one of the first product sorting unit and the second product sorting unit to adjust the position of the product.

2. In paragraph 1, A weight sensor installed on the lower side of the above conveying section and measuring the weight of the product Including more, The above product identification section is, A scanning unit installed at a preset third distance from the above-mentioned transport unit and scanning the barcode and image of a product transported by the above-mentioned transport unit; and A processor that identifies what the product is based on the barcode and image of the product scanned through the above scanning unit and the weight of the product measured through the above weight sensor using artificial intelligence learning data. An unmanned store product calculation device, comprising:

3. In paragraph 2, The above scanning section, A barcode scanner that recognizes the barcode of the above product; and Image scanner that scans the image of the above product to obtain image information Including, The above processor, If the barcode is recognized, the product is identified as a scanned product corresponding to the identification information contained in the barcode. If the above barcode is not recognized, the product name and string are obtained from the image information, and the product is identified as a scanned product based on the image information, product name, and string using artificial intelligence learning data. The weight of the product measured using the weight sensor is compared with the weight information included in the product information corresponding to the scanned product, and if the product is verified as the scanned product as a result of the comparison, a first signal indicating that the product has been normally identified is transmitted to the control unit. An unmanned store product checkout device that transmits a second signal to the control unit indicating that the product has not been properly identified if the product is not identified as the scanned product or if the product is verified as not the scanned product as a result of the comparison.

4. In paragraph 3, A third product recognition unit installed at a fourth point where scanning of the product is completed by the above scanning unit and recognizes that the product has arrived at the fourth point; and A product classification unit installed at the above-mentioned fourth location and classifying the product based on the identification results of the product. Including more, The above control unit, When the first signal is received from the processor, the product classification unit is controlled not to operate while the product is transferred to the first zone through the transfer unit. An unmanned store product calculation device, wherein when the second signal is received from the processor, the third product recognition unit recognizes that the product has arrived at the fourth point, controls the transport unit to stop, and controls the operation of the product classification unit to push the product out of the transport unit so that the product is classified into the second zone.

5. Step of receiving user information from a user terminal; A step of recognizing a product placed in a transport section through the first product recognition section; A step of controlling the transport unit to operate when the product is recognized as being placed on the transport unit through the first product recognition unit; A step of recognizing the width and position of the product conveyed by the conveying unit through the second product recognition unit; and A step for adjusting the position of the product by controlling the position of the product alignment section based on the width and position of the product. Including, The steps for adjusting the position of the above product are: A step of calculating a position adjustment path of the product to align the position of the product so that the center of the product is located within a preset second distance from the center of the transport unit based on the width and position of the product measured through the second product recognition unit; and A step for controlling the product alignment unit so that the product is positioned along the position adjustment path. Including, The above product sorting section is, A first product sorting unit arranged on the left side of the direction of movement of the above transport unit; and The second product sorting section is arranged on the right side of the above-mentioned transport section in the direction of travel. Including, The steps for controlling the above product sorting section are: A step of adjusting the position of the product by controlling at least one of the first product sorting unit and the second product sorting unit. A method for calculating products in an unmanned store, comprising:

6. In paragraph 5, When the product is recognized as being placed on the transport section through the first product recognition section, a step of measuring the weight of the product using a weight sensor; A step of scanning the product conveyed by the conveying unit through the scanning unit; A step of identifying the product through a processor based on the scan result of the product and the weight of the product; A step of classifying the product so that the product is classified into the first zone or the second zone according to the identification result according to the above identification; A step of calculating the first price by adding up the prices of the above products; and Step of providing the first price to the user terminal Including more, The steps to scan the above product are: If the barcode of the above product is recognized, the barcode is scanned to obtain scanned product information corresponding to the barcode, and if the barcode of the above product is not recognized, the entire image of the above product is scanned to obtain image information. If the product's barcode is not recognized or the product's image information is not obtained, the product is designated as an unconfirmed product. After scanning the above product, If the barcode of the above product is not recognized, a step of obtaining the product name of the above product from the image information; and A step of obtaining scanned product information corresponding to a product for which image information has been obtained based on the image information and the product name using artificial intelligence learning data. Including, The above artificial intelligence learning data is, An unmanned store product calculation method that includes data learned about the size, shape, name, and weight of products sold in the unmanned store.

7. In paragraph 6, The steps for classifying the above products are: A step of comparing the weight information of the scanned product included in the above scanned product information with the measured weight of the product; and If the product is verified as the scanned product as a result of the comparison, the step of transporting the product through the transport section and classifying it into the first zone A method for calculating products in an unmanned store, comprising:

8. In paragraph 6, The steps for classifying the above products are: A step of comparing the weight information of the scanned product included in the above scanned product information with the measured weight of the product; If the product is verified as a different product as a result of comparison or if the product is an unconfirmed product, a step of recognizing whether the product has arrived at the fourth branch where the third product recognition unit is installed through the third product recognition unit; A step of controlling the operation of the transport unit to stop when it is recognized through the third product recognition unit that the product has arrived at the fourth point; A step for controlling the operation of the product classification unit so that the product is pushed out of the transfer unit and the product is classified into the second zone; and A step of providing a notification to the user terminal indicating that the product has been classified into the second zone. A method for calculating products in an unmanned store, comprising:

Images