Method and apparatus for product checkout in unmanned store

The unmanned store product calculation device automates product counting using sensors and AI to enhance recognition rates, addressing inefficiencies in manual counting and reducing operational costs by streamlining the product recognition process.

WO2024232667A1PCT designated stage expired Publication Date: 2024-11-14GAEASOFT
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2024/006209
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-10
Filing Date
2024-05-09
Publication Date
2024-11-14

AI Technical Summary

Technical Problem

Manual product counting in stores is time-consuming and increases operational costs due to the need for staff, leading to inefficiencies and increased waiting times for customers.

Method used

An unmanned store product calculation device using a transfer unit, product recognition units, weight and height sensors, and artificial intelligence to quickly and accurately identify products through barcode and image scanning, with a product sorting unit to enhance recognition rates.

Benefits of technology

Enables fast and accurate product counting, reducing operational costs and customer waiting times by automating the product recognition process and improving scanning accuracy through AI learning data and product alignment using rollers.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2024006209_14112024_PF_FP_ABST
    Figure KR2024006209_14112024_PF_FP_ABST
Patent Text Reader

Abstract

A method and an apparatus for product checkout in an unmanned store are disclosed. The apparatus for product checkout in an unmanned store according to an embodiment of the present invention may comprise: a transfer unit for transferring a product; a first product recognition unit for recognizing that the product has been placed on the transfer unit; a height sensor for measuring the height of the product; a weight sensor for measuring the weight of the product; a scan unit for scanning a barcode and an image of the product transferred by the transfer unit; a processor for identifying what the product is, by using artificial intelligence learning data; a product alignment unit for aligning the product to increase a recognition rate of the product; a second product recognition unit for recognizing that the product has arrived at a third point; a product classification unit for classifying the product; and a control unit for controlling operations of the transfer unit, the product alignment unit, and the product classification unit.
Need to check novelty before this filing date? Find Prior Art

Description

Method and device for calculating products in an unmanned store

[0001] The present invention relates to a method and device for calculating products in an unmanned store.

[0002] The content described below merely provides background information related to one embodiment of the present invention and does not constitute prior art.

[0003] Efforts are being made to automate the entire logistics process—from product production, shipping, transportation, unloading, packaging, storage, and accounting—to reduce human resources and improve accuracy. Automating logistics can reduce costs through reduced manpower and prevent safety accidents. It also shortens logistics time and facilitates systematic management.

[0004] In particular, when calculating products in a store, there is a problem that the time required for calculating products increases as store employees perform barcode scanning on each product using a barcode scanning device, which increases unnecessary waiting time for malicious customers, increases store congestion, and increases store operation management costs due to hiring employees for calculating products.

[0005] Accordingly, there is a demand for technology that can quickly and accurately perform calculations for products that customers wish to purchase without human intervention.

[0006] The purpose of the present invention is to provide a method for calculating products in an unmanned store.

[0007] In addition, the present invention aims to perform product calculations quickly and accurately by increasing the product recognition rate through artificial intelligence learning data.

[0008] In addition, the present invention aims to increase the recognition rate through product scanning by aligning products using rollers.

[0009] In order to achieve the above object, an unmanned store product calculation device according to one embodiment of the present invention comprises: a conveying unit for conveying a product to be scanned by a user for purchase; a first product recognition unit installed at a first point where conveyance of the product by the conveying unit begins and recognizes that the product has been placed on the conveying unit; a height sensor installed at the first point and measures the height of the product; a weight sensor installed at a lower side of the conveying unit and measures the weight of the product; a scanning unit installed at a predetermined distance from the conveying unit and scans a barcode and an image of the product conveyed by the conveying unit; a processor for identifying what the product is using artificial intelligence learning data based on the barcode and the image of the product scanned by the scan unit and the weight of the product measured by the weight sensor; a product sorting unit installed at a second point where scanning of the product by the scanning unit begins and arranges the product so that the recognition rate of the product through scanning of the product increases; a second product recognition unit installed at a third point where scanning of the product by the scanning unit ends and recognizes that the product has arrived at the third point; It may include a product classification unit installed at a third location and classifying the product based on the product identification result, and a control unit that controls the operation of the transfer unit, the product sorting unit, and the product classification unit based on the first product recognition result by the first product recognition unit, the height of the product measured by the height sensor, the second product recognition result by the second product recognition unit, and the product identification result by the processor.

[0010] The above product alignment unit is installed at a distance above the transport unit at the second point, and the position is adjusted so that the distance between the transport unit and the product alignment unit is equal to or smaller than the height of the product based on the height of the product measured by the height sensor, and the product alignment unit may include at least one roller so that the product can smoothly pass through the distance.

[0011] The above scanning unit may include a barcode scanner that recognizes the barcode of the product and an image scanner that scans an image of the product to obtain image information.

[0012] The processor, when a barcode is recognized, identifies the product as a scanned product corresponding to identification information included in the barcode, and when the barcode is not recognized, obtains a product name and a character string from the image information, identifies the product as a scanned product based on the image information, the product name, and the character string using artificial intelligence learning data, compares the weight of the product measured using the weight sensor with weight information included in the product information corresponding to the scanned product, and when the product is verified as the scanned product as a result of the comparison, transmits a first signal indicating that the product has been normally identified to the control unit, and when the product is not identified as the scanned product or when the product is verified as not the scanned product as a result of the comparison, transmits a second signal indicating that the product has not been normally identified to the control unit.

[0013] When the control unit receives the first signal from the processor, it controls the product classification unit to not operate while the product is transferred to the first zone through the transfer unit, and when the control unit receives the second signal from the processor, it controls the transfer unit to stop after recognizing through the second product recognition unit that the product has arrived at the second point, and controls the operation of the product classification unit to push the product out of the transfer unit so that the product is classified to the second zone, and based on the height of the product measured through the height sensor, it can control the position of the product alignment unit so that the distance between the transfer unit and the product alignment unit is equal to or lower than the height of the product.

[0014] In addition, an unmanned store product calculation method according to an embodiment of the present invention may include a step of receiving user information from a user terminal, a step of recognizing a product placed on a conveying unit through a first product recognition unit, a step of measuring a weight of the product using a weight sensor when the product is recognized, a step of measuring a height of the product using the height sensor, a step of controlling a position of a product arrangement unit based on the height of the product, a step of scanning the product conveyed by the conveying unit through a scan unit, a step of identifying the product through a processor based on a scan result of the product and the weight of the product, a step of classifying the product so that the product is classified into a first zone or a second zone based on the identification result, a step of calculating a first price by adding up the prices of the products, and a step of providing the first price to the user terminal.

[0015] The step of scanning the product includes: if the barcode of the product is recognized, scanning the barcode to obtain scanned product information corresponding to the barcode; if the barcode of the product is not recognized, scanning the entire image of the product to obtain image information; if the barcode of the product is not recognized or the image information of the product is not obtained, designating the product as an unidentified product; and, after the step of scanning the product, if the barcode of the product is not recognized, obtaining the product name of the product from the image information; and using artificial intelligence learning data, obtaining scanned product information corresponding to the product whose image information is obtained based on the image information and the product name. The artificial intelligence learning data may include data that has learned the size, shape, name, and weight of products sold in an unmanned store.

[0016] The step of classifying the above product may include a step of comparing the weight information of the scanned product included in the scanned product information with the measured weight of the product, and a step of transporting the product through the transport unit and classifying it into the first zone if the product is verified as the scanned product as a result of the comparison.

[0017] The step of classifying the above product may include a step of comparing the weight information of the scanned product included in the scanned product information with the measured weight of the product, a step of recognizing whether the product has arrived at a third location where the second product recognition unit is installed if the comparison result is verified as a different product or if the product is an unconfirmed product, through a second product recognition unit, a step of controlling the operation of the transport unit to stop if the second product recognition unit recognizes that the product has arrived at the third location, a step of controlling the operation of the product classification unit to push the product out of the transport unit so that the product is classified into a second zone, and a step of providing a notification to the user terminal indicating that the product has been classified into the second zone.

[0018] The step of receiving the user information includes a step of receiving the user's membership information generated using the user information, and after the step of providing the first price, if the user's payment for the product is completed, a step of accumulating purchase points corresponding to the first price in the membership points included in the membership information, and the step of accumulating purchase points may grant additional purchase points at a preset first rate corresponding to the ratio of the number of products whose barcodes are recognized through a scanning unit to the number of products purchased by the user, and the step of providing the first price may provide the user terminal with a second price to which a discount rate at a preset second rate corresponding to a section in which the membership points are included in the first price is applied.

[0019] According to the present invention, a method for calculating products in an unmanned store can be provided.

[0020] In addition, according to the present invention, product recognition rate can be increased through artificial intelligence learning data, enabling product calculation to be performed quickly and accurately.

[0021] In addition, according to the present invention, the recognition rate through product scanning can be increased by aligning products using rollers.

[0022] FIG. 1 and FIG. 2 are drawings showing the external appearance of an unmanned store product calculation device according to one embodiment of the present invention.

[0023] Figure 3 is a block diagram showing the configuration of an unmanned store product calculation device according to one embodiment of the present invention.

[0024] FIG. 4 is a block diagram showing the configuration of a scanning unit of an unmanned store product calculation device according to one embodiment of the present invention.

[0025] FIG. 5 is a block diagram showing entities for calculating products in an unmanned store according to one embodiment of the present invention.

[0026] Figure 6 is a flowchart illustrating an unmanned store product calculation method according to one embodiment of the present invention.

[0027] Figure 7 is a flowchart illustrating an unmanned store product calculation method according to one embodiment of the present invention.

[0028] Figure 8 is a flowchart illustrating an unmanned store product calculation method according to one embodiment of the present invention.

[0029] Figure 9 is a flowchart illustrating an unmanned store product calculation method according to one embodiment of the present invention.

[0030] Figure 10 is a flowchart illustrating an unmanned store product calculation method according to one embodiment of the present invention.

[0031] The present invention will be described in detail with reference to the attached drawings. Herein, repetitive descriptions, well-known functions that may unnecessarily obscure the gist of the present invention, and detailed descriptions of configurations are omitted. The embodiments of the present invention are provided to more fully explain the present invention to those of ordinary skill in the art. Accordingly, the shapes and sizes of elements in the drawings may be exaggerated for clarity.

[0032] Throughout the specification, whenever a part is said to "include" a component, this does not mean that it excludes other components, but rather that it may include other components, unless otherwise stated.

[0033] Hereinafter, a preferred embodiment according to the present invention will be described in detail with reference to the attached drawings.

[0034] FIG. 1 and FIG. 2 are drawings showing the external appearance of an unmanned store product calculation device according to one embodiment of the present invention.

[0035] Referring to FIGS. 1 and 2, an unmanned store product device (1) according to one embodiment of the present invention may include a product transfer device (11), a product scanning device (12), a calculation result display device (13), a product holder (14), a QR code recognition unit (15), a product classification device (not shown), a normal calculation product discharge outlet (16), an abnormal calculation product discharge outlet (17), a height sensor (21), and a product alignment device (22).

[0036] The product transport device (11) may include a conveyor belt through which products are transported for calculation.

[0037] The product scanning device (12) may include multiple image scanners to scan products transported by the product transport device (11). Here, the multiple image scanners are arranged separately on the upper and lower portions of the conveyor belt included in the product transport device (11) and can image scan products from various directions. Products that have been accurately recognized upon completion of the image scan can be discharged through the normal checkout product discharge port (16).

[0038] The product sorting device (not shown) can operate to discharge scanned products to either a normal checkout product discharge outlet (16) or an abnormal checkout product discharge outlet (17). If the product is correctly recognized, the product sorting device does not operate and the product can be discharged to the normal checkout product discharge outlet (16) via the product transfer device (11). Conversely, if the product is not correctly recognized, the product sorting device can operate to push the product so that it is discharged to the abnormal checkout product discharge outlet (17). The product discharged to the abnormal checkout product discharge outlet can be confirmed by the user and then fed back into the unmanned store checkout device.

[0039] The product scanning device (12) can gradually increase the accuracy of image scanning through deep learning. As the number of image scans of a product increases, the accuracy of the image scanning can increase.

[0040] A height sensor (21) is installed at the entrance of the product scanning device (12) and can measure the height of a product fed into the product scanning device (12).

[0041] The product alignment device (22) can adjust the position according to the height of the product measured by the height sensor (21), and can align the product using a roller to increase the product recognition rate through product scanning. Here, alignment may refer to a process of increasing the product recognition rate by straightening crumpled packaging paper or by causing a standing product to lie down.

[0042] The calculation result display device (13) can include a list of all products and can separately display products discharged through the normal calculation product discharge port (23) and products discharged through the abnormal calculation product discharge port (24).

[0043] Figure 3 is a block diagram showing the configuration of an unmanned store product calculation device according to one embodiment of the present invention.

[0044] Referring to FIG. 3, an unmanned store product device according to one embodiment of the present invention may include a transfer unit (310), a first product recognition unit (320), a scanning unit (330), a second product recognition unit (340), a control unit (350), a weight sensor (360), a height sensor (370), a processor (380), a product classification unit (390), and a product sorting unit (400).

[0045] The transport unit can transport the product so that the user can scan the product he or she wishes to purchase.

[0046] The above first product recognition unit is installed at a first point where the product is transferred by the transfer unit, and can recognize that the product has been placed on the transfer unit.

[0047] A height sensor is installed at the first point and can measure the height of the product.

[0048] The weight sensor is installed on the lower side of the conveyor and can measure the weight of the product.

[0049] The scanning unit is installed at a preset distance from the transport unit and can scan the barcode and image of the product transported by the transport unit.

[0050] The processor can identify what the product is using artificial intelligence learning data based on the barcode and image of the product scanned through the scanning unit and the weight of the product measured through the weight sensor.

[0051] The product sorting unit is installed at the second point where scanning of products begins by the scanning unit, and can sort the products so that the recognition rate of the products through scanning of the products increases.

[0052] Here, the product alignment unit is installed at a distance above the transfer unit at the second point, and the position can be adjusted so that the distance between the transfer unit and the product alignment unit is equal to or less than the height of the product based on the height of the product measured by the height sensor.

[0053] At this time, the product alignment unit may include at least one roller to allow the product to pass smoothly between the above-mentioned distances.

[0054] The second product recognition unit is installed at the third point where the product scanning by the scanning unit is completed, and can recognize that the product has arrived at the third point.

[0055] The product classification department is installed at the third branch and can classify products based on the product identification results.

[0056] The control unit can control the operations of the transport unit, the product sorting unit, and the product classification unit based on the first product recognition result by the first product recognition unit, the height of the product measured by the height sensor, the second product recognition result by the second product recognition unit, and the product identification result by the processor.

[0057] Here, the transport unit does not operate if it does not recognize that a product has been placed through the first product recognition unit, operates to transport the product if it recognizes that a product has been placed, and can stop operating if it does not recognize that another product has been placed through the first product recognition unit until a preset time has elapsed after the classification of the product is completed.

[0058] FIG. 4 is a block diagram showing the configuration of a scanning unit of an unmanned store product calculation device according to one embodiment of the present invention.

[0059] Referring to FIG. 4, the scanning unit of the unmanned store product calculation device according to one embodiment of the present invention may include a barcode scanner (331) and an image scanner (332).

[0060] The above barcode scanner can recognize the barcode of the above product.

[0061] The above image scanner can obtain image information by scanning an image of the above product.

[0062] If the barcode is recognized, the processor identifies the product as a scanned product corresponding to the identification information included in the barcode, and if the barcode is not recognized, the processor obtains a product name and a string from the image information, and identifies the product as a scanned product based on the image information, product name, and string using artificial intelligence learning data.

[0063] In addition, the weight of the product measured using the weight sensor may be compared with the weight information included in the product information corresponding to the scanned product, and if the product is verified as the scanned product as a result of the comparison, a first signal indicating that the product has been properly identified may be transmitted to the control unit, and if the product is not identified as the scanned product or if the product is verified as not the scanned product as a result of the comparison, a second signal indicating that the product has not been properly identified may be transmitted to the control unit.

[0064] At this time, when the control unit receives the first signal from the processor, it controls the product classification unit to not operate while the product is transferred to the first zone through the transfer unit, and when the control unit receives the second signal from the processor, it controls the transfer unit to stop after recognizing that the product has arrived at the second point through the second product recognition unit, and it controls the operation of the product classification unit to push the product out of the transfer unit so that the product is classified to the second zone.

[0065] Additionally, the control unit can control the position of the product alignment unit so that the distance between the transport unit and the product alignment unit is equal to or lower than the height of the product based on the height of the product measured by the height sensor.

[0066] As an optional embodiment, the unmanned store product checkout device may include a third product recognition unit installed at a fourth point where products enter the first zone, and recognizing products classified to be sent to the first zone.

[0067] Specifically, the third product recognition unit can recognize products moving to the first zone and count the number of products moving to the first zone.

[0068] At this time, the unmanned store product calculation device compares the number of times the first signal is transmitted to be sent to the first zone through the processor with the number of products counted through the third product recognition unit, and if the comparison results are different, creates a list of products classified to be sent to the first zone and transmits the list to the administrator terminal.

[0069] Here, the administrator can check the above list through the administrator terminal and check whether the products included in the above list are classified incorrectly.

[0070] Through this, if a product verified as a scanned product is incorrectly classified into the second zone, the issue can be resolved through a verification process.

[0071] FIG. 5 is a block diagram showing entities for calculating products in an unmanned store according to one embodiment of the present invention.

[0072] Referring to FIG. 5, the entities for calculating unmanned store products according to one embodiment of the present invention include an unmanned store product calculation device (1) and a user terminal (510).

[0073] An unmanned store product calculation device (1) may refer to a device that receives user information from a user terminal (510), recognizes products scanned by a scanning unit as being purchased by a user using the user terminal, and calculates the total price.

[0074] The unmanned store product calculation device (1) may be a device that provides the calculated total price to a user terminal (510).

[0075] The user terminal (510) may be a device that provides user information to an unmanned store product calculation device (1).

[0076] The user terminal (510) may be a device that receives the total price from the unmanned store product calculation device (1).

[0077] The unmanned store product calculation device (1) and the user terminal (510) can be interconnected through a communication network.

[0078] A communications network refers to a connection path that enables data to be transmitted and received between the above entities. For example, a communications network may encompass wired networks such as LANs (Local Area Networks), WANs (Wide Area Networks), MANs (Metropolitan Area Networks), and ISDNs (Integrated Service Digital Networks), or wireless networks such as wireless LANs, CDMA, Bluetooth, and satellite communications. However, the scope of communications networks applicable to the present invention is not limited thereto.

[0079] Figure 6 is a flowchart illustrating an unmanned store product calculation method according to another embodiment of the present invention.

[0080] Referring to FIG. 6, an unmanned store product calculation method according to one embodiment of the present invention can first receive user information from a user terminal (S610).

[0081] Next, the product placed on the conveyor can be recognized through the first product recognition unit (S620).

[0082] Next, if the product is recognized, the weight of the product can be measured using a weight sensor (S630).

[0083] Next, the height of the product can be measured using the height sensor (S640).

[0084] Next, based on the height of the product, the position of the product alignment section can be controlled (S650).

[0085] For example, if a product placed on a conveyor belt is upright, it can be toppled over as it passes through the product sorting section, thereby increasing the recognition rate through product scanning. Furthermore, if the upper portion of a product placed on a conveyor belt is crumpled, it can be unfolded as it passes through the product sorting section, thereby increasing the recognition rate through product scanning.

[0086] Next, the product transported by the transport unit can be scanned through the scanning unit (S660).

[0087] At this time, if the barcode of the product is recognized, the barcode is scanned to obtain scanned product information corresponding to the barcode, and if the barcode of the product is not recognized, the entire image of the product can be scanned to obtain image information.

[0088] Additionally, if the product's barcode is not recognized or the product's image information is not obtained, the product may be designated as an unconfirmed product.

[0089] Next, based on the scan result of the product and the weight of the product, the product can be identified through the processor (S670).

[0090] Next, the product can be classified into the first zone or the second zone according to the identification result according to the above identification (S680).

[0091] Next, the first price can be calculated by adding up the prices of the above products through the calculation unit (S690).

[0092] Next, the first price can be provided to the user terminal (S700).

[0093] Figure 7 is a flowchart illustrating an unmanned store product calculation method according to one embodiment of the present invention.

[0094] Referring to FIG. 7, in an unmanned store product calculation method according to one embodiment of the present invention, after the step of scanning the product, if the barcode of the product is not recognized, the product name of the product can be obtained from the image information (S710).

[0095] Next, using artificial intelligence learning data, scanned product information corresponding to a product whose image information was obtained based on the image information and the product name can be obtained (S720).

[0096] Here, the artificial intelligence learning data may include data learned about the size, shape, name, and weight of products sold in an unmanned store.

[0097] Figure 8 is a flowchart illustrating an unmanned store product calculation method according to one embodiment of the present invention.

[0098] Referring to FIG. 8, the unmanned store product calculation method according to one embodiment of the present invention can first compare the weight information of the scanned product included in the scanned product information with the measured weight of the product (S810).

[0099] Next, if the product is verified as the scanned product as a result of the comparison, the product can be transported through the transport unit and classified into the first zone (S820).

[0100] Figure 9 is a flowchart illustrating an unmanned store product calculation method according to one embodiment of the present invention.

[0101] Referring to FIG. 9, the unmanned store product calculation method according to one embodiment of the present invention can first compare the weight information of the scanned product included in the scanned product information with the measured weight of the product.

[0102] Next, if the product is verified as another product as a result of the comparison or if the product is an unconfirmed product, it can be recognized through the second product recognition unit whether the product has arrived at the second branch where the second product recognition unit is installed (S920).

[0103] Next, if it is recognized through the second product recognition unit that the product has arrived at the second point, the operation of the transport unit can be controlled to stop (S930).

[0104] Next, the product classification unit can control the operation of the product classification unit so that the product is pushed out of the transfer unit and the product is classified into the second zone (S940).

[0105] Next, a notification indicating that the product has been classified into the second zone can be provided to the user terminal (S950).

[0106] Figure 10 is a flowchart illustrating an unmanned store product calculation method according to one embodiment of the present invention.

[0107] Referring to FIG. 10, the unmanned store product calculation method according to one embodiment of the present invention can receive the user's member information generated using the user information in step S610.

[0108] And after the step of providing the first price, if the user's payment for the product is completed, the purchase points corresponding to the first price can be accumulated in the membership points included in the member information (S1010).

[0109] At this time, the step S1010 may grant additional purchase points at a preset first ratio corresponding to the ratio of the number of products whose barcodes are recognized through the scanning unit to the number of products purchased by the user.

[0110] In addition, the S700 step may provide the user terminal with a second price to which a preset second discount rate corresponding to the section including the membership points is applied to the first price.

[0111] As an optional embodiment, before the S700 step, a first product list for products classified into the first zone at one time and a second product list for products classified into the second zone at least once can be created, and the created first product list and second product list can be provided to a user terminal.

[0112] Specifically, the unmanned store product checkout device can first generate a first product list for products classified into the first zone at a time.

[0113] At this time, a preset first mark or second mark can be displayed next to each product name included in the first product list.

[0114] Here, the first preset mark may mean that the barcode has been scanned using a barcode scanner to obtain scanned product information, and that the obtained scanned product information has been verified to match.

[0115] Additionally, the preset second mark may mean that image information of the product is acquired through an image scanner, scanned product information is acquired based on the image information, and the acquired scanned product information is verified to match.

[0116] Next, the unmanned store product checkout device can generate a second product list for products classified into the second zone at least once.

[0117] At this time, a preset third mark can be displayed next to each product name included in the second product list.

[0118] Here, the third pre-defined mark may mean that the product is an unconfirmed product or a product that has been verified as different from the scanned product information and has been classified into the second zone at least once.

[0119] As an optional embodiment, when the S700 step provides the entire price to the user terminal, the first product list and the second product list may be provided to the user terminal.

[0120] At this time, the first product list and the second product list may include the prices of each product in the list.

[0121] This allows users to verify scanned barcodes using the barcode scanner. Furthermore, the higher the percentage of scanned items, the higher the member's score. Since higher member scores lead to higher discounts, users are encouraged to place items on the conveyor belt so that the barcodes can be easily scanned. Consequently, as the number of scanned items increases, they are sorted into a secondary section, reducing the number of items requiring rescanning, thus reducing the time required for checkout.

[0122] The specific implementations described in the present invention are merely exemplary embodiments and do not limit the scope of the present invention in any way. For the sake of brevity, descriptions of conventional electronic components, control systems, software, and other functional aspects of the systems may be omitted. In addition, the lines connecting or connecting members between components depicted in the drawings are merely exemplary functional connections and / or physical or circuit connections, and may be replaced or represented as various additional functional connections, physical connections, or circuit connections in an actual device. In addition, unless specifically mentioned as “essential,” “important,” etc., a component may not be absolutely necessary for the application of the present invention.

[0123] Therefore, the idea of ​​the present invention should not be limited to the embodiments described above, and not only the scope of the patent claims described below but also all scopes equivalent to or equivalently modified from the scope of the patent claims are considered to fall within the scope of the idea of ​​the present invention.

[0124] According to the unmanned store product calculation method and device according to embodiments of the present invention, product calculation can be performed quickly and accurately by increasing the product recognition rate through artificial intelligence learning data, and the recognition rate through product scanning can be increased by aligning products using rollers, so that there is industrial applicability.

Claims

1. A transport unit that transports the product to scan the product the user wishes to purchase; A first product recognition unit installed at a first point where the transfer of goods begins by the above transfer unit, and recognizing that goods have been placed on the transfer unit; A height sensor installed at the first point and measuring the height of the product; A weight sensor installed on the lower side of the above transport section and measuring the weight of the product; A scanning unit installed at a preset distance from the above-mentioned transport unit and scanning the barcode and image of a product transported by the above-mentioned transport unit; A processor that identifies what the product is using artificial intelligence learning data based on the barcode and image of the product scanned through the above scanning unit and the weight of the product measured through the weight sensor; A product alignment unit installed at a second point where scanning of products begins by the above-mentioned scanning unit, and aligning the products so as to increase the recognition rate of the products through scanning of the products; A second product recognition unit installed at a third point where scanning of the product is completed by the above scanning unit, and recognizing that the product has arrived at the third point; A product classification unit installed at the third point and classifying the product based on the product identification result; and A control unit that controls the operations of the transfer unit, the product sorting unit, and the product classification unit based on the first product recognition result by the first product recognition unit, the height of the product measured by the height sensor, the second product recognition result by the second product recognition unit, and the product identification result by the processor. An unmanned store product calculation device including:

2. In paragraph 1, The above product sorting section is, It is installed spaced apart from the upper part of the transfer section at the second point, Based on the height of the product measured through the height sensor, the position is adjusted so that the distance between the transport unit and the product alignment unit is equal to or less than the height of the product. The above product sorting section is, An unmanned store product checkout device comprising at least one roller to allow the product to pass smoothly between the distances provided.

3. In paragraph 2, The above scanning section, A barcode scanner that recognizes the barcode of the above product; and Image scanner that scans the image of the above product to obtain image information An unmanned store product calculation device including:

4. In paragraph 3, The above processor, If the barcode is recognized, the product is identified as a scanned product corresponding to the identification information contained in the barcode, If the above barcode is not recognized, the product name and string are obtained from the image information, and the product is identified as a scanned product based on the image information, product name, and string using artificial intelligence learning data. The weight of the product measured using the weight sensor is compared with the weight information included in the product information corresponding to the scanned product, and if the product is verified as the scanned product as a result of the comparison, a first signal indicating that the product has been normally identified is transmitted to the control unit. An unmanned store product checkout device that transmits a second signal to the control unit indicating that the product is not properly identified when the product is not identified as the scanned product or when the comparison results verify that the product is not the scanned product.

5. In paragraph 4, The above control unit, When the first signal is received from the processor, the product classification unit is controlled not to operate while the product is transferred to the first zone through the transfer unit, When the second signal is received from the processor, the second product recognition unit recognizes that the product has arrived at the second point, and then controls the transport unit to stop, and the product classification unit pushes the product out of the transport unit so that the product is classified into the second zone, and controls the operation of the product classification unit. An unmanned store product calculation device that controls the position of the product sorting unit so that the distance between the transport unit and the product sorting unit is equal to or lower than the height of the product based on the height of the product measured by the height sensor.

6. Step of receiving user information from a user terminal; A step of recognizing a product placed on a conveyor belt through a first product recognition unit; When the above product is recognized, a step of measuring the weight of the product using a weight sensor; A step of measuring the height of the product using the height sensor; A step of controlling the position of the product alignment unit based on the height of the product; A step of scanning the product transported by the transport unit through the scanning unit; A step of identifying the product through a processor based on the scan result of the product and the weight of the product; A step of classifying the product so that the product is classified into the first zone or the second zone according to the identification result according to the above identification; A step of calculating the first price by adding up the prices of the above products; and A step of providing the first price to the user terminal A method for calculating products in an unmanned store, including:

7. In paragraph 6, The steps to scan the above product are: If the barcode of the above product is recognized, the barcode is scanned to obtain scanned product information corresponding to the barcode, and if the barcode of the above product is not recognized, the entire image of the above product is scanned to obtain image information. If the product's barcode is not recognized or the product's image information is not obtained, the product is designated as an unconfirmed product. After scanning the above product, A step of obtaining the product name of the product from the image information when the barcode of the product is not recognized; A step of obtaining scanned product information corresponding to a product whose image information has been obtained based on the image information and the product name using artificial intelligence learning data. Including, The above artificial intelligence learning data is, A method for calculating products in an unmanned store, including data learned from the size, shape, name, and weight of products sold in the unmanned store.

8. In paragraph 7, The steps for classifying the above products are: A step of comparing the weight information of the scanned product included in the above scanned product information with the measured weight of the product; and If the product is verified as the scanned product as a result of the comparison, a step of transporting the product through the transport section and classifying it into the first zone A method for calculating products in an unmanned store, including:

9. In paragraph 7, The steps for classifying the above products are: A step of comparing the weight information of the scanned product included in the above scanned product information with the measured weight of the product; If the product is verified as a different product as a result of comparison or if the product is an unconfirmed product, a step of recognizing whether the product has arrived at the third location where the second product recognition unit is installed through the second product recognition unit; A step of controlling the operation of the transport unit to stop when the product is recognized as having arrived at the third point through the second product recognition unit; A step of controlling the operation of the product classification unit so that the product is pushed out of the conveyance unit and the product is classified into the second zone; and A step of providing a notification to the user terminal indicating that the product has been classified into the second zone. A method for calculating products in an unmanned store, including:

10. In paragraph 8, The step of receiving the above user information is: A step of receiving the user's membership information generated using the user information above. Including, After the step of providing the above first price, When the payment for the above product by the above user is completed, a step of accumulating purchase points corresponding to the first price in the membership points included in the above member information Including, The steps for accumulating the above purchase points are: Grant additional purchase points at a preset first ratio corresponding to the ratio of the number of products whose barcodes are recognized through the scanning unit to the number of products purchased by the user above, The step of providing the above first price is: An unmanned store product calculation method that provides a second price to the user terminal with a discount rate of a preset second ratio corresponding to the section including the membership points in the first price.

Citation Information

Patent Citations

  • Unmanned checkout counter

    KR101998525B1

  • Drone with folding arm structure

    KR102323415B1

  • Artificial intelligence-based unmanned payment device and method

    KR102433004B1

  • Method and apparatus for unmanned store merchandise counting

    KR102500437B1

  • Antimicrobial handle manufactured by antimicrobial copper having improved antimicrobial performance

    KR102555037B1