Method and apparatus for product checkout in unmanned store

The unmanned store product calculation device uses AI and conveyor belt technology to automate product counting, addressing inefficiencies in manual counting by quickly and accurately identifying products, thus reducing operational costs and waiting times.

WO2024232664A1PCT designated stage expired Publication Date: 2024-11-14GAEASOFT
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2024/006201
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-10
Filing Date
2024-05-09
Publication Date
2024-11-14

AI Technical Summary

Technical Problem

Manual product counting in stores is time-consuming and increases operational costs due to the need for staff, leading to inefficiencies and increased waiting times for customers.

Method used

An unmanned store product calculation device using a conveyor belt and artificial intelligence to quickly and accurately identify products through barcode and image scanning, with a weight sensor and processor for classification and pricing, reducing the need for manual intervention.

Benefits of technology

Enables fast and accurate product counting, reducing operational costs and waiting times by automating the product recognition and classification process, improving efficiency and accuracy through AI learning data and conveyor belt-based sorting.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2024006201_14112024_PF_FP_ABST
    Figure KR2024006201_14112024_PF_FP_ABST
Patent Text Reader

Abstract

Disclosed are a method and an apparatus for product checkout in an unmanned store. The apparatus for product checkout in an unmanned store, according to an embodiment of the present invention, comprises: a first transfer unit that transfers a product; a first product recognition unit that recognizes that the product is placed on the first transfer unit; a weight sensor that measures the weight of the product; a scan unit that scans a barcode and an image of the product transferred by the first transfer unit; a processor that uses artificial intelligence learning data to identify what the product is, on the basis of the barcode and the image of the product scanned by the scan unit and the weight of the product measured by the weight sensor; a product classification unit that classifies, on the basis of results of the identification of the product, the product so that the product is classified into a first area or a second area; a calculation unit that calculates a total price; a display unit that provides, to the user, the total price calculated by the calculation unit and a list of products; and a control unit that controls operations of the first transfer unit and the product classification unit.
Need to check novelty before this filing date? Find Prior Art

Description

Method and device for calculating products in an unmanned store

[0001] The present invention relates to a method and device for calculating products in an unmanned store.

[0002] The content described below merely provides background information related to one embodiment of the present invention and does not constitute prior art.

[0003] Efforts are being made to automate the entire logistics process—from product production, shipping, transportation, unloading, packaging, storage, and accounting—to reduce human resources and improve accuracy. Automating logistics can reduce costs through reduced manpower and prevent safety accidents. It also shortens logistics time and facilitates systematic management.

[0004] In particular, when calculating products in a store, there is a problem that the time required for calculating products increases as store employees perform barcode scanning on each product using a barcode scanning device, which increases unnecessary waiting time for malicious customers, increases store congestion, and increases store operation management costs due to hiring employees for calculating products.

[0005] Accordingly, there is a demand for technology that can quickly and accurately perform calculations for products that customers wish to purchase without human intervention.

[0006] The purpose of the present invention is to provide a method for calculating products in an unmanned store.

[0007] In addition, the present invention aims to perform product calculations quickly and accurately by increasing the product recognition rate through artificial intelligence learning data.

[0008] In addition, the present invention aims to increase the accuracy of product classification by using a product classification unit including a conveyor belt.

[0009] In order to achieve the above object, an unmanned store product calculation device according to one embodiment of the present invention includes a first transfer unit that transfers a product to be purchased by a user for scanning the product, a first product recognition unit that is installed at a first point where the transfer of the product by the first transfer unit starts and recognizes that the product has been placed on the first transfer unit, a weight sensor that is installed on one side of the lower portion of the first transfer unit and measures the weight of the product, a scan unit that is installed spaced upwards by a preset distance from the first transfer unit and scans a barcode and an image of the product transferred by the first transfer unit, a processor that identifies what the product is using artificial intelligence learning data based on the barcode and the image of the product scanned by the scan unit and the weight of the product measured by the weight sensor, a second transfer unit that is arranged to be in contact with a second point where the transfer of the product by the first transfer unit ends, and a product classification unit that moves left and right so that the product is classified into a first zone or a second zone based on the result of the product identification and operates the second transfer unit to classify the product, and determines the price of the product classified into the first zone. It may include a calculation unit that calculates a total price by adding up the first price and the second price that is the sum of the prices of products classified into the second zone and confirmed by the manager, a display unit that provides the user with the total price and a product list calculated by the calculation unit, and a control unit that controls the operations of the first transfer unit and the product classification unit based on the product recognition result by the first product recognition unit and the product identification result by the processor.

[0010] The above scanning unit may include a barcode scanner that recognizes the barcode of the product and an image scanner that scans an image of the product to obtain image information.

[0011] The processor, when a barcode is recognized, identifies the product as a scanned product corresponding to identification information included in the barcode, and when the barcode is not recognized, obtains a product name and a character string from the image information, identifies the product as a scanned product based on the image information, the product name, and the character string using artificial intelligence learning data, compares the weight of the product measured using the weight sensor with weight information included in the product information corresponding to the scanned product, and when the product is verified as the scanned product as a result of the comparison, transmits a first signal indicating that the product has been normally identified to the control unit, and when the product is not identified as the scanned product or when the product is verified as not the scanned product as a result of the comparison, transmits a second signal indicating that the product has not been normally identified to the control unit.

[0012] When the control unit receives the first signal from the processor, it can control the product classification unit to move in the first zone direction so that the product can be classified into the first zone, and when the control unit receives the second signal from the processor, it can control the product classification unit to move in the second zone direction so that the product can be classified into the second zone.

[0013] The first transfer unit includes a third transfer unit that transfers the product from the first point to a third point where scanning is started by the scanning unit, and a fourth transfer unit that is arranged in contact with the third transfer unit at the third point and transfers the product from the third point to the second point, and further includes a second product recognition unit that is installed at the third point and recognizes that the product has arrived at the third point, and the control unit controls the third transfer unit and the fourth transfer unit to operate when it recognizes through the first product recognition unit that the product has been placed, controls the operation of the third transfer unit to stop when it recognizes through the second product recognition unit that the product has arrived at the third point, and controls the third transfer unit to operate when there is no product for which identification through the processor has not been completed so that the product located at the third point is transferred to the fourth transfer unit.

[0014] In addition, an unmanned store product calculation method according to an embodiment of the present invention may include a step of receiving user information from a user terminal, a step of recognizing a product placed on a first conveyance unit through a first product recognition unit, a step of scanning the product conveyed by the first conveyance unit when the product is recognized, a step of identifying the product through a processor based on a scan result of the product, a step of classifying the product through a product classification unit so that the product is classified into a first zone or a second zone according to a result of the identification, a step of calculating a total price by adding up the prices of the classified products through a calculation unit, and a step of providing the total price to the user terminal.

[0015] The step of scanning the product includes: if the barcode of the product is recognized, scanning the barcode to obtain scanned product information corresponding to the barcode; if the barcode of the product is not recognized, scanning the entire image of the product to obtain image information; if the barcode of the product is not recognized or the image information of the product is not obtained, designating the product as an unidentified product; if the barcode of the product is not recognized after the step of scanning the product, obtaining the product name of the product from the image information; and using artificial intelligence learning data, obtaining scanned product information corresponding to the product whose image information is obtained based on the image information and the product name, wherein the artificial intelligence learning data may include data that has learned the size, shape, name, and weight of products sold in an unmanned store.

[0016] After the step of recognizing a product placed on the first conveying section, the step of measuring the weight of the product using a weight sensor may be included, and the step of classifying the product may include the step of comparing the weight information of the scanned product included in the scanned product information with the measured weight of the product, the step of classifying the product into the first zone so that it is sent to a user if the product is verified as the scanned product as a result of the comparison, the step of classifying the product into the second zone so that it is sent to an administrator if the product is verified as a different product as a result of the comparison or the product is an unconfirmed product, and the step of transmitting the number of products classified into the second zone, device information, and the user information to an administrator terminal.

[0017] The step of calculating the total price may include recognizing that all products classified into the first zone or the second zone have been purchased by the user, calculating a third price by adding up a first price obtained by adding up the prices of products classified into the first zone and a second price obtained by adding up the prices of products classified into the second zone, and the step of providing the total price may include a step of generating a product list including all of the classified products and a step of providing the product list and the third price to the user through the user terminal and the display unit.

[0018] The step of receiving the user information includes the step of receiving the user's membership information generated using the user information, and after the step of providing the total price, if the user's payment for the product is completed, the step of accumulating purchase points corresponding to the third price to the membership points included in the membership information includes the step of accumulating purchase points, and the step of granting additional purchase points at a preset first rate corresponding to the ratio of the number of products whose barcodes are recognized through the scanning unit to the number of products purchased by the user, and the step of providing the total price may provide the user terminal with a fourth price to which a preset second rate discount rate corresponding to a section including the membership points is applied to the third price.

[0019] According to the present invention, a method for calculating products in an unmanned store can be provided.

[0020] In addition, according to the present invention, product recognition rate can be increased through artificial intelligence learning data, enabling product calculation to be performed quickly and accurately.

[0021] In addition, according to the present invention, the accuracy of product classification can be improved by using a product classification unit including a conveyor belt.

[0022] FIG. 1 and FIG. 2 are drawings showing the external appearance of an unmanned store product calculation device according to one embodiment of the present invention.

[0023] Figure 3 is a block diagram showing the configuration of an unmanned store product calculation device according to one embodiment of the present invention.

[0024] FIG. 4 is a block diagram showing the configuration of a scanning unit of an unmanned store product calculation device according to one embodiment of the present invention.

[0025] FIG. 5 is a block diagram showing entities for calculating products in an unmanned store according to one embodiment of the present invention.

[0026] Figure 6 is a flowchart illustrating an unmanned store product calculation method according to one embodiment of the present invention.

[0027] Figure 7 is a flowchart illustrating an unmanned store product calculation method according to one embodiment of the present invention.

[0028] Figure 8 is a flowchart illustrating an unmanned store product calculation method according to one embodiment of the present invention.

[0029] Figure 9 is a flowchart illustrating an unmanned store product calculation method according to one embodiment of the present invention.

[0030] Figure 10 is a flowchart illustrating an unmanned store product calculation method according to one embodiment of the present invention.

[0031] The present invention will be described in detail with reference to the attached drawings. Herein, repetitive descriptions, well-known functions that may unnecessarily obscure the gist of the present invention, and detailed descriptions of configurations are omitted. The embodiments of the present invention are provided to more fully explain the present invention to those of ordinary skill in the art. Accordingly, the shapes and sizes of elements in the drawings may be exaggerated for clarity.

[0032] Throughout the specification, whenever a part is said to "include" a component, this does not mean that it excludes other components, but rather that it may include other components, unless otherwise stated.

[0033] Hereinafter, a preferred embodiment according to the present invention will be described in detail with reference to the attached drawings.

[0034] FIG. 1 and FIG. 2 are drawings showing the external appearance of an unmanned store product calculation device according to one embodiment of the present invention.

[0035] Referring to FIGS. 1 and 2, an unmanned store product calculation device (1) according to one embodiment of the present invention may include a product transfer device (11), a product scanning device (12), a calculation result display device (13), a product holder (14), a QR code recognition unit (15), a product classification device (21), a plurality of image scanners (22), a normal calculation product discharge outlet (23), and an abnormal calculation product discharge outlet (24).

[0036] The product transport device (11) may include a conveyor belt through which products are transported for calculation.

[0037] The product scanning device (12) may include a plurality of image scanners (22) to scan products transported by the product transport device (11). Here, the plurality of image scanners (22) are arranged separately on the upper and lower portions of the conveyor belt included in the product transport device (11) and can image-scan products from various directions. Products that have been accurately recognized upon completion of the image scan can be discharged through the normal checkout product discharge port (23).

[0038] In addition, the product sorting device (21) may include a product sorting conveyor belt (211). After the product scan is completed using the product scanning device (12), the product may be transferred to the product sorting device (21). Here, if the product is accurately recognized, the product sorting device (21) may move toward the normal calculation product discharge port (23), and the product sorting conveyor belt (211) may operate so that the product may be discharged to the normal calculation product discharge port (23). Conversely, if the product is not accurately recognized, the product sorting device (21) may move toward the abnormal calculation product discharge port (24), and the product sorting conveyor belt (211) may operate so that the product may be discharged to the abnormal calculation product discharge port (24). The product discharged to the abnormal calculation product discharge port (24) may be included in the calculation result after being confirmed by an administrator.

[0039] The product scanning device (12) can gradually increase the accuracy of image scanning through deep learning. As the number of image scans for a product increases, the accuracy of the image scanning can increase.

[0040] The calculation result display device (13) can include a list of all products and can separately display products discharged through the normal calculation product discharge port (23) and products discharged through the abnormal calculation product discharge port (24).

[0041] Figure 3 is a block diagram showing the configuration of an unmanned store product calculation device according to one embodiment of the present invention.

[0042] Referring to FIG. 3, an unmanned store product device according to one embodiment of the present invention may include a first transfer unit (310), a first product recognition unit (320), a scanning unit (330), a control unit (340), a weight sensor (350), a processor (360), a product classification unit (370), a calculation unit (380), and a display unit (390).

[0043] The first transport section can transport products so that users can scan the products they wish to purchase.

[0044] The first product recognition unit is installed at a first point where the product is transferred by the first transfer unit, and can recognize that the product has been placed on the first transfer unit.

[0045] A weight sensor is installed on the lower side of the first transport section and can measure the weight of the product.

[0046] The scanning unit is installed at a predetermined distance above the first transport unit, and can scan the barcode and image of a product transported by the first transport unit.

[0047] The processor can identify what the product is using artificial intelligence learning data based on the barcode and image of the product scanned through the scanning unit and the weight of the product measured through the weight sensor.

[0048] The product classification unit includes a second transfer unit arranged to be in contact with a second point where the transfer of the product by the first transfer unit ends, and can move left and right and operate the second transfer unit to classify the product so that the product is classified into the first zone or the second zone based on the product identification result.

[0049] The calculation section can calculate the total price by adding up the first price, which is the sum of the prices of products classified into the first zone, and the second price, which is the sum of the prices of products classified into the second zone and confirmed by the administrator.

[0050] The display unit can provide the user with a list of all prices and products calculated by the calculation unit.

[0051] The control unit can control the operations of the first transport unit and the product classification unit based on the product recognition result by the first product recognition unit and the product identification result by the processor.

[0052] Here, the first transport unit does not operate if it does not recognize that a product has been placed through the first product recognition unit, operates to transport the product if it recognizes that a product has been placed, and can stop operating if it does not recognize that another product has been placed through the first product recognition unit until a preset time has elapsed after recognizing that a product has been placed through the first product recognition unit.

[0053] FIG. 4 is a block diagram showing the configuration of a scanning unit of an unmanned store product calculation device according to one embodiment of the present invention.

[0054] Referring to FIG. 4, the scanning unit of the unmanned store product calculation device according to one embodiment of the present invention may include a barcode scanner (331) and an image scanner (332).

[0055] The above barcode scanner can recognize the barcode of the above product.

[0056] The above image scanner can obtain image information by scanning an image of the above product.

[0057] If the barcode is recognized, the processor identifies the product as a scanned product corresponding to the identification information included in the barcode, and if the barcode is not recognized, the processor obtains a product name and a string from the image information, and identifies the product as a scanned product based on the image information, product name, and string using artificial intelligence learning data.

[0058] In addition, the weight of the product measured using the weight sensor may be compared with the weight information included in the product information corresponding to the scanned product, and if the product is verified as the scanned product as a result of the comparison, a first signal indicating that the product has been properly identified may be transmitted to the control unit, and if the product is not identified as the scanned product or if the product is verified as not the scanned product as a result of the comparison, a second signal indicating that the product has not been properly identified may be transmitted to the control unit.

[0059] At this time, when the control unit receives the first signal from the processor, it can control the product classification unit to move in the first zone direction so that the product can be classified into the first zone, and when the control unit receives the second signal from the processor, it can control the product classification unit to move in the second zone direction so that the product can be classified into the second zone.

[0060] According to one embodiment, the first transport unit may include a third transport unit that transports the product from the first point to a third point where scanning by the scanning unit begins, and a fourth transport unit that is arranged to be in contact with the third transport unit at the third point and transports the product from the third point to the second point. That is, the conveyor belt of the third transport unit and the conveyor belt of the fourth transport unit may be arranged to be in contact with each other at the third point, or the fourth transport unit may be arranged at a lower position than the third transport unit so that the product can be transported continuously through the third transport unit and the fourth transport unit.

[0061] The unmanned store product calculation device may be installed at the third point and may further include a second product recognition unit that recognizes that the product has arrived at the third point.

[0062] At this time, when the control unit recognizes that a product has been placed through the first product recognition unit, it controls the third transfer unit and the fourth transfer unit to operate, when it recognizes that a product has arrived at the third point through the second product recognition unit, it controls the operation of the third transfer unit to stop, and when there is no product for which identification through the processor has not been completed, it controls the operation of the third transfer unit to transfer the product located at the third point to the fourth transfer unit.

[0063] Through this, the accuracy of product classification can be improved by allowing products to be scanned and identified one by one through the scanning unit and processor.

[0064] As an optional embodiment, the unmanned store product checkout device may be installed at a fourth point where products enter the first zone, and may include a third product recognition unit that recognizes products classified by the product classification unit to be sent to the first zone.

[0065] Specifically, the third product recognition unit can recognize products classified into the first zone after being classified by the product classification unit and count the number of products moved to the first zone.

[0066] At this time, the unmanned store product calculation device compares the number of times the first signal is transmitted to be sent to the first zone through the processor with the number of products counted through the third product recognition unit, and if the comparison results are different, creates a list of products classified to be sent to the first zone and transmits the list to the administrator terminal.

[0067] Here, the administrator can check the above list through the administrator terminal and check whether the products included in the above list are classified incorrectly.

[0068] Through this, if a product verified as a scanned product is incorrectly classified into the second zone, the problem can be resolved through the above verification process.

[0069] FIG. 5 is a block diagram showing entities for calculating products in an unmanned store according to one embodiment of the present invention.

[0070] Referring to FIG. 5, the entities for calculating unmanned store products according to one embodiment of the present invention include an unmanned store product calculation device (1), a user terminal (510), and an administrator terminal (520).

[0071] An unmanned store product calculation device (1) may refer to a device that receives user information from a user terminal (510), recognizes products scanned by a scanning unit as being purchased by a user using the user terminal, and calculates the total price.

[0072] The unmanned store product calculation device (1) may be a device that provides the calculated total price to a user terminal (510).

[0073] The unmanned store product calculation device (1) may be a device that transmits information about unconfirmed products among scanned products to the administrator terminal (520).

[0074] The user terminal (510) may be a device that provides user information to an unmanned store product calculation device (1).

[0075] The user terminal (510) may be a device that receives the total price from the unmanned store product calculation device (1).

[0076] The administrator terminal (520) may be a device that receives information on unconfirmed products among products scanned from an unmanned store product calculation device (1).

[0077] The unmanned store product calculation device (1) and the user terminal (510), and the unmanned store product calculation device (1) and the administrator terminal (520) can each be interconnected through a communication network.

[0078] A communications network refers to a connection path for transmitting and receiving data between the above entities. For example, a communications network may encompass wired networks such as LANs (Local Area Networks), WANs (Wide Area Networks), MANs (Metropolitan Area Networks), and ISDNs (Integrated Service Digital Networks), or wireless networks such as wireless LANs, CDMA, Bluetooth, and satellite communications. However, the scope of communications networks applicable to the present invention is not limited thereto.

[0079] Figure 6 is a flowchart illustrating an unmanned store product calculation method according to one embodiment of the present invention.

[0080] Referring to FIG. 6, an unmanned store product calculation method according to one embodiment of the present invention can first receive user information from a user terminal (S610).

[0081] Next, the product placed in the first transport section can be recognized through the first product recognition section (S620).

[0082] Next, if the above product is recognized, the product transported by the first transport unit can be scanned through the scanning unit (S630).

[0083] At this time, if the barcode of the product is recognized, the barcode is scanned to obtain scanned product information corresponding to the barcode, and if the barcode of the product is not recognized, the entire image of the product can be scanned to obtain image information.

[0084] Additionally, if the product's barcode is not recognized or the product's image information is not obtained, the product may be designated as an unconfirmed product.

[0085] Next, based on the scan result of the product, the product can be identified through the processor (S640).

[0086] Next, the product can be classified into the first zone or the second zone through the product classification unit according to the identification result according to the above identification (S650).

[0087] Next, the total price can be calculated by adding up the prices of the classified products through the calculation unit (S660).

[0088] Next, the total price can be provided to the user terminal (S670).

[0089] According to one embodiment, after the step of recognizing a product placed on the first conveying section, the weight of the product can be measured using a weight sensor.

[0090] Figure 7 is a flowchart illustrating an unmanned store product calculation method according to one embodiment of the present invention.

[0091] Referring to FIG. 7, in an unmanned store product calculation method according to one embodiment of the present invention, after the step of scanning the product, if the barcode of the product is not recognized, the product name of the product can be obtained from the image information (S710).

[0092] Next, using artificial intelligence learning data, scanned product information corresponding to a product whose image information was obtained based on the image information and the product name can be obtained (S720).

[0093] Here, the artificial intelligence learning data may include data learned about the size, shape, name, and weight of products sold in an unmanned store.

[0094] Figure 8 is a flowchart illustrating an unmanned store product calculation method according to one embodiment of the present invention.

[0095] Referring to FIG. 8, the unmanned store product calculation method according to one embodiment of the present invention can first compare the weight information of the scanned product included in the scanned product information with the measured weight of the product (S810).

[0096] Next, if the product is verified as the scanned product as a result of the comparison, the product can be classified into the first zone to be sent to the user, and if the product is verified as a different product as a result of the comparison or if the product is an unconfirmed product, the product can be classified into the second zone to be sent to the administrator (S820).

[0097] Next, the number of products classified into the second zone, device information, and user information can be transmitted to the administrator terminal (S830).

[0098] At this time, the step S660 recognizes that all products classified into the first zone or the second zone have been purchased by the user, and calculates a third price by adding up the first price, which is the sum of the prices of products classified into the first zone, and the second price, which is the sum of the prices of products classified into the second zone.

[0099] Figure 9 is a flowchart illustrating an unmanned store product calculation method according to one embodiment of the present invention.

[0100] Referring to FIG. 9, the unmanned store product calculation method according to one embodiment of the present invention can first generate a product list including all of the classified products (S910).

[0101] Next, the product list and the third price can be provided to the user through the user terminal and display unit (S920).

[0102] Figure 10 is a flowchart illustrating an unmanned store product calculation method according to one embodiment of the present invention.

[0103] Referring to FIG. 10, the unmanned store product calculation method according to one embodiment of the present invention can receive the user's member information generated using the user information in step S610.

[0104] And after the step of providing the total price, if the payment for the product by the user is completed, the purchase points corresponding to the third price can be accumulated in the membership points included in the member information (S1010).

[0105] At this time, the step S1010 may grant additional purchase points at a preset first ratio corresponding to the ratio of the number of products whose barcodes are recognized through the scanning unit to the number of products purchased by the user.

[0106] In addition, the step S670 may provide the user terminal with a fourth price to which a preset second discount rate corresponding to the section including the membership points is applied to the third price.

[0107] As an optional embodiment, when generating a product list, a first product list for products classified into a first zone and a second product list for products classified into a second zone may be generated, and the generated first product list and second product list may be provided to a user terminal.

[0108] Specifically, the unmanned store product checkout device can first generate a first product list for products classified into the first zone.

[0109] At this time, a preset first mark or second mark can be displayed next to each product name included in the first product list.

[0110] Here, the first mark may mean that the barcode has been scanned using a barcode scanner to obtain scanned product information, and that it has been verified to match the obtained scanned product information.

[0111] Additionally, the second mark may mean that image information of the product has been acquired through an image scanner, scanned product information has been acquired based on the image information, and the acquired scanned product information has been verified to match.

[0112] Next, the unmanned store product checkout device can generate a second product list for products classified in the second zone when the products classified in the second zone have been confirmed by the manager.

[0113] At this time, a preset third mark can be displayed next to each product name included in the second product list.

[0114] Here, the third mark may mean that the product is unconfirmed or has been verified by the administrator as a product different from the scanned product information.

[0115] At this time, the above step S920 can provide the first product list and the second product list to the user through the user terminal and the display unit.

[0116] At this time, the first product list and the second product list may include the prices of each product in the list.

[0117] This allows users to verify scanned barcodes using the barcode scanner. Furthermore, the higher the percentage of scanned items, the higher the member score. Since higher member scores lead to higher discounts, users are encouraged to place items on the conveyor belt so that the barcodes can be easily scanned. Consequently, as the number of scanned items increases, fewer items require administrator verification, reducing the time required for product checkout.

[0118] The specific implementations described in the present invention are merely exemplary embodiments and do not limit the scope of the present invention in any way. For the sake of brevity, descriptions of conventional electronic components, control systems, software, and other functional aspects of the systems may be omitted. In addition, the lines connecting or connecting members between components depicted in the drawings are merely exemplary functional connections and / or physical or circuit connections, and may be replaced or represented as various additional functional connections, physical connections, or circuit connections in an actual device. In addition, unless specifically mentioned as “essential,” “important,” etc., a component may not be absolutely necessary for the application of the present invention.

[0119] Therefore, the idea of ​​the present invention should not be limited to the embodiments described above, and not only the scope of the patent claims described below but also all scopes equivalent to or equivalently modified from the scope of the patent claims are considered to fall within the scope of the idea of ​​the present invention.

[0120] According to the unmanned store product calculation method and device according to embodiments of the present invention, product calculation can be performed quickly and accurately by increasing the product recognition rate through artificial intelligence learning data, and the accuracy of product classification can be increased by using a product classification unit including a conveyor belt, so that there is industrial applicability.

Claims

1. A first transport unit that transports the product to scan the product the user wishes to purchase; A first product recognition unit installed at a first point where the transfer of goods begins by the first transfer unit, and recognizing that goods have been placed on the first transfer unit; A weight sensor installed on the lower side of the first transport section and measuring the weight of the product; A scanning unit installed at a predetermined distance above the first transport unit and scanning the barcode and image of a product transported by the first transport unit; A processor that identifies what the product is using artificial intelligence learning data based on the barcode and image of the product scanned through the above scanning unit and the weight of the product measured through the weight sensor; A product classification unit including a second transfer unit arranged to be in contact with a second point where the transfer of the product is terminated by the first transfer unit, and moving left and right based on the product identification result so that the product is classified into a first zone or a second zone, and operating the second transfer unit to classify the product; A calculation unit that calculates the total price by adding up the first price, which is the sum of the prices of products classified into the first zone, and the second price, which is the sum of the prices of products classified into the second zone and confirmed by the administrator; A display unit that provides the user with the total price and product list calculated by the calculation unit; and A control unit that controls the operations of the first transfer unit and the product classification unit based on the product recognition result by the first product recognition unit and the product identification result by the processor. An unmanned store product calculation device including:

2. In paragraph 1, The above scanning section, A barcode scanner that recognizes the barcode of the above product; and Image scanner that scans the image of the above product to obtain image information An unmanned store product calculation device including:

3. In paragraph 2, The above processor, If the barcode is recognized, the product is identified as a scanned product corresponding to the identification information contained in the barcode, If the above barcode is not recognized, the product name and string are obtained from the image information, and the product is identified as a scanned product based on the image information, product name, and string using artificial intelligence learning data. The weight of the product measured using the weight sensor is compared with the weight information included in the product information corresponding to the scanned product, and if the product is verified as the scanned product as a result of the comparison, a first signal indicating that the product has been normally identified is transmitted to the control unit. An unmanned store product checkout device that transmits a second signal to the control unit indicating that the product is not properly identified when the product is not identified as the scanned product or when the comparison results verify that the product is not the scanned product.

4. In paragraph 3, The above control unit, When the first signal is received from the processor, the product classification unit is controlled to move in the direction of the first zone so that the product can be classified into the first zone, An unmanned store product calculation device that, when receiving the second signal from the processor, controls the product classification unit to move in the direction of the second zone so that the product can be classified into the second zone.

5. In paragraph 4, The above first transfer unit is, A third transport unit that transports the product from the first point to a third point where scanning begins by the scanning unit; and A fourth transport section is arranged in contact with the third transport section at the third point and transports the product from the third point to the second point. Including, A second product recognition unit installed at the third point and recognizing that the product has arrived at the third point Including more, The above control unit, When it is recognized that a product has been placed through the first product recognition unit, the third transport unit and the fourth transport unit are controlled to operate, When it is recognized through the second product recognition unit that the product has arrived at the third point, the operation of the third transport unit is controlled to stop, An unmanned store product checkout device that controls the third transfer unit to operate so that products located at the third point are transferred to the fourth transfer unit when there are no products for which identification through the processor has not been completed.

6. Step of receiving user information from a user terminal; A step of recognizing a product placed in the first transport section through the first product recognition section; When the above product is recognized, a step of scanning the product transported by the first transport unit through the scanning unit; A step of identifying the product through a processor based on the scan result of the product; A step of classifying the product through a product classification unit so that the product is classified into the first zone or the second zone according to the identification result according to the above identification; A step of calculating the total price by adding up the prices of the classified products through the calculation unit; and A step of providing the total price to the user terminal A method for calculating products in an unmanned store, including:

7. In paragraph 6, The steps to scan the above product are: If the barcode of the above product is recognized, the barcode is scanned to obtain scanned product information corresponding to the barcode, and if the barcode of the above product is not recognized, the entire image of the above product is scanned to obtain image information. If the product's barcode is not recognized or the product's image information is not obtained, the product is designated as an unconfirmed product. After scanning the above product, A step of obtaining the product name of the product from the image information when the barcode of the product is not recognized; A step of obtaining scanned product information corresponding to a product whose image information has been obtained based on the image information and the product name using artificial intelligence learning data. Including, The above artificial intelligence learning data is, A method for calculating products in an unmanned store, including data learned from the size, shape, name, and weight of products sold in the unmanned store.

8. In paragraph 7, After the step of recognizing the product placed in the first transport section, A step of measuring the weight of the above product using a weight sensor Including, The steps for classifying the above products are: A step of comparing the weight information of the scanned product included in the above scanned product information with the measured weight of the product; A step of classifying the product into the first zone so that it is sent to the user if the product is verified as the scanned product as a result of the comparison, and classifying the product into the second zone so that it is sent to the administrator if the product is verified as another product as a result of the comparison or if the product is an unconfirmed product; and A step of transmitting the number of products classified into the above second zone, device information, and user information to the administrator terminal. A method for calculating products in an unmanned store, including:

9. In paragraph 8, The steps for calculating the total price above are: All products classified into the first zone or the second zone are recognized as having been purchased by the user, and a third price is calculated by adding up the first price, which is the sum of the prices of products classified into the first zone, and the second price, which is the sum of the prices of products classified into the second zone. The step of providing the above total price is, A step of generating a product list including all of the above classified products; and A step of providing the product list and the third price to the user through the user terminal and display unit. A method for calculating products in an unmanned store, including:

10. In paragraph 9, The step of receiving the above user information is: A step of receiving the user's membership information generated using the user information above. Including, After the step of providing the total price above, When the payment for the above product by the above user is completed, a step of accumulating purchase points corresponding to the third price in the membership points included in the above member information Including, The steps for accumulating the above purchase points are: Grant additional purchase points at a preset first ratio corresponding to the ratio of the number of products whose barcodes are recognized through the scanning unit to the number of products purchased by the user above, The step of providing the above total price is, A method for calculating products in an unmanned store, which provides a fourth price to the user terminal, with a discount rate of a preset second ratio corresponding to the section including the membership points in the third price.

Citation Information

Patent Citations

  • Unmanned checkout counter

    KR101998525B1

  • Extra moving member installation apparatus of machine tool

    KR1020230157018A

  • Drone with folding arm structure

    KR102323415B1

  • Method and apparatus for unmanned store merchandise counting

    KR102500437B1

  • Method and apparatus for unmanned store merchandise counting

    KR102660457B1