An unmanned store device including an identification device

Abstract

The present invention discloses a material loading and unloading conveying device for an automated production line, comprising a device body, fresh food vending units arranged in a row, and a monitoring module, wherein the fresh food vending units are drawer structures slidably plugged into the side of the device body, and the fresh food vending units include a drawer storage bin and an automatic bagging device, wherein a significant opening mark is provided on the top of the drawer storage bin to mark the opening range, and the automatic bagging device includes a bag sealing mechanism, a label reader and a fixed claw for grabbing and fixing the mouth of the packaging bag, wherein the fixed claw has four and is provided with a vertex marking portion, and the image acquisition device downwardly acquires monitoring images at the corresponding row of fresh food vending units. The present invention can accurately monitor a series of processes of customers selecting, bagging, sealing, and registering and marking bulk fruits and vegetables in a store.

Description

Technical Field

[0001] The present invention belongs to the technical field of unmanned stores, and in particular relates to unmanned store equipment comprising an identification device. Background Art

[0002] At present, when ordinary fresh food supermarkets sell fresh fruits and vegetables, most of them are for service staff or customers to choose a kind of fruit and vegetable to pack, and then hand it over to service staff to weigh, seal and affix corresponding labels to indicate the type, weight and corresponding price. In existing unmanned supermarkets, fresh food is mainly sold in small packages. This is because unmanned supermarkets need to be easy to identify goods, fresh fruits and vegetables themselves are not easy to label, and it is difficult to accurately identify the quantity during the bagging process. If customers pack and weigh them by themselves in unmanned supermarkets, the existing monitoring equipment cannot ensure that customers will not carry some fresh food without bagging, and because the fresh food itself is not labeled, it is impossible to identify the fresh fruits and vegetables that are taken away without bagging.

[0003] However, there are some drawbacks to selling fresh produce in small packages: first, small standardized packaging of fresh produce often requires slicing and packaging of larger fresh produce, which results in the loss of nutrients in the fresh produce during the slicing and packaging process. Sliced ​​and packaged fresh produce also results in some loss. In addition, the packaging cost results in higher prices for products compared to unpackaged products, and relatively poor market competitiveness, especially for middle-aged and elderly people who value price. On the other hand, selling fresh produce after packaging also limits customers' choice of product quantity. For smaller fruits and vegetables, the quantity and weight of fruits and vegetables in a small package are fixed, and customers cannot further adjust and choose a smaller quantity.

[0004] In summary, the current unmanned supermarket equipment in the prior art is unable to accurately monitor a series of processes including selection, bagging, sealing and registration of bulk fruits and vegetables by customers in the store, resulting in the inability to sell fresh fruits and vegetables in bulk bagging in unmanned supermarkets. The supermarkets have to bear the defects caused by selling pre-packaged small-packaged fresh fruits and vegetables, which leads to increased costs, increased loss of nutrients and difficulty in meeting the quantity selection needs of some customers. Summary of the invention

[0005] The purpose of the present invention is to provide an unmanned store equipment including an identification device, which is used to solve the technical problem that the prior art cannot accurately monitor a series of processes of customers selecting, bagging, sealing and registering bulk fruits and vegetables in the store, thereby making it impossible to sell fresh fruits and vegetables in bulk bagging.

[0006] The unmanned store equipment including the identification device comprises an equipment body, a fresh food vending unit and a monitoring module, wherein the fresh food vending unit is provided with a plurality of fresh food vending units, and the plurality of fresh food vending units are arranged from top to bottom to form a row of fresh food vending units, the fresh food vending unit is a drawer structure slidably plugged into the side of the equipment body, the fresh food vending unit comprises a drawer storage bin and an automatic bagging device arranged on the outward end surface of the drawer storage bin, the top of the drawer storage bin is a bin opening for taking and placing fresh fruits and vegetables, and the top surface of the side edge of the bin opening is provided with a significant opening mark to mark the opening range, the automatic bagging device comprises a bag sealing mechanism, a label reader and a fixed claw for grabbing and fixing the mouth of the packaging bag, the fixed claw has four and exposes the top vertex mark part when grabbing the packaging bag, the monitoring module comprises a monitoring processing unit and a plurality of image acquisition devices arranged on the top of the equipment body, the image acquisition device is arranged one-to-one correspondingly to each row of fresh food vending units, and the image acquisition device downwardly acquires the monitoring image at the corresponding row of fresh food vending units.

[0007] Preferably, the monitoring image includes a prominent opening mark, a vertex mark, and the current customer's face and hand movements; the monitoring processing unit is used to identify the exposed area of ​​the warehouse opening according to the prominent opening mark, identify the mouth area of ​​the packaging bag according to the vertex mark, identify the customer's identity according to the customer's face, and identify the customer's bagging process of bulk fruits and vegetables according to the customer's hand movements; the mouth area of ​​the packaging bag is adjacent to the exposed area of ​​the warehouse opening.

[0008] Preferably, sliding strips are fixed on both sides of the drawer storage bin, a drawer cavity corresponding to the drawer storage bin is provided on the device body, the sliding strips slide along drawer guide rails on the inner walls on both sides of the drawer cavity, a drawer locking device capable of locking the sliding strips is provided in the drawer cavity, and the drawer locking device is controlled by the monitoring processing unit.

[0009] Preferably, the automatic bagging device includes a fixed component and a movable component, the fixed component is arranged on the outward end surface of the drawer storage bin, and the movable component is installed on the inner side of the drawer end panel, a bagging guide slide is also fixed to the inner side of the drawer end panel, a sliding slot is provided on the sliding strip plate for slidingly plugging with the bagging guide slide, a bagging locking device is provided in the sliding slot, and the bagging locking device is controlled by the monitoring and processing unit.

[0010] Preferably, a packaging bag conveying mechanism is provided on the fixed component, and the packaging bag conveying mechanism includes at least one pair of conveying wheels symmetrically arranged on the left and right sides of the fixed component and a storage roller arranged under the drawer storage bin, and the storage roller is wound and stored with rolled packaging bags, one end of the packaging bag roll is wound around the conveying wheel, and the packaging bag that bypasses the conveying wheel extends from above the fixed component to between the fixed component and the movable component.

[0011] Preferably, the end faces of the fixed component and the movable component facing each other are both provided with negative pressure wind windows, and the negative pressure wind windows are connected to the exhaust fan in the equipment body through air ducts, and the exhaust fan is controlled by the monitoring and processing unit.

[0012] Preferably, the end faces of the fixed component and the movable component facing each other are provided with claw mounting grooves, the fixed claw is installed in the claw mounting groove via a mounting shaft provided with a torsion spring, and a claw driving device for driving the fixed claw to rotate is provided in the claw mounting groove, and the claw driving device is controlled by the monitoring processing unit.

[0013] Preferably, the movable component is also provided with an electronic scale, which includes a weighing part, a pressure sensor, a computing unit and a display component. The fixed claw and the claw driving device at the movable component are arranged on the weighing part. The movable component has a weighing slot for setting the weighing part. The weighing part is arranged in the weighing slot. The weighing part is connected to the bottom of the weighing slot through a pressure sensor. The pressure sensor and the display component are both connected to the computing unit signal. The display component is arranged on the outer side of the drawer end panel to display the weighing result to the outside.

[0014] Preferably, the automatic bagging device is also provided with a cutting mechanism, a bag sealing mechanism and a label reader / writer.

[0015] The advantages of the present invention are: the present invention provides a corresponding fresh food vending unit for fresh goods, each fresh food vending unit also has a corresponding automatic bagging device, and the opening area of ​​the packaging bag opened by the automatic bagging device is set to be adjacent to the drawer storage bin, so that both are located in the same monitoring image collected by the image acquisition device, which is convenient for the monitoring processing unit to identify the two at the same time, and can realize the recognition of the customer's actions in the bagging process, and through the position relationship between the hand action state and position and the two areas, it is relatively reliable to judge whether the customer's behavior is reasonable, thereby ensuring the monitoring of the process from bagging to packaging by the customer. At the same time, since the fresh food vending unit and the fresh fruits and vegetables are in a one-to-one correspondence by type, it is only necessary to judge whether the hand action is to pick up the item or not, and there is no need to judge the specific type of the goods to be picked up, so the reliability of the monitoring is better. Therefore, the device can accurately monitor a series of processes of customers selecting, bagging, sealing and registering bulk fruits and vegetables in the store.

[0016] Two or more fresh food vending units in the same row are not allowed to be opened at the same time in the monitoring area of ​​the surveillance image, thus avoiding the situation where the monitoring is blocked. Since this solution realizes the binding relationship between the bagging of fresh fruits and vegetables and the customer, and writes the relevant information into the label on the bag, the unmanned supermarket can accurately verify the customer and the packaged goods at the exit or settlement equipment to avoid the problem of wrong taking or wrong settlement. If the packaged items are not settled for a long time, the customer can be linked in time, and the previous bagging process can be traced to see if there is a problem, so as to solve the problem. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 The present invention is a schematic structural diagram of an unmanned store device including an identification device.

[0018] Figure 2 for Figure 1 Front view of the structure shown.

[0019] Figure 3 for Figure 1 The module connection diagram of the structural monitoring module is shown, and the arrows indicate the direction of signal transmission.

[0020] Figure 4 and 5 for Figure 1 Schematic diagram of the structure of the fresh food vending unit in the shown structure.

[0021] Figure 6 for Figure 1 A cross-sectional view of the fresh food vending unit in the structure shown after the automatic bagging device is opened.

[0022] Figure 7 for Figure 1 A cross-sectional view of the fresh food vending unit in the structure shown after the automatic bagging device is folded.

[0023] Figure 8 for Figure 7 Magnified view of region A in the structure shown.

[0024] The marks in the attached drawings are: 1. Equipment body, 2. Fresh food vending unit, 201. Drawer storage bin, 202. Sliding strip, 203. Fixed assembly, 204. Drawer end panel, 205. Display assembly, 206. Claw mounting slot, 207. Upper conveying wheel, 208. Lower conveying wheel, 209. Guide slide, 210. Fixed claw, 211. Negative pressure window, 212. Auxiliary wheel, 213. Guide ramp, 214. Horizontal cutting board, 215. Weighing slot, 2 16. Heat sealing assembly, 217. Tag reader / writer, 218. Electric telescopic mechanism, 219. Claw driving device, 220. Pressing plate, 221. Electronic scale, 222. Position sensor, 223. Exhaust fan, 224. Drawer locking device, 225. Bagging locking device, 3. Monitoring module, 301. Image acquisition device, 302. Monitoring processing unit, 4. Packaging bag mouth area, 5. Bin opening exposed area, 6. Packaging bag roll, 601. Packaging bag. DETAILED DESCRIPTION

[0025] The specific implementation modes of the present invention are further explained in detail below by describing the embodiments with reference to the accompanying drawings, so as to help those skilled in the art to have a more complete, accurate and in-depth understanding of the inventive concept and technical solution of the present invention.

[0026] like Figure 1-8 As shown, the present invention provides an unmanned store device including an identification device, including a device body 1, a fresh food vending unit 2 and a monitoring module 3, wherein the fresh food vending unit 2 has a plurality of units, and the plurality of units 2 are arranged from top to bottom to form a row of fresh food vending units 2, wherein the fresh food vending unit 2 is a drawer structure slidably plugged into the side of the device body 1, and the fresh food vending unit 2 includes a drawer storage bin 201 and an automatic bagging device provided on the outward end surface of the drawer storage bin 201, wherein the top of the drawer storage bin 201 is a bin opening for taking in and putting in fresh fruits and vegetables, and the top side surfaces of the bin opening are provided with significant opening marks to mark the opening range, and the automatic bagging device It includes a bag sealing mechanism, a label reader / writer 217 and a fixed claw 210 for grabbing and fixing the mouth of the packaging bag. The fixed claw 210 has four vertex identification parts that are exposed at the top when the packaging bag 601 is grasped. When the automatic bagging device opens the mouth of the packaging bag, the four vertex identification parts constitute the four vertices of a rectangle (corresponding to the four fixed-point identification parts A, B, C, and D in the figure). The monitoring module 3 includes a monitoring processing unit 302 and a plurality of image acquisition devices 301 arranged on the top of the device body 1. The image acquisition device 301 is arranged one-to-one with each column of fresh food sales units 2, and the image acquisition device 301 downwardly collects monitoring images of the corresponding column of fresh food sales units 2.

[0027] The monitoring image includes a significant opening mark, a vertex mark, and the current customer's face and hand movements; the monitoring processing unit 302 is used to identify the warehouse opening exposed area 5 according to the significant opening mark, identify the packaging bag mouth area 4 according to the vertex mark, identify the customer's identity according to the customer's face, and identify the customer's bagging process of bulk fruits and vegetables according to the customer's hand movements; the packaging bag mouth area 4 is adjacent to the warehouse opening exposed area 5. If the fruits and vegetables taken out from the warehouse opening exposed area 5 by the hand movement are all placed in the packaging bag mouth area 4 and the bag is sealed and the label information is written, it means that the bagging process is normal. If the fruits and vegetables taken out from the warehouse opening exposed area 5 by the hand movement are not placed in the packaging bag mouth area 4 and are moved to the area that cannot be displayed by the monitoring image, it means that the bagging process is abnormal, and the monitoring processing unit 302 issues an alarm.

[0028] The color and brightness of the significant opening mark and vertex mark are obviously different from the surrounding scene (i.e., background), the corresponding fresh fruits and vegetables, and the packaging bag. When identifying the above-mentioned significant opening mark and vertex mark, the monitoring image is processed: first, the image is converted into a grayscale image, image noise reduction is performed, and then converted into a binary image by pixel value comparison, and the image features belonging to the significant opening mark and vertex mark are extracted from it, and the coordinates of the corresponding image features are calculated and determined. The image features corresponding to the significant opening mark form continuous line image features, thereby identifying the significant opening mark and determining the exposed area 5 of the warehouse opening surrounded by the significant opening mark; and the vertex mark corresponds to the point-like image feature. After identification, the four vertices of the rectangle formed by the four vertex mark parts are used to determine the corresponding rectangular area, i.e., the packaging bag mouth area 4. Customer facial recognition is achieved through existing face recognition technology.

[0029] Sliding strips 202 are fixed on both sides of the drawer storage bin 201, and a drawer cavity corresponding to the drawer storage bin 201 is provided on the device body 1. The sliding strips 202 slide along the drawer guide rails on the inner walls on both sides of the drawer cavity. A drawer locking device 224 capable of locking the sliding strips 202 is provided in the drawer cavity, and the drawer locking device 224 is controlled by the monitoring processing unit 302.

[0030] The automatic bagging device includes a fixed component 203 and a movable component. The fixed component 203 is arranged on the outward end surface of the drawer storage bin 201. The movable component is installed on the inner side of the drawer end panel 204. A bagging guide slide 209 is also fixed on the inner side of the drawer end panel 204. The sliding strip plate 202 is provided with a sliding slot that is slidably plugged with the bagging guide slide 209. The sliding slot is provided with a bagging locking device 225, and the bagging locking device 225 is controlled by the monitoring processing unit 302. Position sensors 222 are provided in the sliding slot and the drawer guide rail to check the state of the drawer storage bin 201 and the movable component and whether they are pulled open. The position sensor 222 sends a signal to the monitoring processing unit 302.

[0031] The fixed component 203 is provided with a packaging bag conveying mechanism, which includes at least one pair of conveying wheels symmetrically arranged on the left and right sides of the fixed component 203 and a storage roller arranged below the drawer storage bin 201, on which a rolled packaging bag roll 6 is wound and stored, and one end of the packaging bag roll 6 is wound around the conveying wheel, and the packaging bag 601 bypassing the conveying wheel extends from above the fixed component 203 to between the fixed component 203 and the movable component. The conveying wheel is driven by a corresponding conveying motor, and the conveying motor is controlled by the monitoring processing unit 302.

[0032] The conveying wheel is provided with two pairs, upper and lower, which are the upper conveying wheel 207 and the lower conveying wheel 208. The lower part of the movable assembly is provided with an auxiliary wheel 212, which corresponds to the lower conveying wheel 208 and is located at the lower part of the lower conveying wheel 208. The inner side of the movable assembly is also provided with a guide slope 213 extending to the position of the auxiliary wheel 212. The auxiliary wheel 212 is located at the lower end of the guide slope 213. The guide slope 213 guides one end of the packaging bag roll 6 transported and dropped from the upper conveying wheel 207 to between the lower conveying wheel 208 and the auxiliary wheel 212. The lower conveying wheel 208 and the auxiliary wheel 212 act on the end, and the protruding part of the packaging bag 601 is guided to the direction facing inward below the drawer storage bin 201, so as to prevent the packaging bag 601 from being squeezed and entangled inside the folded automatic bagging device, which makes it difficult to open.

[0033] The opposite end faces of the fixed component 203 and the movable component are both provided with negative pressure windows 211, and the negative pressure windows 211 are connected to the exhaust fan 223 in the device body 1 through air ducts, one of the air ducts passes from the drawer storage bin 201 to the negative pressure window 211 on the fixed component 203, and one of the air ducts passes from the sliding strip 202 and the bagging guide slide 209 to the negative pressure window 211 on the movable component. The exhaust fan 223 is controlled by the monitoring processing unit 302.

[0034] The end faces of the fixed component 203 and the movable component facing each other are both provided with claw mounting grooves 206, the fixed claw 210 is installed in the claw mounting groove 206 via a mounting shaft provided with a torsion spring, the claw mounting groove 206 is provided with a claw driving device 219 for driving the fixed claw 210 to rotate, and the claw driving device 219 is controlled by the monitoring processing unit 302. After the fixed claw 210 rotates and extends out of the claw mounting groove 206, the two sides of the bag mouth separated by the negative pressure wind window 211 are clamped on the end face to fix the packaging bag 601.

[0035] The automatic bagging device is also provided with a cutting mechanism and a bag sealing mechanism. The cutting mechanism is located higher than each conveying wheel. The cutting mechanism is a horizontal cutting plate 214 driven by an electric telescopic mechanism 218. The horizontal cutting plate 214 is used to extend and cut the connection between two packaging bags 601. The upper end of the packaging bag 601 located between the fixed component 203 and the movable component is the packaging bag mouth after being cut off. The bag sealing mechanism is arranged below the fixed claw 210. The bag sealing mechanism includes a heat sealing component 216 and a pressing plate 220. The heat sealing component 216 and the pressing plate 220 are respectively arranged on the two opposite sides of the fixed component 203 and the movable component. When the movable component is folded and close to the fixed component 203, the heat sealing member of the heat sealing component 216 is pressed onto the pressing plate 220 to achieve heat sealing of the packaging bag mouth. The electric telescopic mechanism 218 and the heat sealing component 216 are both controlled by the monitoring and processing unit 302.

[0036] The movable component is also provided with an electronic scale 221, which includes a weighing component, a pressure sensor, a calculation unit and a display component 205. The movable component is provided on the weighing component. A weighing slot 215 for setting the weighing component is provided on the inner side of the drawer end panel 204. The weighing component is provided in the weighing slot 215. The weighing component is connected to the bottom of the weighing slot 215 through a pressure sensor. The pressure sensor and the display component 205 are both connected to the calculation unit signal. The display component 205 is provided on the outer side of the drawer end panel 204 to display the weighing result. The calculation unit calculates the total weight of the fresh fruits and vegetables in the packaging bag 601 according to the pressure generated by one side of the packaging bag 601 on the pressure sensor, and calculates the actual price according to the corresponding fruit and vegetable types and unit prices stored in the packaging bag 601, and displays the unit price, total price and total weight on the display component 205. The electronic scale 221 can also be connected to and controlled by an external monitoring processing unit 302 , and the external device can input and modify the corresponding types of fruits and vegetables and unit prices into the electronic scale 221 .

[0037] The automatic bagging device is also provided with a tag reader / writer 217, which is arranged on the fixing component 203, and the reading and writing end of the tag reader / writer 217 is facing the side of the packaging bag 601. When the packaging bag 601 is opened by the automatic bagging device, the RFID tag of the packaging bag 601 faces the tag reader / writer 217. The tag reader / writer 217 is connected to the electronic scale 221 by signal, and can receive the pricing information such as the type of fruits and vegetables, unit price, total price, total weight, etc. sent by the electronic scale 221, and write the pricing information and the number of the corresponding packaged fresh fruits and vegetables into the RFID tag; the tag reader / writer 217 is connected to the monitoring processing unit 302 to read the customer identity information identified by it and write it into the RFID tag, so that the packaged packaging bag 601 can be bound to the corresponding customer identity. When the customer leaves, the reader at the exit of the unmanned supermarket can not only identify the pricing information and number in the packaging bag 601, thereby generating corresponding payment information, but also verify the identity of the purchasing customer. If the identity of the customer who packed the bag is inconsistent with the identity of the customer who actually leaves, a signal can be sent to the customer for verification to avoid erroneous payment.

[0038] The shopping management method using the unmanned store equipment provided by the present invention comprises the following steps:

[0039] 1. The customer starts to pull a fresh food vending unit 2, triggering the monitoring processing unit 302. The monitoring processing unit 302 obtains the corresponding monitoring image from the image acquisition device 301 corresponding to the column where the fresh food vending unit 2 is located, identifies the customer in the image through the face recognition model, and obtains the corresponding identity information.

[0040] Second, check whether the fresh food vending unit 2 in the same row has been opened. If so, keep the drawer locking device 224 and the bagging locking device 225 locked to prohibit the fresh food vending unit 2 from being opened, and remind the customer, otherwise, complete the preparation for bag opening. The steps of bag opening preparation specifically include: starting the horizontal cutting plate 214 to cut the packaging bag 601 in the automatic bagging device from the packaging bag roll 6, and at the same time, the negative pressure wind window 211 sucks air to open the cut packaging bag mouth, and then the fixing claw 210 is driven to extend to complete the fixing of the front and rear sides of the opened packaging bag mouth.

[0041] 3. After the bag opening preparation is completed, the bagging locking device 225 is unlocked, prompting the customer to allow the drawer end panel 204 and the connected movable components to be opened. When the customer pulls the movable components to the bottom, the bag opening is fully opened, and the vertex markings on the fixed claws 210 are exposed.

[0042] 4. The monitoring processing unit 302 determines the fully opened packaging bag mouth according to the four vertex identification parts in the monitoring image, identifies and tracks the corresponding packaging bag mouth area 4, and then contacts the locking state of the corresponding drawer locking device 224, so that the customer can open the drawer storage bin 201.

[0043] 5. After the customer opens the drawer storage bin 201, the monitoring processing unit 302 identifies and tracks the exposed bin opening area 5 based on the significant opening mark in the monitoring image.

[0044] 6. The customer starts to take fresh fruits and vegetables from the drawer storage bin 201 and put them into the packaging bag 601. During this process, the monitoring processing unit 302 identifies the hand movements in the monitoring image and monitors the customer's movements. The identification includes identifying the relevance between the hand and the customer, the hand position, and whether the hand is in the state of taking items. During the bagging process, the electronic scale 221 displays the item type, unit price, total price and total weight in real time.

[0045] The recognition of hand movements is achieved by using a vision-based image recognition method. The human body parts in the monitoring image are segmented from the surrounding image background, and then different hand movements are pre-modeled and analyzed. For example, a deep learning algorithm is used to train a gesture recognition model through a variety of gesture images. The hand movements of the customer can be recognized by the trained gesture recognition model. Among them, the common features that can be applied to hand movement recognition include: skin color features, HOG features, shape features and corner features, etc. Common recognition methods also include: SVM (support vector machine) method, HMM (hidden Markov) method, etc. The recognition method of whether the hand is in the state of picking up items is still based on images. The recognition model is trained based on the image training set of the corresponding fresh fruits and vegetables. The recognition model of fresh fruits and vegetables is used for image segmentation and recognition during recognition. In conjunction with the recognition result of the hand movement, if the hand is identified as a grasping state and it is identified that there are fresh fruits and vegetables moving with the hand, it means that the hand is in the state of picking up items. Since the purpose of the recognition of hand movements is to identify whether the bulk fresh fruits and vegetables are moved out of the opening exposure area 5, and where they are moved. Therefore, while identifying hand movements, it can also be determined whether the hand is carrying fresh fruits and vegetables across the obvious opening mark.

[0046] The monitoring process specifically includes: when the hand associated with the customer takes an object from the exposed area 5 of the warehouse opening (the state of the taken object changes), and puts it into the mouth area 4 of the packaging bag (the state of the taken object changes), it is judged as a normal action of putting fresh fruits and vegetables into the bag; when the hand associated with the customer takes an object from the mouth area 4 of the packaging bag (the state of the taken object changes), and puts it into the exposed area 5 of the warehouse opening (the state of the taken object changes), it is judged as a normal action of putting fresh fruits and vegetables back into the warehouse; the above judgments will be verified in combination with the changes in the weighing results of the electronic scale 221 (the weighing result corresponding to the loading increases, and the weighing result corresponding to the putting back decreases), and if there is a contradiction in the verification, a signal is issued to remind the customer. When the automatic bagging device is not confirmed to be bagged and the monitoring processing unit 302 does not recognize the increase or decrease of items in the packaging bag 601, if the weighing results of the electronic scale 221 have abnormal increases and decreases, the monitoring processing unit 302 will also issue a warning.

[0047] When an abnormality occurs in the tracking and identification of hand movements, the monitoring processing unit 302 issues an alarm. The abnormalities include: identifying that the hand-associated object is not the identified customer; identifying that the hand movement moves outside the monitoring image while picking up an item; identifying that the hand movement is trying to fold the automatic bagging device or the fresh food vending unit 2 while picking up an item; identifying that the hand movement takes an object from an area other than the exposed area 5 of the warehouse opening and the area 4 of the mouth of the packaging bag and puts the object into the exposed area 5 of the warehouse opening or the area 4 of the mouth of the packaging bag.

[0048] 7. After the customer completes bagging of fresh fruits and vegetables, the automatic bagging device is folded, i.e., the movable component is pushed toward the fixed component 203. After folding, the customer confirms that the bagging is complete. After receiving the information, the monitoring processing unit 302 starts the bag sealing mechanism to complete the bag sealing and starts the tag reader 217 to write the pricing information, the corresponding number and the associated customer identity. The customer then takes off the packaging bag 601.

[0049] 8. After the customer takes off the packaging bag 601, the bagging locking device 225 is locked again under the control of the monitoring processing unit 302. After the customer pushes the drawer storage bin 201 into the drawer cavity, the drawer locking device 224 is also locked. Then the monitoring processing unit 302 starts the packaging bag conveying mechanism to convey the packaging bag roll 6, allowing the new packaging bag 601 to enter the automatic bagging device. During the above process, the monitoring processing unit 302 still monitors the customer and his hand movements in the monitoring image. When the hand movement of continuing to take fresh fruits and vegetables from the drawer storage bin 201 after the automatic bagging device is folded appears, the monitoring processing unit 302 issues a warning to the customer.

[0050] The present invention is described above by way of example in conjunction with the accompanying drawings. It is obvious that the specific implementation of the present invention is not limited to the above-mentioned method. As long as various non-substantial improvements are made using the inventive concept and technical solution of the present invention, or the inventive concept and technical solution are directly applied to other occasions without improvement, they are all within the protection scope of the present invention.

Claims

1. An unmanned store device including an identification device, characterized in that: The device comprises a device body (1), a fresh food vending unit (2) and a monitoring module (3), wherein the fresh food vending unit (2) is in a plurality and the plurality of fresh food vending units (2) are arranged from top to bottom to form a row of fresh food vending units (2), wherein the fresh food vending unit (2) is a drawer structure slidably plugged into the side of the device body (1), wherein the fresh food vending unit (2) comprises a drawer storage bin (201) and an automatic bagging device arranged on the outer end surface of the drawer storage bin (201), wherein the top of the drawer storage bin (201) is a bin opening for taking in and putting in fresh fruits and vegetables, and the top side surfaces of the bin opening are provided with a prominent opening mark. The automatic bagging device comprises a bag sealing mechanism, a label reader / writer (217) and a fixed claw (210) for grabbing and fixing the mouth of the packaging bag, the fixed claw (210) has four vertex marking parts at the top that are exposed when the packaging bag (601) is grabbed, the monitoring module (3) comprises a monitoring processing unit (302) and a plurality of image acquisition devices (301) arranged at the top of the device body (1), the image acquisition devices (301) are arranged one-to-one corresponding to each row of fresh food vending units (2), and the image acquisition devices (301) downwardly acquire monitoring images at the corresponding row of fresh food vending units (2); The monitoring image includes a prominent opening mark, a vertex mark, and the current customer's face and hand movements; the monitoring processing unit (302) is used to identify the warehouse opening exposed area (5) according to the prominent opening mark, identify the packaging bag mouth area (4) according to the vertex mark, identify the customer's identity according to the customer's face, and identify the customer's bagging process of bulk fruits and vegetables according to the customer's hand movements; the packaging bag mouth area (4) is adjacent to the warehouse opening exposed area (5); The monitoring processing unit (302) determines the fully opened packaging bag mouth according to the four vertex identification parts in the monitoring image, identifies the corresponding packaging bag mouth area (4) and tracks it, and then contacts the locking state of the corresponding drawer locking device (224) to allow the customer to open the drawer storage bin (201); After the customer opens the drawer storage bin (201), the monitoring processing unit (302) identifies the exposed bin opening area (5) according to the significant opening mark in the monitoring image and tracks it; The customer starts to take fresh fruits and vegetables from the drawer storage bin (201) and put them into the packaging bag (601). During this process, the monitoring processing unit (302) identifies the hand movements in the monitoring image and monitors the customer's movements and behaviors; the identification content includes identifying the association between the hand and the customer, the hand position, and whether the hand is in the state of picking up items.

2. The unmanned store equipment comprising an identification device according to claim 1, characterized in that: Sliding strips (202) are fixed on both sides of the drawer storage bin (201); a drawer cavity corresponding to the drawer storage bin (201) is provided on the device body (1); the sliding strips (202) slide along drawer guide rails on the inner walls on both sides of the drawer cavity; a drawer locking device (224) capable of locking the sliding strips (202) is provided in the drawer cavity; and the drawer locking device (224) is controlled by the monitoring processing unit (302).

3. The unmanned store equipment comprising an identification device according to claim 2, characterized in that: The automatic bagging device comprises a fixed component (203) and a movable component, wherein the fixed component (203) is arranged on the outward end surface of the drawer storage bin (201), and the movable component is installed on the inner side of the drawer end panel (204). A bagging guide slide bar (209) is also fixed on the inner side of the drawer end panel (204). The sliding strip plate (202) is provided with a sliding slot slidably connected with the bagging guide slide bar (209), and a bagging locking device (225) is provided in the sliding slot. The bagging locking device (225) is controlled by the monitoring processing unit (302).

4. The unmanned store equipment comprising an identification device according to claim 3, characterized in that: The fixed component (203) is provided with a packaging bag conveying mechanism, which comprises at least one pair of conveying wheels symmetrically arranged on the left and right sides of the fixed component (203) and a storage roller arranged below the drawer storage bin (201), a rolled packaging bag roll (6) being wound and stored on the storage roller, one end of the packaging bag roll (6) being wound around the conveying wheel, and the packaging bag (601) bypassing the conveying wheel extends from above the fixed component (203) to between the fixed component (203) and the movable component.

5. The unmanned store equipment comprising an identification device according to claim 3, characterized in that: The end faces of the fixed component (203) and the movable component facing each other are both provided with negative pressure wind windows (211), and the negative pressure wind windows (211) are connected to the exhaust fan (223) in the device body (1) through an air duct, and the exhaust fan (223) is controlled by the monitoring processing unit (302).

6. The unmanned store equipment comprising an identification device according to claim 3, characterized in that: The end surfaces of the fixed component (203) and the movable component facing each other are both provided with a claw mounting groove (206); the fixed claw (210) is installed in the claw mounting groove (206) via a mounting shaft provided with a torsion spring; a claw driving device (219) for driving the fixed claw (210) to rotate is provided in the claw mounting groove (206); the claw driving device (219) is controlled by the monitoring processing unit (302).

7. The unmanned store equipment comprising an identification device according to claim 6, characterized in that: The movable component is also provided with an electronic scale (221), the electronic scale (221) comprising a weighing component, a pressure sensor, a computing unit and a display component (205), the movable component is provided on the weighing component, the inner side of the drawer end panel (204) is provided with a weighing slot (215) for arranging the weighing component, the weighing component is arranged in the weighing slot (215), the weighing component is connected to the bottom of the weighing slot (215) via a pressure sensor, the pressure sensor and the display component (205) are both connected to the computing unit signal, and the display component (205) is arranged on the outer side of the drawer end panel (204) to display the weighing result to the outside.

8. The unmanned store equipment comprising an identification device according to claim 1, characterized in that: The automatic bagging device is also provided with a cutting mechanism, a bag sealing mechanism and a label reader / writer (217).

Images