Product pick-up device and product pick-up system
The product pickup device uses cameras and LEDs to ensure accurate product placement and tracking, addressing the challenge of distinguishing between heavy and light items in product pickup systems.
Patent Information
- Application Number
- JP2020199260
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2020-12-01
- Publication Date
- 2024-11-27
- Estimated Expiration
- 2040-12-01
AI Technical Summary
Existing product pickup systems struggle to reliably identify and distinguish between heavy and light items, making it difficult to ensure all ordered products are correctly stored in the correct storage sections.
A product pickup device equipped with a storage unit, positioning unit, acquisition section, detection section, and display section, utilizing cameras and LEDs to accurately identify and guide the placement of products into the correct containers, and display the status of product pickup progress.
Enables reliable recognition of product placement and efficient pickup by ensuring each product is correctly stored, allowing for accurate tracking and completion of orders.
Smart Images

Figure 0007590857000001 
Figure 0007590857000002 
Figure 0007590857000003
Abstract
Description
[Technical field]
[0001] An embodiment of the present invention relates to a product pick-up device and a product pick-up system. [Background technology]
[0002] A purchasing method has been proposed in which, when shopping at a store such as a supermarket or a convenience store, a customer orders the products he or she wishes to purchase, and a store staff member collects, or picks, the ordered products and delivers the picked products to the customer.
[0003] For example, Patent Document 1 proposes a sorting device that determines whether an article has been inserted in the correct position.
[0004] However, the sorting device disclosed in Patent Document 1 determines whether an inserted item has been inserted into a predetermined sorting position based on the weight of the item, so when heavy and light items are mixed, such as products sold in a store, it is difficult to reliably identify that all of these items have been placed in a storage section such as a basket. More specifically, it is difficult for the same weight sensor to identify whether a 10 kg bag of rice has been placed in a basket and whether several tens of grams of sweets have been placed in the basket. Summary of the Invention [Problem to be solved by the invention]
[0005] An object of the present invention is to provide a product pick-up device and a product pick-up system that can reliably recognize that an ordered product has been picked up. [Means for solving the problem]
[0006] The product pickup device according to the embodiment has a storage unit including a plurality of containers for storing picked-up products in a manner to distinguish them according to orders, A positioning unit; The device includes an acquisition unit, a detection unit, and a display unit. The positioning unit measures the current position of the product pick-up device. The acquisition unit acquires information on the products to be picked up and the number of products for each container. At the same time, obtain route information to ensure that all products are picked up The detection unit detects that the picked up product has been placed in the correct container and the product information of the placed product based on an image of the storage unit. The display unit displays the guide light installed in the container into which the next product to be picked up is to be placed, among the guide lights installed in each of the multiple containers. Before picking up the item As well as turning it on, Current location and route information, The system distinguishes and displays items that have already been picked up, items to be picked up next, and items that have not yet been picked up. [Brief description of the drawings]
[0007] [Figure 1] FIG. 1 is a system block diagram showing an example of a system configuration of a product pickup system. [Diagram 2] FIG. 2 is an overall perspective view of a cart that is an example of a product pick-up device. [Diagram 3] FIG. 3 is a diagram explaining the function of the camera installed on the cart. [Figure 4] FIG. 4 is a diagram for explaining a method for detecting insertion of a commodity from an image captured by a camera installed on a cart. [Diagram 5] FIG. 5 is a diagram showing an example of information displayed on the display device of the cart. [Figure 6] FIG. 6 is a hardware block diagram illustrating an example of a hardware configuration of the server device. [Figure 7] FIG. 7 is a hardware block diagram showing an example of a hardware configuration of the cart. [Figure 8] FIG. 8 is a functional block diagram illustrating an example of a functional configuration of the server device. [Figure 9] FIG. 9 is a functional block diagram showing an example of a functional configuration of the cart. [Figure 10] FIG. 10 is a flowchart illustrating an example of the flow of a process performed by the product pickup system according to the first embodiment. [Figure 11]FIG. 11 is a flowchart showing an example of the flow of processing performed by a product insertion detection unit included in the cart. [Figure 12] FIG. 12 is a diagram illustrating a product image transmission function included in the cart according to the second embodiment. [Figure 13] FIG. 13 is a functional block diagram illustrating an example of a functional configuration of a server device according to the second embodiment. As illustrated in FIG. [Figure 14] FIG. 14 is a functional block diagram illustrating an example of a functional configuration of the cart according to the second embodiment. As illustrated in FIG. [Figure 15] FIG. 15 is a flowchart illustrating an example of the flow of a process performed by the product pickup system according to the second embodiment. [Figure 16] FIG. 16 is a flowchart illustrating an example of the flow of processes performed by a merchandise insertion detection unit and a merchandise image selection unit included in the cart according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0008] (First embodiment) A product pickup system 10 according to a first embodiment of the present invention will be described.
[0009] (Overall configuration of product pickup system) First, the overall configuration of a product pickup system 10 will be described with reference to Fig. 1. Fig. 1 is a system block diagram showing an example of the system configuration of a product pickup system according to a first embodiment.
[0010] The product pickup system 10 includes a cart 20, a server device 50, and a mobile terminal 70. The cart 20 is pushed by a store clerk and moves around the store or the back yard. The cart 20 includes a basket for storing products picked up by the store clerk and ordered by a customer (see FIG. 2 for details). Although FIG. 1 illustrates only one cart 20, there may be multiple carts 20. Each cart 20 is assigned a unique identification number that identifies the individual cart. The cart 20 is an example of a product pickup device in the present disclosure.
[0011] The server device 50 accepts product orders from customers' mobile terminals 70, such as smartphones, tablet terminals, and personal computers, via the Internet 72. The server device 50 also generates product pickup information including the products to be picked up and the number of products based on the orders accepted from the customers. The server device 50 also transmits the generated product pickup information to the cart 20. The product pickup information may also include route information (pickup route information) indicating a travel route for efficiently picking up all of the ordered products.
[0012] A plurality of wireless communication units 60 connected to a server device 50 are installed in the store. The server device 50 transmits product pickup information and pickup route information to the cart 20 via the wireless communication unit 60 with the best communication state.
[0013] A store clerk (picker) carrying the cart 20 takes out the product to be picked up from the product display shelf and stores it in the cart 20. The cart 20 then detects the stored product and determines whether the correct product has been stored. The configuration of the cart 20 will be described in detail later (see FIG. 2).
[0014] (Overall Cart Configuration) Next, the overall configuration of the cart 20 will be described with reference to Fig. 2. Fig. 2 is an overall perspective view of a cart which is an example of a product pick-up device.
[0015] Cart 20 has a frame 21 as its main component, to which handles 22 and casters 23 are attached. Casters 23 are small wheels that can freely turn, i.e., change the traveling direction of cart 20, depending on the direction of force applied to handle 22. A picker moves cart 20 within the store by holding handle 22 and changing the traveling direction using casters 23.
[0016] A container installation frame 24 is provided on the upper part of the frame 21, and a container installation frame 25 is provided on the lower part of the frame 21. The container installation frame 24 is a frame member on which two different bags 311, 312 can be removably installed. The container installation frame 25 is a frame member on which two different baskets 313, 314 can be removably installed. The picker stores products corresponding to different orders in the bags 311, 312 and the baskets 313, 314, respectively. In the example of FIG. 2, the bags 311, 312 are installed on the container installation frame 24, and the baskets 313, 314 are installed on the container installation frame 25, but the present invention is not limited to this example. That is, all bags may be installed on the container installation frames 24, 25, or all baskets may be installed. The bags 311, 312 and the baskets 313, 314 are examples of the container and storage section 31 in the present disclosure.
[0017] A display device 26 is provided on the handle 22. The display device 26 includes, for example, a liquid crystal panel or an organic EL panel, and displays image information. A list of products to be picked up and a route to travel in order to efficiently pick up products are displayed on the display device 26 (see FIG. 5 for details). A touch panel 27 is provided on the display surface of the display device 26 and is layered on the display surface. The display device 26 accepts operational inputs from the picker. The display device 26 may be, for example, a mobile terminal such as a tablet terminal or a smartphone.
[0018] A GPS (Global Positioning System) receiver 32 is installed inside the housing of the display device 26. The GPS receiver 32 performs positioning to identify its own position by receiving GPS signals output from GPS satellites, and identifies the current position and traveling direction of the cart 20 in the store. The method of identifying the current position of the cart 20 is not limited to GPS positioning. For example, the cart 20 may communicate with a plurality of wireless communication units 60 and identify its own position based on the strength of the signal received from each wireless communication unit 60. The cart 20 may also identify its own position by receiving reference signals output from a plurality of beacom posts installed in the store.
[0019] A plurality of cameras 28 (281, 282, 283, 284) and a plurality of lighting LEDs (Light Emitting Diodes) 29 (291, 292, 293, 294) are installed on the container installation frame 24 and the container installation frame 25, facing the inside of the baskets 313, 214 or the bags 311, 312. More specifically, four cameras 281 and four lighting LEDs 291 are installed at the position where the bag 311 is installed. The four cameras 281 are installed approximately horizontally along the X-axis and Y-axis at equal height positions in the Z-axis direction. The installation positions of the cameras 281 will be described in detail later (see FIG. 3). The four cameras 281 capture images from four different directions of an area through which the product is expected to pass when the product is put into the bag 311. 2 does not show a specific installation position of the illumination LED 291, the illumination LED 291 is installed near the camera 281 and illuminates at least the imaging range of the camera 281. The camera 28 is an example of an imaging device in this disclosure.
[0020] Similarly, four cameras 282 and four lighting LEDs 292 are installed at the installation positions of bag 312. Furthermore, four cameras 283 and four lighting LEDs 293 are installed at the installation positions of basket 313. And, four cameras 284 and four lighting LEDs 294 are installed at the installation positions of basket 314.
[0021] Furthermore, guide lights 30 (301, 302, 303, 304) are installed on the container installation frame 24 and the container installation frame 25 at positions visible to a picker moving the cart 20. Guide light 301 is an indicator that indicates that the next insertion position for the product to be picked up is bag 311. Guide light 302 is an indicator that indicates that the next insertion position for the product to be picked up is bag 312. Guide light 303 is an indicator that indicates that the next insertion position for the product to be picked up is basket 313. And guide light 304 is an indicator that indicates that the next insertion position for the product to be picked up is basket 314.
[0022] When the cart 20 is moved along the above-mentioned pickup route information, the next product to be picked up is the product that is closest to the selected product. The cart 20 then turns on the guide light 30 corresponding to the storage position of that product. The guide light 30 is turned off when it is detected that the correct product has been placed in the specified position. The cart 20 then turns on the guide light 30 corresponding to the storage position of the next product to be picked up.
[0023] (Method of detecting the input of a product and method of recognizing the input product) Next, a method for the cart 20 to detect the insertion of a product and a method for recognizing the inserted product will be described with reference to Figures 3 and 4. Figure 3 is a diagram for explaining the function of a camera installed in the cart. Figure 4 is a diagram for explaining a method for detecting the insertion of a product from an image captured by a camera installed in the cart.
[0024] The upper part of Fig. 3 is a YZ cross-sectional view showing a state in which the bag 311 is attached to the container installation frame 24 of the cart 20. The above-mentioned cameras 281 are installed on the four inner surfaces of the container installation frame 24. Only three of the four cameras 281 are shown in Fig. 3. The cameras 281 at opposing positions are installed at the same height position so that their observation ranges face each other. In addition, each camera 281 has the same viewing angle θ. Although not shown in the figure, a lighting LED 291 is installed near the camera 281 to illuminate at least the range of the viewing angle θ.
[0025] The middle part of FIG. 3 shows an example of a state in which fresh food 73 is being put into bag 311. Each camera 281 captures an image at the same time based on an external synchronization signal output from cart 20. This imaging operation is performed continuously regardless of whether or not a product is put in. As a result, four images are captured at the same time. Cart 20 performs a product insertion determination process for determining whether a product may have been put in for each of the four captured images and identifying the put-in product. The product insertion determination process will be described in detail later (see FIG. 4). Note that the speed of the product when it is put in is not constant. Therefore, in order to prevent blurring in the captured image, it is desirable to capture the image at as fast a shutter speed as possible. Since the image becomes dark when captured at a fast shutter speed, the brightness of the image is ensured by turning on lighting LED 294. Note that lighting LED 294 only needs to be turned on at least at the moment of capturing the image.
[0026] When it is determined by the product insertion determination process that a product may have been inserted, the cart 20 subsequently performs object recognition. Object recognition for recognizing products included in an image is also called generic object recognition. Various recognition technologies used in generic object recognition are explained in detail in the following documents, so explanations will be omitted here.
[0027] Keiji Yanai, “Current Status and Future of General Object Recognition”, Transactions of the Information Processing Society of Japan, Vol. 48, No. SIG16 [Retrieved November 18, 2020], Internet<URL: https: / / mm.cs.uec.ac.jp / IPSJ-TCVIM-Yanai.pdf>
[0028] Jamie Shotton et al., “Semantic Texton Forests for Image Categorization and Segmentation,” [Retrieved November 18, 2020], Internet <URL: http: / / mi.eng.cam.ac.uk / ~cipolla / publications / inproceedings / 2008-CVPR-semantic-texton-forests.pdf>
[0029] In addition, object recognition involves recognizing whether a code symbol such as a barcode or two-dimensional code is captured in the captured image, and if a code symbol is captured, it is read.
[0030] In the example in the middle part of FIG. 3, after detecting the insertion of a product, the cart 20 recognizes that the inserted product is a fresh food item 73.
[0031] The lower part of Fig. 3 shows an example of a state in which a product 74 with a barcode attached is being inserted into a bag 311. In this case, the cart 20 performs the same process as described above. After detecting the insertion of the product, the cart 20 reads the barcode 75 attached to the inserted product. The cart 20 then collates the code information recorded in the read barcode 75 with the product master M (see Fig. 6) to recognize that the inserted product is the product 74.
[0032] Next, a method of the commodity insertion determination process will be described with reference to Fig. 4. The upper part of Fig. 4 shows an example of an image I(t) captured by the camera 281 at time t. The middle part of Fig. 4 shows an example of an image I(t+Δt) captured by the camera 281 after Δt seconds, that is, at time t+Δt.
[0033] The cart 20 performs a difference calculation to subtract the image I(t) from the image I(t+Δt). The difference calculation results in a difference image J(t+Δt) shown in the lower part of FIG.
[0034] When a product is added to the cart 20, the product passes through the observation range of the camera 281, and so an area of the product generally appears in the difference image J(t+Δt). The difference image J(t+Δt) is a so-called grayscale image in which brightness is converted into pixel values. The cart 20 converts the difference image J(t+Δt) into a binary image by binarizing it with a predetermined threshold value. Then, when the area of the area in the binary image exceeds a predetermined value, the cart 20 determines that the brightness of the image has changed significantly in Δt seconds, i.e., that a product may have been added.
[0035] If it is determined from the difference image J(t+Δt) that a product may have been inserted, it is assumed that the product appears in the image I(t+Δt), so the cart 20 recognizes the inserted product by performing object recognition on the image I(t+Δt). Also, if the product has a code symbol such as a barcode, the code information recorded in the code symbol is read.
[0036] The above description is of the flow of processing for images captured by one camera 281. In reality, the same processing is performed for four sets of images captured by four cameras 281, respectively. Then, when it is determined that a product may have been inserted into only one set of images among the four sets of images captured by the four cameras 281, respectively, the cart 20 performs object recognition for only that one set of images. On the other hand, when it is determined that a product may have been inserted into multiple sets of images, the cart 20 performs object recognition for each of the multiple sets of images. Then, for example, the cart 20 recognizes the inserted product based on the recognition result for the image that outputs the most reliable recognition result.
[0037] (Information displayed on the cart display device) Next, the contents of the information displayed on the display device 26 of the cart 20 will be described with reference to Fig. 5. Fig. 5 is a diagram showing an example of information displayed on the display device of the cart.
[0038] The display device 26 of the cart 20 displays the product list 34 and the store map 80 shown in FIG. 5. The product list 34 is a list of products to be put into each of the storage sections 31 (bags 311, 312 and baskets 313, 314). The product lists 34 corresponding to each storage section 31 are displayed aligned to match the arrangement of the storage sections 31 as seen by the store clerk (picker) holding the handle 22. More specifically, the product list 341 displayed in the upper left is a list of products to be put into the bag 311 located in the upper left as seen by the store clerk holding the handle 22. The product list 342 displayed in the upper right is a list of products to be put into the bag 312 located in the upper right as seen by the store clerk holding the handle 22. The product list 343 displayed in the lower left is a list of products to be put into the basket 313 located in the lower left as seen by the store clerk holding the handle 22. The product list 344 displayed in the lower right corner is a list of products to be placed in the basket 314 located at the lower right corner as seen by the store clerk holding the handle 22. By matching the arrangement of the containers 31 with the arrangement of the product list in this way, the store clerk can easily determine the position to place the picked up product.
[0039] Additionally, a store map 80 shows the layout of the store's aisles and shelves.
[0040] Each product list 34 (341, 342, 343, 344) displays an order number 35 and a target picking completion time 36. The order number 35 is the order number of the product. Instead of the order number 35, information that uniquely identifies the customer may be displayed. The target picking completion time 36 is the target time when picking up the products should be completed. The current time 88 is displayed on the upper section of the display device 26, so the store clerk refers to the target picking completion time 36 and the current time 88 and picks up the products so as not to be late for the target picking completion time 36.
[0041] Additionally, the products to be picked up are displayed in a lined-up state in each product list 34 (341, 342, 343, 344). The order of arrangement is not limited, but in this embodiment, the products are displayed in a lined-up state in the order in which they will be picked up when the cart 20 moves from the current position along pickup route information 83 (described later).
[0042] The list showing each product is displayed with hatching according to the progress of picking or with coloring according to the progress of picking. For example, in Fig. 5, the hatched product shown in picking state 37 indicates that the product has already been picked. The hatched product shown in picking state 38 indicates that the product is to be picked next. Also, the hatched product shown in picking state 39 indicates that the product has not yet been picked.
[0043] The in-store map 80 further displays a current location 82, pickup route information 83, and numbers of products 84, 85, and 86.
[0044] The current position 82 is an icon indicating the current position and traveling direction of the cart 20. The current position and traveling direction of the cart 20 are detected by the GPS receiver 32 (see FIG. 7) provided in the cart 20.
[0045] The pickup route information 83 is information that indicates a travel route for efficiently picking up all ordered products and transporting the picked up products to the rush-up shelf 87. In the example shown in Fig. 5, in order to make the screen easier to view, the pickup route information 83 that has already been passed to reach the current position 82 is displayed in a dotted line.
[0046] The numbers of items 84, 85, and 86 are icons that indicate the number of items to be picked up at that position. It is preferable that the numbers of items 84, 85, and 86 have a display form that corresponds to the progress of picking. For example, the number of items 84 shown in FIG. 5 indicates the position and number of items that have already been picked. The number of items 85 indicates the position and number of items to be picked next. Furthermore, the number of items 86 indicates the position and number of items that have not yet been picked.
[0047] (Server hardware configuration) Next, the hardware configuration of the server device 50 will be described with reference to Fig. 6. Fig. 6 is a hardware block diagram showing an example of the hardware configuration of the server device.
[0048] The server device 50 includes a control unit 51 , a storage unit 52 , an input / output controller 54 , and a communication interface 57 .
[0049] The control unit 51 has a typical computer configuration including a central processing unit (CPU) 511, a read only memory (ROM) 512, and a random access memory (RAM) 513. The CPU 511 reads out various programs, data files, and the like stored in the ROM 512 and a storage unit 52 (described later), and loads them in the RAM 513. The CPU 511 controls the entire server device 50 by operating in accordance with the various programs, data files, and the like loaded in the RAM 513.
[0050] The control unit 51 is connected to the storage unit 52, the input / output controller 54, and the communication interface 57 via an internal bus 53.
[0051] The storage unit 52 retains stored information even when the power is turned off. The storage unit 52 is, for example, a hard disk drive (HDD). Instead of the HDD, a non-volatile memory such as a flash memory may be provided. The storage unit 52 stores programs including a control program Q. The control program Q is a program for implementing the functions of the server device 50.
[0052] The control program Q may be provided by being pre-installed in the ROM 512. The control program Q may be provided by being recorded in a computer-readable recording medium such as a CD-ROM, a flexible disk (FD), a CD-R, or a digital versatile disk (DVD) in the form of a file that can be installed in the control unit 51 or that can be executed. The control program Q may be provided by being stored on a computer connected to a network such as the Internet and downloaded via the network. The control program Q may be provided or distributed via a network such as the Internet.
[0053] The storage unit 52 further stores a product master M, store map data S, customer data C, and order data R.
[0054] The product master M is a master file that stores product information such as product names, unit prices, etc., in association with product codes. The product master M is updated as needed according to the products that arrive at the store.
[0055] The in-store map data S is information including the layout of the store and the layout positions of products (shelf allocation data). The store layout is so-called map data that includes the positions and shapes of the aisles in the store. The layout position of a product is information that associates the coordinate position where the product is placed with the product information of the product (e.g., product code). The format of the in-store map data S is not important, but for example, a format similar to that of road maps used in car navigation systems (data that represents aisles with links and nodes) is used.
[0056] The customer data C is pre-registered data including a customer's identification number and the like.
[0057] The order data R is order information including the customer's identification number, and the product name and quantity to be purchased. The method of acquiring the order data R is not important. That is, the server device 50 may acquire the order data R from the customer's smartphone via the Internet 72, or may acquire the order data R from the customer's personal computer via the Internet 72. The server device 50 may also acquire the order data R that a customer visiting the store inputs using the touch panel 56 while looking at the display device 55 of the server device 50.
[0058] The input / output controller 54 connects the control unit 51 with a display device 55 and a touch panel 56, which are input / output devices.
[0059] The display device 55 displays various information output by the server device 50. The display device 55 is, for example, a liquid crystal display or an organic EL display.
[0060] The touch panel 56 is disposed so as to be superimposed on the display surface of the display device 55, and inputs operation information to the server device 50 according to the position where the touch panel 56 is pressed.
[0061] The communication interface 57 transmits and receives various information between the server device 50 and the cart 20 via the wireless communication unit 60. The communication interface 57 also transmits and receives various information to and from the mobile terminal .
[0062] (Cart hardware configuration) Next, the hardware configuration of the cart 20 will be described with reference to Fig. 7. Fig. 7 is a hardware block diagram showing an example of the hardware configuration of the cart.
[0063] The cart 20 includes a control unit 41 , a memory unit 42 , an input / output controller 44 , and a communication interface 45 .
[0064] The control unit 41 has a typical computer configuration including a CPU 411, a ROM 412, and a RAM 413. The CPU 411 reads out various programs, data files, etc. stored in the ROM 412 and a storage unit 42 (described later), and loads them in the RAM 413. The CPU 411 controls the entire cart 20 by operating in accordance with the various programs, data files, etc. loaded in the RAM 413.
[0065] The control unit 41 is connected to a storage unit 42 , an input / output controller 44 , and a communication interface 45 via an internal bus 43 .
[0066] The storage unit 42 retains stored information even when the power is turned off. The storage unit 42 is, for example, a HDD. Instead of the HDD, a non-volatile memory such as a flash memory may be provided. The storage unit 42 stores programs including a control program P. The control program P is a program for implementing the functions of the cart 20.
[0067] The control program P may be provided by being pre-installed in the ROM 412. The control program P may also be provided by being recorded in a computer-readable recording medium such as a CD-ROM, a flexible disk, a CD-R, or a DVD as a file in a format that can be installed in the control unit 41 or in a format that can be executed. Furthermore, the control program P may be provided by being stored on a computer connected to a network such as the Internet and downloaded via the network. The control program P may also be provided or distributed via a network such as the Internet.
[0068] The storage unit 42 further stores product pickup information T. The product pickup information T includes product information and the number of products to be picked up, which are transmitted from the server device 50. Note that the storage unit 42 may store, in addition to the product pickup information T, route information (pickup route information 83) indicating a travel route for picking up the products.
[0069] The input / output controller 44 connects the control unit 41 with the display device 26, which is an input / output device, the touch panel 27, the camera 28, the lighting LEDs 29, the guide lights 30, and the GPS receiver 32.
[0070] The display device 26 displays various information (for example, the product list and the store map shown in FIG. 5) output by the cart 20. The display device 26 is, for example, a liquid crystal display or an organic EL display.
[0071] The touch panel 27 is disposed so as to be superimposed on the display surface of the display device 26, and inputs operation information to the cart 20 according to a pressed position.
[0072] As described above (see FIG. 2), a plurality of cameras 28 are installed on container installation frames 24, 25 to capture images of products to be inserted. Cameras 28 are cameras using solid-state imaging elements such as CCD (Charge Coupled Device) and CMOS (Complementary Metal Oxide Semiconductor).
[0073] The illumination LED 29 is installed near the camera 28 and illuminates at least the range of the viewing angle θ of the camera 28 .
[0074] The guide lights 30 are installed on the container installation frames 24, 25, and as described above (see FIG. 2), are indicators that show the insertion position of the next commodity to be picked.
[0075] The GPS receiver 32 is a receiver that receives a GPS signal. The cart 20 determines its current position based on the GPS signal received by the GPS receiver 32.
[0076] The communication interface 45 transmits and receives various information to and from the server device 50 .
[0077] (Server device functional configuration) Next, the functional configuration of the server device 50 will be described with reference to Fig. 8. Fig. 8 is a functional block diagram showing an example of the functional configuration of the server device.
[0078] The control unit 51 of the server device 50 loads the control program Q into the RAM 513 and runs it to control an order receiving unit 521 and a product pick-up information generating unit 522 shown in FIG. 522 A pickup route information generating unit 523, an information transmitting unit 524, a picking progress status acquiring unit 525, a display control unit 526, and an operation control unit 527 are realized as functional units.
[0079] The order receiving unit 521 receives order information, such as customer information who has ordered a product and information on the product to be picked up and the number of products, from the mobile terminal 70. The order receiving unit 521 may receive order information input by a customer who visits the store by operating the touch panel 56 of the server device 50.
[0080] Product Pickup Information Generation Unit 522 Based on the order information acquired by the order receiving unit 521, the order receiving unit 522 generates product pick-up information T including the products to be picked up and the number of products to be picked up.
[0081] The pickup route information generating unit 523 generates the pickup route information 83 described with reference to FIG. 5, which is used to move in order to pick up all of the products included in the order information.
[0082] The information transmission unit 524 is a product pick-up information generation unit 522The information transmitting unit 524 transmits the product pickup information T generated by the cart 20 and the pickup route information 83 generated by the pickup route information generating unit 523 to the cart 20. Since a plurality of carts 20 are generally prepared, the information transmitting unit 524 transmits an identification number that uniquely identifies the cart 20, the product pickup information T, and the pickup route information 83 to the cart 20. The information transmitting unit 524 also transmits information to the server device 50 indicating that pickup of all products has been completed.
[0083] The picking progress status acquisition unit 525 acquires from the cart 20 the picking progress status, that is, information identifying which of the products included in the order information have been picked and which have not been picked.
[0084] The display control unit 526 causes the display device 55 to display various pieces of information generated by the server device 50.
[0085] The operation control unit 527 controls the operation of the server device 50 based on operation information acquired from the touch panel 56 .
[0086] (Cart function configuration) Next, the functional configuration of the cart 20 will be described with reference to Fig. 9. Fig. 9 is a functional block diagram showing an example of the functional configuration of the cart.
[0087] The control unit 41 of the cart 20 deploys the control program P in the RAM 413 and operates it to realize, as functional units, a product pickup information acquisition unit 421, a pickup route information acquisition unit 422, a container setting reception unit 423, a positioning processing unit 424, a product insertion detection unit 425, a picking progress status confirmation unit 426, a display control unit 427, and an operation control unit 428 shown in FIG. 9.
[0088] The product pickup information acquisition unit 421 acquires, from the server device 50, information on the customer who ordered the product and the product to be picked up and the number of the product, i.e., product pickup information T. Note that the product pickup information acquisition unit 421 is an example of an acquisition unit in this disclosure.
[0089] The pickup route information acquisition unit 422 acquires the pickup route information 83 generated by the pickup route information generation unit 523 from the server device 50 .
[0090] The container setting reception unit 423 receives information indicating which of the multiple storage compartments (bags 311, 312 and baskets 313, 314) of the cart 20 should be filled with the product ordered by which customer. The specific storage location is set by the store clerk (picker) who carries the cart 20 pointing to the storage location on the touch panel 27 while looking at a picture (not shown) showing the layout of the storage compartments displayed on the display device 26.
[0091] The positioning processing unit 424 measures the current position of the cart 20. Note that the positioning processing unit 424 is an example of a positioning unit in this disclosure.
[0092] The product insertion detection unit 425 detects that the picked up product has been inserted into the storage unit and the product information of the inserted product based on the captured images of the bags 311, 312 and the baskets 313, 314 (storage units). Note that the product insertion detection unit 425 is an example of a detection unit in the present disclosure.
[0093] The picking progress status confirmation unit 426 checks how much picking has been completed by referring to the product pickup information T and the detection result of the product insertion detection unit 425.
[0094] The display control unit 427 distinguishes between products that have been picked up, products to be picked up next, and products that have not been picked up and displays them on the display device 26. The display control unit 427 also displays the pickup route information 83 and information indicating the position of the product to be picked up on the display device 26. The display control unit 427 also controls the turning on and off of the guide light 301. The display control unit 427 is an example of a display unit in the present disclosure.
[0095] The operation control unit 428 controls the operation of the cart 20 based on operation information acquired from the touch panel 27 .
[0096] (Flow of processing performed by the product pickup system) Next, a flow of processing performed by the product pickup system 10 will be described with reference to Fig. 10. Fig. 10 is a flowchart showing an example of the flow of processing performed by the product pickup system according to the first embodiment.
[0097] (Processing flow performed by the server device) First, a description will be given of the flow of processing performed by the server device 50. The order receiving unit 521 receives a customer order from the mobile terminal 70, that is, order data R including the customer identification number and the product name and quantity to be purchased (step S11).
[0098] The product picking information generating unit 522 generates product picking information T (Step S12).
[0099] The pickup route information generating unit 523 generates pickup route information 83 indicating a route along which the customer should move to pick up the product (Step S13).
[0100] The information transmitting unit 524 transmits the product pick-up information T and the pick-up route information 83 to the cart 20 (step S14).
[0101] The picking progress status acquisition unit 525 determines whether picking up all the products has been completed (step S15). If it is determined that picking up all the products has been completed (step S15: Yes), the server device 50 ends the process in Fig. 10. On the other hand, if it is determined that picking up all the products has not been completed (step S15: No), the server device 50 repeats the determination in step S15.
[0102] (Processing flow of the cart) Next, a description will be given of the flow of processing performed by the cart 20. The product pick-up information acquisition unit 421 acquires the product pick-up information T from the server device 50. In addition, the pick-up route information acquisition unit 422 acquires the pick-up route information 83 from the server device 50 (Step S21).
[0103] The container setting reception unit 423 determines whether the container setting has been received (step S22). If it is determined that the container setting has been received (step S22: Yes), the process proceeds to step S23. On the other hand, if it is not determined that the container setting has been received (step S22: No), the determination in step S22 is repeated.
[0104] When it is determined in step S22 that the setting of the container has been accepted, the display control unit 427 displays a list of products to be picked up and a pick-up route on the display device 26 (step S23).
[0105] The positioning processing unit 424 measures the current position of the cart 20 (step S24).
[0106] The display control unit 427 displays the current position of the cart 20 on the display device 26 (step S25).
[0107] The display control unit 427 turns on the guide light 301 that indicates the insertion position of the next product to be picked up (step S26).
[0108] The product insertion detection unit 425 performs a product insertion detection process to determine into which of the storage units 31 (the bags 311, 312 and the baskets 313, 314) the product has been inserted and to identify the inserted product (step S27). The detailed flow of the product insertion detection process will be described later (see FIG. 11).
[0109] The product insertion detection unit 425 determines whether the insertion of a product has been detected (step S28). If it is determined that the insertion of a product has been detected (step S28: Yes), the process proceeds to step S29. On the other hand, if it is determined that the insertion of a product has not been detected (step S28: No), the process returns to step S24.
[0110] When it is determined in step S28 that the insertion of a product has been detected, the product insertion detection unit 425 determines whether the correct product has been inserted into the correct storage unit 31 (step S29). If it is determined that the correct product has been inserted into the correct storage unit 31 (step S29: Yes), the process proceeds to step S30. On the other hand, if it is not determined that the correct product has been inserted into the correct storage unit 31 (step S29: No), the process proceeds to step S31.
[0111] If it is determined in step S29 that the correct product has been placed in the correct storage section 31, the display control section 427 updates the product list and the pickup route displayed on the display device 26 (step S30).
[0112] The picking progress status confirmation unit 426 confirms whether all the products have been picked (step S32). If it is confirmed that all the products have been picked (step S32: Yes), the process proceeds to step S33. On the other hand, if it is not confirmed that all the products have been picked (step S32: No), the process returns to step S24 and repeats the above-mentioned process.
[0113] When it is confirmed in step S32 that all the products have been picked, the picking progress status confirmation unit 426 transmits information indicating that picking up of all the products has been completed to the server device 50 (step S33). After that, the cart 20 ends the process of FIG.
[0114] Returning to step S29, if it is not determined in step S29 that the correct product has been inserted into the correct storage section 31, the display control section 427 displays a warning on the display device 26 to prompt the user to check the insertion position and the inserted product (step S31). Then, the process returns to step S24.
[0115] (Product input detection process flow) Next, the flow of the product insertion detection process performed in step S27 of Fig. 10 will be described with reference to Fig. 11. Fig. 11 is a flow chart showing an example of the flow of the process performed by the product insertion detection unit included in the cart.
[0116] The product insertion detection unit 425 captures an image by the camera 28 (step S41).
[0117] The product insertion detection unit 425 determines whether or not there is a moving object in the image captured by the camera 28 (step S42). If it is determined that there is a moving object in the image captured by the camera 28 (step S42: Yes), the process proceeds to step S43. On the other hand, if it is not determined that there is a moving object in the image captured by the camera 28 (step S42: No), the process returns to the main routine (the flow chart in FIG. 10).
[0118] In step S42, when it is determined that a moving object is present in the image captured by the camera 28, the merchandise insertion detection unit 425 executes an object recognition process on the image I(t+Δt) (step S43).
[0119] Next, the product insertion detection unit 425 judges whether the product has been specified. If it is judged that the product has been specified (step S44: Yes), the process returns to the main routine. On the other hand, if it is not judged that the product has been specified (step S44: No), the process proceeds to step S45.
[0120] If it is determined in step S44 that the product has not been specified, the product insertion detection unit 425 determines whether a code symbol has been detected in the image I(t+Δt) (step S45). If it is determined that a code symbol has been detected in the image I(t+Δt) (step S45: Yes), the process proceeds to step S46. On the other hand, if it is not determined that a code symbol has been detected in the image I(t+Δt) (step S45: No), the process returns to the main routine.
[0121] In step S45, when it is determined that the code symbol is detected from the image I(t+Δt), the product insertion detection unit 425 reads the code information recorded in the detected code symbol (step S46), and then returns to the main routine.
[0122] As described above, in the cart 20 (product pick-up device) of the first embodiment, the product pick-up information acquisition unit 421 (acquisition unit) acquires information on the products to be picked up and the number of products. The product insertion detection unit 425 (detection unit) detects that the picked-up products have been inserted into the storage unit 31 and the product information of the inserted products based on an image of the storage unit 31. Then, the display control unit 427 (display unit) distinguishes and displays the products that have been picked up, the next product to be picked up, and the products that have not been picked up. Therefore, it can be reliably recognized that the ordered products have been picked up.
[0123] In the cart 20 of the first embodiment, the storage unit 31 includes a plurality of bags 311, 312 (containers) and a plurality of baskets 313, 314 (containers) for storing products classified by order, the product pickup information acquisition unit 421 (acquisition unit) acquires information on the products to be picked up and their number for each container, and the product insertion detection unit 425 (detection unit) detects that the picked up products have been inserted into the correct container and the product information of the inserted products. Therefore, the container into which the picked up products have been inserted can be identified and recognized.
[0124] Moreover, the cart 20 of the first embodiment further includes a positioning processing unit 424 (positioning unit) that measures the current position of the cart 20, and a product pick-up information acquisition unit 421 (acquisition unit) acquires pick-up route information 83 (route information) along which the cart 20 moves to pick up all products, and a display control unit 427 (display unit) displays the current position of the cart 20 measured by the positioning processing unit 424 and the pick-up route information 83 acquired by the product pick-up information acquisition unit 421. Therefore, by picking up products while moving along the pick-up route information 83, all products can be picked up efficiently.
[0125] In the cart 20 of the first embodiment, the product insertion detection unit 425 (detection unit) detects that a picked-up product has been inserted into the storage unit 31 and detects a feature that identifies the product or a code symbol attached to the product from a plurality of images captured in time series by a plurality of cameras 28 (imaging devices) provided on the outer edge of the storage unit 31 facing inward of the storage unit 31. Therefore, by monitoring the insertion of products from a plurality of different directions, if the product is captured in an image captured from at least one direction, the product can be recognized. Therefore, the insertion of the product and the type of product can be reliably recognized regardless of how the product is held.
[0126] In the product pickup system 10 of the first embodiment, the server device 50 receives a product order, generates information on the products to be picked up and the number of products, and transmits the information to the cart 20. The cart 20 (product pickup device) obtains the information on the products to be picked up and the number of products from the server device 50, and detects that the picked up products have been put into the storage unit 31 and the product information of the put-in products based on an image of the storage unit 31 that stores the picked up products, and distinguishes and displays the products that have been picked up, the next product to be picked up, and the products that have not been picked up. Therefore, it is possible to reliably recognize that the ordered products have been picked up.
[0127] (Second embodiment) Next, a product pickup system 100 (not shown) according to a second embodiment of the present invention will be described. The product pickup system 100 includes a server device 500 and a cart 200 instead of the server device 50 and the cart 20 described in the first embodiment. In addition to the functions of the product pickup system 10, the product pickup system 100 includes a function of sending a photo of a picked-up product for which a customer has requested that a photo be sent.
[0128] The hardware configuration of the server device 500 is the same as the hardware configuration of the server device 50 described in the first embodiment (see FIG. 6). The hardware configuration of the cart 200 is the same as the hardware configuration of the cart 20 described in the first embodiment (see FIG. 7). Therefore, the following description will use the same reference numerals as those used in the first embodiment.
[0129] 12 is a diagram for explaining the product image sending function provided in the cart of the second embodiment. When a customer orders a product, if the customer wishes to have a photo of the product sent, the customer attaches the information to that effect. The server device 500 accepts the customer's order and generates product pickup information T for the product for which the customer wishes to have a photo sent, with information indicating that the photo needs to be sent.
[0130] When the cart 200 displays a list of products to be picked up on the display device 26, products for which photos need to be sent are displayed with a photo icon 90 shown in FIG.
[0131] Then, when the cart 200 detects that a product with a photo icon 90 attached has been placed in the storage section 31, it displays the captured image 92 on the display device 26 and also displays a message 93 indicating that the photo has been sent to the customer. After that, the cart 200 changes the display form of the photo icon 90 displayed on the display device 26 to a photo sent icon 91 indicating that the sending of the photo has been completed.
[0132] The cart 200 is provided with four cameras 28 for each storage section 31. Therefore, the cameras 28 can capture images of one product from four directions. Therefore, for a product that requires a photo to be sent, the cart 200 selects the image that best shows the product from among the images captured from the four directions and transmits it to the customer.
[0133] (Server device functional configuration) Next, the functional configuration of the server device 500 will be described with reference to Fig. 13. Fig. 13 is a functional block diagram showing an example of the functional configuration of the server device according to the second embodiment.
[0134] The control unit 51 of the server device 500 loads the control program Q in the RAM 513 and runs it to realize each of the functional units shown in FIG. 13. More specifically, the control unit 51 of the server device 500 implements an order receiving unit 528 and a product pickup information generating unit 522 The pick-up route information generating unit 523, the information transmitting unit 524, the picking progress status acquiring unit 525, the product image receiving unit 529, the product image transmitting unit 530, the display control unit 526, and the operation control unit 527 are realized as functional units. 522 The pickup route information generation unit 523, the information transmission unit 524, the picking progress status acquisition unit 525, the display control unit 526, and the operation control unit 527 realize the same functions as the functional units of the server device 50 described in the first embodiment.
[0135] The control unit 51 of the server device 500 includes an order receiving unit 528 in place of the order receiving unit 521. The order receiving unit 528 acquires, from the mobile terminal 70, information on the customer who has ordered the product, information on the product to be picked up and the number of products, i.e., order information, and information designating the product for which an image is desired to be sent.
[0136] The product image receiving unit 529 receives from the cart 200 an image of the product designated by the customer and information (eg, a product code) that uniquely identifies the product shown in the image.
[0137] The product image transmission unit 530 transmits an image of the product specified by the customer to the mobile terminal 70 of the customer.
[0138] (Cart function configuration) Next, the functional configuration of the cart 200 will be described with reference to Fig. 14. Fig. 14 is a functional block diagram showing an example of the functional configuration of the cart according to the second embodiment.
[0139] The control unit 41 of the cart 200 realizes each functional unit shown in Fig. 14 by expanding the control program P in the RAM 413 and running it. More specifically, the control unit 41 of the cart 200 realizes, as functional units, a product pickup information acquisition unit 421, a pickup path information acquisition unit 422, a container setting reception unit 423, a positioning processing unit 424, a product insertion detection unit 425, a product image selection unit 430, a product image transmission unit 431, a picking progress status confirmation unit 426, a display control unit 427, and an operation control unit 428. Among these, the product pickup information acquisition unit 421, the pickup path information acquisition unit 422, the container setting reception unit 423, the positioning processing unit 424, the product insertion detection unit 425, the picking progress status confirmation unit 426, the display control unit 427, and the operation control unit 428 realize the same actions as the functional units provided in the cart 20 described in the first embodiment.
[0140] The product image selection unit 430 selects an image to be sent to the customer from among images of the product specified by the customer. For example, the product image selection unit 430 selects an image in which the product is best shown from among images of the product taken from multiple directions by the product insertion detection unit 425. The image in which the product is best shown is selected based on an evaluation criterion such as the product being shown largest, the product being shown brightest, the product being shown most clearly, or the like.
[0141] The product image transmission unit 431 transmits the image selected by the product image selection unit 430 to the server device 500 together with information (eg, a product code) that uniquely identifies the product shown in the image.
[0142] (Flow of processing performed by the product pickup system) Next, a flow of processes performed by the product pickup system 100 will be described with reference to Fig. 15. Fig. 15 is a flow chart showing an example of a flow of processes performed by the product pickup system according to the second embodiment.
[0143] (Processing flow performed by the server device) First, a description will be given of the flow of processing performed by the server device 500. The order receiving unit 528 receives a customer order from the mobile terminal 70, that is, order data R including the customer's identification number, the product name and the quantity to be purchased, and information specifying the product for which an image is desired to be sent (step S51).
[0144] The product pickup information generating unit 522 generates product pickup information T (Step S52). The product pickup information T includes product information and the number of products to be picked up, and information specifying a product for which an image is desired to be sent.
[0145] The pickup route information generating unit 523 generates pickup route information 83 indicating a route along which the customer should move to pick up the product (Step S53).
[0146] The information transmitting unit 524 transmits the product pick-up information T and the pick-up route information 83 to the cart 200 (step S54).
[0147] The product image receiving unit 529 determines whether an image of the product specified by the customer has been received from the cart 200 (step S55). If it is determined that an image of the product specified by the customer has been received (step S55: Yes), the process proceeds to step S56. On the other hand, if it is determined that an image of the product specified by the customer has not been received (step S55: No), the process proceeds to step S57.
[0148] If it is determined in step S55 that an image of the product specified by the customer has been received, the product image transmitting unit 530 transmits the received image to the mobile terminal 70 of the customer (step S56).
[0149] The picking progress status acquisition unit 525 determines whether picking up all the products has been completed (step S57). If it is determined that picking up all the products has been completed (step S57: Yes), the server device 500 ends the process in Fig. 15. On the other hand, if it is determined that picking up all the products has not been completed (step S57: No), the process returns to step S55.
[0150] (Processing flow of the cart) Next, the flow of the process performed by the cart 200 will be described. The product pickup information acquisition unit 421 acquires product pickup information T from the server device 500. The product pickup information T includes product information and the number of products to be picked up, and information specifying the product for which an image is desired to be sent. The pickup route information acquisition unit 422 acquires pickup route information 83 from the server device 500 (step S61).
[0151] The process flow from step S62 to step S66 is the same as the process flow from step S22 to step S26 described with reference to FIG. 10, and therefore will not be described.
[0152] Next, the product insertion detection unit 425 and the product image selection unit 430 perform a product insertion detection process (step S67) to determine into which of the storage units 31 (the bags 311, 312 and the baskets 313, 314) the product has been inserted, to identify the inserted product, and to select an image to be sent to the customer. The detailed flow of the product insertion detection process will be described later (see FIG. 16).
[0153] The processes of steps S68, S69, S70, and S71 performed thereafter are the same as the processes of steps S28, S29, S30, and S31 described with reference to FIG. 10, respectively, and therefore will not be described.
[0154] Following step S69, the product image transmission unit 431 determines whether there are images to be sent to the customer (step S72). If it is determined that there are images to be sent to the customer (step S72: Yes), the process proceeds to step S73. On the other hand, if it is not determined that there are images to be sent to the customer (step S72: No), the process proceeds to step S74.
[0155] If it is determined in step S72 that there is an image to be transmitted to the customer, the product image transmission unit 431 transmits the image of the product to the server device 500 (step S73).
[0156] Thereafter, the picking progress status confirmation unit 426 confirms whether all the products have been picked (step S74). If it is confirmed that all the products have been picked (step S74: Yes), the process proceeds to step S75. On the other hand, if it is not confirmed that all the products have been picked (step S74: No), the process returns to step S64 and repeats the above-mentioned process.
[0157] When it is confirmed in step S74 that all the products have been picked, the picking progress status confirmation unit 426 transmits information indicating that picking up of all the products has been completed to the server device 50 (step S75). After that, the cart 200 ends the process of FIG.
[0158] (Product input detection process flow) Next, a flow of the product insertion detection process performed in step S68 of Fig. 15 will be described with reference to Fig. 16. Fig. 16 is a flowchart showing an example of the flow of the process performed by a product insertion detection unit and a product image selection unit included in the cart.
[0159] The processes from step S81 to step S86 in FIG. 16 are the same as the processes from step S41 to step S46 described in FIG. 11, respectively, and therefore will not be described.
[0160] If it is determined that the product has been specified in step S44, or following step S86, the product image transmission unit 431 determines whether the specified product is a product for which an image should be sent to the customer (step S87). If it is determined that the product is a product for which an image should be sent to the customer (step S87: Yes), the process proceeds to step S88. On the other hand, if it is not determined that the product is a product for which an image should be sent to the customer (step S87: No), the process returns to the main routine (the flow chart in FIG. 15).
[0161] In step S87, when it is determined that the image of the product should be sent to the customer, the product image selection unit 430 selects an image to be sent to the server device 500 from the images captured from multiple directions by the product insertion detection unit 425 (step S88). After that, the process returns to the main routine (the flow chart in FIG. 15).
[0162] As described above, in the cart 200 (product pickup device) of the second embodiment, the product insertion detection unit 425 (detection unit) detects that a product has been inserted into the storage unit 31 and detects product information of the inserted product based on images of the storage unit 31 captured from different directions. Then, the product image selection unit 430 selects an image that best shows the product from among the multiple images captured from different directions. Then, the product image transmission unit 431 transmits the image selected by the product image selection unit 430 and information that uniquely identifies the product shown in the image to the server device 500. Therefore, an image of the picked up product can be transmitted to the customer who ordered the product, so that the customer can check in advance the product that will be delivered to him or her.
[0163] Although the embodiment of the present invention has been described above, this embodiment is merely an example and is not intended to limit the scope of the invention. This novel embodiment can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]
[0164] 10,100...Product pickup system, 20,200...Cart (product pickup device), 26...Display device, 28,281,282,283,284...Camera (imaging device), 29,291,292,293,294...Lighting LED, 30,301,302,303,304...Guide light, 31...Storage section, 34,341,342,343,344...Product list, 35...Order number, 37,38,39 ...Picking status, 50,500...Server device, 60...Wireless communication unit, 70...Mobile terminal, 72...Internet, 73...Fresh food products, 74...Products, 75...Barcode, 80...Store map, 83...Pickup route information (route information), 84, 85, 86...Number of products, 87...Rush-up shelf, 88...Current time, 311,312...Bag (container, storage section), 313,314...Basket (container, storage section) , 421... product pickup information acquisition unit (acquisition unit), 422... pickup route information acquisition unit, 423... container setting reception unit, 424... positioning processing unit (positioning unit), 425... product insertion detection unit (detection unit), 426... picking progress status confirmation unit, 427... display control unit (display unit), 428... operation control unit, 430... product image selection unit, 431... product image transmission unit, 521, 528... order reception unit, 522... product pickup information Generation unit, 523...pickup route information generation unit, 524...information transmission unit, 525...picking progress status acquisition unit, 526...display control unit, 527...operation control unit, 529...product image receiving unit, 530...product image transmission unit, I(t), I(t+Δt)...image, J(t+Δt)...difference image, C...customer data, M...product master, P, Q...control program, R...order data, S...in-store map data, T...product pickup information [Prior art documents] [Patent documents]
[0165] [Patent Document 1] JP 2020-152534 A
Claims
1. A product pickup device having a storage unit with a plurality of containers for storing picked-up products according to order, A positioning unit that measures a current position of the product pickup device; An acquisition unit that acquires information on the products to be picked up and the number of products for each container, and acquires route information for moving to pick up all the products; a detection unit that detects, based on an image of the storage unit, whether the picked-up product has been placed in the correct container and product information of the placed product; a display unit that turns on the guide light installed in the container into which the next product to be picked up is to be put, among the guide lights installed in each of the plurality of containers, before picking up the product, and that distinguishes and displays the current location, the route information, the product that has been picked up, the product that will be picked up next, and the product that has not been picked up; A product pick-up device comprising:
2. The detection unit is a plurality of image capturing devices provided on the outer edge of the storage unit facing inward of the storage unit detect, from a plurality of images captured in time series, that a picked-up product has been placed in the storage unit and a feature that identifies the product or a code symbol affixed to the product; The product pick-up device according to claim 1 .
3. a server device that receives an order for a product, generates information on the products to be picked up and the number of products, and route information for picking up all the products, and transmits the information to the product pickup device; a product pickup device which acquires from the server device information relating to the products to be picked up and the number of products for each of a plurality of containers which it has and which store the products classified by order, detects that the picked up products have been placed in the correct container and product information for the placed products based on an image of a storage unit which has a plurality of the containers, turns on an information light installed in the container into which the next product to be picked up will be placed among the information lights installed in each of the plurality of containers before picking up the product, and identifies and displays the current position of the product pickup device, the route information, products which have been picked up, the next product to be picked up, and products which have not been picked up; A product pickup system comprising:
Citation Information
Patent Citations
Picking device
JP1995285622A
Picking system
JP1999043211A
Article managing device, article conveying device, and system and method for processing article
JP2010280468A
Sorting method, program of sorting method, and sorting system
JP2014088234A
Sorting device
JP2020152534A
