Control method, program, delivery system, and display cabinet
By using display devices and sensors in the delivery system to display the bottom image of the product, combined with the three-dimensional data in the robotic arm and the database, the problem of product placement position identification in the automated delivery system is solved, and efficient and accurate product loading is achieved Set up and operate.
Patent Information
- Application Number
- CN202380034679.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-04-19
- Filing Date
- 2023-04-19
- Publication Date
- 2024-11-26
AI Technical Summary
There is room for improvement in the existing heating chambers to identify and guide the optimal placement of foods, especially in automated shipping systems, where it is difficult to accurately identify and place the location of goods.
By using display devices and sensors in the delivery system, the ID of the product is obtained and its bottom image is obtained from the database, the display device is controlled to display the image to guide the placement position of the product, and the product is determined using the robotic arm and three-dimensional data in the database. and ensure accurate loading through speaker and image feedback.
It improves the accuracy and efficiency of commodity loading, reduces labor costs and energy consumption, and realizes the efficient operation of an automated shipping system.
Smart Images

Figure CN119032369A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to a control method, a program, a delivery system and a display cabinet. Background Art
[0002] Patent Document 1 discloses a heating chamber in which a guide mark indicating an optimal placement position for food is formed on the bottom surface of the heating chamber by light from a light emitting unit.
[0003] (Prior art literature)
[0004] (Patent Document)
[0005] Patent Document 1: Japanese Patent No. 6746332 Summary of the invention
[0006] Problems to be solved by the invention
[0007] However, there is room for improvement in the heating chamber of Patent Document 1 described above.
[0008] Therefore, the present disclosure provides a control method and the like that are further improved compared to the related art.
[0009] Means for solving problems
[0010] A control method involved in one embodiment of the present disclosure is a control method in a delivery system including a display device. In the control method, a first product ID for identifying a first product is obtained based on sensing data obtained from a sensor, a first bottom surface image showing the shape of the bottom surface of the first product is obtained based on a first database and the obtained first product ID, the first database associates the product ID with an image showing the shape of the bottom surface of the product corresponding to the product ID to manage them, and the display device is controlled so that the first bottom surface image is displayed in a loading area for loading the first product.
[0011] Furthermore, these general or specific aspects may be realized by an integrated circuit, a computer program, or a computer-readable recording medium such as a CD-ROM, or may be realized by any combination of these.
[0012] Effects of the Invention
[0013] Further improvements can be expected for the control method and the like disclosed herein. BRIEF DESCRIPTION OF THE DRAWINGS
[0014] Figure 1 This is a diagram showing an example of a delivery system according to an embodiment.
[0015] Figure 2This is a diagram showing an example of a state where a first product that has been received is placed on a display device and displayed on a multi-storey cabinet in the delivery system according to the embodiment.
[0016] Figure 3 This is a block diagram illustrating a delivery system according to an embodiment.
[0017] Figure 4 This is a flowchart showing an operation example 1 of the delivery system according to the embodiment.
[0018] Figure 5 This is a flowchart showing an operation example 2 of the delivery system according to the embodiment.
[0019] Figure 6 This is a flowchart showing operation example 3 of the delivery system according to the embodiment.
[0020] Figure 7 This is a flowchart showing an operation example 4 of the delivery system according to the embodiment.
[0021] Figure 8 This is a flowchart showing an operation example 5 of the delivery system according to the embodiment.
[0022] Fig.9A This is a diagram illustrating a delivery system according to Modification 1 of the embodiment.
[0023] Fig. 9B This is a block diagram illustrating a delivery system according to Modification 1 of the embodiment.
[0024] Fig. 10A This is a diagram illustrating a delivery system according to Modification 2 of the embodiment.
[0025] Fig. 10B This is a diagram illustrating a delivery system according to Modification 3 of the embodiment. DETAILED DESCRIPTION
[0026] In addition, these general or specific forms can be implemented by systems, methods, integrated circuits, computer programs, or computer-readable recording media such as CD-ROMs, or by any combination of systems, methods, integrated circuits, computer programs, or recording media.
[0027] In addition, the embodiments to be described below are all general or specific examples. The values, shapes, materials, components, configuration positions of components, connection methods, steps, and order of steps shown in the following embodiments are all examples, and their purpose is not to limit the present disclosure. Among the components of the following embodiments, the components that are not recorded in the independent technical solutions are described as arbitrary components.
[0028] The embodiments will be described in detail below with reference to the drawings.
[0029] (Implementation Method)
[0030] The following use Figures 1 to 3 The delivery system 2600 in this embodiment is described.
[0031] Figure 1 This is a diagram showing an example of a delivery system 2600 according to an embodiment. Figure 2 2 is a diagram showing an example of a first commodity being placed on a display device 2610 and displayed on a multi-storey cabinet in a delivery system 2600 according to an embodiment. Figure 2 The dotted line represents the movable range of the robot arm 2620. Figure 3 This is a block diagram illustrating a delivery system 2600 according to an embodiment.
[0032] like Figures 1 to 3 As shown, the delivery system 2600 is used, for example, in the following situations: when a user orders a first commodity through a terminal device, order information indicating the ordered first commodity is obtained, the first commodity indicated by the obtained order information is shipped (picked), or the first commodity received is displayed in a multi-layer cabinet for shipment. Therefore, in the delivery system 2600, the first commodity ordered by the user is received in advance and displayed in a multi-layer cabinet, and the first commodity ordered by the user is delivered by an unmanned aerial vehicle, a cargo handling device, etc.
[0033] Specifically, in a store that displays and delivers the first commodity, the first commodity delivered to the store and taken out from the delivery cabinet, i.e., the first commodity received, can be automatically displayed in the multi-layer cabinet by using the robot arm 2620 and the display device 2610, etc. The operator places the first commodity received on the display screen 2611 of the display device 2610, i.e., the loading area, so that in the delivery system 2600, the robot arm 2620 can lift the first commodity and display it at a specified position in the multi-layer cabinet. In addition, in the delivery system 2600, when the ordered first commodity is delivered, the robot arm 2620 takes the ordered first commodity out of the multi-layer cabinet and moves it to a cargo box for delivery. Accordingly, the operator can carry the first commodity moved to the cargo box and load the first commodity into the unmanned transport device, so that the unmanned transport device can deliver the first commodity to the user who has placed the order.
[0034] Such a delivery system 2600 includes a barcode reader 2605 , a data management unit 2606 , a display device 2610 , and a robot arm 2620 .
[0035] When the first commodity is received, the barcode reader 2605 can read the barcode marked on the first commodity received. The barcode reader 2605 can be used by an operator to read the barcode marked on the first commodity received, or can automatically read the barcode of the first commodity. The barcode reader 2605 outputs the read first commodity ID marked on the first commodity to the data management unit 2606. The barcode reader 2605 is an example of a sensor.
[0036] The data management unit 2606 holds information on all commodities that the user can order, that is, holds and manages the first database and the second database. The data management unit 2606 has a storage unit 2624 such as a memory, and the storage unit 2624 stores the first database and the second database.
[0037] The first database has a plurality of data that associates a product ID with a bottom surface image, and the plurality of data are listed to constitute the first database. The product ID is an ID for identifying a product, and the bottom surface image is an image showing the shape of the bottom surface of the product corresponding to the product ID. In addition, the first database has a plurality of data that associates a product ID with an appearance image, and the first database can also be constituted by a list of these plurality of data. The appearance image is an image showing the appearance of the product corresponding to the product ID. That is, the first database is, for example, a data table that associates at least the product ID with the bottom surface image among all the multiple products. In addition, the appearance image of the product can be an orthographic projection such as a plan view or a front view when looking down at the product from a vertical position, or can be a product image showing the appearance of the product.
[0038] The second database is composed of a list of product IDs and three-dimensional data of the products corresponding to the product IDs. The product ID is an ID for identifying the product. That is, the second database is a data table that associates the product IDs with the three-dimensional data of the products among all the products. Here, the three-dimensional data is the three-dimensional shape of the product, including the size and height of the product.
[0039] The data management unit 2606 can obtain the first commodity ID for identifying the first commodity based on the sensing data obtained from the barcode reader 2605. When the data management unit 2606 obtains the first commodity ID from the barcode reader 2605, it determines the first bottom surface image, the first appearance image, and the three-dimensional data corresponding to the obtained first commodity ID from the first database and the second database. Here, the first bottom surface image is an image showing the shape of the bottom surface of the first commodity, and is a bottom surface image corresponding to the first commodity ID among the multiple bottom surface images included in the first database. And, the first appearance image is an image showing the appearance shape of the first commodity, and is an appearance image corresponding to the first commodity ID among the multiple appearance images included in the first database. The three-dimensional data is the three-dimensional data of the first commodity, and is the three-dimensional data corresponding to the first commodity ID among the multiple three-dimensional data included in the first database.
[0040] The data management unit 2606 may output the determined first product ID and three-dimensional data to the robot arm 2620 , or may output the first bottom surface image and the first appearance image to the display device 2610 .
[0041] The display device 2610 is a display for displaying the first bottom image and the first appearance image of the first commodity on the display screen 2611. For example, in the case of a container such as a plastic bottle, if the first bottom image of the plastic bottle when placed upright is circular, the display device 2610 can display the first bottom image having the same shape and size as the bottom of the plastic bottle on the display screen 2611. After the barcode reader 2605 reads the first commodity ID of the first commodity, the display device 2610 displays the first bottom image and the first appearance image of the first commodity on the display screen 2611.
[0042] Specifically, the display device 2610 includes a display control unit 2612, and the display control unit 2612 controls the display screen 2611 to display the first bottom image and the first appearance image corresponding to the first commodity having the read first commodity ID. In addition, the display control unit 2612 may display only the first bottom image on the display screen 2611. In addition, the display control unit 2612 may not be mounted on the display device 2610, but may be another device different from the display device 2610.
[0043] More specifically, the display device 2610 can obtain the first bottom image of the first commodity based on the first database and the obtained first commodity ID. Accordingly, the display control unit 2612 of the display device 2610 can display the first bottom image in the placement area for placing the first commodity, that is, the display screen 2611. The placement area corresponds to the area in the display where the first bottom image is displayed, has the same size and shape as the display screen 2611, and is synonymous with the display screen 2611.
[0044] In addition, the display device 2610 may also include a touch screen, and the touch screen may be located in the placement area of the display screen 2611 where the image is displayed. In this case, it can be recognized that the first commodity is placed in the placement area. In addition, the display device 2610 may also be a projector for projecting the first bottom image onto a screen. In this case, the placement area corresponds to the area on the screen where the first bottom image is projected, and the area where the first bottom image is projected becomes the display screen 2611.
[0045] In addition, the display device 2610 can obtain an image showing the appearance of the first commodity, i.e., a first appearance image, based on the first database and the obtained first commodity ID. Accordingly, the display control unit 2612 of the display device 2610 can display the first appearance image while displaying the first bottom image in the placement area for placing the first commodity, i.e., the display screen 2611.
[0046] In this way, since the first bottom image of the first product can be displayed on the display screen 2611 of the display device 2610, or the first appearance image can be displayed on the display screen 2611 of the display device 2610, the operator can place the first product whose first product ID has been read to a position overlapping with the first position, which is the position where the first bottom image or the first appearance image on the display screen 2611 is displayed.
[0047] The display device 2610 further includes a position determination processing unit 2614, which determines whether the first product is correctly placed at the first position in the placement area where the first bottom surface image is displayed on the display screen 2611, when the first product is placed in the placement area. The position determination processing unit 2614 may not include the display device 2610, may be included in the components of the delivery system 2600, or may be another device different from the display device 2610.
[0048] When the position determination processing unit 2614 determines that the first product is correctly placed at the first position on the placement area, the display control unit 2612 controls the display screen 2611 to display an image showing that the first product is correctly placed at the first position on the display screen 2611. When the position determination processing unit 2614 determines that the first product is not correctly placed at the first position, the display control unit 2612 controls the display screen 2611 to display an image showing that the first product is not correctly placed at the first position on the display screen 2611.
[0049] Furthermore, the delivery system 2600 may also include a speaker 2633. In this case, when the position determination processing unit 2614 determines that the first product is correctly placed at the first position on the placement area, the speaker 2633 may be controlled to output a sound indicating that the first product is correctly placed at the first position. In addition, when the position determination processing unit 2614 determines that the first product is not correctly placed at the first position on the placement area, the speaker 2633 may be controlled to output a sound indicating that the first product is not correctly placed at the first position.
[0050] Furthermore, while an image showing that the first product is correctly placed is displayed on display screen 2611, a sound indicating that the first product is correctly placed is output from speaker 2633. Furthermore, while an image showing that the first product is not correctly placed is displayed on display screen 2611, a sound indicating that the first product is not correctly placed is output from speaker 2633.
[0051] Furthermore, the delivery system 2600 may further include a drop sensor 2631 for detecting the drop of the first commodity. In this case, the delivery system 2600 may further include a drop determination processing unit 2632 for determining whether the first commodity lifted by the robot arm 2620 has dropped based on the sensing data obtained from the drop sensor 2631. The drop sensor 2631 is an example of a sensor such as an infrared sensor or a camera sensor. Furthermore, the drop sensor 2631 may be provided in a store or in the robot arm 2620.
[0052] When the drop determination processing unit 2632 determines that the first product lifted by the robot arm 2620 has dropped, the display control unit 2612 may control the display screen 2611 to display an image showing that the first product has dropped on the display screen 2611. Furthermore, when the drop determination processing unit 2632 determines that the first product lifted by the robot arm 2620 has dropped, the speaker 2633 may output a sound indicating that the first product has dropped.
[0053] Furthermore, when the first product lifted by robot arm 2620 falls, an image showing that the first product has fallen may be displayed on display screen 2611 , and a sound indicating that the first product has fallen may be outputted from speaker 2633 .
[0054] Furthermore, the delivery system 2600 may also include a camera capable of outputting image information, which is information showing an image of the placement area and the first product placed in the placement area. In this case, the position determination processing unit 2614 may determine whether the first product is correctly placed in the first position based on the image information obtained from the camera.
[0055] When the position determination processing unit 2614 determines that the first product is correctly placed at the first position based on the image information, the display control unit 2612 may control the display screen 2611 to display an image showing that the first product is correctly placed at the first position on the display screen 2611. Furthermore, when the position determination processing unit 2614 determines that the first product is correctly placed at the first position based on the image information, the display control unit 2612 may control the display screen 2611 to display an image showing that the first product is not correctly placed at the first position on the display screen 2611. Furthermore, when the position determination processing unit 2614 determines that the first product is not correctly placed at the first position based on the image information, the display control unit 2612 may control the display screen 2611 to display an image showing that the first product is not correctly placed at the first position on the display screen 2611. Furthermore, when the position determination processing unit 2614 determines that the first product is not correctly placed at the first position based on the image information, the display control unit 2612 may control the display screen 2611 to display an image showing that the first product is not correctly placed at the first position on the display screen 2611.
[0056] Furthermore, when the first commodity is placed at the first position where the first bottom image is displayed on the display screen 2611, the display control unit 2612 outputs the first position information to the robot arm 2620, the first position information being information indicating the first position of the first bottom image in the display screen 2611, i.e., the placement area. The first position information is represented, for example, by the position coordinates of the first bottom image displayed on the placement area. The position coordinates are the same or substantially the same as the position coordinates of the commodity placed on the placement area. Furthermore, the first position information may further include information indicating the position where the first appearance image is displayed, i.e., position information.
[0057] The display device 2610 may further include a placement sensor 2613 for detecting placement of the first commodity at the first position where the first bottom image of the first commodity and the first appearance image of the first commodity are displayed on the display screen 2611. The placement sensor 2613 is, for example, a camera, a pressure sensor, or an infrared sensor, which is an example of a sensor. When the placement sensor 2613 detects that the first commodity is placed at the first position where the first bottom image of the first commodity and the first appearance image of the first commodity are displayed on the display screen 2611, the display control unit 2612 stops displaying the first bottom image of the first commodity and the first appearance image of the first commodity currently being displayed on the display screen 2611. The placement sensor 2613 is an example of a camera.
[0058] The robot arm 2620 is composed of a plurality of wrists and a plurality of joints (axes), etc., and can move freely, and can lift and move the first commodity. That is, the robot arm 2620 can move the first commodity placed in the placing area of the display device 2610 and display it in the multi-layer cabinet, and can move the first commodity displayed in the multi-layer cabinet to the cargo box.
[0059] Specifically, the robot arm 2620 includes a displacement unit 2622 , a first actuator 2621 , an arm control unit 2623 , and a storage unit 2624 .
[0060] The displacement unit 2622 is driven by the first actuator 2621 to lift the first commodity that is the object and change the position of the first commodity. The first commodity is one or more first commodities placed in the placement area. The displacement unit 2622 includes a holding unit, an adsorption unit, or a magnetic unit. The holding unit can hold the first commodity by clamping it, the adsorption unit can hold the first commodity by adsorbing it by sucking out air, and the magnetic unit can hold the first commodity by attracting it by magnetic force. Figure 2 The example of the displacement unit 2622 is shown as an example, that is, the case of using the gripping unit is shown. Here, the object refers to the commodity that becomes the object of the displacement unit 2622 to lift the commodity.
[0061] The displacement unit 2622 can move the first commodity arranged in the loading area of the display device 2610 into the multi-layer cabinet and display it in the multi-layer cabinet. In addition, the displacement unit 2622 can move the first commodity displayed in the multi-layer cabinet to the cargo box by lifting the first commodity.
[0062] The first actuator 2621 can drive the displacement unit 2622 by being controlled by the arm control unit 2623. For example, the first actuator 2621 can move the first product by causing the displacement unit 2622 to lift the first product placed in the placement area of the display device 2610 under the control of the arm control unit 2623.
[0063] The arm control unit 2623 can control the driving of the first actuator 2621. The arm control unit 2623 controls the first actuator 2621 to cause the displacement unit 2622 to lift the first commodity. Specifically, the arm control unit 2623 controls the first actuator 2621 using the second database, the first commodity ID, and the first position information indicating the first position where the first bottom surface image in the placement area is displayed, and determines the method for the displacement unit 2622 to lift the first commodity.
[0064] Here, the method for the arm control unit 2623 to determine the method for lifting the first commodity includes the arm control unit 2623 determining the first portion, which is the portion for the displacement unit 2622 to lift the first commodity. Specifically, after the first commodity is placed at the first position in the placement area, the arm control unit 2623 controls the first actuator 2621 to connect the first portion of the first commodity on the placement area to the displacement unit 2622. That is, the arm control unit 2623 determines which portion of the first commodity is connected in order to connect the first commodity to the displacement unit 2622 to move. Accordingly, after the displacement unit 2622 lifts the first commodity, even if the first commodity is moved, the first commodity is unlikely to fall from the displacement unit 2622.
[0065] After the first commodity is placed at the first position in the loading area, the arm control unit 2623 controls the first actuator 2621 to cause the displacement unit 2622 to lift the first commodity on the loading area in a determined manner, and move the first commodity into the multi-layer cabinet for display.
[0066] Furthermore, the arm control unit 2623 can associate the first commodity ID with the configuration position of each first commodity stored in the multi-layer cabinet and store it in the storage unit 2624 when the robot arm 2620 stores the first commodity in the specified configuration position in the multi-layer cabinet according to the information related to the multi-layer cabinet stored in the storage unit 2624 of the robot arm 2620, the control instruction of the first actuator 2621, etc. The information related to the multi-layer cabinet is information showing the number of shelves in the multi-layer cabinet, the height of each shelf, the position of each shelf, the storage space of each shelf, the distance from the robot arm 2620 to each shelf, etc. Accordingly, since the position of each first commodity displayed in the multi-layer cabinet is stored in the storage unit 2624, the robot arm 2620 can grab the first commodity of the first commodity ID shown in the order information from the multi-layer cabinet and move it to the cargo box without carrying a camera sensor, etc. Accordingly, the first commodity shown in the order information can be shipped.
[0067] [Working Example 1]
[0068] In this working example, we use Figure 4The following describes the operation from reading the first commodity ID of the first commodity received to displaying it in the multi-storey cabinet.
[0069] Figure 4 This is a flowchart showing an operation example 1 of the delivery system 2600 according to the embodiment.
[0070] first, Figure 4 As shown, when the first commodity is received, the barcode reader 2605 reads the barcode attached to the nth first commodity received ( S2601 ). The barcode reader 2605 outputs the first commodity ID attached to the read nth first commodity to the data management unit 2606 .
[0071] Next, when the data management unit 2606 obtains the first product ID from the barcode reader 2605, it determines the first bottom surface image corresponding to the obtained first product ID from the first database, and determines the three-dimensional data corresponding to the obtained first product ID from the second database. The data management unit 2606 outputs the first product ID determined from the second database and the three-dimensional data of the first product ID to the robot arm 2620, and outputs the first bottom surface image determined from the first database to the display device 2610 (S2602). In addition, when the data management unit 2606 obtains the first product ID from the barcode reader 2605, it can further determine the first appearance image corresponding to the obtained first product ID from the first database. In this case, the data management unit 2606 can output the first appearance image to the display device 2610.
[0072] Next, when the display device 2610 acquires the first bottom surface image from the data management unit 2606, it displays the acquired first bottom surface image on the display screen 2611 (S2603). That is, the display control unit 2612 of the display device 2610 displays the first bottom surface image at the first position of the display screen 2611 in the placement area for placing the first commodity. Furthermore, when the display device 2610 acquires the first appearance image from the data management unit 2606, it may also display the acquired first appearance image on the display screen 2611. In this case, the display control unit 2612 may also display the first appearance image at a predetermined position of the display screen 2611 in the placement area for placing the first commodity. The display device 2610 outputs the first position information to the robot arm 2620, and the first position information is information for displaying the first bottom surface image in the placement area.
[0073] Next, the first commodity with the first commodity ID read by the barcode reader 2605 is placed at the first position in the placement area (S2604). In the present embodiment, although the operator places the first commodity with the read first commodity ID at the first position in the placement area, a robot may also place the first commodity at the first position in the placement area.
[0074] Next, the robot arm 2620 moves the first commodity placed at the first position (S2605). Specifically, the robot arm 2620 obtains the three-dimensional data and the first commodity ID corresponding to the first commodity ID determined in the second database from the data management unit 2606, and when the first position information is obtained from the display device 2610, the robot arm 2620 causes the displacement unit 2622 to lift and move the first commodity placed at the first position indicated by the first position information.
[0075] Next, the robot arm 2620 determines whether the movement of the first product is completed (S2606). That is, the arm control unit 2623 controls the first actuator 2621, so that the robot arm 2620 causes the displacement unit 2622 to lift the first product placed at the first position and move the first product into the multi-layer cabinet. At this time, the robot arm 2620 determines whether the display of the first product to the multi-layer cabinet is completed.
[0076] When the robot arm 2620 determines that the movement of the first product has not been completed (No in S2606 ), the process returns to step S2605 and executes step S2605 .
[0077] In addition, when the robot arm 2620 determines that the movement of the first commodity is completed ("Yes" in S2606), the next first commodity is regarded as n=n+1 (S2607). Then, in the delivery system 2600, for the n+1th first commodity as the next commodity, the process returns to step S2601 and repeats the process. In this way, in the delivery system 2600, after the first commodity is delivered, the first commodity ID of each first commodity can be read, and the first commodity placed in the placement area can be lifted and displayed in the multi-layer cabinet.
[0078] [Working Example 2]
[0079] In this working example, we use Figure 5 Yes Figure 4 The case where the result of determining whether the first product is correctly placed at the first position in step S2604 is displayed as an image is described.
[0080] Figure 5 This is a flowchart showing operation example 2 of the delivery system 2600 according to the embodiment.
[0081] First, if Figure 5As shown, when the first product is placed on the placement area, the position determination processing unit 2614 of the display device 2610 determines whether the first product is correctly placed on the first position in the placement area where the first bottom surface image is displayed on the display screen 2611 (S2611).
[0082] When the position determination processing unit 2614 determines that the first product is correctly placed at the first position on the placement area ("Yes" in S2611), the display control unit 2612 of the display device 2610 controls the display screen 2611 to display an image showing that the first product is correctly placed at the first position on the display screen 2611 (S2612). Figure 5 Accordingly, the display device 2610 outputs the first position information indicating the first position where the first product is placed to the robot arm 2620, so that the robot arm 2620 can lift the first product placed at the first position.
[0083] In addition, when the position determination processing unit 2614 determines that the first commodity is not correctly placed at the first position ("No" in S2611), the display control unit 2612 controls the display screen 2611 to display an image showing that the first commodity is not correctly placed at the first position on the display screen 2611 (S2613), returns to step S2611 and executes step S2611. In this case, since the operator can recognize that the first commodity is not placed at the correct position, the first commodity can be re-placed at the correct position, i.e., the first position. Accordingly, the display device 2610 outputs the information showing the first position of the re-placed first commodity, i.e., the first position information, to the robot arm 2620, so that the robot arm 2620 can lift the first commodity placed at the first position.
[0084] [Working Example 3]
[0085] In this working example, we use Figure 6 Outputting sound to Figure 4 The following describes the operation of determining whether the first product is correctly placed at the first position in step S2604. Figure 5 The same operations are assigned the same reference numerals and description thereof will be appropriately omitted.
[0086] Figure 6 This is a flowchart showing operation example 3 of the delivery system 2600 according to the embodiment.
[0087] like Figure 6As shown, in the case of "yes" in step S2611, the delivery system 2600 causes the speaker 2633 to output a sound indicating that the first product is correctly placed at the first position (S2614). Figure 6 According to this, since the display device 2610 outputs the first position information indicating the first position where the first product is placed to the robot arm 2620, the robot arm 2620 can lift the first product placed at the first position.
[0088] In the case of "No" in step S2611, the delivery system 2600 causes the speaker 2633 to output a sound indicating that the first commodity is not correctly placed at the first position (S2615), returns to step S2611 and executes step S2611. In this case, the operator can recognize that the first commodity is not placed at the correct position, and can therefore re-place the first commodity at the correct position, i.e., the first position. Accordingly, the display device 2610 outputs the first position information indicating that the first commodity is re-placed at the first position to the robot arm 2620, and the robot arm 2620 can lift the first commodity placed at the first position.
[0089] [Working Example 4]
[0090] In this working example, we use Figure 7 To represent the image in Figure 4 The following describes the operation in the case where, when the first product is lifted and moved in step S2606, it is determined whether the first product has fallen.
[0091] Figure 7 This is a flowchart showing operation example 4 of the delivery system 2600 according to the embodiment.
[0092] First, if Figure 7 As shown, the drop determination processing unit 2632 of the delivery system 2600 determines whether the first product lifted by the robot arm 2620 has dropped (S2621).
[0093] When the drop determination processing unit 2632 determines that the first product lifted by the robot arm 2620 has dropped ("Yes" in S2621), the display control unit 2612 controls the display screen 2611 to display an image showing that the first product has dropped on the display screen 2611 (S2622). Figure 7 According to this, the operator can recognize that the first commodity has fallen, and can make the robot arm 2620 grab the first commodity again. In addition, when the fall judgment processing unit 2632 determines that the first commodity lifted by the robot arm 2620 has fallen, the driving of the robot arm 2620 can be stopped.
[0094] In addition, when the drop determination processing unit 2632 determines that the first product lifted by the robot arm 2620 has not fallen (“No” in S2621), the process ends. Figure 7 Flowchart of the process.
[0095] [Working Example 5]
[0096] In this working example, we use Figure 8 Outputting sound to Figure 4 The following describes the operation in the case where, when the first product is lifted and moved in step S2606, it is determined whether the first product has fallen.
[0097] Figure 8 This is a flowchart showing operation example 5 of the delivery system 2600 according to the embodiment.
[0098] like Figure 8 As shown, in the case of "yes" in step S2621, the delivery system 2600 controls the display screen 2611 to make the speaker 2633 output a sound indicating that the first product has fallen (S2623). Figure 8 According to this, the operator can recognize that the first commodity received has fallen, and therefore can make the robot arm 2620 grab the first commodity received again.
[0099] In addition, when the drop determination processing unit 2632 determines that the first product lifted by the robot arm 2620 has not fallen (“No” in S2621), the process ends. Figure 8 Flowchart of the process.
[0100] [Effects]
[0101] Next, the effects of the control method, program, and delivery system 2600 according to the present embodiment will be described.
[0102] The control method of the present embodiment is a control method in a system including a display device 2610, which obtains a first product ID for identifying a first product based on sensing data obtained from a sensor, obtains a first bottom surface image showing the shape of the bottom surface of the first product based on a first database that associates and manages the product ID with an image showing the shape of the bottom surface of the product corresponding to the product ID, and the obtained first product ID, and controls the display device 2610 to display the first bottom surface image in a loading area for loading the first product.
[0103] According to this, since the display device 2610 can display the first bottom image of the first product, the first product can be placed at the position where the first bottom image is displayed. Therefore, even without using a sensor or the like to determine the position where the first product is placed, it can be inferred that the position where the first product is placed is the position where the first bottom image is displayed.
[0104] Therefore, in this control method, not only can the position where the first product is placed be easily estimated, but also an increase in system cost can be suppressed.
[0105] The system of this embodiment executes the above-mentioned control method.
[0106] Even in this case, the same effects as those of the above-mentioned control method can be achieved.
[0107] The program of this embodiment is a program for causing the delivery system 2600 to execute the control method.
[0108] Even in this case, the same effects as those of the above-mentioned control method can be achieved.
[0109] In the control method of this embodiment, the first database further associates and manages the product ID with the image showing the appearance of the product corresponding to the product ID. In the control method, based on the first database and the acquired first product ID, the first bottom image and the first appearance image showing the appearance of the first product are acquired, and the display device 2610 is controlled to display the first bottom image and the first appearance image in the loading area.
[0110] According to this, since the display device 2610 can display the first bottom surface image and the first appearance image, the correct first commodity can be placed at the position where the first bottom surface image and the first appearance image are displayed. As a result, the picking operation of incoming commodities can be smoothly performed, and the increase in energy cost and human resource cost including the delivery system 2600 can be suppressed.
[0111] In the control method of this embodiment, the system further includes a robot arm 2620. Furthermore, the robot arm 2620 includes a displacement unit 2622, which lifts one or more first commodities, i.e., the first commodities to be the objects, placed in the placement area to change the position of the first commodities. In addition, the displacement unit 2622 is driven by a first actuator 2621. Furthermore, in the control method, the second database, the first commodity ID, and the first position information are further used to determine the method by which the displacement unit 2622 lifts the first commodity. The second database is a database that manages by associating the commodity ID with the three-dimensional data of the commodity corresponding to the commodity ID. The first position information is information showing the first position in the placement area where the first bottom surface image is displayed. After the first commodity is placed in the first position in the placement area, the first actuator 2621 is controlled so that the displacement unit 2622 lifts the first commodity on the placement area in the determined method.
[0112] According to this, the robot arm 2620 can lift the first commodity placed in the placement area of the display device 2610 and move the first commodity to another position. Thus, the first commodity received is displayed at a predetermined position, and the displayed first commodity can be taken out and shipped.
[0113] In the control method of the present embodiment, further, when the first product is placed in the placement area, it is determined whether the first product is correctly placed in the first position. When it is determined that the first product is correctly placed in the first position, the display device 2610 is controlled so that the display device 2610 displays an image showing that the first product is correctly placed in the first position. When it is determined that the first product is not correctly placed in the first position, the display device 2610 is controlled so that the display device 2610 displays an image showing that the first product is not correctly placed in the first position.
[0114] According to this, when the first product is correctly placed at the first position, an image showing that the first product is correctly placed can be displayed. And, when the first product is not correctly placed at the first position, an image showing that the first product is not correctly placed can be displayed. Thus, the operator can easily recognize whether the first product is correctly placed.
[0115] In the control method of this embodiment, the system further includes a speaker 2633. And further in the control method, when the first product is placed in the placement area, it is determined whether the first product is correctly placed in the first position, and when it is determined that the first product is correctly placed in the first position, the speaker 2633 is controlled to output a sound indicating that the first product is correctly placed in the first position, and when it is determined that the first product is not correctly placed, the speaker 2633 is controlled to output a sound indicating that the first product is not correctly placed in the first position.
[0116] According to this, when the first product is correctly placed at the first position, a sound indicating that the first product is correctly placed can be output. Also, when the first product is not correctly placed at the first position, a sound indicating that the first product is not correctly placed can be output. Thus, the operator can easily recognize whether the first product is correctly placed.
[0117] The control method of this embodiment determines whether the first product is correctly placed based on the image information acquired from the camera.
[0118] According to this, it is possible to determine whether the first product is correctly placed using the camera. Furthermore, it is possible to determine whether the first product is correctly placed based on the image information with high accuracy.
[0119] In the control method of this embodiment, the displacement part 2622 includes a holding part, an adsorption part, or a magnetic part. The holding part can clamp and hold the first product, the adsorption part can adsorb the first product by extracting air, thereby holding the first product, and the magnetic part can hold the first product by attracting the first product through magnetic force.
[0120] Thereby, the first product can be lifted regardless of its type.
[0121] In the control method of this embodiment, the displacement unit 2622 is a device for clamping. In the control method, the method of determining that the displacement unit 2622 lifts the first commodity includes determining a first portion, which is a portion for lifting the first commodity, and after the first commodity is placed at a first position in the placement area, controlling the actuator so that the displacement unit 2622 lifts the first commodity on the placement area at the first portion.
[0122] According to this, the part for lifting the first product can be determined, and the first product can be lifted, thereby preventing the lifted first product from falling.
[0123] In the control method of this embodiment, the system further includes a speaker 2633. In addition, in the control method, it is further determined whether the first commodity lifted by the displacement unit 2622 has fallen based on the sensing result obtained from the sensor (drop sensor 2631), and when it is determined that the first commodity has fallen, the speaker 2633 is controlled to output a sound indicating that the first commodity has fallen.
[0124] Thus, when the first product lifted by the robot arm 2620 falls, a sound indicating that the first product has fallen can be output. Since the operator can easily recognize whether the first product is correctly placed, measures such as collecting the fallen first product can be taken.
[0125] In the control method of this embodiment, it is further determined whether the first product lifted by the displacement unit 2622 has fallen based on the sensing result obtained from the sensor. After it is determined that the first product has fallen, the display device 2610 is controlled to output an image showing that the first product has fallen.
[0126] Thus, when the first product lifted by the robot arm 2620 falls, an image indicating that the first product has fallen can be displayed. Since the operator can easily recognize that the first product is correctly placed, he can take measures such as collecting the fallen first product.
[0127] In the control method of this embodiment, the display device 2610 is a display for displaying the first bottom image of the first product on the placement area. And the placement area corresponds to the area of the display where the first bottom image is displayed.
[0128] According to this, the first bottom surface image can be displayed using a general-purpose display.
[0129] In the control method of this embodiment, the area of the display that displays the first bottom surface image has a touch screen.
[0130] This can be used to determine whether the first product is correctly arranged simply by arranging the first product received in the area of the display where the first bottom surface image is displayed.
[0131] In the control method of this embodiment, the display device 2610 is a projector for projecting the first bottom surface image on a screen, and the placement area corresponds to an area on the screen where the first bottom surface image is projected.
[0132] This can be applied to determining whether the first product is correctly arranged using a projector.
[0133] (Variation 1 of the embodiment)
[0134] Hereinafter, since the basic configuration of the delivery system 2600a in this variation is the same as that of the delivery system in the embodiment, the basic configuration of the delivery system 2600a in this variation is given the same reference numerals as above and the description thereof is omitted as appropriate.
[0135] use FIG. 9A to FIG. 9B The configuration of this modification example will be described.
[0136] Fig.9A 2 is a diagram showing an example of a delivery system 2600a according to a first variation of the embodiment. Fig.9A The dotted line indicates the movable range of the robot arm 2620 when the stage 2641 moves to a specified position on the belt conveyor 2650. Fig. 9B This is a block diagram illustrating a delivery system 2600a according to Modification 1 of the embodiment.
[0137] like Fig.9A as well as Fig. 9B As shown, the delivery system 2600a also has a belt conveyor 2650 for moving the robot arm 2620.
[0138] The belt conveyor 2650 includes a second actuator 2652 , a conveyor control unit 2651 , and a conveyor slider 2640 .
[0139] Belt conveyor 2650 Fig.9A The hatched lines in the figure indicate that the plurality of multi-layer cabinets are arranged in the direction in which the cabinets are arranged. In other words, the plurality of multi-layer cabinets are arranged along the length direction of the belt conveyor 2650. The belt conveyor 2650 can be driven by the second actuator 2652 so that the conveying slider 2640 arranged on the belt conveyor 2650 is conveyed along the length direction of the belt conveyor 2650 as indicated by the arrow.
[0140] The second actuator 2652 can drive the belt conveyor 2650 by being controlled by the conveyor control unit 2651. For example, the second actuator 2652 can move the conveyor slider 2640 to the front of a predetermined multi-layer cabinet among the plurality of multi-layer cabinets by being controlled by the conveyor control unit 2651.
[0141] The conveyor control unit 2651 can control the driving of the second actuator 2652. The conveyor control unit 2651 can drive or stop the belt conveyor 2650 by controlling the second actuator 2652. Accordingly, since the movement of the conveyor slider 2640 placed on the belt conveyor 2650 can be controlled, the conveyor control unit 2651 can move the conveyor slider 2640 to the front of a predetermined multi-layer cabinet.
[0142] The conveying slider 2640 has a table 2641 that moves together with the robot arm 2620 by the drive of the belt conveyor 2650. That is, the table 2641 is arranged on the belt conveyor 2650 and can be moved by the drive of the belt conveyor 2650. In addition, the robot arm 2620 is arranged on the table 2641, and the table 2641 and the robot arm 2620 are moved to the front of the specified multi-layer cabinet by the drive of the belt conveyor 2650.
[0143] Furthermore, a temporary storage area where a plurality of commodities can be placed is formed on the table 2641. The temporary storage area corresponds to the area on the top surface of the table 2641. It can also be said that the temporary storage area corresponds to the area on the top surface of the table 2641 connected to the robot arm 2620.
[0144] Furthermore, when the commodity is placed on the table 2641, the displacement unit 2622 of the robot 2620 moves the first commodity from the placement area to the temporary storage area for temporarily placing the first commodity. When at least the first commodity is placed in the temporary storage area, the temporary storage area of the table 2641 moves together with the robot 2620 as the second actuator 2652 is driven.
[0145] Furthermore, when a plurality of commodities are placed on the table 2641 of the conveying slider 2640, the robot arm 2620 moves the first commodity, which is the first commodity, from the placing area and arranges it in the temporary storage area for temporarily placing the first commodity. Furthermore, after the second commodity is placed at the second position in the placing area, the robot arm 2620 moves the second commodity on the placing area to the temporary storage area using the determined method. In other words, the robot arm 2620 moves the second commodity, which is the second commodity, from the placing area and arranges it in the temporary storage area for temporarily placing the second commodity.
[0146] Furthermore, after the first commodity is lifted by the displacement unit 2622, the delivery system 2600a can drive the second actuator 2652 to move the robot arm 2620 on the belt conveyor 2650 to the first predetermined position to be displayed. In other words, the conveyor control unit 2651 can control the second actuator 2652 to move the conveyor slider 2640 to the first predetermined position to be displayed.
[0147] After the robot arm 2620 disposed on the belt conveyor 2650 moves to the first predetermined position, the robot arm 2620 can drive the first actuator 2621 to move the first product lifted by the displacement unit 2622 to the second predetermined position as a predetermined arrangement position.
[0148] In such a delivery system 2600a, after the operator places the first commodity to be received on the placing area of the display device 2610, the robot arm 2620 can move the first commodity placed on the placing area to the top surface of the table 2641. Specifically, when the operator places the first commodity, which is the first commodity, on the placing area of the display device 2610, the robot arm 2620, after the first commodity is lifted by the displacement unit 2622, places the first commodity in the temporary storage area on the top surface of the table 2641. At this time, the robot arm 2620 can associate the first commodity ID with the placement position of the first commodity placed in the temporary storage area and store it in the storage unit 2624 based on the information related to the table 2641 stored in the storage unit 2624, the control instruction of the first actuator 2621, and the like when placing the first commodity in the temporary storage area. The information related to the table 2641 is information showing the height of the table 2641, the position of the temporary storage area, the space of the temporary storage area, the distance from the robot arm 2620 to the temporary storage area, etc. Thus, since the position of the first commodity arranged in the temporary storage area is stored in the storage unit 2624, the robot arm 2620 can grasp the first commodity of the first commodity ID arranged in the temporary storage area after moving to the first prescribed position without having to carry a camera sensor, etc., and move it to the second prescribed position in the multi-layer cabinet. Accordingly, the first commodity to be delivered can be displayed in the multi-layer cabinet.
[0149] Furthermore, in the case where a plurality of commodities such as the first commodity and the second commodity are arranged in the temporary storage area, when the operator places the first commodity as the first commodity on the placement area of the display device 2610, the robot arm 2620 places the first commodity in the temporary storage area on the top surface of the table 2641. Then, when the operator places the second commodity as the second commodity on the placement area of the display device 2610, the robot arm 2620 places the second commodity in the temporary storage area on the top surface of the table 2641 after the second commodity is lifted by the displacement unit 2622. At this time, the robot arm 2620 can associate the second commodity ID with the placement position of the second commodity arranged in the temporary storage area and store it in the storage unit 2624 based on the information related to the table 2641 stored in the storage unit 2624, the control instruction of the first actuator 2621, and the like when placing the second commodity in the temporary storage area. Accordingly, since the position of the second commodity arranged in the temporary storage area is stored in the storage unit 2624, the robot arm 2620 can grab the second commodity with the second commodity ID arranged in the temporary storage area after moving to the first predetermined position and move it to the second predetermined position in the multi-layer cabinet even if it is not equipped with a camera sensor, etc. Thus, the delivered second commodity can be displayed in the multi-layer cabinet.
[0150] In addition, in this modification, when the first commodity lifted by the robot arm 2620 falls onto the belt conveyor 2650, the first commodity can be moved to a position where it does not get in the way by driving the belt conveyor 2650. In this case, a weight sensor for detecting the first commodity falling onto the belt conveyor 2650 may also be provided.
[0151] Next, the effects of the control method according to this modification will be described.
[0152] In the control method of this variation, the delivery system 2600a further includes a belt conveyor 2650 for moving the robot arm 2620. The belt conveyor 2650 is driven by a second actuator 2652. Furthermore, in the control method, after the first commodity is lifted by the displacement unit 2622, the second actuator 2652 is driven to move the robot arm 2620 on the belt conveyor 2650 to the first prescribed position, and after the robot arm 2620 on the belt conveyor 2650 is moved to the first prescribed position, the first actuator 2621 is driven to move the first commodity lifted by the displacement unit 2622 to the second prescribed position.
[0153] Thus, the robot arm 2620 that lifts the first product can be moved together with the first product by the belt conveyor 2650. Thus, even if the placement area is far from the second predetermined position, the robot arm 2620 can move the first product to the second predetermined position.
[0154] The control method of this variation is a control method in a delivery system 2600a including a robot arm 2620 and a display device 2610. In addition, the robot arm 2620 includes a displacement unit 2622 for lifting an object and changing the position of the object. The displacement unit 2622 is driven by a first actuator 2621, and the delivery system 2600a further includes a belt conveyor 2650 for moving the robot arm 2620. In addition, the belt conveyor 2650 is driven by a second actuator 2652. Furthermore, in the control method, a first product ID for identifying a first product is acquired based on the sensing data obtained from the sensor, a first bottom surface image showing the shape of the bottom surface of the first product is acquired based on a first database that is managed by associating the product ID with an image showing the shape of the bottom surface of the product corresponding to the product ID and the acquired first product ID, and the display device 2610 is controlled to display the first bottom surface image in a placement area for placing the product, a second product ID for identifying a second product is acquired based on the sensing data obtained from the sensor, a second bottom surface image showing the shape of the bottom surface of the second product is acquired based on the first database and the acquired second product ID, and the display device 2610 is controlled to display the first bottom surface image in a placement area for placing the product. The control is performed so that the second bottom surface image is displayed in the loading area, and the method of lifting the first product by the displacement unit 2622 is determined by using the second database managed by associating the product ID with the three-dimensional data of the product corresponding to the product ID, the first product ID, and the first position information indicating the first position in the loading area where the first bottom surface image is displayed. After the first product is loaded at the first position in the loading area, the first actuator 2621 is controlled so that the displacement unit 2622 lifts the first product on the loading area in the determined method. After lifting the first product, the first actuator 2621 is controlled so that the first product lifted by the displacement unit 2622 is moved to a temporary storage area for temporarily loading the first product. The temporary storage area moves together with the robot arm 2620 as the second actuator 2652 is driven. Furthermore, in the control method, a method for lifting the second product by the displacement unit 2622 is determined using the second database, the second product ID, and the second position information showing the second position in the loading area where the second bottom surface image is displayed. After the second product is loaded at the second position in the loading area, the first actuator 2621 is controlled to cause the displacement unit 2622 to lift the second product on the loading area in the determined method. After the second product is lifted, the first actuator 2621 is controlled to move the second product lifted by the displacement unit 2622 to a temporary storage area for temporarily loading the second product.
[0155] For example, in the absence of a temporary storage area, the robot arm is required to lift the first products one by one and move them to a predetermined position for placing the first products, and then return after the movement.
[0156] In this regard, through this variation, a plurality of commodities can be placed on the temporary storage area. Accordingly, the robot arm 2620 can collect a plurality of commodities in a short time, and efficiently move to a predetermined position, and place the commodities after the movement.
[0157] Furthermore, since the display device 2610 can display the first bottom image of the first commodity, the first commodity can be placed at the position where the first bottom image is displayed. Therefore, even if the position where the first commodity is placed is not determined by a sensor or the like, it can be inferred that the position where the first commodity is placed is the position where the first bottom image is displayed. The same is true for the second commodity. Therefore, in this control method, not only can the positions where the first commodity and the second commodity are placed be easily determined, but also the increase in cost in the delivery system 2600a can be suppressed.
[0158] Furthermore, the robot arm 2620 can lift the first commodity according to the three-dimensional data of the first commodity placed in the loading area of the display device 2610, and can move the first commodity to the temporary storage area. Furthermore, after lifting the first commodity, the second commodity can be lifted according to the three-dimensional data of another second commodity, and can move the second commodity to the temporary storage area. In this way, a plurality of commodities can be continuously arranged in the temporary storage area. Thus, a plurality of incoming commodities (the first commodity and the second commodity) can be arranged in the temporary storage area, and thus a plurality of commodities can be moved at one time. Accordingly, a plurality of commodities can be displayed at a specified position, and a plurality of displayed commodities can be taken out and shipped.
[0159] In this way, the picking operation of incoming goods can be smoothly performed, and the increase in energy cost and human resource cost including the shipping system 2600a can be suppressed.
[0160] In the control method of this variation, the temporary storage area corresponds to the area of the part connected to the robot arm 2620.
[0161] According to this, since the robot arm 2620 can be arranged in the temporary storage area, the first product and the second product can be moved to the second predetermined position together with the robot arm 2620, so that a plurality of products can be displayed at the predetermined position, and the displayed plurality of products can be taken out and shipped. According to this, the increase of the time required for displaying and shipping a plurality of products can be suppressed.
[0162] In the control method of this modification, the temporary storage area corresponds to an area on the top surface of the stage 2641 that is moved together by the belt conveyor 2650 and the robot arm 2620 .
[0163] According to this, the first product and the second product lifted by the robot arm 2620 can be easily placed on the top surface of the table.
[0164] (Variation 2 of the embodiment)
[0165] Hereinafter, since the basic configuration of the delivery system 2600b in this variation is the same as that of the delivery system in the embodiment, the basic configuration of the delivery system 2600b in this variation is given the same reference numerals as above and the description thereof is omitted as appropriate.
[0166] use Fig. 10A The configuration of this modification example will be described.
[0167] Fig. 10A FIG. 2 is a diagram showing a delivery system 2600b according to a second variation of the embodiment. Fig. 10A (a) shows an example of the first shelf 2656a displaying the first product moving upward. The double-dashed line shows the first shelf 2656a after it is raised. Fig. 10A (b) shows an example of the robot arm 2620 extending the second wrist 2620b to the first commodity arranged on the inner side of the second shelf 2656b. Fig. 10A (c) shows the displacement unit 2622 of the robot arm 2620 grabbing the first product. Fig. 10A (d) shows the displacement unit 2622 of the robot arm 2620 lifting the first product. Fig. 10A (e) shows the robot arm 2620 that has lifted the first product and retracted the extended second wrist 2620b. Fig. 10A (f) shows the robot arm 2620 moving the lifted first product.
[0168] like Fig. 10A As shown, the delivery system 2600b further has a multi-layer cabinet 2655. In addition, the delivery system 2600b may also have a belt conveyor 2650 for moving the robot arm 2620.
[0169] In the multi-layer cabinet 2655, a plurality of shelves 2656 are arranged in multiple layers in the vertical direction. Specifically, the multi-layer cabinet 2655 includes a plurality of shelves 2656, an actuator 2657 for changing the position of each of the plurality of shelves 2656 in the vertical direction, and a control processing unit 2658 for controlling the driving of the actuator 2657. The multi-layer cabinet 2655 is an example of a display cabinet.
[0170] Each of the plurality of shelves 2656 is plate-shaped and arranged in a posture parallel to the horizontal direction. Each of the plurality of shelves 2656 is a shelf for carrying the first commodity, and is arranged in multiple layers in the vertical direction. The first commodity is displayed on each of the plurality of shelves 2656 by the robot arm 2620.
[0171] The plurality of shelves 2656 include a first shelf 2656a and a second shelf 2656b located in a layer below the first shelf 2656a. In this modification, two shelves adjacent to each other in the vertical direction among the plurality of shelves 2656, namely, the first shelf 2656a and the second shelf 2656b are described as an example.
[0172] The plurality of shelves 2656 can be moved in the up-down direction by driving the actuator 2657 controlled by the control processing unit 2658 .
[0173] The actuator 2657 can move each of the plurality of shelves 2656 in the vertical direction by being controlled by the control processing unit 2658. For example, the actuator 2657 can move the uppermost shelf 2656 among the plurality of shelves 2656 to a predetermined level in the vertical direction by being controlled by the control processing unit 2658.
[0174] The control processing unit 2658 controls the actuator 2657 to change the interval between the first shelf 2656a and the second shelf 2656b. Specifically, when the control processing unit 2658 obtains the first signal for requesting to increase the interval between the first shelf 2656a and the second shelf 2656b in the vertical direction, the actuator 2657 is controlled to change the interval from the first interval to the second interval larger than the first interval.
[0175] For example, Fig. 10A In (a), when the robot 2620 takes down the first commodity displayed on the second shelf 2656b, which is the second shelf from the top, the control processing unit 2658 controls the actuator 2657 upon receiving the first signal from the robot 2620, so that the first shelf 2656a, which is the top shelf, can be raised. Accordingly, the first shelf 2656a is raised by the actuator 2657, and the interval between the first shelf 2656a and the second shelf 2656b in the vertical direction changes from the first interval to the second interval.
[0176] In order to prevent the first commodity from contacting the top surface of the multi-layer cabinet 2655, before the first shelf 2656a rises, the interval between the first shelf 2656a carrying the first commodity and the top surface of the multi-layer cabinet 2655 is preferably a third interval larger than the first interval. The third interval may be the same as the second interval or may be larger than the second interval. That is, a space larger than the first interval is formed between the uppermost shelf 2656 in the multi-layer cabinet 2655 and the top surface of the multi-layer cabinet 2655.
[0177] And in Fig. 10A In (f), when the robot arm 2620 takes out the first commodity displayed on the inner side of the second shelf 2656b, which is the second shelf from the top, the control processing unit 2658 controls the actuator 2657 upon receiving the second signal from the robot arm 2620, so that the first shelf 2656a, which is the top shelf, can be lowered to the original position. Accordingly, the first shelf 2656a is lowered by the actuator 2657, and the interval between the first shelf 2656a and the second shelf 2656b in the vertical direction changes from the second interval to the first interval.
[0178] Next, an operation example of the delivery system 2600b according to this modification will be described.
[0179] For example, in the delivery system 2600, when the first commodity is delivered according to the order information from the user, the first commodity to be delivered needs to be taken out from the back of the shelf 2656. Since the delivery system 2600 manages all the first commodities and the multi-layer cabinets 2655, the first commodity to be delivered is managed in which multi-layer cabinet 2655, which shelf 2656 and which position. When the delivery system 2600 takes out the first commodity to be delivered from the back of the shelf 2656 by the robot arm 2620, it may be difficult to take out the first commodity to be delivered due to the influence of the first commodity arranged in front of the shelf 2656.
[0180] In this operation example, it is assumed that the robot arm 2620 takes out the first product that is placed on the second shelf 2656b and is blocked by another first product, and ships the taken out first product.
[0181] First, if Fig. 10A As shown in (a), the conveyor slider 2640 is moved by the belt conveyor 2650, so that the robot arm 2620 moves to the front of the multi-layer cabinet 2655 where the first commodity to be displayed is displayed. Then, the robot arm 2620 outputs a first signal for requesting to increase the interval between the first shelf 2656a and the second shelf 2656b in the vertical direction to the multi-layer cabinet 2655. In response, the control processing unit 2658 of the multi-layer cabinet 2655 obtains the first signal.
[0182] Then, if Fig. 10A As shown in (a) and (b), when the control processing unit 2658 obtains the first signal, it controls the actuator 2657 to change the interval between the first shelf 2656a and the second shelf 2656b in the vertical direction from the first interval to the second interval larger than the first interval. That is, the actuator 2657 is controlled by the control processing unit 2658 to raise the first shelf 2656a in a manner that the first commodity does not contact the top surface of the multi-layer cabinet 2655. Accordingly, the interval between the second shelf 2656b on which the first commodity is placed and the first shelf 2656a is increased, and the robot arm 2620 can insert the displacement unit 2622 into the interval.
[0183] Then, if Fig. 10A As shown in (b), the robot 2620 extends the first wrist 2620a upward, and positions the displacement unit 2622 at a height between the first shelf 2656a and the second shelf 2656b, and extends the second wrist 2620b horizontally. Furthermore, the robot 2620 positions the displacement unit 2622 above the first commodity that is blocked by another first commodity and is located on the inner side of the second shelf 2656b, and changes the posture of the displacement unit 2622 in order to grasp the first commodity.
[0184] Then, if Fig. 10A As shown in (c) and (d), the displacement unit 2622 of the robot arm 2620 grasps and lifts the first product that is the target.
[0185] Then, if Fig. 10A As shown in (e), after the robot arm 2620 lifts the first product that is the target, the extended second arm 2620b is retracted.
[0186] Then, if Fig. 10A As shown in (f), after taking out the first commodity to be the target, the robot arm 2620 outputs a second signal to the multi-layer cabinet 2655 requesting that the interval between the first shelf 2656a and the second shelf 2656b in the vertical direction be reduced (returned to the original state). In response, the control processing unit 2658 of the multi-layer cabinet 2655 obtains the second signal.
[0187] Next, when the control processing unit 2658 obtains the second signal, it controls the actuator 2657 to change the vertical distance between the first shelf 2656a and the second shelf 2656b from the second distance to the first distance. As a result, the distance between the second shelf 2656b and the first shelf 2656a returns to the original first distance.
[0188] Then, if Fig. 10AAs shown in (f), the robot arm 2620 retracts the first arm 2620a downward to a predetermined amount when shortening the second arm 2620b to a predetermined amount.
[0189] Then, the robot arm 2620 can place the lifted first commodity on the table 2641 of the conveying slide 2640. The robot arm 2620 continues until the first commodity to be the target is taken out from the multi-layer cabinet 2655. In addition, the robot arm 2620 may not place the first commodity to be the target on the table 2641 of the conveying slide 2640, but may move the first commodity to the cargo box while lifting it.
[0190] In addition, in the delivery system 2600b, when taking out the first commodity to be taken out, it can be determined in advance whether it can be taken out without raising the shelf 2656. The delivery system 2600b can also perform the above-mentioned operation example when it is determined that the first commodity cannot be taken out without raising the shelf 2656.
[0191] In addition, although the present modification example shows the case where only the top shelf 2656 is raised, for example, when the first commodity to be the target is arranged on the shelf 2656 of the third layer from the top and is located on the inner side blocked by another first commodity, the control processing unit 2658 controls the actuator 2657 upon acquiring the first signal, so that the interval between the second shelf 2656b and the third shelf (the shelf 2656 of the third layer from the top) in the vertical direction is changed from the first interval to the second interval. That is, the actuator 2657 is controlled by the control processing unit 2658 to raise the first shelf 2656a and the second shelf 2656b in a manner that the first commodity does not contact the top surface of the multi-layer cabinet 2655. Accordingly, the interval between the second shelf 2656b and the third shelf where the first commodity to be the target is arranged is increased, and the robot arm 2620 can insert the displacement unit 2622 into the interval. Thus, in this variation, when taking out a first product located on the back side of shelf 2656 that is blocked by another first product, robot arm 2620 raises all shelves above shelf 2656 on which the target first product is placed.
[0192] Next, the effects of the control method according to this modification will be described.
[0193] In the control method of this variation, the delivery system 2600b further includes a display cabinet (multi-layer cabinet 2655), which includes a plurality of shelves 2656 for placing the first commodity and forming multiple layers in the vertical direction, and an actuator 2657 for changing the vertical position of each of the plurality of shelves 2656. In addition, the plurality of shelves 2656 include a first shelf 2656a and a second shelf 2656b located in the next layer of the first shelf 2656a. Therefore, when the delivery system 2600b obtains a first signal for requesting an increase in the vertical interval between the first shelf 2656a and the second shelf 2656b, the actuator 2657 is controlled to change the interval from the first interval to a second interval larger than the first interval.
[0194] Accordingly, even if the first commodity placed on the shelf 2656 is located at the inner side of the shelf 2656 and is blocked by another first commodity among the plurality of shelves 2656, the first commodity arranged at the inner side of the shelf 2656 can be lifted by the robot arm 2620 by increasing the vertical interval between the first shelf 2656a and the second shelf 2656b. Thus, since the first commodity can be lifted regardless of where it is arranged on the shelf 2656, the space on the shelf 2656 can be effectively utilized to display the first commodity.
[0195] (Variation 3 of the embodiment)
[0196] Hereinafter, since the basic configuration of the delivery system 2600c in this modification is the same as that of the delivery system 2600c in the embodiment, the basic configuration of the delivery system 2600c in this modification is given the same reference numerals as above and the description thereof is omitted as appropriate.
[0197] use Fig. 10B The configuration of this modification example will be described. Fig. 10B FIG. 2 is a diagram showing an example of a delivery system 2600c according to a third variation of the embodiment. Fig. 10B In (a) of FIG. 1 , a plurality of shelves 2656 displaying the first commodity are shown as an example. Fig. 10B (b) shows an example of the robot arm 2620 extending its wrist to the first commodity arranged on the inner side of the first shelf 2656a. Fig. 10B (c) shows an example of the displacement unit 2622 of the robot arm 2620 grabbing the first product. Fig. 10B (d) shows the displacement unit 2622 of the robot arm 2620 lifting the first product. Fig. 10B (e) shows an example of the front wall 2662 being rotated and laid down, and the shelf 2656 displaying the first product sliding. Fig. 10BThe numbers 1 to 7 shown next to represent the number of layers of shelf 2656.
[0198] The delivery system 2600c includes a multi-layer cabinet 2655a and a robot arm 2620. The delivery system 2600c is an example of a display cabinet system.
[0199] like Fig. 10B As shown in (a) and (b) of FIG. 2 , the multi-layer cabinet 2655a includes: a plurality of shelves 2656 arranged in multiple layers in the vertical direction, a first actuator 2657a for moving a first shelf 2656a included in the plurality of shelves 2656 in the horizontal direction, a control processing unit 2658, a first barrier 2659a, a second barrier 2659b, and a second actuator 2657b. The multi-layer cabinet 2655a is an example of a display cabinet.
[0200] Each of the plurality of shelves 2656 is plate-shaped and arranged in a posture parallel to the horizontal direction. Each of the plurality of shelves 2656 is a shelf for placing the first commodity and is arranged in a vertical direction. Each of the plurality of shelves 2656 is moved in the horizontal direction by the first actuator 2657a.
[0201] The first shelf 2656a among the plurality of shelves 2656 is driven by the first actuator 2657a to move between a first position and a second position located in front of the first position. The first position is a position where the first shelf 2656a is stored in the multi-layer cabinet 2655a. In addition, the second position is a position where the first shelf 2656a slides and extends from the multi-layer cabinet 2655a in the horizontal direction and is out of the multi-layer cabinet 2655a.
[0202] The first barrier 2659a is arranged on the front side of the plurality of shelves 2656 and extends downward from the top of the multi-layer cabinet 2655a. Specifically, the upper end of the first barrier 2659a is connected to the upper plate of the multi-layer cabinet 2655a, and the lower end of the first barrier 2659a is in contact with the upper end of the second barrier 2659b.
[0203] The second barrier 2659b is arranged on the front side of the plurality of shelves 2656 and extends upward from the bottom of the multi-layer cabinet 2655a. Specifically, the lower end of the second barrier 2659b is connected to the lower plate of the multi-layer cabinet 2655a, and the upper end of the second barrier 2659b can contact the lower end of the first barrier 2659a.
[0204] The opening of the multi-layer cabinet 2655a is sealed by the contact between the lower end of the first barrier 2659a and the upper end of the second barrier 2659b.
[0205] The second actuator 2657b drives the first barrier 2659a and the second barrier 2659b. As a result, the lower end of the first barrier 2659a and the upper end of the second barrier 2659b can move in the up-down direction. Furthermore, by separating the lower end of the first barrier 2659a from the upper end of the second barrier 2659b, the interior of the multi-layer cabinet 2655a can be opened to expose the plurality of shelves 2656. In addition, the second actuator 2657b can also be provided for the first barrier 2659a and the second barrier 2659b, respectively.
[0206] The second actuator 2657b is controlled by the control processing unit 2658 of the multi-layer cabinet 2655a. When the control processing unit 2658 obtains a signal for requesting that the first shelf 2656a should be moved to the front from the signal acquisition unit 2660, the control processing unit 2658 controls the first actuator 2657a to move the first shelf 2656a from the first position to the second position. Specifically, when the opening of the multi-layer cabinet 2655a is sealed, if the control processing unit 2658 obtains a signal indicating that the first shelf 2656a should be moved to the front, (1) the second actuator 2657b is controlled to form a first gap between the lower end of the first barrier 2659a and the upper end of the second barrier 2659b, and (2) the first actuator 2657a is controlled to move the first shelf 2656a from the first position to the second position through the first gap. The control processing unit 2658 is an example of a controller.
[0207] The robot arm 2620 includes a displacement unit 2622 , an arm control unit 2623 , and an arm driving unit 2625 .
[0208] The displacement unit 2622 is driven by the arm driving unit 2625 to lift one or more commodities placed on the first shelf 2656a, that is, the commodities (first commodities) to be the target, and to change the position of the commodities by moving the commodities lifted by the robot arm to the outside of the multi-layer cabinet 2655a. The displacement unit 2622 includes a gripping unit, an adsorption unit, or a magnetic unit. The gripping unit can clamp the first commodity, the adsorption unit can adsorb the first commodity by extracting air to hold the first commodity, and the magnetic unit can attract the first commodity by magnetic force to hold the first commodity.
[0209] The displacement unit 2622 can move the first commodity arranged on the shelf 2656 in the multi-layer cabinet 2655a by lifting the first commodity, and display the first commodity on another shelf 2656 or another multi-layer cabinet 2655a.
[0210] The arm driving unit 2625 drives the displacement unit 2622. Specifically, the arm driving unit 2625 can drive the displacement unit 2622 by being controlled by the arm control unit 2623. The arm driving unit 2625 may be renamed as the first actuator 2621. Therefore, the arm driving unit 2625 may have the same functional configuration as the first actuator 2621.
[0211] When the arm control unit 2623 obtains a signal for instructing to take out the first commodity on the first shelf 2656a, the robot arm 2620 lifts the commodity placed on the first shelf 2656a, and after the commodity lifted by the robot arm 2620 is moved to the outside of the multi-layer cabinet 2655a, the first shelf 2656a is moved from the first position to the second position by the control processing unit 2658 through the first actuator, and the position of the first commodity on the first shelf 2656a is displaced by the displacement unit 2622 by controlling the arm driving unit 2625.
[0212] When the opening (the take-out port on the front side) of the multi-layer cabinet 2655a is sealed by the first barrier 2659a and the second barrier 2659b, the control processing unit 2658, when receiving a signal for instructing to take out the first commodity on the first shelf 2656a, (1) controls the second actuator 2657b to form a first gap between the lower end of the first barrier 2659a and the upper end of the second barrier 2659b, and (2) controls the first actuator 2657a to move the first shelf 2656a from the first position to the second position through the first gap. After the first shelf 2656a moves to the second position, the control processing unit 2658 transmits a signal indicating that the first shelf 2656a has been moved to the front to the robot arm 2620 via the signal transmission unit 2661. Then, the arm control unit 2623 ( 3 ) of the robot arm 2620 controls the arm driving unit 2625 to displace the position of the first product on the first shelf 2656 a via the displacement unit 2622 .
[0213] Next, an operation example of the delivery system 2600c according to this modification will be described.
[0214] like Fig. 10BAs shown in (b), for example, in the delivery system 2600c, when the first commodity is delivered according to the order information from the user, there may be a case where the first commodity to be delivered needs to be taken out from the back of the shelf 2656. Since the delivery system 2600c manages all the first commodities and the multi-layer cabinets 2655a, it manages which multi-layer cabinet 2655a, which shelf 2656 and which position of the first commodity to be delivered are arranged. When the delivery system 2600c takes out the first commodity to be delivered from the back of the shelf 2656 by the robot arm 2620, there may be a case where it is difficult to take out the first commodity to be delivered due to the influence of the first commodity arranged in front of the shelf 2656.
[0215] In this operation example, it is assumed that the shelf 2656 is moved, the robot arm 2620 lifts and takes out the first product to be delivered, and the taken-out first product is shipped.
[0216] First, if Fig. 10B As shown in (a), the opening of the multi-layer cabinet 2655a may be sealed. Therefore, when the first commodity is taken out by the robot arm 2620, the control processing unit 2658 obtains a signal from the data management unit indicating that the first shelf 2656a should be moved to the front when the opening of the multi-layer cabinet 2655a is sealed.
[0217] like Fig. 10B As shown in (b), the control processing unit 2658 controls the second actuator 2657b based on the signal indicating that the first shelf 2656a should be moved to the front, so that a first gap is formed between the lower end of the first barrier 2659a and the upper end of the second barrier 2659b. At this time, the control processing unit 2658 controls the second actuator 2657b to form a first gap in front of the shelf (first shelf 2656a) from which the first commodity is to be taken out. Accordingly, the lower end of the first barrier 2659a is separated from the upper end of the second barrier 2659b, and a first gap is formed in front of the first shelf 2656a from which the first commodity is to be taken out. Fig. 10B (b) shows an example of a case where the first gap is formed in front of the shelf 2656 on the second floor from the bottom.
[0218] Next, the control processing unit 2658 causes the robot arm 2620 to lift the commodity placed on the first shelf 2656a according to the signal indicating that the first shelf 2656a should be moved to the front. After the commodity lifted by the robot arm 2620 is moved to the outside of the multi-layer cabinet 2655a, the first actuator 2657a is controlled to move the first shelf 2656a from the first position to the second position through the first gap. As a result, the first shelf 2656a, which is the object of taking out the first commodity, slides in the horizontal direction and moves from the first position to the second position. As a result, the first shelf 2656a and the first commodity are moved out of the multi-layer cabinet 2655a, so that the robot arm 2620 can grab the first commodity from above.
[0219] Then, if Fig. 10B As shown in (b), when the arm control unit 2623 obtains a signal for instructing to take out the first commodity on the first shelf 2656a, it controls the arm driving unit 2625 to move the displacement unit 2622 vertically above the first commodity to be taken out. Specifically, the robot arm 2620 moves the displacement unit 2622 horizontally to vertically above the first commodity to be taken out.
[0220] Then, if Fig. 10B As shown in (c) and (d), the displacement unit 2622 of the robot arm 2620 descends, grabs and lifts the first product to be taken out.
[0221] In response to this, the arm control unit 2623 controls the arm driving unit 2625 , and the position of the first product on the first shelf 2656 a is displaced by the displacement unit 2622 .
[0222] In this way, the displacement unit 2622 can lift the first product arranged on the first shelf 2656a and store it in a cargo box for shipment.
[0223] In addition, if Fig. 10BAs shown in (d), for example, when the shelf 2656 located at the bottom layer among the multiple shelves 2656 of the multi-layer cabinet 2655a is slid to move in the horizontal direction (moved from the first position to the second position), it will contact the front wall 2662 of the multi-layer cabinet 2655a. Therefore, when the shelf 2656 that will contact the front wall 2662 of the multi-layer cabinet 2655a among the multiple shelves 2656 is slid and moved in the horizontal direction, the front wall 2662 of the multi-layer cabinet 2655a can be rotated and laid down, so that the contact between the front wall 2662 of the multi-layer cabinet 2655a and the shelf 2656 can be suppressed. Specifically, when the shelf 2656 that will contact the front wall 2662 of the multi-layer cabinet 2655a moves from the first position to the second position, the control processing unit 2658 can rotate the front wall 2662 by controlling another actuator of the multi-layer cabinet 2655a.
[0224] Next, the effects of the multi-layer cabinet 2655 according to this variation will be described.
[0225] The display cabinet (multi-layer cabinet 2655) of this modified example includes: a plurality of shelves 2656 for placing goods, and the plurality of shelves 2656 are arranged in multiple layers along the up-down direction; an actuator for changing the position of each of the plurality of shelves 2656 in the front-to-back direction; a signal acquisition unit 2660 for acquiring a signal from the outside of the display cabinet; and a controller (control processing unit 2658) for controlling the actuator. In addition, the plurality of shelves 2656 include a first shelf 2656a. Therefore, when the controller acquires a signal acquired by the signal acquisition unit 2660 for requesting that the first shelf 2656a be moved forward, the controller controls the actuator (the first actuator 2657a) so that the first shelf 2656a moves from the first position to the second position that is further forward than the first position.
[0226] Thereby, the first shelf 2656a can be moved to the front of the first position. Therefore, it is easy to place commodities on the first shelf 2656a and to take out commodities placed on the first shelf 2656a.
[0227] In the display cabinet of this variation, the signal is transmitted based on an instruction from a controller for controlling a robot arm 2620 that can place merchandise on the display cabinet.
[0228] Accordingly, the robot 2620 sends a signal, so that the first shelf 2656a can be moved to the front of the first position. And it can be expected that the first shelf 2656a is moved to the front of the first position at the timing when the robot 2620 places the product on the first shelf 2656a or the timing when the robot 2620 grabs the product to take out the product from the first shelf 2656a. Therefore, the robot 2620 can smoothly place the product on the first shelf 2656a and can smoothly take out the product from the first shelf 2656a. In this way, the overall operation rate including the display cabinet and the robot 2620 can be expected.
[0229] The display cabinet of this variation further includes a signal transmission unit 2661 that transmits a signal to the outside of the display cabinet. Then, after the controller moves the first shelf 2656a to the second position, the controller transmits a signal to the robot arm 2620 via the signal transmission unit 2661 indicating that the first shelf 2656a has been moved to the front.
[0230] Accordingly, the controller sends a signal to the robot arm 2620, so that the robot arm 2620 can recognize the timing of placing goods on the first shelf 2656a and taking goods out of the first shelf 2656a. Therefore, the robot arm 2620 can smoothly place goods on the first shelf 2656a and can smoothly take goods out of the first shelf 2656a. In this way, the overall operation rate including the display cabinet and the robot arm 2620 can be expected.
[0231] In the display cabinet of this variation, the controller further lifts the goods placed on the first shelf 2656a through the robot arm 2620, and after the goods lifted by the robot arm 2620 are moved to the outside of the display cabinet, the actuator is controlled to move the first shelf 2656a from the first position to the second position.
[0232] Accordingly, when the robot arm 2620 lifts the product, the first shelf 2656a can be quickly moved to the second position.
[0233] (Other Modifications)
[0234] The present disclosure has been described above based on the embodiments, but the present disclosure is not limited to these embodiments, etc. In addition, it is considered that the embodiments include Modifications 1 to 3 of the above-mentioned embodiments and others.
[0235] Furthermore, each component included in the delivery system and the display cabinet involved in the above-mentioned embodiment may be constituted by dedicated hardware, or may be implemented by executing a software program suitable for each component. Each component may also be implemented by a program execution unit such as a CPU or a processor reading and executing a software program recorded in a recording medium such as a hard disk or a semiconductor memory.
[0236] Furthermore, the components of the delivery system and the display cabinet can be typically implemented as an integrated circuit, that is, LSI. These can be made into a single chip, or a part or all of them can be integrated into a single chip.
[0237] Furthermore, integrated circuits are not limited to LSIs, and can also be implemented by dedicated circuits or general-purpose processors. After LSI manufacturing, programmable FPGAs (Field Programmable Gate Arrays) or reconfigurable processors in which the connections or settings of circuit cells within LSIs can be reconfigured can also be used.
[0238] In addition, in the above-mentioned embodiments, each component can be formed by dedicated hardware, or can be implemented by executing a software program suitable for each component. Each component can be implemented by a program execution unit such as a CPU or a processor, reading and executing a software program recorded on a hard disk or a semiconductor memory recording medium.
[0239] Furthermore, the numbers used above are all examples given to specifically illustrate the present disclosure, and the embodiments of the present disclosure are not limited to the numbers shown as examples.
[0240] Furthermore, the division of the functional blocks in the block diagram is an example, and multiple functional blocks can be implemented as one functional block, or one functional block can be divided into multiple blocks, and part of the functions can be transferred to other functional blocks. Furthermore, the functions of multiple functional blocks with similar functions can be processed in parallel or in a time-sharing manner by a single hardware or software.
[0241] Furthermore, the execution order of each step in the flowchart is an example given for the purpose of specifically describing the present disclosure, and may be an order other than the above. Furthermore, part of the above steps may be executed simultaneously (in parallel) with other steps.
[0242] In addition, although the control method, program, delivery system and display cabinet are described above based on the implementation mode, the present disclosure is not limited to the above implementation mode. Without departing from the scope of the present disclosure, various forms obtained by performing various modifications that can be thought of by those skilled in the art on the present implementation mode and forms constructed by combining constituent elements in different implementation modes can be included in the scope of one or more forms.
[0243] Industrial Applicability
[0244] The present disclosure can be applied to, for example, a display cabinet for displaying goods and a delivery system for goods.
[0245] (Note)
[0246] The following describes the features of a control method, a program, a delivery system, and a display cabinet based on the above-mentioned embodiments.
[0247] <Technology 1>
[0248] A control method is a control method in a delivery system including a display device,
[0249] In the control method,
[0250] acquiring a first commodity ID for identifying the first commodity based on the sensing data obtained from the sensor,
[0251] A first bottom surface image showing the shape of the bottom surface of the first product is obtained based on the first database and the obtained first product ID, wherein the first database associates the product ID with the image showing the shape of the bottom surface of the product corresponding to the product ID for management.
[0252] The display device is controlled so that the first bottom surface image is displayed in a placement area for placing the first product.
[0253] <Technique 1a>
[0254] Other performances of the delivery system are shown below.
[0255] A control method is a control method in a delivery system including a display device,
[0256] In the control method,
[0257] acquiring a first commodity ID for identifying the first commodity based on the sensing data obtained from the sensor,
[0258] A first bottom surface image showing the shape of the bottom surface of the first product is obtained based on the first database and the obtained first product ID, wherein the first database associates the product ID with the image showing the shape of the bottom surface of the product corresponding to the product ID for management.
[0259] controlling the display device so that the first bottom surface image is displayed in a placement area for placing the first commodity,
[0260] The control device is a display,
[0261] The placement area corresponds to an area of the display where the first bottom surface image is displayed.
[0262] <Technique 1b>
[0263] Another embodiment of the delivery system is shown below.
[0264] A control method is a control method in a delivery system including a display device and a robotic arm.
[0265] In the control method,
[0266] acquiring a first commodity ID for identifying the first commodity based on the sensing data obtained from the sensor,
[0267] A first bottom surface image showing the shape of the bottom surface of the first product is obtained based on the first database and the obtained first product ID, wherein the first database associates the product ID with the image showing the shape of the bottom surface of the product corresponding to the product ID for management.
[0268] The display device is controlled so that the first bottom surface image is displayed in a placement area for placing the first product.
[0269] <Technology 1c>
[0270] Another embodiment of the delivery system is shown below.
[0271] A control method is a control method in a delivery system including a display device,
[0272] In the control method,
[0273] acquiring a first commodity ID for identifying the first commodity based on the sensing data obtained from the sensor,
[0274] A first bottom surface image showing the shape of the bottom surface of the first product is obtained based on the first database and the obtained first product ID, wherein the first database associates the product ID with the image showing the shape of the bottom surface of the product corresponding to the product ID for management.
[0275] controlling the display device so that the first bottom surface image is displayed in a placement area for placing the first commodity,
[0276] After the first commodity placed on the first bottom surface image displayed in the placement area is lifted by the robot arm, the display device is controlled to delete the first bottom surface image.
[0277] <Technology 2>
[0278] As the control method described in technology 1,
[0279] The first database further manages the product ID by associating it with an image showing the appearance of the product corresponding to the product ID.
[0280] acquiring the first bottom surface image and the first appearance image showing the appearance of the first product based on the first database and the acquired first product ID,
[0281] The display device is controlled so that the first bottom surface image and the first external appearance image are displayed in the placement area.
[0282] <Technology 3>
[0283] As the control method described in technology 1 or 2,
[0284] The delivery system further comprises a robotic arm,
[0285] The robot arm includes a displacement unit that lifts one or more first products, i.e., the first products serving as targets, placed on the placement area to change positions of the first products.
[0286] The displacement unit is driven by a first actuator.
[0287] In the control method,
[0288] A method for lifting the first commodity by the displacement unit is further determined by using a second database, the first commodity ID, and the first position information, wherein the second database manages the commodity ID by associating it with the three-dimensional data of the commodity corresponding to the commodity ID, and the first position information is information indicating the first position in the placement area where the first bottom surface image is displayed.
[0289] After the first product is placed at the first position in the placement area, the first actuator is controlled so that the displacement unit lifts the first product on the placement area in a determined manner.
[0290] <Technique 4>
[0291] A control method as described in any one of techniques 1 to 3,
[0292] In the control method, further,
[0293] When the first product is placed in the placement area, determining whether the first product is correctly placed in the first position in the placement area;
[0294] When it is determined that the first product is correctly placed at the first position, the display device is controlled so that an image showing that the first product is correctly placed at the first position is displayed on the display device.
[0295] When it is determined that the first product is not correctly placed at the first position, the display device is controlled so that an image indicating that the first product is not correctly placed at the first position is displayed on the display device.
[0296] <Technique 5>
[0297] A control method as described in any one of techniques 1 to 4,
[0298] The delivery system further includes a speaker,
[0299] In the control method, further,
[0300] When the first product is placed in the placement area, determining whether the first product is correctly placed in the first position in the placement area;
[0301] When it is determined that the first product is correctly placed at the first position, the speaker is controlled so that a sound indicating that the first product is correctly placed at the first position is outputted from the speaker.
[0302] When it is determined that the first product is not correctly placed, the speaker is controlled so that a sound indicating that the first product is not correctly placed at the first position is output from the speaker.
[0303] <Technique 6>
[0304] As the control method described in technology 4 or 5,
[0305] Based on the image information acquired from the camera, it is determined whether the first product is correctly placed.
[0306] <Technique 7>
[0307] As the control method described in technology 3,
[0308] The displacement portion includes a holding portion, an adsorption portion, or a magnetic portion. The holding portion can clamp the first product, the adsorption portion can adsorb the first product by extracting air to hold the first product, and the magnetic portion can attract the first product by magnetic force to hold the first product.
[0309] <Technology 8>
[0310] As the control method described in technology 7,
[0311] The displacement part is a device for clamping.
[0312] The method for determining the position for lifting the first commodity by the displacement unit includes determining a first portion, the first portion being a portion for lifting the first commodity,
[0313] After the first product is placed at the first position in the placement area, the first actuator is controlled so that the first portion of the first product on the placement area is lifted by the displacement unit.
[0314] <Technique 9>
[0315] A control method as described in any one of techniques 3, 7, and 8,
[0316] The delivery system further includes a belt conveyor for moving the robot arm, wherein the belt conveyor is driven by a second actuator.
[0317] In the control method, further,
[0318] After the first commodity is lifted by the displacement unit, the second actuator is driven to move the robot arm on the belt conveyor to a first predetermined position.
[0319] After the robot arm on the belt conveyor moves to the first predetermined position, the first actuator is driven to move the first product lifted by the displacement unit to a second predetermined position.
[0320] <Technique 10>
[0321] A control method as described in any one of techniques 3, 7, 8, and 9,
[0322] The delivery system further includes a speaker,
[0323] In the control method, further,
[0324] Based on the sensing result obtained from the sensor, it is determined whether the first product lifted by the displacement unit has fallen.
[0325] After it is determined that the first product has fallen, the speaker is controlled to output a sound indicating that the first product has fallen.
[0326] <Technology 11>
[0327] A control method as described in any one of techniques 3, 7, 8, 9, and 10,
[0328] In the control method, further,
[0329] Based on the sensing result obtained from the sensor, it is determined whether the first product lifted by the displacement unit has fallen.
[0330] After it is determined that the first product has fallen, the display device is controlled to output an image indicating that the first product has fallen.
[0331] <Technology 12>
[0332] A control method is a control method in a delivery system including a robot arm and a display device, wherein the robot arm includes a displacement unit for lifting an object and changing the position of the object, and the displacement unit is driven by a first actuator.
[0333] The delivery system further comprises a belt conveyor for moving the robot arm,
[0334] The belt conveyor is driven by a second actuator,
[0335] In the control method,
[0336] acquiring a first commodity ID for identifying the first commodity based on the sensing data obtained from the sensor,
[0337] Based on the first database and the acquired first product ID, a first bottom surface image showing the shape of the bottom surface of the first product is acquired, wherein the first database associates the product ID with the image showing the shape of the bottom surface of the product corresponding to the product ID for management,
[0338] controlling the display device so that the first bottom surface image is displayed in a placement area for placing the commodity,
[0339] acquiring a second commodity ID for identifying the second commodity based on the sensing data obtained from the sensor,
[0340] acquiring a second bottom surface image showing the shape of the bottom surface of the second product based on the first database and the acquired second product ID,
[0341] controlling the display device so that the second bottom surface image is displayed in the placement area,
[0342] A method for lifting the first commodity by the displacement unit is determined by using a second database, the first commodity ID, and the first position information, wherein the second database manages the commodity ID by associating it with the three-dimensional data of the commodity corresponding to the commodity ID, and the first position information indicates a first position in the loading area where the first bottom surface image is displayed.
[0343] After the first product is placed at the first position in the placement area, the first actuator is controlled so that the displacement unit lifts the first product on the placement area in a determined manner.
[0344] After the first product is lifted, the first actuator is controlled so that the first product lifted by the displacement unit is moved to a temporary storage area for temporarily placing the first product.
[0345] The temporary storage area moves together with the robot arm as the second actuator is driven.
[0346] determining a method for lifting the second commodity by the displacement unit using the second database, the second commodity ID, and second position information indicating a second position in the placement area where the second bottom surface image is displayed,
[0347] After the second product is placed at the second position in the placement area, the first actuator is controlled so that the displacement unit lifts the second product on the placement area in a determined manner.
[0348] After the second product is lifted, the first actuator is controlled to move the second product lifted by the displacement unit to a temporary storage area for temporarily placing the second product.
[0349] <Technology 13>
[0350] As the control method described in technology 12,
[0351] The temporary storage area corresponds to an area of a portion connected to the robot arm.
[0352] <Technology 14>
[0353] As the control method described in technology 12 or 13,
[0354] The temporary storage area corresponds to an area of an upper surface of a stage that moves together with the robot arm through the belt conveyor.
[0355] <Technology 15>
[0356] A control method as described in any one of techniques 1 to 14,
[0357] The delivery system further comprises a display cabinet,
[0358] The display cabinet has a plurality of shelves and an actuator.
[0359] The plurality of shelves are arranged in multiple layers along the vertical direction and are used to carry the commodities.
[0360] The actuator is used to change the position of each of the plurality of shelves in the front-rear direction.
[0361] The plurality of shelves include a first shelf,
[0362] When the display cabinet acquires the first signal for requesting the first shelf to move to the front, the display cabinet controls the actuator so that the first shelf moves from the first position to a second position located forward of the first position.
[0363] <Technology 16>
[0364] A control method as described in any one of techniques 1 to 15,
[0365] The display device is a display for displaying the first bottom surface image of the first product on the placement area.
[0366] The placement area corresponds to an area of the display where the first bottom surface image is displayed.
[0367] <Technology 17>
[0368] As the control method described in technology 16,
[0369] The area of the display that displays the first bottom surface image includes a touch screen.
[0370] <Technology 18>
[0371] A control method as described in any one of techniques 1 to 17,
[0372] The display device is a projector for projecting the first bottom surface image onto a screen, and the placement area corresponds to an area of the screen where the first bottom surface image is projected.
[0373] <Technology 19>
[0374] A control method for executing any one of technologies 1 to 18 of a delivery system.
[0375] <Technology 20>
[0376] A program for causing the delivery system to execute the control method described in any one of techniques 1 to 18.
[0377] <Technology 21>
[0378] A display cabinet,
[0379] The display cabinet has:
[0380] A plurality of shelves, the plurality of shelves are arranged in multiple layers in an up-down direction and are used for placing commodities;
[0381] an actuator to change the position of each of the plurality of shelves in the front-rear direction;
[0382] a signal acquisition unit, which acquires a signal from outside the display cabinet; and
[0383] a controller for controlling the actuator,
[0384] The plurality of shelves include a first shelf,
[0385] The controller controls the actuator to move the first shelf from a first position to a second position located forward of the first position when acquiring the signal for requesting the first shelf to move forward, and the signal is acquired by the signal acquisition unit.
[0386] <Technology 22>
[0387] A display case as described in Technique 21,
[0388] The signal is transmitted based on an instruction from the controller, and the controller controls a robot arm capable of placing the product on the display case.
[0389] <Technology 23>
[0390] A display case as described in technology 22,
[0391] The display cabinet further comprises a signal transmitting unit, which is used to transmit a signal to the outside of the display cabinet.
[0392] After moving the first shelf to the second position, the controller transmits a signal indicating that the first shelf has been moved to the front to the robot arm via the signal transmitting unit.
[0393] <Technology 24>
[0394] A display cabinet as described in any one of techniques 21 to 23,
[0395] The controller further controls the actuator to move the first shelf from the first position to the second position after the robot arm lifts the product placed on the first shelf and the product lifted by the robot arm is moved outside the display cabinet.
[0396] In addition, the judgment of whether "the commodity placed on the first shelf is lifted by the robot arm, and the commodity lifted by the robot arm is moved outside the display cabinet" can be made based on the sensing result obtained from the sensor, or based on a signal indicating that the commodity has moved outside the display cabinet and sent according to the instruction from the control unit that controls the robot arm. For example, the sensor may be a weight sensor arranged on the first shelf, or a camera. Moreover, the sensor may be a camera arranged on the robot arm, and may be a camera arranged in the store. Furthermore, for example, based on the sensing result from the weight sensor arranged on the first shelf, it may be judged that the commodity has moved outside the display cabinet only after a predetermined time has passed after detecting that the commodity has been lifted.
[0397] Description of Reference Numerals
[0398] 2600, 2600a, 2600b, 2600c Shipping System
[0399] 2605 Barcode Reader (Sensor)
[0400] 2610 Display Device
[0401] 2613 Loading sensors (camera, sensor)
[0402] 2620 Robotic Arm
[0403] 2621 Actuator No.1
[0404] 2622 displacement part (holding part, adsorption part, magnetic part)
[0405] 2631 Drop sensor (sensor)
[0406] 2633 Speakers
[0407] 2641 units
[0408] 2650 Belt Conveyor
[0409] 2652 Second Actuator
[0410] 2655, 2655a Multi-layer cabinet (display cabinet)
[0411] 2656 Shelves
[0412] 2656a Shelf 1
[0413] 2656b Shelf 2
[0414] 2657 Actuator
[0415] 2657a 1st actuator (actuator)
[0416] 2657b 2nd actuator (actuator)
[0417] 2658 Control Processing Unit (Controller)
[0418] 2660 Signal Acquisition Department
[0419] 2661 Signal Transmission Department
Claims
1. A control method is a control method in a delivery system including a display device, In the control method, acquiring a first commodity ID for identifying the first commodity based on the sensing data obtained from the sensor, A first bottom surface image showing the shape of the bottom surface of the first product is obtained based on the first database and the obtained first product ID, wherein the first database associates the product ID with the image showing the shape of the bottom surface of the product corresponding to the product ID for management. The display device is controlled so that the first bottom surface image is displayed in a placement area for placing the first product.
2. The control method according to claim 1, The first database further manages the product ID by associating it with an image showing the appearance of the product corresponding to the product ID. acquiring the first bottom surface image and the first appearance image showing the appearance of the first product based on the first database and the acquired first product ID, The display device is controlled so that the first bottom surface image and the first external appearance image are displayed in the placement area.
3. The control method according to claim 1 or 2, The delivery system further comprises a robotic arm, The robot arm includes a displacement unit that lifts one or more first products, i.e., the first products serving as targets, placed on the placement area to change positions of the first products. The displacement unit is driven by a first actuator. In the control method, A method for lifting the first commodity by the displacement unit is further determined by using a second database, the first commodity ID, and the first position information, wherein the second database manages the commodity ID by associating it with the three-dimensional data of the commodity corresponding to the commodity ID, and the first position information is information indicating the first position in the placement area where the first bottom surface image is displayed. After the first product is placed at the first position in the placement area, the first actuator is controlled so that the displacement unit lifts the first product on the placement area in a determined manner.
4. The control method according to any one of claims 1 to 3, Further in the control method, When the first product is placed on the placement area, determining whether the first product is correctly placed at the first position in the placement area; When it is determined that the first product is correctly placed at the first position, the display device is controlled so that an image showing that the first product is correctly placed at the first position is displayed on the display device. When it is determined that the first product is not correctly placed at the first position, the display device is controlled so that an image indicating that the first product is not correctly placed at the first position is displayed on the display device.
5. The control method according to any one of claims 1 to 4, The delivery system further includes a speaker, Further in the control method, When the first product is placed on the placement area, determining whether the first product is correctly placed at the first position in the placement area; When it is determined that the first product is correctly placed at the first position, the speaker is controlled so that a sound indicating that the first product is correctly placed at the first position is outputted from the speaker. When it is determined that the first product is not correctly placed, the speaker is controlled so that a sound indicating that the first product is not correctly placed at the first position is output from the speaker.
6. The control method according to claim 4 or 5, Based on the image information acquired from the camera, it is determined whether the first product is correctly placed.
7. The control method according to claim 3, The displacement portion includes a holding portion, an adsorption portion, or a magnetic portion. The holding portion can clamp the first product, the adsorption portion can adsorb the first product by extracting air to hold the first product, and the magnetic portion can attract the first product by magnetic force to hold the first product.
8. The control method according to claim 7, The displacement part is a device for clamping. The method for determining the position for lifting the first commodity by the displacement unit includes determining a first portion, the first portion being a portion for lifting the first commodity, After the first product is placed at the first position in the placement area, the first actuator is controlled so that the first portion of the first product on the placement area is lifted by the displacement unit.
9. The control method according to any one of claims 3, 7 and 8, The delivery system further includes a belt conveyor for moving the robot arm, wherein the belt conveyor is driven by a second actuator. In the control method, further, After the first commodity is lifted by the displacement unit, the second actuator is driven to move the robot arm on the belt conveyor to a first predetermined position. After the robot arm on the belt conveyor moves to the first predetermined position, the first actuator is driven to move the first product lifted by the displacement unit to a second predetermined position.
10. The control method according to any one of claims 3, 7, 8 and 9, The delivery system further includes a speaker, In the control method, further, Based on the sensing result obtained from the sensor, it is determined whether the first product lifted by the displacement unit has fallen. After it is determined that the first product has fallen, the speaker is controlled to output a sound indicating that the first product has fallen.
11. The control method according to any one of claims 3, 7, 8, 9 and 10, In the control method, further, Based on the sensing result obtained from the sensor, it is determined whether the first product lifted by the displacement unit has fallen. After it is determined that the first product has fallen, the display device is controlled to output an image indicating that the first product has fallen.
12. A control method for a delivery system including a robot arm and a display device, wherein the robot arm includes a displacement unit for lifting an object and changing the position of the object, the displacement unit being driven by a first actuator, The delivery system further comprises a belt conveyor for moving the robot arm, The belt conveyor is driven by a second actuator, In the control method, acquiring a first commodity ID for identifying the first commodity based on the sensing data obtained from the sensor, Based on the first database and the acquired first product ID, a first bottom surface image showing the shape of the bottom surface of the first product is acquired, wherein the first database associates the product ID with the image showing the shape of the bottom surface of the product corresponding to the product ID for management, controlling the display device so that the first bottom surface image is displayed in a placement area for placing the commodity, acquiring a second commodity ID for identifying the second commodity based on the sensing data obtained from the sensor, acquiring a second bottom surface image showing the shape of the bottom surface of the second product based on the first database and the acquired second product ID, controlling the display device so that the second bottom surface image is displayed in the placement area, A method for lifting the first commodity by the displacement unit is determined by using a second database, the first commodity ID, and the first position information, wherein the second database manages the commodity ID by associating it with the three-dimensional data of the commodity corresponding to the commodity ID, and the first position information indicates a first position in the loading area where the first bottom surface image is displayed. After the first product is placed at the first position in the placement area, the first actuator is controlled so that the displacement unit lifts the first product on the placement area in a determined manner. After the first product is lifted, the first actuator is controlled so that the first product lifted by the displacement unit is moved to a temporary storage area for temporarily placing the first product. The temporary storage area moves together with the robot arm as the second actuator is driven. determining a method for lifting the second commodity by the displacement unit using the second database, the second commodity ID, and second position information indicating a second position in the placement area where the second bottom surface image is displayed, After the second product is placed at the second position in the placement area, the first actuator is controlled so that the displacement unit lifts the second product on the placement area in a determined manner. After the second product is lifted, the first actuator is controlled so that the second product lifted by the displacement unit is moved to a temporary storage area for temporarily placing the second product.
13. The control method according to claim 12, The temporary storage area corresponds to an area of a portion connected to the robot arm.
14. The control method according to claim 12 or 13, The temporary storage area corresponds to an area of an upper surface of a stage that moves together with the robot arm through the belt conveyor.
15. The control method according to any one of claims 1 to 14, The delivery system further comprises a display cabinet, The display cabinet has a plurality of shelves and an actuator. The plurality of shelves are arranged in multiple layers along the vertical direction and are used to carry the commodities. The actuator is used to change the position of each of the plurality of shelves in the front-rear direction. The plurality of shelves include a first shelf, When the display cabinet acquires the first signal for requesting the first shelf to move to the front, the display cabinet controls the actuator so that the first shelf moves from the first position to a second position located forward of the first position.
16. The control method according to any one of claims 1 to 15, The display device is a display for displaying the first bottom surface image of the first product on the placement area. The placement area corresponds to an area of the display where the first bottom surface image is displayed.
17. The control method according to claim 16, The area of the display that displays the first bottom surface image includes a touch screen.
18. The control method according to any one of claims 1 to 17, The display device is a projector for projecting the first bottom surface image onto a screen, and the placement area corresponds to an area of the screen where the first bottom surface image is projected.
19. A delivery system, executing the control method according to any one of claims 1 to 18.
20. A program for causing the delivery system to execute the control method according to any one of claims 1 to 18.
21. A display cabinet, The display cabinet has: A plurality of shelves, the plurality of shelves are arranged in multiple layers in an up-down direction and are used for placing commodities; an actuator to change the position of each of the plurality of shelves in the front-rear direction; A signal acquisition unit, which acquires a signal from outside the display cabinet; as well as a controller for controlling the actuator, The plurality of shelves include a first shelf, The controller controls the actuator to move the first shelf from a first position to a second position located forward of the first position when acquiring the signal for requesting the first shelf to move forward, and the signal is acquired by the signal acquisition unit.
22. The display cabinet according to claim 21, The signal is transmitted based on an instruction from the controller, and the controller controls a robot arm capable of placing the product on the display case.
23. The display cabinet according to claim 22, The display cabinet further comprises a signal transmitting unit, which is used to transmit a signal to the outside of the display cabinet. After moving the first shelf to the second position, the controller transmits a signal indicating that the first shelf has been moved to the front to the robot arm via the signal transmitting unit.
24. A display cabinet as claimed in any one of claims 21 to 23, The controller further controls the actuator to move the first shelf from the first position to the second position after the robot arm lifts the product placed on the first shelf and the product lifted by the robot arm is moved outside the display cabinet.
