Work equipment

Abstract

To provide a work installation having a container arraying unit on which a plurality of containers are arrayed, allowing for easily carrying out loading / unloading operation of an article to / from the container.SOLUTION: A work installation comprises a container arraying unit 4 on which a plurality of containers 3 are arrayed, a work area, and a work-supporting device 5 that supports the loading / unloading work for an operator. The work-supporting device 5 comprises a display device 6 that allows an operator to wear in front of the eyes and to view an augmented reality image, an article-information acquiring system that acquires article information as information of an article W received in a container 3 arranged on the container arraying unit 4, and a control system that controls the display device 6. The control system generates a container transmission image 9 which is such an augmented reality image that allows the operator to view an external appearance of the article W received in the container 3 by transmission through at least part of the container 3 arranged on the container arraying unit 4 based on the article information acquired by the article-information acquiring system and makes the display device 6 display the container transmission image 9.SELECTED DRAWING: Figure 4

Description

Technical Field

[0001] The present invention relates to work equipment.

Background Art

[0002] For example, Japanese Unexamined Patent Application Publication No. 2014-043353 (Patent Document 1) discloses a technique related to work equipment. Hereinafter, the reference numerals shown in parentheses in the description of the background art are those of Patent Document 1.

[0003] The work equipment (picking equipment) of Patent Document 1 includes a storage shelf (3) for storing a plurality of containers, a work area for an operator to perform picking work on these containers, and a work support device (augmented reality device) for supporting the picking work. The work support device includes a display device (AR glasses 5) worn by the operator. On the display device, in addition to the scene of the real space, a work instruction image is displayed so as to overlap a part of this scene. The work instruction image includes information specifying the container to be picked and information such as the number of articles to be taken out from the container. The operator performs the picking work according to the content of the work instruction image displayed on the display device.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] In the work equipment described in Patent Document 1, the worker can look inside the container through the opening to understand the state inside the container (for example, the position and orientation of the items) while putting items in and taking them out. However, there may be cases where the worker cannot easily see inside the container. In such cases, the worker would have to put items in and take them out by feel without understanding the state inside the container, which could lead to delays in picking up items from the container or accidentally taking out items of a different type than those shown in the work instruction image, potentially reducing work efficiency.

[0006] Therefore, in a work facility equipped with a container arrangement section where multiple containers are arranged, there is a need for a technology that can easily handle the loading and unloading of items into and from the containers. [Means for solving the problem]

[0007] The work equipment relating to this disclosure comprises a container arrangement section in which a plurality of containers are arranged, a work area located adjacent to the container arrangement section in which an operator performs the operation of loading and unloading items into the containers, and a work support device that assists the operator in the loading and unloading operation, The work support device comprises a display device worn in front of the worker's eyes to show the worker augmented reality images, an item information acquisition system that acquires item information which is information about the items contained in the containers arranged in the container arrangement section, and a control system that controls the display device. Based on the item information acquired by the item information acquisition system, the control system generates a container-transparent image, which is an augmented reality image, that allows the worker to see the appearance of the items contained in the containers by making at least a portion of the containers arranged in the container arrangement transparent, and displays the container-transparent image on the display device.

[0008] With this configuration, even when workers in the work area cannot see the inside of containers placed in the container arrangement section, such as when loading or unloading items from containers placed on the upper shelves, workers can understand the state inside the containers by viewing the transparent container image as an augmented reality image displayed on the display device. Thus, with this configuration, in a work facility equipped with a container arrangement section in which multiple containers are arranged, it is possible to easily load and unload items into the containers.

[0009] Further features and advantages of the work equipment will become clear from the following description of exemplary and non-limiting embodiments, which will be illustrated with reference to the drawings. [Brief explanation of the drawing]

[0010] [Figure 1] A schematic side view showing the work equipment. [Figure 2] A schematic plan view showing the work equipment. [Figure 3] Control block diagram [Figure 4] A schematic close-up of the main part of an augmented reality image (container-transparent image). [Figure 5] Control flow diagram [Modes for carrying out the invention]

[0011] The following describes an embodiment of the work equipment 1 based on the drawings. As shown in Figures 1 and 2, the work equipment 1 comprises a container arrangement section 4 in which a plurality of containers 3 are arranged, a work area 10 located adjacent to the container arrangement section 4 where a worker P performs the loading and unloading of items W into and out of the containers 3, and a work support device 5 that assists the worker P in the loading and unloading work. The work equipment 1 also further comprises a conveyor belt 15 located adjacent to the work area 10. Here, the container arrangement section 4 is located adjacent to the work area 10 on the opposite side from the conveyor belt 15. As a result, the work area 10 is positioned so that it is sandwiched between the container arrangement section 4 and the conveyor belt 15 when viewed from above.

[0012] In this example, the "operation of loading and unloading items W into container 3" is defined as the operation of picking items W from containers 3 arranged in the container arrangement section 4. Specifically, worker P takes items W from one of the multiple containers 3 arranged in the container arrangement section 4 and places it into another container 3 arranged on the conveyor belt 15. In this embodiment, as shown in Figure 2, container 3 is configured to have an opening at the top. Therefore, worker P loads and unloads items into the container 3 through the opening at the top. Here, container 3 is a rectangular parallelepiped carton, but is not limited to this. Container 3 may be, for example, a container (including a foldable one). Also, the shape of container 3 may be other than a rectangular parallelepiped (for example, a cylinder).

[0013] As shown in Figures 1 and 2, the container arrangement section 4 is a work shelf 14 in which multiple shelves 41 are arranged vertically, and containers 3 are placed on each shelf 41. In other words, the container arrangement section 4 is configured to allow multiple containers 3 to be arranged side by side in the vertical direction. Furthermore, each of the multiple shelves 41 is configured to allow multiple containers 3 to be arranged horizontally. In this example, each shelf 41 is equipped with an opening 40 for an operator P to take out items W from the containers 3. The opening 40 is configured to allow multiple containers 3 to be arranged side by side. Here, the direction in which multiple containers 3 are arranged side by side in the opening 40 is defined as the arrangement direction Y. Also, the direction perpendicular to the arrangement direction Y when viewed vertically is defined as the transfer direction X. In this example, the work rack 14, work area 10, and conveyor belt 15 are arranged in the order described above in the transfer direction X. The side of the work rack 14 where the work area 10 is located is designated as the first transfer direction X1, and the opposite side (the side of the work area 10 where the work rack 14 is located) is designated as the second transfer direction X2.

[0014] As shown in Figures 1 and 2, the work shelf 14 comprises a plurality of support columns 43 and a plurality of support parts 42 that support the containers 3 from below. The support parts 42 are long, plate-shaped members in the transfer direction X, and can support a plurality of containers 3 lined up in the transfer direction X. The plurality of support parts 42 are arranged in the vertical direction and the arrangement direction Y, and are supported by the plurality of support columns 43. The spacing between the support parts 42 arranged in the vertical direction is larger than the vertical dimension of the container 3 supported by the support parts 42, and is sufficient for a worker P to reach their hand through the opening of the container 3 and take out the item W from inside the container 3. A shelf section 41 corresponding to one tier is formed by the plurality of support parts 42 arranged in the arrangement direction Y on the same tier, and the space on which the containers 3 are placed on these support parts 42. In this example, the loading / unloading opening 40 is formed at the end of the first side X1 in the transfer direction of the shelf section 41 of each tier (Figures 1 and 2).

[0015] In the illustrated example, each of the multiple support sections 42 is arranged to incline downwards as it moves toward the first transfer direction. Multiple containers 3 are arranged along the transfer direction X in one support section 42, and the weight of the last container 3 (closest to the second transfer direction X2) pushes and moves the containers 3 in front of it (towards the first transfer direction X1). As a result, the loading / unloading opening 40 is at the lowest vertical position on the shelf section 41 of the same level. Note that conveying equipment for transporting goods W to each support section 42 may be arranged on the second transfer direction X2 relative to the work shelf 14. Also, the support sections 42 do not have to be inclined as described above; in that case, it is preferable that a conveyor or the like is provided in each support section 42 to move the containers 3 in the transfer direction X. Furthermore, the loading / unloading opening 40 may be provided at one end of the shelf section 41 in the arrangement direction Y, in which case it is preferable that the work area 10 is adjacent to the work shelf 14 on one side in the arrangement direction Y. Thus, the arrangement of the work equipment 1 can be changed as appropriate.

[0016] As shown in Figures 1, 2, and 3, the work equipment 1 includes a moving device 12 that moves the camera 17 along the arrangement direction Y of the containers 3 in the container arrangement section 4. In this example, the moving device 12 is provided to correspond to the top loading / unloading opening 40 of the work shelf 14 (container arrangement section 4). Here, the moving device 12 includes a rail 12a and a moving part 12b that supports the camera 17 from above. The moving part 12b moves guided by the rail 12a. As shown in Figures 1 and 2, the rail 12a is provided along the arrangement direction Y and above the containers 3 arranged in the loading / unloading opening 40. Furthermore, the rail 12a is provided so as to overlap with the central region in the transfer direction X of all the containers 3 arranged in the loading / unloading opening 40 when viewed from above. The configuration of the camera 17 will be described later.

[0017] As shown in Figure 3, the work support device 5 includes a display device 6 worn in front of the worker P to show the worker P augmented reality images, an item information acquisition system 7 that acquires item information, which is information about the items W contained in the containers 3 arranged in the container arrangement section 4, and a control system 8 that controls the display device 6. The work support device 5 also further includes a container detection device 61 that detects the containers 3 arranged in the loading / unloading opening 40, and a voice guidance device 13.

[0018] In this embodiment, the display device 6 includes a display unit 6a on which an augmented reality image is displayed, a communication unit (not shown) that communicates with the control system 8, and a support member 6b that supports the display unit 6a and the communication unit. The communication unit performs wireless communication with the control system 8. In this example, the support member 6b is configured to be able to support the container detection device 61 and the voice guidance device 13. The support member 6b is configured to be wearable on the head of the operator P (here, the face of the operator P is also included in the head). Further, the communication unit is configured to be able to transmit and receive information between the display unit 6a, the container detection device 61, the voice guidance device 13, and the control system 8. And at least the display unit 6a, the container detection device 61, the voice guidance device 13, and the communication unit are provided on the support member 6b. Here, the display unit 6a, the container detection device 61, the voice guidance device 13, the communication unit, and the support member 6b may be collectively referred to as an external terminal 60. In the illustrated example, the external terminal 60 is a pair of goggles, and the display unit 6a (display screen) is provided in the lens portion (the portion disposed in front of the eyes of the operator P). The external terminal 60 may be, for example, a helmet having a lens portion or the like. Also, in this example, the display unit 6a of the display device 6 is disposed in the lens portion of the goggles, but it is not limited thereto. For example, the display device 6 may be a contact lens type device. In this case, the display device 6 is worn in a state of contacting the cornea of the eye. Therefore, in this specification, the phrase "worn in front of the eyes" shall include "wearing in a state of contacting the eye".

[0019] In this example, the container detection device 61 detects each of a plurality of containers 3 arranged at the uppermost access opening 40 in the container arrangement section 4 (the work shelf 14). Here, the container detection device 61 is a camera sensor (imaging device). The container detection device 61 is configured to detect at least the outer shape of the container 3. Also, the container detection device 61 can detect the container 3 targeted for the loading and unloading operation by the operator P as a target container 30. The voice guidance device 13 is provided in the external terminal 60 so as to correspond to the position of the ear of the operator P, and guides the operator P wearing the external terminal 60 with voice instructions and the like.

[0020] In this example, the work equipment 1 includes a control device 100 (FIG. 3). The control device 100 is configured to perform the respective functions of the article information acquisition system 7 and the control system 8. The control device 100 includes a processor such as a microcomputer and peripheral circuits such as a memory. And, each function is realized by the cooperation of these hardware and a program executed on a processor such as a computer.

[0021] As shown in FIGS. 1 and 3, the article information acquisition system 7 includes a camera 17 that photographs the inside of the container 3 from above the container 3, and an image recognition processing unit 71 that performs image recognition processing on the image photographed by the camera 17. The camera 17 is configured to be able to photograph the inside of each of a plurality of containers 3 arranged in the arrangement direction Y at the loading / unloading port 40 from above each container 3. In this example, as described above, the camera 17 is supported by the moving part 12b of the moving device 12 and moves in the arrangement direction Y by being guided by the rail 12a. Further, the movement locus of the camera 17 overlaps with the central region in the transfer direction X of each container 3 arranged at the loading / unloading port 40 when viewed from above and below. Thereby, the camera 17 can photograph the entire opening portion of each of the plurality of containers 3 at the loading / unloading port 40 from above (FIG. 3). The image recognition processing unit 71 is provided in the control device 100. The control device 100 is configured to be able to communicate wirelessly with the camera 17, and the image recognition processing unit 71 acquires the image photographed by the camera 17 as imaging information D. The image recognition processing unit 71 acquires information (hereinafter, may be simply referred to as "information on the arrangement inside the container") regarding the shapes and arrangements (more specifically, the shapes, postures, positions, and numbers of the articles W) of the plurality of articles W accommodated in the container 3 within the range that can be confirmed when viewed from above and below from the imaging information D (image data).

[0022] The item information acquisition system 7 further includes an inventory information acquisition unit 72 that acquires inventory information indicating the type and number of items W contained in each of the multiple containers 3 arranged in the container arrangement unit 4, and an appearance data acquisition unit 73 that acquires item appearance data, which is data of the appearance of each type of item W. The inventory information acquisition unit 72 and the appearance data acquisition unit 73 are provided in the control device 100. Here, the inventory information and item appearance data are stored in the item database 99 provided in the control device 100. The inventory information acquisition unit 72 acquires inventory information (here, the type and number of each type of item W) contained in each container 3 by accessing the item database 99. Item appearance data is acquired by accessing the item database 99. The item database 99 stores images showing the shape, size, pattern, etc. of the appearance of the item W as item appearance data, associated with the type of item W. The item database 99 may store the shape, size, pattern, etc. of all the outer surfaces of the item W for one type, or it may select and store outer surfaces that have distinctive shapes or patterns. Furthermore, in this example, the item database 99 stores container information indicating the shape, size, etc. of container 3. The shape and size of container 3 include not only the external appearance of container 3 but also the shape and size of the inside of container 3 (i.e., the internal area in which the item W is contained). In this example, the multiple containers 3 placed at the loading / unloading opening 40 are all of the same type (same shape, same size) container 3.

[0023] The item information acquisition system 7 identifies the container 3 that is the target of the loading and unloading operation by worker P as the target container 30, and moves the camera 17 to a position where it can photograph the inside of the target container 30 using the moving device 12. In this example, one of the multiple containers 3 placed in the loading / unloading opening 40 is identified as the target container 30. In this example, the control device 100 includes a control unit 82. The control unit 82 then controls the moving device 12 to move the camera 17 to a position corresponding to the target container 30 (in this case, directly above the target container 30). In this way, the control unit 82 is configured to perform some of the functions of the item information acquisition system 7.

[0024] The control system 8 generates a container transparency image 9, which is an augmented reality image that allows the worker P to see the appearance of the items W contained in the containers 3 arranged in the container arrangement section 4, by making at least a portion of the containers 3 transparent, based on the item information acquired by the item information acquisition system 7, and causes the display device 6 to display the container transparency image 9. In this embodiment, the control unit 82 controls the display device 6. That is, the control unit 82 causes the display device 6 to display the container transparency image 9. In this way, the control unit 82 is configured to perform some functions of the control system 8 in addition to the item information acquisition system 7. Furthermore, the item information includes information indicating the shape and arrangement of the items W, which is the result of image recognition processing. More specifically, the item information includes the shape and arrangement of the items W (shape, orientation, position, and number of items W), which is the result of image recognition processing, and further includes the type and number of items W indicated in the inventory information, and the item appearance data acquired by the appearance data acquisition unit 73. The control system 8 then generates a container-transparent image 9 based on the shape and arrangement of the item W, which are the results of the image recognition processing, the type and number of item W indicated in the inventory information, and the item appearance data acquired by the appearance data acquisition unit 73.

[0025] In this example, the control system 8 further includes an image generation unit 81. The image generation unit 81 generates a container transparency image 9. Here, the image generation unit 81 is provided in the control device 100. Specifically, the image generation unit 81 acquires information from the image recognition processing unit 71 regarding the shape and arrangement of articles W contained in the target container 30 (more specifically, the shape, orientation, position, and number of articles W) within the range that can be confirmed by viewing in the vertical direction (hereinafter referred to as "container arrangement information"). The image generation unit 81 also acquires inventory information of the target container 30 (the types of articles W contained in the target container 30 and the number of each type) from the inventory information acquisition unit 72. Furthermore, the image generation unit 81 acquires article appearance data (image data showing the shape, size, pattern, etc. of the article W's appearance) corresponding to each type of article W included in the inventory information from the appearance data acquisition unit 73. Furthermore, the image generation unit 81 acquires container information from the article database 99. The image generation unit 81 generates a transparent container image 9 by associating container placement information, inventory information, item appearance data, and container information. Specifically, the image generation unit 81 identifies the type (in this case, the item name) of each of the multiple items W included in the container placement information by comparing the shape of the items W included in the container placement information, the item appearance data, and the items W included in the inventory information. Once the image generation unit 81 identifies the type of item W in the container placement information, it identifies the appearance of each identified type of item W as image data. The image generation unit 81 then creates a transparent container image 9 of the item W facing the surface (internal end surface 30a) located on the work area 10 side (transfer direction first side X1) inside the target container 30. The image generation unit 81 creates the transparent container image 9 while estimating how the item W appears to the worker P based on the item appearance data, container placement information, and detection information from the container detection device 61. Here, the container transparency image 9 is displayed as a virtual external image corresponding to the position, orientation, and size of each article W facing the internal end face 30a, as included in the container placement information (see Figure 4). In this example, the peripheral portion and pattern (including text) forming the opposing surface of the article W facing the internal end face 30a are displayed as the container transparency image 9.

[0026] In the example in Figure 4, the items W are exemplified as a box-shaped item W1, a bag-shaped item W2, a small item W3, and an unknown item Wt. For the box-shaped item W1, the bag-shaped item W2, and the small item W3, the patterns and peripheral edges of the surfaces on the surface of each item W (the surface facing the inner end face 30a) are displayed as container-transparent images 9. For the unknown item Wt, which is placed below the small item W3, no pattern is displayed as a container-transparent image 9. Thus, if the type of item W is unknown from the imaging information D acquired by the camera 17, the pattern is not displayed as a container-transparent image 9. On the other hand, if the external shape of the item W can be determined from the imaging information D, the external shape (peripheral edge) of the unknown item Wt is displayed as a container-transparent image 9, as shown in the figure. Furthermore, if the image generation unit 81 cannot estimate the external shape of the unknown item Wt, the area where the unknown item Wt is estimated to be located can be displayed, for example, with a dashed line or a gray fill. Furthermore, if the type of item W cannot be identified based on the imaging information D, the container transparency image 9 for the item W may be omitted, regardless of whether the external shape of the item W can be determined. Also, if the presence of item W can be determined based on the imaging information D, but its external shape and pattern cannot be determined, the container transparency image 9 may simply display a mark, pattern, color, etc., indicating the presence of item W. Additionally, the peripheral portion and pattern of item W may be displayed more intensely as the position of item W within the target container 30 approaches the internal end face 30a. Furthermore, in addition to the peripheral portion and pattern of item W, the container transparency image 9 may also virtually display the area in the target container 30 where item W is contained. Thus, it is preferable that the display content of the container transparency image 9 can be changed as appropriate.

[0027] In this example, the display unit 6a of the display device 6 is equipped with a transparent display screen. Therefore, the container-transparent image 9 generated by the image generation unit 81 is positioned on the display unit 6a so as to be superimposed on the real scenery visible to the worker P. Specifically, on the display screen of the display unit 6a, the container-transparent image 9 is projected so as to be superimposed from the second transfer direction X2 onto the surface (surface 30b) of the real target container 30 facing the work area 10 side (first transfer direction X1). In this way, the container-transparent image 9 is projected so as to be superimposed on the scenery of the real surface 30b, thereby generating an augmented reality image. The augmented reality image may also be generated by displaying the image captured by the container detection device 61 (camera sensor) on the display screen of the display unit 6a and compositing the container-transparent image 9 onto the image (image generation by mixed reality). Thus, in this specification, augmented reality images also include images generated by mixed reality.

[0028] In this embodiment, as shown in Figure 1, the control system 8 displays a transparent image 9 of a container 3 placed at a height of H or higher, which is predetermined, on the display device 6. Here, it is preferable that the height H be set according to the vertical position of the container 3, which corresponds to the eye level of the worker P. In this example, the height H is set to the height of the support part 42 corresponding to the uppermost loading / unloading opening 40. The control unit 82 then controls the display device 6 to display the transparent image 9 only for the target container 30 among the multiple containers 3 placed in the uppermost loading / unloading opening 40. For this reason, the container detection device 61 is configured to detect only the containers 3 placed in the uppermost loading / unloading opening 40. With this configuration, the processing load on the control device 100 can be reduced compared to the case where the transparent image 9 is displayed for all containers 3 in the uppermost loading / unloading opening 40, regardless of whether they are the target container 30 or not. In addition, the target container 30 can be easily recognized by the worker P, and the efficiency of loading and unloading work can be improved. Here, when the container detection device 61 detects the target container 30, the surface 30b of the target container 30 is visible within the range of the display screen of the display unit 6a. When the container detection device 61 detects the target container 30, the container transparency image 9 is displayed on the surface 30b within the range visible to the worker P (i.e., the area of ​​the surface 30b within the range of the display screen). As described above, this container transparency image 9 is displayed in a manner that corresponds to the position, orientation, and size of the item W placed inside the target container 30. Furthermore, it is preferable that the container transparency image 9 be displayed in a manner that corresponds to changes in the relative orientation of the surface 30b with respect to the display unit 6a. Specifically, for example, when the worker P is wearing an external terminal 60 and viewing the surface 30b from diagonally above, it is preferable that the container transparency image 9 is also displayed within the range of the display screen in an orientation that corresponds to the orientation of the surface 30b. In other words, the image generation unit 81 creates the container transparency image 9 in real time, and the control unit 82 is configured to change the container transparency image 9 displayed on the display unit 6a in real time. With this configuration, the operator P can always view the container transparency image 9 as an augmented reality image in a natural state.Furthermore, the control unit 82 can also display a transparent image 9 of the container for all containers 3 in the uppermost loading / unloading opening 40, regardless of whether or not they are the target container 30.

[0029] In this embodiment, the item information acquisition system 7 further includes a work instruction information acquisition unit 74 that acquires work instruction information, which is information indicating the content of instructions for loading and unloading work to worker P. Here, the work instruction information is set for each of the multiple containers 3 arranged in the loading / unloading opening 40. Specifically, the type and number of items W that worker P should take out for each container 3 are stored as work instruction information in the work instruction information acquisition unit 74. Here, the worker P inputs the work instruction information in advance, and the work instruction information acquisition unit 74 acquires and stores the input work instruction information. Here, the item name (product name) is given as an example of the type of item W (Figure 4), but it is not limited to this. Also, in this embodiment, as shown in Figure 4, the control system 8 generates a work instruction image 11, which is an image showing the work instruction information, and displays the work instruction image 11 on the display device 6 in a form distinct from the container transparency image 9. The image generation unit 81 creates the work instruction image 11 based on the work instruction information for the target container 30. In this example, the work instruction image 11 displays the product name of the item W that worker P should retrieve, the quantity of each item, and the container number designated as the target container 30. The work instruction image 11 is generated each time the target container 30 is changed and displayed on the display screen of the display unit 6a. For this reason, a digital display (an example of a display device) that displays work instruction information is not provided at the top loading / unloading opening 40 where the container 3 that is the target of the display of the container transparency image 9 is located. Also, as described above, containers 3 located at loading / unloading openings 40 on levels other than the top level are not the target of the display of the container transparency image 9. Therefore, it is preferable to provide digital displays at loading / unloading openings 40 on levels other than the top level. In this example, the content of the work instruction information can also be guided by voice using the voice guidance device 13. Worker P can also perform loading / unloading operations according to the work instruction information guided by the voice guidance device 13.

[0030] As shown in Figure 5, when the control device 100 sets the target container 30 (S01), it controls the moving device 12 to move the camera 17 to a position corresponding to the target container 30 (S02). Subsequently, when the control device 100 acquires container placement information based on the imaging information D (S03), it creates a container transparency image 9 based on the item information (container placement information, inventory information, item appearance data) (S04), and creates a work instruction image 11 based on the work instruction information (S05). Subsequently, when the control device 100 acquires information that the target container 30 has been detected by the container detection device 61 (S06: Yes), it displays the container transparency image 9 and the work instruction image 11 on the display device 6 (S07). The control device 100 also provides voice guidance on the content of the work instruction information (S08). Although not shown in Figure 5, when the target container 30 is no longer detected by the container detection device 61, the control device 100 controls the display device 6 so as not to display the container transparency image 9 and the work instruction image 11. The timing of creating the container transparency image 9 and the work instruction image 11, and the timing of displaying the container transparency image 9 and the work instruction image 11, may be simultaneous or in a different order than shown in Figure 6.

[0031] Here, as shown in Figure 3, a completion button 93 indicating the completion of the loading / unloading operation is displayed on the display device 6 (in this case, the display screen of the display unit 6a). In the illustrated example, the completion button 93 is located in the lower right corner of the display screen. The container detection device 61 (in this case, a camera sensor) is configured to detect the actions of worker P. When worker P completes the loading / unloading operation in the target container 30 according to the work instructions, they press the completion button 93 on the display screen. When the control device 100 receives information from the container detection device 61 that the completion button 93 has been pressed (S09: Yes), it recognizes that the loading / unloading operation in the target container 30 has been completed (S10). If it is necessary to set up the next target container 30 (S11: Yes), the control device 100 sets up the target container 30 (S01). The control device 100 may also recognize the completion of the loading / unloading operation in the target container 30 by the voice of worker P.

[0032] [Other Embodiments] (1) In the above embodiment, the operation of removing an article W from a container 3 arranged in the container arrangement section 4 was described as an example of an operation of putting an article W into and taking it out of the container 3, but the system is not limited to this. The operation of putting an article W into a container 3 arranged in the container arrangement section 4 can also be described as an operation of putting an article W into and taking it out of the container 3.

[0033] (2) In the above embodiment, the container 3 has an open top and the item information acquisition system 7 is provided with a camera 17 that photographs the inside of the container 3 from above, as an example, but the system is not limited to this. For example, the container 3 may have a sealed structure with no open top, and the item information acquisition system 7 may be provided with a device that detects the item W inside the container 3 by passing through it (for example, an X-ray inspection device) instead of the camera 17.

[0034] (3) In the above embodiment, the item information acquisition system 7 was described as having an example configuration in which it identifies the container 3 that is the target of the loading and unloading operation by worker P as the target container 30 and moves the camera 17 to a position where it can photograph the inside of the target container 30 using the moving device 12, but it is not limited to this. For example, the item information acquisition system 7 may be configured without the moving device 12. In that case, multiple cameras 17 corresponding to multiple containers 3 can be placed at the uppermost loading and unloading opening 40.

[0035] (4) In the above embodiment, the control system 8 was described as generating a container-transparent image 9 based on the shape and arrangement of the articles W as a result of image recognition processing, the type and number of articles W indicated in the inventory information, and the article appearance data acquired by the appearance data acquisition unit 73, but it is not limited to this. For example, the control system 8 may generate a container-transparent image 9 without using the article appearance data. In that case, for example, the container-transparent image 9 may be generated such that the product name or a mark indicating the product is displayed in the location where each article W is estimated to be placed.

[0036] (5) In the above embodiment, the control system 8 was described as having a configuration that displays container transparency images 9 on the display device 6 for containers 3 that are arranged at a height of H or higher that has been set in advance, but it is not limited to this. For example, the control system 8 can also display container transparency images 9 on the display device 6 for containers 3 that are arranged in all of the loading / unloading openings 40 of the container arrangement section 4 (work shelf 14).

[0037] (6) In the above embodiment, the control system 8 was described as generating a work instruction image 11, which is an image showing work instruction information, and displaying the work instruction image 11 on the display device 6 in a form distinct from the container transparency image 9, but the system is not limited to this. The control system 8 can also output the work instruction image 11 to an output device different from the display device 6. For example, the control system 8 can display it directly on the surface 30b of the target container 30 without going through the display device 6, or a screen can be installed in the work area 10 and the work instruction screen can be displayed on the screen.

[0038] (7) The configurations disclosed in each of the embodiments described above can be applied in combination with configurations disclosed in other embodiments, as long as no inconsistencies arise. With regard to other configurations, the embodiments disclosed herein are merely illustrative in all respects. Therefore, various modifications can be made as appropriate without departing from the spirit of this disclosure.

[0039] [Summary of the above embodiments] The following is a summary of the work equipment described above.

[0040] The work equipment relating to this disclosure comprises a container arrangement section in which a plurality of containers are arranged, a work area located adjacent to the container arrangement section in which an operator performs the operation of loading and unloading items into the containers, and a work support device that assists the operator in the loading and unloading operation, The work support device comprises a display device worn in front of the worker's eyes to show the worker augmented reality images, an item information acquisition system that acquires item information which is information about the items contained in the containers arranged in the container arrangement section, and a control system that controls the display device. Based on the item information acquired by the item information acquisition system, the control system generates a container-transparent image, which is an augmented reality image, that allows the worker to see the appearance of the items contained in the containers by making at least a portion of the containers arranged in the container arrangement transparent, and displays the container-transparent image on the display device.

[0041] With this configuration, even when workers in the work area cannot see the inside of containers placed in the container arrangement section, such as when loading or unloading items from containers placed on the upper shelves, workers can understand the state inside the containers by viewing the transparent container image as an augmented reality image displayed on the display device. Thus, with this configuration, in a work facility equipped with a container arrangement section in which multiple containers are arranged, it is possible to easily load and unload items into the containers.

[0042] Here, the container has an open top, The item information acquisition system comprises a camera that photographs the inside of the container from above, and an image recognition processing unit that performs image recognition processing on the image captured by the camera. Preferably, the article information includes information indicating the shape and arrangement of the article, which is the result of the image recognition processing.

[0043] This configuration allows for the acquisition of information indicating the shape and arrangement of items based on the actual state inside the container as captured by the camera, thereby generating an appropriate transparent image of the container.

[0044] Furthermore, the container arrangement section includes a moving device for moving the camera along the arrangement direction of the containers, The item information acquisition system preferably identifies the container that was the target of the loading and unloading operation performed by the worker as the target container, and moves the camera using the moving device to a position where it can photograph the inside of the target container.

[0045] This configuration allows for a low number of cameras relative to the number of containers on which a transparent image can be displayed. Therefore, it is easier to reduce the cost of the work equipment.

[0046] Furthermore, the item information acquisition system further comprises: an inventory information acquisition unit that acquires inventory information indicating the type and number of items contained in each of the plurality of containers arranged in the container arrangement unit; and an appearance data acquisition unit that acquires item appearance data, which is data of the appearance of each type of item. The control system preferably generates the container-transparent image based on the shape and arrangement of the articles, which are the result of the image recognition processing, the type and number of the articles as shown in the inventory information, and the article appearance data acquired by the appearance data acquisition unit.

[0047] According to this configuration, a transparent image of the container that accurately reproduces the inside of the container can be generated based on the shape and arrangement of the items as a result of image recognition processing, the type and number of items indicated in the inventory information, and the item appearance data acquired by the appearance data acquisition unit. Therefore, by viewing such a transparent image of the container, the operator can understand the condition of the inside of the container in more detail.

[0048] Furthermore, the container arrangement section is a work shelf in which multiple shelves are arranged vertically, and the containers are placed on each of the shelves. The control system preferably displays a transparent image of the container on the display device for the container that is positioned at a height equal to or greater than a preset height.

[0049] This configuration allows for the display of transparent images of containers on a display device, specifically for containers that are difficult for workers to see inside because they are located on relatively high shelves in the work shelving system. Therefore, it is possible to facilitate the loading and unloading of items into and from multiple containers placed on the work shelving system.

[0050] Furthermore, the item information acquisition system further includes a work instruction information acquisition unit that acquires work instruction information, which is information indicating the content of the instructions given to the worker for the loading and unloading work. Preferably, the control system generates a work instruction image, which is an image showing the work instruction information, and displays the work instruction image on the display device in a form distinct from the container transparency image.

[0051] With this configuration, a work instruction image is displayed on the display device in addition to the container transparency image. Therefore, the worker can perform the task of putting items into and taking items out of the container simply by looking at the image displayed on the display device. This makes it easier to improve the efficiency of the task of putting items into and taking items out of the container.

[0052] The work equipment relating to this disclosure only needs to be able to achieve at least one of the effects described above. [Explanation of symbols]

[0053] 1: Work equipment 3: Container 4: Container arrangement section 5: Work support devices 6:Display device 7: Item Information Acquisition System 8: Control System 9: Transparent image of the container 10: Work Area 11: Work instruction image 12: Mobile device 17: Camera 30: Target container 41:Shelf 71: Image Recognition Processing Unit 72: Inventory Information Acquisition Department 73: Appearance data acquisition unit 74: Work instruction information acquisition section H: Height P: worker W:Goods Y: Array direction

Claims

1. A work facility comprising: a container arrangement section in which multiple containers are arranged; a work area located adjacent to the container arrangement section, in which an operator performs the task of loading and unloading items into the containers; and a work support device that assists the operator in the loading and unloading work, The work support device comprises a display device worn in front of the worker's eyes to show the worker augmented reality images, an item information acquisition system that acquires item information which is information about the items contained in the containers arranged in the container arrangement section, and a control system that controls the display device. The control system generates a container-transparent image, which is an augmented reality image, based on the item information acquired by the item information acquisition system, that allows at least a portion of the containers arranged in the container array to be transparent, so that the worker can see the appearance of the items contained in the containers, and displays the container-transparent image on the display device.

2. The container has an open top, The item information acquisition system comprises a camera that photographs the inside of the container from above, and an image recognition processing unit that performs image recognition processing on the image captured by the camera. The work equipment according to claim 1, wherein the article information includes information indicating the shape and arrangement of the article, which is the result of the image recognition processing.

3. The container arrangement section includes a moving device for moving the camera along the arrangement direction of the containers, The work equipment according to claim 2, wherein the item information acquisition system identifies the container that has been subjected to the loading and unloading operation by the worker as the target container, and moves the camera to a position where it can photograph the inside of the target container using the moving device.

4. The item information acquisition system further comprises: an inventory information acquisition unit that acquires inventory information indicating the type and number of items contained in each of the plurality of containers arranged in the container arrangement unit; and an appearance data acquisition unit that acquires item appearance data, which is data of the appearance of each type of item. The work equipment according to claim 2, wherein the control system generates the container-transparent image based on the shape and arrangement of the articles, which are the result of the image recognition processing, the type and number of the articles indicated in the inventory information, and the article appearance data acquired by the appearance data acquisition unit.

5. The container arrangement section is a work shelf in which multiple shelves are arranged vertically, and the containers are placed on each of the shelves. The work equipment according to any one of claims 1 to 4, wherein the control system causes the display device to show a transparent image of the container for the container which is positioned at a height equal to or greater than a preset height.

6. The item information acquisition system further comprises a work instruction information acquisition unit that acquires work instruction information, which is information indicating the content of instructions given to the worker for the loading and unloading work. The work equipment according to any one of claims 1 to 4, wherein the control system generates a work instruction image which is an image showing the work instruction information, and causes the display device to display the work instruction image in a form distinct from the container transparency image.

Images