Information processing apparatus, information processing system, information processing method, and program

Abstract

To provide: an information processing device which accurately executes a component assembly task by an operator; an information processing system; an information processing method; and a program.SOLUTION: An information processing device includes: an instruction generation part for generating an instruction of taking out at least one or more components from one storage part out of a plurality of storage parts contained in a storage shelf; a number derivation part for deriving the number of components taken out from the one storage part based on weight of the components taken out from the one storage part; a determination part for determining whether or not the number of derived components coincides with the number of components instructed to be taken out by the instruction; and a notification generation part for generating, based on the determination, result of the determination part notification for notifying an operator who has taken out the components.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an information processing system, an information processing method, and a program.

Background Art

[0002] In recent years, operations using storage shelves having a plurality of storage units have been performed in various fields. By using a storage shelf, an operator can sequentially take out parts related to the work stored in each of the plurality of storage units.

[0003] For example, in a parts assembly operation, a technique has been proposed in which a storage shelf having a plurality of storage units is used as a parts warehouse, and information indicating an assembly procedure and parts to be taken out is projected onto a predetermined member of the storage shelf by a projector.

[0004] Also, in such a parts assembly operation, consideration has been given to confirming whether an operator who has taken out parts from the storage shelf is performing the work accurately. For example, Patent Document 1 below describes a technique for confirming whether all the parts on a tray have been used for assembly by analyzing a captured image of the tray on which the taken-out parts are placed.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] However, with the technology described in Patent Document 1 above, it was difficult to accurately confirm the number of parts taken out from the storage shelf. Specifically, in the image analysis of the captured image, it was difficult to recognize the parts existing in the area that became the shadow of other parts. Therefore, it is desired that the operator accurately perform the part assembly work by accurately grasping the number of parts taken out from the storage shelf.

[0007] Therefore, the present invention has been made in view of the above problems, and an object of the present invention is to provide a novel and improved information processing apparatus, information processing system, information processing method, and program that enable an operator to accurately perform part assembly work.

Means for Solving the Problems

[0008] In order to solve the above problems, according to an aspect of the present invention, an instruction generation unit that generates an instruction to take out at least one or more parts from one storage unit among a plurality of storage units included in a storage shelf, and based on the weight of the parts taken out from the one storage unit, a number derivation unit that derives the number of the parts taken out from the one storage unit, a determination unit that determines whether the derived number of the parts matches the number of the parts instructed to be taken out in the instruction, and based on the determination result of the determination unit, a notification generation unit that generates a notification to the operator who took out the parts are provided. When the number of the parts derived by the number derivation unit is greater than the number of the parts instructed to be taken out by the instruction, the notification generation unit generates a notification instructing the operator to return a part of the taken-out parts to the one storage unit. The notification includes information on the number of parts excessively taken out from the one storage unit based on the difference between the number of the parts derived by the number derivation unit and the number of the parts instructed to be taken out by the instruction. An information processing apparatus is provided.

[0009] The number derivation unit may derive the number of the parts by dividing the weight of the taken-out parts by the weight per one part.

[0010] When the derived number of the parts matches the number of the parts instructed to be taken out in the instruction, the instruction generation unit may generate an instruction subsequent to the instruction that instructed the taking out.

[0012] When the number of the derived parts is less than the number of the parts instructed to be taken out in the instruction, the notification generation unit may generate a notification instructing the operator to further take out the parts from the one storage unit.

[0014] The number derivation unit may derive the number of the parts stored in each of the storage units based on the weight of the parts stored in each of the storage units for each storage unit.

[0015] The number derivation unit may further derive the number of the parts taken out from the one storage unit based on the amount of decrease in the weight of the parts stored in the one storage unit before and after the extraction of the parts from the one storage unit.

[0016] The number derivation unit may further derive the number of the parts taken out from the one storage unit based on an image of the parts taken out from the one storage unit.

[0017] When the number of the derived parts matches the number of outputs from an external device used for assembling the parts, the instruction generation unit may generate an instruction subsequent to the instruction that instructed the extraction. occurring during the assembly of the parts

[0018] When the number of the parts derived by the number derivation unit is greater than the number of the parts instructed to be taken out by the instruction, the notification generation unit generates a notification instructing the operator to return a part of the taken-out parts to the one storage unit. The notification includes information on the number of parts excessively taken out from the one storage unit based on the difference between the number of the parts derived by the number derivation unit and the number of the parts instructed to be taken out by the instruction. Also, in order to solve the above problems, according to another aspect of the present invention, there is provided an instruction generation unit that generates an instruction to take out at least one or more parts from one of a plurality of storage units included in a storage shelf, a number derivation unit that derives the number of the parts taken out from the one storage unit based on the weight of the parts taken out from the one storage unit, a determination unit that determines whether the derived number of the parts matches the number of the parts instructed to be taken out in the instruction, and a notification generation unit that generates a notification to the operator who has taken out the parts based on the determination result of the determination unit. An information processing system is provided.

[0019] ​Also, in order to solve the above problems, according to another aspect of the present invention, a step of generating an instruction to take out at least one or more parts from one storage part among a plurality of storage parts included in a storage shelf by an arithmetic processing device; a step of deriving the number of the parts taken out from the one storage part based on the weight of the parts taken out from the one storage part; a step of determining whether the derived number of the parts matches the number of the parts instructed to be taken out in the instruction; and a step of generating a notification to the operator who took out the parts based on the result of the determination, are included When it is found that the number of the derived parts is greater than the number of the parts instructed to be taken out by the instruction, a notification instructing the operator to return a part of the taken-out parts to the one storage unit is generated. The notification includes information on the number of parts excessively taken out from the one storage unit based on the difference between the number of the derived parts and the number of the parts instructed to be taken out by the instruction. , an information processing method is provided.

[0020] Furthermore, in order to solve the above problems, according to another aspect of the present invention, a computer is caused to function as an instruction generation unit that generates an instruction to take out at least one or more parts from one storage part among a plurality of storage parts included in a storage shelf; a number derivation unit that derives the number of the parts taken out from the one storage part based on the weight of the parts taken out from the one storage part; a determination unit that determines whether the derived number of the parts matches the number of the parts instructed to be taken out in the instruction; and a notification generation unit that generates a notification to the operator who took out the parts based on the determination result of the determination unit When the number of the parts derived by the number derivation unit is greater than the number of the parts instructed to be taken out by the instruction, the notification generation unit generates a notification instructing the operator to return a part of the taken-out parts to the one storage unit. The notification includes information on the number of parts excessively taken out from the one storage unit based on the difference between the number of the parts derived by the number derivation unit and the number of the parts instructed to be taken out by the instruction. , a program is provided.

[0021] With the above configuration, based on the weight of the parts taken out from one storage part among the plurality of storage parts included in the storage shelf, the number of the parts taken out is derived. Thereby, the information processing device can determine whether the number of the parts instructed to be taken out matches the number of the parts actually taken out, and can generate a notification to the operator based on the determination result.

Effect of the Invention

[0022] As described above, according to the present invention, it is possible to cause an operator to accurately perform a parts assembly operation using a storage shelf.

Brief Description of the Drawings

[0023]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Embodiments for Carrying Out the Invention

[0024] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the present specification and the drawings, components having substantially the same functional configuration are denoted by the same reference numerals, and redundant description is omitted.

[0025] <1. Example of System Configuration> First, with reference to FIGS. 1 and 2, a work support system to which an information processing apparatus according to an embodiment of the present invention is applied will be described. FIG. 1 is a perspective view showing an example of the configuration of a work support system 10 according to the present embodiment. The work support system 10 includes an information processing apparatus 11 according to the present embodiment.

[0026] As shown in FIG. 1, the work support system 10 includes an information processing apparatus 11, a storage shelf 12, a workbench 13, a sensor unit 14, a display projection unit 15, and a mirror 18.

[0027] The work support system 10 according to this embodiment is a system that supports component assembly work using a storage shelf 12. The storage shelf 12 has a plurality of storage parts 121 in which various components used in component assembly work are stored. An operator can appropriately assemble the taken-out components to a product by sequentially taking out the components stored in each of the plurality of storage parts 121 according to the flow of the component assembly work.

[0028] In addition, in FIG. 1, the direction from the storage shelf 12 toward the workbench 13 is defined as the front direction, and the direction opposite to the front direction is defined as the rear direction. Also, when looking directly at the storage shelf 12 from the workbench 13 (that is, when looking directly at the rear side from the front side), the up, down, left, and right directions are defined as the upward direction, downward direction, left direction, and right direction, respectively.

[0029] The storage shelf 12 includes a plurality of storage parts 121. In the component assembly work, the components to be assembled to the product are respectively stored in the plurality of storage parts 121. By using the storage shelf 12, an operator can reach into any of the storage parts 121, take out the components stored in the storage part 121, and assemble the taken-out components to the product. In the example shown in FIG. 1, the storage shelf 12 includes a total of 16 storage parts 121 arranged in 4 rows in the vertical direction and 4 columns in the horizontal direction. However, the number of storage parts 121 included in the storage shelf 12 is not particularly limited. The storage shelf 12 may include more storage parts 121, such as 20, 30, or 50.

[0030] The workbench 13 is a table used by an operator when performing component assembly work. The workbench 13 includes a flat tabletop (upper surface) that extends horizontally across the entire width of the storage shelf 12. The tabletop of the workbench 13 may function as a projection area where an image projected from a display projection unit 15 described later is formed.

[0031] In addition, a measuring instrument 20 is provided on the workbench 13. The measuring instrument 20 is, for example, a weighing scale that measures the weight of an object placed on the measurement area. When an operator takes out a part from any of the storage units 121, first, the taken-out part is placed on the measurement area of the measuring instrument 20. Thereby, the measuring instrument 20 can measure the weight of the part taken out from the storage unit 121 by the operator and output information regarding the measured weight to the information processing device 11.

[0032] The sensor unit 14 includes various sensors and senses information regarding the work performed by the operator. Specifically, the sensor unit 14 may include a camera capable of capturing a still image or a moving image (hereinafter also referred to as an image), and acquire an image of the work performed by the operator. According to this, the sensor unit 14 can output, as a sensing result, an image of the work by the operator captured by the camera to the information processing device 11. For example, the sensor unit 14 may include a live camera (also referred to as a USB camera) connected to the information processing device 11 via USB (Universal Serial Bus). However, the type of camera included in the sensor unit 14 is not limited to the above. For example, the sensor unit 14 may include an infrared camera, and may include a stereo camera or a ToF (Time Of Flight) camera, etc.

[0033] The sensor unit 14 may include a camera disposed at a position above the height of the head of an operator of standard height (for example, a position above the uppermost storage unit 121) and in front of the front surface of the storage shelf 12. In such a case, the sensor unit 14 can capture an image including a part or the whole body of the operator located in front of the work support system 10. The sensor unit 14 may be attached to, for example, a support frame 17 that supports the mirror 18 as shown in FIG. 1.

[0034] In addition, the sensor unit 14 may further include a camera arranged to capture an image of the storage shelf 12. According to this, the information processing device 11 can recognize which storage unit 121 the operator has reached into to take out a part based on the captured image of the storage shelf 12.

[0035] Note that the number and installation location of the cameras included in the sensor unit 14 are not particularly limited. The sensor unit 14 may include, for example, a camera arranged to image the tabletop of the workbench 13, or a camera arranged to image the surrounding environment of the work support system 10.

[0036] The display projection unit 15 displays a support image including information for assisting the operator's component assembly work by projection based on the control by the information processing device 11. For example, the display projection unit 15 may project the support image onto the front surface of the storage shelf 12 or the tabletop of the workbench 13 using so-called projection mapping technology by a projector.

[0037] For example, as shown in FIG. 1, the display projection unit 15 may be arranged above the storage shelf 12. The display projection unit 15 can project the projection light reflected by the mirror 18 onto the front surface of the storage shelf 12 or the tabletop of the workbench 13 by irradiating the projection light toward the mirror 18 provided opposite to the display projection unit 15. According to this, the display projection unit 15 can project the support image onto the front surface of the storage shelf 12 or the tabletop of the workbench 13 via the mirror 18.

[0038] Note that the display projection unit 15 may be arranged at a position where the projection light can be directly projected onto the front surface of the storage shelf 12 or the tabletop of the workbench 13 (for example, the ceiling or wall not shown in the space where the work support system 10 is arranged). Also, the display projection unit 15 may include a plurality of projectors. For example, the display projection unit 15 may include a projector that projects the projection light onto the front surface of the storage shelf 12 and a projector that projects the projection light onto the upper surface of the workbench 13.

[0039] Mirror 18 is arranged to face the display projection unit 15 at a position above the height of the head of an operator of standard height (for example, a position above the uppermost storage unit 121) and in front of the front surface of the storage shelf 12, as shown in FIG. 1 for example. Specifically, the mirror 18 may be arranged obliquely above the workbench 13 and above the storage shelf 12 such that the reflecting surface faces both the front surface of the storage shelf 12 or the tabletop of the workbench 13 and the display projection unit 15. According to this, the mirror 18 can reflect the projection light irradiated from the display projection unit 15 toward the front surface of the storage shelf 12 or the tabletop of the workbench 13.

[0040] The mirror 18 may be rotatably supported by a support mechanism such that the reflection angle is variable in the vertical direction. According to this, the mirror 18 can reflect the projection light irradiated from the display projection unit 15 at an arbitrary reflection angle. Therefore, the mirror 18 can selectively reflect the projection light irradiated from the display projection unit 15 with respect to the front surface of the storage shelf 12 or the tabletop of the workbench 13.

[0041] A card reader 19 for reading an ID (identification) card of an operator may be connected to the information processing apparatus 11. The card reader 19 is provided in the vicinity of the storage shelf 12 or the workbench 13. The card reader 19 can read identification information of the operator (for example, the identification number and name of the operator) from the ID card and output it to the information processing apparatus 11. For example, the information processing apparatus 11 may recognize which operator has started the work by reading an ID card that is a magnetic card or an IC (integrated circuit) card.

[0042] Note that the work support system 10 may include, instead of or in addition to the card reader 19, a biometric information recognition device that recognizes biometric information such as fingerprints or palm prints, an identification number input device that inputs an identification number, or a reader device that reads a barcode or two-dimensional code (e.g., QR code (registered trademark)) in which the information of the worker is stored. The work support system 10 can also recognize which worker has started the work based on the information read by the biometric information recognition device or the reader device.

[0043] The information processing device 11 is a computer or the like that controls the overall operation of the work support system 10. The functional configuration of the information processing device 11 will be described later with reference to FIG. 3.

[0044] The information processing device 11 may be connected to an administrator terminal 30 operated by an administrator via, for example, a network 40. FIG. 2 is a block diagram showing the connection between the information processing device 11 and the administrator terminal 30 according to the present embodiment.

[0045] As shown in FIG. 2, the administrator terminal 30 is composed of a computer or the like and is connected to at least one or more information processing devices 11 via a network 40. The administrator terminal 30 can manage the progress of the component assembly work in each of the work support systems 10, for example, by managing the data transmitted from the connected information processing device 11.

[0046] <2. Configuration Example of Information Processing Device> Subsequently, with reference to FIG. 3, the functional configuration of the information processing device 11 according to the present embodiment will be described. FIG. 3 is a block diagram showing the structural configuration of the information processing device 11.

[0047] As shown in FIG. 3, the information processing device 11 includes a control unit 110, an I / F (interface) unit 120, and a storage unit 130.

[0048] (Control Unit 110) The control unit 110 controls the overall operation of the work support system 10. The control unit 110 includes an image acquisition unit 111, a work progress estimation unit 112, an instruction generation unit 113, a quantity derivation unit 114, a determination unit 115, and a notification generation unit 116.

[0049] For example, the control unit 110 includes an arithmetic device such as a CPU (Central Processing Unit) and a storage device such as a ROM (Read Only Memory) and a RAM (Random Access Memory). The control unit 110 can control the overall operation of the work support system 10 by temporarily expanding the program stored in the ROM into the RAM and executing the program with the CPU.

[0050] The image acquisition unit 111 acquires, via the I / F unit 120, the real-time captured image of the storage shelf 12 continuously obtained by the sensor unit 14. The image acquisition unit 111 may store the acquired real-time captured image in the storage unit 130. For example, the image acquisition unit 111 may store the real-time captured images of a certain past period in the storage unit 130. Alternatively, each time the image acquisition unit 111 acquires a real-time captured image from the sensor unit 14, it may overwrite (update) the real-time captured image stored in the storage unit 130.

[0051] The work progress estimation unit 112 estimates the progress of the work by the worker based on the captured image of the storage shelf 12 acquired by the image acquisition unit 111.

[0052] Specifically, first, the work progress estimation unit 112 compares the real-time captured image acquired by the image acquisition unit 111 with the captured image captured earlier in time than the real-time captured image to detect the difference. Note that the captured image to be compared with the real-time captured image (i.e., the captured image captured earlier in time) may be stored in the storage unit 130, for example. After the difference detection is performed, the real-time captured image may be stored in the storage unit 130 to overwrite (update) the captured image to be compared.

[0053] Next, the work progress estimation unit 112 recognizes the storage unit 121 corresponding to the area where the detected difference has occurred as the storage unit 121 from which the operator has taken out the parts. For example, when parts are taken out from the storage unit 121, at least a part of the storage unit 121 or the area directly below the storage unit 121 is shielded by the operator's hand. At this time, a difference in the presence or absence of the operator's hand occurs in the captured image of the storage unit 121 from which the parts have been taken out. Thereby, the work progress estimation unit 112 can recognize the storage unit 121 from which the parts have been taken out based on the presence or absence of the operator's hand included in the captured image. According to this, the work progress estimation unit 112 can estimate whether or not the parts to be assembled into the product in each process of the parts assembly work have been taken out from the storage unit 121 by whether or not the operator has put their hand into the storage unit 121.

[0054] Note that the estimation by the work progress estimation unit 112 is not limited to the estimation by the above-described difference detection. For example, the work progress estimation unit 112 can also estimate the progress of the work by using various image recognition techniques. Further, the work progress estimation unit 112 may estimate the progress of the work by detecting the operator's hand based on the sensing results of various sensors provided in each of the storage units 121.

[0055] The instruction generation unit 113 generates an instruction to take out parts from one of the storage units 121 included in the storage shelf 12. Specifically, the instruction generation unit 113 sequentially generates instructions to take out the parts to be assembled into the product from the storage unit 121 in accordance with the order of assembling the parts into the product in the parts assembly work. The instruction generated by the instruction generation unit 113 is presented to the operator, for example, by the support image projected from the display projection unit 15. Therefore, the operator can understand the storage unit 121 in which the parts to be assembled into the product are stored and take out the parts from the storage unit 121 in each process of the parts assembly work.

[0056] According to this, the information processing apparatus 11 indicates to the operator the storage unit 121 from which the parts are to be taken out based on the instruction generated by the instruction generation unit 113, and can confirm that the operator has taken out the parts from the storage unit 121 based on the captured image acquired by the image acquisition unit 111. By repeating the above operations, the information processing apparatus 11 can cause the operator to proceed with the component assembly work of sequentially assembling the components into the product.

[0057] The quantity derivation unit 114 derives the number of parts taken out from the storage unit 121 using the weight of the parts taken out from the storage unit 121. The information processing apparatus 11 according to the present embodiment can derive the number of parts from the weight of the parts by measuring the weight of the parts taken out from the storage unit 121 with the measuring instrument 20. Specifically, the quantity derivation unit 114 may derive the number of parts by dividing the weight of the parts taken out from the storage unit 121 by the weight per part. The weight per part may be stored in advance as table data in the storage unit 130 or the like for each of the parts stored in the storage unit 121.

[0058] The determination unit 115 determines whether the number of parts taken out by the operator matches the number of parts instructed to be taken out by the operator. Specifically, the determination unit 115 determines whether the number of parts derived from the weight by the quantity derivation unit 114 matches the number of parts instructed to be taken out in the instruction generated by the instruction generation unit 113.

[0059] When the number of parts derived by the quantity derivation unit 114 matches the number of parts instructed to be taken out, the information processing apparatus 11 can determine that the component assembly work is proceeding normally. Therefore, the information processing apparatus 11 can generate an instruction for the next process by the instruction generation unit 113 and present the generated instruction to the operator. On the other hand, when the number of parts derived by the quantity derivation unit 114 does not match the number of parts instructed to be taken out, the information processing apparatus 11 can generate a notification notifying the operator that an abnormality has occurred in the number of parts by the notification generation unit 116 described later.

[0060] Based on the determination result by the determination unit 115, the notification generation unit 116 generates a notification to inform the operator that an abnormality has occurred in the number of parts taken out. Specifically, when the number of parts derived by the number derivation unit 114 is greater than the number of parts instructed to be taken out, the notification generation unit 116 may generate a notification instructing the operator to return a part of the taken-out parts to the storage unit 121. Also, when the number of parts derived by the number derivation unit 114 is less than the number of parts instructed to be taken out, the notification generation unit 116 may generate a notification instructing the operator to take out more parts from the storage unit 121.

[0061] The notification generated by the notification generation unit 116 may include information regarding, for example, the difference between the number of parts derived by the number derivation unit 114 and the number of parts instructed to be taken out (i.e., the excessive number or the shortage number). According to this, the operator who has confirmed the notification can recognize the number of parts to be returned to the storage unit 121 or the number of parts to be further taken out from the storage unit 121.

[0062] Also, the notification generated by the notification generation unit 116 may include information indicating, for example, the storage unit 121 to which the excessive taken-out parts are to be returned or the storage unit 121 from which the shortage parts are to be taken out. According to this, the operator who has confirmed the notification can more smoothly return the excessive parts to the storage unit 121 or take out the shortage parts from the storage unit 121. The notification generated by the notification generation unit 116 may be presented to the operator, for example, in the support image projected from the display projection unit 15.

[0063] (I / F unit 120) The I / F unit 120 inputs and outputs data with an external device connected by wire or wirelessly. Specifically, the I / F unit 120 may acquire a captured image from the sensor unit 14 connected by wire or wirelessly, may acquire information regarding the weight of a component from the measuring instrument 20 connected by wire or wirelessly, and may acquire ID information from the card reader 19 connected by wire or wirelessly. Further, the I / F unit 120 may output information regarding a support image projected onto the front surface of the storage shelf 12 or the work surface of the workbench 13 to the display projection unit 15 connected by wire or wirelessly, and may output information regarding the work progress to the administrator terminal 30 connected by wire or wirelessly. For example, the I / F unit 120 may be an interface configured of a communication device or the like for connecting to a network.

[0064] (Storage unit 130) The storage unit 130 is a storage device that stores programs and data for operating the control unit 110. Further, the storage unit 130 may temporarily store various data necessary in the process of the operation of the control unit 110. The storage unit 130 may be configured of, for example, an HDD (Hard Disk Drive).

[0065] The information processing apparatus 11 having the above configuration can determine the number of components taken out by dividing the weight of the components taken out by an operator by the weight per component. Therefore, since the information processing apparatus 11 can confirm whether the number of components taken out by the operator from the storage unit 121 is the instructed number, it is possible to instruct the operator to take out a plurality of components at once. Further, since the information processing apparatus 11 can more accurately determine the number of components by using the weight, it is possible to more accurately determine an abnormality in the number of components taken out. Therefore, the information processing apparatus 11 can cause the operator to more accurately perform the component assembly work.

[0066] <3. Modification Example> Next, first to third modification examples of the work support system 10 including the information processing apparatus 11 according to the present embodiment will be described.

[0067] (First Modification Example) In the first modification example, a weighing scale for measuring the weight of the stored parts is provided in each of the storage units 121 of the storage shelf 12. In such a case, the quantity derivation unit 114 can derive the number of parts stored in each of the storage units 121 by dividing the weight of the parts stored for each storage unit 121 by the weight per part. According to this, the information processing device 11 can more easily confirm whether a predetermined number of parts are stored in each of the storage units 121 before the start of the parts assembly work.

[0068] Also, the quantity derivation unit 114 can also derive the number of parts taken out from the storage unit 121 based on the amount of decrease in the weight of the parts stored in the storage unit 121 before and after taking out the parts from the storage unit 121. Specifically, when parts are taken out from the storage unit 121, the weight of the parts stored in the storage unit 121 decreases by the weight of the parts taken out from the storage unit 121. Therefore, the quantity derivation unit 114 can also derive the number of parts taken out by dividing the amount of decrease in the weight of the parts stored in the storage unit 121 before and after taking out the parts from the storage unit 121 by the weight per part.

[0069] If the number of parts derived from the amount of decrease in the weight of the parts stored in the storage unit 121 does not match the number of parts derived from the weight of the parts taken out, there is a possibility that some of the parts taken out from the storage unit 121 are lost on the workbench 13. In such a case, the information processing device 11 may notify the operator that some of the parts may be lost.

[0070] (Second Modification Example) In the second modification example, the quantity derivation unit 114 derives the number of parts taken out from the storage unit 121 based on the captured image of the workbench 13 surface acquired by the image acquisition unit 111. For example, the quantity derivation unit 114 may derive the number of parts taken out from the storage unit 121 by performing image recognition on the captured image of the parts placed on the measurement area of the measuring instrument 20. The quantity derivation unit 114 can derive the number of parts taken out more accurately by comparing the number of parts derived from the weight of the taken-out parts with the number of parts derived by image recognition of the captured image.

[0071] (Third Modification Example) In the third modification example, the information processing apparatus 11 can manage the progress of the work with higher accuracy by comparing the number of parts derived by the quantity derivation unit 114 with the number of outputs from the external device. Specifically, when the parts taken out from the storage unit 121 are screws or the like, it is considered that a predetermined output is generated from the external device used when attaching the parts to the product for each number of parts. For example, it is considered that an output of a predetermined torque is generated from the electric driver for attaching the screw to the product for each number of screws.

[0072] Therefore, when the number of parts taken out matches the number of outputs from the external device used when attaching the parts to the product, the information processing apparatus 11 can infer that all the taken-out parts have been attached to the product. Also, when the number of parts taken out does not match the number of outputs from the external device used when attaching the parts to the product, the information processing apparatus 11 can infer that the taken-out parts have not been completely attached to the product. According to this, when it is inferred that all the taken-out parts have been attached to the product, the information processing apparatus 11 may generate an instruction for the next process by the instruction generation unit 113 and advance the process of the parts assembly work first.

[0073] <4. Operation Example of Information Processing Apparatus> Next, with reference to FIG. 4, an operation example of the information processing apparatus 11 will be described. FIG. 4 is a flowchart showing the flow of the operation of the information processing apparatus 11.

[0074] As shown in FIG. 4, first, a part extraction instruction is generated by the instruction generation unit 113 (S101). The generated instruction is presented to the operator via the display projection unit 15, and the operator takes out the parts from the storage unit 121. The taken-out parts are placed in the measurement area of the measuring instrument 20, and the weight of the taken-out parts is measured (S102). Next, the number of parts taken out is derived by dividing the weight of the parts taken out by the weight per part by the number derivation unit 114 (S103).

[0075] Here, the determination unit 115 determines whether or not the number of parts derived by the number derivation unit 114 matches the number of parts instructed in the part extraction instruction (S104). If the number of derived parts matches the number of parts instructed to be taken out (S104 / Yes), the information processing apparatus 11 transitions to the next process of the part assembly operation, and the instruction generation unit 113 generates an instruction to extract the parts in the next process.

[0076] If the number of derived parts does not match the number of parts instructed to be taken out (S104 / No), the notification generation unit 116 generates a number error notification indicating that the number of derived parts does not match the number of parts instructed to be taken out (S105). The generated number error notification is presented to the operator via the display projection unit 15.

[0077] Furthermore, the determination unit 115 determines whether or not the number of parts derived by the number derivation unit 114 is greater than the number of parts instructed to be taken out (S106).

[0078] If the number of derived parts is greater than the number of parts instructed to be taken out (S106 / Yes), the notification generation unit 116 generates a notification to return the excessive parts to the storage unit 121 (S107). The generated notification is presented to the operator via the display projection unit 15. Thereafter, the measuring instrument 20 measures the weight of the taken-out parts again (S102), and the number derivation unit 114 determines again whether the number of parts derived matches the number of parts instructed in the part take-out instruction.

[0079] On the other hand, if the number of derived parts is less than the number of parts instructed to be taken out (S106 / Yes), the notification generation unit 116 generates a notification to further take out the insufficient parts from the storage unit 121 (S108). The generated notification is presented to the operator via the display projection unit 15. Note that the information processing device 11 may skip the operation of step S108 without generating a notification to further take out the insufficient parts from the storage unit 121 and wait until the instructed number of parts are taken out. Thereafter, the measuring instrument 20 measures the weight of the taken-out parts again (S102), and the number derivation unit 114 determines again whether the number of parts derived matches the number of parts instructed in the part take-out instruction.

[0080] According to the above operations, when the number of parts taken out from the storage unit 121 is different from the instructed number, the information processing device 11 can notify the operator of a quantity error. Therefore, the information processing device 11 can more strictly manage the part assembly work so that the number of taken-out parts matches the number assumed to be used in the work.

[0081] <5. Hardware Configuration Example> As described above, the embodiments of the present invention have been described. Various information processes performed by the above-described work support system 10 are realized by the cooperation of software and the hardware of the work support system 10 described below.

[0082] FIG. 5 is a block diagram showing an example of the hardware configuration of an information processing apparatus 900 that embodies the work support system 10 (more specifically, for example, the information processing apparatus 11) according to the present embodiment.

[0083] As shown in FIG. 5, the information processing apparatus 900 includes a CPU 901, a ROM 902, a RAM 903, a host bus 904, a bridge 905, an external bus 906, an interface 907, an input device 908, an output device 909, a storage device 910, a drive 911, and a communication device 913.

[0084] The CPU 901 functions as an arithmetic processing unit and a control unit, and controls the overall operation within the information processing apparatus 900 according to various programs. The CPU 901 may be a microprocessor. The ROM 902 stores programs and arithmetic parameters used by the CPU 901. The RAM 903 temporarily stores programs used in the execution of the CPU 901 and parameters that appropriately change during the execution of the programs. These CPU 901, ROM 902, and RAM 903 are interconnected by a host bus 904 composed of a CPU bus or the like. The functions of the control unit 110 described above are realized by the cooperation of the CPU 901, ROM 902, and RAM 903.

[0085] The host bus 904 is connected to an external bus 906 such as a PCI (Peripheral Component Interconnect / Interface) bus via the bridge 905. Note that the host bus 904, the bridge 905, and the external bus 906 do not necessarily have to be separated, and these functions may be implemented in one bus.

[0086] The input device 908 is composed of an input means such as a mouse, keyboard, touch panel, button, switch, or microphone for the user to input information, and an input control circuit that generates an input signal based on the input by the user and outputs it to the CPU 901. A user who operates the information processing device 900 can input various data to the information processing device 900 or instruct processing operations by operating the input device 908.

[0087] Also, the input device 908 may be composed of a device that detects information related to work. For example, the input device 908 may include various sensors such as an image sensor (e.g., a camera), a depth sensor (e.g., a stereo camera or a ToF sensor), an acceleration sensor, a gyro sensor, a geomagnetic sensor, a light sensor, a sound sensor, a distance measuring sensor, and a force sensor. The input device 908 may, for example, realize the function of the sensor unit 14.

[0088] The output device 909 includes, for example, a display device such as a CRT (Cathode Ray Tube) display device, a liquid crystal display (LCD) device, an OLED (Organic Light Emitting Diode) device, a lamp, or an audio output device such as a speaker. The output device 909 may, for example, realize the function of the display projection unit 15.

[0089] The storage device 910 is a device for storing data. The storage device 910 may include a storage medium, a recording device for recording data on the storage medium, a reading device for reading data from the storage medium, a deleting device for deleting data recorded on the storage medium, and the like. The storage device 910 may, for example, realize the function of the storage unit 130.

[0090] Drive 911 is a reader / writer for a storage medium and is externally attached to the information processing apparatus 900. Drive 911 reads the information recorded on a removable storage medium 912 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory that is mounted, and outputs it to the RAM 903. Further, drive 911 can also write information to the removable storage medium 912.

[0091] The communication device 913 is a communication interface composed of a communication device or the like for performing communication. The communication device 913 may be a communication device compatible with a wireless LAN (Local Area Network), or may be a wire communication device that performs wired communication. The communication device 913 can realize the functions of the I / F unit 120, for example.

[0092] Note that the hardware configuration of the information processing apparatus 900 is not limited to the configuration shown in FIG. 5. For example, the information processing apparatus 900 may not include the input device 908 or the output device 909, etc. Also, part or all of the configuration shown in FIG. 5 may be realized by one or two or more ICs (Integrated Circuits).

[0093] <6. Summary> As described above, the preferred embodiments of the present invention have been described in detail with reference to the accompanying drawings, but the present invention is not limited to such examples. It is obvious that those having ordinary knowledge in the technical field to which the present invention pertains can come up with various modification examples or correction examples within the scope of the technical idea described in the claims, and it is naturally understood that these also belong to the technical scope of the present invention.

[0094] For example, the processes described using flowcharts in this specification do not necessarily have to be executed in the order shown in the drawings. Some of the process steps may be executed in parallel. Also, additional process steps may be adopted, and some of the process steps may be omitted.

[0095] In addition, the series of processes performed by the information processing apparatus described in this specification may be realized using any of software, hardware, and a combination of software and hardware. The programs constituting the software are, for example, pre-stored in a storage medium (non-transitory media) provided inside or outside each device. And each program is, for example, read into the RAM when executed by a computer and executed by a processor such as a CPU. The storage medium is, for example, a magnetic disk, an optical disk, a magneto-optical disk, a flash memory, etc. Also, the above computer program may be distributed via a network, for example, without using a storage medium.

Description of Signs

[0096] 10 Work support system 11 Information processing apparatus 12 Storage shelf 121 Storage section 13 Workbench 14 Sensor section 15 Display projection section 17 Support frame 18 Mirror 19 Card reader 20 Measuring instrument 110 Control section 111 Image acquisition section 112 Work progress estimation section 113 Instruction generation section 114 Quantity derivation section 115 Judgment section 116 Notification generation section 120 I / F section 130 Storage section 30 Administrator terminal 40 Network

Claims

1. An instruction generation unit that generates an instruction to take out at least one or more parts from one storage unit among a plurality of storage units included in a storage shelf; A quantity derivation unit that derives the number of parts taken out from the one storage unit based on the weight of the parts taken out from the one storage unit; A determination unit that determines whether the derived number of parts matches the number of parts instructed to be taken out in the instruction; A notification generation unit that generates a notification to the worker who took out the parts based on the determination result of the determination unit; Comprising: When the number of parts derived by the number derivation unit is greater than the number of parts instructed to be taken out in the instruction, the notification generation unit generates the notification instructing the worker to return a part of the taken-out parts to the one storage unit; The notification includes information on the number of parts excessively taken out from the one storage unit based on the difference between the number of parts derived by the number derivation unit and the number of parts instructed to be taken out in the instruction. An information processing apparatus.

2. The number derivation unit derives the number of parts by dividing the weight of the taken-out parts by the weight per part. The information processing apparatus according to claim 1.

3. When the derived number of parts matches the number of parts instructed to be taken out in the instruction, the instruction generation unit generates an instruction subsequent to the instruction that instructed the taking out. The information processing apparatus according to claim 1 or 2.

4. When the derived number of parts is less than the number of parts instructed to be taken out in the instruction, the notification generation unit generates the notification instructing the worker to further take out the parts from the one storage unit. The information processing apparatus according to any one of claims 1 to 3.

5. The number derivation unit derives the number of parts stored in each of the storage units based on the weight of the parts stored in each of the storage units for each storage unit. The information processing apparatus according to any one of claims 1 to 4.

6. The number derivation unit further derives the number of parts taken out from the one storage unit based on the amount of decrease in the weight of the parts stored in the one storage unit before and after the taking out of the parts from the one storage unit. The information processing apparatus according to claim 5.

7. The information processing apparatus according to any one of claims 1 to 6, wherein the number derivation unit derives the number of the components taken out from the one storage unit, based further on an image of the components taken out from the one storage unit.

8. The information processing apparatus according to any one of claims 1 to 7, wherein the instruction generation unit generates an instruction in a subsequent stage of the instruction that instructed the extraction, when the derived number of the components matches the number of outputs generated at the time of assembling the components from an external device used for assembling the components.

9. An instruction generation unit that generates an instruction to extract at least one or more components from one storage unit among a plurality of storage units included in a storage shelf; A number derivation unit that derives the number of the components taken out from the one storage unit, based on the weight of the components taken out from the one storage unit; A determination unit that determines whether or not the derived number of the components matches the number of the components instructed to be extracted by the instruction; A notification generation unit that generates a notification to an operator who has taken out the components, based on a determination result of the determination unit; comprising when the number of the components derived by the number derivation unit is greater than the number of the components instructed to be extracted by the instruction, the notification generation unit generates the notification instructing the operator to return a part of the taken-out components to the one storage unit; The information processing system, wherein the notification includes information on the number of components excessively taken out from the one storage unit, based on a difference between the number of the components derived by the number derivation unit and the number of the components instructed to be extracted by the instruction.

10. by an arithmetic processing unit a step of generating an instruction to extract at least one or more components from one storage unit among a plurality of storage units included in a storage shelf; a step of deriving the number of the components taken out from the one storage unit, based on the weight of the components taken out from the one storage unit; a step of determining whether or not the derived number of the components matches the number of the components instructed to be extracted by the instruction; a step of generating a notification to an operator who has taken out the components, based on a result of the determination; including when the derived number of the components is greater than the number of the components instructed to be extracted by the instruction, the notification instructing the operator to return a part of the taken-out components to the one storage unit is generated. An information processing method, wherein the notification includes information on the number of parts excessively taken out from the one storage unit based on the difference between the derived number of the parts and the number of the parts instructed to be taken out in the instruction.

11. A computer is caused to function as an instruction generation unit that generates an instruction to take out at least one part from one storage unit among a plurality of storage units included in a storage shelf, a number derivation unit that derives the number of the parts taken out from the one storage unit based on the weight of the parts taken out from the one storage unit, a determination unit that determines whether or not the derived number of the parts matches the number of the parts instructed to be taken out in the instruction, and a notification generation unit that generates a notification to an operator who has taken out the parts based on the determination result of the determination unit, wherein when the number of the parts derived by the number derivation unit is greater than the number of the parts instructed to be taken out in the instruction, the notification generation unit generates the notification instructing the operator to return a part of the taken-out parts to the one storage unit, and the notification includes information on the number of parts excessively taken out from the one storage unit based on the difference between the number of the parts derived by the number derivation unit and the number of the parts instructed to be taken out in the instruction.

Images