Assortment work support system, head-mounted display, and assortment work support method

Abstract

To enable support for assortment work without using a monitor.SOLUTION: An assortment work support system comprises: a setting information acquisition part 101 for acquiring setting information including component information as information representing one or more components as objects to be picked and the number of the components for each model, and storage container information as information representing a coordinate of a storage container storing the components, that is, a relative coordinate to a reference position for each component; a reference position specification part 102 for specifying the reference position; a model specification part 103 for specifying a model; and a picking guide part 107 which performs display indicating the components as present objects to be picked, the number of the components, and the storage container storing the components, on a screen of a head-mounted display 1, based on the setting information acquired by the setting information acquisition part 101, the reference position specified by the reference position specification part 102, and the model specified by the model specification part 103.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to an inventory arrangement task assistance system, a head mounted display, and an inventory arrangement task assistance method that assist a worker in an inventory arrangement task. [Background technology]

[0002] The stock arrangement work refers to the work of picking "designated parts" and "designated number" from multiple storage containers in which parts are stored, and arranging them in a designated place. For this stock arrangement work, stock arrangement work support systems for supporting the stock arrangement work have been known for some time (for example, see Patent Document 1).

[0003] In such a conventional assortment work support system, for example, a barcode is attached to each of a plurality of storage containers, and a monitor is provided that displays information related to the assortment work. In this assortment work support system, information indicating the parts to be picked, the number of the parts, and the storage container in which the parts are stored is displayed on the monitor. The worker picks the parts based on the information displayed on the monitor, and then uses a barcode reader to read the barcode attached to the storage container from which the part was picked. The assortment work support system then judges whether the picking was successful or not based on the result of reading by the barcode reader. Here, if the assortment work support system judges that the picking was incorrect, it displays on the monitor an indication that the picking was incorrect. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2006-306505 A Summary of the Invention [Problem to be solved by the invention]

[0005] In this way, the conventional stock arrangement work support system supports stock arrangement work by using a monitor. However, in this case, the worker needs to carry out the stock arrangement work while checking the monitor, which is cumbersome.

[0006] The present disclosure has been made to solve the above-mentioned problems, and aims to provide an inventory arrangement work support system that is capable of supporting inventory arrangement work without using a monitor. [Means for solving the problem]

[0007] The inventory work support system of the present disclosure is characterized by comprising a setting information acquisition unit that acquires setting information including part information, which is information indicating one or more parts to be picked and the number of parts for each model, and storage container information, which is information indicating the coordinates of the storage container in which the part is stored for each part, the coordinates being relative to a reference position; a reference position identification unit that identifies the model; and a picking guidance unit that displays, on a screen of a head-mounted display, the part currently to be picked, the number of parts, and the storage container in which the part is stored, based on the setting information acquired by the setting information acquisition unit, the reference position identified by the reference position identification unit, and the model identified by the model identification unit. Effect of the Invention

[0008] According to the present disclosure, with the above-mentioned configuration, it is possible to assist in stocking work without using a monitor. [Brief description of the drawings]

[0009] [Figure 1] 1 is a diagram illustrating an example of a configuration of an assortment operation support system according to a first embodiment. [Diagram 2] FIG. 2 is a diagram illustrating a configuration example of a head mounted display according to the first embodiment. [Diagram 3]FIG. 2 is a diagram illustrating an example of a configuration of a server according to the first embodiment. [Figure 4] 4 is a time chart showing an example of the operation of the assortment work support system according to the first embodiment. [Diagram 5] FIG. 2 is a diagram illustrating an example of the operation of the assortment operation support system according to the first embodiment. [Figure 6] FIG. 2 is a diagram illustrating an example of the operation of the assortment operation support system according to the first embodiment. [Figure 7] 7A and 7B are diagrams illustrating an example of a hardware configuration of the head mounted display and the server according to the first embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, the embodiments will be described in detail with reference to the drawings. Embodiment 1 FIG. 1 is a diagram showing an example of the configuration of an item sorting operation support system according to the first embodiment. The stock sorting operation support system is a system for supporting a worker in stock sorting operations. As shown in FIG. 1, the stock arrangement task support system includes a head mounted display 1, a server 2, and an image capturing device 3.

[0011] The head mounted display 1 is a device worn by a worker and supports the worker in the assortment work. Based on the picking result created by the server 2, if the picking result indicates that there is a picking error, the head mounted display 1 supports the assortment work by displaying the error. The picking result is information indicating whether the picking was good or bad.

[0012] This head mounted display 1 may be any display that can be worn by a worker and display a screen superimposed on the worker's field of vision, such as an MR (Mixed Reality) device, AR (Augmented Reality) glasses, or VR (Virtual Reality) glasses. A configuration example of the head mounted display 1 will be described later.

[0013] The server 2 is an information processing device that manages the stocking work by communicating with the head mounted display 1 and the camera 3. The server 2 acquires an image captured by the camera 3, and creates a picking result based on the image. The image includes an area where the parts picked by the worker are placed. The server 2 is, for example, a PC. An example of the configuration of this server 2 will be described later.

[0014] The photographing device 3 obtains an image by photographing an area where the parts picked by the worker are to be placed. The photographing device 3 photographs in response to an instruction from the server 2. The photographing device 3 is, for example, a web camera.

[0015] Next, a configuration example of the head mounted display 1 in the first embodiment will be described with reference to FIG. As shown in FIG. 2, the head mounted display 1 in embodiment 1 includes a setting information acquisition unit 101, a reference position identification unit 102, a model identification unit 103, a hand position detection unit 104, a result acquisition unit 105, a notification transmission / reception unit 106, a picking guidance unit 107, and a work log transmission unit 108.

[0016] The setting information acquisition unit 101 acquires setting information. At this time, for example, the setting information acquisition unit 101 acquires the setting information from the server 2 by making an acquisition request to the server 2. Alternatively, the setting information acquisition unit 101 may acquire the setting information held inside the head mounted display 1. The setting information includes, for example, part information and storage container information. The part information is information indicating, for each model, one or more parts to be picked and the number of the parts. The storage container information is information indicating, for each part, the coordinates of the storage container in which the part is stored. The coordinates of the storage container are relative coordinates with respect to a reference position.

[0017] Furthermore, when parts to be picked that are associated with the model exist in multiple locations, information indicating the picking order of the parts is added to the setting information.

[0018] The reference position identifying unit 102 identifies a reference position. At this time, for example, the reference position specifying unit 102 detects a QR marker attached to a shelf or the like on which a plurality of the storage containers are stored, and specifies the position of the QR marker as the reference position.

[0019] The model identification unit 103 identifies the model. At this time, for example, the model identification unit 103 detects a 2D code attached to a work instruction sheet or the like, and identifies the model from the 2D code.

[0020] The hand position detection unit 104 detects the position of the worker's hand. At this time, for example, the hand position detection unit 104 detects the positions of the worker's hands based on an image including the worker's hands obtained by an external imaging device (not shown) that the head mounted display 1 has.

[0021] The result acquisition unit 105 acquires the picking result from the server 2.

[0022] The notification transmission / reception unit 106 transmits and receives notifications to and from the server 2 . For example, when the picking work is completed, the notification transmitting / receiving unit 106 transmits a work completion notification to the server 2 based on the setting information acquired by the setting information acquiring unit 101 and the model identified by the model identifying unit 103. This work completion notification includes, for example, information that enables the head mounted display 1 to be identified, as well as information indicating the model, the parts to be picked, and the number of the parts. Also, for example, the notification transmitting / receiving unit 106 receives a notification from the server 2 that the work log has been saved.

[0023] The picking guidance unit 107 displays information to assist the picking work. Based on the setting information acquired by the setting information acquisition unit 101, the reference position identified by the reference position identification unit 102, and the model identified by the model identification unit 103, the picking guidance unit 107 displays on the screen of the head mounted display 1 the part currently to be picked, the number of parts, and the storage container in which the parts are stored. At this time, the picking guidance unit 107 first searches for a model identical to the model from the part information included in the setting information, and extracts information indicating the parts to be picked and the number of parts associated with the searched model.Then, the picking guidance unit 107 searches for the same parts as the parts indicated by the extracted information from the storage container information included in the setting information, and extracts information indicating the coordinates of the storage container associated with the searched parts.Then, the picking guidance unit 107 displays the storage container in which the parts to be picked are stored at a position on the screen based on the coordinates indicated by the extracted information and the reference position, and also displays the parts and the number of parts.

[0024] In addition, when there are multiple parts to be picked that are associated with the model, the picking guidance unit 107 performs the above display while switching to the next part to be picked each time a picking operation is completed, in accordance with the picking order of the parts to be picked.

[0025] In addition, the picking guidance unit 107 may display on the screen of the head mounted display 1 the distance between the position of the hand and the part currently to be picked, based on the setting information acquired by the setting information acquisition unit 101, the reference position identified by the reference position identification unit 102, the model identified by the model identification unit 103, and the position of the hand detected by the hand position detection unit 104.

[0026] In addition, the picking guidance unit 107 may display a warning at a position on the screen of the head mounted display 1 that corresponds to the position of the storage container in which the previous part to be picked is stored, based on the setting information acquired by the setting information acquisition unit 101, the reference position identified by the reference position identification unit 102, and the model identified by the model identification unit 103.

[0027] In addition, the picking guidance unit 107 may determine whether the hand is about to enter a storage container other than the storage container in which the part currently to be picked is stored, based on the setting information acquired by the setting information acquisition unit 101, the reference position identified by the reference position identification unit 102, the model identified by the model identification unit 103, and the position of the hand detected by the hand position detection unit 104. When the picking guidance unit 107 determines that the user is about to insert the hand into a storage container different from the storage container in which the part currently being picked is stored, the picking guidance unit 107 may issue a notification to that effect. At this time, the picking guidance unit 107 may display a message to that effect on the screen of the head mounted display 1, or may output a voice message to that effect from a voice output device (not shown) of the head mounted display 1.

[0028] Furthermore, when the picking result acquired by the result acquisition unit 105 indicates that there is a picking error, the picking guidance unit 107 displays, on the screen of the head mounted display 1, a message indicating that there is an error. Furthermore, at this time, the picking guiding unit 107 may output a voice indicating that an error has occurred by using a voice output device (not shown) that the head mounted display 1 has.

[0029] Furthermore, when the picking result acquired by the result acquisition unit 105 indicates that there was no picking error, the picking guidance unit 107 may display, on the screen of the head mounted display 1, a message indicating that there was no error. Furthermore, at this time, the picking guiding unit 107 may output a voice indicating that there is no error by using a voice output device (not shown) that the head mounted display 1 has.

[0030] When the picking work is completed, the work log transmission unit 108 creates a work log including traceability data and transmits the work log to the server 2. Examples of the traceability data include information that identifies the worker, information indicating the time required for the work, and information indicating the number of times the work was retried. Note that information that identifies the head mounted display 1 is added to the work log.

[0031] 2 shows a case where the work log transmission unit 108 is provided in the head mounted display 1 (stocking work support system). However, the work log transmission unit 108 is not an essential component of the head mounted display 1 (stocking work support system), and the work log transmission unit 108 does not have to be provided in the head mounted display 1 (stocking work support system).

[0032] Next, a configuration example of the server 2 in the first embodiment will be described with reference to FIG. The server 2 in the first embodiment includes a setting information transmitting unit 201, a notification transmitting / receiving unit 202, an image determining unit 203, a result transmitting unit 204, and a log saving unit 205, as shown in FIG.

[0033] The setting information transmission unit 201 detects an acquisition request from the head mounted display 1, and transmits setting information to the head mounted display 1 in response to the acquisition request.

[0034] The notification transmitting / receiving unit 202 transmits and receives notifications to and from the head mounted display 1. For example, when the log storage unit 205 has completed storing the work log, the notification transmission / reception unit 202 transmits a storage completion notification of the work log to the head mounted display 1 that is the transmission source of the work log. Note that, when the log storage unit 205 has failed to store the work log, the notification transmission / reception unit 202 transmits a notification to that effect to the head mounted display 1. Also, for example, the notification transmitting / receiving unit 202 receives a task completion notification from the head mounted display 1.

[0035] When the notification transmission / reception unit 202 receives a task completion notification, the image determination unit 203 performs a pass / fail determination of the picking task based on the image. At this time, for example, first, the image determination unit 203 instructs the photographing device 3 to photograph and acquires the image captured by the photographing device 3. Then, the image determination unit 203 performs quality determination of the picking work based on the parts to be picked and the number of the parts indicated in the work completion notification, and the acquired image.

[0036] The result transmission unit 204 creates a picking result based on the determination result by the image determination unit 203, and transmits the picking result to the head mounted display 1 which is the sender of the above-mentioned work completion notification.

[0037] The log storage unit 205 acquires the work log transmitted by the work log transmission unit 108 of the head mounted display 1, and stores the work log in a storage device (not shown) provided inside or outside the server 2. At this time, the log storage unit 205 stores the work log in association with information indicating the model indicated in the work completion notification received by the notification transmission / reception unit 202, based on information capable of identifying the head mounted display 1. Furthermore, the log storage unit 205 may store not only the operation log but also a system log in the storage device.

[0038] 3 shows a case where the setting information transmission unit 201 and the log storage unit 205 are provided in the server 2 (stocking work support system). However, the setting information transmission unit 201 and the log storage unit 205 are not essential components of the server 2 (stocking work support system), and the setting information transmission unit 201 and the log storage unit 205 do not have to be provided in the server 2 (stocking work support system).

[0039] 2 shows a case where the head mounted display 1 includes a setting information acquisition unit 101, a reference position identification unit 102, a model identification unit 103, a hand position detection unit 104, a result acquisition unit 105, a notification transmission / reception unit 106, a picking guidance unit 107, and a work log transmission unit 108. However, the present invention is not limited to this, and in the assortment work assistance system, some or all of the above components may be provided outside the head mounted display 1, for example, in the server 2.

[0040] 3 shows a case where the server 2 includes a setting information transmission unit 201, a notification transmission / reception unit 202, an image determination unit 203, a result transmission unit 204, and a log storage unit 205. However, the present invention is not limited to this, and in the inventory assortment work support system, some or all of the above components may be provided outside the server 2, for example, in the head mounted display 1.

[0041] Next, an example of the operation of the stock arrangement work support system according to the first embodiment shown in FIGS. 1 to 3 will be described with reference to FIG. It is assumed that the setting information acquisition unit 101 has acquired the setting information in advance. It is assumed that the hand position detection unit 104 detects the position of the worker's hand constantly or at a predetermined interval. The following description will show a case where there are multiple parts to be picked that are associated with the model (n is 2 or more). It will also show a case where the picking guidance unit 107 issues a notification indicating that the hand is about to be inserted into a storage container different from the storage container in which the part to be currently picked is stored, when the picking result indicates that there is no picking error. It will also show a case where the picking guidance unit 107 issues a display indicating that there is no error.

[0042] In an operation example of the assortment task assistance system according to the first embodiment shown in FIGS. 1 to 3, first, as shown in FIG. 4, for example, in the head mounted display 1, the reference position identifying unit 102 identifies a reference position (step ST101). At this time, for example, the reference position identifying unit 102 detects a QR marker attached to a shelf or the like on which a plurality of the storage containers are stored, and identifies the position of the QR marker as the reference position. This enables the head mounted display 1 to associate the coordinates of the screen of the head mounted display 1 with the coordinates of the real space.

[0043] Next, in the head mounted display 1, the model identification unit 103 identifies the model (step ST102). At this time, for example, the model identification unit 103 detects a 2D code attached to a work instruction sheet or the like, and identifies the model from the 2D code.

[0044] Moreover, the head mounted display 1 initializes (n=1) the number of the part to be picked (step ST103).

[0045] Next, in the head mounted display 1, the picking guidance unit 107 displays on the screen of the head mounted display 1 the part currently to be picked, the number of parts, and the storage container in which the parts are stored, based on the setting information acquired by the setting information acquisition unit 101, the reference position identified by the reference position identification unit 102, and the model identified by the model identification unit 103 (step ST104). At this time, for example, first, the picking guidance unit 107 searches for a model identical to the model from the part information included in the setting information, and extracts information indicating the parts to be picked and the number of parts associated with the searched model.Then, the picking guidance unit 107 searches for the same parts as the parts indicated by the extracted information from the storage container information included in the setting information, and extracts information indicating the coordinates of the storage container associated with the searched parts.Then, the picking guidance unit 107 displays the storage container in which the parts to be picked are stored at a position on the screen based on the coordinates indicated by the extracted information and the reference position, and also displays the parts and the number of parts.

[0046] For example, as indicated by reference numerals 51 and 52 in Fig. 5, the picking guidance unit 107 displays an icon indicating a storage container in which a part currently to be picked is stored at a position on the screen of the head mounted display 1 corresponding to the storage container, and also displays an icon indicating the part and the number of the parts. In the example of Fig. 5, a frame surrounding the storage container in which the part currently to be picked is stored, indicated by reference numeral 51, and a speech bubble indicating the part and the number of the parts, indicated by reference numeral 52, are displayed.

[0047] In addition, the picking guidance unit 107 may display on the screen of the head mounted display 1 the distance between the position of the hand and the part currently to be picked, based on the setting information acquired by the setting information acquisition unit 101, the reference position identified by the reference position identification unit 102, the model identified by the model identification unit 103, and the position of the hand detected by the hand position detection unit 104.

[0048] For example, the picking guidance unit 107 expresses distance by displaying icons with different display forms such as colors depending on whether the position of the hand and the storage container in which the part is stored are farther or closer than a threshold value. For example, the picking guidance unit 107 may display the color of the icon indicated by the reference numeral 51 in red when the position of the hand and the storage container in which the part is stored are farther or closer than the threshold value, and may display the color in green when the position of the hand and the storage container in which the part is stored are closer than the threshold value.

[0049] In addition, the picking guidance unit 107 may display, on the screen of the head-mounted display 1, a position corresponding to the position of the storage container in which the previous part to be picked is stored, and a warning, based on the setting information acquired by the setting information acquisition unit 101, the reference position identified by the reference position identification unit 102, and the model identified by the model identification unit 103.

[0050] 5, the picking guidance unit 107 may display an icon indicating a storage container in which the part to be picked immediately before is stored, at a position corresponding to the storage container on the screen of the head mounted display 1. In this case, the picking guidance unit 107 sets the display form of the icon, such as a color, to be different from that of the icon indicating the storage container in which the part to be picked currently is stored.

[0051] The worker then picks up the parts.

[0052] Also, the picking guidance unit 107 judges whether the hand is about to enter a storage container other than the storage container in which the part currently to be picked is stored, based on the setting information acquired by the setting information acquisition unit 101, the reference position identified by the reference position identification unit 102, the model identified by the model identification unit 103, and the position of the hand detected by the hand position detection unit 104. At this time, the head mounted display 1 judges whether the hand has entered a storage container other than the storage container in which the part currently to be picked is stored, based on the position of the hand detected by the hand position detection unit 104. Then, when the picking guidance unit 107 determines that the hand is about to be inserted into a storage container different from the storage container in which the part currently being picked is stored, it issues a notification to that effect (step ST105). At this time, the picking guidance unit 107 may display an indication of the above effect on the screen of the head mounted display 1, or may output an audio indication of the above effect from an audio output device (not shown) of the head mounted display 1.

[0053] Next, when the head mounted display 1 determines that the part currently to be picked has been picked by the worker based on the setting information acquired by the setting information acquisition unit 101, the reference position identified by the reference position identification unit 102, the model identified by the model identification unit 103, and the position of the hand detected by the hand position detection unit 104, it updates the number of the part currently to be picked to the next number (n=n+1) (step ST106). At this time, for example, based on the position of the hand detected by the hand position detection unit 104, when the hand enters and exits the storage container in which the part currently to be picked is stored, the head mounted display 1 determines that the part currently to be picked has been picked. Then, the sequence returns to step ST 104. Then, the picking guidance unit 107 switches to the next part to be picked and displays it according to the picking order of the parts to be picked. If the head mounted display 1 cannot update the number of the part to be picked to the next number, that is, if the number of the current part to be picked is the final number, the sequence proceeds to step ST107.

[0054] Next, in the head mounted display 1, the notification transmitting / receiving unit 106 transmits a work completion notification to the server 2 based on the setting information acquired by the setting information acquiring unit 101 and the model identified by the model identifying unit 103, and in the server 2, the notification transmitting / receiving unit 202 receives the work completion notification (step ST107). This work completion notification includes, for example, information that enables the head mounted display 1 to be identified, as well as information indicating the model, the parts to be picked, and the number of the parts.

[0055] Next, in the server 2, the image assessment unit 203 assesses the acceptability of the picking operation based on the image (steps ST108 to ST111). At this time, for example, first, the image determination unit 203 instructs the photographing device 3 to photograph and acquires the image captured by the photographing device 3. Then, the image determination unit 203 performs quality determination of the picking work based on the parts to be picked and the number of the parts indicated in the work completion notification, and the acquired image.

[0056] For example, in image determination by the image determination unit 203, the logical sum of histogram comparison and feature point matching is used as the determination result. That is, in this case, in image determination, a correct image is prepared for each model, and the logical sum of the following two matching methods is taken. First, in the histogram comparison, the similarity is calculated in the range of [-1, 1], and a pass / fail judgment is made for this similarity using a threshold value. Next, for example, brute-force matching using the k-Nearest Neighbor (kNN) method is used to match feature points. The matching result is calculated based on the number of matches (an integer equal to or greater than 0), and a pass / fail judgment is made based on this number of matches using a threshold value. The threshold value for determining whether a response is correct may be arbitrarily specified for each model.

[0057] Next, in the server 2, the result transmission unit 204 creates a picking result based on the judgment result by the image judgment unit 203 and transmits the picking result to the head mounted display 1, and in the head mounted display 1, the result acquisition unit 105 acquires the picking result (steps ST112, ST113).

[0058] Here, if the picking result acquired by the result acquisition unit 105 indicates that there is no picking error, the picking guidance unit 107 in the head mounted display 1 displays an indication of the absence of error on the screen of the head mounted display 1 (step ST114). Furthermore, at this time, the picking guiding unit 107 may output a voice indicating that there is no error by using a voice output device (not shown) that the head mounted display 1 has. After that, the sequence proceeds to step ST116.

[0059] On the other hand, if the picking result acquired by the result acquisition unit 105 indicates that there was a picking error, the picking guidance unit 107 in the head mounted display 1 displays an indication of the error on the screen of the head mounted display 1 (step ST115). Furthermore, at this time, the picking guiding unit 107 may output a voice indicating that an error has occurred by using a voice output device (not shown) that the head mounted display 1 has.

[0060] For example, as indicated by reference numeral 61 in Fig. 6, the picking guiding unit 107 displays a message indicating that an error has occurred on the screen of the head mounted display 1. Note that the display indicated by reference numeral 61 in Fig. 6 also displays a "Confirm" button to prompt the worker to make a confirmation.

[0061] Then, the worker redoes the picking operation. In the example of FIG. 6, the worker presses the "Confirm" button. The sequence then proceeds to step ST116.

[0062] Next, in the head mounted display 1, the work log sending unit 108 creates a work log including the traceability data and sends the work log to the server 2, and in the server 2, the log saving unit 205 acquires the work log (step ST116). Examples of the traceability data include information that can identify the worker, information indicating the time required for the work, and information indicating the number of redoes. Note that information that can identify the head mounted display 1 is added to the work log.

[0063] Next, in the server 2, the log storage unit 205 stores the acquired work log in a storage device (not shown) provided inside or outside the server 2 (step ST117). At this time, for example, the log storage unit 205 associates the above-mentioned work log with the model indicated in the work completion notification received by the notification transmission / reception unit 202 based on information capable of identifying the head mounted display 1, and stores it in a storage device. Furthermore, the log storage unit 205 may store not only the operation log but also a system log in the storage device.

[0064] Next, in the server 2, the notification transmitting / receiving unit 202 transmits a storage completion notification of the work log to the head mounted display 1 which is the transmission source of the work log, and in the head mounted display 1, the notification transmitting / receiving unit 106 receives the storage completion notification of the work log (step ST118). Note that, if the log storage unit 205 fails to store the work log, the notification transmitting / receiving unit 202 transmits a notification indicating that fact to the head mounted display 1. After that, the sequence returns to step ST102.

[0065] In the example of operation of the stock-picking operation support system shown in Fig. 4, when the worker has completed picking all the parts to be picked that correspond to the model, the head mounted display 1 notifies the server 2 of the completion of the operation, and after receiving the notification, the server 2 judges whether the picking is good or bad. That is, in this case, the quality of the picking is judged collectively for all the parts corresponding to the model. However, the present invention is not limited to this, and the stock picking operation support system may operate such that the head mounted display 1 notifies the server 2 of the completion of the operation every time the worker finishes picking an individual part that is a picking target corresponding to a model, and the server 2 judges the quality of the picking after receiving the notice. That is, in this case, the quality of the picking is judged for each individual part corresponding to a model each time.

[0066] In the above-described inventory selection operation support system, the server 2 creates picking results based on images. Without being limited thereto, for example, in an inventory arrangement work support system, the server 2 may generate picking results based on images and weights.

[0067] In this case, for example, the stocking operation support system includes a measuring device in addition to the configuration shown in Fig. 1. This measuring device measures the total weight of each storage container in which parts are stored and the parts stored in that storage container. This measuring device performs measurements in response to instructions from server 2. This measuring device is, for example, an electronic balance.

[0068] Then, the server 2 acquires the image captured by the photographing device 3 and the weight measured by the measuring device, and creates a picking result from the image and the weight. More specifically, the server 2 has a weight determination unit in addition to the configuration shown in Fig. 3. When a work completion notification is received by the notification transmission / reception unit 202, this weight determination unit determines whether the picking work is good or bad based on the weight. In this case, for example, the weight determination unit first instructs a measuring device to measure and obtains the weight measured by the measuring device.Then, the weight determination unit determines whether the picking work is good or bad based on the parts to be picked and the number of parts indicated in the work completion notice, and the obtained weight.In this case, the work completion notice includes information indicating the weight of the part alone, and the weight determination unit uses this information to perform the pass / fail determination. Then, the result transmission unit 204 creates a picking result based on the judgment result by the image judgment unit 203 and the judgment result by the weight judgment unit, and transmits the picking result to the head mounted display 1, which is the sender of the above-mentioned work completion notification.

[0069] In this way, the stocking operation support system according to the first embodiment uses the head mounted display 1 to display an indication of a picking error when the picking result based on the image indicates that there is a picking error. This makes it possible for the stocking operation support system according to the first embodiment to support stocking operation without using a monitor.

[0070] Furthermore, in the inventory selection work support system according to embodiment 1, the progress of the work can be automatically determined and the system can automatically proceed in accordance with the progress of the work, thereby improving workability and speed. That is, conventionally, when a worker completes picking, the worker uses a barcode reader to read the barcode. In this case, the worker needs to read the barcode every time he or she completes picking. This can result in a loss of time while pressing the button and a misreading. In addition, there is a possibility that a picking error will occur. For example, there is a possibility that the worker will pick the part next to the specified part. In contrast, the inventory assortment work support system according to embodiment 1 eliminates the need to read barcodes, and the system can determine when picking is complete. As a result, the inventory assortment work support system according to embodiment 1 automatically performs the determination, allowing the worker to concentrate on the picking work. In other words, the worker does not need to perform a reading operation. Furthermore, the inventory assortment work support system according to embodiment 1 automatically performs the determination, so there is no risk of the worker misreading. Furthermore, the inventory assortment work support system according to embodiment 1 is capable of detecting errors when making the determination. Therefore, the inventory assortment work support system according to embodiment 1 is capable of immediately issuing a warning when a picking error is detected.

[0071] Moreover, in the stocking work support system according to embodiment 1, it is possible to reduce the need for workers to move their eyes to check work procedures, etc., compared to conventional systems, thereby enabling the speed of work to be improved and the physical burden to be reduced. That is, conventionally, work instructions are displayed on a monitor. In this case, the worker needs to check the monitor for each task. This requires movement of the neck or waist, which places a physical burden on the worker. Even if the burden is small each time, the burden increases if the number of times is large. In addition, the frequent movement of the line of sight requires a lot of time to search for the necessary information on the monitor. In contrast, the stocking work support system according to the first embodiment makes it possible to display only the necessary information in the space in front of the worker. As a result, the stocking work support system according to the first embodiment does not require the worker to change his / her posture, reducing physical movement and easing the burden on the worker. In addition, if the number of times is large, this can also contribute to reducing time. Furthermore, the stocking work support system according to the first embodiment can display the necessary information in front of the worker, eliminating the need for the worker to go through the trouble of searching for the necessary information.

[0072] Moreover, the stock arrangement work support system according to the first embodiment can be used to provide work procedure guidance to new employees, which is expected to reduce training costs. In other words, in the past, it was necessary to confirm the work procedures based on an instructor or a procedure manual. In this case, it was difficult to secure the man-hours and time for both the instructor and the newcomer. Also, the procedure manual can be difficult to understand, or it can get in the way. Also, there are differences in the level of guidance provided by instructors. In contrast, the stocking work support system according to the first embodiment can display work procedures on the actual items. As a result, the stocking work support system according to the first embodiment allows a new employee to check the procedures by himself. Furthermore, the stocking work support system according to the first embodiment is easy to understand because it can display on the actual items. Furthermore, the stocking work support system according to the first embodiment makes it possible to train employees on uniform quality.

[0073] Also, for example, a conventional assortment work support system is known in which a light and a button are attached to each of a plurality of storage containers (see, for example, Patent Document 2). In this assortment work support system, the light corresponding to the storage container in which the part to be picked is stored is turned on. The worker picks the part from the storage container with the light turned on, and then presses the button corresponding to that storage container. In response to pressing the button, the assortment work support system transitions to turning on the light corresponding to the storage container in which the next part to be picked is stored. [Patent Document 2] JP 2008-30919 A

[0074] In contrast, the stock arrangement work assistance system according to the first embodiment enables improved maintainability and effective use of space. That is, conventionally, a light and a button are provided for each storage container. In this case, since there are many lights and buttons, the risk of failure is high and they take up a lot of space. Furthermore, downtime is long when hardware fails. Furthermore, it takes time to respond when a new model or specification change is made. Furthermore, it is time-consuming to set addresses when rearranging parts. Furthermore, it is sometimes difficult to know which button corresponds to which storage container, which may lead to mistakes. In contrast, in the stocking work support system according to the first embodiment, the display system can be consolidated in the head mounted display 1. As a result, in the stocking work support system according to the first embodiment, there is no restriction on the shape and size of the storage container. In addition, in the stocking work support system according to the first embodiment, devices such as switches are not required, and space saving can be realized. In addition, in the stocking work support system according to the first embodiment, since there is no electronic hardware of the picking table, it is possible to reduce the risk of failure and expand the space that can be used as a storage container. In addition, in the stocking work support system according to the first embodiment, if multiple head mounted displays 1 are prepared, they can be easily replaced. In addition, in the stocking work support system according to the first embodiment, flexible specifications can be accommodated simply by setting the software.

[0075] As described above, according to the first embodiment, the assortment operation support system includes a setting information acquisition unit 101 that acquires setting information including part information, which is information indicating one or more parts to be picked for each model and the number of the parts, and storage container information, which is information indicating the coordinates of the storage container in which the part is stored for each part and is relative to a reference position, a reference position identification unit 102 that identifies a reference position, a model identification unit 103 that identifies a model, and a picking guidance unit 107 that displays the part currently to be picked, the number of the parts, and the storage container in which the part is stored, on the screen of the head mounted display 1 based on the setting information acquired by the setting information acquisition unit 101, the reference position identified by the reference position identification unit 102, and the model identified by the model identification unit 103. This makes it possible for the assortment operation support system according to the first embodiment to support assortment operations without using a monitor.

[0076] Finally, with reference to FIG. 7, a hardware configuration example of the head mounted display 1 and the server 2 according to the first embodiment will be described. The functions of the setting information acquisition unit 101, the reference position identification unit 102, the model identification unit 103, the hand position detection unit 104, the result acquisition unit 105, the notification transmission / reception unit 106, the picking guidance unit 107, and the work log transmission unit 108 in the head mounted display 1 are realized by a processing circuit 501. The processing circuit 501 may be dedicated hardware as shown in Fig. 7A, or may be a CPU (also called a central processing unit, processing unit, arithmetic unit, microprocessor, microcomputer, processor, or DSP (Digital Signal Processor)) 502 that executes a program stored in a memory 503 as shown in Fig. 7B.

[0077] When the processing circuit 501 is a dedicated hardware, the processing circuit 501 corresponds to, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or a combination of these. The functions of each of the setting information acquisition unit 101, the reference position identification unit 102, the model identification unit 103, the hand position detection unit 104, the result acquisition unit 105, the notification transmission / reception unit 106, the picking guidance unit 107, and the work log transmission unit 108 may be realized by the processing circuit 501 individually, or the functions of each unit may be realized by the processing circuit 501 collectively.

[0078] When the processing circuit 501 is a CPU 502, the functions of the setting information acquisition unit 101, the reference position identification unit 102, the model identification unit 103, the hand position detection unit 104, the result acquisition unit 105, the notification transmission / reception unit 106, the picking guidance unit 107, and the work log transmission unit 108 are realized by software, firmware, or a combination of software and firmware. The software and firmware are described as programs and stored in the memory 503. The processing circuit 501 realizes the functions of each unit by reading and executing the programs stored in the memory 503. That is, the head mounted display 1 includes a memory 503 for storing a program that, when executed by the processing circuit 501, results in the execution of each step shown in FIG. 4, for example. These programs can also be said to cause a computer to execute procedures and methods of the setting information acquisition unit 101, the reference position identification unit 102, the model identification unit 103, the hand position detection unit 104, the result acquisition unit 105, the notification transmission / reception unit 106, the picking guidance unit 107, and the work log transmission unit 108. Here, examples of the memory 503 include non-volatile or volatile semiconductor memories such as RAM (Random Access Memory), ROM (Read Only Memory), flash memory, EPROM (Erasable Programmable ROM), and EEPROM (Electrically EPROM), magnetic disks, flexible disks, optical disks, compact disks, mini disks, and DVDs (Digital Versatile Discs).

[0079] The functions of the setting information acquisition unit 101, the reference position identification unit 102, the model identification unit 103, the hand position detection unit 104, the result acquisition unit 105, the notification transmission / reception unit 106, the picking guidance unit 107, and the work log transmission unit 108 may be partially realized by dedicated hardware and partially realized by software or firmware. For example, the function of the setting information acquisition unit 101 may be realized by a processing circuit 501 as dedicated hardware, and the functions of the reference position identification unit 102, the model identification unit 103, the hand position detection unit 104, the result acquisition unit 105, the notification transmission / reception unit 106, the picking guidance unit 107, and the work log transmission unit 108 may be realized by the processing circuit 501 reading out and executing a program stored in the memory 503.

[0080] Thus, the processing circuitry 501 can realize each of the above-described functions by hardware, software, firmware, or a combination of these.

[0081] Furthermore, the functions of the setting information transmission unit 201, the notification transmission / reception unit 202, the image determination unit 203, the result transmission unit 204, and the log storage unit 205 in the server 2 are realized by a processing circuit 501. The processing circuit 501 may be dedicated hardware as shown in Fig. 7A, or may be a CPU 502 that executes a program stored in a memory 503 as shown in Fig. 7B.

[0082] When the processing circuit 501 is a dedicated hardware, the processing circuit 501 corresponds to, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC, an FPGA, or a combination of these. The functions of each of the setting information transmission unit 201, the notification transmission / reception unit 202, the image determination unit 203, the result transmission unit 204, and the log storage unit 205 may be realized by the processing circuit 501, or the functions of each unit may be realized by the processing circuit 501 collectively.

[0083] When the processing circuit 501 is a CPU 502, the functions of the setting information transmission unit 201, the notification transmission / reception unit 202, the image determination unit 203, the result transmission unit 204, and the log storage unit 205 are realized by software, firmware, or a combination of software and firmware. The software and firmware are written as programs and stored in the memory 503. The processing circuit 501 realizes the functions of each unit by reading and executing the programs stored in the memory 503. That is, the server 2 includes a memory 503 for storing a program that, when executed by the processing circuit 501, results in the execution of each step shown in FIG. 4. It can also be said that these programs cause a computer to execute the procedures and methods of the setting information transmission unit 201, the notification transmission / reception unit 202, the image determination unit 203, the result transmission unit 204, and the log storage unit 205. Here, memory 503 may be, for example, a RAM, a ROM, a flash memory, a non-volatile or volatile semiconductor memory such as an EPROM or an EEPROM, a magnetic disk, a flexible disk, an optical disk, a compact disk, a mini disk, or a DVD.

[0084] It should be noted that the functions of the setting information transmission unit 201, the notification transmission / reception unit 202, the image determination unit 203, the result transmission unit 204, and the log storage unit 205 may be partially realized by dedicated hardware and partially realized by software or firmware. For example, the function of the setting information transmission unit 201 may be realized by a processing circuit 501 as dedicated hardware, and the functions of the notification transmission / reception unit 202, the image determination unit 203, the result transmission unit 204, and the log storage unit 205 may be realized by the processing circuit 501 reading out and executing a program stored in a memory 503.

[0085] Thus, the processing circuitry 501 can realize each of the above-described functions by hardware, software, firmware, or a combination of these.

[0086] Any of the components of the embodiments may be modified or omitted.

[0087] Various aspects of the present disclosure are summarized below as appendices.

[0088] (Appendix 1) a setting information acquisition unit that acquires setting information including part information, which is information indicating one or more parts to be picked and the number of the parts for each model, and storage container information, which is information indicating the coordinates of the storage container in which the part is stored for each part and is relative coordinates with respect to a reference position; a reference position specifying unit for specifying a reference position; A model identification unit that identifies a model; a picking guidance unit that displays, on a screen of a head mounted display, the part that is currently being picked, the number of the parts, and the storage container in which the parts are stored, based on the setting information acquired by the setting information acquisition unit, the reference position identified by the reference position identification unit, and the model identified by the model identification unit; An inventory support system equipped with the above. (Appendix 2) an image determination unit that determines whether a picking operation is satisfactory based on an image including parts to be picked and the number of parts based on the setting information acquired by the setting information acquisition unit and the model acquired by the model identification unit, and an area in which the parts picked by the worker are to be placed; A result transmission unit that creates a picking result based on the determination result by the image determination unit and transmits the picking result; a result acquisition unit that acquires the picking result transmitted by the result transmission unit, When the picking result acquired by the result acquisition unit indicates that there is a picking error, the picking guidance unit displays, on a screen of the head mounted display, a message indicating that there is a picking error. 2. The inventory arrangement work support system according to claim 1, (Appendix 3) A hand position detection unit is provided to detect the position of a hand of a worker, When the picking guidance unit determines that the hand is about to be inserted into a storage container different from the storage container in which the part currently being picked is stored, based on the setting information acquired by the setting information acquisition unit, the reference position identified by the reference position identification unit, the model identified by the model identification unit, and the position of the hand detected by the hand position detection unit, the picking guidance unit issues a notification to that effect. 3. The inventory arrangement work support system according to claim 1 or 2, (Appendix 4) a work log transmission unit that creates a work log including traceability data when the picking work is completed and transmits the work log; a log storage unit that acquires the work log transmitted by the work log transmission unit and stores the work log in a storage device; 4. The product arrangement work support system according to claim 1, (Appendix 5) a setting information acquisition unit that acquires setting information including part information, which is information indicating one or more parts to be picked and the number of the parts for each model, and storage container information, which is information indicating the coordinates of the storage container in which the part is stored for each part and is relative coordinates with respect to a reference position; a reference position specifying unit for specifying a reference position; A model identification unit that identifies a model; a picking guidance unit that displays, on a screen of the device itself, the part currently being picked, the number of the parts, and the storage container in which the parts are stored, based on the setting information acquired by the setting information acquisition unit, the reference position identified by the reference position identification unit, and the model identified by the model identification unit; Equipped with a head mounted display. (Appendix 6) A setting information acquisition unit acquires setting information including part information, which is information indicating one or more parts to be picked and the number of the parts for each model, and storage container information, which is information indicating the coordinates of the storage container in which the part is stored for each part and is relative to a reference position; A reference position specifying unit specifies a reference position; A model identification unit identifies a model; a picking guidance unit displays, on a screen of a head mounted display, the part currently being picked, the number of the parts, and the storage container in which the parts are stored, based on the setting information acquired by the setting information acquisition unit, the reference position identified by the reference position identification unit, and the model identified by the model identification unit; The present invention relates to a product assortment operation support method. [Explanation of symbols]

[0089] 1 Head mounted display, 2 Server, 3 Imaging device, 101 Setting information acquisition unit, 102 Reference position identification unit, 103 Model identification unit, 104 Hand position detection unit, 105 Result acquisition unit, 106 Notification transmission / reception unit, 107 Picking guidance unit, 108 Work log transmission unit, 201 Setting information transmission unit, 202 Notification transmission / reception unit, 203 Image judgment unit, 204 Result transmission unit, 205 Log storage unit, 501 Processing circuit, 502 CPU, 503 Memory.

Claims

1. a setting information acquisition unit that acquires setting information including part information, which is information indicating one or more parts to be picked and the number of the parts for each model, and storage container information, which is information indicating the coordinates of a storage container in which the part is stored for each part and is relative coordinates with respect to a reference position; a reference position specifying unit for specifying a reference position; A model identification unit that identifies a model; a picking guidance unit that displays, on a screen of a head mounted display, the part that is currently being picked, the number of the parts, and the storage container in which the parts are stored, based on the setting information acquired by the setting information acquisition unit, the reference position identified by the reference position identification unit, and the model identified by the model identification unit; An inventory support system equipped with the above.

2. an image determination unit that determines whether a picking operation is satisfactory based on an image including parts to be picked and the number of parts based on the setting information acquired by the setting information acquisition unit and the model acquired by the model identification unit, and an area in which the parts picked by the worker are to be placed; A result transmission unit that creates a picking result based on the determination result by the image determination unit and transmits the picking result; a result acquisition unit that acquires the picking result transmitted by the result transmission unit, When the picking result acquired by the result acquisition unit indicates that there is a picking error, the picking guidance unit displays, on a screen of the head mounted display, a message indicating that there is a picking error.

2. The product sorting operation support system according to claim 1.

3. A hand position detection unit is provided to detect the position of a hand of a worker, When the picking guidance unit determines that the hand is about to be inserted into a storage container different from the storage container in which the part currently being picked is stored, based on the setting information acquired by the setting information acquisition unit, the reference position identified by the reference position identification unit, the model identified by the model identification unit, and the position of the hand detected by the hand position detection unit, the picking guidance unit issues a notification to that effect.

2. The product sorting operation support system according to claim 1.

4. a work log transmission unit that creates a work log including traceability data when the picking work is completed and transmits the work log; a log storage unit that acquires the work log transmitted by the work log transmission unit and stores the work log in a storage device; 2. The product sorting operation support system according to claim 1.

5. a setting information acquisition unit that acquires setting information including part information, which is information indicating one or more parts to be picked and the number of the parts for each model, and storage container information, which is information indicating the coordinates of a storage container in which the part is stored for each part and is relative coordinates with respect to a reference position; a reference position specifying unit for specifying a reference position; A model identification unit that identifies a model; a picking guidance unit that displays, on a screen of the device itself, the part currently being picked, the number of the parts, and the storage container in which the parts are stored, based on the setting information acquired by the setting information acquisition unit, the reference position identified by the reference position identification unit, and the model identified by the model identification unit; Equipped with a head mounted display.

6. A setting information acquisition unit acquires setting information including part information, which is information indicating one or more parts to be picked and the number of the parts for each model, and storage container information, which is information indicating the coordinates of a storage container in which the part is stored for each part and is relative to a reference position; A reference position specifying unit specifies a reference position; A model identification unit identifies a model; a picking guidance unit displays, on a screen of a head mounted display, the part currently being picked, the number of the parts, and the storage container in which the parts are stored, based on the setting information acquired by the setting information acquisition unit, the reference position identified by the reference position identification unit, and the model identified by the model identification unit; The present invention relates to a product assortment operation support method.

Images