Method, management system and program for managing handling operations at a logistics center

JP7639792B2Active Publication Date: 2025-03-05TOYOTA JIDOSHA KK
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
JP2022131878
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-08-22
Publication Date
2025-03-05
Estimated Expiration
2042-08-22

AI Technical Summary

Benefits of technology

【0015】 以上述べたように、本開示の方法、システム及びプログラムによれば、物流センタにおいて行われるハンドリング作業に遅れが生じたときに、ハンドリング作業のどの動作に問題があるのかを特定することが可能となる。

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007639792000001
    Figure 0007639792000001
  • Figure 0007639792000002
    Figure 0007639792000002
  • Figure 0007639792000003
    Figure 0007639792000003
Patent Text Reader

Abstract

To identify a faulty action of handling operation when a delay occurs in the handling operation conducted in a distribution center.SOLUTION: A method comprises: calculating, by simulation, a model time required for each action of handling operation for an object handled in a distribution center; identifying a start time and an end time of each action of the handling operation based on an analysis of camera image data obtained in the distribution center; calculating an actual time required for each action of the handling operation from a time difference between the identified start time and end time; and calculating a difference between the actual time required and the model time required for each action of the handling operation.SELECTED DRAWING: Figure 5
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a management method, a management system, and a management program for handling operations in a logistics center. [Background technology]

[0002] Japanese Patent Application Laid-Open Publication No. 2007-041950 discloses a system that performs a simulation for managing a production line. This system compares the results of the simulation with actual data from the actual line and displays the comparison result. Furthermore, if the compared value is worse than a preset value or an overall average value including other simulations, this system determines that attention is required and adds and registers information about cautions to the comparison contents. By registering the information about cautions, it becomes possible to grasp problems with the production line.

[0003] In the conventional technology described in JP 2007-041950 A, the simulation results are assumed to be the number of inputs, output, work in progress, lead time, personnel, and production efficiency. In other words, in the conventional technology, these evaluation items are acquired as performance data and compared with the simulation results. However, these evaluation items are set with a focus on the entire process on the production line, and do not focus on the individual actions of the workers or robots involved in each process. Therefore, in the conventional technology, it is not possible to evaluate whether the time required for each action is delayed compared to a reference time.

[0004] In addition to JP-A-2007-041950, other examples of documents showing the state of the art in the technical field related to the present disclosure include JP-A-2007-094981 and JP-A-2007-133543. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2007-041950 A [Patent Document 2] JP 2007-094981 A [Patent Document 3] JP 2007-133543 A Summary of the Invention [Problem to be solved by the invention]

[0006] In a logistics center, handling of goods, luggage, and other items is performed by multiple workers and robots. If it is possible to evaluate whether the time required for each handling operation is delayed compared to a reference time, it will be possible to identify which handling operation has a problem when a delay occurs in the handling operation. If the problem can be identified at the operation level, it is expected that specific and appropriate improvement measures for the delay can be considered.

[0007] The present disclosure has been made in consideration of the above problems. One objective of the present disclosure is to make it possible to identify which operation in a handling operation has a problem when a delay occurs in the handling operation performed at a logistics center. [Means for solving the problem]

[0008] The present disclosure provides a method for managing handling operations in a logistics center. The method of the present disclosure includes the following first to fourth steps. The first step is a step of calculating, by simulation, a model required time for each operation of the handling operation for an item handled in the logistics center. The second step is a step of identifying the start time and end time of each operation of the handling operation based on an analysis of camera image data of the logistics center. The third step is a step of calculating the actual required time for each operation of the handling operation from the time difference between the start time and end time of each operation of the handling operation. And the fourth step is a step of calculating the difference between the actual required time and the model required time for each operation of the handling operation.

[0009] The present disclosure also provides a management system for handling operations in a logistics center. The system of the present disclosure includes one or more processors and a program memory coupled to the one or more processors and storing a plurality of instructions. The plurality of instructions are configured to cause the one or more processors to execute the following first to fourth processes. The first process is a process of calculating, by simulation, a model required time for each operation of a handling operation for an object handled in the logistics center. The second process is a process of identifying a start time and an end time for each operation of the handling operation based on an analysis of camera image data of the logistics center. The third process is a process of calculating an actual required time for each operation of the handling operation from a time difference between a start time and an end time for each operation of the handling operation. And the fourth process is a process of calculating a difference between an actual required time and a model required time for each operation of the handling operation.

[0010] The present disclosure further provides a management program for handling operations in a logistics center. The program of the present disclosure is configured to cause a computer to execute the above-mentioned first to fourth processes.

[0011] According to the method, system, and program disclosed herein, the start and end times of each handling operation are identified by analyzing camera images, making it possible to compare the results of simulation calculations of the time required for each handling operation with actual results. Therefore, when a delay occurs in the handling operation at a logistics center, it becomes possible to identify which handling operation has a problem.

[0012] The method of the present disclosure may further include the following fifth to eighth steps. The fifth step is a step of calculating, by simulation, a model required time for each element motion when each motion of a handling operation is decomposed into one or more element motions. The sixth step is a step of identifying a start time and an end time for each element motion based on an analysis of camera image data of the logistics center. The seventh step is a step of calculating an actual required time for each element motion from the time difference between the start time and end time of each element motion. And the eighth step is a step of calculating the difference between the actual required time and the model required time for each element motion.

[0013] In the system of the present disclosure, the instructions may be configured to cause the one or more processors to execute the following fifth to eighth processes. The fifth process is a process for calculating, by simulation, a model required time for each element motion when each motion of a handling operation is decomposed into one or more element motions. The sixth process is a process for identifying a start time and an end time for each element motion based on an analysis of camera image data of a logistics center. The seventh process is a process for calculating an actual required time for each element motion from the time difference between the start time and the end time of each element motion. And the eighth process is a process for calculating a difference between the actual required time and the model required time for each element motion.

[0014] The program of the present disclosure may be configured to cause a computer to execute the above fifth to eighth processes. Furthermore, the program of the present disclosure may be provided by being stored in a computer-readable storage medium. Effect of the Invention

[0015] As described above, according to the method, system, and program disclosed herein, when a delay occurs in handling operations performed at a logistics center, it is possible to identify which operation in the handling operations is causing a problem. [Brief description of the drawings]

[0016] [Figure 1] FIG. 1 is a diagram illustrating an overview of a management system according to an embodiment of the present disclosure. [Diagram 2] This is a diagram explaining an example of the actions of a work subject defined in a digital twin that reproduces a real logistics center in a digital space. [Diagram 3] FIG. 1 is a diagram showing an example of a flow of handling operations in a logistics center. [Figure 4] FIG. 11 is a diagram showing an example of the flow of individual operations in handling work at a logistics center. [Diagram 5] 11 is a flowchart showing a method for evaluating the action of a work subject using an actual required time and a model required time. [Figure 6] 11 is a flowchart showing a method for evaluating an element action of a work subject using an actual required time and a model required time. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0017] Hereinafter, a management method and a management system according to an embodiment of the present disclosure will be described with reference to the drawings. The management method according to the embodiment is realized by computer processing performed in the management system according to the embodiment. In each drawing, the same or corresponding parts are given the same reference numerals, and the description thereof will be simplified or omitted.

[0018] 1. Overview of the management system The management system according to this embodiment is a management system that manages handling operations in a logistics center. Fig. 1 is a diagram showing an overview of a management system 2 according to this embodiment.

[0019] The management system 2 includes a management server 10. The management of handling operations in the logistics center 30 is performed by the management server 10. The management server 10 itself can also be regarded as the management system 2. In the example shown in FIG. 1, one management server 10 is provided for one logistics center 30. However, multiple management servers may be provided for one logistics center, or one management server may be provided for multiple logistics centers.

[0020] In the logistics center 30, a plurality of workers 40 and a plurality of robots 50 work. The workers 40 and the robots 50 are lined up on a logistics line from arrival to shipment to handle items (e.g., luggage and products) handled in the logistics center 30. Alternatively, a logistics line is made up of the workers 40 and the robots 50. In this specification, the workers 40 and the robots 50 who are responsible for handling operations may be collectively referred to as the work subject.

[0021] A plurality of surveillance cameras 22 are installed in the logistics center 30. The surveillance cameras 22 may be stationary cameras mounted on walls or ceilings, or mobile cameras mounted on robots or vehicles. Some of the surveillance cameras 22 are arranged in locations where the movement of the worker 40 relative to the objects can be captured, particularly in locations where the worker's 40 hands can be captured. In addition, when a robot is in charge of part of the handling work, another set of surveillance cameras 22 is arranged in locations where the movement of the robot 50 relative to the objects can be captured. The surveillance cameras 22 are arranged in a distributed manner so that the movements of all the workers in charge of the handling work in the logistics center 30 can be captured. Image data captured by the surveillance cameras 22 is transmitted to the management server 10 via the network 20.

[0022] The management server 10 is composed of one or more computers provided in the cloud. The management server 10 includes one or more processors (hereinafter simply referred to as processors) 12 and a program memory 14 coupled to the processor 12. The program memory 14 stores a plurality of instructions 16 executable by the processor 12.

[0023] The instructions 16 include instructions for making the management server 10 function as an image data analysis device that analyzes camera image data transmitted from the surveillance camera 22. The instructions 16 also include instructions for making the management server 10 function as a simulator. When the management server 10 functions as a simulator, the management server 10 constructs a digital twin 60 that reproduces a logistics center in a digital space. The instructions 16 also include instructions for making the management server 10 function as an evaluation device that evaluates the actions of the workers performing handling work in the logistics center 30.

[0024] 2. Digital Twin In the digital twin 60, the ideal state of the real logistics center 30 is reproduced. In the real logistics center 30, the handling work for the items handled in the logistics center 30 is performed by the cooperation of multiple workers. In other words, a series of handling work is composed of the cooperation of the individual actions of multiple workers. FIG. 2 illustrates an example of the actions of the workers performed in the logistics center 30. "Receiving", "Receiving inspection", "Labeling", "Temporary storage", "Shelving / unpacking", "Shelving", "Picking", "Packing", "Shipping inspection", and "Shipping" shown in FIG. 2 are defined as the actions of the workers in the digital twin 60.

[0025] The logistics center 30 illustrated in Fig. 2 is an inventory-type logistics center in which transport boxes 70 of multiple types of received products are temporarily stored and a delivery box 80 in which the products are combined and packed according to customer orders is shipped. For this reason, examples of handling operations performed at the logistics center 30 include handling operations including "receiving", "receiving inspection", "labeling" and "temporary storage", handling operations including "shelf removal / unpacking" and "shelf placement", and handling operations including "picking", "packing", "shipping inspection" and "shipping". However, the management method and management system disclosed herein can also be applied to a transit-type logistics center that mainly delivers packages.

[0026] In the example shown in FIG. 2, a robot 51 is in charge of "receiving" the transport box 70, and a worker 41 is in charge of "receiving inspection" of the transport box 70. A worker 42 is in charge of "labeling" the transport box 70, and a robot 53 is in charge of "temporary storage" of the transport box 70. The robot 52 is in charge of moving the transport box 70 from "receiving" to "temporary storage". The digital twin 60 is composed of three digital twins 61, 62, and 63. The digital twin 61 reproduces the ideal state of the real space where handling work from "receiving" to "temporary storage" is performed. Therefore, each operation defined in the digital twin 61 is also an operation in an ideal state. A simulation using the digital twin 61 calculates the model required time for each operation from "receiving" to "temporary storage".

[0027] In the example shown in Fig. 2, a worker 43 is in charge of "taking out from the shelf and unpacking" the transport box 70 and "putting away" the products taken out of the transport box. The digital twin 62 reproduces the ideal state of the real space where the handling work from "taking out from the shelf and unpacking" to "putting away" is carried out. A simulation using the digital twin 62 calculates the model required time for each action from "taking out from the shelf and unpacking" to "putting away".

[0028] In the example shown in FIG. 2, a worker 44 is responsible for "picking" products from the shelves and "packing" the picked products into a delivery box 80. A worker 45 is responsible for "shipping inspection" of the delivery box 80 in which the products are packed, and a robot 55 is responsible for "shipping" the delivery box 80. The robot 54 is responsible for moving the delivery box 80 from "packing" to "shipping." The digital twin 63 reproduces the ideal state of the real space where handling work from "picking" to "shipping" is performed. A simulation using the digital twin 63 calculates the model required time for each operation from "picking" to "shipping."

[0029] Furthermore, in a simulation using each of the digital twins 61, 62, 63, when each action from "receiving" to "shipping" is decomposed into one or more element actions, the model required time of each element action is calculated. As a specific example, the action of "labeling" by the worker 42 is decomposed into the action of operating a label issuing machine to issue a label, the action of approaching the transport box 70 with the label, and the action of attaching the label to the transport box 70. Each of these element actions has an ideal action, and the time required for the ideal action is calculated as the model required time of the element action.

[0030] Although not included in the handling task shown in FIG. 2, one example of an action is "measuring luggage." The component actions of "measuring luggage" include "move," "hold," "put," "push," and "wait." Another example of an action is "moving to where the luggage is." The component actions of "moving to where the luggage is" include "hold the luggage," "move to the measuring device," "put the luggage," "press the measurement button," "wait," "hold the luggage," "move to the storage area," and "put the luggage."

[0031] 3. Camera image data analysis The management server 10 calculates the actual time required for each action of the workers who are responsible for handling work in the logistics center 30. The camera image data transmitted from the surveillance camera 22 is used to calculate the actual time required for each action of the workers. The management server 10, which serves as an image data analyzer, identifies the start time and end time of each action of the workers from the camera image data.

[0032] The state regarded as the start of an action and the state regarded as the end of an action are defined in advance for each action. With regard to the start of an action, for example, the start of the action may be defined as a hand touching a load or as a button being pressed. With regard to the end of an action, for example, the end of the action may be defined as a hand removing from a load or as a subject of the action returning to a designated position.

[0033] The management server 10 marks camera image data that captures a state that is deemed to be the start of an action, and records the time code included in the marked camera image data as the start time of the action. The management server 10 also marks camera image data that captures a state that is deemed to be the end of an action, and records the time code included in the marked camera image data as the end time of the action.

[0034] Fig. 3 is a diagram showing an example of the flow of handling operations in the logistics center 30. Fig. 3 shows the flow of handling operations including "receiving", "receiving inspection", "labeling", and "temporary storage". As simulated in the digital twin 61 shown in Fig. 2, "receiving" is an action performed by a robot 51, "receiving inspection" is an action performed by a worker 41, "labeling" is an action performed by a worker 42, and "temporary storage" is an action performed by a robot 53.

[0035] In the example shown in FIG. 3, time t1 is acquired as the start time of "receiving", and time t2 is acquired as the end time of "receiving". Next, time t5 is acquired as the start time of "receiving inspection", and time t6 is acquired as the end time of "receiving inspection". Furthermore, time t9 is acquired as the start time of "labeling", and time t10 is acquired as the end time of "labeling". Finally, time t13 is acquired as the start time of "temporary storage", and time t14 is acquired as the end time of "temporary storage".

[0036] The management server 10 calculates the time difference TA between times t1 and t2 as the actual time required for the receiving operation by the robot 51, and calculates the time difference TB between times t5 and t6 as the actual time required for the receiving inspection operation by the operator 41. The management server 10 also calculates the time difference TC between times t9 and t10 as the actual time required for the labeling operation by the operator 42, and calculates the time difference TD between times t13 and t14 as the actual time required for the temporary storage operation by the robot 53.

[0037] The handling operation time includes the time it takes for the robot 52 to move the transport box 70. The movement of the transport box 70 from "receiving" to "receiving inspection" is performed between time t3 and time t4. The movement of the transport box 70 from "receiving inspection" to "labeling" is performed between time t7 and time t8. And the movement of the transport box 70 from "labeling" to "temporary storage" is performed between time t11 and time t12.

[0038] Depending on the relationship between the processing speeds of the workers and the timing of the arrival of the transport box 70, there may be waiting times before and after each operation. The time from time t2 to time t3, the time from time t6 to time t7, and the time from time t10 to time t11 correspond to waiting times after the end of the previous operation and before the movement of the transport box 70. The time from time t4 to time t5, the time from time t8 to time t9, and the time from time t12 to time t13 correspond to waiting times after the movement of the transport box 70 and before the start of the next operation. These waiting times tend to increase as the difference between the actual required time and the model required time of each operation increases.

[0039] The management server 10 identifies the start time and end time of each handling operation from "shelf removal / unpacking" to "shelf placement" and calculates the actual required time based on the time difference between the start time and end time for each operation. The management server 10 also identifies the start time and end time of each handling operation from "picking" to "shipping" and calculates the actual required time based on the time difference between the start time and end time for each operation.

[0040] Furthermore, the management server 10 also calculates the actual required time of each element operation of each work subject. As defined in the digital twin 60, "receiving", "receiving inspection", "labeling", "temporary storage", "shelf removal / unpacking", "shelf placement", "picking", "packing", "shipping inspection", and "shipment" each consist of one or more element operations. To calculate the actual required time of each element operation, the management server 10 identifies the start time and end time of each element operation based on the analysis of the camera image data. The element operation for which the actual required time is calculated based on the analysis of the camera image data corresponds to the element operation for which the model required time is calculated by a simulation using the digital twin 60.

[0041] A state regarded as the start of an element action and a state regarded as the end of an element action are defined in advance for each element action. For example, a specific state within one action is defined as the start or end of a certain element action. In addition, since multiple element actions are connected to form one action, the end of the previous element action becomes the start of the next element action. The management server 10 marks camera image data capturing a state regarded as the start of an element action, and records the time code included in the marked camera image data as the start time of the element action. In addition, the management server 10 marks camera image data capturing a state regarded as the end of an element action, and records the time code included in the marked camera image data as the end time of the element action.

[0042] FIG. 4 is a diagram showing an example of the flow of individual operations in handling work in the logistics center 30. FIG. 4 shows the flow of the "labeling" operation. As simulated in the digital twin 61 shown in FIG. 2, "labeling" is an operation performed by a worker 42, and labeling of one transport box 70 is consistently performed by one worker 42. "Labeling" by the worker 42 consists of three component operations: "the action of issuing a label," "the action of approaching the package with the label," and "the action of attaching the label to the package." The management server 10 identifies the start time and end time of each component operation based on an analysis of the camera image data.

[0043] In the example shown in Fig. 4, at time t9, the worker 42 touches the label issuing machine, which is detected as the start time of the "action of issuing a label". Next, at time t9a, the worker 42 picks up the label, which is detected as the end time of the "action of issuing a label" and the start time of the "action of approaching the package with the label". Furthermore, at time t9b, the worker 42 touches the package, which is detected as the end time of the "action of approaching the package with the label" and the start time of the "action of attaching the label to the package". And finally, at time t10, the worker 42 takes his hand off the package, which is detected as the end time of the "action of attaching the label to the package".

[0044] The management server 10 calculates the time difference TC1 between times t9 and t9a as the actual required time for the element action of the worker 42 issuing a label. The management server 10 also calculates the time difference TC2 between times t9a and t9b as the actual required time for the element action of the worker 41 approaching the package with a label. The management server 10 also calculates the time difference TC3 between times t9b and t10 as the actual required time for the element action of the worker 42 attaching a label to the package.

[0045] 4. Evaluation of behavior The management server 10, which serves as an evaluation device, evaluates the actions of all workers performing handling work in the logistics center 30. As information for the evaluation, the management server 10 uses the model required time for each action calculated by a simulation using the digital twin 60 and the actual required time for each action obtained by analyzing camera image data.

[0046] Fig. 5 is a flow chart showing a method for evaluating the actions of a worker using the actual required time and the model required time. The method for evaluating the actions of a worker is to first evaluate whether there are any problems with a series of handling operations, and if there are any problems, to evaluate each of the actions included in the handling operations. Fig. 5 shows an example of an evaluation flow for evaluating the actions included in a series of handling operations from "receiving" to "temporary storage" among the handling operations at the logistics center 30.

[0047] First, in step S101, model required times MTA, MTB, MTC, and MTD for each operation calculated by a simulation using the digital twin 61 are obtained. The model required time MTA is the model required time for the receiving operation, the model required time MTB is the model required time for the receiving inspection operation, the model required time MTC is the model required time for the labeling operation, and the model required time MTD is the model required time for the temporary storage operation. In addition, in step S102, actual required times TA, TB, TC, and TD for each operation obtained by analyzing the camera image data are obtained.

[0048] In step S103, the sum of the model required times MTA, MTB, MTC, and MTD obtained in step S101 is calculated as a total model required time ΣMT. In step S104, the sum of the actual required times TA, TB, TC, and TD obtained in step S102 is calculated as a total actual required time ΣT.

[0049] Next, in step S105, the total model required time ΣMT is compared with the total actual required time ΣT. Specifically, it is determined whether the total actual required time ΣT is greater than the total model required time ΣMT plus a predetermined margin. If the result of this determination is negative, the evaluation flow ends.

[0050] The difference between the total model required time ΣMT and the total actual required time ΣT represents the delay in the actual handling work compared to the ideal. The margin included in the comparison formula in step S105 is the allowable delay time. Therefore, a positive judgment result in step S105 means that an unacceptable delay has occurred in the series of handling work from "receiving" to "temporary storage".

[0051] If the determination result in step S105 is positive, it is determined which of the movements included in the handling work has a problem. The processes from step S106 to step S113 are processes for determining whether or not there is a problem with each movement.

[0052] In step S106, the model required time MTA for the receiving operation is compared with the actual required time TA. Specifically, it is determined whether the actual required time TA is greater than a value obtained by adding a predetermined margin to the model required time MTA. The margin in the comparison formula in step S106 is the delay time permitted in the receiving operation. If the determination result is positive, flag A is turned on in step S107. Flag A is a flag indicating that a problem has occurred in the receiving operation. If the determination result is negative, step S107 is skipped.

[0053] In step S108, the model required time MTB for the incoming inspection operation is compared with the actual required time TB. Specifically, it is determined whether the actual required time TB is greater than a value obtained by adding a predetermined margin to the model required time MTB. The margin in the comparison formula in step S108 is the delay time permitted in the incoming inspection operation. If the determination result is positive, flag B is turned on in step S109. Flag B is a flag indicating that a problem has occurred in the incoming inspection operation. If the determination result is negative, step S109 is skipped.

[0054] In step S110, the model required time MTC and the actual required time TC of the labeling operation are compared. Specifically, it is determined whether the actual required time TC is greater than a value obtained by adding a predetermined margin to the model required time MTC. The margin in the comparison formula in step S110 is a delay time allowed in the labeling operation. If the determination result is positive, flag C is turned on in step S111. Flag C is a flag indicating that a problem has occurred in the labeling operation. If the determination result is negative, step S111 is skipped.

[0055] In step S112, the model required time MTD and the actual required time TD of the temporary storage operation are compared. Specifically, it is determined whether the actual required time TD is greater than a value obtained by adding a predetermined margin to the model required time MTD. The margin in the comparison formula in step S112 is a delay time permitted in the temporary storage operation. If the determination result is positive, flag D is turned on in step S113. Flag D is a flag indicating that a problem has occurred in the temporary storage operation. After step S113 is executed, the evaluation flow ends. If the determination result in step S112 is negative, step S113 is skipped and the evaluation flow ends.

[0056] By executing the above evaluation flow, it is possible to identify which action of the operator is causing a delay in the handling work. The evaluation flow shown in Fig. 5 can be executed at any time after a series of handling work from "receiving" to "temporary storage" has been executed and the actual required time for each action has been acquired. For example, the evaluation flow may be executed every time a series of handling work is executed, or the evaluation flow may be executed once a day after the end of the day's work at the logistics center 30.

[0057] Furthermore, when an operation that is causing a delay in the handling operation is identified, the management server 10 as an evaluation device evaluates each element operation of the operation. As information for the evaluation, the management server 10 uses the model required time of each element operation calculated by a simulation using the digital twin 60 and the actual required time of each element operation obtained by analyzing the camera image data.

[0058] 6 is a flowchart showing a method for evaluating an element operation of a work subject using the actual required time and the model required time. In FIG. 6, an evaluation flow for evaluating an element operation of a labeling operation is shown.

[0059] First, in step S201, it is determined whether flag C is on. If there is a problem with the labeling operation, flag C is turned on in the evaluation flow shown in Fig. 5. If flag C is off, there is no problem with the labeling operation. In this case, the evaluation flow ends.

[0060] If the determination result in step S201 is positive, it is determined which of the elemental actions constituting the labeling action has a problem. The processes from step S202 to step S209 are processes for determining whether or not there is a problem with each elemental action.

[0061] In step S202, model required times MTC1, MTC2, and MTC3 are obtained for each element operation constituting the labeling operation, calculated by a simulation using the digital twin 61. The model required time MTC1 is the model required time for the operation of issuing a label, the model required time MTC2 is the model required time for the operation of approaching the package with a label, and the model required time MTC3 is the model required time for the operation of attaching a label to the package. In addition, in step S203, actual required times TC1, TC2, and TC3 for each element operation obtained by analyzing the camera image data are obtained.

[0062] In step S204, the model required time MTC1 for the operation of printing a label is compared with the actual required time TC1. Specifically, it is determined whether the actual required time TC1 is greater than a value obtained by adding a predetermined margin to the model required time MTC1. The margin in the comparison formula in step S204 is an allowable delay time in the operation of printing a label. If the determination result is positive, then in step S205, flag C1 is turned on. Flag C1 is a flag indicating that a problem has occurred in the operation of printing a label. If the determination result is negative, step S205 is skipped.

[0063] In step S206, the model required time MTC2 for the action of approaching the package with the label is compared with the actual required time TC2. Specifically, it is determined whether the actual required time TC2 is greater than a value obtained by adding a predetermined margin to the model required time MTC2. The margin in the comparison formula in step S206 is the delay time permitted in the action of approaching the package with the label. If the determination result is positive, flag C2 is turned on in step S207. Flag C2 is a flag indicating that a problem has occurred in the action of approaching the package with the label. If the determination result is negative, step S207 is skipped.

[0064] In step S208, the model required time MTC3 and the actual required time TC3 for the operation of attaching the label to the package are compared. Specifically, it is determined whether or not the actual required time TC3 is greater than a value obtained by adding a predetermined margin to the model required time MTC3. The margin in the comparison formula in step S208 is a delay time permitted in the operation of attaching the label to the package. If the determination result is positive, then in step S209, flag C3 is turned on. Flag C3 is a flag indicating that a problem has occurred in the operation of attaching the label to the package. If the determination result is negative, then step S209 is skipped. After step S209 is executed, the evaluation flow ends. If the determination result in step S208 is negative, then step S209 is skipped and the evaluation flow ends.

[0065] By executing the above evaluation flow, when a delay occurs in the actions of the worker, it is possible to identify whether the element action is the cause of the delay. The evaluation flow shown in Fig. 6 can be executed at any time after a series of handling operations from "receiving" to "temporary storage" have been executed and the actual required time for each element action has been acquired. For example, the evaluation flow may be executed every time a series of handling operations is executed, or the evaluation flow may be executed once a day after the end of the day's work at the logistics center 30.

[0066] 5.Effects According to the embodiment described above, when a delay occurs in the handling work performed at the logistics center 30, it is possible to identify which operation in the handling work is problematic. Furthermore, it is also possible to identify which element operation is causing the problem in the problematic operation. By providing feedback on the identified problem to the operator, the operator's operation can be improved, and the productivity of the logistics center 30 can be increased. [Explanation of symbols]

[0067] 2. Management System 10 Management Server 12 processors 14 Program Memory 16 Instructions 22 Surveillance Cameras 30 Logistics Center 40, 41, 42, 43, 44, 45 Workers 50, 51, 52, 53, 54, 55 Robot 60, 61, 62, 63 Digital Twin 70 Transport box 80 shipping box

Claims

1. Calculating by simulation a model required time for each operation of a handling task for an item handled at a logistics center; capturing a movement of a worker performing the handling work with respect to the object by a surveillance camera installed in the logistics center; Identifying a start time and an end time of each of the actions based on an analysis of camera image data of the surveillance camera capturing a movement of the work subject relative to the object; calculating an actual time required for each of the actions from a time difference between the start time and the end time of each of the actions; calculating a difference between the actual duration and the model duration of each of the operations. A method comprising:

2. 10. The method of claim 1 , calculating a model required time of each element motion when the individual motion is decomposed into one or more element motions by simulation; determining a start time and an end time of each of the elemental motions based on an analysis of the camera image data; calculating an actual required time for each of the elemental movements from a time difference between the start time and the end time of each of the elemental movements; calculating a difference between the actual duration and the model duration of each of the element operations. A method comprising:

3. one or more processors; a program memory coupled to the one or more processors and having a plurality of instructions stored thereon; The instructions may include instructions for causing the one or more processors to: Calculating by simulation a model required time for each operation of a handling task for an item handled at a logistics center; capturing a movement of a worker performing the handling work with respect to the object by a surveillance camera installed in the logistics center; Identifying a start time and an end time of each of the actions based on an analysis of camera image data of the surveillance camera capturing a movement of the work subject relative to the object; calculating an actual time required for each of the actions from a time difference between the start time and the end time of each of the actions; calculating a difference between the actual duration and the model duration of each of the operations. A system characterized by:

4. 4. The system of claim 3, The instructions may include instructions for causing the one or more processors to: calculating a model required time of each element motion when the individual motion is decomposed into one or more element motions by simulation; determining a start time and an end time of each of the elemental motions based on an analysis of the camera image data; calculating an actual required time for each of the elemental movements from a time difference between the start time and the end time of each of the elemental movements; calculating a difference between the actual duration and the model duration of each of the element operations. A system characterized by:

5. Calculating by simulation a model required time for each operation of a handling task for an item handled at a logistics center; capturing a movement of a worker performing the handling work with respect to the object by a surveillance camera installed in the logistics center; Identifying a start time and an end time of each of the actions based on an analysis of camera image data of the surveillance camera capturing a movement of the work subject relative to the object; calculating an actual time required for each of the actions from a time difference between the start time and the end time of each of the actions; and calculating a difference between the actual duration and the model duration of each of the operations. A program characterized by:

6. The program according to claim 5, calculating a model required time of each element motion when the individual motion is decomposed into one or more element motions by simulation; determining a start time and an end time of each of the elemental motions based on an analysis of the camera image data; calculating an actual required time for each of the elemental movements from a time difference between the start time and the end time of each of the elemental movements; and calculating a difference between the actual duration and the model duration of each of the element operations. A program characterized by:

Citation Information

Patent Citations

  • Method / System for diagnostic work efficiency

    JP1995254024A

  • Physical distribution optimizing apparatus

    JP2004086358A

  • Production simulation management apparatus

    JP2007041950A

  • Efficient management method for production process comprising plurality of production processes including manual work

    JP2007094981A

  • Method for assisting efficiency improvement in manufacturing process

    JP2007133543A