Work analysis device, work analysis method, and work analysis program

Abstract

To provide a work analysis device configured so that an analyst records work video for efficient work analysis.SOLUTION: A work analysis device 1 includes: a first boundary setting unit configured to receive input of user operation and set a boundary for each work element on work video; a boundary detection unit configured to detect recognition information associated with each work process, for recognizing a boundary between work of a first work process and work of a second work process; a second boundary setting unit configured to automatically set the boundary on the work video between the work of the first work process and the work of the second work process, on the basis of the recognition information; a type designation unit configured to designate a type related to work for a segmented work element; a worker information acquisition unit configured to acquire attribute information of a worker in a work element, on the basis of the segmented work video; and a storage unit configured to store work-related data obtained by associating the type of the work video with the attribute information of the worker for each work element.SELECTED DRAWING: Figure 5B

Description

[Technical Field]

[0001] The present invention relates to a task analysis device, a task analysis method, and a task analysis program. [Background technology]

[0002] Conventionally, there has been known a work analysis device that can display a video of a work being performed and analyze the movements of that work, with the aim of "visualizing" the movements and time of people, machines, and objects, thereby shortening work time, saving labor, and reducing costs at production sites. Among the above work analysis devices, there is known a mobile work analysis device that can be carried around to capture images of work in each work process in line work consisting of a plurality of work processes (see, for example, Patent Documents 1 and 2). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2002-288703 [Patent Document 2] Japanese Patent Application Laid-Open No. 2013-211000 Summary of the Invention [Problem to be solved by the invention]

[0004] The above-mentioned task analysis device allows task analysts to record task videos and perform task analysis based on the task videos. However, this places a heavy burden on task analysts, and there has been a demand for technology that allows task analysts to perform task analysis efficiently. In particular, in line work consisting of multiple work processes, there has been a demand for technology that can identify work elements for each work process and efficiently analyze those work elements.

[0005] An object of the present invention is to provide an operation analysis device, an operation analysis method, and an operation analysis program that enable an operation analyst to record operation videos and analyze operations based on the operation videos. [Means for solving the problem]

[0006] The above-mentioned problem can be solved by the work analysis device of the present invention, which analyzes a work video of a work consisting of a plurality of work steps, which is captured by an imaging unit, and which includes: a first division setting unit that receives user input during the capture of the work video and sets divisions for each work element in the work video; a division detection unit that detects recognition information that recognizes a division between a work in a first work step and a work in a second work step that follows the first work step during the capture of the work video; a second division setting unit that sets divisions for the work video, based on the recognition information, with the work in the first work step and the work in the second work step as work elements; a type designation unit that designates a type of the work for each of the work elements separated by the set divisions; a worker information acquisition unit that acquires attribute information of workers in the work steps and / or the work elements based on the work video in which the divisions have been set; and the work video for the work and / or the work elements. Regarding the above work The type, the attribute information of the worker, and the , relating to the division of the work This problem is solved by including a storage unit that stores work-related data that is at least associated with the presence or absence of the recognition information.

[0007] The problem is also solved by a work analysis method executed by a computer that analyzes a work video of a work consisting of a plurality of work steps that is captured by an imaging unit, wherein the computer receives user input during the capture of the work video and sets a division for each work element in the work video, detects recognition information during the capture of the work video that recognizes a division between a work in a first work step and a work in a second work step that follows the first work step, sets the division for the work video as work elements for the work in the first work step and the work in the second work step based on the recognition information, specifies a type of the work for each of the work elements that are separated by the division, acquires attribute information of the worker in the work step and / or the work element based on the work video in which the division is set, and Regarding the above work The type, the attribute information of the worker, and the detected Regarding the division of the work The problem is also solved by a task analysis method that executes storing task-related data that is at least associated with the presence or absence of the recognition information.

[0008] The problem is also solved by providing a computer as a work analysis device that analyzes a work video of a work consisting of a plurality of work steps, which is captured by a capturing unit, with the following steps: a process of accepting user input during the capture of the work video and setting a division for each work element in the work video; a process of detecting, during the capture of the work video, recognition information that recognizes a division between a work in a first work step and a work in a second work step that follows the first work step; a process of setting the division for the work video, with the work in the first work step and the work in the second work step as work elements, based on the recognition information; a process of specifying a type of the work for each of the work elements that are separated by the division; a process of acquiring attribute information of the worker in the work step and / or the work element based on the work video in which the division is set; Regarding the above work The type, the attribute information of the worker, and the detected Regarding the division of the work The above-mentioned problems can also be solved by a task analysis program that executes a process of storing task-related data that is at least associated with the presence or absence of the recognition information. [Effects of the Invention]

[0009] The task analysis device, task analysis method, and task analysis program of the present invention have the advantage that a task analyst can record task videos and perform task analysis based on the task videos. In addition, task analysis has the advantage that task elements can be identified for each task process and analyzed efficiently. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a diagram illustrating the overall configuration of a work analysis system according to an embodiment of the present invention. [Figure 2] FIG. 1 is a diagram illustrating a hardware configuration of a work analysis system. [Figure 3] FIG. 2 is a diagram illustrating the functions of the work analysis system. [Figure 4]FIG. 10 is a diagram illustrating an example of a menu screen. [Figure 5A] FIG. 10 is a diagram illustrating an example of an imaging screen. [Figure 5B] FIG. 10 is a diagram showing a state in which a task element list is displayed on an imaging screen. [Figure 6] FIG. 10 is a diagram illustrating an example of a work analysis screen. [Figure 7] FIG. 10 is a diagram illustrating an example of a cycle analysis screen. [Figure 8] FIG. 10 is a diagram illustrating an example of a pile analysis screen. [Figure 9] FIG. 10 is a diagram illustrating an example of work element list data. [Figure 10] FIG. 2 is a diagram illustrating an example of work-related data. [Figure 11] FIG. 1 is a process flow diagram illustrating an example of a work analysis method. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, an embodiment of the present invention will be described with reference to FIGS. As shown in FIG. 1, the work analysis system S of this embodiment is mainly composed of a mobile work analysis device 1 that is used to analyze work in real time while capturing images of the work and recording work videos, and an external analysis device 100 that is connected to the work analysis device 1 via a network, acquires analysis data related to work analysis from the work analysis device 1, and is used to perform work analysis (detailed analysis) and create work standards based on the analysis data. In this embodiment, "work" refers to line work or cell work consisting of multiple work processes, each of which is carried out in conjunction with the other processes, and includes work performed by workers as well as work performed by machines such as robots. "Line work" refers to a collection of a series of work processes, and is work carried out using a method known as a line production system, in which work processes are arranged in a predetermined line configuration. "Cell work" refers to a collection of a series of work processes, and is work carried out using a method known as a cell production system, in which work processes are arranged in a special line configuration, such as a U-shape or a D-shape, among the predetermined line configurations in line work. Because cell work is a type of line work, hereinafter "line work" will include this "cell work." For example, an assembly line is one in which products or assemblies are assembled through various work processes such as joining, separating, processing, etc. A "work process (tasks in a work process)" refers to a collection of a series of work elements, and examples include assembling an engine, attaching a bumper, and attaching tires. A "work element" refers to a collection of a series of actions, such as preparing a bush, checking the bush setting position, setting the bush, and assembling it to the vehicle body. An "action" refers to the smallest unit when a task is broken down.

[0012] <Hardware configuration of the work analysis system> As shown in FIG. 1, the work analysis device 1 is a portable mobile terminal used by an analyst who performs work analysis, and is used to capture images of work in each work process in line work consisting of multiple work processes. The work analysis device 1 can perform work analysis (real-time analysis) while displaying work video in real time, as shown in Figures 5A and 5B, or perform work analysis (work time analysis) for each cycle while displaying work video after capture, as shown in Figure 6. The work analysis device 1 can also perform cycle analysis to check the variations in the work (work elements) of each cycle by displaying the cycle analysis screen shown in Fig. 7 or the pile analysis screen shown in Fig. 8. A cycle in this case is made up of one or more work processes, and is a collection of a series of work processes in which a certain product or assembly is assembled, and indicates a single "line work." The task analysis and cycle analysis performed by this task analysis device 1 are also referred to as "simple analysis" and "first task analysis."

[0013] Specifically, as shown in Figure 2, the work analysis device 1 is a mobile computer equipped with a CPU 2 as a data calculation and control processing device, a storage device 3 having ROM, RAM, and HDD (SSD), a communication interface 4 for sending and receiving information data over a network, a display unit 5 for displaying text or image information, an input unit 6 that is operated by the user when entering specified commands into the CPU, and an imaging unit 7 (specifically, an imaging camera) for capturing images of work and recording work videos. The work analysis device 1 stores the work video (work video data) recorded by the imaging unit 7, dividing it into cycles. It can also store it divided into work processes. In addition to a main program that performs the functions necessary for a computer, the memory device 3 of the work analysis device 1 also stores a work analysis program, and the functions of the work analysis device 1 are realized by executing this program by the CPU.

[0014] As shown in Fig. 2, the work analysis device 1 can communicate with an external analysis device 100 via a network and transmit analytical data related to work analysis (strictly speaking, simplified analytical data). Specifically, the analytical data transmitted includes "work video data" and "work-related data" shown in Fig. 10. Of course, analytical data following a simplified analysis performed by the work analysis device 1 can also be transmitted.

[0015] As shown in Figures 1 and 2, the external analysis device 100 is a computer used by an external analyst, and like the work analysis device 1, it is equipped with a CPU 101, a storage device 102, a communication interface 103, a display unit 104, an input unit 105, and an output unit 106 that outputs text or image information. The external analysis device 100 communicates with the work analysis device 1 via a network, receives analysis data related to work analysis, and can perform work analysis based on the analysis data. Alternatively, the external analysis device 100 can communicate in real time with the work analysis device 1, share work videos with analysts at the work site, and perform work analysis (real-time analysis) and add work comments related to the work based on the work videos. This task analysis performed by external analysis device 100 is also referred to as a “detailed analysis” or a “second task analysis.” This second task analysis includes the first task analysis, but is different from the first task analysis.

[0016] More specifically, as a more detailed analysis, the external analysis device 100 accepts user input to set a "rating rate" for each task element and calculates a "standard task time." In addition, it can set a "category" and a "task type" for each task element. The "rating rate" is a numerical value used to classify or quantify an object based on a predetermined standard. For example, it is an evaluation value that evaluates whether a worker shown in a work video is mature or accustomed to the work. "Standard work time" is the time required for a skilled worker who is suited to the job to complete the job at a normal work pace with the necessary leeway under specified working conditions. Standard work time is generally calculated by multiplying the rating rate by the effective operating time. "Classification" is an item where one of the following categories is selected and entered for each work element: "operating," "semi-operating," or "non-operating." "Operating" indicates a state where a person is working, "semi-operating" indicates a state where a machine is operating, and "non-operating" indicates a waiting state where neither a person nor a machine is operating. The "work type" is an item that is entered by selecting one of the categories of "manual work," "tool work," and "machine work" for each work element, for example.

[0017] The analysis data (strictly speaking, detailed analysis data) generated by the external analysis device 100 is associated with information different from the simple analysis data, and is sent from the external analysis device 100 to the work analysis device 1 in response to a data request from the work analysis device 1. The work analysis device 1 can receive the detailed analysis data and output it. This allows the analyst to request an external second task analysis when he or she wishes to check the analysis content in more detail than the first task analysis, and the results of this second task analysis can be checked in the task analysis device 1. This means that work analysis can be performed according to the importance of the work and the degree of consideration for improvement, and analysts and workers can output and check the work results using the work analysis device 1 regardless of the work analysis (first work analysis or second work analysis).

[0018] <Functions of the work analysis system> As shown in FIG. 3, from a functional perspective, the work analysis device 1 mainly comprises a memory unit 10 that stores various programs and data such as "work video data," "work element list data," and "work-related data," a screen display unit 11, a division setting unit 12, a division detection unit 13, a second division setting unit 14, a work time calculation unit 15, a type designation unit 16, a worker information acquisition unit 17, an analysis data generation unit 18, a communication unit 19, and an analysis data output unit 20. These are composed of a CPU, ROM, RAM, HDD, communication interface, various programs, etc.

[0019] Regarding the external analysis device 100 from a functional perspective, its main components are a memory unit 110 that stores various programs and various data, a communication unit 111 that sends and receives various data to and from the work analysis device 1, a screen display unit 112 that displays a work analysis screen, and an analysis execution unit 113 that accepts user input and executes work analysis.

[0020] Below, we will explain in detail the functions of the work analysis device 1. In this embodiment, the work analysis device 1 is configured to include a memory unit 10, but this is merely an example, and the memory unit 10 may also be realized in an external storage device provided outside the work analysis device 1. In this case, it is preferable that the work analysis device 1 and the external storage device are connected via a communication path.

[0021] <<Display analysis screen>> The screen display unit 11, for example, accepts input from a user operation, executes software installed in the work analysis apparatus 1, and displays a "menu screen" which is an initial screen when the user logs in. Specifically, as shown in FIG. 4, the screen display unit 11 displays a list screen as a menu screen 30 for allowing the user to select a predetermined selection item from a plurality of selection items. When the screen display unit 11 receives a user selection of the selection item 31 "video capture" on the menu screen 30, the screen transitions to a capture screen 40 shown in Fig. 5A. Furthermore, when the screen display unit 11 receives a user selection of the selection item 32 "task analysis" on the menu screen 30, the screen transitions to a work analysis screen 50 shown in Fig. 6. Furthermore, it is also possible to transition from the work analysis screen 50 to a cycle analysis screen 60 shown in Fig. 7 or a pile graph screen 70 shown in Fig. 8. It should be noted that "user operation" is assumed to be a touch panel operation by the user, but may be an operation other than a touch panel operation, such as a voice operation or a gesture operation.

[0022] Here, the "capture screen 40" shown in Figs. 5A and 5B is a display screen used for analyzing work based on the work video in real time while the work video is being recorded. The "Work Analysis Screen 50," "Cycle Analysis Screen 60," and "Pile Graph Screen 70" are display screens used to conduct work analysis after the work video has been recorded, and analysts can switch between the display screens depending on the purpose of the work analysis. On the "Work Analysis Screen 50" shown in Fig. 6, the work video after capture is displayed and divided into work elements for each cycle, and work element time calculations, type setting, etc. are possible. The "Cycle Analysis Screen 60" shown in Fig. 7 displays a list of work elements, and the "Pile Graph Screen 70" shown in Fig. 8 displays a pile graph, and it is then possible to check the variation in work (work elements) for each cycle, rearrange the work elements, and organize (recombine, swap, rearrange) the work process.

[0023] The screen display unit 11 has, as specific functional units, a moving image display unit 11a, an operation button display unit 11b, an operation element list display unit 11c, a position information display unit 11d, and a stacked graph display unit 11e. The video display unit 11a displays a "work video" of the work on a display screen. Specifically, it displays a work video 41 in real time on the imaging screen 40 shown in Figures 5A and 5B, and displays a work video 51 after imaging on the work analysis screen 50 shown in Figure 6. In this embodiment, the work analysis screen shown in FIG. 6 is described as an example in which the work video is displayed after being captured, but it is also possible for the analyst to perform a predetermined screen change operation to temporarily display the screen in place of FIG. 5A or FIG. 5B, or until a new screen change operation is performed.

[0024] The operation button display unit 11b accepts user operations and displays on the display screen a "divide execution button" that sets divisions to divide the work video being displayed in real time into work elements, and a "type designation button" that designates a valid action that indicates that a valid action has been performed as work for each work element divided by the divisions that have been set, or an invalid action that indicates that an invalid action has been performed as work. Specifically, the operation button display unit 11b displays a segmentation execution button 42 and a type designation button 43 at a position (specifically, at the right end position) that overlaps with a part of the work video 41 on the captured image screen 40 shown in Fig. 5A. In this case, each operation button indicates an operation button operated by software, but an operation button made of hardware may be separately provided and the operation may be performed by using that operation button. In addition, the operation button display unit 11b displays, on the imaging screen 40, an imaging execution button 44 for starting and stopping (pausing) imaging, and a cycle switching button 45 for switching to imaging of the next cycle of work when imaging of one cycle of work has been completed.

[0025] On the imaging screen 40, a division execution button 42, a type designation button 43, an imaging execution button 44, and a cycle switching button 45 are arranged in a line at the right end of the display screen. Therefore, when an analyst picks up the work analysis device 1, the analyst can easily operate the operation buttons 42 to 45 using, for example, just the thumb of the right hand. When a specific user operation (for example, a long press of the operation button) is received with respect to the division execution button 42, a division point can be automatically set for the work video by image recognition using artificial intelligence (AI) (the automatic setting continues until it is canceled by a user operation). Furthermore, when a specific user operation is received using the type designation button 43, the type of work element can be designated as "valid action," "invalid action," "useless action," or "verification action." The type at this time is information indicating the result of the certification of the work element for each work element divided at a delimiter in the captured work video. In other words, it is the result of the certification determined by the analyst in the work analysis performed in real time. In this case, "valid actions" and "invalid actions" refer to the actions described above. Furthermore, "wasteful actions" are actions that are valid as work, but that have been determined to be "unnecessary" as a result of analysis (these actions are different from invalid actions). Furthermore, "verification actions" are actions that cannot be determined to be "valid actions" or "invalid actions" and that have been determined to require further verification. For work elements that have been set as types of "verification actions," it is possible to change them to "valid actions," "invalid actions," or "wasteful actions" on the work analysis screen shown in Figure 6.

[0026] In addition, when an upward drag operation of the operation button is received, a "valid operation" can be specified; when a downward drag operation is received, an "invalid operation" can be specified; when a leftward drag operation is received, an "useless operation" can be specified; and when a rightward drag operation is received, an "verification operation" can be specified.

[0027] The work element list display unit 11c displays on the display screen "work element list data" including information on the work time for each divided work element and information on the total time obtained by aggregating the work times for each work element. Here, the "work element list data" is a data table showing detailed information about each work element in a work (line work), as shown in Figure 9, and is created and updated by accepting input from a user (automatic input is also acceptable). Specifically, the "work element list data" includes an identification number (No.) that identifies the work element, "work time information" that corresponds at least to the work element name, work time, and type, and "total time information" for all work elements, and is stored in memory unit 10. The work time includes information on the average work time, maximum work time, minimum work time, and work time for each cycle in the entire cycle.

[0028] Looking at the "Work Element List Data" shown in Figure 9, we can see that for the identification number "1" and work element name "Work Element 1-1," the work time of cycle 3, "10.50 (seconds)" is the best lap (minimum time), and the work time of cycle 1, "12.00 seconds" is the worst lap (maximum time). We can also see that the type is "Valid (valid operation)." It should be noted that cycle 3 refers to the third cycle, and cycle 1 refers to the first cycle.

[0029] 5A and 5B, the task element list display unit 11c pops up a task element list 46 at a position on the captured image screen 40 where it overlaps with a part of the task video 41. Then, upon receiving input of a user operation, the task element information and task time (total time) information in the task element list 46 are updated. As the information in the task element list 46 is updated, the information in the “task element list data” is also updated and stored in the storage unit 10 .

[0030] The work element list 46 displays information such as the identification number (No.), work element name, work time, and type, as well as the cycle of the work currently being imaged and the total work time. In addition, display marks 46a and 46b indicating the best and worst lap work times in the entire cycle, and display marks 46c and 46d indicating that the work time is faster or slower than the previous cycle, are given to specific work elements. In addition, a display mark indicating the smallest error or the largest error in comparison with a preset reference time may be given to each of the predetermined tasks. This allows for analysis of good and bad work at the workplace, allowing workers to immediately propose improvements to their work. It also allows for suggestions on how to organize work elements (recombining, switching, rearranging).

[0031] Looking at the work element list 46 shown in Figure 5B, it can be seen that the work time of cycle 3 of identification number "1" and work element name "work element 1-1" is "10.50 (seconds)" is the best lap, and the work time of cycle 3 of identification number "2" and work element name "work element 1-2" is "12.50 (seconds)" is the worst lap (see display marks 46a and 46b). It can also be seen that the work time of cycle 3, "9.50 (seconds)", for the identification number "3" and work element name "work element 1-3" is faster than the work time of cycle 2 (see display mark 46c). In this embodiment, the work time and total time in the work element list 46 are displayed numerically, but this is merely an example, and a graph or illustration may also be used.

[0032] In addition, the work element list display unit 11c can display the work element list 52 in a display area different from the display area (display window) in which the work video 51 is displayed on the work analysis screen 50 shown in Figure 6, and can display the work element list 61 in the entire display area on the cycle analysis screen 60 shown in Figure 7. The work element list 52 on the work analysis screen 50 shown in Fig. 6 displays information such as identification number (No.), work element name, work time, type, total time, and cycle. The cycle to be analyzed can be switched by operating cycle switching buttons 53 and 54 by the user (e.g., "Cycle 3" can be switched to another cycle). The work element list 61 on the cycle analysis screen 60 shown in FIG. 7 includes information such as the identification number (No.), work element name, average work time for all cycles, maximum work time, minimum work time, work time for each cycle, and type, as well as information on the total time for the work elements. It is preferable that the best lap and worst lap cycles among all cycles are displayed in different display modes.

[0033] The position information display unit 11d displays on the display screen the "position information" of the work location (work location of the work process) currently being imaged. The position information is detected by the division detection unit 13, and is calculated by detecting an identification mark M provided at the work location of each work process or by receiving a GNSS signal from an external base station ST. Specifically, the position information display unit 11d can display the position information 47 at a position on the captured screen 40 where the position information 47 overlaps with a part of the work video 41, as shown in FIG. 5B. The location information 47 displays the work location currently being imaged, "second work process." Therefore, it is possible to identify which work process in the line work the current image capture location is a work location for. In this embodiment, it is possible to identify that the work (work element) being imaged is a work (work element) in the "second work process." The location information 47 is not limited to the name of the work process, but may be the name of a work location associated with each work process, or may be geographic information (geographic coordinates).

[0034] The pile graph display section 11e is a graph in which the horizontal axis represents cycles and the vertical axis represents work time, and displays a pile graph in the form of a bar graph by piling up work elements in order for each cycle. Specifically, the pile graph display unit 11e displays a pile graph 71 in which each work element is piled up, and a timeline 72 showing the takt time of the work set by the user, on a pile graph screen 70 shown in FIG. 8. On the pile graph screen 70, the analyst can compare the pile graphs 71 of the cycles and perform leveling of the work (work elements) of each cycle in accordance with the timeline 72. In the case of analyzing line work, the pile graph display unit 11e can also display a pile graph in which the horizontal axis represents work steps and the vertical axis represents work time, and in which work elements are piled up in order for each work step. By using this pile graph, the analyst can organize the work steps.

[0035] <<Setting the separation of work elements>> The division setting unit 12 receives input of a predetermined user operation and sets divisions for each work element in the work video. Specifically, the division setting unit 12 accepts a user's pressing of the division execution button 42 on the imaging screen 40 shown in Fig. 5A, and sets a division in the work video 41 being captured. By setting the division, the work being captured is divided into work elements (new work elements are added).

[0036] The division setting unit 12 can also set divisions in the captured work video 51 by accepting an operation of tapping on the work video 51 by the user on the work analysis screen 50 shown in Fig. 6. By setting the divisions, the captured work is divided into work elements. From the above, the division setting unit 12 can set divisions in real time for the work video 41 being filmed and divide the work into work elements, and can also set divisions in the work video 51 after filming and divide the work into work elements.

[0037] A seek bar 55 indicating the playback time point of the currently played task video 51 is displayed at a predetermined position (bottom end position) on the task analysis screen 50. A division 55a set by the division setting unit 12 is added to the seek bar 55. At this time, by accepting a drag operation of the predetermined division 55a by the user, the position of the division 55a can be fine-tuned (the task time of a predetermined task element can be fine-tuned).

[0038] The boundary detection unit 13 detects "recognition information" that recognizes work processes in order to recognize the boundary between work in a first work process and work in a second work process that follows the first work process in line work. This "recognition information" may be associated with each work process, in which case it becomes possible to identify work processes separated by the boundary. Below, a case where recognition information associated with each work process is detected will be described, but the present invention is not limited to this. When "recognition information" associated with the second work process is detected, the second division setting unit 14 sets a division between the work (work element) in the first work process and the work (work element) in the second work process in the work video based on the recognition information. In this embodiment, the "recognition information" corresponds to the "identification mark M" shown in Fig. 1 that is provided at the work point for each work process, or the "position information" calculated by receiving a GNSS signal from the external base station ST shown in Fig. 1. Naturally, the recognition information is not limited to the identification mark or the position information, and the "work equipment" or "beacon" to be identified may also be used.

[0039] More specifically, the division detection unit 13 (also referred to as the mark detection unit) detects, as the above-mentioned "recognition information," an "identification mark M" provided at the work point for each work process, as shown in FIG. 1, through the work video. Then, for example, when an identification mark M provided at a work point of the second work process is detected, the second division setting unit 14 automatically sets a division in the work video based on the identification mark M. In other words, the second division setting unit 14 automatically sets the start time of the work (work element) in the second work process based on the time when the identification mark M in the second work process is detected. The second break setting unit 14 can also automatically set the end point of the work (work element) in the second work process based on the point in time when the identification mark M in the second work process is no longer detected. This allows the start (end) and end points of each task (task element) in each work process to be automatically set, and also allows for accurate alignment (uniformity) between cycles, resulting in efficient real-time work analysis.

[0040] Alternatively, the delimiter detection unit 13 (also referred to as the location information detection unit) detects the "location information" of the work point for each work process by receiving a GNSS signal from the external base station ST shown in Figure 1 as the above-mentioned "recognition information." Then, when the position information of the work point of the second work process is detected, the second division setting unit 14 automatically sets a division in the work video based on the position information. In other words, the second break setting unit 14 automatically sets the start time of the work (work element) in the second work process based on the time when the position information of the work point in the second work process is detected. The second division setting unit 14 can also automatically set the end point of the work (work element) in the second work process based on the point in time when the position information of the work point in the second work process is no longer detected. The second division setting unit 14 sets a division based on the recognition information to separate the first work process from the second work process, in other words, to separate the work in the first work process from the work in the second work process, and further to separate the last work element in the first work process from the first work element in the second work process. The above method also makes it possible to efficiently perform real-time work analysis.

[0041] In the above configuration, the delimiter detection unit 13 detects both the "identification mark M" and the "position information" as the "recognition information." At this time, depending on the size of the work place and the communication situation, it is possible to detect only either the "identification mark M" or the "position information." In other words, it is possible to detect only the recognition information with high detection accuracy. Alternatively, the "identification mark M" may be given priority, and a delimiter may be automatically set when the "identification mark M" is detected, and if the "identification mark M" is not detected for a certain period of time, a delimiter may be automatically set based on the "position information." Alternatively, the "position information" may be given priority. The delimiter detection unit 13 may also detect other "recognition information."

[0042] In the above configuration, the divisions set by the division setting unit 12 and the divisions automatically set by the second division setting unit 14 may be distinguished by different display modes. Alternatively, the divisions set by the former and the latter may be stored in association with different types (for example, manual division, automatic division). Furthermore, with regard to the delimiters set by the second delimiter setting unit 14, different types (for example, automatic delimiter 1, automatic delimiter 2) may be associated with delimiters based on the "identification mark M" and delimiters based on the "position information". This makes it easy to distinguish whether the breaks were set by a user operation or automatically based on "recognition information," facilitating work analysis.

[0043] <<Analysis of work elements>> The work time calculation unit 15 calculates the work time of a work (work element) in a work process based on the work video in which a breakpoint is set. Specifically, when a division is set for the work video 41 on the captured screen 40 shown in Fig. 5B and the work video 41 is divided into work elements, the work time calculation unit 15 calculates the work time for each work element. In addition, the total time for the work elements is calculated based on the start time of the work. The task time (total time) of the task elements is calculated in the same manner on the task analysis screen 50 shown in FIG.

[0044] The type designation unit 16 records the work video, accepts user operation input based on the work video, and designates a type such as "valid action," "invalid action," "useless action," or "verification action" for each divided work element. Specifically, the type designation unit 16 accepts a drag operation of the type designation button 43 by the user on the imaging screen 40 shown in FIG. 5B, and designates a type for each work element. The type designation unit 16 can also designate a type for each work element by receiving input of a predetermined user operation on the work analysis screen 50 shown in FIG. 6 or the cycle analysis screen 60 shown in FIG.

[0045] The worker information acquisition unit 17 acquires "worker attribute information" for the work (work element) in the work process based on the work video in which the breakpoints are set. Here, "worker attribute information (data)" refers to information that associates at least the worker ID, worker name, worker gender, age, years of experience, and skills with a specified task (task element), and is stored in memory unit 10. Specifically, the worker information acquisition unit 17 receives input of a user operation and generates "worker attribute information" for each work process or work (work element). Alternatively, the worker information acquisition unit 17 can generate "worker attribute information" for each work process or work (work element) by performing image recognition (face recognition) of the worker through work video and extracting matching workers from registered workers whose data has been registered in advance.

[0046] The analysis data generation unit 18 generates "task-related information (task-related data)" as an example of "simplified analysis data" analyzed by the work analysis device 1. As shown in FIG. 10, "work-related data" is a data table showing the analysis results of each work element in line work, which is created and updated by accepting user input (or automatic input), and is stored in the memory unit 10 (also called the work-related memory unit). Specifically, the "work-related data" is data that, for each work (work element), corresponds at least to an identification ID, a work video, information on the work location, attribute information of the worker, recognition information detected by the division detection unit 13, information on the work time, and information on the type. Although details about the work time information are omitted, it also includes information on the work time, average work time, maximum work time, minimum work time, and total time for each cycle, as shown in the "Work Element List Information" in Figure 9.

[0047] Looking at the "Work-related data" shown in Figure 10, we can see that for the identification ID "001" and work element name "Work element 1-1", the work video is "001.mp4", the work location is "First work process", the worker is "Broad Ichiro", the recognition information is "Identification mark", the work time is "-", and the type is "Valid (valid operation)".

[0048] The communication unit 19 performs data communication with the outside via a network. Specifically, the communication unit 19 communicates with the external analysis device 100 via a network, and transmits "task-related data" as simplified analysis data relating to task analysis. The external analysis device 100, which has received the "task-related data," performs a task analysis (detailed analysis) based on the received data, and generates "detailed analysis data." It may also generate "task standard data" that indicates the content of the task standard. Alternatively, the external analysis device 100 may generate detailed analysis data not using the task-related data, but using data that associates at least task videos with type information, which is part of the task-related data. The communication unit 19 communicates with the external analysis device 100 again and receives the "detailed analysis data."

[0049] The analysis data output unit 20 outputs the above-mentioned "detailed analysis data." Specifically, in order to present the contents of the "detailed analysis data" to the analyst or worker, the analysis data output unit 20 outputs and displays the "detailed analysis data" on the display screen of the work analysis device 1. The "detailed analysis data" may also be printed out using an external printing device.

[0050] With the above configuration, it is possible to realize a work analysis device 1 that allows an analyst to identify work elements for each work process while recording work videos in the analysis of line work, and to efficiently analyze the work elements. Furthermore, by using the work analysis device 1, an analyst can immediately provide work improvement guidance (feedback) to a worker.

[0051] <Work analysis method> Next, the processing of the task analysis program (task analysis method) executed by the task analysis device 1 will be described with reference to FIG. The program according to this embodiment is a program for realizing the above-mentioned screen display unit 11, division setting unit 12, division detection unit 13, second division setting unit 14, task time calculation unit 15, type designation unit 16, worker information acquisition unit 17, analysis data generation unit 18, communication unit 19, and analysis data output unit 20 as functional components of the work analysis device 1 equipped with a memory unit 10, and the CPU of the work analysis device 1 executes this work analysis program. The storage unit 10 of the work analysis device 1 mainly stores "work video data," "work element list data," "work-related data," and "work history data."

[0052] The flow shown in Figure 11 shows a part of the processing flow of the "work analysis method." Specifically, it shows the processing flow of a method for performing work analysis based on work videos in real time while recording the work videos.

[0053] The processing flow of the work analysis method shown in Figure 11 begins with step S1, in which the screen display unit 11 accepts a user selection of the option 31 "video capture" on the menu screen 30 shown in Figure 4, and displays the capture screen 40 shown in Figures 5A and 5B. The work analysis device 1 accepts user input, executes a dedicated web application (work analysis program), and displays the above-mentioned "menu screen" when the user logs in.

[0054] Next, in step S2, the work analysis device 1 (imaging unit 7) accepts a predetermined user operation selection and starts imaging the line work (starts recording a work video). More specifically, the work analysis device 1 accepts a user's operation of the imaging execution button 44 on the imaging screen 40 shown in FIGS. 5A and 5B, and starts imaging the work in the first work process of the line work. At this time, the division detection unit 13 detects "recognition information" associated with each work process. The "recognition information" may be an "identification mark M" provided at the work point of each work process, or may be "position information" of the work point of each work process. Furthermore, the worker information acquisition unit 17 acquires "worker attribute information" for a task (task element) in a work process through a work video. At this time, the "worker attribute information" may be generated by accepting input of a user operation, or may be automatically generated by image recognition.

[0055] Next, in step S3, the division setting unit 12 accepts input of a predetermined user operation and sets a "division" for each work element in the work video. Specifically, the operation of the division execution button 42 by the user on the imaging screen 40 shown in Figures 5A and 5B is accepted, and a "division point" is set for the work video 41 being captured. By setting a "division point," a new work element is added. At this time, when a division is set for the work video 41 on the captured screen 40 and the work video 41 is divided into work elements, the work time calculation unit 15 automatically calculates the work time for each work element. In addition, the total time for the work elements is calculated based on the start time of the work. The analyst can check information about the calculated task time through task element list 46 shown in FIG. 5B.

[0056] Next, in step S4, the work analysis device 1 (also referred to as the detection determination unit) determines whether or not the break detection unit 13 has detected new "recognition information." The new "recognition information" corresponds to the "recognition information" associated with the second work process that follows the first work process. If it is determined that new "recognition information" has been detected (step S4: Yes), the process proceeds to step S5. On the other hand, if it is determined that new "recognition information" has not been detected (step S4: No), the process returns to step S3.

[0057] Next, in step S5, the second division setting unit 14 automatically sets a "division" between work in the first work process and work in the second work process in the work video based on the "recognition information" associated with the second work process. Specifically, the start time (dividing point) of the work in the second work process is automatically set for the work video based on the time point when the "recognition information" associated with the second work process is detected.

[0058] Next, in step S6, the work analysis device 1 (imaging unit 7) continuously captures images of the work in the second work process among the line work (continuously records the work video). Then, in step S7, the division setting unit 12 accepts input of a predetermined user operation, as in step S3, and sets a "division" for each work element in the work video.

[0059] Next, in step S8, the work analysis device 1 (also referred to as the detection determination unit) determines whether the break detection unit 13 has detected new "recognition information." The new "recognition information" corresponds to the "recognition information" associated with the third work process that follows the second work process. If it is determined that new "recognition information" has been detected (step S8: Yes), the process returns to step S5, and steps S5 to S8 are repeated for the third work step. Note that this process is repeated until the final work step. On the other hand, if it is determined that new "recognition information" has not been detected (step S8: No), the process proceeds to step S9.

[0060] Finally, in step S9, if the work analysis device 1 receives a user operation to stop recording the work video (step S9: Yes), the process of FIG. 11 ends. On the other hand, if the work analysis device 1 continues to record the work video (step S9: No), the process returns to step S7.

[0061] The above-described configuration of the work analysis program enables an analyst to identify work elements for each work process while recording work videos in the analysis of line work, and to analyze the work elements efficiently.

[0062] The "simplified analysis data" generated by executing the task analysis program is transmitted from the task analysis device 1 to the external analysis device 100 in response to a user operation request. The external analysis device 100 performs a detailed task analysis based on the “simplified analysis data,” generates “detailed analysis data,” and transmits it to the task analysis device 1. The work analysis device 1 receives the "detailed analysis data" and outputs the "detailed analysis data." Note that, in the case of a work that does not require detailed analysis data, it is sufficient to simply output the "simplified analysis data."

[0063] <Other embodiments> In the above embodiment, as shown in FIG. 1, the work analysis device 1 is used to perform work analysis on line work, but it may also be used to perform work analysis on work other than line work.

[0064] In the above embodiment, as shown in FIG. 2, the work analysis device 1 is a mobile terminal and is equipped with a display unit 5 and an imaging unit 7, but it does not necessarily have to be equipped with a display unit 5. That is, the work analysis device 1 does not have to be limited to one equipped with a "display unit (display)", an "imaging unit (imaging camera)", and an "analysis function". For example, the system configuration may be such that the work analysis device 1 is a mobile terminal equipped with an imaging unit and an analysis function, and an external analysis device that communicates with the work analysis device 1 via a network is equipped with a "display device" for displaying work videos.

[0065] In the above embodiment, as shown in Figures 6 to 9, the work analysis device 1 switches between displaying a work analysis screen 50, a cycle analysis screen 60, and a pile graph screen 70, and can perform work analysis from various perspectives, but is not limited to these display screens. For example, a "task comparison screen" that simultaneously displays multiple work videos may be displayed, and a "task comparison analysis" that compares work videos created by different cycles or workers may be performed.

[0066] In the above embodiment, a dedicated web application is launched using the work analysis device 1 (mobile terminal), and the work analysis program is executed on a web browser. Alternatively, the work analysis program may be stored on a recording medium readable by the work analysis device 1, and the processing may be performed by the work analysis device 1 reading and executing the program. Examples of the recording medium include magnetic disks, magneto-optical disks, CD-ROMs, DVD-ROMs, and semiconductor memories.

[0067] In the above embodiment, the task analysis device and task analysis method according to the present invention have been mainly described. However, the above embodiment is merely an example for facilitating understanding of the present invention, and does not limit the present invention. The present invention can be modified or improved without departing from the spirit thereof, and the present invention naturally includes equivalents thereof. [Explanation of symbols]

[0068] S Work Analysis System 1. Work analysis device (mobile work analysis device) 2 CPU 3 Storage device 4. Communication Interface 5 Display section 6 Input section 7. Imaging unit (imaging camera) 10 Memory section (work-related memory section) 11 Screen display section 11a Video display section 11b Operation button display section 11c Work element list display section 11d Location information display section 11e Stacked graph display 12 Delimiter setting unit (first delimiter setting unit) 13 Delimiter detection unit (mark detection unit, position information detection unit) 14 Second delimiter setting section (second delimiter setting section) 15 Work time calculation section 16 Type designation section 17 Worker information acquisition section 18 Analysis Data Generation Department 19 Communications Department 20 Analysis data output section 30 Menu screen 31, 32 Selection items 40 Imaging screen 41 Work Video 42 Separator execution button 43 Type specification button 44 Capture button 45 Cycle Switch Button 46 Work Element List 46a, 46b, 46c, 46d display marks 47 Location information 50 Work analysis screen 51 Work Video 52 Work Element List 53, 54 Cycle switch button 55 Seek bar 55a Division 60 Cycle Analysis Screen 61 Work Element List 70 Stacked graph screen 71 Stacked Graph 72 Timeline 100 External analyzer 101 CPU 102 Storage device 103 Communication Interface 104 Display section 105 Input section 106 Output section 110 Storage section 111 Communications Department 112 Screen display section 113 Analysis Execution Department M Identification mark ST external base station

Claims

1. A work analysis device that analyzes work video of a work consisting of a plurality of work steps, which is captured by an imaging unit, comprising: a first division setting unit that receives a user operation input during shooting of the work video and sets a division for each work element in the work video; a division detection unit that detects, during shooting of the work video, recognition information that recognizes a division between a work in a first work process and a work in a second work process that follows the first work process in the work; a second division setting unit that sets the division for the work video by using a work in the first work process and a work in the second work process as work elements based on the recognition information; a type designation unit that designates a type of the work for each of the work elements separated by the set delimiters; a worker information acquisition unit that acquires attribute information of a worker in the work in the work process and / or the work element based on the work video in which the breakpoint is set; a memory unit that stores work-related data in which at least the work video of the work and / or the work element, a type of the work, attribute information of the worker, and the presence or absence of recognition information regarding a break in the work detected by the break detection unit are associated with each other.

2. The work analysis device according to claim 1 , wherein the storage unit stores different types of first divisions set by the first division setting unit and second divisions set by the second division setting unit in association with each other.

3. The work analysis device A portable device having the imaging unit and capable of capturing the work video, The task analysis device according to claim 1 , wherein analysis data relating to task analysis is generated based on the task-related data.

4. the worker information acquisition unit performs image recognition of a worker in the work in the work process and / or the work element based on the work video, and acquires attribute information of the worker; 3. The work analysis device according to claim 1, further comprising an analysis data generation unit that generates the work-related data associated with information on a work location for each work and / or each work element in the work process.

5. A work analysis method executed by a computer that analyzes work video of a work consisting of a plurality of work steps captured by an imaging unit, comprising: The computer receiving a user operation input during shooting of the work video to set a break point for each work element in the work video; detecting recognition information for recognizing a boundary between a work in a first work process and a work in a second work process subsequent to the first work process during the work video; setting the division for the work video by using the work in the first work process and the work in the second work process as work elements based on the recognition information; Specifying a type of work for each of the work elements separated by the set delimiters; acquiring attribute information of a worker in the work in the work process and / or the work element based on the work video in which the breakpoint is set; A work analysis method that executes the steps of: storing work-related data in which at least the work video of the work and / or the work element, the type of the work, attribute information of the worker, and the presence or absence of recognition information regarding the detected breakpoint of the work are associated with each other.

6. A computer as a work analysis device that analyzes work videos of work consisting of a plurality of work processes captured by an imaging unit, a process of accepting a user operation input during shooting of the work video and setting a break point for each work element in the work video; a process of detecting, during shooting of the work video, recognition information for recognizing a boundary between a work in a first work process and a work in a second work process subsequent to the first work process in the work; a process of setting the division point for the work video based on the recognition information, with the work in the first work process and the work in the second work process being work elements; a process of specifying a type of work for each of the work elements separated by the set delimiters; a process of acquiring attribute information of a worker in the work in the work process and / or the work element based on the work video in which the breakpoint is set; A work analysis program that executes a process of storing work-related data that corresponds at least to the work video of the work and / or the work element, the type of the work, the attribute information of the worker, and the presence or absence of the recognition information regarding the detected breakpoints in the work.

Images