Information processing device, information processing method, and program

Abstract

To provide an information processor, information processing method, and program capable of readily measuring a work time of a wide variety of work.SOLUTION: An information processor includes: an image receiving unit 123 that receives an image outputted from a camera which images an area where work is carried out; an image analysis unit 124 that detects in the image a predetermined condition of an identification mark provided on a work table; and a measurement unit 125 that measures the time elapsed since a first condition, which is detected by the image analysis unit, until a second condition to be detected by the image analysis unit is attained.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] 2. Description of the Related Art Conventionally, in order to manage operations at manufacturing sites and the like, cameras have been installed at the manufacturing sites and image information has been utilized. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2008-59322 A Summary of the Invention [Problem to be solved by the invention]

[0004] Patent Document 1 discloses a system that measures the work time at each process on a line by detecting the parts being worked on with a switch or a sensor. However, in manufacturing sites where parts are not handed over, the technology of measuring work time using a switch or a sensor cannot be directly used. Even if it were technically possible to measure work time using a switch or a sensor, the introduction of such a system would require a considerable capital investment, and switches and sensors specialized for each task would need to be installed.

[0005] SUMMARY OF THE PRESENT EMBODIMENTS Accordingly, an object of the present invention is to provide an information processing device, an information processing method, and a program that are capable of easily measuring the working time of a wide variety of tasks. [Means for solving the problem]

[0006] An information processing device according to one embodiment of the present invention includes an image receiving unit that receives an image output by a camera that photographs the area where work is performed, an image analysis unit that detects a predetermined state of an identification mark affixed to the workbench in the image, and a measurement unit that measures the time required from a first state detected by the image analysis unit to a second state detected by the image analysis unit.

[0007] According to this aspect, the start and end of measurement are indicated by a predetermined state of the identification mark, so that the working time for a wide variety of tasks can be easily measured.

[0008] In the information processing device, when a worker sets a work object on the workbench, the identification mark may be hidden by the work object and the state of the identification mark may change. According to this aspect, the working time of the worker setting the work object on the workbench can be easily measured.

[0009] In the information processing device, the number or shape of the identification marks may be changed between the first state and the second state. According to this aspect, by using a plurality of identification marks to detect a change in the number, or by using a specific mark to detect a change in the shape, it is possible to set optimal measurement start and end times for a wide variety of tasks.

[0010] The information processing device may further include a storage unit that stores information about the predetermined state detected by the image analysis unit. According to this aspect, the working time of a wide variety of tasks can be easily measured according to the information about the predetermined state stored in the storage unit.

[0011] A method according to another aspect of the present invention includes the steps of receiving an image output by a camera photographing an area where work is to be performed, detecting a first state of an identification mark affixed to the workbench in the image, detecting a second state of the identification mark affixed to the workbench in the image, and measuring the time required for the identification mark to change from the first state to the second state.

[0012] A program according to another aspect of the present invention causes one or more computers to perform the following processes: receiving an image output by a camera that photographs the area where work is to be performed; detecting a first state of an identification mark affixed to the workbench in the image; detecting a second state of the identification mark affixed to the workbench in the image; and measuring the time required from the first state to the second state. Effect of the Invention

[0013] According to the present invention, it is possible to provide an information processing device, an information processing method, and a program that are capable of easily measuring the task times of a wide variety of tasks. [Brief description of the drawings]

[0014] [Figure 1] 1 is a schematic diagram of a work management system having an information processing device according to an embodiment of the present invention; [Diagram 2] 1 is a block diagram of a work management system according to an embodiment of the present invention. [Diagram 3] 5 is a diagram illustrating an example of the contents of an identification mark storage unit according to the embodiment of the present invention; FIG. [Figure 4] 4 is a flowchart showing information processing according to an embodiment of the present invention. [Diagram 5] 4 is a diagram illustrating an example of the contents of a work data storage unit according to an embodiment of the present invention; FIG. [Figure 6] 1 is a diagram illustrating an example of an identification mark according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] With reference to the accompanying drawings, the embodiments of the present invention will be described. Note that the following embodiments are intended to facilitate understanding of the present invention and are not intended to limit the present invention. In addition, the present invention can be modified in various ways without departing from the gist of the invention. Furthermore, a person skilled in the art can adopt an embodiment in which each element described below is replaced with an equivalent, and such an embodiment is also included in the scope of the present invention.

[0016] (System Configuration) Fig. 1 is a schematic diagram of a work management system having an information processing device according to an embodiment of the present invention. Fig. 1 shows a schematic diagram of a work site where the work management system is installed. The work management system includes an information processing device 100 and one or more cameras 200 (200a to 200N).

[0017] The information processing device 100 is communicably connected to one or more cameras 200 that capture images of the work area. The cameras 200 are installed so as to be able to capture images of the work area where workers perform work, and output the captured images to the information processing device 100. In this embodiment, as shown in Fig. 1, the cameras 200a and 200b are installed so as to be able to capture images of the work area where workers A and B, who are putting on and taking off T-shirts, perform work on a rotating workbench.

[0018] The work area is provided with an identification mark M that is used to grasp the progress of the worker's work. For example, in one embodiment, four identification marks M are provided at the four corners of each rotating work table. In another embodiment, an identification mark M is provided at each position on the work table where the coasters are set. The T-shirt and the coaster are examples of work objects.

[0019] The identification mark M may be of any shape and any color that can be detected from the image output by the camera 200. Here, one identification mark M may be attached within the working area photographed by one camera, or multiple identification marks M may be attached. Furthermore, when multiple identification marks M are attached within the working area photographed by one camera, the same identification marks M may be attached, or different identification marks M may be attached. In one embodiment, of the four corners of each rotating work table, the two outer corners are attached with identification marks M of a first color, and the two inner corners are attached with identification marks M of a second color.

[0020] Any paint including fluorescent paint and reflective paint can be used for the paint used to draw the identification mark M, and a light source according to the characteristics of the paint can be used to detect the identification mark M. The identification mark M may be drawn directly on the workbench, or a sticker with the identification mark M drawn on it may be affixed.

[0021] The information processing device 100 detects the identification mark M in the image output by the camera 200, and can calculate the working time of the worker based on the change in state of the detected identification mark M.

[0022] (Functional configuration) Fig. 2 is a block diagram of a work management system according to an embodiment of the present invention. Note that Fig. 2 assumes a single information processing device 100 and shows only the necessary functional configuration, but the information processing device 100 can also be configured as a part of a multi-functional distributed system consisting of multiple computer systems.

[0023] The camera 200 includes an image transmission unit 211 .

[0024] The information processing device 100 includes an input unit 110, a control unit 120, a storage unit 130, and a communication unit 140.

[0025] The input unit 110 is configured to receive operations from an administrator of the information processing device 100, and can be realized by a keyboard, a mouse, a touch panel, or the like.

[0026] The control unit 120 includes an arithmetic processing unit 121 such as a CPU or an MPU, and a memory 122 such as a RAM. The arithmetic processing unit 121 operates various functional units by executing a program recorded in the storage unit 130 based on various inputs. This program may be stored in a recording medium such as a CD-ROM, or distributed via a network and installed in the computer. The memory 122 is for temporarily storing various data required for calculations, etc., during execution of processing in various programs.

[0027] The storage unit 130 is configured with a storage device such as a hard disk, and records various programs necessary for executing processes in the control unit 120, data necessary for executing the various programs, etc. In this embodiment, it is desirable for the storage unit 130 to have an image storage unit 131, an identification mark storage unit 132, a work data storage unit 133, and a management information storage unit 134.

[0028] In the image storage unit 131, images output from the image transmission unit 211 of the camera 200 are stored.

[0029] The identification mark storage unit 132 stores information about the identification mark M to be detected by the information processing device 100. In one embodiment, as shown in Fig. 3, it is desirable that the identification mode, the shape, color, size, initial state, state 1, state 2, etc. of the identification mark M are registered in the identification mark storage unit 132. The initial state represents the state of the identification mark M indicating that the worker has not yet started work. State 1 and state 2 are information representing the state of the identification mark M to be detected by the information processing device 100.

[0030] Here, the state of the identification mark M refers to one or more pieces of attribute information related to the identification mark M affixed to the workbench. For example, the state of the identification mark M includes the shape of the detected identification mark M, the color of the detected identification mark M, the size of the detected identification mark M, the coordinates of the detected identification mark M, and the fact that the identification mark M is not detected. In addition, when multiple identification marks M are used, the state of the identification mark M also includes the number of detected identification marks M.

[0031] For example, in the record in the first row of Fig. 3, "Blue: 0" in state 1 represents a state in which the blue identification mark M is zero, i.e., not detected in the image. "Red: 0" in state 2 represents a state in which the red identification mark M is zero, i.e., not detected in the image.

[0032] Also, for example, in the record on the third line in Fig. 3, "decrement" in state 1 represents a state in which the identification marks M present in the initial state are decreased by one. "zero" in state 2 represents a state in which all of the identification marks M present in the initial state are not detected in the image.

[0033] The work data storage unit 133 stores the work time of the workers measured by the information processing device 100. In one embodiment, the work data storage unit 133 stores the work time of worker A who puts one T-shirt on a rotating work table and the work time of worker B who takes off one T-shirt from the rotating work table. In another embodiment, the work data storage unit 133 stores, for worker C who sets coasters on the work table, the work time to set one coaster and the work time to set the maximum number of coasters that can be set on the work table.

[0034] Information related to production management calculated using the working time of each worker is stored in the management information storage unit 134. In one embodiment, the information related to production management preferably includes the average working time of each worker, the expected production volume per unit time, the expected production volume per day, etc.

[0035] The communication unit 140 is configured to connect the information processing device 100 to a network. For example, the communication unit 140 can be realized by a LAN card, an analog modem, an ISDN modem, or the like, and an interface for connecting these to a processing unit via a transmission path such as a system bus.

[0036] Furthermore, as shown in FIG. 2, the arithmetic processing unit 121 includes, as functional units, an image receiving unit 123, an image analyzing unit 124, a measuring unit 125, a calculating unit 126, and an output unit 127.

[0037] The image receiving unit 123 receives the images output from the image transmitting unit 211 of the camera 200 and stores them in the image storage unit 131 .

[0038] The image analysis unit 124 detects a change in the state of the identification mark M in the image stored in the image storage unit 131. Specifically, the image analysis unit 124 detects a specific state of the identification mark M in the image based on the information stored in the identification mark storage unit 132, and notifies the measurement unit 125 of the detected state information.

[0039] The measurement unit 125 measures the time taken to change from one state to another state based on the state information notified from the image analysis unit 124, and stores the measured time in the work data storage unit 133. In one embodiment, the measurement unit 125 measures the time taken to change from state 1 to state 2, which is notified from the image analysis unit 124, based on the record in the first row of Fig. 3, and stores the measured time in the work data storage unit 133. In another embodiment, the measurement unit 125 measures the time taken to change from state 1 to the next state 1, which is notified from the image analysis unit 124, based on the record in the third row of Fig. 3, and stores the measured time in the work data storage unit 133.

[0040] The calculation unit 126 calculates information related to manufacturing management using the work hours of the workers stored in the work data storage unit 133, and stores the calculated information in the management information storage unit 134. In one embodiment, the calculation unit 126 calculates the average work time of each worker, the expected production volume per unit time, and the expected production volume per day, and stores the calculated information in the management information storage unit 134.

[0041] The output unit 127 outputs the time measured by the measurement unit 125 or the information calculated by the calculation unit 126 .

[0042] (First embodiment) In this embodiment, an example of measuring the working time of a worker putting a T-shirt on a rotating workbench will be described with reference to FIG. 4. Each rotating workbench has an identification mark M on each of the four corners. As shown in FIG. 1, blue identification marks M are attached to the two outer corners and red identification marks M are attached to the two inner corners. When a worker puts a T-shirt on the workbench, first the blue identification mark M on the outside becomes invisible because it is hidden by the T-shirt, and then the red identification mark M on the inside becomes invisible because it is hidden by the T-shirt. It is also assumed that an administrator has stored information in advance in the identification mark storage unit 132 via the input unit 110 of the information processing device 100.

[0043] In step S 401 , the image receiving unit 123 of the information processing device 100 receives an image output from the image transmitting unit 211 of the camera 200 , and stores it in the image storage unit 131 .

[0044] In step S402, the image analysis unit 124 of the information processing device 100 determines whether or not there is an unanalyzed image. If it is determined that there is no unanalyzed image, the process ends.

[0045] On the other hand, if there is an unanalyzed image (S402: Yes), the image analysis unit 124 reads the image stored in the image storage unit 131 and attempts to detect the identification mark M (S403). In step S404, the image analysis unit 124 determines whether or not the image is in a specific state stored in the identification mark storage unit 132, and if it is determined that the image is not in a specific state (S404: No), the process returns to step S402.

[0046] On the other hand, if it is determined that the state is a specific state (S404: Yes), the image analysis unit 124 notifies the measurement unit 125 of the detected state information (S405). Here, the image analysis unit 124 notifies the measurement unit 125 of the detected state information "State 1".

[0047] In step S406, the measurement unit 125 of the information processing device 100 determines whether to start or end measurement, or to end measurement and start a new measurement, based on the state information notified from the image analysis unit 124. Here, the measurement unit 125 determines to start measurement, starts measurement (S407), and the process returns to step S402.

[0048] When it is determined in step S404 again that the state is a specific state (S404: Yes), the image analysis unit 124 notifies the measurement unit 125 of the detected state information (S405). Here, the image analysis unit 124 notifies the measurement unit 125 of the detected state information "State 2".

[0049] In step S406 again, the measurement unit 125 determines whether to start or end the measurement, or to end the measurement and start a new one, based on the status information notified from the image analysis unit 124. Here, the measurement unit 125 determines to end the measurement (S406: End), ends the measurement, and stores the measured time in the work data storage unit 133 (S408). Thereafter, the process returns to step S402, and continues until it is determined in step S402 that there are no unanalyzed images.

[0050] As described above, according to this embodiment, the information processing device 100 can easily measure the task time of a worker who sets a single work object on the workbench. By indicating the start and end of a task by the state of the identification mark M, the optimal start and end of a task can be set according to a wide variety of tasks, and task time can be easily measured.

[0051] In this embodiment, identification marks M are attached to the four corners of the workbench to measure the work time, but identification marks M may also be attached to two places, one on the outside and one on the inside of the workbench to measure the work time, or a single identification mark M may be attached to the entire workbench to measure the work time.

[0052] In addition, in this embodiment, the identification marks M are different in color between the outside and inside, but the same color may be used for the identification marks M. When selecting the color of the identification marks M, it is preferable to select a color that does not exist in the working area in order to avoid erroneous detection of the identification marks M.

[0053] In addition, although a circular identification mark M is used in this embodiment, an identification mark M of any other shape can be used. For example, a code such as a barcode or a two-dimensional code may be used as the identification mark M. By using a code identification mark M, it is expected that the detection speed of the identification mark M can be increased and erroneous detection of the identification mark M can be prevented. Furthermore, by using an identification mark M of a code that is carefully set for each task and the progress of the task, more detailed task data can be obtained. When selecting the shape of the identification mark M, it is preferable to select a shape that does not exist in the work area in order to avoid erroneous detection of the identification mark M.

[0054] Second embodiment In the second embodiment, an example of measuring the working time of a worker who sets a coaster on a workbench will be described with reference to Fig. 4. As shown in Fig. 6(a), an identification mark M is attached to each position on the workbench where the coaster is to be set. When the worker sets the coaster in a predetermined position, the identification mark M becomes hidden by the coaster and cannot be seen. It is also assumed that the administrator has stored information in advance in the identification mark storage unit 132 via the input unit 110 of the information processing device 100.

[0055] In step S 401 , the image receiving unit 123 of the information processing device 100 receives an image output from the image transmitting unit 211 of the camera 200 , and stores it in the image storage unit 131 .

[0056] In step S402, the image analysis unit 124 of the information processing device 100 determines whether or not there is an unanalyzed image. If it is determined that there is no unanalyzed image, the process ends.

[0057] On the other hand, if there is an unanalyzed image (S402: Yes), the image analysis unit 124 reads the image stored in the image storage unit 131 and attempts to detect the identification mark M (S403). In step S404, the image analysis unit 124 determines whether or not the image is in a specific state stored in the identification mark storage unit 132, and if it is determined that the image is not in a specific state (S404: No), the process returns to step S402.

[0058] On the other hand, if it is determined that the image is in a specific state (S404: Yes), the image analysis unit 124 notifies the measurement unit 125 of the detected state information (S405). Here, in response to the number of identification marks M detected in the previous image (30) becoming 29 in the image currently being analyzed, the image analysis unit 124 notifies the measurement unit 125 of the state information "State 1".

[0059] In step S406, the measurement unit 125 of the information processing device 100 determines whether to start or end measurement, or to end measurement and start a new measurement, based on the state information notified from the image analysis unit 124. Here, the measurement unit 125 determines to start measurement, starts measurement (S407), and the process returns to step S402.

[0060] When it is determined again in step S404 that the image is in a specific state (S404: Yes), the image analysis unit 124 notifies the measurement unit 125 of the detected state information (S405). Here, in response to the number of identification marks M detected in the previous image being 29 becoming 28 in the image currently being analyzed, the image analysis unit 124 notifies the measurement unit 125 of the state information "state 1".

[0061] In step S406 again, the measurement unit 125 determines whether to start or end measurement, or to end measurement and start a new measurement, based on the state information notified from the image analysis unit 124. Here, the measurement unit 125 determines to end measurement and start a new measurement (S406: end & start), and the measurement unit 125 stores the measured time in the work data storage unit 133 (S409). Furthermore, the measurement unit 125 starts measurement (S410), and the process returns to step S402.

[0062] Then, again in step S404, the image analysis unit 124 notifies the measurement unit 125 of the status information “Status 1, Status 2” in response to the fact that the number of identification marks M detected in the previous image: 1 has become 0 in the image currently being analyzed.

[0063] In step S406 again, the measurement unit 125 determines to end the measurement (S406: End), and the measurement unit 125 ends the measurement and stores the measured time in the working data storage unit 133 (S408). After that, the process continues until it is determined in step S402 that there are no unanalyzed images.

[0064] As described above, according to this embodiment, the information processing device 100 can easily measure the task time of a worker who sets multiple work objects on a workbench. By indicating the start and end of a task by the state of the identification mark M, the optimal start and end of a task can be set according to a wide variety of tasks, and task time can be easily measured.

[0065] In this embodiment, a circular identification mark M is used, but any other shape of identification mark M can be used. For example, a code such as a barcode or a two-dimensional code may be used as the identification mark M. By using a code identification mark M, it is expected that the detection speed of the identification mark M can be increased and erroneous detection of the identification mark M can be prevented. Furthermore, by using a code identification mark M that is carefully set for each task and the progress of the task, more detailed task data can be obtained. When selecting the shape of the identification mark M, it is preferable to select a shape that does not exist in the work area in order to avoid erroneous detection of the identification mark M.

[0066] In this embodiment, the identification marks M have the same shape, but different shapes of identification marks M may be used at each position. For example, as shown in Fig. 6(b), by using identification marks M with consecutive numbers at each position, the order in which the workers set the coasters can be easily understood while measuring the work time.

[0067] Furthermore, by using the identification mark M of, for example, a number or a character string, it is possible to easily detect the identification mark M with high accuracy using existing OCR technology.

[0068] (Variation 1) In the first and second embodiments, an example has been described in which the measurement unit 125 measures the task time at the timing when the image analysis unit 124 analyzes the image. In another embodiment, the task time can be measured at any timing after the image analysis unit 124 analyzes the image. For example, instead of notifying the status information in step S405 in Fig. 4, the image analysis unit 124 may store the time and the detected status information in the task data storage unit 133 as shown in Fig. 5.

[0069] Thereafter, the measurement unit 125 can measure the task time using the time, the identification mode, and the detected state stored in the task data storage unit 133, and store the measured task time in the storage unit .

[0070] (Variation 2) In the first and second embodiments, an example of measuring the task time of a worker has been described. In another embodiment, instead of or in addition to the task time of a worker, the task quantity of the worker can be counted. For example, instead of ending the measurement in steps S408 and S409 of FIG. 4, the measurement unit 125 may increment the task quantity and store the incremented task quantity in the task data storage unit 133.

[0071] In addition, in an example in which the work quantity is counted in addition to the work time of a worker, the measurement unit 125 may increment the work quantity when ending measurement in steps S408 and S409 of FIG. 4, and store the incremented work quantity and work time in the work data storage unit 133, or in steps S408 and S409 of FIG. 4, only the work time may be stored in the work data storage unit 133, and the number of work times stored in the work data storage unit 133 may be counted at any timing after the processing of FIG. 4 is completed, thereby determining the work quantity.

[0072] (Management information calculation process) Next, the management information calculation process will be described. The calculation unit 126 of the information processing device 100 can calculate information related to manufacturing management using the work time of the workers stored in the work data storage unit 133, and store the calculated information in the management information storage unit 134. In this embodiment, the calculation unit 126 calculates the average work time of each worker, the expected production number per unit time, and the expected production number per day, and stores the calculated information in the management information storage unit 134.

[0073] The calculation unit 126 may start processing at any timing, may receive an instruction to start processing from an administrator via the input unit 110, or may start processing at a predetermined timing, such as 10 p.m. every day.

[0074] Furthermore, the output unit 127 of the information processing device 100 can output the information calculated by the calculation unit 126.

[0075] As described above, according to this embodiment, the information processing device 100 can obtain various data by utilizing the measured working time of the workers. By grasping the average working time of each worker, the expected production volume per unit time, the expected production volume per day, etc., production management at the manufacturing site can be performed more accurately.

[0076] (Identification mark) Variations of the identification mark M will be described with reference to Fig. 6. Fig. 6(a) to (c) respectively show examples of the identification mark. Fig. 6(a) is an example in which a circular figure is used as the identification mark, as explained in the second embodiment. Fig. 6(b) is an example in which consecutive numbers are used as the identification mark, as explained at the end of the second embodiment.

[0077] FIG. 6(c) shows an example of a lattice-shaped figure as an identification mark. For example, when measuring T-shirts of multiple sizes while distinguishing between sizes, a lattice-shaped figure can be used as the identification mark. Specifically, when a large-sized T-shirt is placed on the work bench, all the lines of the lattice pattern are hidden by the T-shirt and cannot be seen, whereas when a small-sized T-shirt is placed on the work bench, some of the inner lines are not hidden by the T-shirt and can be seen. In such a case, the work time or the amount of work of the worker can be measured using information from the identification mark storage unit 132 shown in the identification modes "4" and "5" in FIG. 3. [Explanation of symbols]

[0078] 100...information processing device, 110...input unit, 120...control unit, 121...arithmetic processing unit, 122...memory, 123...image receiving unit, 124...image analysis unit, 125...measurement unit, 126...calculation unit, 127...output unit, 130...storage unit, 131...image storage unit, 132...identification mark storage unit, 133...work data storage unit, 134...management information storage unit, 140...communication unit, 200...camera, 211...image transmission unit, M...identification mark

Claims

1. an image receiving unit that receives an image output by a camera that photographs an area where work is to be performed; an image analysis unit that detects a predetermined state of an identification mark affixed to the workbench in the image; a measurement unit that measures a time from a first state detected by the image analysis unit to a second state detected by the image analysis unit; An information processing device comprising:

2. The information processing apparatus according to claim 1 , wherein when a worker sets a work object on the work table, the identification mark is hidden by the work object and a state of the identification mark changes.

3. The information processing device according to claim 1 , wherein the number of identification marks or the shape of the identification marks is changed between the first state and the second state.

4. The information processing device according to claim 1 , further comprising a storage unit that stores information regarding the predetermined state detected by the image analysis unit.

5. receiving an image output by a camera capturing an area in which work is to be performed; detecting a first state of an identification mark affixed to the workbench in the image; detecting a second state of an identification mark affixed to the workbench in the image; measuring the time it takes for the first state to change to the second state; The method includes:

6. On one or more computers, receiving an image output by a camera photographing the area in which the work is to be performed; detecting a first state of an identification mark affixed to the workbench in the image; detecting a second state of an identification mark affixed to the workbench in the image; measuring a time required for the first state to change to the second state; A program that executes the following.

Images