Information processing device, lighting device, and lighting system

Abstract

To provide an information processing apparatus configured to improve accuracy of work information to be recorded, an illumination apparatus, and an illumination system.SOLUTION: An information processing apparatus includes a detection unit, a specifying unit, a determination unit, and a work recording unit. The detection unit detects a position of a specific section of the body of a worker from an image captured by an imaging unit. The specifying unit specifies work executed by the worker on the basis of the detected position of the specific section. The determination unit determines whether the specified work has deviated from a work procedure registered in advance. The work recording unit records the work determined to have deviated from the work procedure, as invalid work, on work information. Accordingly, accuracy of the recorded work information can be improved.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] FIELD Embodiments of the present invention relate to an information processing device, a lighting device, and a lighting system. [Background technology]

[0002] A technology has been proposed in the past in which an image captured by an imaging unit is acquired by an information processing device, the position of a specific part of the worker is detected, and if the position of the specific part is located within the work area, it is determined that the worker is performing useful work, and the working time of the useful work is recorded, and the working time when the worker completes one unit of work is recorded. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-120577 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in conventional technology, valid work is determined solely based on the intrusion of a specific part. For example, if a worker must pass through another work area to enter a certain work area, valid work may be determined in the other work area even though there is no work being done in that area, which could result in incorrect work information being recorded.

[0005] The problem to be solved by the present invention is to provide an information processing device, a lighting device, and a lighting system that can improve the accuracy of recorded work information. [Means for solving the problem]

[0006] An information processing device according to an embodiment includes a detection unit, an identification unit, a determination unit, and a work recording unit. The detection unit detects the position of a specific part of a worker's body from an image captured by an imaging unit. The identification unit identifies a work performed by the worker based on the detected position of the specific part. The determination unit determines whether the identified work deviates from a pre-registered work procedure. The work recording unit records work information for the work determined to deviate from the work procedure as invalid work. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a perspective view showing an example of the appearance of a lighting device included in a lighting system according to an embodiment. [Figure 2] FIG. 2 is a diagram showing an overview of a lighting system according to an embodiment. [Figure 3] FIG. 3 is a block diagram showing the configuration of the information processing device according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of information processing according to the embodiment. [Figure 5] FIG. 5 is a diagram illustrating an example of information processing according to the embodiment. [Figure 6] FIG. 6 is a flowchart showing the processing procedure of the processing executed in the information processing device according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0008] The information processing device 20 described below includes a detection unit 232, an identification unit 233, a determination unit 234, and a work recording unit 235. The detection unit 232 detects the position of a specific body part of the worker 50 from an image captured by the imaging unit (camera 16). The identification unit 233 identifies the work performed by the worker 50 based on the detected position of the specific body part. The determination unit 234 determines whether the identified work deviates from a work procedure registered in advance. The work recording unit 235 records work information for work determined to deviate from the work procedure as invalid work.

[0009] The determination unit 234, which will be described below, determines that a deviation has occurred when the work procedure of the identified work falls into a preset exceptional work procedure.

[0010] The work recording unit 235 described below records work information when work that deviates from a pre-registered work procedure is performed after the work is performed according to the work procedure, as invalid work.

[0011] The lighting device 10 described below includes an imaging unit and a lighting unit 11. The imaging unit captures an image of the worker 50 and transmits the captured image to the information processing device 20. The lighting unit 11 illuminates the worker 50.

[0012] The lighting system 1 described below includes a lighting device 10 and an information processing device 20. The lighting device 10 has an imaging unit that captures an image of a worker 50, and an illumination unit 11 that illuminates the worker 50. The information processing device 20 has a detection unit 232 that detects the position of a specific body part of the worker 50 from an image captured by the imaging unit, an identification unit 233 that identifies an operation performed by the worker 50 based on the detected position of the specific body part, a determination unit 234 that determines whether the identified operation deviates from a pre-registered operation procedure, and a work recording unit 235 that records operation information of an operation determined to deviate from the operation procedure as an invalid operation.

[0013] Hereinafter, an information processing device, a lighting device, and a lighting system according to an embodiment will be described with reference to the drawings. The same components in the embodiments are denoted by the same reference numerals, and duplicated descriptions will be omitted.

[0014] [Lighting equipment] First, the configuration of a lighting device 10 according to an embodiment will be described with reference to Fig. 1. Fig. 1 is a perspective view showing an example of the appearance of the lighting device 10 included in a lighting system 1 according to an embodiment.

[0015] 1, lighting device 10 includes lighting unit 11, imaging unit 12, and main body 13. Lighting device 10 is a ceiling-mounted lighting device in which main body 13 is installed on a ceiling surface or the like, and light output from lighting unit 11 is irradiated onto a floor surface. Lighting device 10 is primarily used indoors, for example, for monitoring production lines in a factory or the status of employees in an office.

[0016] For ease of understanding, Fig. 1 illustrates a three-dimensional Cartesian coordinate system including a Z axis, with the positive direction being vertically downward and the negative direction being vertically upward. The X axis is illustrated as extending along the length direction of the lighting device 10, and the Y axis is illustrated as extending along the width direction of the lighting device 10.

[0017] The lighting unit 11 is an illumination bar having a plurality of light-emitting elements (not shown) arranged at predetermined intervals on a long chassis or substrate (not shown) arranged along the Y-axis direction, and a diffusion cover 14 is provided on the floor side, i.e., on the positive Z-axis side, so that the light-emitting elements are housed between the chassis and the light-emitting elements.

[0018] The diffusion cover 14 is made of a light-transmitting material such as acrylic or polycarbonate. The diffusion cover 14 is frosted to diffuse the light emitted from the multiple light-emitting elements. Note that the diffusion cover 14 may contain a suitable diffusing material or colorant.

[0019] The imaging unit 12 has a light-shielding cover 15 and a camera 16. The camera 16 is an example of an imaging section. The imaging units 12 are arranged side by side adjacent to the illumination section 11 on the negative side of the X axis.

[0020] The main body 13 holds the lighting section 11 and the imaging unit 12. The main body 13 also serves as a mounting member for mounting the lighting device 10 to a predetermined position such as a ceiling.

[0021] The light-shielding cover 15 is disposed on the positive side of the Z axis of the main body 13 so as to cover the camera 16 between the main body 13 and the light-shielding cover 15. The light-shielding cover 15 also has a through-hole provided in a position facing the lens of the camera 16. By disposing such a light-shielding cover 15, it is possible to make it difficult for light emitted from the diffusion cover 14 of the illumination unit 11 to enter the lens of the camera 16.

[0022] [Lighting System] Next, the configuration of a lighting system 1 according to an embodiment will be described with reference to Fig. 2. Fig. 2 is a diagram showing an overview of the lighting system 1 according to an embodiment. Note that the following description will be given taking as an example a case where the lighting system 1 is installed in a factory.

[0023] 2, the lighting system 1 according to the embodiment includes a plurality of lighting devices 10 and an information processing device 20. In the example shown in FIG. 2, the lighting devices 10 are installed in a work site (for example, a production line) of a factory.

[0024] The lighting devices 10 are provided, for example, above the work spaces 40 (see FIG. 4) of the workers 50 on the production line, and the cameras 16 capture images of the work spaces 40 from above.

[0025] The information processing device 20 is a device that manages each lighting device 10 installed at a work site. For example, the information processing device 20 remotely controls the lighting mode of the lighting unit 11 of each lighting device 10, the imaging process of the camera 16, etc. via the network N.

[0026] The information processing device 20 also collects and stores captured images captured by the camera 16 of each lighting device 10. For example, the captured images collected by the information processing device 20 are used for monitoring a work site. In the present disclosure, the information processing device 20 may acquire captured images as still images or as moving images.

[0027] [Information processing device] Next, the configuration of the information processing device 20 according to the embodiment will be described with reference to Fig. 3. Fig. 3 is a block diagram showing the configuration of the information processing device 20 according to the embodiment. As shown in Fig. 3, the information processing device 20 includes a communication unit 21, a storage unit 22, and a control unit 23. The information processing device 20 is, for example, a cloud server.

[0028] The communication unit 21 is realized by, for example, a network interface card (NIC), etc. The communication unit 21 transmits and receives information to and from the plurality of lighting devices 10 and the administrator terminal 30 via the network N, for example.

[0029] The storage unit 22 functions as a storage unit in the cloud server and is realized by, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a storage device such as a hard disk or an optical disk.

[0030] 3, the storage unit 22 includes a captured image storage unit 221, a work time storage unit 222, a work process storage unit 223, a work information storage unit 224, and an exception setting storage unit 225. The captured image storage unit 221 stores captured images captured by each lighting device 10.

[0031] The work time memory unit 222 stores the time during which the worker 50 (see Figure 4) performed valid work (hereinafter also referred to as valid work time) and the time during which the worker 50 performed invalid work (hereinafter also referred to as invalid work time) in one unit work or one work process described below.

[0032] In the present disclosure, useful work refers to work that adds value to an object of work, such as work to attach parts to an object.

[0033] In addition, in this disclosure, an invalid operation is an operation that does not add value to the object of the operation, such as the operation of picking up parts or tools for work. Furthermore, in this disclosure, a single unit operation is, for example, an operation performed on a single object.

[0034] The work process memory unit 223 stores pre-registered work processes that each worker 50 should perform on the production line. In the present disclosure, a work process refers to a unit task that the worker 50 should perform in the work space 40. Specifically, a work process includes the type of unit task to be performed and the order in which the unit tasks are performed (work sequence). Note that the work sequence does not necessarily have to be included in the work process.

[0035] The work information storage unit 224 stores the work performed by each worker 50. For example, the work information storage unit 224 stores the type of unit work performed by the worker 50 and the start time and end time of each unit work (or only one of the times may be stored). In other words, the work information storage unit 224 stores the history of work performed by each worker 50.

[0036] The exception setting storage unit 225 stores exceptional work procedures for treating an invalid work. The exceptional work procedures are used in the determination process of the determination unit 234, which will be described later.

[0037] The control unit 23 functions as a control unit in the cloud server. The control unit 23 is a controller, and is realized, for example, by a CPU (Central Processing Unit) or an MPU (Micro Processing Unit) executing various programs stored in a storage device inside the information processing device 20 using RAM as a work area. The control unit 23 is also, for example, a controller, and is realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0038] 3, the control unit 23 includes an acquisition unit 231, a detection unit 232, an identification unit 233, a determination unit 234, and an operation recording unit 235, and realizes or executes the functions and actions of the control processing described below. Note that the internal configuration of the control unit 23 is not limited to the configuration shown in FIG. 3, and may be any other configuration as long as it performs the control processing described below.

[0039] The acquisition unit 231 acquires captured images captured by the camera 16 of the lighting device 10. For example, the acquisition unit 231 acquires captured images from the camera 16 of each lighting device 10 in real time, and stores the acquired captured images in the captured image storage unit 221 for each work space 40 (or for each worker 50).

[0040] The detection unit 232 performs various detections. For example, the detection unit 232 detects the positions of both hands 51 (see FIG. 4) of the worker 50 from the captured images acquired by the acquisition unit 231 and stored in the captured image storage unit 221. Both hands 51 of the worker 50 are an example of a specific body part of the worker 50. Note that the detection unit 232 may detect only one hand as the specific body part of the worker 50, or may detect parts other than the hands, such as the head or feet.

[0041] Furthermore, the detection unit 232 detects the position of an object (target object) to be worked on within the work space 40 from the captured image acquired by the acquisition unit 231.

[0042] The identification unit 233 identifies the work (unit work) performed by the worker 50 based on the positions of both hands 51 of the worker 50, the position of the object, etc. detected by the detection unit 232. For example, the identification unit 233 identifies that the unit work was performed in the work area where the hands of the worker 50 are located.

[0043] The determination unit 234 determines whether the worker 50 is performing valid work or invalid work based on the positions of both hands 51 of the worker 50 and the position of the object detected by the detection unit 232. Specifically, the determination unit 234 determines whether the work is valid or invalid based on the state in which the object is being held by both hands 51 of the worker 50 and whether both hands 51 are present within the work area.

[0044] Furthermore, the determination unit 234 determines whether or not an operation determined to be a valid operation among the operations (unit operations) identified by the identification unit 233 deviates from a pre-registered operation procedure. Details of this determination process will be described later with reference to FIG. 4 and subsequent figures.

[0045] The determination unit 234 also measures the time during which the worker 50 performed valid work (valid work time) and the time during which the worker 50 performed invalid work (invalid work time) in one unit task. The determination unit 234 also stores the valid work time and invalid work time in one unit task performed by the worker 50 in the task time memory unit 222 of the memory unit 22.

[0046] The work recording unit 235 records the work information of the work (valid work) that has been determined by the determining unit 234 to have deviated from the work procedure as an invalid work. Note that this recording process will be described later with reference to FIG.

[0047] Next, details of the information processing performed by the information processing device 20 will be described with reference to Fig. 4 and Fig. 5. Fig. 4 and Fig. 5 are diagrams showing an example of the information processing according to the embodiment. Fig. 4 shows an image captured by the camera 16 of the lighting device 10 placed above the workspace 40.

[0048] 4 shows a work process in which worker 50 works in work areas A1 to A5 on workbench 41 and places the target object, which is the finished product, in finished product area A6. Each of work areas A1 to A5 includes an area where worker 50 works on the target object and an area where each part is placed. Alternatively, each of work areas A1 to A5 may include only an area where each part is placed. In such a case, worker 50 picks up parts from each of work areas A1 to A5 and works on the target object in an area other than areas A1 to A6 on workbench 41.

[0049] Although FIG. 4 shows an example in which one unit task is performed in each of the work areas A1 to A5, a plurality of unit tasks may be performed in each of the work areas A1 to A5.

[0050] When worker 50 works in work area A2, his / her hand passes through work area A3 to access work area A2, as shown by the arrow in Fig. 4. When worker 50 picks up a part in work area A2 and returns, he / she passes through work area A3.

[0051] In this case, although the work should have been done only in the work area A2, in the prior art, erroneous work information would be recorded indicating that work was done in the work area A3, the work area A2, and the work area A3.

[0052] Therefore, when work is performed that deviates from the pre-registered work procedure, the information processing device 20 records the work information as invalid work.

[0053] Specifically, as shown in FIG. 5, in a work procedure from work area A1 to work area A3, if work area A1 is followed by work area A3, work area A2, work area A3, and work area A3, the judgment unit 234 modifies the work information by treating the valid work in the second work area A3 and the fourth work area A4 as invalid work.

[0054] As a result, the actually recorded work information will record that work was performed in the order of work area A1, work area A2, and work area A3. In other words, the accuracy of the recorded work information can be improved.

[0055] Specifically, if the work procedure of a task determined to be valid work is the same as an exceptional work procedure stored in the exception setting memory unit 225, the judgment unit 234 judges that the task has deviated from the pre-registered work procedure.

[0056] In other words, if the work procedures for work area A1, work area A3, work area A2, work area A3, and work area A3 are stored as exceptional work procedures, the judgment unit 234 will judge that the work procedures have been deviated from if such exceptional work procedures actually occur.

[0057] By setting such an exceptional work procedure, invalid work that deviates from the work procedure can be identified with high accuracy.

[0058] More specifically, when a task that deviates from a pre-registered work procedure is performed after a task that conforms to the work procedure is performed, the work recording unit 235 records the deviating task as an invalid task in the work information. That is, when a task in the deviating work area A3 is performed after the task in the work area A1, and then a task in the original work procedure, namely, a task in the work area A2, is performed, the work in the work area A3 is recorded in the work information as an invalid task.

[0059] This makes it possible to improve the accuracy of the work information recorded in situations such as when a worker must pass through another work area A3 in order to perform the original work procedure in work area A2.

[0060] Next, a processing procedure of processing executed by the information processing device 20 according to the embodiment will be described with reference to Fig. 6. Fig. 6 is a flowchart showing the processing procedure of processing executed by the information processing device 20 according to the embodiment.

[0061] 6, first, the information processing device 20 starts the work analysis (step S101). The start of the work analysis may be triggered by an instruction from a manager or the like, or may be triggered by the start of production on the production line.

[0062] Next, the information processing device 20 reads the work process information stored in the work process storage unit 223 (step S102). Next, the information processing device 20 starts acquiring captured images from the lighting device 10 (step S103).

[0063] Next, the information processing device 20 starts measuring the work time (step S104). Next, the information processing device 20 determines whether or not the hands of the worker 50 have been detected (step S105).

[0064] If the information processing device 20 detects the hand of the worker 50 (step S105: Yes), it determines whether the hand is present in the work area (step S106). Subsequently, if the hand is present in the work area (step S106: Yes), the information processing device 20 determines whether the work procedure of the identified work is an exceptional work procedure (step S107).

[0065] If the procedure is not an exceptional work procedure (step S107: No), the information processing device 20 determines that the work procedure is a valid work procedure (step S108), records this as work information (step S109), and returns to step S105.

[0066] On the other hand, if the work procedure is an exceptional work procedure in step S107 (step S107: Yes), the information processing device 20 determines that the work procedure is an invalid work procedure (step S110), records this as work information (step S111), and returns to step S105.

[0067] Furthermore, in step S105, if the information processing device 20 does not detect the hands of the worker 50 (step S105: No), it determines whether or not to end the work analysis (step S112). Note that the end of the work analysis may be triggered, for example, by an instruction from a manager or by the end of production on the production line.

[0068] When the task analysis is to be ended (step S112: Yes), the information processing device 20 ends the measurement of task time (step S113), ends the task analysis (step S114), and ends the process.

[0069] Furthermore, in step S112, if the information processing device 20 does not want to end the task analysis (step S115: No), the process returns to step S105.

[0070] Furthermore, in step S106, if the hand is not within the work area (step S106: No), the information processing device 20 returns to step S105.

[0071] As described above, the information processing device 20 according to the embodiment includes the detection unit 232, the identification unit 233, the determination unit 234, and the work recording unit 235. The detection unit 232 detects the position of a specific body part of the worker 50 from an image captured by the imaging unit (camera 16). The identification unit 233 identifies the work performed by the worker 50 based on the detected position of the specific body part. The determination unit 234 determines whether the identified work deviates from a pre-registered work procedure. The work recording unit 235 records work information about work determined to deviate from the work procedure as invalid work. This can improve the accuracy of the recorded work information.

[0072] Although an embodiment of the present invention has been described, this embodiment is presented as an example and is not intended to limit the scope of the invention. This embodiment can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. This embodiment and its modifications are included within the scope and spirit of the invention, as well as the invention described in the claims and their equivalents. [Explanation of symbols]

[0073] 1. Lighting system 10. Lighting equipment 11 Lighting Department 12 Imaging unit 13 Main body 14 Diffusion Cover 15 Light-shielding cover 16 Camera 20 Information processing equipment 21 Communications Department 22 Memory section 23 Control Unit 30 Administrator terminal 40 workspace 41 Workbench 50 workers 51 Both hands 221 Captured image storage unit 222 Working time memory section 223 Work process memory section 224 Work information memory unit 225 Exception setting memory section 231 Acquisition Department 232 Detection unit 233 Specific part 234 Judgment section 235 Work Recording Department N Network

Claims

1. a detection unit that detects the position of a specific part of the worker's body from the captured image taken by the imaging unit; an identification unit that identifies the work performed by the worker based on the detected position of the specific part; a determination unit that determines whether the identified work deviates from a pre-registered work procedure; a work recording unit that records work information of the work determined to have deviated from the work procedure as an invalid work; Equipped with The determination unit If the identified work procedure of the work falls into a preset exceptional work procedure, it is determined that a deviation has occurred. Information processing device.

2. a detection unit that detects the position of a specific part of the worker's body from the captured image taken by the imaging unit; an identification unit that identifies the work performed by the worker based on the detected position of the specific part; a determination unit that determines whether the identified work deviates from a pre-registered work procedure; a work recording unit that records work information of the work determined to have deviated from the work procedure as an invalid work; Equipped with The work recording unit When a work deviating from a pre-registered work procedure is performed after the work is performed according to the work procedure, the work information is recorded regarding the deviating work as an invalid work. Information processing device.

3. a lighting device; an information processing device; Equipped with The lighting device includes: an imaging unit that images the worker; a lighting unit that illuminates the worker; and The information processing device includes: a detection unit that detects the position of a specific part of the worker's body from the captured image taken by the imaging unit; an identification unit that identifies the work performed by the worker based on the detected position of the specific part; a determination unit that determines whether the identified work deviates from a pre-registered work procedure; a work recording unit that records work information of the work determined to have deviated from the work procedure as an invalid work; and The determination unit If the identified work procedure of the work falls into a preset exceptional work procedure, it is determined that a deviation has occurred. Lighting system.

4. a lighting device; an information processing device; Equipped with The lighting device includes: an imaging unit that images the worker; a lighting unit that illuminates the worker; and The information processing device includes: a detection unit that detects the position of a specific part of the worker's body from the captured image taken by the imaging unit; an identification unit that identifies the work performed by the worker based on the detected position of the specific part; a determination unit that determines whether the identified work deviates from a pre-registered work procedure; a work recording unit that records work information of the work determined to have deviated from the work procedure as an invalid work; and The work recording unit When a work deviating from a pre-registered work procedure is performed after the work is performed according to the work procedure, the work information is recorded regarding the deviating work as an invalid work. Lighting system.

Images