Information processing device, lighting device, and lighting system
The information processing device quickly detects and alerts workers or managers of deviations from pre-registered work processes by analyzing captured images, enhancing the recognition of work errors and improving the understanding of the worker's status.
Patent Information
- Application Number
- JP2021202779
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-12-14
- Publication Date
- 2025-08-05
- Estimated Expiration
- 2041-12-14
AI Technical Summary
Conventional systems struggle to quickly recognize work errors or deviations from pre-registered work processes, making it difficult for workers or managers to understand the working status promptly.
An information processing device equipped with a detection unit to identify the position of a worker's specific body parts from captured images, a determination unit to assess compliance with pre-registered work processes, and a notification unit to alert workers or managers of deviations or errors.
Enables rapid identification of work errors and deviations, allowing for immediate corrective actions and improving the overall understanding of the worker's working status.
Smart Images

Figure 0007718260000001 
Figure 0007718260000002 
Figure 0007718260000003
Abstract
Description
[Technical Field]
[0001] FIELD Embodiments of the present invention relate to an information processing device, a lighting device, and a lighting system. [Background technology]
[0002] A technology has been proposed in the past in which an image captured by an imaging unit is acquired by an information processing device, the position of a specific part of the worker is detected, and if the position of the specific part is located within the work area, it is determined that the worker is performing useful work, and the working time of the useful work is recorded, and the working time when the worker completes one unit of work is recorded. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-120577 Summary of the Invention [Problem to be solved by the invention]
[0004] However, with conventional technology, when a worker makes a work error, it is possible to record the work error, but it is difficult for the worker or manager to immediately recognize the occurrence of the work error. In other words, there is room for improvement in terms of quickly understanding the work status of the worker.
[0005] The problem to be solved by the present invention is to provide an information processing device, a lighting device, and a lighting system that can quickly grasp the working status of a worker. [Means for solving the problem]
[0006] An information processing device according to an embodiment includes a detection unit, a determination unit, and a notification unit. The detection unit detects the position of a specific body part of a worker from an image captured by an imaging unit. The determination unit determines whether the worker has performed a pre-registered work process based on the position of the specific body part detected by the detection unit. The notification unit issues a process alert when it is determined that the worker has not performed the pre-registered work process. [Brief explanation of the drawings]
[0007] [Figure 1] FIG. 1 is a perspective view showing an example of the appearance of a lighting device included in a lighting system according to an embodiment. [Figure 2] FIG. 2 is a diagram showing an overview of a lighting system according to an embodiment. [Figure 3] FIG. 3 is a block diagram showing the configuration of the information processing device according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of information processing according to the embodiment. [Figure 5] FIG. 5 is a diagram illustrating an example of information processing according to the embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of information processing according to the embodiment. [Figure 7] FIG. 7 is a flowchart showing the processing procedure of the processing executed in the information processing device according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0008] The information processing device 20 described below includes a detection unit 232, a determination unit 234, and a notification unit 235. The detection unit 232 detects the position of a specific body part of the worker 50 from an image captured by the imaging unit (camera 16). The determination unit 234 determines whether or not the worker 50 has performed a pre-registered work process based on the position of the specific body part detected by the detection unit 232. The notification unit 235 issues a process alert when it is determined that the worker 50 has not performed a pre-registered work process.
[0009] The judgment unit 234 described below judges that the worker 50 has not performed the pre-registered work process if some of the work steps that have been pre-registered are missing in one cycle of work steps that have been completed.
[0010] The notification unit 235, which will be described below, notifies the process alert to at least one of the worker 50, the manager who manages the work, and the worker 50 who performs the work downstream.
[0011] The determination unit 234, which will be described below, further determines whether the worker 50 performed the work in accordance with the work procedure in the pre-registered work process. If it is determined that the worker did not perform the work in accordance with the work procedure in the pre-registered work process, the notification unit 235 notifies a procedure alert that is different from the process alert.
[0012] The notification unit 235, which will be described below, notifies a process alert and a procedure alert if it is determined during the work that the work has not been performed in accordance with the work procedure, and notifies the cancellation of the process alert if it is determined at the end of the work that the pre-registered work procedure has been performed.
[0013] The information processing device 20 described below further includes an estimation unit 233 that estimates the work procedure of the worker 50 based on the work history of the worker 50. When the estimated work procedure deviates from the estimated work procedure, a determination unit 234 determines that the pre-registered work process has not been performed.
[0014] The lighting device 10 described below includes an imaging unit and a lighting unit 11. The imaging unit captures an image of the worker 50 and transmits the captured image to the information processing device 20. The lighting unit 11 illuminates the worker 50.
[0015] The lighting system 1 described below includes a lighting device 10 and an information processing device 20. The lighting device 10 has an imaging unit that captures an image of a worker 50 and a lighting unit that illuminates the worker 50. The information processing device 20 has a detection unit 232 that detects the position of a specific body part of the worker 50 from an image captured by the imaging unit, a determination unit 234 that determines whether the worker 50 has performed a pre-registered work process based on the position of the specific body part detected by the detection unit 232, and a notification unit 235 that notifies a process alert when it is determined that the worker 50 has not performed the pre-registered work process.
[0016] Hereinafter, an information processing device, a lighting device, and a lighting system according to an embodiment will be described with reference to the drawings. The same components in the embodiments are denoted by the same reference numerals, and duplicated descriptions will be omitted.
[0017] [Lighting equipment] First, the configuration of a lighting device 10 according to an embodiment will be described with reference to Fig. 1. Fig. 1 is a perspective view showing an example of the appearance of the lighting device 10 included in a lighting system 1 according to an embodiment.
[0018] 1, lighting device 10 includes lighting unit 11, imaging unit 12, and main body 13. Lighting device 10 is a ceiling-mounted lighting device in which main body 13 is installed on a ceiling surface or the like, and light output from lighting unit 11 is irradiated onto a floor surface. Lighting device 10 is primarily used indoors, for example, for monitoring production lines in a factory or the status of employees in an office.
[0019] For ease of understanding, Fig. 1 illustrates a three-dimensional Cartesian coordinate system including a Z axis, with the positive direction being vertically downward and the negative direction being vertically upward. The X axis is illustrated as extending along the length direction of the lighting device 10, and the Y axis is illustrated as extending along the width direction of the lighting device 10.
[0020] The lighting unit 11 is an illumination bar having a plurality of light-emitting elements (not shown) arranged at predetermined intervals on a long chassis or substrate (not shown) arranged along the Y-axis direction, and a diffusion cover 14 is provided on the floor side, i.e., on the positive Z-axis side, so that the light-emitting elements are housed between the chassis and the light-emitting elements.
[0021] The diffusion cover 14 is made of a light-transmitting material such as acrylic or polycarbonate. The diffusion cover 14 is frosted to diffuse the light emitted from the multiple light-emitting elements. Note that the diffusion cover 14 may contain a suitable diffusing material or colorant.
[0022] The imaging unit 12 has a light-shielding cover 15 and a camera 16. The camera 16 is an example of an imaging section. The imaging units 12 are arranged side by side adjacent to the illumination section 11 on the negative side of the X axis.
[0023] The main body 13 holds the lighting section 11 and the imaging unit 12. The main body 13 also serves as a mounting member for mounting the lighting device 10 to a predetermined position such as a ceiling.
[0024] The light-shielding cover 15 is disposed on the positive side of the Z axis of the main body 13 so as to cover the camera 16 between the main body 13 and the light-shielding cover 15. The light-shielding cover 15 also has a through-hole provided in a position facing the lens of the camera 16. By disposing such a light-shielding cover 15, it is possible to make it difficult for light emitted from the diffusion cover 14 of the illumination unit 11 to enter the lens of the camera 16.
[0025] [Lighting System] Next, the configuration of a lighting system 1 according to an embodiment will be described with reference to Fig. 2. Fig. 2 is a diagram showing an overview of the lighting system 1 according to an embodiment. Note that the following description will be given taking as an example a case where the lighting system 1 is installed in a factory.
[0026] 2, the lighting system 1 according to the embodiment includes a plurality of lighting devices 10, an information processing device 20, and an administrator terminal 30. The example shown in FIG. 2 illustrates a case where each lighting device 10 is installed at a work site (for example, a production line) in a factory.
[0027] The lighting devices 10 are provided, for example, above the work spaces 40 (see FIG. 4) of the workers 50 on the production line, and the cameras 16 capture images of the work spaces 40 from above.
[0028] The information processing device 20 is a device that manages each lighting device 10 installed at a work site. For example, the information processing device 20 remotely controls the lighting mode of the lighting unit 11 of each lighting device 10, the imaging process of the camera 16, etc. via the network N.
[0029] The information processing device 20 also collects and stores captured images captured by the camera 16 of each lighting device 10. For example, the captured images collected by the information processing device 20 are used for monitoring a work site. In the present disclosure, the information processing device 20 may acquire captured images as still images or as moving images.
[0030] The manager terminal 30 is a terminal device operated by a manager in a factory. Managers include, for example, a manager who manages the entire factory (such as the factory manager), a manager who manages each production line, and a manager who manages each worker. The manager terminal 30 may be a portable terminal device such as a mobile phone or a smartphone, or may be a fixed terminal device such as a desktop PC (Personal Computer) or a notebook PC.
[0031] The manager's terminal 30, for example, acquires images captured by the camera 16 so that the manager can monitor the work site, and acquires notifications regarding work errors from the information processing device 20.
[0032] [Information processing device] Next, the configuration of the information processing device 20 according to the embodiment will be described with reference to Fig. 3. Fig. 3 is a block diagram showing the configuration of the information processing device 20 according to the embodiment. As shown in Fig. 3, the information processing device 20 includes a communication unit 21, a storage unit 22, and a control unit 23. The information processing device 20 is, for example, a cloud server.
[0033] The communication unit 21 is realized by, for example, a network interface card (NIC), etc. The communication unit 21 transmits and receives information to and from the plurality of lighting devices 10 and the administrator terminal 30 via the network N, for example.
[0034] The storage unit 22 functions as a storage unit in the cloud server and is realized by, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a storage device such as a hard disk or an optical disk.
[0035] 3, the storage unit 22 includes a captured image storage unit 221, a work time storage unit 222, a work process storage unit 223, a work information storage unit 224, and an alert storage unit 225. The captured image storage unit 221 stores captured images captured by each lighting device 10.
[0036] The work time memory unit 222 stores the time during which the worker 50 (see Figure 4) performed valid work (hereinafter also referred to as valid work time) and the time during which the worker 50 performed invalid work (hereinafter also referred to as invalid work time) in one unit work or one work process described below.
[0037] In the present disclosure, useful work refers to work that adds value to an object of work, such as work to attach parts to an object.
[0038] In addition, in this disclosure, an invalid operation is an operation that does not add value to the object of the operation, such as the operation of picking up parts or tools for work. Furthermore, in this disclosure, a single unit operation is, for example, an operation performed on a single object.
[0039] The work process memory unit 223 stores pre-registered work processes that each worker 50 should perform on the production line. In the present disclosure, a work process refers to a unit task that the worker 50 should perform in the work space 40. Specifically, a work process includes the type of unit task to be performed and the order in which the unit tasks are performed (work sequence). Note that the work sequence does not necessarily have to be included in the work process.
[0040] The work information storage unit 224 stores the work performed by each worker 50. For example, the work information storage unit 224 stores the type of unit work performed by the worker 50 and the start time and end time of each unit work (or only one of the times may be stored). In other words, the work information storage unit 224 stores the history of work performed by each worker 50.
[0041] The alert storage unit 225 stores alerts notified by the notification unit 235, which will be described later. Specifically, the alert storage unit 225 stores the notification time of a process alert or procedure alert notified by the notification unit 235, and the cause of the alert. The cause here refers to which unit task in the work process an error occurred in, which unit task the work procedure was incorrect in, etc.
[0042] The control unit 23 functions as a control unit in the cloud server. The control unit 23 is a controller, and is realized, for example, by a CPU (Central Processing Unit) or an MPU (Micro Processing Unit) executing various programs stored in a storage device inside the information processing device 20 using RAM as a work area. The control unit 23 is also, for example, a controller, and is realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).
[0043] 3, control unit 23 includes an acquisition unit 231, a detection unit 232, an estimation unit 233, a determination unit 234, and a notification unit 235, and realizes or executes the functions and actions of the control processing described below. Note that the internal configuration of control unit 23 is not limited to the configuration shown in FIG. 3, and may be any other configuration as long as it performs the control processing described below.
[0044] The acquisition unit 231 acquires captured images captured by the camera 16 of the lighting device 10. For example, the acquisition unit 231 acquires captured images from the camera 16 of each lighting device 10 in real time, and stores the acquired captured images in the captured image storage unit 221 for each work space 40 (or for each worker 50).
[0045] The detection unit 232 performs various detections. For example, the detection unit 232 detects the positions of both hands 51 (see FIG. 4) of the worker 50 from the captured images acquired by the acquisition unit 231 and stored in the captured image storage unit 221. Both hands 51 of the worker 50 are an example of a specific body part of the worker 50. Note that the detection unit 232 may detect only one hand as the specific body part of the worker 50, or may detect parts other than the hands, such as the head or feet.
[0046] Furthermore, the detection unit 232 detects the position of an object (target object) to be worked on within the work space 40 from the captured image acquired by the acquisition unit 231.
[0047] The estimation unit 233 estimates the work procedure of the worker 50 in a work process based on the work history of the worker 50. That is, the estimation unit 233 estimates the tendency of the worker 50 to perform work in a similar work procedure in each work process by utilizing the characteristic that the worker 50 tends to perform work in a similar work procedure in each work process. Details of the work procedure estimation process by the estimation unit 233 will be described later using FIG. 6.
[0048] The determination unit 234 determines whether the worker 50 is performing valid work or invalid work based on the positions of both hands 51 of the worker 50 and the position of the object detected by the detection unit 232. Specifically, the determination unit 234 determines whether the work is valid or invalid based on the state in which the object is being held by both hands 51 of the worker 50 and whether both hands 51 are present within the work area.
[0049] Furthermore, the determination unit 234 determines whether or not the worker 50 has performed a pre-registered work process based on the positions of both hands 51 of the worker 50 detected by the detection unit 232. Details of this determination process will be described later with reference to FIG. 4 and subsequent figures.
[0050] The determination unit 234 also measures the time during which the worker 50 performed valid work (valid work time) and the time during which the worker 50 performed invalid work (invalid work time) in one unit task. The determination unit 234 also stores the valid work time and invalid work time in one unit task performed by the worker 50 in the task time memory unit 222 of the memory unit 22.
[0051] The determination unit 234 also determines whether the worker 50 performed the work in accordance with the work procedure in the work process that has been registered in advance. Details of this determination process will be described later with reference to FIG.
[0052] The notification unit 235 issues a process alert when the determination unit 234 determines that the worker 50 is not performing a pre-registered work process. The process alert is notified to, for example, the worker 50 himself, a manager, or at least one of workers 50 working downstream of the worker 50. The process alert may be, for example, a visual alert for the worker 50 or the manager, or an alert using sound or vibration from a terminal device (not shown). The visual alert may be, for example, a method of lighting a lighting member (not shown), a method of displaying on a display unit (not shown), or a method of illuminating the lighting unit 11 of the lighting device 10 in a lighting mode different from normal, etc.
[0053] Furthermore, when the determination unit 234 determines that the worker 50 is not performing the work in accordance with the work procedure in the pre-registered work process, the notification unit 235 notifies a procedure alert that is different from the process alert. The procedure alert is notified, for example, to at least one of the worker 50 himself / herself, the manager, or a worker 50 working downstream of the worker 50. Note that the notification destination of the procedure alert may be the same as or different from the notification destination of the process alert.
[0054] Furthermore, procedure alerts are notified in a different manner from process alerts. In other words, procedure alerts are notified so that the worker 50, manager, etc. can distinguish them from process alerts. Procedure alerts can be notified, for example, using a lighting component or display unit that is separate from the process alert. Furthermore, procedure alerts may be notified in a different manner using the same component as the process alert. Specifically, procedure alerts use different visual modes (lighting modes, display modes, illumination modes), sound modes, and vibration modes than process alerts.
[0055] Furthermore, the notification unit 235 cancels the process alert when all unit tasks in the work process are completed, even if the work procedure is different. This point will be described in detail later with reference to FIG.
[0056] Next, details of the information processing performed by the information processing device 20 will be described with reference to Fig. 4 to Fig. 6. Fig. 4 to Fig. 6 are diagrams showing an example of the information processing according to the embodiment. Fig. 4 shows an image captured by the camera 16 of the lighting device 10 placed above the work space 40.
[0057] 4 shows a work process in which worker 50 works in work areas A1 to A4 on workbench 41 and places the target object, which is a finished product, in finished product area A5. Each of work areas A1 to A4 includes an area where worker 50 works on the target object and an area where each part is placed. Alternatively, each of work areas A1 to A4 may include only an area where each part is placed. In such a case, worker 50 picks up parts from each of work areas A1 to A4 and works on the target object in an area other than areas A1 to A5 on workbench 41.
[0058] Although FIG. 4 shows an example in which one unit task is performed in each of the work areas A1 to A4, a plurality of unit tasks may be performed in each of the work areas A1 to A4.
[0059] The detection unit 232 detects, for example, the hands 51a, 51b of the worker 50 and detects which of the work areas A1 to A4 the hands 51a, 51b are located in. When the hands 51a, 51b of the worker 50 are located in any of the work areas A1 to A4, the determination unit 234 determines that the worker 50 has performed a unit task in that work area A1 to A4.
[0060] The determination unit 234 then determines whether the worker 50 has performed the pre-registered work process. If it is determined that the worker 50 has not performed the pre-registered work process, the notification unit 235 issues a process alert, and if it is determined that the worker 50 has performed the pre-registered work process, the notification unit 235 does not issue a process alert.
[0061] This point will be explained using Fig. 5. Fig. 5 shows the work process in the Nth cycle and the work process in the N+1th cycle. Specifically, as shown in Fig. 5, the determination unit 234 does not issue a process alert when an object is placed in the finished product area A5 after completing a unit work in each of the work areas A1 to A4, but issues a process alert when an object is placed in the finished product area A5 without completing a unit work in any of the work areas A1 to A4.
[0062] More specifically, as shown in the left diagram of FIG. 5, when the determination unit 234 judges all areas (work areas A1 to A4 and finished product area A5) to be "OK," the notification unit 235 does not issue a process alert.
[0063] On the other hand, as shown in the right diagram of Figure 5, if the work area A4 is not "OK" but the finished product area A5 is "OK", the judgment unit 234 causes the notification unit 235 to notify a process alert.
[0064] At this time, the notification unit 235 stores in the alert storage unit 225 information linking the time when the process alert was notified and the cause thereof (work area A4 in the case of FIG. 5).
[0065] That is, as shown in FIG. 5, when some work (unit work) among the pre-registered work processes is missing in one cycle of work processes in which work has been completed, the judgment unit 234 judges that the worker 50 has not performed the pre-registered work process.
[0066] This allows an object produced in a work process where a unit operation is missing to be detected as a defective product at an early stage, and also allows the missing part of the unit operation to be detected at an early stage.
[0067] In Fig. 5, when all unit tasks are completed regardless of the work procedure, a process alert is not sent. On the other hand, when the work procedure of the worker 50 is not performed according to the procedure, a procedure alert is sent. This point will be explained using Fig. 6.
[0068] In FIG. 6, it is assumed that the work procedure is set so that work proceeds in the order of work area A1, work area A2, work area A3, work area A4, and finished product area A5.
[0069] The determination unit 234 determines whether the worker 50 performed the work (unit work) in accordance with the work procedure in the work process registered in advance. The notification unit 235 notifies a procedure alert when it is determined that the worker has not performed the work in accordance with the work procedure in the work process registered in advance.
[0070] 6, when the work area A1, work area A2, work area A3, work area A4, and finished product area A5 are evaluated as "OK" in this order, the determination unit 234 determines that the worker is performing the work in accordance with the work procedure in the pre-registered work process. In this case, the notification unit 235 does not issue a process alert or a procedure alert.
[0071] 6, when the worker 50 performs a unit task in the work area A4 after the work areas A1 and A2, the determination unit 234 issues a procedure alert when the worker 50 performs the unit task in the work area A4 (or while the worker 50 is performing the unit task). At this time, since there is a possibility that the worker 50 will place the target object in the finished product area A5 while skipping the work area A3, the determination unit 234 also issues a process alert.
[0072] In this way, by notifying the procedure alert, it is possible to quickly grasp that the worker 50 has made a mistake in the work procedure.
[0073] Then, as shown in the right diagram of Figure 6, after performing the unit work in work area A4, if worker 50 performs work area A3 and then places the object in finished product area A5, the process alert that has already been notified will be canceled.
[0074] In other words, if the notification unit 235 determines that the work is not being performed in accordance with the work procedure during the work, it will notify a process alert and a procedure alert, and if it determines that the pre-registered work process has been carried out at the end of the work (at the end of one cycle of work process), it will notify that the process alert has been canceled.
[0075] This allows the worker 50 or manager to quickly understand that although the work procedures are different, all work processes have been carried out and no faulty products have been produced. Furthermore, by notifying the worker 50 of a procedure alert and a process alert during the work, the worker 50 can be guided to ultimately complete all unit work even if the worker makes a mistake in the work procedures.
[0076] The determination unit 234 is not limited to determining whether or not a deviation from a pre-registered work procedure has occurred, and may determine whether or not a deviation from a work procedure estimated by the estimation unit 233 has occurred.
[0077] Specifically, the estimation unit 233 estimates the work procedure that the worker 50 is actually performing from the work status of the worker 50 in the work process in a cycle prior to the work process in the (N+1)th cycle. If the work order in the (N+1)th cycle deviates from the work procedure estimated by the estimation unit 233, the determination unit 234 causes the notification unit 235 to notify a procedure alert.
[0078] This eliminates the need to register work procedures in advance, and allows a procedure alert to be sent if the worker 50 deviates from a work procedure that is easy for the worker to perform the work.
[0079] Next, a processing procedure of processing executed by the information processing device 20 according to the embodiment will be described with reference to Fig. 7. Fig. 7 is a flowchart showing the processing procedure of processing executed by the information processing device 20 according to the embodiment.
[0080] 7, first, the information processing device 20 starts the task analysis (step S101). The start of the task analysis may be triggered by an instruction from a manager or the like, or may be triggered by the start of production on the production line.
[0081] Next, the information processing device 20 reads the work process information stored in the work process storage unit 223 (step S102). Next, the information processing device 20 starts acquiring captured images from the lighting device 10 (step S103).
[0082] Next, the information processing device 20 starts measuring the work time (step S104). Next, the information processing device 20 determines whether or not the hands of the worker 50 have been detected (step S105).
[0083] If the information processing device 20 detects the hand of the worker 50 (step S105: Yes), it determines whether the hand is present in the work area (step S106). Subsequently, if the hand is present in the work area (step S106: Yes), the information processing device 20 reads the position of the previous unit work (step S107).
[0084] Next, the information processing device 20 determines whether the current unit task is in accordance with the task procedure based on the position of the previous unit task (step S108). If the current unit task is in accordance with the task procedure (step S108: Yes), the information processing device 20 determines whether the current unit task has been completed (step S109).
[0085] If the current unit work is completed (step S109: Yes), the information processing device 20 stores it as work information (step S110) and returns to step S105.
[0086] On the other hand, in step S108, if the current unit task does not conform to the task procedure (step S108: No), the information processing device 20 issues a procedure alert (step S111). Subsequently, the information processing device 20 issues a process alert (step S112).
[0087] Next, the information processing device 20 determines whether the previous unit task has been completed by the previous time (step S113). If the previous unit task has been completed by the previous time (step S113: Yes), the information processing device 20 notifies the cancellation of the process alert (step S114) and returns to step S105.
[0088] On the other hand, in step S113, if the previous unit work has not been completed by the previous time (step S113: No), the information processing device 20 returns to step S105, that is, does not cancel the process alert.
[0089] Furthermore, in step S105, if the information processing device 20 does not detect the hands of the worker 50 (step S105: No), it determines whether or not to end the work analysis (step S115). Note that the end of the work analysis may be triggered, for example, by an instruction from a manager or by the end of production on the production line.
[0090] When the task analysis is to be ended (step S115: Yes), the information processing device 20 ends the measurement of task time (step S116), ends the task analysis (step S117), and ends the process.
[0091] Furthermore, in step S115, if the information processing device 20 does not want to end the task analysis (step S115: No), the process returns to step S105.
[0092] Furthermore, in step S106, if the hand is not within the work area (step S106: No), the information processing device 20 returns to step S105.
[0093] Furthermore, in step S109, if the current unit work has not been completed (step S109: No), the information processing device 20 returns to step S105.
[0094] As described above, the information processing device 20 according to the embodiment includes the detection unit 232, the determination unit 234, and the notification unit 235. The detection unit 232 detects the position of a specific body part of the worker 50 from an image captured by the imaging unit (camera 16). The determination unit 234 determines whether the worker 50 has performed a pre-registered work process based on the position of the specific body part detected by the detection unit 232. The notification unit 235 issues a process alert when it is determined that the worker 50 has not performed a pre-registered work process. This makes it possible to quickly grasp the work status of the worker.
[0095] Although an embodiment of the present invention has been described, this embodiment is presented as an example and is not intended to limit the scope of the invention. This embodiment can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. This embodiment and its modifications are included within the scope and spirit of the invention, as well as the invention described in the claims and their equivalents. [Explanation of symbols]
[0096] 1. Lighting system 10. Lighting equipment 11 Lighting Department 12 Imaging unit 13 Main body 14 Diffusion Cover 15 Light-shielding cover 16 Camera 20 Information processing equipment 21 Communications Department 22 Memory section 23 Control Unit 30 Administrator terminal 40 workspace 41 Workbench 50 workers 221 Captured image storage unit 222 Working time memory section 223 Work process memory section 224 Work information memory unit 225 Alert Memory 231 Acquisition Department 232 Detection unit 233 Estimation Department 234 Judgment section 235 Notification Department N Network
Claims
1. a detection unit that detects the position of a specific part of the worker's body from the captured image taken by the imaging unit; a determination unit that determines whether the worker has performed a pre-registered work process based on the position of the specific part detected by the detection unit; a notification unit that issues a process alert when it is determined that the worker has not performed a pre-registered work process; Equipped with The determination unit Further, it is determined whether the worker has performed the work in accordance with the work procedure in the pre-registered work process; The notification unit If it is determined that the worker is not performing the work in accordance with the work procedure in the pre-registered work process, a procedure alert different from the process alert is notified; If it is determined during the work that the work is not being performed in accordance with the work procedure, the process alert and the procedure alert are notified; When it is determined that the pre-registered work process has been completed at the end of the work, the process alert is canceled. Information processing device.
2. The determination unit When a part of the pre-registered work steps is missing in the work steps of one cycle in which the work is completed, it is determined that the worker has not performed the pre-registered work steps. The information processing device according to claim 1 .
3. The notification unit The process alert is notified to at least one of the worker, a manager who manages the work, and a worker who performs the work downstream.
3. The information processing device according to claim 1.
4. an estimation unit that estimates a work procedure of the worker based on a work history of the worker; The determination unit When the estimated work procedure is deviated from, it is determined that the pre-registered work process has not been performed.
4. The information processing device according to claim 1.
5. a lighting device; an information processing device; Equipped with The lighting device includes: an imaging unit that images the worker; a lighting unit that illuminates the worker; and The information processing device includes: a detection unit that detects the position of a specific part of the worker's body from the image captured by the imaging unit; a determination unit that determines whether the worker has performed a pre-registered work process based on the position of the specific part detected by the detection unit; a notification unit that issues a process alert when it is determined that the worker has not performed a pre-registered work process; and The determination unit Further, it is determined whether the worker has performed the work in accordance with the work procedure in the pre-registered work process; The notification unit If it is determined that the worker is not performing the work in accordance with the work procedure in the pre-registered work process, a procedure alert different from the process alert is notified; If it is determined during the work that the work is not being performed in accordance with the work procedure, the process alert and the procedure alert are notified; When it is determined that the pre-registered work process has been completed at the end of the work, the process alert is canceled. Lighting system.
Citation Information
Patent Citations
Work support device, and work support program
JP2018156279A
Position estimation device, position estimation method and computer program for position estimation
JP2019120577A
Work support device and work support program
JP2020149101A
Model generator, model generation method, and model generation program
JP2021135541A