Safety assurance assistance system and safety assurance assistance method

Abstract

The present application provides a safety assurance assistance system and a safety assurance assistance method that can prevent false determination of use of a safety belt hook even in a dark environment. A safety assurance assistance system characterized by having a management device that detects a hook of a safety belt worn by an operator from images sequentially sent from a camera worn by the operator, and instructs output of an alarm to an output terminal device carried by the operator in a case where the hook is not detected, the hook having a retroreflective material with a specific color phase provided on a surface, the management device detecting an entering action of the operator into a work site using the hook based on the images sequentially sent from the camera, and implementing detection of the hook based on color information of each image after the entering action is detected.

Description

Technical Field

[0001] This invention relates to a safety assurance assistance system and a safety assurance assistance method. Background Technology

[0002] Regarding the technology related to the confirmation of the use of safety belt hooks in high-altitude operations, there exists the technology disclosed in Patent Document 1. Patent Document 1 describes a "management system comprising: an image acquisition unit that acquires a field image obtained by photographing the work site of an operator equipped with a safety belt; an image processing unit that generates a color image of the color of the safety belt hook and a color image of the color of the handrail or sling attached to the field, based on the field image; and a determination unit that determines the usage status of the hook based on the color image of the hook and the color image of the handrail or sling."

[0003] Existing technical documents

[0004] Patent documents

[0005] Patent Document 1: Japanese Patent Application Publication No. 2021-129953 Summary of the Invention

[0006] The problem that the invention aims to solve

[0007] In high-altitude operations, such as maintenance work on an elevator car, there are high-altitude operations carried out in dark environments using lighting. In this case, in the structure of Patent Document 1 mentioned above, due to the influence of lighting, it is impossible to identify the hooks and locking parts (handrails or slings) as if the color information were assumed, which can easily lead to misjudgments due to detection omissions.

[0008] Therefore, the purpose of this invention is to provide a safety assurance assistance system and method that can prevent misjudgment of the use of seat belt hooks even in dark environments.

[0009] Methods for solving problems

[0010] To solve the aforementioned problem, for example, the structure described in the patented technical solution may be adopted.

[0011] This application includes several means to solve the above-mentioned problems. One example is the following safety assurance assistance system: detecting the hook of the safety belt worn by the worker in images sequentially transmitted from a camera worn by the worker; if the hook is not detected, indicating an alarm output to an output terminal device carried by the worker; the hook has a retroreflective material with a specific hue on its surface; the management device detects the worker's entry action into the work site using the hook based on the images sequentially transmitted from the camera; and the detection of the hook is performed based on the color information of each image after the entry action is detected.

[0012] Invention Effects

[0013] According to the present invention, a safety assurance assistance system and a safety assurance assistance method can be provided, which can improve the detection accuracy of seat belt hooks even in dark environments, thereby preventing misjudgment of hook usage. Attached Figure Description

[0014] Figure 1 This is a diagram of the equipment structure of the safety assurance auxiliary system for the implementation method.

[0015] Figure 2 This is a diagram illustrating an installation example of a safety assurance auxiliary system for implementing an embodiment.

[0016] Figure 3 This is a diagram used to illustrate the elevator car that serves as the work site.

[0017] Figure 4 This is an example of a warning display set up at the work site.

[0018] Figure 5 This is a functional structure diagram of the management device.

[0019] Figure 6 This is a flowchart illustrating the safety assurance assistance method involved in the implementation method.

[0020] Figure 7 This is a diagram illustrating an example of the actions of workers at a work site.

[0021] Figure 8 It is a diagram that shows the changes in hue of an image taken based on the illumination light.

[0022] Explanation of reference numerals in the attached figures

[0023] 1…Safety Assurance Assist System

[0024] 11…camera

[0025] 12… Output terminal device

[0026] 13… Management Device

[0027] 31…Seat belt

[0028] 31c… hook

[0029] 41b…On the car (work site)

[0030] 133…Time Counting Department

[0031] 135… Hook Inspection Department

[0032] 134…Feature Marker Detection Department

[0033] 136…Color Information Correction Department

[0034] 137… Hook Re-inspection Department

[0035] 138…Alarm Output Indicator

[0036] 402… Warning displayed (characteristic marker)

[0037] 402a…substrate

[0038] [W]...the operator. Detailed Implementation

[0039] Hereinafter, embodiments related to the safety assurance assistance system and method of the present invention will be described in detail based on the accompanying drawings. The safety assurance assistance system and method described herein are systems and methods for assisting workers in ensuring safety during high-altitude operations in dark environments. In the following embodiments, operations on an elevator car are used as an example of high-altitude operations in dark environments, but the description is not limited to this.

[0040] Safety Assurance Assistance System

[0041] Figure 1 This is a diagram of the equipment structure of the safety assurance auxiliary system 1 involved in the implementation method. Figure 2 This is a diagram illustrating an installation example of the safety assurance assistance system 1 according to the embodiment. First, before describing the equipment structure of the safety assurance assistance system 1, the equipment and working environment of the operator [W] participating in high-altitude operations in a dark environment will be described.

[0042] <Equipment of the Operator [W]>

[0043] like Figure 2 As shown, workers [W] engaged in high-altitude operations are obligated to wear a harness 31 and a helmet 32. Additionally, especially if the working environment is dark, the worker [W] must keep the light 33 mounted on the helmet 32.

[0044] Here, the safety harness 31 is a fall protection device, comprising a harness mechanism 31a, a rope 31b, and a hook 31c. The harness mechanism 31a is a structure in which shoulder straps, chest straps, torso straps, leg straps, and pelvic straps are integrated. The rope 31b has a cushioning mechanism, and its base end is connected to the back side of the shoulder strap of the harness mechanism 31a. Figure 2 As shown in the enlarged view, hook 31c is a locking device that is attached to the front end of rope 31b. This hook 31c is used to lock onto a locking part located at the work site, and in other cases, it is used to lock onto the chest strap of the belt mechanism 31a.

[0045] In particular, the surface of the hook 31c is covered with a retroreflective material. Typically, hooks 31c are mostly made of semi-gloss steel, which is easily affected by ambient light, and therefore the viewing experience can vary considerably depending on the type of light source and the angle of incidence. Therefore, the hook 31c used in this safety assurance auxiliary system 1 uses a hook with a surface covered by a retroreflective material. A retroreflective material is a material that reflects light from a light source back towards the light source, allowing light from the lamp 33 to be reflected back towards the lamp 33 even in dark environments. For example... Figure 2 As shown in the enlarged view, such a hook 31c can also be a hook with a strip of retroreflective material wound around it relative to the original hook 31c, preferably with as much of the surface area as possible covered by the retroreflective material.

[0046] Furthermore, the color of the retroreflective material on the surface of hook 31c is a specific hue not found at the work site, thereby preventing false detection of hook 31c. Therefore, in the case where the work site is an elevator car, the hue of the retroreflective material should be a hue not found on the car. Examples of suitable hues for such retroreflective materials include red, blue, and green hues. In particular, red may react with a person's face or incandescent light, and blue may react with the maintenance sheet (blue sheet), so green hues are preferred.

[0047] <Work Environment>

[0048] Figure 3 This is a diagram used to illustrate an elevator car used as a high-altitude work site. For example... Figure 3 As shown, the elevator car 41, which serves as the work site, is suspended by a main hoist 43 within a vertically extending hoisting channel 42 along the building. The passenger car 41 is equipped with a car door 41a for entering the car. The operator [W] (see reference) Figure 2The landing door (not shown) located in the elevator shaft 42 is opened, and the passenger enters the elevator shaft 42 through the landing door and boards the car 41b of the car 41, which becomes the work site. The elevator shaft 42 is a dark environment with no or very little lighting.

[0049] In addition, a locking part 401 for securing the hook 31c of the safety belt 31 is provided on the car 41b, which serves as the work site. The locking part 401 includes, for example, a handrail 401a erected on the car 41b, a lifting eye bolt 401b fixed to the floor of the car 41b, and a U-shaped hook (not shown in the figure). Furthermore, in addition to the guardrail (not shown in the figure) for preventing falls provided around the perimeter of the car 41b, various equipment is fixed to the floor.

[0050] Furthermore, a warning display 402 is provided on the car 41b to draw the attention of the operator [W]. The warning display 402 is used to make the operator [W] riding on the car 41b aware of the precautions on the car 41b, which is located at a high position. Such a warning display 402 is set on the side of the floor of the car 41b where the operator [W] must enter the car 41b, such as on the side where the operator [W] enters, i.e., on the side of the car door 41a of the landing door (not shown) of the elevator shaft 42, in a manner that requires the operator [W] to be within the operator's [W]'s field of vision when entering the car 41b. Figure 4 This diagram illustrates an example of a warning display 402 installed at the work site. (See diagram for example.) Figure 4 As shown, the warning display 402 is a display of warning text 402b or warning mark 402c on a white or yellow hue background 402a to improve visual visibility in dark areas.

[0051] Such a warning 402 is in a conspicuous location when the operator [W] intends to enter the car 41b and is facing the direction of the car 41b, and is therefore used as a "feature mark" for color information correction as described in the subsequent safety assurance aids method.

[0052] <System Structure>

[0053] Next, based on Figure 1 and Figure 2 The equipment structure of the safety assurance auxiliary system 1 for workers [W] engaged in high-altitude operations in dark environments is described. Figure 1 as well as Figure 2 The safety assurance assistance system 1 shown includes a camera 11, an output terminal device 12, and a management device 13. They are connected via a network 2 and are configured as follows.

[0054] [Camera 11]

[0055] Camera 11 is used to continuously capture images of the work site as dynamic images, and is installed on each worker [W] for use. In addition, camera 11 has a communication function, configured to sequentially and continuously transmit the captured images along with the identification information of each camera 11 to management device 13 via network 2.

[0056] The mounting position of camera 11 relative to the worker [W] is not particularly limited, but it should be mounted in a direction that allows it to capture the worker's [W] line of sight. From this perspective, camera 11 is preferably mounted on the front side of the chest strap in the belt mechanism 31a or the helmet 32, preferably near the light 33. Therefore, it is preferable to provide a mounting part for mounting camera 11 in the belt mechanism 31a or the helmet 32. Furthermore, the light 33 mounted on the helmet 32 ​​can also be integrated with camera 11.

[0057] [Output terminal device 12]

[0058] Output terminal device 12 is a device for outputting alarms to operators [W]. It has identification information and is associated with camera 11. It is installed for use by each operator [W]. In addition, output terminal device 12 has communication functions that enable communication with identification information. It is configured to output alarms based on instructions sent from management device 13 via network 2.

[0059] The installation position of the output terminal device 12 relative to the operator [W] is not particularly limited, but the operator [W] installs a camera 11 and the output terminal device 12 corresponding to the identification information. Alternatively, the output terminal device 12 may also have some of the functions of the management device 13 described below, and a camera function to capture images of the work site and send them to the output terminal device 12. When the output terminal device 12 has a camera function and also functions as a camera 11, it is preferably installed in a direction that allows it to capture the operator's [W] line of sight, for example, preferably mounted on a chest strap in the belt mechanism 31a. In this case, the belt mechanism 31a preferably has a mounting section for mounting the output terminal device 12, which also functions as a camera 11.

[0060] [Management Device 13]

[0061] The management device 13 is a terminal device equipped with a computer for implementing safety assurance assistance methods, such as a management center configured for elevator maintenance and management. In addition to the computer, the management device 13 may also include a display unit and an operation unit, and may be a personal computer. The computer in the management device 13 includes non-volatile storage units such as a CPU (Central Processing Unit), RAM (Random Access Memory), and ROM (Read Only Memory), as well as a network interface. This management device 13 continuously and sequentially receives images captured by the camera 11 via the network 2. Furthermore, based on the received images, it determines whether an alarm needs to be output, and sends an alarm output instruction to the output terminal device 12 via the network 2.

[0062] Figure 5 This is a functional structure diagram of the management device 13. (For example...) Figure 5 As shown, the management device 13 includes an image holding unit 131, a darkening judgment unit 132, an elapsed time counting unit 133, a feature mark detection unit 134, a hook detection unit 135, a color information correction unit 136, a hook re-detection unit 137, and an alarm output indication unit 138 as functional units for implementing safety assurance assistance methods. Hereinafter, refer to... Figure 5 as well as Figures 1-4 Explain the functions of each department.

[0063] -Image Holding Unit 131-

[0064] The image holding unit 131 saves the images sequentially transmitted from the camera 11 as a continuous moving image. Each image is associated with the identification information of the camera 11 at the transmission destination. The image holding unit 131 saves the images from the saved images in which a hook is detected in the hook detection unit 135 or the hook re-detection unit 137, which will be described later, as hook detection images.

[0065] -Darkening Judgment Section 132-

[0066] Darkening determination unit 132 determines whether the overall brightness of the image transmitted from camera 11 exceeds a predetermined determination value and thus darkens, i.e., whether the image darkens. Details of the determination by darkening determination unit 132 will be explained in the subsequent safety assurance assistance method.

[0067] -Passing through time counter 133-

[0068] The time counting unit 133 counts the elapsed time since the darkening judgment unit 132 determined that the image has darkened.

[0069] -Feature marker detection unit 134-

[0070] The feature marker detection unit 134 analyzes the images sequentially transmitted from the camera 11 and detects the feature markers within each image. Here, the feature markers are used as a reference for the correction processing of the color information correction unit 136, which will be described later. Such feature markers are standardly set up at the work site, and are displays that inevitably come into view when the worker [W] enters the work site, and are highly visible in dark conditions. As an example of such feature markers, a warning display 40 (see reference 40) can be used. Figure 3 and Figure 4 ).

[0071] -Hook Inspection Department 135-

[0072] The hook detection unit 135 sequentially analyzes the images sent from the camera 11, detects the hooks 31c in each image, and determines whether a hook 31c has been detected. Details of the determination made by the hook detection unit 135 will be explained in the subsequent safety assurance assistance method.

[0073] -Color Information Correction Department 136-

[0074] If the hook detection unit 135 determines that the hook 31c has not been captured, the color information correction unit 136 corrects the color information that serves as the judgment criterion for the hook detection unit 135. Details of the color information correction performed by the color information correction unit 136 will be explained in the subsequent safety assurance assistance method.

[0075] -Hook Re-inspection Department 137-

[0076] The hook re-detection unit 137 performs hook re-detection on each image held in the image holding unit 131, based on the color information corrected by the color information correction unit 136. The hook re-detection unit 137 analyzes each image based on the corrected color information, thereby performing hook 31c re-detection within each image and determining whether hook 31c has been detected. Details of the determination made by the hook re-detection unit 137 will be explained in the subsequent safety assurance assistance method.

[0077] -Alarm Output Indicator 138-

[0078] If the hook 31c is not detected in any of the images detected by the hook re-detection unit 137, the alarm output indication unit 138 sends an alarm indication indicating that the hook is not used to the output terminal device 12 corresponding to the camera 11. The alarm output indication unit 138 maintains the correspondence between the identification information of the camera 11 and the identification information of the output terminal device 12.

[0079] Safety Assurance Auxiliary Methods

[0080] Next, the implementation method of the security assurance assistance method implemented by the aforementioned security assurance assistance system 1 will be described.

[0081] Figure 6 This is a flowchart illustrating a safety assurance assistance method involved in the implementation. The steps shown in the flowchart are performed according to the use of... Figure 1 The safety assurance assistance system 1, as described, includes a management device 13 that has a program to check the usage status of the safety belt hook, thereby assisting the worker [W] in ensuring safety during high-altitude operations in dark environments. Additionally, the worker [W] upon entering the work site... Figure 2 As shown, the worker is wearing a safety belt 31, helmet 32, light 33, camera 11, and output terminal device 12. At this time, the worker [W] engages the safety belt 31 by hooking the hook 31c onto the chest strap of the belt mechanism 31a. Then, the worker turns on the light 33, camera 11, and output terminal device 12, enters the elevator car (which serves as the work site), and begins work on the car using the hook 31c to ensure their safety.

[0082] The following is in accordance with Figure 6 The flowchart is shown above. Figures 1-5 This describes the steps of a safety assurance aid method for working at heights in a dark environment. Furthermore, the process begins when the management device 13 receives images transmitted from the camera 11 worn by the operator [W]. Figure 6 The flowchart shown.

[0083] <Step S101>

[0084] In step S101, the image holding unit 131 begins recording images sequentially transmitted from the camera 11. The image holding unit 131 saves the images sequentially transmitted from the camera 11 as a continuous moving image. Each image is associated with the identification information of the camera 11 at the transmission destination.

[0085] <Step S102>

[0086] In step S102, the darkening determination unit 132 determines whether the overall brightness of the image sent from the camera 11 exceeds a predetermined determination value and thus darkens, i.e., whether the image darkens. At this time, the darkening determination unit 132 uses the initial overall brightness of the image sent from the camera 11 as a reference value, and determines that the image darkens (yes) when the overall brightness of the image relative to the reference value exceeds a predetermined difference.

[0087] Here, the elevator car 41b, which serves as the work site, is a dark environment within the elevator shaft 42. Therefore, when the worker [W] wearing the light 33 enters the elevator car 41b from a floor with a certain level of brightness, the amount of light received by the image captured by the camera 11 is drastically reduced. Consequently, the difference in brightness between the images sequentially transmitted from the camera 11 exceeds a predetermined value, causing the images to darken. This allows it to be determined that the worker [W] equipped with the camera 11 has performed the action of entering the work site, i.e., the elevator car 41b.

[0088] In addition, the difference in brightness that is judged as darkening is preset, for example, through a preliminary experiment.

[0089] <Step S103>

[0090] In step S103, the elapsed time counting unit 133 starts counting the elapsed time from the moment when the image was determined to darken in step S102. This elapsed time is counted as the elapsed time from the moment the operator [W] begins to enter the car 41b, that is, the moment the entry action to the work site begins.

[0091] <Step S104>

[0092] In step S104, the feature marker detection unit 134 analyzes the image transmitted from the camera 11 and detects feature markers within the image captured by the camera 11. At this time, the feature marker detection unit 134 uses a warning display 402 (see reference 402). Figure 3 and Figure 4 The feature marker detection unit 134 identifies the warning text 402b or warning marker 402c of the pre-stored warning display 402 from the image and detects them as feature markers, and maintains the image containing the detected feature markers.

[0093] Furthermore, the warning display 402, used as a feature marker, is captured by camera 11 when the operator [W] intends to enter the car 41b and is facing the car 41b. Therefore, the feature marker detection is considered a scene of entering the car 41b. Thus, the elapsed time counting unit 133 can also start counting elapsed time based on the detection of the feature marker as the detection of the operator [W]'s entry action into the work area. In this case, even when the light from the operator [W]'s lamp 33 is sufficiently bright, the operator's entry action into the dark work area can be accurately detected. Additionally, the elapsed time counting unit 133 can also start counting elapsed time from the moment the image darkens and the feature marker is detected.

[0094] <Step S105>

[0095] In step S105, the hook detection unit 135 determines whether a hook 31c is detected in the image based on the color information within the image sent from the camera 11. At this time, the hook detection unit 135 uses, for example, the HSV color model as the color information. The HSV color model, also known as the HSB model (B for Brightness), is a method of representing processed colors numerically on a computer, using three elements: "hue," "saturation," and "value."

[0096] The hook detection unit 135 extracts pixels from the image that satisfy each judgment threshold based on preset judgment thresholds (upper and lower thresholds) for hue, saturation, and brightness. If the number of extracted pixels is greater than the preset number of pixels, the hook detection unit 135 determines that a hook 31c has been detected (yes). Furthermore, the judgment threshold is set to include the range of hue, saturation, and brightness, for example, when photographing a retroreflective material on the surface of the hook 31c under natural light. In addition, the number of pixels used as the judgment criterion for detecting the hook 31c is set based on the field of view and pixel count of the camera 11, and is based on the number of pixels of the hook 31c photographed by the camera 11 when the operator [W] uses the hook 31c.

[0097] Figure 7 This is a diagram illustrating an example of the actions of a worker [W] at a work site. For example... Figure 7 As shown, the worker [W] entering the elevator car 41b, which becomes the work site, removes the hook 31c from the belt mechanism 31a of the safety belt 31 and secures the hook 31c to the car 41b (see reference). Figure 3 The hook 31c is easily placed into the field of view of the camera 11 by removing it from the belt mechanism 31a of the safety belt 31. Furthermore, when the operator [W] engages the hook 31c in the locking part 401, the camera 11 is directed towards the handle where the hook 31c is engaged, thus the hook 31c enters the field of view of the camera 11. Therefore, by detecting the hook 31c in the image transmitted from the camera 11, it is considered that the operator [W] has performed the action of engaging the hook 31c in the locking part 401.

[0098] Therefore, if the hook detection unit 135 determines that hook 31c has been detected (yes) through the above steps, it determines that the operator [W] has performed the action of locking hook 31c to locking part 401, and proceeds to step S106. On the other hand, if the hook detection unit 135 determines that hook 31c has not been detected (no), it determines that the operator [W] has not performed the action of locking hook 31c to locking part 401, and proceeds to step S107.

[0099] <Step S106>

[0100] In step S106, the image holding unit 131 records the image in step S105 that indicates the hook 31c has been detected as a hook detection image and ends the processing.

[0101] <Step S107>

[0102] On the other hand, in step S107, the hook detection unit 135 determines whether the elapsed time counted by the elapsed time counting unit 133 has exceeded a preset predetermined time. This predetermined time sufficiently includes the range of time required from the time the operator [W] enters the car 41b, which serves as the work site, until the hook 31c is engaged with the engaging part 401 on the car 41b. From the viewpoint of preventing falls, the shortest possible time is preferred. For example, such a predetermined time is set to 2 minutes.

[0103] If the hook detection unit 135 determines that a predetermined time has elapsed (yes), it proceeds to the next step S108. On the other hand, if it determines that the predetermined time has not elapsed (no), it returns to step S105 and then repeatedly detects the hook 31c for each image sequentially sent from the camera 11.

[0104] <Step S108>

[0105] In step S108, the color information correction unit 136 performs a process to correct the color information that serves as the judgment criterion for hook detection by the hook detection unit 135. The color information to be corrected here is the judgment threshold (upper and lower limit thresholds) of each color information that serves as the judgment criterion for hook detection. That is, in a dark environment, the image captured by the camera 11 is affected by the light illuminating the lamp 33, so a correction is performed to eliminate this effect.

[0106] Figure 8 This is a diagram showing the hue change of an image captured based on the illumination light; it is also a diagram showing an image captured by a camera of a hook 31c with a retroreflective material on its surface. For example... Figure 8As shown, when the retroreflective material on the surface of hook 31c is illuminated by natural light 1001 and incandescent lamp 1002, the hue of hook 31c in the obtained image [P1] is a roughly natural hue, becoming the hue of the original retroreflective material. In contrast, especially when the retroreflective material on the surface of hook 31c is illuminated by LED 1003, sometimes the hue of hook 31c in the obtained image [P2] is a stronger blue reflection compared to the original retroreflective material. This is believed to be because, as a white LED, there are types that contain a blue LED internally. Due to manufacturing processes, the blue light and yellow phosphor are not properly balanced and mixed, resulting in blue light. Alternatively, the lens of the lamp may also cause a beam splitting effect. In short, when illuminated by a white LED, the hue of the object may change (especially turning blue). Therefore, in step S105, there is a possibility that hook 31c cannot be correctly detected due to the influence of the light illuminating from lamp 33.

[0107] Therefore, the color information correction unit 136 corrects the judgment thresholds (upper and lower thresholds) for each color information, such as hue, saturation, and brightness, which are preset for detecting the hook 31c, based on the image of the feature mark identified in step S104. Specifically, firstly, based on the reference value of the color information of the base in the feature mark, the change in the color information of the base in the feature mark identified in step S104 is calculated. Hue is used as color information, for example. The reference value is, for example, the hue of the base of the feature mark when the feature mark is photographed by the camera 11 under natural light. The color information correction unit 136 corrects the hue judgment thresholds (upper and lower thresholds) in hue, saturation, and brightness in accordance with the calculated change in hue. That is, when the hue of the base of the feature mark changes towards blue, a correction is performed to change the hue judgment thresholds (upper and lower thresholds) towards blue by an amount corresponding to the change.

[0108] <Step S109>

[0109] In step S109, the hook re-detection unit 137 analyzes each image held by the image holding unit 131 based on a judgment threshold of the color information corrected by the color information correction unit 136, and determines whether hook 31c has been detected. At this time, the hook re-detection unit 137 analyzes each image held by the image holding unit 131 related to each pixel during the period from the time count in the initial step S103 to the determination in step S107 that a predetermined time (yes) has elapsed. These images are those for which hook 31c detection was performed by the hook detection unit 135 in step S105. The order of image analysis is the same as the order of step S105.

[0110] If the hook re-detection unit 137 detects an image where the number of pixels satisfying the corrected judgment threshold is greater than the preset number of pixels, it determines that hook 31c has been detected (yes), that is, it determines that the operator [W] has used hook 31c and proceeds to step S106. Then, the image holding unit 131 records the image that the hook re-detection unit 137 determined to have detected hook 31c as a hook detection image and ends the processing.

[0111] On the other hand, if the parsed image fails to detect an image in which the number of pixels satisfying the corrected judgment threshold is greater than the number of pixels preset, it is determined that hook 31c was not detected (No), that is, it is determined that the operator [W] did not use hook 31c and proceeds to step S110.

[0112] <Step S110>

[0113] In step S110, the alarm output indicator 138 sends an output indicator to the output terminal device 12 corresponding to the camera 11 that transmitted the image, indicating that the hook 31c is not in use, thus ending the process. This notifies the worker [W] wearing the output terminal device 12 of the alarm that the hook 31c is not in use. The alarm is reported immediately after a predetermined time (in this case, 2 minutes) elapsed from entry into the work site, prompting the worker [W] to ensure their own safety by using the hook 31c.

[0114] Effects of the Implementation Method

[0115] According to the embodiment described above, the device is configured to detect the hook 31c, which has a retroreflective material on its surface, after detecting the worker [W]'s entry into the work area where the hook 31c is used, based on images sequentially transmitted from the camera. Therefore, it eliminates the need to install light sensors, load sensors, etc., on the hook 31c and the locking part 401, thereby improving the detection accuracy of the hook 31c in dark environments and preventing misjudgments of the hook 31c's use.

[0116] Furthermore, if the hook 31c is not detected within a predetermined time period from the detection of the entry action, the judgment threshold (color information) used for detection is modified to perform re-detection of the hook 31c. This prevents the detection of the hook 31c from being missed due to the influence of the light from the lamp 33, improves the detection accuracy of the hook 31c, and prevents misjudgment of the use of the hook 31c regardless of the type of lamp 33 used in a dark environment.

[0117] Furthermore, the judgment threshold (color information) used for detection is corrected to prevent the hook 31c from being detected during a predetermined period from the detection of the entry action until a predetermined time has elapsed. Thus, the effect of suppressing the increase in over-detection of the hook 31c when correction is implemented immediately after the feature mark is detected in step S104 is also confirmed.

[0118] Furthermore, the judgment threshold (color information) is corrected based on the image of the warning display 402, which is located within the field of view of the camera 11 that inevitably enters the worker's [W] field of view upon entering the work site. Therefore, it is not necessary to set a separate color pattern for correction, and the worker [W] is not burdened with taking pictures of the color pattern, thus improving the detection accuracy of the hook and preventing misjudgments.

[0119] Furthermore, the present invention is not limited to the described embodiments and modifications, but also includes various modifications. For example, the embodiments described above are detailed for ease of understanding and explanation of the present invention, and are not necessarily limited to having all the described structures. In addition, a part of the structure of a certain embodiment can be replaced with the structure of another embodiment, and it is also possible to add the structure of another embodiment to the structure of a certain embodiment. Furthermore, regarding a part of the structure of each embodiment, other structures can be added, deleted, or replaced.

Claims

1. A safety assurance auxiliary system, characterized in that, The safety assurance assistance system includes a management device that detects the hook of the safety belt worn by the worker within images sequentially transmitted from a camera worn by the worker. If the hook is not detected, the management device instructs the worker to output an alarm to an output terminal device. The hook is a hook with a retroreflective material having a specific hue on its surface. The management device detects the worker's entry into the work area where the hook is used based on images sequentially transmitted from the camera, and performs hook detection based on the color information of each image after the entry action is detected. The management device detects the entry action by dimming the brightness of images sequentially sent from the camera within a predetermined range.

2. The safety assurance auxiliary system according to claim 1, characterized in that, The management device detects pixels with the hue of the relativistic reflective material in each image after the entry action is detected. If the number of detected pixels exceeds a predetermined number, it determines that a hook has been detected.

3. The safety assurance auxiliary system according to claim 1, characterized in that, The management device has: The time counting unit counts the elapsed time since the entry action was detected; The hook detection unit detects the hook in each image sequentially transmitted from the camera during the period from the detection of the entry action to the elapsed time counting unit after a predetermined time has elapsed. as well as An alarm output indicator unit, which indicates the output of an alarm when the hook detection unit does not detect the hook.

4. The safety assurance auxiliary system according to claim 3, characterized in that, The management device includes: The feature marker detection unit detects characteristic feature markers at the work site from images sequentially transmitted by the camera; The color information correction unit corrects the judgment threshold of the color information used in the detection of the hook based on the feature markers detected by the feature marker detection unit when the hook detection unit does not detect the hook. as well as The hook re-detection unit performs hook re-detection on each image detected by the hook detection unit based on the color information corrected by the color information correction unit.

5. The safety assurance auxiliary system according to claim 4, characterized in that, The feature marker is a warning display set at the work site. The color information correction unit corrects the hue judgment threshold in the color information based on the hue of the base of the warning display in the image sent from the camera.

6. The safety assurance auxiliary system according to claim 1, characterized in that, The management device records an image of the detected hook.

7. The safety assurance auxiliary system according to claim 1, characterized in that, The regressive reflective material has a greenish hue on its surface as the specific hue.

8. A safety assurance assistance method, comprising detecting the hook of a safety belt worn by a worker within images sequentially transmitted from a camera worn by the worker, and issuing an alarm to an output terminal device carried by the worker if the hook is not detected, characterized in that, As the hook, a hook with a retroreflective material having a specific hue on its surface is used. When detecting the hook, the operator's entry action towards the work site where the hook is used is detected based on images sequentially transmitted from the camera. The hook detection is performed based on the color information of each image after the entry action is detected. The entry action is detected by dimming the brightness of images sequentially sent from the camera within a predetermined range.

Images