Occupational safety monitoring device and method for operation
Patent Information
- Application Number
- EP2024709309
- Authority / Receiving Office
- EP · EP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-02-16
- Filing Date
- 2024-02-13
- Publication Date
- 2025-12-24
AI Technical Summary
Occupational safety is challenging to monitor and enforce, particularly in environments where protective clothing and operator qualifications are critical, as existing systems struggle to reliably prevent unauthorized operation of machines and systems.
An occupational health and safety control device equipped with a sensor device, such as a camera, and a computing device using AI and computer vision applications to evaluate the presence and correctness of safety features, enabling automated decision-making and actions to ensure compliance with safety protocols.
Enhances the reliable monitoring and enforcement of occupational safety by allowing for real-time evaluation and appropriate responses to safety feature compliance, including warnings, operational restrictions, or emergency stops, thereby preventing unsafe operations.
Smart Images
Figure EP2024053642_22082024_PF_FP
Abstract
Description
[0001] Occupational safety control device and method for operating
[0002] Description
[0003] The present invention relates to an occupational safety control device comprising at least one control device, wherein the control device comprises at least one sensor device and at least one computing device. The present invention also relates to a method for operating such an occupational safety control device and to a use thereof.
[0004] Occupational safety is of great importance for the protection of people. Depending on the activity, for example, very stringent requirements can be placed on the protective clothing to be worn. Furthermore, depending on the system or machine to be operated, it must be ensured that only adequately trained or specially qualified persons can operate the machine or system.
[0005] Occupational safety must always be ensured. Many machines and systems have certain automated safety functions that only permit operation under certain conditions. For example, with moving parts of a machine, it may be necessary for a person to press two switches located far apart. These switches are positioned in such a way that both hands are required, preventing the person from reaching into the machine during operation. However, monitoring protective clothing is generally difficult, and controlling the operation of machines and systems is also difficult. Certain keys or similar devices may be provided to prevent unauthorized operation of a machine. However, if such a key accidentally or intentionally falls into the hands of the wrong person, the machine or system can still be operated by that person.
[0006] It is therefore the object of the present invention to increase the occupational safety of a person.
[0007] This object is achieved by an occupational safety control device having the features of claim 1 and by a method for operating an occupational safety control device having the features of claim 7. Preferred developments of the invention are the subject of the subclaims. Further advantages and features of the present invention will become apparent from the general description and the description of the exemplary embodiment.
[0008] The occupational safety control device according to the invention for at least one machine or system with at least one control device comprises at least one control device, wherein the control device comprises at least one sensor device and at least one computing device, wherein the sensor device comprises at least one camera device. The computing device is suitable and designed to check at least one security feature on at least one person to be checked using the data recorded by the camera device using an evaluation based on at least one automated application, wherein the automated application comprises at least one AI application and / or at least one computer vision application.The monitoring device is operatively connected to the control device, wherein the evaluation of the automated application can be transferred to the control device and wherein at least one predetermined action can be carried out or is carried out by means of the control device based on the result of the check.
[0009] A computing device preferably comprises at least one computer and / or the like and / or is provided by at least one computer and / or the like.
[0010] A safety feature is, in particular, the wearing of suitable or predetermined safety equipment or protective clothing.
[0011] The occupational safety control device according to the invention can be used in particular in the field of packaging machines for filling bulk goods.
[0012] In general, an occupational safety monitoring device according to the invention is operatively connected to a single machine, to a group of several machines, to simple and / or complex systems and / or equipment for which a specific occupational safety check is necessary and / or useful. Preferably, the occupational safety monitoring device according to the invention can also be used when using tools such as a pillar drill, a lathe, a milling machine, and / or the like.
[0013] An automated application is, in particular, at least one processor-based application or a computer-based application that processes, further processes, or analyzes the data acquired by the sensor device. According to the invention, the automated application is at least one AI application and / or at least one computer vision application and / or comprises at least one of these applications.
[0014] Computer vision refers specifically to the analysis of images and videos using computer programs. The goal of these analyses is primarily to extract information contained in the image. Depending on the design, probabilistic methods, image processing, projective geometry, deep learning, and computer graphics are preferably used.
[0015] In the area of AI application, any application in the field of artificial intelligence can be used which can be used for monitoring purposes with regard to occupational safety and health.
[0016] The use of machine learning (ML) is particularly advantageous here, with such machine learning being a subfield of artificial intelligence (AI). Central components of machine learning are algorithms and methods that enable programs to learn from data without being explicitly programmed. This allows these programs to make decisions, preferably independently. A distinction is made between supervised, unsupervised, and semi-supervised learning. Supervised learning methods include convolutional neural networks (also known as space-invariant artificial neural networks) and further developments of convolutional neural networks, such as region-based convolutional neural networks.These modifications of conventional neural networks are particularly suitable for image processing applications, as, depending on the design, one or more preprocessing steps are performed before the neural network, including, for example, convolution operations depending on the application. In particular, sensors (e.g., optical sensors such as a color or black / white camera, thermal image, etc.) are used to record data from specific states. These images and their states are then related by assigning the corresponding label to each state (an image = a matrix of information).
[0017] A lack of a security feature detected by the control device can also be used as an additional data basis for learning.
[0018] This declared information is then transferred / trained into a CNN (convolutional neural network), preferably using machine learning or AI methods or AI applications.
[0019] If a sensor observes or monitors, for example, a person, the data is continuously passed through the CNN, which evaluates the condition directly and the status is further processed directly by the machine to be operated, e.g. a packaging machine or the control device (e.g. safety equipment is missing, machine cannot be started, machine can only be operated to a limited extent, machine stops).
[0020] A sensor device can, for example, be and / or comprise a camera device, or, depending on the design, can also comprise or be designed as an acoustic sensor, a temperature sensor and / or at least one other suitable sensor.
[0021] The occupational safety monitoring device according to the invention offers many advantages. A significant advantage is that occupational safety can be monitored reliably and in detail. For example, the wearing of prescribed or predetermined protective equipment can be checked or monitored. Because the automatic application, depending on its design, can also detect the missing individual pieces of protective equipment, a decision can be made on a case-by-case basis regarding subsequent action. For example, only a warning can be issued, the functionality of the corresponding machine or system can be restricted, the functionality of the machine or system can initially remain unchanged, and the system waits to see whether a user responds to a warning or notification regarding missing protective equipment, or whether the machine or system does not start or stops.
[0022] According to the invention, the monitoring device is operatively connected to at least one control device, wherein the evaluation of the automated application can be transmitted to the control device. Such a control device can in particular also be part of the occupational health and safety monitoring device or be comprised thereof. Depending on the design, the control device can also be a separate component or assigned to another system that is operated by the user. Since the control device can preferably initiate predetermined actions by means of the evaluation of the automated application, the functionality of the system or the machine to be operated can, for example, be the approval or a restriction in the operation of the machine or system depending on the result of the evaluation.
[0023] According to the invention, the sensor device comprises at least one camera device. Such a camera device can capture images or image data of the person being monitored, so that, by evaluating the images using the automated application, reliable conclusions can be drawn about compliance with occupational health and safety regulations.
[0024] Such a camera device can preferably comprise any suitable type of camera. In particular, the use of a conventional webcam is also possible here. Preferably, the control device is suitable and designed to recognize the wearing of predetermined protective equipment, in particular the wearing of a helmet, the wearing of safety goggles, the wearing of a face mask, the wearing of safety shoes, the wearing of hearing protection, the maintenance of a predetermined safety distance (e.g. intervention in the machine is to be prevented), a specific person, a predetermined authorization and / or other safety features as a safety feature. The requirements for occupational health and safety and the consequences for non-compliance with the occupational health and safety regulations can be provided for differently.
[0025] In appropriate further developments, the predetermined action is the issuing of a note, (pure) documentation, approval of normal operation, approval of maintenance operation, a warning period before a further predetermined action, a functional restriction, a controlled or guided or regulated emergency stop and / or an emergency stop. A warning period is particularly appropriate if the absence of part of the safety device does not immediately pose a danger to a user and interference with the operation of the system can still be prevented by completing the protective equipment. Depending on the design, other appropriate actions can also be carried out.
[0026] The control device is particularly preferably suitable and designed to carry out a different predetermined action depending on the recognized safety feature. Different gradations of the action can occur depending on the recognized protective equipment. This means that the same action does not always have to be carried out, even if, for example, only part of the protective equipment is missing. If, for example, only part of the protective equipment is missing, the occupational health and safety control device or the control device can decide, based on the evaluation of the occupational health and safety control device, that an emergency shutdown of the system is not necessary, but that the safety regulations permit a controlled emergency shutdown, which is generally much more advantageous and less damaging than a direct emergency shutdown. In the area of rotating packaging machines, for example, the packaging machine is depressurized directly in the event of an emergency shutdown, which leads to, for example,Pneumatic grippers may release, and bags hanging from the filling nozzle may fall off. This can lead to significant dust exposure, which, for example, would be more detrimental to the operator if they are not wearing a face mask than a guided emergency stop or even just a reminder to put on a mask.
[0027] In advantageous embodiments, the control device is suitable and designed to take into account different safety features depending on the operating state of the machine or system. For example, it may be provided that the prescribed protective equipment differs during certain work steps. During maintenance, for example, the requirements for protective equipment may also differ from those during normal operation.
[0028] The control device is preferably suitable and designed to carry out different predetermined actions depending on the operating state of the machine or system. If the machine is, for example, a tool such as a pillar drill, the action can be selected differently depending on the position of the drill. If the drill is in the raised position, a user could, for example, briefly remove their safety goggles relatively safely, even when the drill is rotating, in order to scratch themselves or clean their glasses. If the drill is lowered and rotating on a workpiece to be machined, the control device would generally have to immediately trigger an emergency stop upon detecting that the safety goggles have been removed. The method according to the invention is suitable for operating an occupational health and safety monitoring device, as described above, in conjunction with a machine or system.Based on the evaluation of the data from the sensor device, the control device uses the automated application to determine at least one security feature, wherein the automated application comprises at least one AI application and / or at least one computer vision application. The evaluation is transmitted to a control device of the system or machine, wherein the control device initiates a corresponding predetermined action.
[0029] A predetermined action can, for example, consist in a machine or system to be operated by the controlled person not starting, functioning only to a limited extent and / or stopping.
[0030] The same definitions of artificial intelligence and computer vision apply here as previously described for the occupational safety control device according to the invention.
[0031] The method according to the invention also offers the advantages already described for the occupational safety control device.
[0032] Preferably, the automated application checks the data online. For example, a computing process can be executed decentrally at multiple computing centers or on an online computing application based on the data to determine a predetermined event.
[0033] Particularly preferably, the automated application is trained and / or usable offline on the computing device. Depending on the design, the automated application can initially be trained online in order to have the broadest and greatest possible computing power available for training. Depending on the design, any additional functionality and further learning can also take place locally.
[0034] The automated application is further trained in appropriate training courses. This can be done online, offline, or using other methods and procedures.
[0035] A particularly preferred safety feature is the wearing of predetermined protective equipment, in particular wearing a helmet, wearing safety goggles, wearing a mouth guard, wearing safety shoes, wearing hearing protection, maintaining a predetermined safety distance (e.g. to prevent interference with the machine), recognizing a specific person, a predetermined authorization and / or other safety features. The predetermined safety features and the measures to be taken in the event of non-compliance with occupational health and safety regulations can be provided for differently.
[0036] Preferably, the predetermined action is the issuance of a notice, documentation, a warning period before a further predetermined action, a functional restriction, a controlled or guided or regulated emergency stop, and / or an emergency stop. Regarding the advantages and further embodiments, the same applies as described for the occupational safety control device.
[0037] In advantageous embodiments, the control device takes into account different safety features depending on the operating state of the machine or system. With regard to the advantages and further embodiments, the same applies as was described for the occupational safety control device. In expedient further developments, the control device is suitable and designed to carry out different predetermined actions depending on the operating state of the machine or system. With regard to the advantages and further embodiments, the same applies as was described for the occupational safety control device.
[0038] The invention also relates to the use of an automated application comprising at least one Kl application and / or at least one computer vision application in the control of the occupational safety of persons in the area of machines and systems, wherein a predetermined action is preferably carried out by the control device of the system or machine based on the recognized protective equipment.
[0039] The use according to the invention also offers the advantages which have already been previously described for the occupational safety control device according to the invention and the method according to the invention.
[0040] The use according to the invention can preferably be further developed according to the occupational safety control device according to the invention or the method for operating such a device.
[0041] Further advantages and features of the present invention will become apparent from the exemplary embodiment which is explained below with reference to the accompanying figures.
[0042] The figures show:
[0043] Fig. 1 is a purely schematic representation of an embodiment of an occupational safety control device according to the invention during the control of a person; Fig. 2 is a purely schematic representation of an embodiment of an occupational safety control device according to the invention during the control of a person;
[0044] Fig. 3 is a purely schematic representation of an embodiment of an occupational safety control device according to the invention when controlling a person; and
[0045] Fig. 4 is a purely schematic representation of an embodiment of an occupational safety control device according to the invention when controlling a person.
[0046] Figure 1 shows a purely schematic representation of an occupational safety control device 1 according to the invention with a person 100 to be controlled.
[0047] In the exemplary embodiment shown here, the occupational safety control device 1 comprises a control device 50, which here comprises a sensor device 51 and a computing device 52. In the exemplary embodiment shown here, the computing device 52 is a computer 53, which is online or connected to the Internet, as indicated by the corresponding symbol.
[0048] In the illustrated embodiment, the sensor device 51 comprises a camera device 54, which is embodied here as a conventional webcam 55. Using this sensor device 51 or the camera device 54, the person 100 to be monitored or a corresponding detection area 56 can be recorded and / or adjusted.
[0049] Depending on the design, the detection area 56 corresponds to the entire recording area of the camera device 54. However, it is also possible and generally provided that a larger image section is limited to a specific detection area 56 within the scope of image processing by the computing device 52 and / or a user.
[0050] The images or image data recorded by the sensor device 51 or the camera device 54 or the webcam 55 are checked for predetermined security features by the computing device 52 or the computer 53 by means of an automated application comprising a KI application and / or a computer vision application.
[0051] Furthermore, a system 300 with a control device 30 is provided here, wherein the occupational safety control device 1 checks whether the personnel or operators of the system are wearing prescribed protective equipment. The control device 30 is operatively connected to the control device 50 or to the computing device 52 of the occupational safety control device 1, wherein the evaluation created by the computing device 52 can be transmitted to the control device 30. Depending on the design, the occupational safety control device 1 can also comprise its own control device 30, which can control the system 300 accordingly.
[0052] In the illustrated embodiment, the control device 30 can perform a predetermined action based on the evaluation of the computing device 52. For example, a warning signal can be issued, or restricted operation of a machine or system to be controlled can be specified, or operation can be denied.
[0053] In the embodiment shown here, the camera device 54 captures the head of a person 100 to be checked with its detection area 56 and checks whether all prescribed security features are present.
[0054] In the exemplary embodiment shown here, this is the wearing of predetermined protective equipment 200. In the exemplary embodiment shown here, the automated application or the AI application or the computer vision application checks whether the protective equipment 200 consisting of helmet 201, protective goggles 202 and mouth guard 203 is worn correctly by the person 100 being checked.
[0055] In the exemplary embodiment shown, the predetermined protective equipment 200 corresponds to the protective equipment 200 worn by the person 100, so that the control device 30 enables unrestricted operation for the user of a machine to be operated. Nevertheless, depending on the design, a predetermined action can be provided. For example, it can be documented that the person in question wore a predetermined protective clothing during the inspection. This can be particularly advantageous if, for example, only an access check is carried out and the operating personnel of a system could improperly remove the protective clothing after access. However, a note can also be provided, for example.in the form of a traffic light, indicating that the protective equipment complies with the regulations (green), is acutely / short-term / currently not safety-critically incomplete (yellow) or that (at least acutely / short-term / currently) safety-relevant parts of the protective equipment are missing (red).
[0056] Depending on the design and application, the detection area can be selected differently. For example, the entire body can be detected, or (only) other parts of the body.
[0057] Figure 2 shows a purely schematic representation of the previously shown embodiment, wherein the computing device 52 detects via the automated application or AI application or the computer vision application that the prescribed protective equipment 200 is not completely worn by the person being checked.
[0058] In this case, person 100 in Figure 2 is not wearing the face mask 203 required in the exemplary embodiment shown. Although the face mask 203 is essential, necessary, or required for full operation of the system (not shown) in the exemplary embodiment shown here, limited operation is nevertheless permitted. However, the functions for which wearing the face mask is necessary are not enabled. This could be, for example, the maintenance operation of a system for filling powdered products, but not the filling process itself.
[0059] Additionally or exclusively, documentation could also be provided here and / or a notice could be issued, e.g. in the form of a traffic light (here yellow).
[0060] Figure 3 shows a different situation in the previously shown embodiment of an occupational safety monitoring device 1 according to the invention. Here, the person being monitored is not wearing a helmet 201, which in the configuration shown here is specified as an essential safety feature of the protective equipment 200. As a result, restricted operation of the machine or system to be controlled by the person 100 is not possible; instead, operation is completely blocked. Depending on the design, this can result in a direct emergency stop or, depending on the safety feature, a guided or controlled emergency stop.
[0061] Figure 4 shows, purely schematically, that in the previously shown embodiment of an occupational safety monitoring device 1 according to the invention, a person is being monitored who is not wearing any protective equipment 200 at all. In the case shown here, it is provided that the operation of the system to be controlled by the person is completely prevented.
[0062] Depending on the design, in all embodiments, warnings or instructions can be issued to person 100 and / or a higher authority, or documentation can be provided.
[0063] Depending on the design, additional security features can also be checked. In particular, access controls can also be controlled using facial recognition or other access restrictions. For example, access to a construction site or certain areas of a machine or system can only be permitted with appropriate protective clothing. This can optionally be done independently of the person if the automated application, AI application, or computer vision application is only trained on the protective elements or protective equipment. In the case of access and / or authorization controls, the check can also be person-specific. In particular, certain qualifications can be recognized, for example using certain ID cards and / or markings, which can authorize access to certain levels or functions of machines or systems.
[0064] List of reference symbols
[0065] 1 Work contactor control device
[0066] 30 Control device
[0067] 50 Control device
[0068] 51 Sensor device
[0069] 52 computing device
[0070] 53 computers
[0071] 54 Camera setup
[0072] 55 webcams
[0073] 56 Detection area
[0074] 100 people
[0075] 200 protective equipment
[0076] 201 Helmet
[0077] 202 Safety goggles
[0078] 203 face masks
[0079] 300 machines / systems
Claims
Claims:
1. Occupational safety control device (1) for at least one machine (300) or system (300) with at least one control device (30), comprising at least one control device (50), wherein the control device (50) comprises at least one sensor device (51) and at least one computing device (52), wherein the sensor device (51) comprises at least one camera device (54), wherein the computing device (52) is suitable and designed to check at least one security feature on at least one person (100) to be controlled using the data acquired by the camera device (54) based on an evaluation based on at least one automated application, wherein the automated application comprises at least one AI application and / or at least one computer vision application, characterized in that the control device (50) is operatively connected to the control device (30) of the machine (100) or system (100),wherein the evaluation of the automated application is transferable to the control device (30) and wherein at least one predetermined action can be carried out by means of the control device (30) based on the result of the check.
2. Occupational safety control device (1) according to claim 1, wherein the control device (50) is suitable and designed to detect as a safety feature the wearing of predetermined protective equipment, in particular the wearing of a helmet, the wearing of protective goggles, the wearing of a mouth guard, the wearing of safety shoes, the wearing of hearing protection, the maintenance of a predetermined safety distance, a specific person, a to recognize predetermined authorization and / or other security features.
3. Occupational safety control device (1) according to one of the preceding claims, wherein the control device (30) is suitable and designed to carry out a different predetermined action depending on the recognized safety feature.
4. Occupational safety control device (1) according to one of the preceding claims, wherein the predetermined action is an output of a notice, a documentation, an approval of normal operation, an approval of maintenance operation, a warning period before a further predetermined action, a functional restriction, a controlled emergency stop and / or an emergency stop.
5. Occupational safety control device (1) according to one of the preceding claims, wherein the control device (30) is suitable and designed to take into account different safety features depending on the operating state of the machine or system.
6. Occupational safety control device (1) according to one of the preceding claims, wherein the control device (30) is suitable and designed to carry out different predetermined actions depending on the operating state of the machine or system.
7. Method for operating an occupational safety control device (1) according to one of the preceding claims in conjunction with a machine (300) or system (300), characterized in that the control device (50) based on the evaluation of the data of the sensor device (51) by means of the automated application on at least one Security feature is closed, wherein the automated application comprises at least one Kl application and / or at least one computer vision application, and that the evaluation is transmitted to the control device (30), wherein the control device initiates a correspondingly predetermined action.
8. Method according to the preceding claim, wherein the automated application checks the data online.
9. Method according to one of the two preceding claims, wherein the automated application is trained and / or operates offline on the computing device.
10. Method according to one of the preceding claims 5 to 7, wherein the automated application is retrained.
11. Method according to one of the preceding claims 5 to 8, wherein the wearing of predetermined protective equipment (200), in particular the wearing of a helmet (201), the wearing of protective goggles (202), the wearing of a mouth guard (203), the wearing of safety shoes, the wearing of hearing protection, the maintenance of a predetermined safety distance, a specific person, a predetermined authorization and / or other security features is recognized as a security feature.
12. Method according to one of the preceding claims 5 to 8, wherein the predetermined action is an output of an instruction, a functional restriction, a controlled / guided / regulated emergency stop and / or an emergency stop.
13. Method according to one of the preceding claims 5 to 8, wherein the control device (30) takes into account different safety features depending on the operating state of the machine (300) or system (300).
4. Method (1) according to one of the preceding claims, wherein the control device (30) is suitable and designed to carry out different predetermined actions depending on the operating state of the machine or system.