Occupational safety monitoring equipment and operation method
Occupational safety monitoring equipment using sensors and computing devices uses artificial intelligence and computer vision to evaluate safety features, solving the problems of wearing protective clothing and authorization before machine operation, and achieving reliable monitoring and operational control of occupational safety.
Patent Information
- Application Number
- CN202480012535.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-02-16
- Filing Date
- 2024-02-13
- Publication Date
- 2025-09-12
AI Technical Summary
Existing technologies make it difficult to effectively monitor and ensure occupational safety, especially in terms of the wearing of protective clothing by personnel before machine operation and the authorization of machine operation, which makes unauthorized operation prone to occur.
Occupational safety monitoring equipment including sensor devices and computing devices is used to capture data using camera devices, evaluate safety characteristics through automated applications such as artificial intelligence and computer vision programs, and execute corresponding predetermined actions such as limiting or stopping machine operation through control devices.
It achieves reliable monitoring of occupational safety, ensures that personnel wear protective equipment correctly and operate machines legally, and improves operational safety and the reliability of compliance with occupational safety regulations.
Smart Images

Figure CN120641691A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to an occupational safety monitoring device comprising at least one monitoring device, wherein the monitoring device comprises at least one sensor device and at least one computing device. The present invention also relates to a method for operating such an occupational safety monitoring device and the use thereof. Background Art
[0002] Occupational safety is crucial for personal protection. Depending on the occupation, for example, very high demands may be placed on the protective clothing to be worn. Furthermore, depending on the system or machine to be operated, it must be ensured that only adequately trained or specially qualified personnel are permitted to operate the machine or system.
[0003] Occupational safety must always be ensured. Therefore, many machines and systems have automated safety features that only allow operation under certain conditions. For example, a person might be required to press two switches that are located far apart on a machine's moving parts. These switches are arranged so that two hands are required, making it impossible for the person to reach inside the machine during operation.
[0004] However, it is often difficult to monitor protective clothing and, consequently, the operation of a machine or system. Keys or similar devices can be used to prevent unauthorized operation of the machine. However, if such keys are accidentally or intentionally handed over to the wrong person, the machine or system could be operated by that person. Summary of the Invention
[0005] It is therefore an object of the present invention to improve the occupational safety of personnel.
[0006] This object is achieved by an occupational safety monitoring device having the features of claim 1 and a method for operating an occupational safety monitoring device having the features of claim 7. Preferred developments of the invention form the subject matter of the dependent claims. Further advantages and features of the invention are apparent from the general description and the description of exemplary embodiments.
[0007] An occupational safety monitoring device according to the present invention for at least one machine or system having at least one control device comprises at least one monitoring device, wherein the monitoring device comprises at least one sensor device and at least one computing device, wherein the sensor device comprises at least one camera device. The computing device is adapted and designed to use data captured by the camera device to check at least one safety characteristic of at least one person to be monitored using an evaluation based on at least one automated application, wherein the automated application comprises at least one artificial intelligence application and / or at least one computer vision application. The monitoring device is operatively connected to the control device, wherein the evaluation of the automated application can be transmitted to the control device, and wherein at least one predetermined action can be executed by the control device based on the results of the evaluation, or at least one predetermined action is executed by the control device.
[0008] The computing means preferably comprises and / or is provided by at least one computer and / or similar device.
[0009] Safety features are in particular the wearing of suitable or intended safety equipment or protective clothing.
[0010] The occupational safety monitoring device according to the invention can be used in particular in the field of packaging machines for filling bulk goods.
[0011] In general, the occupational safety monitoring device according to the present invention is operatively connected to individual machines, groups of multiple machines, simple and / or complex systems and / or devices in which specific occupational safety checks are necessary and / or useful. Preferably, the occupational safety monitoring device according to the present invention can also be used when using tools such as drilling machines, lathes, milling machines, and / or the like.
[0012] In particular, an automation application is at least one processor-based application or computer-based application which processes or further processes or analyzes the data captured by the sensor device.
[0013] According to the invention, the automation application is at least one artificial intelligence application, and / or at least one computer vision application, and / or comprises at least one of these applications.
[0014] Computer vision refers in particular to the analysis of images and videos using computer programs. The goal of this analysis is, in particular, to extract information contained in the images. Depending on the configuration, probabilistic statistical methods, image processing methods, projective geometry, deep learning, and computer graphics are preferably used.
[0015] In the field of artificial intelligence applications, any application in the field of artificial intelligence that can be advantageously used in relation to occupational safety monitoring can be used.
[0016] In particular, the use of machine learning (ML), a subfield of artificial intelligence (AI), is advantageous here. The core components of machine learning are algorithms and methods that enable programs to learn from data without being explicitly programmed. This means that these programs can preferably make decisions independently. In particular, a distinction is made between supervised, unsupervised, and semi-supervised learning. Supervised learning methods include, but are not limited to, convolutional neural networks (also known as spatially invariant artificial neural networks) and their further developments, such as region-based convolutional neural networks. These improvements over traditional neural networks are particularly suitable for image processing applications because, depending on the configuration, one or more preprocessing steps, such as convolution operations, are performed before the neural network, depending on the application.
[0017] Specifically, sensors (e.g., optical sensors, cameras such as color or black and white, thermal imaging, etc.) are used to record data about a specific state. These images are then associated with their states by assigning a corresponding label (marker) to each state (image = information matrix).
[0018] Missing safety features detected by the control device can also be used as a further data basis for learning.
[0019] This declared information is then transferred / learned into a CNN (Convolutional Neural Network) preferably using a machine learning or AI method or AI application.
[0020] While sensors observe or monitor, for example, people, the data continuously passes through the CNN, which directly evaluates the status, and this status is further processed directly by the machine to be operated (for example, by the packaging machine or the control device) (for example, safety equipment is missing, the machine cannot be started, the machine can only be operated within a limited range, the machine is stopped).
[0021] The sensor device may be and / or include, for example, a camera device or, depending on the configuration, may also include or be configured as an acoustic sensor, a temperature sensor and / or at least one other suitable sensor.
[0022] The occupational safety monitoring device according to the present invention offers numerous advantages. A significant advantage is the ability to reliably and in detail monitor occupational safety. For example, the wearing of prescribed or pre-determined protective equipment can be checked or monitored. Since, depending on the configuration, the automated application can also detect the absence of individual pieces of protective equipment, subsequent actions can be determined in each individual case. For example, a warning may be issued, the functionality of the corresponding machine or system may be restricted, the functionality of the machine or system may initially remain unchanged, and a wait may be conducted to see whether the user responds to a warning or message regarding missing protective equipment, or the machine or system may not be started or stopped.
[0023] According to the present invention, the monitoring device is operatively connected to at least one control device, wherein the evaluation of the automation application can be transmitted to the control device. In particular, such a control device can also be part of an occupational safety monitoring system or be incorporated therein. Depending on the configuration, the control device can also be a separate component or assigned to another system operated by the user. Since the control device can preferably initiate predetermined actions based on the evaluation of the automation application, the function of the system or machine to be operated can, for example, enable or restrict the operation of the machine or system based on the results of the evaluation.
[0024] According to the invention, the sensor device comprises at least one camera device, by means of which images or image data of the person to be monitored can be recorded so that reliable conclusions regarding compliance with occupational safety can be drawn by evaluating the images using an automated application.
[0025] Preferably, this camera device can comprise any suitable type of camera.In particular, conventional webcams can also be used here.
[0026] Preferably, the monitoring device is adapted and designed to detect the wearing of predetermined protective equipment as a safety feature, in particular the wearing of a helmet, safety goggles, a face mask, safety shoes, hearing protection, the maintenance of a predetermined safety distance (e.g., to prevent contact with machinery), specific personnel, predetermined authorizations, and / or other safety features. Occupational safety requirements and the consequences of non-compliance with occupational safety regulations may vary.
[0027] In a suitable refinement, the predetermined action is the output of a notification, (pure) documentation, release of normal operation, release of maintenance operations, a warning period before another predetermined action, functional limitation, a controlled, guided, or regulated emergency stop, and / or an emergency stop. The warning period is particularly useful when the absence of a component of the safety device does not pose an immediate danger to the user and when adequate protective equipment can still prevent interference with system operation. However, other appropriate actions may also be taken, depending on the configuration.
[0028] Particularly preferably, the control device is adapted and designed to execute different predefined actions depending on the detected safety feature. Different degrees of action can be executed depending on the detected protective equipment. This means that even if, for example, only a piece of protective equipment is missing, the same action does not always have to be executed. For example, if only a piece of protective equipment is missing, the occupational safety monitoring device or the control device may decide, based on the occupational safety monitoring device's assessment, that an emergency stop of the system is not necessary. However, safety regulations allow for a controlled emergency stop, which is generally more advantageous and gentler than a direct emergency stop. In the field of rotary packaging machines, an emergency stop can cause the packaging machine to immediately depressurize, causing, for example, pneumatic grippers to open and bags hanging from the filling spout to fall. This can result in significant dust exposure, which, without a mask, can have a greater adverse effect on the user than a guided emergency stop or simply a notification to wear a mask.
[0029] In an advantageous configuration, the control device is adapted and designed to take into account different safety features depending on the operating state of the machine or system. For example, it may be possible to specify that different protective equipment is required during certain work steps. For example, the protective equipment requirements during maintenance may also differ from those during normal operation.
[0030] Preferably, the control device is adapted and designed to execute different predefined actions depending on the operating state of the machine or system. For example, if the machine is a tool such as a drill press, different actions can be selected depending on the position of the drill head. When the drill head is in the raised position, even while the drill head is rotating, a user can, for example, briefly remove safety goggles relatively safely to scrape or clean them. While the drill head is lowered and rotating over a workpiece, the control device must typically trigger an emergency stop immediately upon detecting that the safety goggles have been removed.
[0031] The method according to the present invention is suitable for operating an occupational safety monitoring device as described above in conjunction with a machine or system. The monitoring device draws conclusions about at least one safety feature based on an evaluation of data from a sensor device using an automated application, wherein the automated application includes at least one artificial intelligence application and / or at least one computer vision application. The evaluation is transmitted to a control device of the system or machine, wherein the control device initiates a corresponding predetermined action.
[0032] The predetermined action may be, for example, that the machine or system operated by the monitored person is not started, is operated only to a limited extent and / or is stopped.
[0033] The definitions of artificial intelligence and computer vision previously described for the occupational safety monitoring device according to the present invention also apply here.
[0034] The method according to the invention also offers the advantages already described for the occupational safety monitoring device.
[0035] The automated application preferably examines the data online.For example, the data can be used to perform a computational process decentralized across multiple computational locations or online computational applications to identify predetermined events.
[0036] The automation application is particularly preferably trained and / or can be used offline on a computing device. Depending on the configuration, the automation application can first be trained online to provide the most extensive and powerful computing power possible for learning. Depending on the configuration, any further functions and further learning can also be performed locally.
[0037] In appropriate improvements, the automated application is retrained. This can be done online, offline, or through other methods and procedures.
[0038] Particularly preferably, the wearing of predetermined protective equipment as a safety feature is detected, in particular the wearing of a helmet, safety goggles, a face mask, safety shoes, hearing protection, the maintenance of a predetermined safety distance (e.g., to prevent contact with machinery), specific personnel, predetermined authorizations, and / or other safety features. The predetermined safety features and the measures to be taken in the event of non-compliance with occupational safety regulations can be specified differently.
[0039] Preferably, the predetermined action is outputting a notification, a document, a warning period before another predetermined action, a function restriction, a controlled or guided or regulated emergency stop and / or an emergency stop. The advantages and further configurations described for the occupational safety monitoring device also apply.
[0040] In an advantageous configuration, the control device takes into account different safety features depending on the operating state of the machine or system. The advantages and further configurations described for the occupational safety monitoring device also apply.
[0041] In an expedient development, the control device is adapted and designed to execute different predetermined actions depending on the operating state of the machine or system.The advantages and further configurations described for the occupational safety monitoring device also apply.
[0042] The present invention also relates to the use of an automation application comprising at least one artificial intelligence application and / or at least one computer vision application for monitoring the occupational safety of personnel in the field of machines and systems, wherein a predetermined action is preferably performed by a control device of the system or machine based on the detected protective equipment.
[0043] The use according to the invention also provides the advantages already described above with respect to the occupational safety monitoring device and method according to the invention.
[0044] The use according to the invention can preferably be accompanied by corresponding developments of the occupational safety monitoring device according to the invention or of the method for operating such a device.
[0045] Further advantages and features of the present invention will become apparent from the exemplary embodiments explained below with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS
[0046] In the attached figure:
[0047] Figure 1 A purely schematic diagram shows an exemplary embodiment of an occupational safety monitoring device according to the present invention when monitoring a person;
[0048] Figure 2 A purely schematic diagram shows an exemplary embodiment of an occupational safety monitoring device according to the present invention when monitoring a person;
[0049] Figure 3 A purely schematic diagram showing an exemplary embodiment of an occupational safety monitoring device according to the present invention when monitoring a person; and
[0050] Figure 4 A purely schematic diagram shows an exemplary embodiment of an occupational safety monitoring device according to the invention when monitoring a person. DETAILED DESCRIPTION
[0051] Figure 1 Purely schematically, an occupational safety monitoring device 1 according to the invention is shown, with a person 100 to be monitored.
[0052] In the exemplary embodiment shown here, the occupational safety monitoring device 1 comprises a monitoring device 50, which here comprises a sensor device 51 and a computing device 52. In the exemplary embodiment shown here, the computing device 52 is a computer 53, which is indicated by a corresponding symbol and is online or connected to the Internet in this case.
[0053] In the exemplary embodiment shown, the sensor device 51 comprises a camera device 54, which is designed here as a conventional webcam 55. By means of such a sensor device 51 or camera device 54, a person 100 to be monitored or a corresponding detection area 56 can be captured and / or set.
[0054] Depending on the configuration, the detection area 56 corresponds to the entire recording area of the camera device 54. However, it is generally also possible to reduce a larger image portion to a specific detection area 56 as part of image processing by the computing device 52 and / or the user.
[0055] The computing device 52 or computer 53 checks predetermined security features of the image or image data captured by the sensor device 51 or the camera device 54 or the webcam 55 through automated applications including AI applications and / or computer vision applications.
[0056] Furthermore, a system 300 is provided, comprising a control device 30, in which the occupational safety monitoring device 1 is used to check whether the personnel or operators of the system are wearing the prescribed protective equipment. The control device 30 is operatively connected to the monitoring device 50 or the computing device 52 of the occupational safety monitoring device 1, wherein the evaluations generated by the computing device 52 can be transmitted to the control device 30. Depending on the configuration, the occupational safety monitoring device 1 may also include its own control device 30, which can control the system 300 accordingly.
[0057] In the exemplary embodiment shown, the control device 30 can perform predetermined actions based on the evaluation of the computing device 52. For example, a warning signal can be issued, or restricted operation of the machine or system to be controlled can be prescribed, or the operation can be denied.
[0058] In the exemplary embodiment shown here, the camera device 54 uses its detection range 56 to detect the head of the person 100 to be monitored and to check whether all prescribed safety features are present.
[0059] In the exemplary embodiment shown here, this refers to wearing predetermined protective equipment 200. In the exemplary embodiment shown here, it is checked via an automated application or an artificial intelligence application or a computer vision application whether the monitored person 100 is correctly wearing the protective equipment 200 consisting of a helmet 201, safety goggles 202 and a mask 203.
[0060] In the exemplary embodiment shown, the predefined protective equipment 200 matches the protective equipment 200 worn by the person 100, allowing the control device 30 to unrestrictedly operate the machine to be operated. However, depending on the configuration, predefined actions can be provided. For example, it can be recorded that the person in question is wearing predefined protective clothing during an inspection. This can be particularly advantageous when, for example, access control is only performed once and the operator of the system may remove the protective clothing without permission after the visit. However, notifications can also be issued, such as in the form of traffic lights, indicating that the protective equipment is in compliance (green), seriously / shortly / currently incomplete (yellow), or that (at least seriously / shortly / currently) safety-relevant parts of the protective equipment are missing (red).
[0061] Depending on the configuration and application, different detection areas can also be selected. For example, the entire body or (only) other parts of the body can be detected.
[0062] exist Figure 2, the previously shown exemplary embodiment is shown purely schematically, in which the computing device 52 detects via an automation application or an AI application or a computer vision application that the monitored person is not fully wearing the prescribed protective equipment 200 .
[0063] in this case, Figure 2 Personnel 100 in the example is not wearing the required face mask 203 shown in the exemplary embodiment. In this case, while a face mask 203 is essential, required, or required for full operation of the system (not shown) in the exemplary embodiment shown here, limited operation is still permitted. However, functions requiring a face mask are not enabled. This could be, for example, maintenance operations on the system for filling powdered products, rather than the filling process itself.
[0064] Additionally or exclusively, documentation can also be prepared here and / or notifications can be issued, for example in the form of a traffic light (in this case yellow).
[0065] Figure 3 A different scenario from the previously described exemplary embodiment of the occupational safety monitoring device 1 according to the present invention is shown. Here, the monitored person is not wearing a helmet 201, which in the illustrated configuration is provided as an essential safety feature of the protective equipment 200. This also results in restricted operation of the machine or system controlled by the person 100 being impossible, and operation being completely blocked. Depending on the configuration, this can result in an immediate emergency stop or, depending on the safety features, a guided or controlled emergency stop.
[0066] Figure 4 Purely schematically, in the previously shown exemplary embodiment of the occupational safety monitoring device 1 according to the invention, a person is monitored who is not wearing any protective equipment 200. In the case shown here, the aim is to completely prevent the operation of the system controlled by this person.
[0067] Depending on the configuration, in all exemplary embodiments, a warning or notification may also be issued to person 100 and / or superior supervisor, or documentation may be prepared.
[0068] Depending on the embodiment, other security features can also be checked. In particular, access control can also be monitored, for example, using facial recognition or other access restrictions. For example, access to a construction site or specific areas of a machine or system can only be granted if the user is wearing appropriate protective clothing. This can be achieved independently of personnel, as automated, artificial intelligence, or computer vision applications are trained only on protective elements or protective equipment. In the case of access and / or authorization checks, these can also be personnel-dependent. In particular, specific qualifications can also be identified using specific ID cards and / or badges, which can, for example, enable access to certain levels or functions of a machine or system.
[0069] Reference Signs List
[0070] 1 Occupational safety monitoring equipment
[0071] 30 Control device
[0072] 50 Monitoring Devices
[0073] 51 sensor device
[0074] 52 computing devices
[0075] 53 Computer
[0076] 54 Camera Device
[0077] 55 webcams
[0078] 56 detection areas
[0079] 100 people
[0080] 200 Protective Equipment
[0081] 201 Helmet
[0082] 202 Safety Goggles
[0083] 203 Mask
[0084] 300 machines / systems
Claims
1. An occupational safety monitoring device (1) for at least one machine (300) or system (300) having at least one control device (30), comprising at least one monitoring device (50), wherein: The monitoring device (50) comprises at least one sensor device (51) and at least one computing device (52), wherein the sensor device (51) comprises at least one camera device (54), wherein the computing device (52) is suitable and designed to use the data captured by the camera device (54) to check at least one safety feature of at least one person (100) to be monitored using an evaluation based on at least one automated application, wherein the automated application comprises at least one artificial intelligence application and / or at least one computer vision application, It is characterized by: The monitoring device (50) is operatively connected to the control device (30) of the machine (100) or system (100), wherein an evaluation of the automation application can be transmitted to the control device (30), and wherein at least one predetermined action can be performed by the control device (30) based on the result of the check.
2. The occupational safety monitoring device (1) according to claim 1, wherein: The monitoring device (50) is suitable for and designed to detect the wearing of predetermined protective equipment as a safety feature, in particular the wearing of a helmet, the wearing of safety goggles, the wearing of a face mask, the wearing of safety shoes, the wearing of hearing protection, the maintenance of a predetermined safety distance, specific personnel, predetermined authorization and / or other safety features.
3. An occupational safety monitoring device (1) according to any one of the preceding claims, wherein The control device (30) is adapted and designed to perform different predetermined actions depending on the detected security feature.
4. Occupational safety monitoring device (1) according to any one of the preceding claims, wherein The predetermined action is output of a notification, a document, release of normal operation, release of maintenance operation, a warning period before another predetermined action, functional limitation, a controlled emergency stop and / or an emergency stop.
5. Occupational safety monitoring device (1) according to any one of the preceding claims, wherein The control device (30) is adapted and designed to take into account different safety features depending on the operating state of the machine or system.
6. Occupational safety monitoring device (1) according to any one of the preceding claims, wherein The control device (30) is adapted and designed to perform different predetermined actions according to the operating state of the machine or system.
7. A method for operating an occupational safety monitoring device (1) according to any one of the preceding claims in combination with a machine (300) or a system (300), It is characterized by: The monitoring device (50) draws conclusions about at least one safety feature based on an evaluation of data from a sensor device (51) using an automation application, wherein the automation application comprises at least one artificial intelligence application and / or at least one computer vision application, and wherein the evaluation is transmitted to a control device (30), wherein the control device initiates a corresponding predetermined action.
8. The method according to the preceding claim, wherein the automated application checks the data online.
9. The method according to any one of the two preceding claims, wherein: The automation application is trained and / or executed offline on the computing device.
10. The method according to any of the preceding claims 5 to 7, wherein the automation application is retrained.
11. The method according to any one of the preceding claims 5 to 8, wherein Detecting the wearing of predetermined protective equipment (200) as a safety feature, in particular the wearing of a helmet (201), the wearing of safety goggles (202), the wearing of a face mask (203), the wearing of safety shoes, the wearing of hearing protection, the maintenance of a predetermined safety distance, specific personnel, predetermined authorization and / or other safety features.
12. The method according to any one of the preceding claims 5 to 8, wherein The predetermined action is output notification, function limitation, controlled / guided / regulated emergency stop and / or emergency stop.
13. The method according to any one of the preceding claims 5 to 8, wherein The control device (30) takes into account different safety features depending on the operating state of the machine (300) or system (300).
14. The method (1) according to any one of the preceding claims, wherein The control device (30) is adapted and designed to perform different predetermined actions according to the operating state of the machine or system.