Data acquisition method and system of intelligent safety helmet
By integrating image acquisition equipment and face recognition model in smart safety helmets, rotating the acquisition equipment to match the wearer's identity, and alarming when the environmental data exceeds the threshold, the problem of blind spots in traditional smart safety helmets and difficulty in identity recognition is solved. Improves safety management and reduces costs.
Patent Information
- Application Number
- CN202411405182.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-10-10
- Publication Date
- 2024-11-08
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
The camera position of traditional smart safety helmets is fixed, and the shooting angle cannot be flexibly adjusted, resulting in blind spots in the viewing angle and the user's identity cannot be identified, increasing production and maintenance costs.
By integrating image acquisition devices and face recognition models in smart safety helmets, obtaining status information of safety helmets, rotating the image acquisition devices to collect face data, matching facial features to determine the wearer's identity, and the environmental data exceeds the security threshold. Alarm is made when
Image acquisition from different angles is realized, ensuring consistency of human caps, reducing production and maintenance costs, and improving safety management level.
Smart Images

Figure CN118918627A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of data collection, and in particular to a data collection method and system for an intelligent helmet. Background Art
[0002] In high-risk working environments, safety monitoring and emergency response of workers have always been the focus and difficulty of management. Traditional helmets provide basic protection when people fall and are hit by foreign objects. In order to achieve more precise and intelligent management of the work site, smart helmets that integrate advanced technologies have come into being. Most of the smart helmets on the market currently have integrated cameras for taking photos, recording videos, audio and video calls, etc. Although these products provide a variety of functions, there are still some shortcomings: 1. The camera position is fixed and the shooting angle cannot be adjusted flexibly. The shooting angle depends on the wearer's head movement, which is prone to blind spots and may miss key image information.
[0003] 2. The camera is directly exposed to the outside without any protective measures. The camera exposed to the construction environment is not only prone to dust and dirt accumulation, but also easily damaged by bumps, which will affect the shooting effect and the audio and video related functions of the helmet.
[0004] 3. With the continuous refinement of safety management measures, it is necessary to ensure the consistency of people and helmets and the attendance of operators. At this time, in order to identify the user's identity, it is necessary to collect the user's face image, but the existing camera viewing angle does not meet the requirements, so other cameras need to be installed, which will increase the production and maintenance costs of smart helmets. Summary of the invention
[0005] The present invention provides a data collection method and system for an intelligent helmet, which are used to solve the problem in the prior art that a traditional helmet camera is prone to produce a visual blind spot and cannot recognize the identity of a user.
[0006] A data collection method for a smart helmet in the present invention comprises: Acquire status information of the helmet, and when the status information is a first state, collect face data of a first area through an image acquisition device and call a face recognition model; the first state indicates that the helmet is worn successfully; the face data is face information of the wearer; Extracting facial features based on the face recognition model according to the face data and the image acquisition angle α, and matching the facial features with user features to determine the identity of the wearer; the user features are information about the helmet user; When the facial features are successfully matched with the user features, environmental data of the second area is collected by an image acquisition device and the environmental data is compared with a preset security threshold; When the environmental data is greater than the preset safety threshold, the safety helmet will sound an alarm.
[0007] Optionally, before collecting the face data of the first area and calling the face recognition model, the method includes: Acquire current location information and determine whether the current location information is located in the first area; the current location information represents location information where the image acquisition device can currently acquire images; When the current position information exceeds the first area, the image acquisition device is controlled to rotate θ degrees so that the current position information is located within the first area.
[0008] Optionally, when the current location information is within the first area, the method further includes: The angle of the current position information is obtained, and the angle α is sent to the face recognition model, so that the face recognition model obtains the user features corresponding to the angle based on the angle.
[0009] Optionally, the method further includes: When the state information is in the second state, the image acquisition device is moved into the closed area of the safety helmet; the second state indicates that the safety helmet is not worn successfully.
[0010] Obtaining the output value and output time of the vibration sensor of the safety helmet; When the output value is greater than the vibration threshold and the output period is greater than the period threshold, the state information is the first state; and / or receiving remote control commands or obtaining short-term changes in ambient light; When the remote control command is to adjust the state information to the second state or the short-term change of the ambient light is greater than the light threshold, the state information is in the second state.
[0011] Optionally, the method further includes: Performing liveness determination on the facial area based on the facial data; When it is determined that the face data is alive, the state information is optional for the first state, and the method further includes: When the facial features fail to match the user features, generating a failure prompt message and / or performing a rematch; The failure prompt information is sent to the background management end, and the status information is modified to the second status.
[0012] Optionally, when the facial features match the user features successfully, the method further includes: The timing starts from the moment when the matching is successful; When the timing reaches the time threshold, the status information of the helmet is obtained again.
[0013] A data collection system for a smart helmet in an embodiment of the present invention comprises: an acquisition unit, configured to acquire status information of the helmet, and when the status information is in a first state, collect face data of a first area through an image acquisition device and call a face recognition model; the first state indicates that the helmet is worn successfully; the face data is face information of the wearer; A feature matching unit, configured to extract facial features from the face data based on the face recognition model, and match the facial features with user features to determine the identity of the wearer; the user features are information about the helmet user; a security monitoring unit, configured to collect environmental data of a second area through an image acquisition device and compare the environmental data with a preset security threshold when the facial features successfully match the user features; The alarm unit is used to alarm the safety helmet when the environmental data is greater than the preset safety threshold.
[0014] Optionally, the system further comprises: a servo, which is embedded in the helmet and used to control the rotation of the image acquisition device; wherein the servo adopts a PWM signal to control the rotation of the image acquisition device; the image acquisition device can rotate upwards in a range of 0° to 90°, and can rotate downwards in a range of 0° to 60°.
[0015] The data collection method and system of the smart helmet of the present invention can collect images at different angles according to needs, thereby improving the performance of the smart helmet as a whole and better meeting the safety management needs of the work site. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] Figure 1 is a flow chart of a data collection method for a smart helmet in an embodiment of the present invention; Figure 2 is a schematic diagram of a steering engine controlling an image acquisition device to rotate to acquire an image in an embodiment of the present invention; Figure 3 It is a structural schematic diagram of a data acquisition system for an intelligent helmet in an embodiment of the present invention; Figure 4 The figure is a schematic diagram of the main structure of the smart helmet in an embodiment of the present invention. DETAILED DESCRIPTION
[0017] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the present invention, rather than to limit the present invention. It should also be noted that, for ease of description, only parts related to the present invention, rather than all structures, are shown in the accompanying drawings.
[0018] It should be understood that in the various embodiments of this document, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this document.
[0019] The embodiment of the present invention provides a data collection method for a smart helmet, such as Figure 1 As shown, the method includes: Step 100, obtain the state information of the helmet. When the state information is the first state, collect the face data of the first area and call the face recognition model through the image acquisition device; the first state indicates that the helmet is worn successfully; the face data is the face information of the wearer. Specifically, in the embodiment of the present invention, the image acquisition device can be integrated or detachably arranged on the helmet, for example, it can be integrated and fixed on the brim of the helmet, so as to facilitate the collection of face data and external environment data. It is also possible to set a mounting interface on the brim part to facilitate the image acquisition device to be loaded on the helmet as needed. Wherein, when the image acquisition device is fixed on the helmet and cannot be moved, at least two fixed image acquisition devices are set, the first image acquisition device is used to collect the face data of the first area, and the second image acquisition device is used to collect the environment data of the second area. In another preferred embodiment, when the image acquisition device is fixed on the helmet but can be rotated, the image acquisition device is used to collect the face data of the first area and the environment data of the second area by rotating at different angles and orientations. In another preferred embodiment, when the image acquisition device is detachably mounted on the safety helmet, the image acquisition device can be installed at different angles and orientations to collect image data at different angles and orientations. In a specific embodiment of the present invention, when the status information of the safety helmet is in the first state, that is, when the safety helmet is successfully worn, face recognition can be performed, so the face data of the first area is collected and the face recognition model is called to identify whether the collected face data is the user of the safety helmet. Through refined face recognition and judgment, the wearer of the safety helmet can be identified and confirmed, which can ensure the consistency between the user and the helmet on the one hand, and record the attendance of the operator on the other hand. In a preferred embodiment, after collecting the face data of the first area, the face data is pre-processed to meet the needs of subsequent facial feature extraction.
[0020] Step 200, extract facial features from the facial data and the image acquisition angle α based on the face recognition model, and match the facial features with user features to determine the identity of the wearer; the user features are the information of the helmet user. Specifically, after calling the face recognition module in step 100, the collected face data is passed to the face recognition module, the face recognition module extracts facial features from the acquired face data, and calls the user features of the database at the same time, matches the facial features with the user features, and determines whether the wearer is the user of the helmet through the above process. If the match is successful, that is, the face similarity reaches the similarity matching threshold, the wearer is the user of the helmet; if the match fails, the face similarity reaches the similarity not reaching the matching threshold, and it is preliminarily judged that the wearer is not the user of the helmet, so an alarm of verification failure will be issued, and the information of wearing failure will be sent to the data terminal for management personnel to handle. In a preferred embodiment, the face recognition module is configured with a face detection and recognition algorithm, which can realize the identity authentication function and ensure the consistency of the person and the helmet. The main control unit controls the image acquisition device to rotate so that it is aimed at the wearer's face to collect facial data, pre-processes the facial data and extracts facial features, compares them with user features stored in a database, and verifies the wearer's identity based on facial similarity.
[0021] Step 300, when the facial features are successfully matched with the user features, the environmental data of the second area is collected by the image acquisition device and the environmental data is compared with the preset safety threshold. Specifically, after verifying whether the wearer is the user of the helmet, the image acquisition device can perform subsequent operations, that is, record the use environment of the user of the helmet, and determine whether the use environment is safe and whether there are any abnormal conditions. At this time, the image acquisition device no longer needs to record in the first area, so it will move to the second area and collect environmental data. The second area is adjusted according to the position of the image acquisition device. For example, when the image acquisition device is located at the brim of the helmet, the image acquisition device can rotate upwards in an angle range of 0° to 90°, and can rotate downwards in an angle range of 0° to 60°. Preferably, a preset safety threshold is obtained, and the collected environmental data is periodically compared with the preset safety threshold to confirm whether the environmental data exceeds the preset safety threshold.
[0022] Step 400: When the environmental data is greater than the preset safety threshold, the safety helmet will sound an alarm.
[0023] The helmet-integrated face recognition model implemented in the present invention uses the image acquisition device on the helmet to collect the wearer's facial information, which not only eliminates the need for additional facial recognition equipment, but also ensures the consistency of the person and the helmet. It can also accurately locate the user's position, facilitate personnel dispatch, and quickly confirm the user's identity during rescue, further improving the safety management level of the construction site. At the same time, it can also monitor the surrounding environment. This highly integrated design not only ensures the lightness of the helmet, but also improves the functionality of the helmet and reduces the production and maintenance costs of the helmet.
[0024] The data collection method for the smart helmet described in the specific embodiment of the present invention preferably includes: The current position information is obtained and it is determined whether the current position information is located in the first area; the current position information represents the position information of the image acquisition device that can currently acquire images. Specifically, since the position of the image acquisition device affects whether the facial information can be correctly acquired, before acquiring the facial information, it is necessary to first determine whether the position information of the image acquisition device that can currently acquire images is located in the first area.
[0025] When the current position information exceeds the first area, the image acquisition device is controlled to rotate so that the current position information is located in the first area. When the current position information is not in the first area, the image acquisition device needs to be controlled to rotate θ degrees to a suitable position so that the current position information is located in the first area, which means that the image acquisition device can capture images in the first area. The first area refers to the area where face data can be captured.
[0026] The data collection method for the smart helmet described in the specific embodiment of the present invention is preferably, when the current location information is within the first area, the method further includes: Acquire the angle of the current position information, and send the image acquisition angle α to the face recognition model, so that the face recognition model acquires the user features corresponding to the angle based on the angle. Specifically, since there may be multiple angles in the first area, the face data acquired at different angles will be different. Therefore, the embodiment of the present invention needs to perform tilt angle face data recognition according to the angle of the current position information to improve the accuracy of face recognition. In a preferred embodiment, user features at different angles are stored in the database, and user features at corresponding angles are acquired according to the acquired angle to achieve accurate recognition of face data. Since face images at different angles have different feature expressions, the specific embodiment of the present invention will input the shooting angle as a variable into the face recognition model during face recognition, so that the model can better understand the image information. The face recognition algorithm and the helmet structure are fully combined to improve the adaptability and accuracy of the face recognition model.
[0027] The data collection method of the smart helmet described in the specific embodiment of the present invention preferably includes: The image acquisition device is controlled to rotate by the built-in servo in the helmet; wherein the servo uses a PWM signal to control the rotation of the image acquisition device. Specifically, a servo is embedded in the front end of the helmet, the control circuit of the servo is connected to the main control unit of the helmet, the servo is fixed on the brim of the helmet, and the image acquisition device is fixed on the rotor of the servo. This mechanical structure allows the image acquisition device to rotate by controlling the servo. Preferably, the parameters of the servo include the rotation range, the operating voltage, and the pulse width. The main control unit is responsible for sending a pulse width modulation PWM (Pulse Width Modulation, PWM) signal to control the rotation of the servo. The viewing angle of the image acquisition device can not only be switched according to the preset scene angle, but also supports remote control. The server sends a control instruction to the main control chip of the helmet, and the chip will promptly respond to the received remote instruction to adjust the servo angle, thereby driving the image acquisition device to rotate to the specified position, thereby realizing remote image acquisition under different viewing angles. A schematic diagram of a servo controlling the image acquisition device to rotate to acquire an image in a specific embodiment of the present invention is shown in FIG. Figure 2 shown.
[0028] The data collection method of the smart helmet described in the specific embodiment of the present invention preferably further includes: When the state information is in the second state, the image acquisition device is moved to the closed area of the helmet; the second state indicates that the helmet is not worn successfully. Specifically, when the helmet is not worn successfully, that is, the image acquisition device is in an idle state, the image acquisition device is stored horizontally downward in the brim of the helmet to protect the lens from dust and dirt.
[0029] The data collection method of the smart helmet described in the specific embodiment of the present invention preferably further includes: The output value and output time of the vibration sensor of the helmet are obtained. The vibration sensor is used to obtain data on the movement of the helmet. When the helmet is moved, the output value of the vibration sensor changes, and the output time is timed according to the time the helmet moves. Some traditional helmets use optical sensors, such as infrared sensors, which will be mistaken for being worn regardless of whether the helmet is blocked by the head or other obstacles; some use temperature sensors, which can also be false or misjudged. Therefore, the specific embodiment of the present invention uses a vibration sensor for judgment to avoid the above misjudgment.
[0030] When the output value is greater than the vibration threshold and the output cycle is greater than the cycle threshold, the state information is in the first state. That is, when the output value of the vibration sensor exceeds the vibration threshold and the moving time exceeds the cycle threshold, it means that the helmet changes from the idle state to the wearing state.
[0031] and / or receiving remote control commands or obtaining short-term changes in ambient light; When the remote control command is to adjust the state information to the second state or the short-term change of the ambient light is greater than the light threshold, the state information is in the second state. When the remote control command indicates to adjust the state information to the second state or the short-term change of the ambient light is greater than the light threshold, it indicates that the helmet is in an idle state, and the state information is in the second state.
[0032] The data collection method of the smart helmet described in the specific embodiment of the present invention preferably further includes: Performing liveness determination on the facial area based on the facial data; When the face data is judged to be alive, the state information is the first state. Specifically, in order to improve the reliability of wearing detection, the specific embodiment of the present invention also performs liveness judgment on the face data. Only when the face data is judged to be alive, the state information at this time can be considered to be the first state to avoid misjudgment or falsification.
[0033] In a specific embodiment, when a valid facial image is detected and the facial image changes within a short period of time t, the face data can be considered alive. The specific detection method includes: obtaining face data at least twice within a time period t; obtaining a face area in the face data, and the face area includes at least one of the following: eyes, mouth, and face illumination. That is, when one of the three variables of eyes, mouth, or face illumination changes, the face data is judged to be alive.
[0034] The data collection method of the smart helmet described in the specific embodiment of the present invention preferably further includes: When the facial features fail to match the user features, a failure prompt message is generated and / or a re-match is performed; specifically, when face recognition fails due to an incorrect wearing method or the wearer of the helmet is not a helmet user, a failure prompt message is generated and / or a re-match is performed.
[0035] The failure prompt information is sent to the background management end, and the status information is modified to the second status.
[0036] The data collection method for the smart helmet described in the specific embodiment of the present invention is preferably, when the facial features are successfully matched with the user features, the method further includes: The timing starts from the moment of successful matching; When the timing reaches the time threshold th, the status information of the helmet is obtained again. Specifically, after the verification is successful, the identity recognition confirmation will be periodically performed from the moment of successful matching, and the activity information of the operator will be recorded throughout the process to ensure that the operator wears the same helmet as the person during the construction process, and the attendance of the operator will be recorded. The process of identity recognition confirmation is consistent with the above-mentioned solution of the embodiment of the present invention, so it will not be repeated here.
[0037] The specific embodiment of the present invention also provides a data acquisition system for an intelligent helmet, such as Figure 3 As shown, the system comprises: The acquisition unit 301 is used to acquire the state information of the helmet. When the state information is in the first state, the face data of the first area is acquired by the image acquisition device and the face recognition model is called; the first state indicates that the helmet is worn successfully; the face data is the face information of the wearer; The feature matching unit 302 is used to extract facial features from the facial data based on the facial recognition model, and match the facial features with user features to determine the identity of the wearer; the user features are information about the helmet user. Specifically, the facial recognition model is based on the PyTorch framework and uses the ArcFace algorithm to implement tilted angle face recognition. In a preferred embodiment, the facial recognition model uses facial key point detection technology to pre-process the collected facial data, aligns the face by estimating and correcting the position of facial key points, and reduces the impact of posture changes. In a preferred embodiment, when training the facial recognition model, a training data set containing tilted angle face images is used in the training stage to effectively improve the model's accuracy in recognizing tilted faces.
[0038] The security monitoring unit 303 is used to collect environmental data of the second area through an image acquisition device and compare the environmental data with a preset security threshold when the facial features match the user features successfully; The alarm unit 304 is used to alarm the helmet when the environmental data is greater than the preset safety threshold.
[0039] The data acquisition system of the smart helmet described in the specific embodiment of the present invention is preferably further provided with: a servo, which is embedded in the helmet and used to control the rotation of the image acquisition device; wherein the servo uses a PWM signal to control the rotation of the image acquisition device; the image acquisition device can rotate upwards in the range of 0° to 90°, and can rotate downwards in the range of 0° to 60°. Specifically, a servo is added to the front end of the helmet, the control circuit of the servo is connected to the helmet main control unit, the servo is fixed on the brim of the helmet, and the image acquisition device is fixed on the servo rotor. This mechanical structure allows the image acquisition device to rotate by controlling the servo. Preferably, the parameters of the servo include the rotation range, the working voltage, and the pulse width. The main control unit is responsible for sending a pulse width modulation PWM (Pulse Width Modulation, PWM) signal to control the rotation of the servo. The viewing angle of the image acquisition device can not only be switched according to the preset scene angle, but also supports remote control. The server sends control instructions to the main control chip of the helmet. The chip will respond to the received remote instructions in a timely manner to adjust the angle of the servo, thereby driving the image acquisition device to rotate to the specified position, realizing remote image acquisition from different perspectives.
[0040] In a preferred embodiment, the intelligent helmet body is as follows Figure 4 As shown, it also includes: a cap body 1, a steering gear 2, an image acquisition device 3 in the first state, an image acquisition device 4 in the second state, a wire 5 for connecting the steering gear and the main board, a battery 6, a main board 7 and a function button 8. Among them, the steering gear 2 and the image acquisition device 3 are installed at the front end of the cap body 1, the steering gear 2 is connected to the main board 7 through the wire 5, the main board 7 and the battery 6 are located at the rear end of the helmet, and the user can operate the helmet through the function buttons 8 on the left and right sides of the cap body. The main body of the helmet is made of high-strength material, and the internal shockproof structure can effectively protect the electronic equipment. The image acquisition device installed on the brim of the helmet is a miniature wide-angle camera with wide-angle shooting capability. When idle, the camera will be stored in the brim of the helmet to prevent dust, dirt and bumps. The steering gear used adopts highly miniaturized components and compact mechanical design, which meets the needs of lightweight applications while taking into account power consumption. The camera is connected to the steering gear, and the camera posture can be adjusted through the control module of the steering gear to adapt to the needs of different viewing angles in different scenarios. In addition, the wireless communication module carried supports multiple communication methods such as 4G / 5G and Wi-Fi.
[0041] In a preferred embodiment, the user can use the buttons on both sides of the smart helmet to trigger the image acquisition device's photo and video recording functions. The administrator can remotely control the camera through the workbench to view, take photos or record videos in real time. The image data on the smart helmet end can be transmitted to the remote end as needed for the administrator to view and analyze. Specifically, the image acquisition device in the brim of the helmet is based on WebRTC technology, which realizes the audio and video call function between the user and the background. The audio and video transmission of the helmet is point-to-point (P2P) and does not need to be transferred through the server, thereby reducing communication delays.
[0042] In another preferred embodiment, storage space for the image acquisition device is added inside the brim of the helmet, and the servo and the image acquisition device are embedded in the front brim of the helmet. When the image acquisition device is in an idle state, the lens is stored horizontally downward in the brim to protect the lens from dust and dirt.
[0043] In a preferred embodiment, the system of the present invention also includes a central monitoring platform to collect data uploaded by all safety helmets, perform big data analysis, and provide decision support for safety management, such as operation efficiency analysis, safety training effectiveness evaluation, etc.
[0044] A specific embodiment of the present invention further provides a computer-readable storage medium, wherein the computer-readable storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the steps of any of the methods described above.
[0045] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.
[0046] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0047] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0048] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable device. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0049] The foregoing description of specific exemplary embodiments of the present invention is for the purpose of illustration and demonstration. These descriptions are not intended to limit the present invention to the precise form disclosed, and it is clear that many changes and variations can be made based on the above teachings. The purpose of selecting and describing the exemplary embodiments is to explain the specific principles of the present invention and its practical application, so that those skilled in the art can realize and utilize various different exemplary embodiments of the present invention and various different selections and changes. The scope of the present invention is intended to be limited by the claims and their equivalents.
Claims
1. A data collection method for a smart helmet, characterized in that: The method comprises: Acquire status information of the helmet, and when the status information is a first state, collect face data of a first area through an image acquisition device and call a face recognition model; the first state indicates that the helmet is worn successfully; the face data is face information of the wearer; Extracting facial features based on the face recognition model according to the face data and the image acquisition angle α, and matching the facial features with user features to determine the identity of the wearer; the user features are information about the helmet user; When the facial features are successfully matched with the user features, environmental data of the second area is collected by an image acquisition device and the environmental data is compared with a preset security threshold; When the environmental data is greater than the preset safety threshold, the safety helmet will sound an alarm.
2. The data collection method of the smart helmet according to claim 1, characterized in that: Before collecting face data of the first area and calling the face recognition model, the method includes: Acquire current location information and determine whether the current location information is located in the first area; the current location information represents location information where the image acquisition device can currently acquire images; When the current position information exceeds the first area, the image acquisition device is controlled to rotate by θ degrees so that the current position information is located within the first area.
3. The data collection method of the smart helmet according to claim 2 is characterized in that: When the current location information is within the first area, the method further includes: The angle of the current position information is obtained, and the image acquisition angle α is sent to the face recognition model, so that the face recognition model obtains user features corresponding to the angle based on the angle.
4. The data collection method of the smart helmet according to claim 1, characterized in that: The method further comprises: When the state information is in the second state, the image acquisition device is moved into the closed area of the safety helmet; the second state indicates that the safety helmet is not worn successfully.
5. The data collection method of the smart helmet according to claim 4 is characterized in that: The method further comprises: Obtaining the output value and output time of the vibration sensor of the safety helmet; When the output value is greater than the vibration threshold and the output period is greater than the period threshold, the state information is the first state; and / or receiving remote control commands or obtaining short-term changes in ambient light; When the remote control command is to adjust the state information to the second state or the short-term change of the ambient light is greater than the light threshold, the state information is in the second state.
6. The data collection method of the smart helmet according to claim 5, characterized in that: The method further comprises: Performing liveness determination on the facial area based on the facial data; When it is determined that the face data is alive, the state information is the first state.
7. The data collection method of the smart helmet according to claim 4, characterized in that: The method further comprises: When the facial features fail to match the user features, generating a failure prompt message and / or performing a rematch; The failure prompt information is sent to the background management end, and the status information is modified to the second status.
8. The data collection method of the smart helmet according to claim 1, characterized in that: When the facial features match the user features successfully, the method further includes: The timing starts from the moment when the matching is successful; When the timing reaches the time threshold, the status information of the helmet is obtained again.
9. A data collection system for a smart helmet, characterized in that: The system comprises: an acquisition unit, configured to acquire status information of the helmet, and when the status information is in a first state, collect face data of a first area through an image acquisition device and call a face recognition model; the first state indicates that the helmet is worn successfully; the face data is face information of the wearer; A feature matching unit, configured to extract facial features from the face data based on the face recognition model, and match the facial features with user features to determine the identity of the wearer; the user features are information about the helmet user; a security monitoring unit, configured to collect environmental data of a second area through an image acquisition device and compare the environmental data with a preset security threshold when the facial features successfully match the user features; The alarm unit is used to alarm the safety helmet when the environmental data is greater than the preset safety threshold.
10. The data acquisition system of the smart helmet according to claim 9, characterized in that: The system also includes: a servo, which is embedded in the helmet and is used to control the rotation of the image acquisition device; wherein the servo uses a PWM signal to control the rotation of the image acquisition device; the image acquisition device can rotate upward in an angle range of 0° to 90°, and can rotate downward in an angle range of 0° to 60°.
Citation Information
Patent Citations
Safety helmet, safety system and personnel management method
CN109938439A
Safety warning method and device based on safety helmet, and storage medium
CN110443976A
Safety monitoring system based on intelligent safety helmet
CN111493441A
Intelligent safety helmet detection method and system
CN114121282A
Intelligent monitoring device with camera
CN221239310U
Cited By
Intelligent identification method and device based on construction site safety model, equipment and medium
CN119624736A
An intelligent identification method, device, equipment and medium based on construction site safety model
CN119624736B
Intelligent safety helmet multi-dimensional data acquisition method and system based on visual identification
CN121259745A
A Multidimensional Data Acquisition Method and System for Smart Safety Helmets Based on Visual Recognition
CN121259745B
