Method and apparatus for determining operation result of operation object, and storage medium
By acquiring images and motion information of objects working at heights, it is possible to determine whether their operation while wearing safety equipment is up to standard, thus solving the problem of not being able to determine whether the operation is standardized in high-altitude operations and achieving the effect of safety monitoring and recording.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- ZHANJIANG POWER SUPPLY BUREAU OF GUANGDONG POWER GRID CO LTD
- Filing Date
- 2025-03-05
- Publication Date
- 2026-05-15
AI Technical Summary
In high-altitude operations, it is impossible to determine in real time whether the work object is wearing safety equipment in accordance with regulations, and existing monitoring methods cannot meet the needs of safety monitoring and recording.
By acquiring initial images, the target position of the work object is determined, motion images are acquired and matched with standard images, the operation result of the work object is judged, and the operation result is output.
It enables accurate judgment of whether the work personnel are wearing safety equipment and operating in a standardized manner, ensuring the safety of the workers and providing real-time safety monitoring and recording.
Smart Images
Figure CN2025080683_15052026_PF_FP_ABST
Abstract
Description
Methods, apparatus and storage media for determining the operation results of the work object
[0001] This application claims priority to Chinese Patent Application No. 202411585227.7, filed on November 7, 2024, entitled "Method, Apparatus and Storage Medium for Determining the Operation Result of an Operation Object", the entire contents of which are incorporated herein by reference. Technical Field
[0002] This application relates to the field of high-altitude operation safety monitoring and photography technology, and more specifically, to a method, device and storage medium for determining the operation result of an object. Background Technology
[0003] Currently, workers operating at heights face extremely high safety risks; accidents can often result in serious injuries or even death. Therefore, ensuring the safety of workers is of paramount importance.
[0004] In related technologies, monitoring of workers at height primarily relies on fixed-position cameras or manual observation, which suffers from limited monitoring range and difficulty in accurately tracking worker movements in real time. Furthermore, traditional filming methods cannot achieve stable and clear footage when workers are moving rapidly or in complex environments, failing to meet the needs of safety monitoring and recording. Therefore, there is a technical problem in determining whether the worker is wearing safety equipment correctly.
[0005] There is currently no effective solution to the technical problem of not being able to determine whether the operator is wearing safety equipment according to standard operating procedures. Summary of the Invention
[0006] This application provides a method, apparatus, and storage medium for determining the operation result of a work object, so as to at least solve the technical problem of not being able to determine whether the operation of the work object wearing safety equipment is standard.
[0007] According to one aspect of the embodiments of this application, a method for determining the operation result of a work object is provided. The method may include: acquiring an initial acquisition image captured by a data acquisition device; determining the target position of the work object based on the initial acquisition image; acquiring a motion image of the work object based on the target position, wherein the motion image is used to indicate the movement behavior performed by the work object while wearing safety equipment; determining the operation result of the work object based on the motion image, wherein the operation result is used to indicate whether the movement behavior of the work object successfully matches or fails to match the standard movement behavior corresponding to the safety equipment; and outputting the operation result.
[0008] Optionally, determining the target location of the work object based on the initially acquired image includes: inputting the initially acquired image into the detection model for analysis to obtain the target location of the work object.
[0009] Optionally, based on the target location, acquiring motion images of the work object includes: obtaining environmental information of the work object, wherein the environmental information is used to indicate the lighting and / or weather conditions of the work object; determining adjustment parameters based on the environmental information and the target location, wherein the adjustment parameters are used to indicate parameters for adjusting the acquisition range of the acquisition device; adjusting the acquisition device based on the adjustment parameters; and acquiring motion images of the work object based on the adjusted acquisition device.
[0010] Optionally, determining the operation result of the task object based on the motion image includes: matching the motion image with a standard image to obtain a matching value, wherein the matching value is used to indicate the degree of matching between the motion behavior of the task object and the standard behavior; and determining the operation result based on the matching value.
[0011] Optionally, the operation result is determined based on the matching value, including: determining the operation result as a successful match in response to the matching value being greater than the matching threshold; and determining the operation result as a failed match in response to the matching value being less than or equal to the matching threshold.
[0012] Optionally, the method for determining the operation result of the work object further includes: determining the safety status of the work object in response to the operation standard result being a matching failure; and outputting the safety status.
[0013] According to another aspect of the embodiments of this application, an apparatus for determining the operation result of a work object is also provided. The apparatus may include: an acquisition unit for acquiring an initial acquisition image acquired by an acquisition device; a first determination unit for determining the target position of the work object based on the initial acquisition image; an acquisition unit for acquiring a motion image of the work object based on the target position, wherein the motion image is used to indicate the movement behavior performed by the work object while wearing safety equipment; a second determination unit for determining the operation result of the work object based on the motion image, wherein the operation result is used to indicate whether the movement behavior of the work object successfully matches or fails to match the standard movement behavior corresponding to the safety equipment; and an output unit for outputting the operation result.
[0014] According to another aspect of the embodiments of this application, a computer-readable storage medium is also provided, the computer-readable storage medium including a stored program, wherein, when the program is run by a processor, it controls the device where the storage medium is located to execute the method for determining the operation result of the job object in the embodiments of this application.
[0015] According to another aspect of the embodiments of this application, a processor is also provided. This processor is used to run a program, wherein the program, when running, executes the method for determining the operation result of the job object in the embodiments of this application.
[0016] According to another aspect of the embodiments of this application, a computer program product is also provided. The program product includes computer instructions that, when executed by a processor, implement the method for determining the operation result of a job object in the embodiments of this application.
[0017] In this embodiment, an initial image acquired by a data acquisition device is obtained; based on the initial image, the target position of the work object is determined; based on the target position, a motion image of the work object is acquired, wherein the motion image is used to indicate the movement behavior performed by the work object during the wearing of the safety equipment; based on the motion image, the operation result of the work object is determined, wherein the operation result is used to indicate whether the movement behavior of the work object successfully matches or fails to match the standard movement behavior corresponding to the safety equipment; and the operation result is output. In other words, this application determines the position of the work object based on the image acquired by the data acquisition device, thereby acquiring motion images of the work object during the wearing of the safety equipment, and thus determining whether the work object's wearing of the safety equipment is standard based on the motion images. This solves the technical problem of being unable to determine whether the work object's operation of wearing the safety equipment is standard, and achieves the technical effect of determining whether the work object's operation is standard. Attached Figure Description
[0018] The accompanying drawings, which are included to provide a further understanding of this application and form part of this application, illustrate exemplary embodiments and are used to explain this application, but do not constitute an undue limitation of this application. In the drawings:
[0019] Figure 1 is a flowchart of a method for determining the operation result of a job object according to an embodiment of this application;
[0020] Figure 2 is a flowchart of a method for intelligent standardized detection of high-altitude operations according to an embodiment of this application;
[0021] Figure 3 is a schematic diagram of an intelligent standardized detection system for high-altitude operations according to an embodiment of this application;
[0022] Figure 4 is a schematic diagram of a device for determining the operation result of a work object according to an embodiment of this application. Detailed Implementation
[0023] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort should fall within the scope of protection of the present application.
[0024] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, functional component, or device that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, functional components, or devices.
[0025] According to an embodiment of this application, an embodiment of a method for determining the operation result of a job object is provided. It should be noted that the steps shown in the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions. Furthermore, although a logical order is shown in the flowchart, in some cases, the steps shown or described may be executed in a different order than that shown here.
[0026] Figure 1 is a flowchart of a method for determining the operation result of a job object according to an embodiment of this application. As shown in Figure 1, the method may include the following steps:
[0027] Step S101: Obtain the initial image acquired by the acquisition device.
[0028] In the technical solution provided by step S101 of this application, the acquisition device may include at least a camera and a sensor.
[0029] In this embodiment, an initial image acquired by the acquisition device is obtained. For example, the initial image acquired by the acquisition device is captured by a camera. This is merely an example and does not limit the specific method by which the acquisition device acquires the initial image.
[0030] For example, using a camera and an accelerometer should enable synchronized data acquisition. At the same time point, the camera captures an image of the worker at height, while the accelerometer detects changes in the worker's acceleration.
[0031] Step S102: Based on the initial acquired image, determine the target location of the work object.
[0032] In the technical solution provided in step S102 of this application, the work object can also be referred to as the worker or the high-altitude worker.
[0033] In this embodiment, after obtaining the initial acquisition image acquired by the acquisition device in step S101, the target location of the work object is determined based on the initial acquisition image.
[0034] Optionally, the target position of the work object can be determined by detecting its displacement and velocity information and using a detection model. The detection model can also be referred to as an image recognition algorithm.
[0035] For example, an accelerometer can provide acceleration information of a worker in three-dimensional space. By integrating the acceleration data, the worker's displacement and velocity information can be obtained. This information can be correlated with the target location in the image, helping the camera to more accurately locate the worker's position in the image.
[0036] For another example, image recognition algorithms can quickly and accurately identify the location of workers at height in an image, but errors may occur when the workers are moving rapidly or are obscured. In such cases, acceleration data can be used to track the target.
[0037] Step S103: Based on the target location, acquire motion images of the work object.
[0038] In the technical solution provided by step S103 of this application, the motion image is used to indicate the motion behavior performed by the work object while wearing safety equipment.
[0039] In this embodiment, after determining the target location of the work object in step S102, motion images of the work object are acquired based on the target location.
[0040] Optionally, the determined target location is compared with the location of the acquisition device to determine adjustment parameters, thereby adjusting the acquisition device to acquire motion images of the work object and ensure that the worker is always within the camera's field of view.
[0041] For example, when an accelerometer detects a significant change in acceleration of a worker in a certain direction, it can predict the worker's direction of movement in the image, thereby adjusting the camera's angle and focus in advance to ensure that the worker remains within the camera's field of view.
[0042] Step S104: Determine the operation result of the task object based on the motion image.
[0043] In the technical solution provided in step S104 of this application, the operation result is used to indicate whether the movement behavior of the work object is successfully matched or not matched with the standard movement behavior corresponding to the safety equipment.
[0044] In this embodiment, in step S103, a motion image of the work object is acquired, and the operation result of the work object is determined based on the motion image.
[0045] Optionally, the acquired motion image is matched with a standard motion image to determine the operation result of the task object. If the degree of matching between the acquired motion image and the standard motion image is greater than the matching threshold, it means that the acquired motion image is similar to the standard motion image. That is, the operation of the task object is consistent with the standard operation. Based on this, the operation result can be determined as a successful match.
[0046] Step S105: Output the operation result.
[0047] In the technical solution provided in step S105 of this application, after determining the operation result of the work object in step S104, the operation result is output.
[0048] In this embodiment, the operation results can be output through at least a display device, a speaker device, and an alarm device.
[0049] For example, when non-standard behavior or safety risks are detected among workers, voice reminders can be issued to the workers through loudspeakers or headphones.
[0050] It should be noted that the above embodiments can be implemented using an intelligent tracking and photography system for identifying safety belts used in high-altitude operations.
[0051] In steps S101 to S105 of this application, an initial image acquired by the acquisition device is obtained; based on the initial image, the target position of the work object is determined; based on the target position, a motion image of the work object is acquired, wherein the motion image is used to indicate the movement behavior performed by the work object during the wearing of the safety equipment; based on the motion image, the operation result of the work object is determined, wherein the operation result is used to indicate whether the movement behavior of the work object matches the standard movement behavior corresponding to the safety equipment successfully or fails to match; and the operation result is output. In other words, this application determines the position of the work object based on the image acquired by the acquisition device, thereby acquiring a motion image of the work object during the wearing of the safety equipment, and thus determining whether the work object is wearing the safety equipment correctly based on the motion image. This solves the technical problem of being unable to determine whether the operation of the work object wearing the safety equipment is standard, and achieves the technical effect of determining whether the operation of the work object is standard.
[0052] The method described in this embodiment will be further described below.
[0053] As an optional implementation method, determining the target location of the work object based on the initially acquired image includes: inputting the initially acquired image into a detection model for analysis to obtain the target location of the work object.
[0054] In this embodiment, the initially acquired image is input into the detection model for analysis to obtain the target location of the work object. The detection model can also be referred to as an image recognition algorithm.
[0055] For example, advanced image recognition algorithms are used to process images captured by cameras in real time, quickly and accurately identifying the location of workers at heights.
[0056] As an optional embodiment, acquiring motion images of the work object based on the target location includes: obtaining environmental information of the work object, wherein the environmental information is used to indicate the lighting and / or weather conditions of the work object; determining adjustment parameters based on the environmental information and the target location, wherein the adjustment parameters are used to indicate parameters for adjusting the acquisition range of the acquisition device; adjusting the acquisition device based on the adjustment parameters; and acquiring motion images of the work object based on the adjusted acquisition device.
[0057] In this embodiment, environmental information of the work object is acquired, and adjustment parameters are determined based on the environmental information and the target location. The environmental information may include at least lighting conditions and weather, and the adjustment parameters may include at least camera parameters such as exposure and ISO.
[0058] Optionally, after determining the adjustment parameters, the acquisition device is adjusted according to the adjustment parameters, so as to acquire motion images of the work object using the adjusted acquisition device.
[0059] For example, the camera parameters, such as exposure and sensitivity, are automatically adjusted according to different lighting and weather conditions to ensure that the captured images are clear and bright.
[0060] As an optional embodiment, determining the operation result of a task object based on a motion image includes: matching the motion image with a standard image to obtain a matching value, wherein the matching value is used to indicate the degree of matching between the motion behavior of the task object and the standard behavior; and determining the operation result based on the matching value.
[0061] In this embodiment, the motion image is matched with a standard image to obtain a matching value, and the operation result is determined based on the matching value. The standard image can be a pre-stored image of a worker wearing safety equipment in accordance with standard procedures.
[0062] Optionally, by matching motion images with standard images, it is determined whether the behavior of the work object is standardized, thus achieving the purpose of detecting the behavior of the work object wearing safety equipment. This solves the technical problem of not being able to determine whether the operation of the work object wearing safety equipment is standardized, and realizes the technical effect of determining whether the operation of the work object is standardized.
[0063] As an optional implementation method, determining the operation result based on the matching value includes: determining the operation result as a successful match in response to the matching value being greater than the matching threshold; and determining the operation result as a failed match in response to the matching value being less than or equal to the matching threshold.
[0064] In this embodiment, when the matching value is greater than the matching threshold, it indicates that the behavior of the work object wearing safety equipment is consistent with the behavior of wearing safety equipment in accordance with regulations. Based on this, the operation result can be determined as a successful match.
[0065] Optionally, when the matching value is less than or equal to the matching threshold, it indicates that the behavior of the work object wearing safety equipment is inconsistent with the behavior of wearing safety equipment in accordance with regulations. Based on this, the operation result can be determined as a matching failure.
[0066] As an optional implementation, in response to an operational standard result indicating a match failure, the safety status of the work object is determined; the safety status is then output.
[0067] In this embodiment, when the operation result is a matching failure, it indicates that the operator's behavior of wearing safety equipment is not standard and may pose a safety hazard. Based on this, the safety status of the work object is determined and the safety status is output.
[0068] For example, when non-standard behavior or safety risks of workers are detected, the safety status of workers is determined. When abnormal movement of workers is detected, such as prolonged constant speed, sudden acceleration, or falling, an emergency alarm is immediately activated. This can be done through audible and visual alarms, SMS notifications, or other means to ensure that ground monitoring personnel receive the alarm information in a timely manner.
[0069] It should be noted that the above embodiments can be implemented using an intelligent tracking and photography system for identifying safety belts used in high-altitude operations.
[0070] In this embodiment, an initial image acquired by a data acquisition device is obtained; based on the initial image, the target position of the work object is determined; based on the target position, a motion image of the work object is acquired, wherein the motion image is used to indicate the movement behavior performed by the work object during the wearing of the safety equipment; based on the motion image, the operation result of the work object is determined, wherein the operation result is used to indicate whether the movement behavior of the work object successfully matches or fails to match the standard movement behavior corresponding to the safety equipment; and the operation result is output. In other words, this application determines the position of the work object based on the image acquired by the data acquisition device, thereby acquiring motion images of the work object during the wearing of the safety equipment, and thus determining whether the work object's wearing of the safety equipment is standard based on the motion images. This solves the technical problem of being unable to determine whether the work object's operation of wearing the safety equipment is standard, and achieves the technical effect of determining whether the work object's operation is standard.
[0071] The technical solutions of the embodiments of this application will be illustrated below with reference to preferred embodiments.
[0072] Currently, workers operating at heights face extremely high safety risks; accidents can often result in serious injuries or even death. Therefore, ensuring the safety of workers is of paramount importance.
[0073] In related technologies, monitoring of workers at height primarily relies on fixed-position cameras or manual observation, which suffers from limited monitoring range and difficulty in accurately tracking worker movements in real time. Furthermore, traditional filming methods cannot achieve stable and clear footage when workers are moving rapidly or in complex environments, failing to meet the needs of safety monitoring and recording. Therefore, there is a technical problem of not being able to determine whether the worker is wearing safety equipment correctly. Currently, no effective solution has been proposed to address this technical problem of not being able to determine whether the worker is wearing safety equipment correctly.
[0074] However, this application proposes a method for intelligent standardized detection of high-altitude operations. By adjusting the position of the camera to acquire the operator's operational behavior, the operational behavior is compared with standard operational behavior to determine whether the operator is operating in accordance with regulations, and the results are output. This solves the technical problem of not being able to determine whether the operator's operation of wearing safety equipment is standard, and achieves the technical effect of determining whether the operator's operation of wearing safety equipment is standard.
[0075] The embodiments of this application will be further described below.
[0076] Figure 2 is a flowchart of a method for intelligent standardized detection of high-altitude operations according to an embodiment of this application. The identification method includes the following steps:
[0077] Step S201: Collect data on the workers.
[0078] In this embodiment, the camera and accelerometer should acquire data synchronously. At the same time point, the camera captures an image of the worker at height, while the accelerometer detects changes in the worker's acceleration. This ensures temporal consistency between the image and acceleration data, facilitating subsequent analysis and processing.
[0079] Step S202, target location and tracking.
[0080] In this embodiment, acceleration data is used to assist in image target localization. An accelerometer can provide acceleration information of the worker in three-dimensional space. By integrating the acceleration data, the worker's displacement and velocity information can be obtained. This information can be correlated with the target position in the image, helping the camera to more accurately locate the worker's position within the image.
[0081] Optionally, when the accelerometer detects a large change in acceleration of the worker in a certain direction, it can predict the worker's direction of movement in the image, thereby adjusting the camera's angle and focus in advance to ensure that the worker is always within the camera's field of view.
[0082] Optionally, target tracking can be performed by combining image and acceleration data. Image recognition algorithms can quickly and accurately identify the position of workers at height in an image, but errors may occur when workers are moving rapidly or are obscured. In such cases, acceleration data can be combined for target tracking.
[0083] Optionally, an accelerometer can provide information about the worker's motion, such as acceleration, velocity, and direction. Analyzing this information can predict the worker's trajectory, thus guiding the camera to track and capture images. For example, when a worker is obscured in an image, their likely location can be predicted based on acceleration data, and the camera's angle and focus can be adjusted to capture their image promptly when they reappear.
[0084] Step S203, Behavioral Analysis and Security Early Warning.
[0085] In this embodiment, behavior analysis based on image and acceleration data allows for a more comprehensive analysis of worker behavior. Images can provide information such as worker actions, postures, and positions, while acceleration data can reflect the worker's motion state and changes in force.
[0086] For example, by analyzing changes in the movements and acceleration data of workers in images, it's possible to determine whether the workers are performing normal operations or exhibiting abnormal behavior, such as sudden acceleration or a fall. Furthermore, the magnitude and frequency of changes in acceleration data can indicate whether the workers are fatigued or operating improperly.
[0087] Optionally, a safety early warning mechanism should be implemented, whereby the system should promptly issue a warning signal when image and acceleration data indicate a potential safety risk to the worker. For example, if the accelerometer detects a sudden increase in the worker's acceleration and the image shows the worker's location approaching a danger zone, the system should immediately issue an alarm to alert ground monitoring personnel to take emergency measures.
[0088] Optionally, safety warnings can be implemented using audible and visual alarms, SMS notifications, or other methods to ensure that ground monitoring personnel receive warning information in a timely manner and take appropriate measures to protect the safety of workers.
[0089] Step S204, data storage.
[0090] In this embodiment, images captured by the camera and data detected by the accelerometer are stored synchronously for subsequent analysis and playback. The stored data may include image files, acceleration data files, and timestamps, ensuring that the situation at the work site can be accurately reconstructed during playback.
[0091] Figure 3 is a schematic diagram of an intelligent standardized detection system for high-altitude operations according to an embodiment of this application. The intelligent standardized detection system 300 includes: ground monitoring equipment 301, control device 302, display device 303 and storage device 304, acceleration sensor module 305, signal transmission module 306, image processing and analysis module 307, emergency alarm module 308, remote collaboration module 309 and voice prompt module 310.
[0092] Ground monitoring equipment 301: includes a high-resolution camera and a pan-tilt unit. The high-resolution camera is an industrial-grade camera with high resolution and high frame rate, capable of capturing clear images under different lighting conditions. The camera has functions such as autofocus and automatic exposure to adapt to the movement of operators and changes in the environment.
[0093] Optionally, the pan-tilt unit is a high-precision motorized pan-tilt unit, capable of rotating 360 degrees horizontally and 180 degrees vertically. The pan-tilt unit offers high control precision, enabling it to quickly and accurately respond to commands from the image processing and analysis module and adjust the camera angle.
[0094] Control device 302: Composed of a high-performance microprocessor and a dedicated control chip, it is responsible for receiving and processing acceleration sensor signals from the signal transmission module and image data captured by the camera. The control device runs advanced image processing algorithms and data analysis software to achieve tracking and focusing of the operator for shooting.
[0095] Display device 303: Used to display images captured by the camera and various parameter information in real time, facilitating ground monitoring personnel to observe the status of workers. A large-screen monitor or a multi-screen splicing display system can be used to improve the display effect.
[0096] Storage device 304: Stores captured images and acceleration data for later analysis and playback. Storage devices can include hard disk arrays, solid-state drives, etc., to ensure data security and reliability.
[0097] Accelerometer sensor module 305: Utilizing a high-precision, low-power MEMS accelerometer sensor, it accurately detects minute acceleration changes of the operator in three-dimensional space. The sensor communicates with the signal transmission module wirelessly via Bluetooth or Wi-Fi.
[0098] Optionally, the sensors are mounted on the worker's safety helmet, safety belt, or work clothes to ensure they are not interfered with or damaged during operation. Furthermore, to improve detection accuracy, multiple sensors can be installed at different locations, and a data fusion algorithm can be used to comprehensively determine the worker's movement status.
[0099] Signal transmission module 306: Establishes a stable wireless communication network to ensure that the accelerometer signal can be transmitted to the ground monitoring equipment in real time and accurately. Low-power, long-range wireless communication technologies such as ZigBee and LoRa can be used to adapt to the complexity of high-altitude working environments.
[0100] Optionally, the transmitted signal can be encrypted to prevent it from being stolen or interfered with. Advanced encryption algorithms, such as AES encryption, are employed to ensure data security.
[0101] Image processing and analysis module 307: Employs advanced image recognition algorithms, such as deep learning-based target detection algorithms, to process images captured by the camera in real time and quickly and accurately identify the location of personnel working at heights.
[0102] Optionally, the camera parameters can be automatically adjusted under different lighting and weather conditions. For example, the exposure can be reduced in strong light and the sensitivity can be increased in low light conditions to ensure that the captured images are clear and bright.
[0103] Optionally, the photos and videos taken can be analyzed in depth to assess the operators' compliance with operating procedures, safety risks, etc., and generate corresponding analysis reports.
[0104] Emergency alarm module 308: When the accelerometer detects abnormal motion, such as sudden acceleration or falling, the system will immediately issue an alarm signal to notify ground personnel to take emergency measures and improve the speed of emergency response.
[0105] Optionally, the emergency alarm module 308 can use audible and visual alarms, SMS notifications, or other methods to ensure that ground monitoring personnel can receive alarm information in a timely manner.
[0106] Remote Collaboration Module 309: The system supports remote collaboration, allowing ground monitoring personnel to communicate with high-altitude workers in real time via voice or text. In complex situations, ground professionals can remotely guide workers, improving work efficiency and safety.
[0107] Optionally, the remote collaboration module 309 can use communication devices such as walkie-talkies and mobile phones to enable real-time communication between ground monitoring personnel and high-altitude workers.
[0108] Voice prompt module 310: Set up a voice prompt function in the ground monitoring equipment. When non-standard behavior or safety risks of the operators are detected, the system can remind the operators to correct them in time through voice.
[0109] Optionally, the voice prompt module 310 can use a speaker or headphones to ensure that the operator can hear the prompt information clearly.
[0110] In this embodiment, a suitable accelerometer is selected and securely mounted on the worker's helmet, safety harness, or work clothes. It is crucial to ensure the sensor is not interfered with or damaged during operation, while also considering the worker's comfort and safety.
[0111] Optionally, a high-resolution camera and pan-tilt unit can be installed at a suitable location on the ground. The angle and position of the camera should be adjusted according to the size and shape of the work area to ensure coverage of the entire area. The pan-tilt unit should be mounted on a stable base to ensure stability when adjusting the angle.
[0112] Optionally, control devices, display equipment, and storage devices may be installed. These devices should be placed in locations easily accessible for operation and observation by ground monitoring personnel, and connected to power and communication lines.
[0113] Optionally, a signal transmission network can be established. Low-power, long-range wireless communication technologies such as ZigBee and LoRa can be used to ensure that the accelerometer signal can be stably and in real-time transmitted to the ground monitoring equipment. Simultaneously, the transmitted signal is encrypted to ensure data security.
[0114] Optionally, the accelerometer detects the movement of the operator in real time and transmits the signal wirelessly to the signal transmission module.
[0115] Optionally, the signal transmission module transmits the received acceleration sensor signal to the control device of the ground monitoring equipment.
[0116] Optionally, the control device receives acceleration sensor signals and image data captured by a camera, and transmits the image data to the image processing and analysis module.
[0117] Optionally, the image processing and analysis module employs advanced image recognition algorithms to process images captured by the camera in real time, quickly and accurately identifying the location of personnel working at heights. Simultaneously, it automatically adjusts camera parameters, such as exposure and ISO, based on varying lighting and weather conditions to ensure clear and bright images.
[0118] Optionally, the captured photos and videos can be analyzed to assess the operational compliance of workers and safety risks. If any non-compliant behavior or safety risks are detected, an alarm can be generated promptly and ground monitoring personnel can be notified.
[0119] Optionally, the environmental monitoring module's sensors monitor parameters of the high-altitude working environment in real time and transmit the data to the control device. Ground monitoring personnel can assess the safety of the operation based on the environmental parameters and take appropriate measures.
[0120] Optionally, the control device generates corresponding instructions based on the results from the image processing and analysis module and the environmental monitoring module, and sends them to the pan-tilt unit and camera. The pan-tilt unit quickly and accurately adjusts its angle according to the instructions, ensuring the camera is always pointed at the operator. The camera adjusts its focus parameters according to the instructions to ensure clear images are captured.
[0121] Optionally, the control device transmits the processed image data to a display device for real-time display, facilitating ground monitoring personnel to observe the status of the workers. Simultaneously, the image data and acceleration data are stored in a storage device for later analysis and playback.
[0122] Optionally, when non-standard behavior or safety risks are detected by the operator, the voice prompt module can issue a voice reminder to the operator through a speaker or headphones.
[0123] Optionally, in the emergency alarm process, when the accelerometer or video sensor detects an abnormal motion state, such as a long period of constant speed, sudden acceleration, or a fall, the signal is immediately transmitted to the signal transmission module.
[0124] Optionally, the signal transmission module transmits the alarm signal to the control device of the ground monitoring equipment.
[0125] Optionally, upon receiving an alarm signal, the control device immediately activates the emergency alarm module. The alarm module can employ audible and visual alarms, SMS notifications, or other methods to ensure that ground monitoring personnel receive alarm information promptly.
[0126] Optionally, upon receiving an alarm message, ground monitoring personnel should immediately take emergency measures, such as notifying rescue personnel or activating emergency response plans.
[0127] In this embodiment, the intelligent standardized detection system for high-altitude operations can automatically adjust the camera parameters according to different environmental conditions such as lighting and weather, ensuring that clear images can be captured in various environments. For example, it automatically adjusts the exposure in strong light and enhances image brightness in low light conditions.
[0128] Optionally, an emergency alarm function: when the accelerometer detects abnormal motion, such as sudden acceleration or falling, the system will immediately issue an alarm signal to notify ground personnel to take emergency measures and improve the speed of emergency response.
[0129] Optionally, multi-camera collaborative tracking: Multiple ground cameras work together, using different angles of shooting and image fusion technology to achieve all-around tracking and filming of personnel working at heights. Even when personnel are obstructed by obstacles, their location can be accurately determined using image information from other cameras.
[0130] Optionally, an energy-saving mode is available: Considering that high-altitude operations may last for extended periods, the system is equipped with an energy-saving mode to extend equipment lifespan. When the operator is stationary or has minimal movement, the camera's resolution and frame rate are automatically reduced to decrease data transmission and processing, thus lowering energy consumption. When the operator begins to move or performs important tasks, the system quickly returns to normal operating conditions, ensuring image quality and real-time performance.
[0131] Optionally, a self-cleaning camera: To ensure clear shooting in various environments, a self-cleaning camera is installed. Special materials or coatings can be used to prevent dust, rain, etc., from adhering to the lens. Simultaneously, the camera is cleaned regularly through vibration or airflow to maintain image quality.
[0132] Optionally, data encryption and secure transmission: The captured images and sensor data are encrypted to ensure data security during transmission. Advanced encryption algorithms and security protocols are employed to prevent data theft or tampering. Only authorized personnel can access and view this data, protecting the privacy and safety of high-altitude operations.
[0133] Optionally, a voice prompt function can be provided: when non-standard behavior or safety risks are detected by operators, the voice prompts can be used to remind operators to correct their behavior in a timely manner, thereby enhancing their safety awareness.
[0134] In this embodiment, the operator's actions are acquired by adjusting the position of the camera, and the actions are compared with standard actions to determine whether the operator is operating in accordance with regulations. The results are then output, which solves the technical problem of not being able to determine whether the operator is wearing safety equipment in accordance with regulations. This achieves the technical effect of determining whether the operator is wearing safety equipment in accordance with regulations.
[0135] According to an embodiment of this application, an apparatus for determining the operation result of a task object is also provided. It should be noted that this apparatus for determining the operation result of a task object can be used to execute the method for determining the operation result of a task object in the method embodiment.
[0136] Figure 4 is a schematic diagram of an apparatus for determining the operation result of a task object according to an embodiment of this application. As shown in Figure 4, the apparatus 400 for determining the operation result of the task object may include: an acquisition unit 401, a first determination unit 402, a collection unit 403, a second determination unit 404, and an output unit 405.
[0137] The acquisition unit 401 is used to acquire the initial acquisition image acquired by the acquisition device.
[0138] The first determining unit 402 is used to determine the target location of the work object based on the initial acquired image.
[0139] The acquisition unit 403 is used to acquire motion images of the work object based on the target location, wherein the motion images are used to indicate the motion behavior performed by the work object while wearing safety equipment.
[0140] The second determining unit 404 is used to determine the operation result of the work object based on the motion image, wherein the operation result is used to indicate whether the motion behavior of the work object matches the standard motion behavior corresponding to the safety device successfully or fails to match.
[0141] Output unit 405 is used to output the operation result.
[0142] Optionally, the first determining unit 402 may include: an analysis module, used to input the initially acquired image into the detection model for analysis to obtain the target location of the work object.
[0143] Optionally, the acquisition unit 403 may include: an acquisition module for acquiring environmental information of the work object, wherein the environmental information is used to indicate the lighting and / or weather environment of the work object; a first determination module for determining adjustment parameters based on the environmental information and the target location, wherein the adjustment parameters are used to indicate parameters for adjusting the acquisition range of the acquisition device; an adjustment module for adjusting the acquisition device based on the adjustment parameters; and an acquisition module for acquiring motion images of the work object based on the adjusted acquisition device.
[0144] Optionally, the second determining unit 404 further includes: a matching module, used to match the motion image with the standard image to obtain a matching value, wherein the matching value is used to indicate the degree of matching between the motion behavior of the work object and the standard behavior; and a second determining module, used to determine the operation result based on the matching value.
[0145] Optionally, the second determining module may include: a first determining submodule, used to determine the operation result as a successful match in response to a matching value being greater than a matching threshold; and a second determining submodule, used to determine the operation result as a failed match in response to a matching value being less than or equal to a matching threshold.
[0146] Optionally, the device 400 for determining the operation result of the work object may further include: a third determining unit, used to determine the safety status of the work object in response to the operation standard result being a matching failure; and a first output unit, used to output the safety status.
[0147] In this embodiment, an initial image acquired by a data acquisition device is obtained; based on the initial image, the target position of the work object is determined; based on the target position, a motion image of the work object is acquired, wherein the motion image is used to indicate the movement behavior performed by the work object during the wearing of the safety equipment; based on the motion image, the operation result of the work object is determined, wherein the operation result is used to indicate whether the movement behavior of the work object successfully matches or fails to match the standard movement behavior corresponding to the safety equipment; and the operation result is output. In other words, this application determines the position of the work object based on the image acquired by the data acquisition device, thereby acquiring motion images of the work object during the wearing of the safety equipment, and thus determining whether the work object's wearing of the safety equipment is standard based on the motion images. This solves the technical problem of being unable to determine whether the work object's operation of wearing the safety equipment is standard, and achieves the technical effect of determining whether the work object's operation is standard.
[0148] According to an embodiment of this application, a computer-readable storage medium is also provided, the storage medium including a stored program, wherein the program execution method embodiment includes a method for determining the operation result of a job object.
[0149] According to an embodiment of this application, a processor is also provided for running a program, wherein the program executes a method for determining the operation result of a job object in a method embodiment.
[0150] According to an embodiment of this application, a computer program product is also provided, which includes computer instructions that, when executed by a processor, implement the method for determining the operation result of a job object in the method embodiment.
[0151] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.
[0152] In the above embodiments of this application, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.
[0153] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. The device embodiments described above are merely illustrative; for example, the division of units can be a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the displayed or discussed mutual couplings, direct couplings, or communication connections may be through some interfaces; indirect couplings or communication connections between units or modules may be electrical or other forms.
[0154] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0155] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.
[0156] If an integrated unit is implemented as a software functional unit and sold or used as an independent functional component, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software functional component. This computer software functional component is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as a USB flash drive, read-only memory (ROM), random access memory (RAM), portable hard disk, magnetic disk, or optical disk.
[0157] The above are merely preferred embodiments of this application. It should be noted that those skilled in the art can make various improvements and modifications without departing from the principles of this application, and these improvements and modifications should also be considered within the scope of protection of this application.
Claims
1. A method for determining the operation result of a work object, characterized in that, include: Acquire the initial image captured by the acquisition device; Based on the initial acquired image, the target location of the work object is determined; Based on the target location, motion images of the work object are acquired, wherein the motion images are used to indicate the movement behaviors performed by the work object while wearing safety equipment; Based on the motion image, the operation result of the work object is determined, wherein the operation result is used to indicate whether the motion behavior of the work object matches the standard motion behavior corresponding to the safety device successfully or fails to match. Output the results of the operation.
2. The method according to claim 1, characterized in that, Based on the initial acquired image, the target location of the work object is determined, including: The initial acquired image is input into the detection model for analysis to obtain the target location of the work object.
3. The method according to claim 1, characterized in that, Based on the target location, acquire motion images of the work object, including: Obtain environmental information of the work object, wherein the environmental information is used to indicate the lighting and / or weather conditions of the work object; Based on the environmental information and the target location, adjustment parameters are determined, wherein the adjustment parameters are used to indicate the parameters for adjusting the acquisition range of the acquisition device; Adjust the acquisition device based on the adjustment parameters; Based on the adjusted acquisition device, the motion image of the work object is acquired.
4. The method according to claim 1, characterized in that, Based on the motion image, the operation result of the task object is determined, including: The motion image is matched with a standard image to obtain a matching value, wherein the matching value is used to indicate the degree of matching between the motion behavior of the work object and the standard behavior; The result of the operation is determined based on the matching value.
5. The method according to any one of claims 4, characterized in that, Determining the operation result based on the matching value includes: In response to the matching value being greater than the matching threshold, the operation result is determined to be a successful match; In response to the matching value being less than or equal to the matching threshold, the operation result is determined to be a matching failure.
6. The method according to any one of claims 1-5, characterized in that, The method further includes: In response to the operational standard result indicating a matching failure, the safety status of the work object is determined; Output the aforementioned safety status.
7. A device for determining the operation result of a work object, characterized in that, include: The acquisition unit is used to acquire the initial image captured by the acquisition device; The first determining unit is used to determine the target location of the work object based on the initial acquired image; The acquisition unit is used to acquire motion images of the work object based on the target location, wherein the motion images are used to indicate the movement behaviors performed by the work object while wearing safety equipment; The second determining unit is used to determine the operation result of the work object based on the motion image, wherein the operation result is used to indicate whether the motion behavior of the work object matches the standard motion behavior corresponding to the safety device successfully or fails to match. The output unit is used to output the operation result.
8. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored program, wherein when the program is run by a processor, it controls the device in which the storage medium is located to perform the method of any one of claims 1 to 6.
9. A processor, characterized in that, The processor is used to run a program, wherein the program executes the method according to any one of claims 1 to 6 when it runs.
10. A computer program product, characterized in that, The computer program product includes computer instructions that, when executed by a processor, implement the method described in any one of claims 1 to 6.