Method and device for determining operation result of operation object and storage medium

Abstract

The invention discloses a method and a device for determining an operation result of an operation object and a storage medium. The method comprises the following steps: acquiring an initial acquisition image acquired by acquisition equipment; determining a target position of the operation object based on the initial acquisition image; based on the target position, a motion image of the work object is collected, and the motion image is used for indicating motion behaviors executed by the work object in the process of wearing the safety equipment; based on the motion image, an operation result of the operation object is determined, and the operation result is used for indicating that the motion behavior of the operation object is successfully matched with a standard motion behavior corresponding to the safety equipment or is failed in matching; and outputting an operation result. The technical problem that whether the operation of wearing the safety equipment by the operation object is standard or not cannot be determined is solved.

Description

Technical Field

[0001] The present invention relates to the field of aerial work safety monitoring and photography technology, and in particular to a method, device and storage medium for determining an operation result of an operation object. Background Art

[0002] At present, in high-altitude operations, operators face extremely high safety risks. Once an accident occurs, it often causes serious injuries or even life-threatening. Therefore, ensuring the safety of operators is of vital importance.

[0003] In the related technologies, the monitoring of high-altitude workers mainly relies on fixed-position cameras or manual observation, which has problems such as limited monitoring range and difficulty in accurately tracking the dynamics of workers in real time. At the same time, traditional shooting methods cannot achieve stable and clear shooting when high-altitude workers move quickly or in complex environments, and it is difficult to meet the needs of safety monitoring and recording. Therefore, there is a technical problem that it is impossible to determine whether the operation of the safety equipment worn by the working object is standard.

[0004] With respect to the above-mentioned technical problem of being unable to determine whether the operation of the safety equipment worn by the working object is in compliance with the standard, no effective solution has been proposed so far. Summary of the invention

[0005] The embodiments of the present invention provide a method, an apparatus and a storage medium for determining the operation result of a working object, so as to at least solve the technical problem that it is impossible to determine whether the operation of the safety equipment worn by the working object is standard.

[0006] According to one aspect of an embodiment of the present invention, a method for determining an operation result of an operating object is provided. The method may include: acquiring an initial acquisition image acquired by an acquisition device; determining a target position of the operating object based on the initial acquisition image; acquiring a motion image of the operating object based on the target position, wherein the motion image is used to indicate the motion behavior performed by the operating object in the process of wearing a safety device; determining an operation result of the operating object based on the motion image, wherein the operation result is used to indicate whether the motion behavior of the operating object successfully matches or fails to match the standard motion behavior corresponding to the safety device; and outputting the operation result.

[0007] Optionally, based on the initial collected image, determining the target position of the working object includes: inputting the initial collected image into a detection model for analysis to obtain the target position of the working object.

[0008] Optionally, based on the target position, a motion image of the working object is captured, including: obtaining environmental information of the working object, wherein the environmental information is used to indicate the lighting and / or weather environment in which the working object is located; based on the environmental information and the target position, determining adjustment parameters, wherein the adjustment parameters are used to indicate parameters for adjusting a capture range of a capture device; based on the adjustment parameters, adjusting the capture device; and based on the adjusted capture device, capturing a motion image of the working object.

[0009] Optionally, based on the motion image, determining the operation result of the operation object includes: matching the motion image with the standard image to obtain a matching value, wherein the matching value is used to indicate the degree of matching between the motion behavior of the operation object and the standard behavior; and determining the operation result based on the matching value.

[0010] Optionally, determining the operation result based on the matching value includes: in response to the matching value being greater than the matching threshold, determining the operation result is a successful match; in response to the matching value being less than or equal to the matching threshold, determining the operation result is a failed match.

[0011] Optionally, the method for determining the operation result of the operation object further includes: in response to the operation standard result being a matching failure, determining the safety status of the operation object; and outputting the safety status.

[0012] According to another aspect of an embodiment of the present invention, a device for determining an operation result of an operating object is also provided. The device may include: an acquisition unit, configured to acquire an initial acquisition image acquired by an acquisition device; a first determination unit, configured to determine a target position of the operating object based on the initial acquisition image; an acquisition unit, configured to acquire a motion image of the operating object based on the target position, wherein the motion image is used to indicate the motion behavior performed by the operating object in the process of wearing the safety device; a second determination unit, configured to determine an operation result of the operating object based on the motion image, wherein the operation result is used to indicate whether the motion behavior of the operating object successfully matches or fails to match the standard motion behavior corresponding to the safety device; and an output unit, configured to output the operation result.

[0013] According to another aspect of an embodiment of the present invention, a computer-readable storage medium is also provided, the computer-readable storage medium including a stored program, wherein when the program is executed by a processor, the device where the storage medium is located is controlled to execute a method for determining an operation result of a job object in an embodiment of the present invention.

[0014] According to another aspect of an embodiment of the present invention, a processor is provided, which is used to run a program, wherein when the program is run, the method for determining the operation result of the job object in the embodiment of the present invention is executed.

[0015] According to another aspect of the embodiment of the present invention, a computer program product is provided, which includes computer instructions, and when the computer instructions are executed by a processor, the method for determining the operation result of the job object in the embodiment of the present invention is implemented.

[0016] In an embodiment of the present invention, an initial acquisition image acquired by an acquisition device is obtained; based on the initial acquisition image, a target position of the operating object is determined; based on the target position, a motion image of the operating object is acquired, wherein the motion image is used to indicate the motion behavior performed by the operating object in the process of wearing the safety device; based on the motion image, an operation result of the operating object is determined, wherein the operation result is used to indicate whether the motion behavior of the operating object successfully matches or fails to match the standard motion behavior corresponding to the safety device; and the operation result is output. That is, the present invention determines the position of the operating object based on the image acquired by the acquisition device, thereby acquiring the motion image of the operating object in the process of wearing the safety device, and determining whether the operating object wears the safety device in a standard manner based on the motion image, thereby solving the technical problem of being unable to determine whether the operation of the operating object wearing the safety device is standard, and achieving the technical effect of determining whether the operation of the operating object is standard. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The drawings described herein are used to provide a further understanding of the present invention and constitute a part of this application. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the drawings:

[0018] Figure 1 is a flow chart of a method for determining an operation result of a job object according to an embodiment of the present invention;

[0019] Figure 2 is a flow chart of a method for intelligent standardized detection of aerial work according to an embodiment of the present invention;

[0020] Figure 3 is a schematic diagram of an intelligent standardized detection system for aerial work according to an embodiment of the present invention;

[0021] Figure 4 2 is a schematic diagram of a device for determining an operation result of a job object according to an embodiment of the present invention. DETAILED DESCRIPTION

[0022] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0023] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, functional component or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, functional components or devices.

[0024] According to an embodiment of the present invention, an embodiment of a method for determining the operation result of a job object is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0025] Figure 1 is a flow chart of a method for determining an operation result of a job object according to an embodiment of the present invention. Figure 1 As shown, the method may include the following steps:

[0026] Step S101, obtaining an initial captured image captured by a capture device.

[0027] In the technical solution provided in the above step S101 of the present invention, the acquisition device may at least include a camera and a sensor.

[0028] In this embodiment, the initial acquisition image acquired by the acquisition device is obtained. For example, the initial acquisition image acquired by the camera acquisition device is only an example, and the specific method of acquiring the initial acquisition image by the acquisition device is not limited.

[0029] For example, the use of cameras and acceleration sensors should achieve synchronous data collection. At the same time point, the camera captures the image of the worker working at high altitude, and the acceleration sensor detects the acceleration change of the worker.

[0030] Step S102: determining the target position of the work object based on the initial captured image.

[0031] In the technical solution provided in the above step S102 of the present invention, the working object may also be referred to as a worker or a high-altitude worker.

[0032] In this embodiment, after the initial acquisition image acquired by the acquisition device is acquired in step S101, the target position of the working object is determined according to the initial acquisition image.

[0033] Optionally, the target position of the working object is determined by detecting the displacement and speed information of the working object and using a detection model, wherein the detection model may also be referred to as an image recognition algorithm.

[0034] For example, the acceleration sensor can provide the acceleration information of the operator in three-dimensional space, and the displacement and velocity information of the operator can be obtained by integrating the acceleration data. This information can be associated with the target position in the image to assist the camera in more accurately locating the position of the operator in the image.

[0035] For example, image recognition algorithms can quickly and accurately identify the position of workers working at high altitudes in an image, but errors may occur when workers move quickly or are blocked. In this case, acceleration data can be combined to track the target.

[0036] Step S103: capturing a moving image of the operation object based on the target position.

[0037] In the technical solution provided in the above step S103 of the present invention, the motion image is used to indicate the motion behavior performed by the operating object in the process of wearing the safety equipment.

[0038] In this embodiment, after the target position of the working object is determined in step S102, a motion image of the working object is collected according to the target position.

[0039] Optionally, the determined target position is compared with the position of the acquisition device to determine adjustment parameters, thereby adjusting the acquisition device to acquire motion images of the operating object to ensure that the operating personnel are always within the field of view of the camera.

[0040] For example, when the acceleration sensor detects that the operator has a large acceleration change in a certain direction, the operator's movement direction in the image can be predicted, so as to adjust the angle and focal length of the camera in advance to ensure that the operator is always within the camera's field of view.

[0041] Step S104: determining the operation result of the operation object based on the motion image.

[0042] In the technical solution provided in the above step S104 of the present invention, the operation result is used to indicate whether the motion behavior of the operation object successfully matches or fails to match the standard motion behavior corresponding to the safety device.

[0043] In this embodiment, a motion image of the operation object is collected in step S103, and an operation result of the operation object is determined according to the motion image.

[0044] Optionally, the captured motion image is matched with a standard motion image to determine the operation result of the operation object. If the degree of matching between the captured motion image and the standard motion image is greater than a matching threshold, it means that the captured motion image is similar to the standard motion image, that is, the operation of the operation object is consistent with the standard operation. Based on this, it can be determined that the operation result is a successful match.

[0045] Step S105, outputting the operation result.

[0046] In the technical solution provided in the above step S105 of the present invention, after the operation result of the operation object is determined in step S104, the operation result is output.

[0047] In this embodiment, the operation result can be outputted at least through a display device, a speaker device and an alarm device.

[0048] For example, when irregular behavior or safety risks of operators are detected, voice reminders are issued to the operators through audio devices such as speakers or headphones.

[0049] It should be noted that the above embodiment can be implemented by an intelligent tracking and photographing system for high-altitude work safety belt identification.

[0050] In the above steps S101 to S105 of the present invention, the initial acquisition image acquired by the acquisition device is obtained; based on the initial acquisition image, the target position of the operating object is determined; based on the target position, a motion image of the operating object is acquired, wherein the motion image is used to indicate the motion behavior performed by the operating object in the process of wearing the safety device; based on the motion image, the operation result of the operating object is determined, wherein the operation result is used to indicate whether the motion behavior of the operating object successfully matches or fails to match the standard motion behavior corresponding to the safety device; and the operation result is output. In other words, the present invention determines the position of the operating object based on the image acquired by the acquisition device, thereby acquiring the motion image of the operating object in the process of wearing the safety device, and then determining whether the operating object wears the safety device in a standard manner based on the motion image, thereby solving the technical problem of being unable to determine whether the operation of the operating object wearing the safety device is standard, and achieving the technical effect of determining whether the operation of the operating object is standard.

[0051] The above method of this embodiment is further introduced below.

[0052] As an optional implementation manner, determining the target position of the working object based on the initial collected image includes: inputting the initial collected image into the detection model for analysis to obtain the target position of the working object.

[0053] In this embodiment, the initial captured image is input into the detection model for analysis to obtain the target position of the work object. The detection model can also be called an image recognition algorithm.

[0054] For example, advanced image recognition algorithms are used to process images taken by cameras in real time to quickly and accurately identify the location of people working at high altitudes.

[0055] As an optional implementation method, based on the target position, a motion image of the working object is captured, including: obtaining environmental information of the working object, wherein the environmental information is used to indicate the lighting and / or weather environment in which the working object is located; based on the environmental information and the target position, determining adjustment parameters, wherein the adjustment parameters are used to indicate parameters for adjusting a capture range of a capture device; based on the adjustment parameters, adjusting the capture device; and based on the adjusted capture device, capturing a motion image of the working object.

[0056] In this embodiment, the environmental information of the operation object is obtained, and the adjustment parameters are determined according to the environmental information and the target position. The environmental information may at least include environmental conditions such as lighting and weather, and the adjustment parameters may at least include: camera parameters such as exposure and sensitivity.

[0057] Optionally, after the adjustment parameters are determined, the acquisition device is adjusted according to the adjustment parameters, so that the motion image of the operation object is acquired using the adjusted acquisition device.

[0058] For example, according to different lighting, weather and other environmental conditions, the camera parameters such as exposure and sensitivity are automatically adjusted to ensure that the captured images are clear and bright.

[0059] As an optional implementation method, based on the motion image, the operation result of the operation object is determined, including: matching the motion image with the standard image to obtain a matching value, wherein the matching value is used to indicate the degree of matching between the motion behavior of the operation object and the standard behavior; based on the matching value, determining the operation result.

[0060] In this embodiment, the motion image is matched with the standard image to obtain a matching value, and then the operation result is determined according to the matching value. The standard image may be a pre-stored image of a standard behavior of an operator wearing safety equipment.

[0061] Optionally, by matching the motion image with the standard image, determining whether the behavior of the operating object is standardized, the purpose of detecting the behavior of the operating object wearing safety equipment is achieved, thereby solving the technical problem of being unable to determine whether the operation of the operating object wearing safety equipment is standard, and achieving the technical effect of determining whether the operation of the operating object is standard.

[0062] As an optional implementation manner, determining the operation result based on the matching value includes: in response to the matching value being greater than the matching threshold, determining the operation result is a successful match; in response to the matching value being less than or equal to the matching threshold, determining the operation result is a failed match.

[0063] In this embodiment, when the matching value is greater than the matching threshold, it indicates that the operation subject's behavior of wearing the safety device is consistent with the standard behavior of wearing the safety device. Based on this, it can be determined that the operation result is a successful match.

[0064] Optionally, when the matching value is less than or equal to the matching threshold, it indicates that the operation object's behavior of wearing the safety device is inconsistent with the standard behavior of wearing the safety device. Based on this, it can be determined that the operation result is a matching failure.

[0065] As an optional embodiment, in response to the operation standard result being a match failure, determining the safety status of the operation object; and outputting the safety status.

[0066] In this embodiment, when the operation result is a matching failure, it means that the operator's behavior in wearing the safety equipment is not standard and there may be safety hazards. Based on this, the safety status of the operation object is determined; and the safety status is output.

[0067] For example, when irregular behavior or safety risks of operators are detected, the safety status of the operators is determined. When abnormal movement status of operators is detected, such as long-term uniform speed, sudden acceleration, falling, etc., the emergency alarm is immediately activated. Sound and light alarms, text message notifications, etc. can be used to ensure that ground monitoring personnel can receive alarm information in time.

[0068] It should be noted that the above embodiment can be implemented by an intelligent tracking and photographing system for high-altitude work safety belt identification.

[0069] In this embodiment, an initial acquisition image acquired by an acquisition device is obtained; based on the initial acquisition image, the target position of the operating object is determined; based on the target position, a motion image of the operating object is acquired, wherein the motion image is used to indicate the motion behavior performed by the operating object in the process of wearing the safety device; based on the motion image, an operation result of the operating object is determined, wherein the operation result is used to indicate whether the motion behavior of the operating object successfully matches or fails to match the standard motion behavior corresponding to the safety device; and the operation result is output. That is, the present invention determines the position of the operating object based on the image acquired by the acquisition device, thereby acquiring the motion image of the operating object in the process of wearing the safety device, and then determining whether the operating object wears the safety device in a standard manner based on the motion image, thereby solving the technical problem of being unable to determine whether the operation of the operating object wearing the safety device is standard, and achieving the technical effect of determining whether the operation of the operating object is standard.

[0070] The technical solution of the embodiment of the present invention is illustrated below in conjunction with preferred implementation modes.

[0071] At present, in high-altitude operations, operators face extremely high safety risks. Once an accident occurs, it often causes serious injuries or even life-threatening. Therefore, ensuring the safety of operators is of vital importance.

[0072] In the related art, the monitoring of workers at heights mainly relies on fixed-position cameras or manual observation, which has problems such as limited monitoring range and difficulty in accurately tracking the dynamics of workers in real time. At the same time, traditional shooting methods cannot achieve stable and clear shooting when workers at heights move quickly or in complex environments, and it is difficult to meet the needs of safety monitoring and recording. Therefore, there is a technical problem that it is impossible to determine whether the operation of the safety equipment worn by the working object is standard. With respect to the above-mentioned technical problem that it is impossible to determine whether the operation of the safety equipment worn by the working object is standard, no effective solution has been proposed.

[0073] However, an embodiment of the present invention proposes a method for intelligent standardized detection of aerial work. By adjusting the position of the camera, the operating behavior of the operator is obtained, the operating behavior is compared with the standard operating behavior, it is determined whether the operator operates in a standardized manner, and the result is output. This solves the technical problem of being unable to determine whether the operation of the safety equipment worn by the operating object is standard, and achieves the technical effect of determining whether the operation of the safety equipment worn by the operating object is standard.

[0074] The embodiments of the present invention are further described below.

[0075] Figure 2 : is a flow chart of a method for intelligent standardized detection of aerial work according to an embodiment of the present invention, the identification method comprises the following steps:

[0076] Step S201, collecting operator data.

[0077] In this embodiment, the camera and the acceleration sensor should realize synchronous data acquisition. At the same time node, the camera captures the image of the high-altitude worker, and the acceleration sensor detects the acceleration change of the worker. This can ensure the consistency of the image and acceleration data in time, which is convenient for subsequent analysis and processing.

[0078] Step S202: target positioning and tracking.

[0079] In this embodiment, acceleration data is used to assist in positioning the target in the image. The acceleration sensor can provide the acceleration information of the operator in three-dimensional space. By integrating the acceleration data, the displacement and velocity information of the operator can be obtained. This information can be associated with the target position in the image to assist the camera in more accurately positioning the position of the operator in the image.

[0080] Optionally, when the acceleration sensor detects that the operator has a large acceleration change in a certain direction, the movement direction of the operator in the image can be predicted, so as to adjust the angle and focal length of the camera in advance to ensure that the operator is always within the field of view of the camera.

[0081] Optionally, the image and acceleration data are combined for target tracking. The image recognition algorithm can quickly and accurately identify the position of the high-altitude worker in the image, but if the worker moves quickly or is blocked, image recognition may be inaccurate. In this case, acceleration data can be combined for target tracking.

[0082] Optionally, the acceleration sensor can provide information about the operator's motion status, such as acceleration, speed, and direction. By analyzing this information, the operator's motion trajectory can be predicted, thereby guiding the camera to track and shoot. For example, when an operator is blocked in the image, the possible position of the operator can be predicted based on the acceleration data, and then the angle and focal length of the camera can be adjusted so that the operator's image can be captured in time when the operator appears again.

[0083] Step S203: behavior analysis and safety warning.

[0084] In this embodiment, based on the behavior analysis of images and acceleration data, a more comprehensive analysis of the behavior of the operator can be performed by combining images and acceleration data. The image can provide information such as the operator's movements, postures, and positions, while the acceleration data can reflect the operator's motion state and force changes.

[0085] For example, by analyzing the operator's movements and changes in acceleration data in the image, it is possible to determine whether the operator is performing normal operations or has abnormal behaviors, such as sudden acceleration, falling, etc. At the same time, it is also possible to determine whether the operator is fatigued or operating improperly based on the amplitude and frequency of changes in acceleration data.

[0086] Optionally, a safety warning mechanism can be used. When the image and acceleration data show that the operator may be at risk, the system should issue a warning signal in a timely manner. For example, when the acceleration sensor detects that the operator's acceleration suddenly increases, and the image shows that the operator's position is close to a dangerous area, the system should immediately issue an alarm to remind the ground monitoring personnel to take emergency measures.

[0087] Optionally, safety warnings can be provided by means of sound and light alarms, text message notifications, etc., to ensure that ground monitoring personnel can receive warning information in a timely manner and take appropriate measures to ensure the safety of operating personnel.

[0088] Step S204, data storage.

[0089] In this embodiment, the images captured by the camera and the data detected by the acceleration sensor are stored synchronously for subsequent analysis and playback. The stored data may include information such as image files, acceleration data files, and timestamps, ensuring that the situation at the work site can be accurately restored during playback.

[0090] Figure 3It is a schematic diagram of an intelligent standardized detection system for aerial work according to an embodiment of the present invention. The intelligent standardized detection system 300 includes: ground monitoring equipment 301, a control device 302, a display device 303 and a storage device 304, an acceleration sensor module 305, a signal transmission module 306, an image processing and analysis module 307, an emergency alarm module 308, a remote collaboration module 309 and a voice prompt module 310.

[0091] Ground monitoring equipment 301: including high-resolution camera and pan / tilt. The high-resolution camera uses an industrial-grade camera with high resolution and high frame rate, which can capture clear images under different lighting conditions. The camera has functions such as auto focus and auto exposure to adapt to the movement of operators and environmental changes.

[0092] Optionally, the pan / tilt adopts a high-precision electric pan / tilt, which can achieve 360-degree horizontal and 180-degree vertical rotation. The pan / tilt has high control accuracy and can quickly and accurately respond to the instructions of the image processing and analysis module to adjust the angle of the camera.

[0093] Control device 302: It is composed of a high-performance microprocessor and a dedicated control chip, and is responsible for receiving and processing the acceleration sensor signal transmitted by the signal transmission module and the image data captured by the camera. The control device runs advanced image processing algorithms and data analysis software to achieve tracking and focusing of the operator.

[0094] Display device 303: used to display the images captured by the camera and various parameter information in real time, so that the ground monitoring personnel can observe the status of the workers. A large-screen display or a multi-screen splicing display system can be used to improve the display effect.

[0095] Storage device 304: stores the captured images and acceleration data for later analysis and playback. The storage device can be a hard disk array, solid state hard disk, etc. to ensure data security and reliability.

[0096] Acceleration sensor module 305: A high-precision, low-power MEMS acceleration sensor is used to accurately detect the slight acceleration changes of the operator in three-dimensional space. The sensor communicates with the signal transmission module through wireless methods such as Bluetooth or Wi-Fi.

[0097] Optionally, the sensor is installed on the worker's helmet, safety belt or work clothes to ensure that it will not be disturbed or damaged during the operation. At the same time, in order to improve the accuracy of detection, multiple sensors can be installed at different locations to comprehensively judge the worker's motion state through data fusion algorithm.

[0098] Signal transmission module 306: Establish a stable wireless communication network to ensure that the signal of the acceleration sensor can be transmitted to the ground monitoring equipment in real time and accurately. Low-power, long-distance wireless communication technologies such as ZigBee and LoRa can be used to adapt to the complexity of the high-altitude working environment.

[0099] Optionally, the transmitted signal is encrypted to prevent the signal from being stolen or interfered with. Advanced encryption algorithms such as AES encryption are used to ensure data security.

[0100] Image processing and analysis module 307: uses advanced image recognition algorithms, such as target detection algorithms based on deep learning, to process images taken by the camera in real time and quickly and accurately identify the location of aerial workers.

[0101] Optionally, the camera parameters are automatically adjusted under different environmental conditions such as lighting and weather. For example, the exposure is reduced in strong light and the sensitivity is increased in low light conditions to ensure that the captured image is clear and bright.

[0102] Optionally, conduct in-depth analysis of the photos and videos taken to evaluate the operating standards of the operators, safety risks, etc., and generate a corresponding analysis report.

[0103] Emergency alarm module 308: When the acceleration sensor detects abnormal motion state, such as sudden acceleration, falling, etc., the system will immediately send out an alarm signal to notify ground personnel to take emergency measures to improve the emergency response speed.

[0104] Optionally, the emergency alarm module 308 can use sound and light alarms, text message notifications, etc. to ensure that ground monitoring personnel can receive alarm information in a timely manner.

[0105] Remote collaboration module 309: The system supports remote collaboration, and ground monitoring personnel can communicate with aerial workers in real time through voice or text. When encountering complex situations, ground professionals can remotely guide operators to operate, improving work efficiency and safety.

[0106] Optionally, the remote collaboration module 309 can use communication devices such as walkie-talkies and mobile phones to achieve real-time communication between ground monitoring personnel and aerial workers.

[0107] Voice prompt module 310: A voice prompt function is set in the ground monitoring equipment. When irregular behavior or safety risks of operators are detected, the system can use voice to remind the operators to correct them in time.

[0108] Optionally, the voice prompt module 310 may use devices such as speakers or headphones to ensure that the operator can clearly hear the prompt information.

[0109] In this embodiment, a suitable acceleration sensor is selected and securely mounted on the helmet, safety belt or work clothes of the height operator, ensuring that the sensor will not be disturbed or damaged during the operation, while taking into account the comfort and safety of the operator.

[0110] Optionally, install a high-resolution camera and a pan / tilt head at a suitable location on the ground. According to the size and shape of the aerial work area, reasonably adjust the angle and position of the camera to ensure that the entire work area can be covered. The pan / tilt head should be installed on a stable base to ensure stability when adjusting the angle.

[0111] Optionally, install control devices, display devices, and storage devices. Place these devices in a location that is convenient for ground monitoring personnel to operate and observe, and connect power and communication lines.

[0112] Optionally, a signal transmission network is established. Low-power, long-distance wireless communication technologies such as ZigBee and LoRa are used to ensure that the signals of the acceleration sensor can be stably and in real time transmitted to the ground monitoring equipment. At the same time, the transmitted signals are encrypted to ensure data security.

[0113] Optionally, the acceleration sensor detects the movement state of the operator in real time and transmits the signal to the signal transmission module wirelessly.

[0114] Optionally, the signal transmission module transmits the received acceleration sensor signal to a control device of the ground monitoring equipment.

[0115] Optionally, the control device receives the acceleration sensor signal and the image data captured by the camera, and transmits the image data to the image processing and analysis module.

[0116] Optionally, the image processing and analysis module uses advanced image recognition algorithms to process the images captured by the camera in real time, quickly and accurately identifying the position of the aerial workers. At the same time, according to different lighting, weather and other environmental conditions, the camera parameters such as exposure and sensitivity are automatically adjusted to ensure that the captured images are clear and bright.

[0117] Optionally, the photos and videos taken are analyzed to evaluate the operator's operational compliance, safety risks, etc. If irregular behavior or safety risks are found, an alarm is generated in a timely manner and the ground monitoring personnel are notified.

[0118] Optionally, the sensors of the environmental monitoring module monitor the parameters of the aerial working environment in real time and transmit the data to the control device. The ground monitoring personnel can evaluate the safety of the operation according to the environmental parameters and take corresponding measures.

[0119] Optionally, the control device generates corresponding instructions based on the results of the image processing and analysis module and the environmental monitoring module and sends them to the pan / tilt and camera. The pan / tilt adjusts the angle quickly and accurately according to the instructions so that the camera is always aimed at the operator. The camera adjusts the focus parameters according to the instructions to ensure that the captured image is clear.

[0120] Optionally, the control device transmits the processed image data to a display device for real-time display, so that ground monitoring personnel can observe the status of the operator. At the same time, the image data and acceleration data are stored in a storage device for later analysis and playback.

[0121] Optionally, when irregular behavior or safety risks of operators are detected, the voice prompt module sends voice reminders to the operators through devices such as speakers or headphones.

[0122] Optionally, in the emergency alarm process, when the acceleration sensor or video recognition detects an abnormal motion state, such as long-term constant speed, sudden acceleration, falling, etc., the signal is immediately transmitted to the signal transmission module.

[0123] Optionally, the signal transmission module transmits the alarm signal to a control device of the ground monitoring equipment.

[0124] Optionally, after receiving the alarm signal, the control device immediately activates the emergency alarm module. The alarm module can use sound and light alarms, SMS notifications, etc. to ensure that ground monitoring personnel can receive the alarm information in time.

[0125] Optionally, after receiving the alarm information, the ground monitoring personnel should immediately take emergency measures, such as notifying rescue personnel, activating emergency plans, etc.

[0126] In this embodiment, the intelligent standardized detection system for aerial work can automatically adjust the parameters of the camera according to different environmental conditions such as lighting and weather to ensure that clear images can be captured in various environments. For example, the exposure is automatically adjusted under strong light and the image brightness is enhanced under low light conditions.

[0127] Optionally, emergency alarm function: when the acceleration sensor detects abnormal motion state, such as sudden acceleration, falling, etc., the system will immediately send out an alarm signal to notify ground personnel to take emergency measures and improve the emergency response speed.

[0128] Optionally, multi-camera collaborative tracking: multiple ground cameras work together to achieve all-round tracking and shooting of high-altitude workers through shooting at different angles and image fusion technology. Even if the worker is blocked by obstacles, the position of the worker can be accurately determined through image information from other cameras.

[0129] Optionally, energy-saving mode: Considering that aerial work may last for a long time, the system sets energy-saving mode to extend the use time of the equipment. When the operator is stationary or less active, the camera's resolution and frame rate are automatically reduced to reduce data transmission and processing, and reduce energy consumption. When the operator starts to move or has important operations, the system quickly returns to normal working state to ensure the quality and real-time performance of the shooting.

[0130] Optionally, self-cleaning camera: To ensure that the camera can maintain clear shooting effects in various environments, a self-cleaning camera is set. Special materials or coatings can be used to prevent dust, rain, etc. from adhering to the lens. At the same time, the camera is cleaned regularly through vibration or airflow to ensure image quality.

[0131] Optionally, data encryption and secure transmission: Encrypt the captured images and sensor data to ensure the security of the data during transmission. Use advanced encryption algorithms and security protocols to prevent data from being stolen or tampered with. Only authorized personnel can access and view this data, protecting the privacy and security of aerial work.

[0132] Optionally, voice prompt function: when irregular behavior or safety risks of operators are detected, timely voice reminders are used to remind operators to correct them, thereby enhancing the safety awareness of operators.

[0133] In this embodiment, the operating behavior of the operator is obtained by adjusting the position of the camera, and the operating behavior is compared with the standard operating behavior to determine whether the operator operates in a standardized manner and output the result. This solves the technical problem of being unable to determine whether the operation of the safety equipment worn by the operating object is standard, and achieves the technical effect of determining whether the operation of the safety equipment worn by the operating object is standard.

[0134] According to an embodiment of the present invention, a device for determining an operation result of a job object is also provided. It should be noted that the device for determining an operation result of a job object can be used to execute the method for determining an operation result of a job object in the method embodiment.

[0135] Figure 4 2 is a schematic diagram of a device for determining an operation result of a job object according to an embodiment of the present invention. Figure 4 As shown, the device 400 for determining the operation result of the operation object may include: an acquisition unit 401 , a first determination unit 402 , a collection unit 403 , a second determination unit 404 and an output unit 405 .

[0136] The acquisition unit 401 is used to acquire an initial acquisition image acquired by an acquisition device.

[0137] The first determining unit 402 is used to determine the target position of the working object based on the initial collected image.

[0138] The acquisition unit 403 is used to acquire a motion image of the operating object based on the target position, wherein the motion image is used to indicate the motion behavior performed by the operating object in the process of wearing the safety equipment.

[0139] The second determining unit 404 is used to determine the operation result of the operation object based on the motion image, wherein the operation result is used to indicate whether the motion behavior of the operation object successfully matches or fails to match the standard motion behavior corresponding to the safety device.

[0140] The output unit 405 is used to output the operation result.

[0141] Optionally, the first determination unit 402 may include: an analysis module, configured to input the initial collected image into the detection model for analysis to obtain the target position of the work object.

[0142] Optionally, the acquisition unit 403 may include: an acquisition module, used to acquire environmental information of the working object, wherein the environmental information is used to indicate the lighting and / or weather environment in which the working object is located; a first determination module, used to determine adjustment parameters based on the environmental information and the target position, wherein the adjustment parameters are used to indicate parameters for adjusting the acquisition range of the acquisition device; an adjustment module, used to adjust the acquisition device based on the adjustment parameters; and an acquisition module, used to acquire motion images of the working object based on the adjusted acquisition device.

[0143] Optionally, the second determination unit 404 further includes: a matching module, used to match the motion image with the standard image to obtain a matching value, wherein the matching value is used to indicate the degree of matching between the motion behavior of the work object and the standard behavior; and a second determination module, used to determine the operation result based on the matching value.

[0144] Optionally, the second determination module may include: a first determination submodule, used to determine that the operation result is a successful match in response to the matching value being greater than the matching threshold; and a second determination submodule, used to determine that the operation result is a failed match in response to the matching value being less than or equal to the matching threshold.

[0145] Optionally, the device 400 for determining the operation result of the operation object may further include: a third determination unit for determining the safety status of the operation object in response to the operation standard result being a matching failure; and a first output unit for outputting the safety status.

[0146] In this embodiment, an initial acquisition image acquired by an acquisition device is obtained; based on the initial acquisition image, the target position of the operating object is determined; based on the target position, a motion image of the operating object is acquired, wherein the motion image is used to indicate the motion behavior performed by the operating object in the process of wearing the safety device; based on the motion image, an operation result of the operating object is determined, wherein the operation result is used to indicate whether the motion behavior of the operating object successfully matches or fails to match the standard motion behavior corresponding to the safety device; and the operation result is output. That is, the present invention determines the position of the operating object based on the image acquired by the acquisition device, thereby acquiring the motion image of the operating object in the process of wearing the safety device, and then determining whether the operating object wears the safety device in a standard manner based on the motion image, thereby solving the technical problem of being unable to determine whether the operation of the operating object wearing the safety device is standard, and achieving the technical effect of determining whether the operation of the operating object is standard.

[0147] According to an embodiment of the present invention, there is further provided a computer-readable storage medium, the storage medium comprising a stored program, wherein the program executes the method for determining the operation result of the job object in the method embodiment.

[0148] According to an embodiment of the present invention, a processor is further provided. The processor is used to run a program, wherein when the program is run, the method for determining the operation result of the job object in the method embodiment is executed.

[0149] According to an embodiment of the present invention, a computer program product is further provided. The computer program product includes computer instructions. When the computer instructions are executed by a processor, the method for determining the operation result of the job object in the method embodiment is implemented.

[0150] The serial numbers of the above embodiments of the present invention are only for description and do not represent the advantages or disadvantages of the embodiments.

[0151] In the above embodiments of the present invention, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0152] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of units can be a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0153] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed over multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0154] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0155] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent functional component, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software functional component, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, server or network device, etc.) to perform all or part of the steps of the methods of each embodiment of the present invention. The aforementioned storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, disk or optical disk, etc., which can store program codes.

[0156] The above are only preferred embodiments of the present invention. It should be pointed out that, for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.

Claims

1. A method for determining an operation result of an operation object, characterized in that: include: Acquire an initial acquisition image acquired by an acquisition device; Based on the initial collected image, determining a target position of the work object; Based on the target position, collecting a motion image of the working object, wherein the motion image is used to indicate a motion behavior performed by the working object in the process of wearing the safety equipment; Based on the motion image, determining an operation result of the operation object, wherein the operation result is used to indicate whether the motion behavior of the operation object successfully matches or fails to match the standard motion behavior corresponding to the safety device; The operation result is output.

2. The method according to claim 1, characterized in that Determining a target position of the work object based on the initial collected image includes: The initial collected image is input into the detection model for analysis to obtain the target position of the work object.

3. The method according to claim 1, characterized in that Based on the target position, collecting a motion image of the operation object includes: Acquiring environmental information of the operation object, wherein the environmental information is used to indicate the lighting and / or weather environment in which the operation object is located; Based on the environmental information and the target location, determining an adjustment parameter, wherein the adjustment parameter is used to indicate a parameter for adjusting a collection range of the collection device; Based on the adjustment parameters, adjusting the acquisition device; Based on the adjusted acquisition device, the motion image of the operation object is acquired.

4. The method according to claim 1, characterized in that: Determining an operation result of the operation object based on the motion image includes: Matching the motion image with a standard image to obtain a matching value, wherein the matching value is used to indicate the matching degree between the motion behavior of the operation object and the standard behavior; Based on the matching value, the operation result is determined.

5. The method according to any one of claim 4, characterized in that Determining the operation result based on the matching value includes: In response to the matching value being greater than a matching threshold, determining that the operation result is a successful match; In response to the matching value being less than or equal to the matching threshold, determining that the operation result is a matching failure.

6. The method according to any one of claims 1 to 5, characterized in that: The method further comprises: In response to the operation standard result being the matching failure, determining a safety status of the operation object; The safe state is output.

7. A device for determining an operation result of an operation object, characterized in that: include: An acquisition unit, used to acquire an initial acquisition image acquired by an acquisition device; A first determining unit, configured to determine a target position of the working object based on the initial collected image; A collection unit, configured to collect a motion image of the working object based on the target position, wherein the motion image is used to indicate a motion behavior performed by the working object in the process of wearing the safety equipment; A second determining unit, configured to determine an operation result of the operation object based on the motion image, wherein the operation result is used to indicate whether the motion behavior of the operation object successfully matches or fails to match a standard motion behavior corresponding to the safety device; An output unit is used to output the operation result.

8. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes a stored program, wherein when the program is executed by a processor, the device where the storage medium is located is controlled to execute the method according to any one of claims 1 to 6.

9. A processor, characterized in that: The processor is used to run a program, wherein the program executes the method according to any one of claims 1 to 6 when running.

10. A computer program product, characterized in that The computer program product comprises computer instructions, which implement the method according to any one of claims 1 to 6 when executed by a processor.

Images