High-place operation hazard source identification method and system based on movable device

Abstract

The invention provides a high-place operation hazard source identification method and system based on a mobile device, and the method comprises the steps: collecting and identifying a high-place operation region image, and determining the personnel characteristics and protection equipment characteristics of a high-place operation region; the method comprises the following steps: acquiring and identifying a dynamic image of personnel in a high-place operation area based on personnel characteristics to obtain change information and motion path information of protection equipment on the personnel so as to determine abnormal event occurrence characteristics of the protection equipment in the high-place operation process of the personnel; and on the basis of the motion path information and the protection equipment characteristics, the protection equipment abnormal event generation characteristics of the personnel in the high-place operation process are determined, the dangerous source characteristics of the personnel in the high-place operation process are identified in combination with the protection equipment abnormal event generation characteristics, and alarm notification operation is carried out. The protection equipment worn by the personnel and the protection equipment installed in the high-place operation area are associated through visual identification, the dangerous source of the high-place operation is automatically and accurately determined, and the safety monitoring reliability of the high-place operation is improved.

Description

Technical Field

[0001] The present invention relates to the field of high-altitude operation monitoring, and in particular to a method and system for identifying high-altitude operation hazard sources based on a movable device. Background Art

[0002] Industrial sites such as construction and shipbuilding all require high-altitude work. According to relevant regulations, work at a height of 2m or more (including 2m) above the falling height reference plane, where there is a possibility of falling, is considered high-altitude work. In actual high-altitude work, protective equipment such as scaffolding is set up and workers wear protective equipment such as five-point safety belts to prevent falling incidents. High-altitude work is affected by external environmental factors and the operating factors of the workers themselves, which makes high-altitude work subject to many safety uncertainties. In order to provide comprehensive and effective safety protection for the workers, a safety supervisor will be specially assigned to the workers. The safety supervisor will observe the high-altitude working environment and workers, so as to discover safety hazards in the high-altitude work process and remind the workers in time. However, the manual observation and reminder services provided by the safety supervisor inevitably have problems such as omissions, and cannot fully and accurately discover safety hazards and quickly remind them, while also increasing the labor cost of high-altitude work. Summary of the invention

[0003] The purpose of the present invention is to provide a method and system for identifying hazardous sources of high-altitude operations based on a mobile device, which collects and identifies images of high-altitude operation areas, and determines the characteristics of personnel and protective equipment in the high-altitude operation areas; based on the personnel characteristics, collects and identifies dynamic images of personnel in the high-altitude operation areas, obtains the change information and movement path information of the protective equipment on the personnel, thereby determining the characteristics of abnormal events of the protective equipment during the operation of the personnel at high altitudes, and locates the structural abnormalities of the protective equipment worn by the personnel; also based on the movement path information and the characteristics of the protective equipment, determines the characteristics of abnormal events of the protective equipment during the operation of the personnel at high altitudes, and identifies the characteristics of hazardous sources during the operation of the personnel at high altitudes in combination with the characteristics of abnormal events of the protective equipment, and performs an alarm notification operation, associates the protective equipment worn by the personnel with the protective equipment installed in the high-altitude operation area through visual recognition, automatically and accurately determines the hazardous sources of the high-altitude operation, and improves the reliability of safety monitoring of the high-altitude operation.

[0004] The present invention is achieved through the following technical solutions:

[0005] The method for identifying hazardous sources of high-altitude operations based on mobile devices includes:

[0006] Controlling the mobile device to perform a first visual acquisition of the high-altitude working area to obtain an image of the high-altitude working area; identifying the image of the high-altitude working area to determine the characteristics of personnel and protective equipment in the high-altitude working area;

[0007] Based on the personnel characteristics, the mobile device is controlled to perform a second visual acquisition of the personnel inside the high-altitude working area to obtain a dynamic image of the personnel; the dynamic image of the personnel is recognized to obtain the change information of the protective equipment on the personnel and the motion path information; based on the motion path information and the change information of the protective equipment, the characteristics of the abnormal event of the protective equipment of the personnel during the high-altitude working process are determined;

[0008] Based on the motion path information and the characteristics of the protective equipment, determine the characteristics of abnormal events occurring in the protective equipment when the personnel are working at height; based on the characteristics of abnormal events occurring in the protective equipment and the characteristics of abnormal events occurring in the protective equipment, identify the characteristics of the hazard sources when the personnel are working at height; based on the characteristics of the hazard sources, perform an alarm notification operation.

[0009] Optionally, controlling the mobile device to perform a first visual acquisition of the high-altitude working area to obtain an image of the high-altitude working area; identifying the image of the high-altitude working area to determine the characteristics of personnel and protective equipment in the high-altitude working area, including:

[0010] Based on the three-dimensional spatial morphological characteristics of the high-altitude working area, the movable device is controlled to perform a full-range wide-angle visual acquisition of the high-altitude working area to obtain a global image of the high-altitude working area;

[0011] The global image of the high-altitude working area is subjected to image contour and image chromaticity recognition to obtain contour features and chromaticity features of the global image of the high-altitude working area; based on the contour features and the chromaticity features, the personnel features and protective equipment features of the high-altitude working area are determined; wherein the personnel features include personnel appearance contour features and personnel limb morphology features; the protective equipment features include appearance and structural features of the protective equipment installed in the high-altitude working area.

[0012] Optionally, based on the personnel characteristics, controlling the mobile device to perform a second visual acquisition of the personnel inside the high-altitude working area to obtain a dynamic image of the personnel; identifying the dynamic image of the personnel to obtain change information and motion path information of the protective equipment on the personnel; based on the motion path information and the change information of the protective equipment, determining the occurrence characteristics of abnormal events of the protective equipment of the personnel during the high-altitude working process, including:

[0013] Based on the characteristics of the personnel, several body part reference points of the personnel are determined; based on all the body part reference points, the movable device is controlled to track and shoot the personnel inside the high-altitude working area to obtain the dynamic image of the personnel corresponding to the high-altitude working area; the body area and the background area of ​​the personnel dynamic image are respectively identified to obtain the structural change information of the protective equipment on the personnel and the movement path information of the personnel inside the high-altitude working area;

[0014] The motion path information and the protection device structure change information are analyzed in the spatial domain to determine the position information of the personnel in the motion path when the protection device has a structural abnormality during the personnel's high-altitude work, and use this as the feature of the occurrence of the protection device abnormality.

[0015] Optionally, controlling the travel speed of the movable device comprises:

[0016] When the mobile device tracks and photographs the personnel inside the high-altitude working area, extracting the current moving speed of the mobile device;

[0017] comparing the travel speed of the movable device with a preset travel speed threshold;

[0018] When the moving speed of the mobile device exceeds a preset moving speed threshold, the ratio of the image area occupied by the personnel in each frame of the image of the personnel inside the high working area currently captured by the mobile device is retrieved;

[0019] adjusting the current moving speed of the mobile device according to the ratio of the image area occupied by the personnel in the image of the personnel inside the high-altitude working area in each frame;

[0020] The adjusted travel speed of the movable device is obtained by the following formula:

[0021]

[0022] Among them, V t represents the adjusted travel speed of the mobile device; V0 represents the travel speed of the mobile device before adjustment; n represents the number of frames corresponding to the image of the personnel inside the high-altitude working area; S ci represents the ratio of the image area occupied by personnel in the image of personnel in the high-altitude working area corresponding to the i-th frame; S ci+1 V represents the ratio of the image area occupied by personnel in the image of personnel in the high-altitude working area corresponding to the i+1th frame; i V represents the speed of the mobile device corresponding to the i-th frame image; i+1represents the traveling speed of the movable device corresponding to the i+1th frame image; k represents the adjustment coefficient, and the adjustment coefficient is obtained by the following formula:

[0023]

[0024] Where, k represents the adjustment coefficient; S i represents the image area occupied by the personnel in the image of the personnel in the high-altitude working area corresponding to the i-th frame; n represents the number of frames corresponding to the image of the personnel in the high-altitude working area; S z Indicates the size and area of ​​the entire image; S bi represents the standard deviation of the image area occupied by personnel in the image of personnel inside the high-altitude working area corresponding to the i-th frame; V i V represents the speed of the mobile device corresponding to the i-th frame image; s Indicates the initial speed of the mobile device when starting tracking shooting.

[0025] Optionally, based on the motion path information and the protective equipment characteristics, determining the characteristics of abnormal events occurring in the protective equipment during the personnel's work at height; based on the characteristics of abnormal events occurring in the protective equipment and the characteristics of abnormal events occurring in the protective equipment, identifying the characteristics of sources of danger during the personnel's work at height; and based on the characteristics of the sources of danger, performing an alarm notification operation, including:

[0026] Perform spatial domain analysis on the motion path information and the protective equipment characteristics to determine the location of the structural defect inside the protective equipment in the high-altitude working area and the location information mapped on the motion path of the personnel, thereby taking this as the occurrence feature of the abnormal event of the protective equipment;

[0027] The position information of the personnel in the motion path when the structural abnormality event of the protective equipment occurs during the personnel working at height, which is included in the abnormal event occurrence characteristics of the protective equipment, is spatially compared with the mapped position information to determine the relative distance between the two; based on the relative distance, the hazard source characteristics of the personnel during the working at height are identified; wherein the hazard source characteristics include the structural defect position distribution information inside the protective equipment;

[0028] Then, based on the structural defect location distribution information inside the protective equipment, voice notification operations and platform message upload alarm operations are performed on the personnel.

[0029] The high-altitude operation hazard identification system based on a mobile device includes:

[0030] A first visual acquisition control module is used to control the mobile device to perform a first visual acquisition on the high-altitude working area to obtain an image of the high-altitude working area;

[0031] A first image recognition module is used to recognize the image of the high-altitude working area and determine the characteristics of personnel and protective equipment in the high-altitude working area;

[0032] A second visual acquisition control module is used to control the mobile device to perform second visual acquisition of the personnel inside the high-altitude working area based on the personnel characteristics to obtain dynamic images of the personnel;

[0033] The second image recognition module is used to recognize the dynamic image of the personnel, obtain the change information of the protective equipment and the movement path information of the personnel; based on the movement path information and the change information of the protective equipment, determine the occurrence characteristics of abnormal events of the protective equipment of the personnel during the high-altitude operation;

[0034] A hazard source identification module, for determining the occurrence characteristics of abnormal events of the protective equipment during the operation of the personnel at heights based on the motion path information and the characteristics of the protective equipment; and identifying the characteristics of hazard sources during the operation of the personnel at heights based on the occurrence characteristics of abnormal events of the protective equipment and the characteristics of abnormal events of the protective equipment;

[0035] The alarm notification module is used to perform alarm notification operations based on the characteristics of the hazard source.

[0036] Optionally, the first visual acquisition control module is used to control the mobile device to perform a first visual acquisition on the high-altitude working area to obtain an image of the high-altitude working area, including:

[0037] Based on the three-dimensional spatial morphological characteristics of the high-altitude working area, the movable device is controlled to perform a full-range wide-angle visual acquisition of the high-altitude working area to obtain a global image of the high-altitude working area;

[0038] The first image recognition module is used to recognize the image of the high-altitude working area and determine the personnel characteristics and protective equipment characteristics of the high-altitude working area, including:

[0039] The global image of the high-altitude working area is subjected to image contour and image chromaticity recognition to obtain contour features and chromaticity features of the global image of the high-altitude working area; based on the contour features and the chromaticity features, the personnel features and protective equipment features of the high-altitude working area are determined; wherein the personnel features include personnel appearance contour features and personnel limb morphology features; the protective equipment features include appearance and structural features of the protective equipment installed in the high-altitude working area.

[0040] Optionally, the second visual acquisition control module is used to control the mobile device to perform second visual acquisition on the personnel inside the high-altitude working area based on the personnel characteristics to obtain a dynamic image of the personnel, including:

[0041] Based on the characteristics of the personnel, several body part reference points of the personnel are determined; based on all the body part reference points, the movable device is controlled to track and shoot the personnel inside the high-altitude working area to obtain a dynamic image of the personnel corresponding to the high-altitude working area;

[0042] The second image recognition module is used to recognize the dynamic image of the personnel to obtain the change information and motion path information of the protective equipment on the personnel; based on the motion path information and the change information of the protective equipment, determine the occurrence characteristics of abnormal events of the protective equipment of the personnel during the high-altitude operation, including:

[0043] Recognize the body area and background area of ​​the personnel dynamic image respectively, and obtain the structural change information of the protective equipment on the personnel and the movement path information of the personnel in the high-altitude working area;

[0044] The motion path information and the protection device structure change information are analyzed in the spatial domain to determine the position information of the personnel in the motion path when the protection device has a structural abnormality during the personnel's high-altitude work, and use this as the feature of the occurrence of the protection device abnormality.

[0045] Optionally, controlling the travel speed of the movable device comprises:

[0046] When the mobile device tracks and photographs the personnel inside the high-altitude working area, extracting the current moving speed of the mobile device;

[0047] comparing the travel speed of the movable device with a preset travel speed threshold;

[0048] When the moving speed of the mobile device exceeds a preset moving speed threshold, the ratio of the image area occupied by the personnel in each frame of the image of the personnel inside the high working area currently captured by the mobile device is retrieved;

[0049] adjusting the current moving speed of the mobile device according to the ratio of the image area occupied by the personnel in the image of the personnel inside the high-altitude working area in each frame;

[0050] The adjusted travel speed of the movable device is obtained by the following formula:

[0051]

[0052] Among them, V t represents the adjusted travel speed of the mobile device; V0 represents the travel speed of the mobile device before adjustment; n represents the number of frames corresponding to the image of the personnel inside the high-altitude working area; S cirepresents the ratio of the image area occupied by personnel in the image of personnel in the high-altitude working area corresponding to the i-th frame; S ci+1 V represents the ratio of the image area occupied by personnel in the image of personnel in the high-altitude working area corresponding to the i+1th frame; i V represents the speed of the mobile device corresponding to the i-th frame image; i+1 represents the traveling speed of the movable device corresponding to the i+1th frame image; k represents the adjustment coefficient, and the adjustment coefficient is obtained by the following formula:

[0053]

[0054] Where, k represents the adjustment coefficient; S i represents the image area occupied by the personnel in the image of the personnel in the high-altitude working area corresponding to the i-th frame; n represents the number of frames corresponding to the image of the personnel in the high-altitude working area; S z Indicates the size and area of ​​the entire image; S bi represents the standard deviation of the image area occupied by personnel in the image of personnel inside the high-altitude working area corresponding to the i-th frame; V i V represents the speed of the mobile device corresponding to the i-th frame image; s Indicates the initial speed of the mobile device when starting tracking shooting.

[0055] Optionally, the hazard source identification module is used to determine the occurrence characteristics of abnormal events of protective equipment during the personnel's work at height based on the motion path information and the characteristics of the protective equipment; based on the occurrence characteristics of abnormal events of the protective equipment and the characteristics of abnormal events of the protective equipment, identify the hazard source characteristics during the personnel's work at height, including:

[0056] Perform spatial domain analysis on the motion path information and the protective equipment characteristics to determine the location of the structural defect inside the protective equipment in the high-altitude working area and the location information mapped on the motion path of the personnel, thereby taking this as the occurrence feature of the abnormal event of the protective equipment;

[0057] The position information of the personnel in the motion path when the structural abnormality event of the protective equipment occurs during the personnel working at height, which is included in the abnormal event occurrence characteristics of the protective equipment, is spatially compared with the mapped position information to determine the relative distance between the two; based on the relative distance, the hazard source characteristics of the personnel during the working at height are identified; wherein the hazard source characteristics include the structural defect position distribution information inside the protective equipment;

[0058] The alarm notification module is used to perform an alarm notification operation based on the hazard source characteristics, including:

[0059] Based on the structural defect location distribution information inside the protective equipment, voice notification operations and platform message upload alarm operations are performed on the personnel.

[0060] Compared with the prior art, the present invention has the following beneficial effects:

[0061] The method and system for identifying hazardous sources of high-altitude operations based on a mobile device provided in the present application collect and identify images of the high-altitude operation area, and determine the characteristics of personnel and protective equipment in the high-altitude operation area; based on the personnel characteristics, collect and identify dynamic images of personnel in the high-altitude operation area, and obtain the change information and movement path information of the protective equipment on the personnel, so as to determine the characteristics of abnormal events of protective equipment during the operation of personnel at height, and locate the structural abnormalities of the protective equipment worn by the personnel; also based on the motion path information and the characteristics of the protective equipment, determine the characteristics of abnormal events of protective equipment during the operation of personnel at height, and in combination with the characteristics of abnormal events of the protective equipment, identify the characteristics of hazardous sources during the operation of personnel at height, and perform alarm notification operations, and associate the protective equipment worn by the personnel with the protective equipment installed in the high-altitude operation area through visual recognition, automatically and accurately determine the hazardous sources of high-altitude operations, and improve the reliability of safety monitoring of high-altitude operations. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the prior art descriptions. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. Among them:

[0063] Figure 1 A schematic flow chart of a method for identifying hazardous sources of operations at heights based on a movable device provided by the present invention.

[0064] Figure 2 A schematic structural diagram of a high-altitude operation hazard identification system based on a movable device provided by the present invention. DETAILED DESCRIPTION

[0065] In order to make the above-mentioned purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are described in detail below in conjunction with the accompanying drawings. It is to be understood that the specific embodiments described herein are only used to explain the present application, rather than to limit the present application. It should also be noted that, for ease of description, only some structures related to the present application are shown in the accompanying drawings, rather than all structures. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0066] The terms "including" and "having" and any variations thereof in this application are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products or devices.

[0067] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0068] See also Figure 1 As shown, an embodiment of the present application provides a method for identifying dangerous sources of high-altitude operations based on a mobile device. The method for identifying dangerous sources of high-altitude operations based on a mobile device includes:

[0069] Controlling the mobile device to perform first visual acquisition of the high-altitude working area to obtain an image of the high-altitude working area; identifying the image of the high-altitude working area to determine the characteristics of personnel and protective equipment in the high-altitude working area;

[0070] Based on the personnel characteristics, the mobile device is controlled to perform a second visual acquisition of the personnel in the high-altitude working area to obtain a dynamic image of the personnel; the dynamic image of the personnel is recognized to obtain the change information of the protective equipment on the personnel and the motion path information; based on the motion path information and the change information of the protective equipment, the characteristics of the abnormal event of the protective equipment of the personnel during the high-altitude working process are determined;

[0071] Based on the motion path information and the characteristics of the protective equipment, determine the characteristics of abnormal events occurring in the protective equipment when the person is working at height; based on the characteristics of abnormal events occurring in the protective equipment and the characteristics of abnormal events occurring in the protective equipment, identify the characteristics of the hazard source when the person is working at height; based on the characteristics of the hazard source, perform an alarm notification operation.

[0072] The beneficial effects of the above-mentioned embodiments are as follows: the method for identifying hazardous sources of high-altitude operations based on a movable device collects and identifies images of the high-altitude operation area, and determines the characteristics of personnel and protective equipment in the high-altitude operation area; based on the personnel characteristics, it collects and identifies dynamic images of personnel in the high-altitude operation area, and obtains the change information and movement path information of the protective equipment on the personnel, thereby determining the characteristics of abnormal events of the protective equipment during the operation of the personnel at height, and locating the structural abnormalities of the protective equipment worn by the personnel; based on the movement path information and the characteristics of the protective equipment, it determines the characteristics of abnormal events of the protective equipment during the operation of the personnel at height, and in combination with the characteristics of abnormal events of the protective equipment, identifies the characteristics of hazardous sources during the operation of the personnel at height, and performs alarm notification operations, associates the protective equipment worn by the personnel with the protective equipment installed in the high-altitude operation area through visual recognition, automatically and accurately determines the hazardous sources of the high-altitude operation, and improves the reliability of safety monitoring of the high-altitude operation.

[0073] In another embodiment, controlling the mobile device to perform a first visual acquisition of the high-altitude working area to obtain an image of the high-altitude working area; recognizing the image of the high-altitude working area to determine the personnel characteristics and protective equipment characteristics of the high-altitude working area, including:

[0074] Based on the three-dimensional spatial morphological characteristics of the high-altitude working area, the mobile device is controlled to perform a full-range wide-angle visual acquisition of the high-altitude working area to obtain a global image of the high-altitude working area;

[0075] The global image of the high-altitude working area is subjected to image contour and image chromaticity recognition to obtain contour features and chromaticity features of the global image of the high-altitude working area; based on the contour features and the chromaticity features, the personnel features and protective equipment features of the high-altitude working area are determined; wherein the personnel features include personnel appearance contour features and personnel limb morphology features; the protective equipment features include appearance and structural features of the protective equipment installed in the high-altitude working area.

[0076] The beneficial effect of the above-mentioned embodiment is that during the high-altitude operation, personnel will move back and forth inside the high-altitude operation area. In order to improve the safety of high-altitude operation, personnel will wear protective equipment such as five-point safety belts and install protective equipment such as guardrails at the edge of the high-altitude operation area. In order to fully cover the personnel and protective equipment inside the high-altitude operation area, based on the height position and three-dimensional size of the high-altitude operation area in three-dimensional space, movable devices such as movable cameras are controlled to perform full-range wide-angle visual acquisition of the high-altitude operation area to obtain a global image of the high-altitude operation area, thereby accurately identifying the personnel characteristics and protective equipment characteristics of the high-altitude operation area. In addition, the global image of the high-altitude operation area is identified by the image contour and image chromaticity to obtain the contour characteristics and chromaticity characteristics of the global image of the high-altitude operation area; based on the contour characteristics and the chromaticity characteristics, the personnel characteristics and protective equipment characteristics of the high-altitude operation area are determined, so that the personnel and protective equipment in the high-altitude operation area can be characterized in appearance, providing a reliable data basis for the subsequent identification of high-altitude operation hazards.

[0077] In another embodiment, based on the personnel characteristics, the mobile device is controlled to perform a second visual acquisition of the personnel in the high-altitude working area to obtain a dynamic image of the personnel; the dynamic image of the personnel is recognized to obtain the change information of the protective equipment on the personnel and the motion path information; based on the motion path information and the change information of the protective equipment, the characteristics of the abnormal event of the protective equipment of the personnel during the high-altitude working process are determined, including:

[0078] Based on the characteristics of the person, several body part reference points of the person are determined; based on all the body part reference points, the movable device is controlled to track and shoot the person inside the high-altitude working area to obtain a dynamic image of the person corresponding to the high-altitude working area; the person's body area and background area are respectively identified in the dynamic image of the person to obtain the structural change information of the protective equipment on the person and the movement path information of the person inside the high-altitude working area;

[0079] The motion path information and the structural change information of the protective device are analyzed in the spatial domain to determine the position information of the person in the motion path when a structural abnormality event occurs in the protective device during the person's high-altitude operation, and use this as the feature of the occurrence of the abnormal event of the protective device.

[0080] The beneficial effect of the above embodiment is that, based on the personnel's appearance contour features and the personnel's limb morphology features, several body part reference points are selected from the personnel's body, and the personnel's body is characterized globally through these body part reference points, so as to track and shoot the personnel inside the high-altitude working area, and obtain the personnel dynamic image corresponding to the personnel's activities inside the high-altitude working area. Then, the personnel body area and background area are respectively identified for the personnel dynamic image, and the protection equipment structure change information on the person and the movement path information of the person inside the high-altitude working area are obtained; wherein, the protection equipment structure change information may include but is not limited to the protection equipment structure connection relationship change information. There is also a spatial domain analysis of the movement path information and the protection equipment structure change information to determine the position information of the person in the movement path when the protection equipment has a structural abnormality event (such as a loose or broken structural connection event of the protection equipment) during the high-altitude working process of the person, and use this as the occurrence feature of the abnormal event of the protection equipment, so that the position of the person when the protection equipment has a loose or broken structural connection during the activities of the person inside the high-altitude working area can be accurately determined.

[0081] In another embodiment, controlling the travel speed of the movable device includes:

[0082] When the mobile device tracks and photographs the personnel inside the high-altitude working area, extracting the current moving speed of the mobile device;

[0083] comparing the travel speed of the movable device with a preset travel speed threshold;

[0084] When the moving speed of the mobile device exceeds a preset moving speed threshold, the ratio of the image area occupied by the personnel in each frame of the image of the personnel inside the high working area currently captured by the mobile device is retrieved;

[0085] adjusting the current moving speed of the mobile device according to the ratio of the image area occupied by the personnel in the image of the personnel inside the high-altitude working area in each frame;

[0086] The adjusted travel speed of the movable device is obtained by the following formula:

[0087]

[0088] Among them, V t represents the adjusted travel speed of the mobile device; V0 represents the travel speed of the mobile device before adjustment; n represents the number of frames corresponding to the image of the personnel inside the high-altitude working area; S ci represents the ratio of the image area occupied by personnel in the image of personnel in the high-altitude working area corresponding to the i-th frame; S ci+1V represents the ratio of the image area occupied by personnel in the image of personnel in the high-altitude working area corresponding to the i+1th frame; i V represents the speed of the mobile device corresponding to the i-th frame image; i+1 represents the traveling speed of the movable device corresponding to the i+1th frame image; k represents the adjustment coefficient, and the adjustment coefficient is obtained by the following formula:

[0089]

[0090] Where, k represents the adjustment coefficient; S i represents the image area occupied by the personnel in the image of the personnel in the high-altitude working area corresponding to the i-th frame; n represents the number of frames corresponding to the image of the personnel in the high-altitude working area; S z Indicates the size and area of ​​the entire image; S bi represents the standard deviation of the image area occupied by personnel in the image of personnel inside the high-altitude working area corresponding to the i-th frame; V i V represents the speed of the mobile device corresponding to the i-th frame image; s Indicates the initial speed of the mobile device when starting tracking shooting.

[0091] The beneficial effects of the above embodiments are that the technical solution ensures that when tracking and shooting personnel inside the high-altitude working area, the device will not miss key safety information due to excessive speed by dynamically monitoring and adjusting the travel speed of the movable device, thereby improving the safety of the working site. By comparing the travel speed with the preset threshold and adjusting according to the proportion of the image area occupied by the personnel, the blur or omission of shooting caused by improper speed can be effectively avoided, and the accuracy and effectiveness of safety monitoring can be further guaranteed. By adjusting the travel speed according to the proportion of the area occupied by the personnel in each frame of the image, it can ensure that the image of the personnel captured is clear and complete, and optimize the effect of tracking shooting. By introducing the adjustment coefficient, multiple factors such as the change of the image area ratio, the standard deviation and the travel speed are comprehensively considered, so that the adjusted travel speed is more reasonable and the shooting effect is better. The technical solution adopts an automated control strategy, and realizes the intelligent adjustment of the travel speed of the movable device through the preset threshold and the formulaic calculation method. Without manual intervention, the shooting strategy can be automatically adjusted according to the actual situation on site, which improves work efficiency and intelligence level. By dynamically adjusting the travel speed, the technical solution can adapt to the complex environment and personnel distribution of different high-altitude working areas. Whether in a densely populated or sparsely populated area, the speed of movement can be adjusted to ensure the accuracy of shooting and security monitoring, enhancing the adaptability and flexibility of the system. The use of automated control strategies reduces the difficulty and complexity of operation. Operators do not need to have professional operating skills or experience, and can effectively control the speed of the mobile device through simple settings and monitoring.

[0092] In summary, the technical effects of the above technical solutions in terms of performance indicators are mainly reflected in improving safety, optimizing tracking and shooting effects, improving the level of intelligence, enhancing adaptability and reducing operational difficulty, etc. These effects together constitute the significant advantages of the technical solution in practical applications, and provide strong technical support for safety monitoring and tracking shooting in high-altitude working areas.

[0093] In another embodiment, based on the motion path information and the protective equipment characteristics, determining the characteristics of abnormal events of the protective equipment during the personnel's work at height; based on the characteristics of the abnormal events of the protective equipment and the characteristics of the abnormal events of the protective equipment, identifying the characteristics of the source of danger during the personnel's work at height; based on the characteristics of the source of danger, performing an alarm notification operation, including:

[0094] Perform spatial domain analysis on the motion path information and the features of the protective equipment to determine the location of the structural defect inside the protective equipment in the high-altitude working area, and map the position information of the personnel in the motion path to use this as the feature of the abnormal event of the protective equipment;

[0095] The position information of the person in the motion path when the structural abnormality event of the protective device occurs during the high-altitude operation of the person included in the abnormal event occurrence feature of the protective device is spatially compared with the mapped position information to determine the relative distance between the two; based on the relative distance, the hazard source characteristics of the person in the high-altitude operation process are identified; wherein the hazard source characteristics include the structural defect position distribution information inside the protective device;

[0096] Based on the structural defect location distribution information inside the protective equipment, the personnel are notified by voice and the platform message is uploaded to the alarm.

[0097] The beneficial effect of the above-mentioned embodiment is that the protective equipment such as guardrails installed in the high-altitude working area will inevitably be damaged during long-term use. When personnel pass through the damaged position of the protective equipment during the high-altitude working process, the safety risk of the high-altitude working will be increased. The motion path information and the characteristics of the protective equipment are analyzed in the spatial domain to determine the location of the structural defects inside the protective equipment in the high-altitude working area at the location mapped by the personnel in the motion path, and this is used as the abnormal event occurrence feature of the protective equipment. In addition, the location information of the personnel in the motion path when the structural abnormal event of the protective equipment occurs during the high-altitude working process contained in the abnormal event occurrence feature of the protective equipment is spatially compared with the mapped location information to determine the relative distance between the two. If the relative distance is less than the preset distance threshold, the structural defect location inside the corresponding protective equipment is determined as the location of the danger source, thereby comprehensively and accurately locating all the danger sources inside the high-altitude working area. In addition, based on the structural defect location distribution information inside the protective equipment, the personnel are voice notified and the platform message upload alarm operation is performed to timely and accurately perform high-altitude working alarm reminders.

[0098] See also Figure 2 As shown, an embodiment of the present application provides a system for identifying dangerous sources of high-altitude operations based on a mobile device. The system for identifying dangerous sources of high-altitude operations based on a mobile device includes:

[0099] A first visual acquisition control module is used to control the mobile device to perform a first visual acquisition on the high-altitude working area to obtain an image of the high-altitude working area;

[0100] The first image recognition module is used to recognize the image of the high-altitude working area and determine the characteristics of the personnel and protective equipment in the high-altitude working area;

[0101] A second visual acquisition control module is used to control the mobile device to perform second visual acquisition of the personnel inside the high-altitude working area based on the personnel characteristics to obtain a dynamic image of the personnel;

[0102] The second image recognition module is used to recognize the dynamic image of the person, obtain the change information of the protective equipment and the movement path information of the person; based on the movement path information and the change information of the protective equipment, determine the occurrence characteristics of abnormal events of the protective equipment of the person during the high-altitude operation;

[0103] A hazard source identification module is used to determine the occurrence characteristics of abnormal events of the protective equipment during the personnel's work at height based on the motion path information and the characteristics of the protective equipment; based on the occurrence characteristics of abnormal events of the protective equipment and the characteristics of abnormal events of the protective equipment, identify the characteristics of hazard sources during the personnel's work at height;

[0104] The alarm notification module is used to perform alarm notification operations based on the characteristics of the hazard source.

[0105] The beneficial effects of the above-mentioned embodiments are as follows: the high-altitude operation hazard source identification system based on a movable device collects and identifies images of the high-altitude operation area, and determines the personnel characteristics and protective equipment characteristics of the high-altitude operation area; based on the personnel characteristics, it collects and identifies the dynamic images of the personnel in the high-altitude operation area, and obtains the protective equipment change information and movement path information on the personnel, thereby determining the characteristics of abnormal events of the protective equipment during the operation of the personnel at height, and locating the structural abnormalities of the protective equipment worn by the personnel; based on the motion path information and the protective equipment characteristics, it determines the characteristics of abnormal events of the protective equipment during the operation of the personnel at height, and combines the characteristics of abnormal events of the protective equipment to identify the hazard source characteristics of the personnel during the operation of the personnel at height, and performs an alarm notification operation, associates the protective equipment worn by the personnel with the protective equipment installed in the high-altitude operation area through visual recognition, automatically and accurately determines the hazard source of the high-altitude operation, and improves the reliability of safety monitoring of the high-altitude operation.

[0106] In another embodiment, the first visual acquisition control module is used to control the mobile device to perform first visual acquisition on the high-altitude working area to obtain an image of the high-altitude working area, including:

[0107] Based on the three-dimensional spatial morphological characteristics of the high-altitude working area, the mobile device is controlled to perform a full-range wide-angle visual acquisition of the high-altitude working area to obtain a global image of the high-altitude working area;

[0108] The first image recognition module is used to recognize the image of the high-altitude working area and determine the personnel characteristics and protective equipment characteristics of the high-altitude working area, including:

[0109] The global image of the high-altitude working area is subjected to image contour and image chromaticity recognition to obtain contour features and chromaticity features of the global image of the high-altitude working area; based on the contour features and the chromaticity features, the personnel features and protective equipment features of the high-altitude working area are determined; wherein the personnel features include personnel appearance contour features and personnel limb morphology features; the protective equipment features include appearance and structural features of the protective equipment installed in the high-altitude working area.

[0110] The beneficial effect of the above-mentioned embodiment is that during the high-altitude operation, personnel will move back and forth inside the high-altitude operation area. In order to improve the safety of high-altitude operation, personnel will wear protective equipment such as five-point safety belts and install protective equipment such as guardrails at the edge of the high-altitude operation area. In order to fully cover the personnel and protective equipment inside the high-altitude operation area, based on the height position and three-dimensional size of the high-altitude operation area in three-dimensional space, movable devices such as movable cameras are controlled to perform full-range wide-angle visual acquisition of the high-altitude operation area to obtain a global image of the high-altitude operation area, thereby accurately identifying the personnel characteristics and protective equipment characteristics of the high-altitude operation area. In addition, the global image of the high-altitude operation area is identified by the image contour and image chromaticity to obtain the contour characteristics and chromaticity characteristics of the global image of the high-altitude operation area; based on the contour characteristics and the chromaticity characteristics, the personnel characteristics and protective equipment characteristics of the high-altitude operation area are determined, so that the personnel and protective equipment in the high-altitude operation area can be characterized in appearance, providing a reliable data basis for the subsequent identification of high-altitude operation hazards.

[0111] In another embodiment, the second visual acquisition control module is used to control the mobile device to perform second visual acquisition of the personnel inside the high-altitude working area based on the personnel characteristics to obtain a dynamic image of the personnel, including:

[0112] Based on the characteristics of the person, several body part reference points of the person are determined; based on all the body part reference points, the movable device is controlled to track and shoot the person inside the high-altitude working area to obtain a dynamic image of the person corresponding to the high-altitude working area;

[0113] The second image recognition module is used to recognize the dynamic image of the person, obtain the protection equipment change information and motion path information of the person; based on the motion path information and the protection equipment change information, determine the occurrence characteristics of abnormal events of the protection equipment of the person during the high-altitude operation, including:

[0114] The body area and background area of ​​the person's dynamic image are respectively identified to obtain the structural change information of the protective equipment on the person and the movement path information of the person in the high-altitude working area;

[0115] The motion path information and the structural change information of the protective device are analyzed in the spatial domain to determine the position information of the person in the motion path when a structural abnormality event occurs in the protective device during the person's high-altitude operation, and use this as the feature of the occurrence of the abnormal event of the protective device.

[0116] The beneficial effect of the above embodiment is that, based on the personnel's appearance contour features and the personnel's limb morphology features, several body part reference points are selected from the personnel's body, and the personnel's body is characterized globally through these body part reference points, so as to track and shoot the personnel inside the high-altitude working area, and obtain the personnel dynamic image corresponding to the personnel's activities inside the high-altitude working area. Then, the personnel body area and background area are respectively identified for the personnel dynamic image, and the protection equipment structure change information on the person and the movement path information of the person inside the high-altitude working area are obtained; wherein, the protection equipment structure change information may include but is not limited to the protection equipment structure connection relationship change information. There is also a spatial domain analysis of the movement path information and the protection equipment structure change information to determine the position information of the person in the movement path when the protection equipment has a structural abnormality event (such as a loose or broken structural connection event of the protection equipment) during the high-altitude working process of the person, and use this as the occurrence feature of the abnormal event of the protection equipment, so that the position of the person when the protection equipment has a loose or broken structural connection during the activities of the person inside the high-altitude working area can be accurately determined.

[0117] In another embodiment, controlling the travel speed of the movable device includes:

[0118] When the mobile device tracks and photographs the personnel inside the high-altitude working area, extracting the current moving speed of the mobile device;

[0119] comparing the travel speed of the movable device with a preset travel speed threshold;

[0120] When the moving speed of the mobile device exceeds a preset moving speed threshold, the ratio of the image area occupied by the personnel in each frame of the image of the personnel inside the high working area currently captured by the mobile device is retrieved;

[0121] adjusting the current moving speed of the mobile device according to the ratio of the image area occupied by the personnel in the image of the personnel inside the high-altitude working area in each frame;

[0122] The adjusted travel speed of the movable device is obtained by the following formula:

[0123]

[0124] Among them, V trepresents the adjusted travel speed of the mobile device; V0 represents the travel speed of the mobile device before adjustment; n represents the number of frames corresponding to the image of the personnel inside the high-altitude working area; S ci represents the ratio of the image area occupied by personnel in the image of personnel in the high-altitude working area corresponding to the i-th frame; S ci+1 V represents the ratio of the image area occupied by personnel in the image of personnel in the high-altitude working area corresponding to the i+1th frame; i V represents the speed of the mobile device corresponding to the i-th frame image; i+1 represents the traveling speed of the movable device corresponding to the i+1th frame image; k represents the adjustment coefficient, and the adjustment coefficient is obtained by the following formula:

[0125]

[0126] Where, k represents the adjustment coefficient; S i represents the image area occupied by the personnel in the image of the personnel in the high-altitude working area corresponding to the i-th frame; n represents the number of frames corresponding to the image of the personnel in the high-altitude working area; S z Indicates the size and area of ​​the entire image; S bi represents the standard deviation of the image area occupied by personnel in the image of personnel inside the high-altitude working area corresponding to the i-th frame; V i V represents the speed of the mobile device corresponding to the i-th frame image; s Indicates the initial speed of the mobile device when starting tracking shooting.

[0127] The beneficial effects of the above embodiments are that the technical solution ensures that when tracking and shooting personnel inside the high-altitude working area, the device will not miss key safety information due to excessive speed by dynamically monitoring and adjusting the travel speed of the movable device, thereby improving the safety of the working site. By comparing the travel speed with the preset threshold and adjusting according to the proportion of the image area occupied by the personnel, the blur or omission of shooting caused by improper speed can be effectively avoided, and the accuracy and effectiveness of safety monitoring can be further guaranteed. By adjusting the travel speed according to the proportion of the area occupied by the personnel in each frame of the image, it can ensure that the image of the personnel captured is clear and complete, and optimize the effect of tracking shooting. By introducing the adjustment coefficient, multiple factors such as the change of the image area ratio, the standard deviation and the travel speed are comprehensively considered, so that the adjusted travel speed is more reasonable and the shooting effect is better. The technical solution adopts an automated control strategy, and realizes the intelligent adjustment of the travel speed of the movable device through the preset threshold and the formulaic calculation method. Without manual intervention, the shooting strategy can be automatically adjusted according to the actual situation on site, which improves work efficiency and intelligence level. By dynamically adjusting the travel speed, the technical solution can adapt to the complex environment and personnel distribution of different high-altitude working areas. Whether in a densely populated or sparsely populated area, the speed of movement can be adjusted to ensure the accuracy of shooting and security monitoring, enhancing the adaptability and flexibility of the system. The use of automated control strategies reduces the difficulty and complexity of operation. Operators do not need to have professional operating skills or experience, and can effectively control the speed of the mobile device through simple settings and monitoring.

[0128] In summary, the technical effects of the above technical solutions in terms of performance indicators are mainly reflected in improving safety, optimizing tracking and shooting effects, improving the level of intelligence, enhancing adaptability and reducing operational difficulty, etc. These effects together constitute the significant advantages of the technical solution in practical applications, and provide strong technical support for safety monitoring and tracking shooting in high-altitude working areas.

[0129] In another embodiment, the hazard source identification module is used to determine the occurrence characteristics of abnormal events of the protective equipment during the personnel's high-altitude operation based on the motion path information and the characteristics of the protective equipment; based on the occurrence characteristics of abnormal events of the protective equipment and the characteristics of abnormal events of the protective equipment, identify the hazard source characteristics of the personnel during the high-altitude operation, including:

[0130] Perform spatial domain analysis on the motion path information and the features of the protective equipment to determine the location of the structural defect inside the protective equipment in the high-altitude working area, and map the position information of the personnel in the motion path to use this as the feature of the abnormal event of the protective equipment;

[0131] The position information of the person in the motion path when the structural abnormality event of the protective device occurs during the high-altitude operation of the person included in the abnormal event occurrence feature of the protective device is spatially compared with the mapped position information to determine the relative distance between the two; based on the relative distance, the hazard source characteristics of the person in the high-altitude operation process are identified; wherein the hazard source characteristics include the structural defect position distribution information inside the protective device;

[0132] The alarm notification module is used to perform an alarm notification operation based on the characteristics of the hazard source, including:

[0133] Based on the structural defect location distribution information inside the protective equipment, voice notification operations and platform message upload alarm operations are performed on the personnel.

[0134] The beneficial effect of the above-mentioned embodiment is that the protective equipment such as guardrails installed in the high-altitude working area will inevitably be damaged during long-term use. When personnel pass through the damaged position of the protective equipment during the high-altitude working process, the safety risk of the high-altitude working will be increased. The motion path information and the characteristics of the protective equipment are analyzed in the spatial domain to determine the location of the structural defects inside the protective equipment in the high-altitude working area at the location mapped by the personnel in the motion path, which is used as the abnormal event occurrence feature of the protective equipment. In addition, the location information of the personnel in the motion path when the structural abnormal event of the protective equipment occurs during the high-altitude working process contained in the abnormal event occurrence feature of the protective equipment is spatially compared with the mapped location information to determine the relative distance between the two. If the relative distance is less than the preset distance threshold, the structural defect location inside the corresponding protective equipment is determined as the location of the danger source, thereby comprehensively and accurately locating all the danger sources inside the high-altitude working area. In addition, based on the structural defect location distribution information inside the protective equipment, the personnel are voice notified and the platform message upload alarm operation is performed to timely and accurately perform high-altitude working alarm reminders.

[0135] In general, the method and system for identifying hazardous sources of high-altitude operations based on mobile devices collect and identify images of high-altitude working areas, and determine the characteristics of personnel and protective equipment in the high-altitude working areas; based on the personnel characteristics, collect and identify dynamic images of personnel in the high-altitude working areas, and obtain the change information and movement path information of the protective equipment on the personnel, so as to determine the characteristics of abnormal events of protective equipment during the high-altitude working process of the personnel, and locate the structural abnormalities of the protective equipment worn by the personnel; also based on the motion path information and protective equipment characteristics, determine the characteristics of abnormal events of protective equipment during the high-altitude working process of the personnel, and combine the characteristics of abnormal events of protective equipment to identify the characteristics of hazardous sources during the high-altitude working process of the personnel, and perform alarm notification operations, and through visual recognition, associate the protective equipment worn by the personnel with the protective equipment installed in the high-altitude working area, automatically and accurately determine the hazardous sources of high-altitude working, and improve the reliability of safety monitoring of high-altitude working.

[0136] The above is only a specific implementation of the present invention, and any other improvements made based on the concept of the present invention are considered to be within the protection scope of the present invention.

Claims

1. A method for identifying hazardous sources of high-altitude operations based on a mobile device, characterized in that: include: Control the movable device to perform first visual acquisition of the high-altitude working area to obtain an image of the high-altitude working area; Identify the image of the high-altitude working area to determine the characteristics of personnel and protective equipment in the high-altitude working area; Based on the personnel characteristics, the mobile device is controlled to perform a second visual acquisition of the personnel inside the high-altitude working area to obtain a dynamic image of the personnel; the dynamic image of the personnel is recognized to obtain the change information of the protective equipment on the personnel and the motion path information; based on the motion path information and the change information of the protective equipment, the characteristics of the abnormal event of the protective equipment of the personnel during the high-altitude working process are determined; Based on the motion path information and the protective equipment characteristics, determining the characteristics of abnormal events of the protective equipment during the personnel working at height; Based on the occurrence characteristics of the abnormal events of the protection equipment and the occurrence characteristics of the abnormal events of the protective equipment, identifying the characteristics of the hazard sources of the personnel during the high-altitude operation; Based on the characteristics of the hazard source, an alarm notification operation is performed.

2. The method for identifying dangerous sources of high-altitude operations based on a mobile device according to claim 1, characterized in that: Control the movable device to perform first visual acquisition of the high-altitude working area to obtain an image of the high-altitude working area; Identify the image of the high-altitude working area and determine the characteristics of personnel and protective equipment in the high-altitude working area, including: Based on the three-dimensional spatial morphological characteristics of the high-altitude working area, the movable device is controlled to perform a full-range wide-angle visual acquisition of the high-altitude working area to obtain a global image of the high-altitude working area; The global image of the high-altitude working area is subjected to image contour and image chromaticity recognition to obtain contour features and chromaticity features of the global image of the high-altitude working area; based on the contour features and the chromaticity features, the personnel features and protective equipment features of the high-altitude working area are determined; wherein the personnel features include personnel appearance contour features and personnel limb morphology features; the protective equipment features include appearance and structural features of the protective equipment installed in the high-altitude working area.

3. The method for identifying dangerous sources of high-altitude operations based on a mobile device according to claim 1, characterized in that: Based on the personnel characteristics, the mobile device is controlled to perform a second visual acquisition of the personnel inside the high-altitude working area to obtain a dynamic image of the personnel; the dynamic image of the personnel is recognized to obtain the change information of the protective equipment on the personnel and the movement path information; Based on the motion path information and the protective equipment change information, determining the occurrence characteristics of abnormal events of the protective equipment during the personnel working at height, including: Based on the characteristics of the person, determining several body part reference points of the person; Based on all body part reference points, the movable device is controlled to track and shoot the personnel inside the high-altitude working area to obtain the dynamic image of the personnel corresponding to the high-altitude working area; the personnel body area and the background area of ​​the personnel dynamic image are respectively identified to obtain the structural change information of the protective equipment on the personnel and the movement path information of the personnel inside the high-altitude working area; the movement path information and the structural change information of the protective equipment are analyzed in the spatial domain to determine the position information of the personnel in the movement path when the structural abnormality event of the protective equipment occurs during the high-altitude working of the personnel, and use this as the occurrence feature of the abnormal event of the protective equipment.

4. The method for identifying dangerous sources of high-altitude operations based on a mobile device according to claim 3, characterized in that: Control the travel speed of movable devices, including: When the mobile device tracks and photographs the personnel inside the high-altitude working area, extracting the current moving speed of the mobile device; comparing the travel speed of the movable device with a preset travel speed threshold; When the travel speed of the mobile device exceeds a preset travel speed threshold, the ratio of the image area occupied by the personnel in each frame of the image of the personnel inside the high-altitude working area currently captured by the mobile device is retrieved; adjusting the current moving speed of the mobile device according to the ratio of the image area occupied by the personnel in the image of the personnel inside the high-altitude working area in each frame; The adjusted travel speed of the movable device is obtained by the following formula: Among them, V t represents the adjusted travel speed of the mobile device; V0 represents the travel speed of the mobile device before adjustment; n represents the number of frames corresponding to the image of the personnel inside the high-altitude working area; S ci represents the ratio of the image area occupied by personnel in the image of personnel in the high-altitude working area corresponding to the i-th frame; S ci+1 V represents the ratio of the image area occupied by personnel in the image of personnel in the high-altitude working area corresponding to the i+1th frame; i V represents the speed of the mobile device corresponding to the i-th frame image; i+1 represents the traveling speed of the movable device corresponding to the i+1th frame image; k represents the adjustment coefficient, and the adjustment coefficient is obtained by the following formula: Where, k represents the adjustment coefficient; S i represents the image area occupied by the personnel in the image of the personnel in the high-altitude working area corresponding to the i-th frame; n represents the number of frames corresponding to the image of the personnel in the high-altitude working area; S z Indicates the size and area of ​​the entire image; S bi represents the standard deviation of the image area occupied by personnel in the image of personnel inside the high-altitude working area corresponding to the i-th frame; V i V represents the speed of the mobile device corresponding to the i-th frame image; s Indicates the initial speed of the mobile device when starting tracking shooting.

5. The method for identifying dangerous sources of high-altitude operations based on a mobile device according to claim 1, characterized in that: Based on the motion path information and the protective equipment characteristics, determining the characteristics of abnormal events of the protective equipment during the personnel working at height; Based on the occurrence characteristics of the abnormal events of the protection equipment and the occurrence characteristics of the abnormal events of the protective equipment, identifying the characteristics of the hazard sources of the personnel during the high-altitude operation; Based on the characteristics of the hazard source, an alarm notification operation is performed, including: Perform spatial domain analysis on the motion path information and the protective equipment characteristics to determine the location of the structural defect inside the protective equipment in the high-altitude working area and the location information mapped on the motion path of the personnel, thereby taking this as the occurrence feature of the abnormal event of the protective equipment; The position information of the personnel in the motion path when the structural abnormality event of the protective equipment occurs during the personnel working at height, which is included in the abnormal event occurrence characteristics of the protective equipment, is spatially compared with the mapped position information to determine the relative distance between the two; based on the relative distance, the hazard source characteristics of the personnel during the working at height are identified; wherein the hazard source characteristics include the structural defect position distribution information inside the protective equipment; Then, based on the structural defect location distribution information inside the protective equipment, voice notification operations and platform message upload alarm operations are performed on the personnel.

6. A high-altitude operation hazard identification system based on a mobile device, characterized in that: include: A first visual acquisition control module is used to control the mobile device to perform a first visual acquisition on the high-altitude working area to obtain an image of the high-altitude working area; A first image recognition module is used to recognize the image of the high-altitude working area and determine the characteristics of personnel and protective equipment in the high-altitude working area; A second visual acquisition control module is used to control the mobile device to perform second visual acquisition of the personnel inside the high-altitude working area based on the personnel characteristics to obtain dynamic images of the personnel; The second image recognition module is used to recognize the dynamic image of the personnel, obtain the change information of the protective equipment and the movement path information of the personnel; based on the movement path information and the change information of the protective equipment, determine the occurrence characteristics of abnormal events of the protective equipment of the personnel during the high-altitude operation; A hazard source identification module, used to determine the characteristics of abnormal events of protective equipment during the personnel's work at height based on the movement path information and the characteristics of the protective equipment; Based on the occurrence characteristics of the abnormal events of the protection equipment and the occurrence characteristics of the abnormal events of the protective equipment, identifying the characteristics of the hazard sources of the personnel during the high-altitude operation; The alarm notification module is used to perform alarm notification operations based on the characteristics of the hazard source.

7. The high-altitude operation hazard source identification system based on a mobile device as claimed in claim 6 is characterized by: The first visual acquisition control module is used to control the mobile device to perform a first visual acquisition on the high-altitude working area to obtain an image of the high-altitude working area, including: Based on the three-dimensional spatial morphological characteristics of the high-altitude working area, the movable device is controlled to perform a full-range wide-angle visual acquisition of the high-altitude working area to obtain a global image of the high-altitude working area; The first image recognition module is used to recognize the image of the high-altitude working area and determine the personnel characteristics and protective equipment characteristics of the high-altitude working area, including: The global image of the high-altitude working area is subjected to image contour and image chromaticity recognition to obtain contour features and chromaticity features of the global image of the high-altitude working area; based on the contour features and the chromaticity features, the personnel features and protective equipment features of the high-altitude working area are determined; wherein the personnel features include personnel appearance contour features and personnel limb morphology features; the protective equipment features include appearance and structural features of the protective equipment installed in the high-altitude working area.

8. The high-altitude operation hazard source identification system based on a mobile device as claimed in claim 6 is characterized by: The second visual acquisition control module is used to control the mobile device to perform second visual acquisition on the personnel inside the high-altitude working area based on the personnel characteristics to obtain dynamic images of the personnel, including: Based on the characteristics of the personnel, several body part reference points of the personnel are determined; based on all the body part reference points, the movable device is controlled to track and shoot the personnel inside the high-altitude working area to obtain a dynamic image of the personnel corresponding to the high-altitude working area; The second image recognition module is used to recognize the dynamic image of the personnel to obtain the change information and motion path information of the protective equipment on the personnel; based on the motion path information and the change information of the protective equipment, determine the occurrence characteristics of abnormal events of the protective equipment of the personnel during the high-altitude operation, including: Recognize the body area and background area of ​​the personnel dynamic image respectively, and obtain the structural change information of the protective equipment on the personnel and the movement path information of the personnel in the high-altitude working area; The motion path information and the protection device structure change information are analyzed in the spatial domain to determine the position information of the personnel in the motion path when a structural abnormality event occurs in the protection device during the personnel's high-altitude work, and use this as the feature of the occurrence of the protection device abnormal event.

9. The high-altitude operation hazard source identification system based on a mobile device as claimed in claim 8, characterized in that: Control the travel speed of movable devices, including: When the mobile device tracks and photographs the personnel inside the high-altitude working area, extracting the current moving speed of the mobile device; comparing the travel speed of the movable device with a preset travel speed threshold; When the travel speed of the mobile device exceeds a preset travel speed threshold, the ratio of the image area occupied by the personnel in each frame of the image of the personnel inside the high-altitude working area currently captured by the mobile device is retrieved; adjusting the current moving speed of the mobile device according to the ratio of the image area occupied by the personnel in the image of the personnel inside the high-altitude working area in each frame; The adjusted travel speed of the movable device is obtained by the following formula: Among them, V t represents the adjusted travel speed of the movable device; V0 represents the travel speed of the movable device before adjustment; n represents the number of frames corresponding to the image of the personnel inside the high-altitude working area; S ci represents the ratio of the image area occupied by personnel in the image of personnel in the high-altitude working area corresponding to the i-th frame; S ci+1 V represents the ratio of the image area occupied by personnel in the image of personnel in the high-altitude working area corresponding to the i+1th frame; i V represents the speed of the mobile device corresponding to the i-th frame image; i+1 represents the traveling speed of the movable device corresponding to the i+1th frame image; k represents the adjustment coefficient, and the adjustment coefficient is obtained by the following formula: Where, k represents the adjustment coefficient; S i represents the image area occupied by the personnel in the image of the personnel in the high-altitude working area corresponding to the i-th frame; n represents the number of frames corresponding to the image of the personnel in the high-altitude working area; S z Indicates the size and area of ​​the entire image; S bi represents the standard deviation of the image area occupied by personnel in the image of personnel inside the high-altitude working area corresponding to the i-th frame; V i V represents the speed of the mobile device corresponding to the i-th frame image; s Indicates the initial speed of the mobile device when starting tracking shooting.

10. The high-altitude operation hazard source identification system based on a mobile device as claimed in claim 6, characterized in that: The hazard source identification module is used to determine the characteristics of abnormal events of protective equipment during the personnel's work at height based on the motion path information and the characteristics of the protective equipment; Based on the occurrence characteristics of the abnormal event of the protection device and the occurrence characteristics of the abnormal event of the protective device, the characteristics of the source of danger of the personnel in the process of working at height are identified, including: Perform spatial domain analysis on the motion path information and the protective equipment characteristics to determine the location of the structural defect inside the protective equipment in the high-altitude working area and the location information mapped on the motion path of the personnel, thereby taking this as the occurrence feature of the abnormal event of the protective equipment; The position information of the personnel in the motion path when the structural abnormality event of the protective equipment occurs during the personnel working at height, which is included in the abnormal event occurrence characteristics of the protective equipment, is spatially compared with the mapped position information to determine the relative distance between the two; based on the relative distance, the hazard source characteristics of the personnel during the working at height are identified; wherein the hazard source characteristics include the structural defect position distribution information inside the protective equipment; The alarm notification module is used to perform alarm notification operations based on the characteristics of the hazard source, including: based on the structural defect location distribution information inside the protective equipment, performing voice notification operations on the personnel and uploading platform message alarm operations.

Images