Power tower hardware identification control method and related device

Abstract

Embodiments of the present application disclose a power tower hardware identification control method and related device, the method comprising: photographing a target power tower with a pan-tilt camera at a first photographing parameter to obtain a first image; performing power tower hardware multi-scale target identification on the first image by a target power tower hardware identification model to obtain k power tower hardware, each power tower hardware corresponding to a scale parameter; determining a target working parameter corresponding to the pan-tilt module and a second photographing parameter of the pan-tilt camera according to the scale parameter of a target first power tower hardware; the target first power tower hardware is one of the k power tower hardware; controlling the pan-tilt module to work at the target working parameter, and controlling the pan-tilt camera to photograph the target first power tower hardware at the second photographing parameter to obtain a second image, so as to improve the screen ratio of the target first power tower hardware in the second image.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of image processing or the technical field of electric power, in particular to an electric power tower hardware identification control method and related device. BACKGROUND

[0002] In practical applications, electric power tower hardware has various types and different purposes, for example, various wire clamps for installing wires; for example, various hanging rings for forming insulator strings; for example, various compression pipes for connecting wires; for example, various types of spacer bars for repairing split conductor wires, various types of stay hardware for electric power towers, etc. Electric power tower hardware is related to the safety of wires or towers. Even if one is damaged, it may cause line failure. However, electric power tower hardware is often high above the ground, and maintenance is relatively inconvenient. Therefore, how to accurately identify electric power tower hardware through images to improve the maintenance efficiency of electric power tower hardware is an urgent problem to be solved. SUMMARY

[0003] The embodiments of the present application provide an electric power tower hardware identification control method and related device to accurately identify electric power tower hardware through images to improve the maintenance efficiency of electric power tower hardware.

[0004] In a first aspect, the embodiments of the present application provide an electric power tower hardware identification control method applied to an electronic device, wherein the electronic device is in communication connection with a gimbal camera, and the gimbal camera includes a gimbal module; the method includes:

[0005] photographing a target electric power tower through the gimbal camera with first photographing parameters to obtain a first image;

[0006] performing electric power tower hardware multi-scale target identification on the first image through a target electric power tower hardware identification model to obtain k electric power tower hardware, each electric power tower hardware corresponding to a scale parameter; k is a positive integer;

[0007] determining target working parameters corresponding to the gimbal module and second photographing parameters of the gimbal camera according to a scale parameter of a target first electric power tower hardware; the target first electric power tower hardware is one of the k electric power tower hardware;

[0008] controlling the gimbal module to work with the target working parameters, and controlling the gimbal camera to photograph the target first electric power tower hardware with the second photographing parameters to obtain a second image, so as to improve the screen ratio of the target first electric power tower hardware in the second image.

[0009] In a second aspect, an embodiment of the present application provides an electric power tower fitting identification and control device, applied to an electronic device, the electronic device being in communication connection with a gimbal camera, the gimbal camera comprising a gimbal module; the device comprising: a photographing unit, an identification unit, a determination unit and a control unit, wherein,

[0010] The photographing unit is configured to photograph a target electric power tower by the gimbal camera with first photographing parameters to obtain a first image.

[0011] The identification unit is configured to perform electric power tower fitting multi-scale target identification on the first image by a target electric power tower fitting identification model to obtain k electric power tower fittings, each electric power tower fitting corresponding to a scale parameter; k is a positive integer.

[0012] The determination unit is configured to determine target working parameters corresponding to the gimbal module and second photographing parameters of the gimbal camera according to a scale parameter of a target first electric power tower fitting; the target first electric power tower fitting is one of the k electric power tower fittings.

[0013] The control unit is configured to control the gimbal module to work with the target working parameters, and control the gimbal camera to photograph the target first electric power tower fitting with the second photographing parameters to obtain a second image, so as to improve a screen ratio of the target first electric power tower fitting in the second image.

[0014] In a third aspect, an embodiment of the present application provides an electronic device, comprising a processor, a memory, a communication interface and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, and the programs comprise instructions for performing the steps in the first aspect of the embodiments of the present application.

[0015] In a fourth aspect, an embodiment of the present application provides a computer readable storage medium, wherein the computer readable storage medium stores a computer program for electronic data exchange, and the computer program causes a computer to perform some or all of the steps described in the first aspect of the embodiments of the present application.

[0016] In a fifth aspect, an embodiment of the present application provides a computer program product, wherein the computer program product includes a non-transitory computer readable storage medium storing a computer program, and the computer program is operable to cause a computer to perform some or all of the steps described in the first aspect of the embodiments of the present application. The computer program product can be a software installation package.

[0017] By implementing the embodiments of the present application, the following beneficial effects are achieved:

[0018] It can be seen that the power tower hardware identification control method and related device described in the embodiments of the present application are applied to an electronic device, the electronic device is in communication connection with a gimbal camera, and the gimbal camera comprises a gimbal module; the target power tower is photographed by the gimbal camera at a first shooting parameter to obtain a first image; a power tower hardware multi-scale target identification is performed on the first image by a target power tower hardware identification model to obtain k power tower hardware, each power tower hardware corresponds to a scale parameter; k is a positive integer; a target working parameter corresponding to the gimbal module and a second shooting parameter of the gimbal camera are determined according to the scale parameter of a target first power tower hardware; the target first power tower hardware is one of the k power tower hardware; the gimbal module is controlled to work at the target working parameter, and the gimbal camera is controlled to shoot the target first power tower hardware at the second shooting parameter to obtain a second image, so as to improve the screen ratio of the target first power tower hardware in the second image. On the one hand, the target power tower hardware identification model can be used to perform power tower hardware multi-scale target identification on the image based on the target power tower to obtain the power tower hardware required by the user. On the other hand, the working parameter of the gimbal module and the shooting parameter can be dynamically adjusted based on the scale parameter of the power tower hardware to improve the screen ratio of the power tower hardware. In this way, accurate image recognition of the power tower hardware can be realized to improve the maintenance and maintenance efficiency of the power tower hardware. BRIEF DESCRIPTION OF DRAWINGS

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the drawings needed to be used in the embodiments or prior art description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0020] Figure 1 is a flowchart of a power tower hardware identification control method provided by an embodiment of the present application;

[0021] Figure 2 is a structural schematic diagram of an electronic device provided by an embodiment of the present application;

[0022] Figure 3 is a structural schematic diagram of another electronic device provided by an embodiment of the present application;

[0023] Figure 4 is a functional unit composition block diagram of a power tower hardware identification control device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0024] In the following, the technical solutions in the embodiments of the present application will be described clearly and completely in conjunction with the drawings in the embodiments of the present application, so that those skilled in the art can better understand the present application. Obviously, the described embodiments are only some of the embodiments of the present application, but not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work fall within the scope of the present application.

[0025] The terms "first", "second", and the like in the specification and claims of the present application and the above-described drawings are used to distinguish different objects, and are not used to describe a particular order. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but can optionally include steps or units not listed, or can optionally include other steps or units inherent to the process, method, product or device.

[0026] In this document, the term "embodiment" means that the specific features, structures or characteristics described in connection with the embodiment can be included in at least one embodiment of the present application. The appearance of this phrase in various places in the specification does not necessarily mean the same embodiment, nor is it independent or alternative to other embodiments. Those skilled in the art explicitly and implicitly understand that the embodiments described herein can be combined with other embodiments.

[0027] In the embodiments of the present application, the electronic device can include at least one of the following: a flying device (e.g., manned flying device or unmanned flying device (drone)), mobile phone, server, etc., which is not limited here.

[0028] The embodiments of the present application will be described in detail below.

[0029] Please refer to Figure 1 , Figure 1 is a flowchart of a power tower hardware identification control method provided by an embodiment of the present application, as shown in the figure, applied to an electronic device, the electronic device is in communication connection with a gimbal camera, the gimbal camera includes a gimbal module; the power tower hardware identification control method includes:

[0030] 101, the target power tower is photographed by the gimbal camera with the first shooting parameter to obtain the first image.

[0031] Wherein, the first shooting parameter can include at least one of the following: sensitivity, exposure, shooting mode, shooting time, focal length, etc., which is not limited here.

[0032] In specific implementation, for example, Figure 2As shown, the electronic device can be in communication connection with the gimbal camera, and the gimbal camera includes a gimbal module, for example, the electronic device can be a drone, and the drone carries the gimbal camera, for example, the gimbal module of the gimbal camera can adjust the shooting angle and ensure the stability of the shooting. The drone and the gimbal camera can be integrated or can be separated.

[0033] In specific implementation, the target power pole tower can be shot by the gimbal camera with the first shooting parameter to obtain a first image, so that the corresponding image of the target power pole tower can be obtained, and since many power pole tower fittings are carried on the target power pole tower, the power pole tower fittings can be identified based on the image.

[0034] Optionally, before the step 101, the following steps can also be included:

[0035] determining a second distance between the gimbal camera and a preset position of the target power pole tower;

[0036] determining an initial shooting parameter corresponding to the second distance;

[0037] obtaining a target environment parameter;

[0038] determining a second adjustment parameter corresponding to the target environment parameter;

[0039] adjusting the initial shooting parameter according to the second adjustment parameter to obtain the first shooting parameter.

[0040] wherein, the preset position can be pre-set or system default.

[0041] wherein, the initial shooting parameter can include at least one of the following: sensitivity, exposure, shooting mode, shooting time, focal length, etc., which are not limited here.

[0042] wherein, the environment parameter can include at least one of the following: weather, ambient brightness, air density, direction, air humidity, temperature, atmospheric pressure, etc., which are not limited here.

[0043] In specific implementation, the gimbal camera can carry a binocular camera, and the binocular camera can be used to realize the distance measuring function, so that the second distance between the gimbal camera and the preset position of the target power pole tower can be determined, and the mapping relationship between the preset distance and the shooting parameter can be pre-stored, so that the initial shooting parameter corresponding to the second distance can be determined based on the mapping relationship, and thus the shooting parameter corresponding to the distance can be obtained.

[0044] Then, the target environment parameter can also be acquired, and a mapping relationship between preset environment parameters and adjustment parameters is pre-stored, and then the second adjustment parameter corresponding to the target environment parameter can be determined based on the mapping relationship, and the initial shooting parameter is adjusted according to the second adjustment parameter to obtain the first shooting parameter. The adjustment parameter can adjust part or all of the initial shooting parameters, so that not only the shooting parameter corresponding to the distance can be obtained, but also the shooting parameter can be adjusted, so that the final shooting parameter depth conforms to the actual environment, which helps to improve the shooting effect and ensure the identification accuracy of the power tower fittings.

[0045] 102. performing power tower fitting multi-scale target identification on the first image by the target power tower fitting identification model to obtain k power tower fittings, each power tower fitting corresponding to a scale parameter; k is a positive integer.

[0046] In the embodiments of the present application, the target power tower fitting identification model can be pre-set or system default. For example, the target power tower fitting identification model can be a deep learning model or a neural network model or an artificial intelligence model, etc., which is not limited herein. For example, the target power tower fitting identification model can be at least one of the following: a convolutional neural network model, a fully connected neural network model, a recurrent neural network model, etc., which is not limited herein.

[0047] The target power tower fitting identification model can be used to realize at least one of the following functions: identifying the type of the power tower fitting, whether it is in the power tower fitting, the model of the power tower fitting, the scale parameter of the power tower fitting, the probability that the power tower fitting belongs to a certain fitting type, the fault type of the power tower fitting, the fault probability of the power tower fitting, the cleanliness of the power tower fitting, etc., which is not limited herein.

[0048] In specific implementation, a large number of images of power tower fittings can be acquired, the features of these images of power tower fittings are extracted to obtain image features, and the image features are input into the initial power tower fitting identification model for training. When the initial power tower fitting identification model meets the preset condition, the target power tower fitting identification model is obtained. The preset condition can be pre-set or system default. For example, the preset condition can be to reach a preset training number, and for another example, the preset condition can be to reach a preset model accuracy. The preset training number and the preset model accuracy can be pre-set or system default.

[0049] The image features can include at least one of the following: feature points, feature vectors, feature values, colors of power tower fittings, shapes of power tower fittings, etc., which are not limited herein.

[0050] In specific implementation, the target power tower hardware identification model can be used to perform multi-scale target identification on the first image to obtain k power tower hardware, each power tower hardware corresponding to a scale parameter; k is a positive integer. The scale parameter reflects the size of the target power tower hardware in the first image to some extent.

[0051] Optionally, the step 102 of performing multi-scale target identification on the first image by using the target power tower hardware identification model to obtain k power tower hardware can include the following steps:

[0052] Obtaining initial model parameters of the target power tower hardware identification model;

[0053] Determining a second screen ratio of the target power tower in the first image;

[0054] Determining a first adjustment parameter corresponding to the second screen ratio;

[0055] Obtaining first attribute information of the target power tower;

[0056] Determining a target power tower hardware distribution parameter corresponding to the first attribute information;

[0057] Determining a first fine-tuning parameter corresponding to the target power tower hardware distribution parameter;

[0058] Adjusting the initial model parameters according to the first adjustment parameter and the first fine-tuning parameter to obtain target model parameters;

[0059] Performing multi-scale target identification on the first image by using the target power tower hardware identification model and the target model parameters to obtain the k power tower hardware.

[0060] The first attribute information of the target power tower can include at least one of the following: a model of the power tower, a number of the power tower, a coordinate position of the power tower, a function of the power tower, and the like, which are not limited herein.

[0061] In specific implementation, different power tower hardware identification models can correspond to different model parameters, which are used to determine the model capability, identification accuracy, identification efficiency, and the like of the power tower hardware identification model, which are not limited herein.

[0062] In the embodiments of the present application, initial model parameters of the target power tower hardware identification model can be obtained, which can be pre-set or system default. Based on the first image, a second screen ratio of the target power tower in the first image, i.e., a ratio between the area of the target power tower in the first image and the entire area of the first image, can be determined as the second screen ratio.

[0063] In a specific implementation, since different screen ratios can correspond to different adjustment parameters, a mapping relationship between preset screen ratios and adjustment parameters can be pre-stored, that is, the first adjustment parameter corresponding to the second screen ratio can be determined based on the mapping relationship, and the first attribute information of the target power tower can also be obtained, and since different power towers have different power tower fittings carried by them, that is, the power tower fitting distribution is different, a mapping relationship between preset attribute information and power tower fitting distribution parameters can be pre-stored, and then the target power tower fitting distribution parameter corresponding to the first attribute information can be determined based on the mapping relationship, and a mapping relationship between preset power tower fitting distribution parameters and fine adjustment parameters is pre-stored, then the first fine adjustment parameter corresponding to the target power tower fitting distribution parameter can be determined based on the mapping relationship, and the initial model parameter is adjusted according to the first adjustment parameter and the first fine adjustment parameter to obtain the target model parameter, that is, the target model parameter=(1+first adjustment parameter)*(1+first fine adjustment parameter)*initial model parameter, that is, the target model parameter can be used to perform power tower fitting multi-scale target identification on the first image through the target power tower fitting identification model, and k power tower fittings are obtained. In this way, on the one hand, since the screen ratio of the power tower will also affect the model identification accuracy to some extent, the initial model parameter can be adjusted based on the screen ratio of the power tower, and on the other hand, considering the inherent characteristics (first attribute information) of the power tower, which determines the distribution density, distribution position, and distribution area of the power tower fitting to some extent, the power tower fitting distribution parameter corresponding to the inherent characteristics of the power tower can be determined, and the model parameter is dynamically fine-tuned based on the power tower fitting distribution parameter, so that the model identification ability is matched with the power tower fitting distribution, and the identification accuracy of the power tower fitting distribution area is ensured, so that the target power tower fitting identification model has regional key identification ability, and the power tower fitting identification accuracy is further ensured.

[0064] Optionally, the step of obtaining the initial model parameter of the target power tower fitting identification model can include the following steps:

[0065] Obtaining the second attribute information of the power tower fitting to be identified;

[0066] Obtaining the initial model parameter of the target power tower fitting identification model according to the second attribute information.

[0067] In the embodiments of the present application, the second attribute information of the power tower hardware to be identified can include at least one of the following: the model of the power tower hardware, the appearance of the power tower hardware, the size of the power tower hardware, the color of the power tower hardware, the material of the power tower hardware, the setting position of the power tower hardware, the purpose or function of the power tower hardware, and the like, without limitation.

[0068] In a specific implementation, the second attribute information of the power tower hardware to be identified can be acquired, and a mapping relationship between the preset attribute information and the initial model parameters of the target power tower hardware identification model can be pre-stored, and then the initial model parameters of the target power tower hardware identification model corresponding to the second attribute information can be determined based on the mapping relationship, so that the power tower hardware to be identified can be accurately identified based on user demand, and the identification accuracy of the specified power tower hardware is further improved.

[0069] 103. Determine the target working parameters corresponding to the gimbal module and the second shooting parameters of the gimbal camera according to the scale parameters of the target first power tower hardware; the target first power tower hardware is one of the k power tower hardware.

[0070] In the embodiments of the present application, the second shooting parameters can include at least one of the following: sensitivity, exposure, shooting mode, shooting time, focal length, and the like, without limitation.

[0071] The target working parameters corresponding to the gimbal module can include at least one of the following: rotation rate, rotation angle, driving force, driving direction, working current, working voltage, working power, and the like, without limitation.

[0072] In the embodiments of the present application, taking the target first power tower hardware as an example, the target first power tower hardware is one of the k power tower hardware, then the target working parameters corresponding to the gimbal module and the second shooting parameters of the gimbal camera can be determined according to the scale parameters of the target first power tower hardware, and then the gimbal module can be adjusted to face the target first power tower hardware for shooting, and the shooting parameters can be adjusted based on the relative position relationship between the gimbal camera and the target first power tower hardware, so that the shooting parameters are in deep accordance with the actual situation, thereby ensuring that the target first power tower hardware has sufficient screen occupation ratio, not only ensuring the identification accuracy of the target first power tower hardware, but also facilitating user viewing and improving user experience.

[0073] Optionally, the step 103 of determining the target working parameters corresponding to the gimbal module and the second shooting parameters of the gimbal camera according to the scale parameters of the target first power tower hardware can include the following steps:

[0074] acquire a first relative angle between the pan-tilt camera and the target first power-pole-tower fitting through the first image;

[0075] determine the target working parameter corresponding to the pan-tilt module according to the first relative angle, the target working parameter being used to adjust the first relative angle to a preset relative angle range;

[0076] determine a first screen-occupying ratio of the target first power-pole-tower fitting in the first image according to the dimension parameter of the target first power-pole-tower fitting;

[0077] determine a first distance between the pan-tilt camera and the target first power-pole-tower fitting;

[0078] determine a reference screen-occupying ratio corresponding to the first distance;

[0079] determine a first deviation between the first screen-occupying ratio and the reference screen-occupying ratio;

[0080] determine a target optimization parameter corresponding to the first deviation;

[0081] optimize the first shooting parameter according to the target optimization parameter to obtain the second shooting parameter.

[0082] The preset relative angle range can be pre-set or system default. Being in the preset relative angle range can be understood as facing directly to shooting.

[0083] In the embodiments of the present application, the first relative angle between the pan-tilt camera and the target first power-pole-tower fitting can be acquired through the first image. Then, the target working parameter corresponding to the pan-tilt module can be determined according to the first relative angle. The target working parameter is used to adjust the first relative angle to a preset relative angle range. For example, the target angle difference value between the first relative angle and the middle value of the preset relative angle range can be determined. The target working parameter corresponding to the first relative angle can be determined according to the mapping relationship between the preset angle difference value and the working parameter.

[0084] Of course, since the scale parameter reflects the size to some extent, the first screen ratio of the target first power tower hardware in the first image can be determined according to the scale parameter of the target first power tower hardware, the first distance between the gimbal camera and the target first power tower hardware can also be determined, and a mapping relationship between the preset distance and the screen ratio can be pre-stored, and then the reference screen ratio corresponding to the first distance can be determined based on the mapping relationship, and the first deviation between the first screen ratio and the reference screen ratio can be determined, the first deviation = (the first screen ratio - the reference screen ratio) / the reference screen ratio, and a mapping relationship between the preset deviation and the optimization parameter can be pre-stored, and then the target optimization parameter corresponding to the first deviation can be determined based on the mapping relationship, and the first shooting parameter can be optimized based on the target optimization parameter to obtain the second shooting parameter. In this way, not only can the working parameter of the gimbal module be dynamically adapted based on the relative angle between the gimbal camera and the target first power tower hardware, but also the deviation between the current screen ratio and the ideal screen ratio can be dynamically optimized based on the scale parameter of the target first power tower hardware and the distance, so that the final shooting parameter can meet the screen ratio requirement and the actual position relationship between the gimbal camera and the target first power tower hardware, thereby further achieving accurate image recognition of the power tower hardware to improve the maintenance efficiency of the power tower hardware.

[0085] 104. Control the gimbal module to work at the target working parameter, and control the gimbal camera to shoot the target first power tower hardware at the second shooting parameter to obtain a second image, so as to improve the screen ratio of the target first power tower hardware in the second image.

[0086] In a specific implementation, the gimbal module can be controlled to work at the target working parameter, and the gimbal camera can be controlled to shoot the target first power tower hardware at the second shooting parameter to obtain a second image, so as to improve the screen ratio of the target first power tower hardware in the second image. In this way, the working parameter and the shooting parameter of the gimbal module can be dynamically adjusted based on the scale parameter of the power tower hardware to improve the screen ratio of the power tower hardware, so that accurate image recognition of the power tower hardware can be achieved to improve the maintenance efficiency of the power tower hardware.

[0087] For example, an AI model of the power tower hardware can be obtained through computer deep learning, and the recognition accuracy of different screen ratio target objects can be solved, so that small scale target objects can be found in a wide angle view, the gimbal module is driven to rotate quickly and widely, and the zoom is adjusted to a certain magnification; on the contrary, large scale target objects can be found in the view of the zoom camera, and the gimbal module and the zoom lens are driven to fine-tune in a small range. In this way, accurate shooting angle and target object screen ratio can be achieved.

[0088] It can be seen that the power tower hardware identification control method described in the embodiments of the present application is applied to an electronic device, the electronic device is in communication connection with a gimbal camera, and the gimbal camera comprises a gimbal module; the target power tower is photographed by the gimbal camera at a first shooting parameter to obtain a first image; a power tower hardware multi-scale target identification is performed on the first image by a target power tower hardware identification model to obtain k power tower hardware, each power tower hardware corresponds to a scale parameter; k is a positive integer; a target working parameter corresponding to the gimbal module and a second shooting parameter of the gimbal camera are determined according to the scale parameter of a target first power tower hardware; the target first power tower hardware is one of the k power tower hardware; the gimbal module is controlled to work at the target working parameter, and the gimbal camera is controlled to photograph the target first power tower hardware at the second shooting parameter to obtain a second image, so as to improve the screen ratio of the target first power tower hardware in the second image. On the one hand, the target power tower hardware identification model can be used to perform power tower hardware multi-scale target identification on the image based on the target power tower to obtain the power tower hardware required by the user. On the other hand, the working parameter of the gimbal module and the shooting parameter can be dynamically adjusted based on the scale parameter of the power tower hardware to improve the screen ratio of the power tower hardware. In this way, accurate image recognition of the power tower hardware can be realized to improve the maintenance and maintenance efficiency of the power tower hardware.

[0089] Consistent with the above embodiments, please refer to Figure 3 , Figure 3 is another structure schematic diagram of an electronic device provided by the embodiments of the present application, as shown in the figure, the electronic device comprises a processor, a memory, a communication interface and one or more programs, the above-mentioned one or more programs are stored in the above-mentioned memory, and are configured to be executed by the above-mentioned processor, in the embodiments of the present application, the electronic device is in communication connection with a gimbal camera, and the gimbal camera comprises a gimbal module; the above-mentioned program comprises instructions for executing the following steps:

[0090] photographing a target power tower by the gimbal camera at a first shooting parameter to obtain a first image;

[0091] performing a power tower hardware multi-scale target identification on the first image by a target power tower hardware identification model to obtain k power tower hardware, each power tower hardware corresponds to a scale parameter; k is a positive integer;

[0092] determining a target working parameter corresponding to the gimbal module and a second shooting parameter of the gimbal camera according to the scale parameter of a target first power tower hardware; the target first power tower hardware is one of the k power tower hardware.

[0093] control the gimbal module to work at the target working parameter, and control the gimbal camera to shoot the target first power tower fitting at the second shooting parameter, to obtain a second image, so as to improve the screen ratio of the target first power tower fitting in the second image.

[0094] Optionally, in the aspect of determining the target working parameter corresponding to the gimbal module and the second shooting parameter of the gimbal camera according to the scale parameter of the target first power tower fitting, the above program includes instructions for performing the following steps:

[0095] obtain a first relative angle between the gimbal camera and the target first power tower fitting through the first image;

[0096] determine the target working parameter corresponding to the gimbal module according to the first relative angle, the target working parameter being used to adjust the first relative angle to a preset relative angle range;

[0097] determine a first screen ratio of the target first power tower fitting in the first image according to the scale parameter of the target first power tower fitting;

[0098] determine a first distance between the gimbal camera and the target first power tower fitting;

[0099] determine a reference screen ratio corresponding to the first distance;

[0100] determine a first deviation between the first screen ratio and the reference screen ratio;

[0101] determine a target optimization parameter corresponding to the first deviation;

[0102] optimize the first shooting parameter according to the target optimization parameter to obtain the second shooting parameter.

[0103] Optionally, in the aspect of performing power tower fitting multi-scale target identification on the first image through the target power tower fitting identification model to obtain k power tower fittings, the above program includes instructions for performing the following steps:

[0104] obtain initial model parameters of the target power tower fitting identification model;

[0105] determine a second screen ratio of the target power tower in the first image;

[0106] determine a first adjustment parameter corresponding to the second screen ratio;

[0107] obtain first attribute information of the target power tower;

[0108] determine a target power tower fitting distribution parameter corresponding to the first attribute information;

[0109] determine a first fine-tuning parameter corresponding to the target power tower fitting distribution parameter;

[0110] adjust the initial model parameter according to the first adjustment parameter and the first fine-tuning parameter to obtain a target model parameter;

[0111] perform power tower fitting multi-scale target identification on the first image through a target power tower fitting identification model with the target model parameter to obtain the k power tower fittings.

[0112] Optionally, in the aspect of obtaining the initial model parameter of the target power tower fitting identification model, the above program includes instructions for performing the following steps:

[0113] obtain second attribute information of the power tower fitting to be identified;

[0114] obtain the initial model parameter of the target power tower fitting identification model according to the second attribute information.

[0115] Optionally, the above program further includes instructions for performing the following steps:

[0116] determine a second distance between the gimbal camera and a preset position of the target power tower;

[0117] determine an initial shooting parameter corresponding to the second distance;

[0118] obtain a target environment parameter;

[0119] determine a second adjustment parameter corresponding to the target environment parameter;

[0120] adjust the initial shooting parameter according to the second adjustment parameter to obtain the first shooting parameter.

[0121] It can be seen that the electronic device described in the embodiments of the present application is in communication connection with a gimbal camera, the gimbal camera includes a gimbal module; the target power pole tower is photographed by the gimbal camera with first shooting parameters to obtain a first image; the first image is subjected to power pole tower hardware multi-scale target identification by a target power pole tower hardware identification model to obtain k power pole tower hardware, each power pole tower hardware corresponds to a scale parameter; k is a positive integer; target working parameters corresponding to the gimbal module and second shooting parameters of the gimbal camera are determined according to the scale parameter of a target first power pole tower hardware; the target first power pole tower hardware is one of the k power pole tower hardware; the gimbal module is controlled to work with the target working parameters, and the gimbal camera is controlled to photograph the target first power pole tower hardware with the second shooting parameters to obtain a second image, so as to improve the screen ratio of the target first power pole tower hardware in the second image. On the one hand, the target power pole tower hardware identification model can be used to realize power pole tower hardware multi-scale target identification based on the image of the target power pole tower to obtain the power pole tower hardware required by the user. On the other hand, the working parameters and the shooting parameters of the gimbal module can be dynamically adjusted based on the scale parameter of the power pole tower hardware to improve the screen ratio of the power pole tower hardware. In this way, accurate image identification of the power pole tower hardware can be realized to improve the maintenance and maintenance efficiency of the power pole tower hardware.

[0122] Figure 4 is a functional unit composition block diagram of a power pole tower hardware identification control device 400 involved in the embodiments of the present application. The power pole tower hardware identification control device 400 is applied to an electronic device in communication connection with a gimbal camera, the gimbal camera includes a gimbal module; the power pole tower hardware identification control device 400 includes a shooting unit 401, an identification unit 402, a determination unit 403 and a control unit 404, wherein,

[0123] The shooting unit 401 is configured to photograph a target power pole tower by the gimbal camera with first shooting parameters to obtain a first image;

[0124] The identification unit 402 is configured to perform power pole tower hardware multi-scale target identification on the first image by a target power pole tower hardware identification model to obtain k power pole tower hardware, each power pole tower hardware corresponds to a scale parameter; k is a positive integer;

[0125] The determination unit 403 is configured to determine target working parameters corresponding to the gimbal module and second shooting parameters of the gimbal camera according to the scale parameter of a target first power pole tower hardware; the target first power pole tower hardware is one of the k power pole tower hardware;

[0126] The control unit 404 is configured to control the gimbal module to work at the target working parameter, and control the gimbal camera to shoot the target first power tower fitting at the second shooting parameter to obtain a second image, so as to improve the screen ratio of the target first power tower fitting in the second image.

[0127] Optionally, in the aspect of determining the target working parameter corresponding to the gimbal module and the second shooting parameter of the gimbal camera according to the scale parameter of the target first power tower fitting, the determination unit 403 is specifically configured to:

[0128] obtain a first relative angle between the gimbal camera and the target first power tower fitting through the first image;

[0129] determine the target working parameter corresponding to the gimbal module according to the first relative angle, the target working parameter being used to adjust the first relative angle to a preset relative angle range;

[0130] determine a first screen ratio of the target first power tower fitting in the first image according to the scale parameter of the target first power tower fitting;

[0131] determine a first distance between the gimbal camera and the target first power tower fitting;

[0132] determine a reference screen ratio corresponding to the first distance;

[0133] determine a first deviation between the first screen ratio and the reference screen ratio;

[0134] determine a target optimization parameter corresponding to the first deviation;

[0135] optimize the first shooting parameter according to the target optimization parameter to obtain the second shooting parameter.

[0136] Optionally, in the aspect of performing power tower fitting multi-scale target identification on the first image through the target power tower fitting identification model to obtain k power tower fittings, the identification unit 402 is specifically configured to:

[0137] obtain initial model parameters of the target power tower fitting identification model;

[0138] determine a second screen ratio of the target power tower in the first image;

[0139] determine a first adjustment parameter corresponding to the second screen ratio;

[0140] obtain first attribute information of the target power tower;

[0141] determine a target power tower fitting distribution parameter corresponding to the first attribute information;

[0142] determine a first fine-tuning parameter corresponding to the target power tower fitting distribution parameter;

[0143] adjust the initial model parameter according to the first adjustment parameter and the first fine-tuning parameter to obtain a target model parameter;

[0144] perform power tower fitting multi-scale target identification on the first image by using the target power tower fitting identification model and the target model parameter to obtain the k power tower fittings.

[0145] Optionally, in the aspect of obtaining the initial model parameter of the target power tower fitting identification model, the identification unit 402 is specifically configured to:

[0146] obtain second attribute information of the power tower fitting to be identified;

[0147] obtain the initial model parameter of the target power tower fitting identification model according to the second attribute information.

[0148] Optionally, the power tower fitting identification control apparatus 400 is further specifically configured to:

[0149] determine a second distance between the pan-tilt camera and a preset position of the target power tower;

[0150] determine an initial shooting parameter corresponding to the second distance;

[0151] obtain a target environment parameter;

[0152] determine a second adjustment parameter corresponding to the target environment parameter;

[0153] adjust the initial shooting parameter according to the second adjustment parameter to obtain the first shooting parameter.

[0154] It can be seen that the power tower hardware identification control device described in the embodiment of the application is applied to an electronic device, the electronic device is in communication connection with a gimbal camera, the gimbal camera comprises a gimbal module; the target power tower is photographed by the gimbal camera with a first shooting parameter to obtain a first image; a power tower hardware multi-scale target identification is performed on the first image by a target power tower hardware identification model to obtain k power tower hardware, each power tower hardware corresponds to a scale parameter; k is a positive integer; a target working parameter corresponding to the gimbal module and a second shooting parameter of the gimbal camera are determined according to the scale parameter of a target first power tower hardware; the target first power tower hardware is one of the k power tower hardware; the gimbal module is controlled to work with the target working parameter, and the gimbal camera is controlled to shoot the target first power tower hardware with the second shooting parameter to obtain a second image, so as to improve the screen ratio of the target first power tower hardware in the second image. On the one hand, the target power tower hardware identification model can be used to perform power tower hardware multi-scale target identification on the image based on the target power tower to obtain the power tower hardware required by the user. On the other hand, the working parameter and the shooting parameter of the gimbal module can be dynamically adjusted based on the scale parameter of the power tower hardware to improve the screen ratio of the power tower hardware. In this way, accurate image recognition of the power tower hardware can be realized to improve the maintenance and maintenance efficiency of the power tower hardware.

[0155] It can be understood that the functions of each program module of the power tower hardware identification control device of the embodiment can be specifically implemented according to the methods in the above method embodiments, and the specific implementation process can be referred to the related description of the above method embodiments, which will not be described here.

[0156] The embodiment of the application further provides a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, and the computer program causes a computer to execute part or all steps of any method described in the above method embodiments.

[0157] The embodiment of the application further provides a computer program product, and the above computer program product comprises a non-transitory computer readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute part or all steps of any method described in the above method embodiments. The computer program product can be a software installation package.

[0158] It should be noted that, for the foregoing method embodiments, the sequences of the described actions are not necessarily required to achieve the objects of the application, and certain steps can be performed in other sequences or even concurrently. Additionally, the described embodiments are merely provided as examples, and not all of the actions described are necessarily required to achieve desired results.

[0159] In the above embodiments, the description of each embodiment is focused on different aspects, and the parts not described in detail in a certain embodiment can be referred to the relevant description of other embodiments.

[0160] In several embodiments provided in the present application, it should be understood that the disclosed apparatus can be implemented in other ways. For example, the apparatus embodiments described above are merely schematic. For example, the division of the above units is merely a logical function division. In actual implementation, another division manner can be adopted. For example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units shown or discussed can be indirect coupling or communication connection through some interfaces, apparatuses or units, and can be electrical or other forms.

[0161] The units described as separate components can or can not be physically separate, and the components shown as units can or can not be physical units, i.e., can be located in one place, or can be distributed on a plurality of network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.

[0162] In addition, each functional unit in each embodiment of the present application can be integrated in one processing unit, or each unit can exist physically, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.

[0163] If the above integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer readable memory. Based on this understanding, the technical solutions of the present application essentially or the part that contributes to the prior art or the whole or part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a memory and includes a plurality of instructions for causing a computer device (which can be a personal computer, a server or a network device, etc.) to execute all or part of the steps of the above-mentioned method of each embodiment of the present application. The aforementioned memory includes: a U disk, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk, and various media that can store program codes.

[0164] A person of ordinary skill in the art can understand that all or part of the steps in the above-mentioned embodiments can be completed by instructing the relevant hardware through a program, which can be stored in a computer readable memory. The memory can include: a flash disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0165] The embodiments of the present application are described in detail above, and the specific examples are applied to the principles and implementation modes of the present application. The above embodiment description is only used to help understand the method of the present application and its core idea; at the same time, for those skilled in the art, according to the idea of the present application, the specific implementation mode and application range will be changed; in summary, the content of the specification should not be understood as a limitation of the present application.

Claims

1. A power tower fitting identification control method, characterized by, The application is applied to an electronic device in communication connection with a gimbal camera, and the gimbal camera comprises a gimbal module; the method comprises: photographing a target power pole tower with a first photographing parameter through the gimbal camera to obtain a first image; performing power pole tower hardware multi-scale target identification on the first image through a target power pole tower hardware identification model to obtain k power pole tower hardware, each power pole tower hardware corresponding to a scale parameter; k is a positive integer; the scale parameter reflects the size of the power pole tower hardware in the first image; determining a target working parameter corresponding to the gimbal module and a second photographing parameter of the gimbal camera according to the scale parameter of a target first power pole tower hardware; the target first power pole tower hardware is one of the k power pole tower hardware; controlling the gimbal module to work with the target working parameter, and controlling the gimbal camera to photograph the target first power pole tower hardware with the second photographing parameter to obtain a second image, so as to improve the screen ratio of the target first power pole tower hardware in the second image; wherein the power pole tower hardware multi-scale target identification on the first image through the target power pole tower hardware identification model to obtain k power pole tower hardware comprises: obtaining initial model parameters of the target power pole tower hardware identification model; determining a second screen ratio of the target power pole tower in the first image; determining a first adjustment parameter corresponding to the second screen ratio; obtaining first attribute information of the target power pole tower; determining a target power pole tower hardware distribution parameter corresponding to the first attribute information; determining a first fine adjustment parameter corresponding to the target power pole tower hardware distribution parameter; adjusting the initial model parameters according to the first adjustment parameter and the first fine adjustment parameter to obtain target model parameters, target model parameters = (1 + first adjustment parameter) * (1 + first fine adjustment parameter) * initial model parameters; performing power pole tower hardware multi-scale target identification on the first image through the target power pole tower hardware identification model with the target model parameters to obtain the k power pole tower hardware.

2. The method of claim 1, wherein, The determination of the target working parameter corresponding to the gimbal module and the second photographing parameter of the gimbal camera according to the scale parameter of the target first power pole tower hardware comprises: obtaining a first relative angle between the gimbal camera and the target first power pole tower hardware through the first image; determining the target working parameter corresponding to the gimbal module according to the first relative angle, the target working parameter being used to adjust the first relative angle to a preset relative angle range; determining a first screen ratio of the target first power pole tower hardware in the first image according to the scale parameter of the target first power pole tower hardware; determining a first distance between the gimbal camera and the target first power pole tower hardware; determining a reference screen ratio corresponding to the first distance; determining a first deviation between the first screen ratio and the reference screen ratio; determining a target optimization parameter corresponding to the first deviation; Optimize the first shooting parameter according to the target optimization parameter, and obtain the second shooting parameter.

3. The method of claim 1, wherein, The method further comprises: Determine a second distance between the pan-tilt camera and a preset position of the target power tower; Determine an initial shooting parameter corresponding to the second distance; 4. The method according to claim 1 or 2, characterized in that, Obtain a target environment parameter; Determine a second adjustment parameter corresponding to the target environment parameter; Adjust the initial shooting parameter according to the second adjustment parameter, and obtain the first shooting parameter. The device is applied to an electronic device, the electronic device is in communication connection with a pan-tilt camera, and the pan-tilt camera comprises a pan-tilt module; the device comprises a shooting unit, an identification unit, a determination unit, and a control unit, wherein: The shooting unit is configured to shoot a target power tower by the pan-tilt camera with a first shooting parameter, and obtain a first image; The identification unit is configured to perform power tower hardware multi-scale target identification on the first image by a target power tower hardware identification model, and obtain k power tower hardware, each power tower hardware corresponding to a scale parameter; k is a positive integer; the scale parameter reflects the size of the power tower hardware in the first image; 5. A power tower fitting identification control device, characterized by, The determination unit is configured to determine a target working parameter corresponding to the pan-tilt module and a second shooting parameter of the pan-tilt camera according to a scale parameter of a target first power tower hardware; the target first power tower hardware is one of the k power tower hardware; The control unit is configured to control the pan-tilt module to work with the target working parameter, and control the pan-tilt camera to shoot the target first power tower hardware with the second shooting parameter, and obtain a second image, so as to improve the screen ratio of the target first power tower hardware in the second image; In the aspect of performing power tower hardware multi-scale target identification on the first image by the target power tower hardware identification model, and obtaining k power tower hardware, the identification unit is specifically configured to: Obtain an initial model parameter of the target power tower hardware identification model; Determine a second screen ratio of the target power tower in the first image; Determine a first adjustment parameter corresponding to the second screen ratio; Obtain first attribute information of the target power tower; Determine a target power tower hardware distribution parameter corresponding to the first attribute information; Determine a first fine adjustment parameter corresponding to the target power tower hardware distribution parameter; Adjust the initial model parameter according to the first adjustment parameter and the first fine adjustment parameter, and obtain a target model parameter, target model parameter=(1+first adjustment parameter)*(1+first fine adjustment parameter)*initial model parameter; Perform power tower hardware multi-scale target identification on the first image by the target power tower hardware identification model with the target model parameter, and obtain the k power tower hardware. ​ ​ ​ 6. The apparatus of claim 5, wherein, In the aspects of determining the target working parameter corresponding to the pan-tilt module and the second shooting parameter of the pan-tilt camera according to the dimension parameter of the target first power tower fitting, the determining unit is specifically configured to: acquire a first relative angle between the pan-tilt camera and the target first power tower fitting through the first image; determine the target working parameter corresponding to the pan-tilt module according to the first relative angle, the target working parameter being used to adjust the first relative angle to a preset relative angle range; determine a first screen-occupying ratio of the target first power tower fitting in the first image according to the dimension parameter of the target first power tower fitting; determine a first distance between the pan-tilt camera and the target first power tower fitting; determine a reference screen-occupying ratio corresponding to the first distance; determine a first deviation between the first screen-occupying ratio and the reference screen-occupying ratio; determine a target optimization parameter corresponding to the first deviation; optimize the first shooting parameter according to the target optimization parameter to obtain the second shooting parameter.

7. An electronic device, comprising: A computer program product comprising a processor, a memory, the memory configured to store one or more programs for execution by the processor, the programs comprising instructions for performing the steps of the method of any of claims 1-4.

8. A computer-readable storage medium, characterized in that, A computer program for electronic data interchange, wherein the computer program causes a computer to perform the method of any of claims 1-4.

Images