Bird nest positioning method, device, equipment, medium and program product
By combining image and sound information to identify the location of the bird's nest, the problem of difficulty in discovering the bird's nest outside the image acquisition range is solved, and timely positioning of the bird's nest and stable maintenance of the power system is achieved.
Patent Information
- Application Number
- CN202411131662.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-16
- Publication Date
- 2024-12-03
AI Technical Summary
The prior art is difficult to find the location of the bird's nest outside the image acquisition range of the smart terminal device, especially when the bird's nest is blocked or the camera device takes a blind spot, which makes it difficult to discover and locate the bird's nest in a timely manner, affecting the stability of the power system.
By identifying whether bird image features exist in the area image information, and collecting regional sound information in real time when bird image features exist, determining the location of the bird's nest based on the sound information, and positioning it in combination with the image and sound information. After meeting the preset threshold conditions, the Determine the location of the bird's nest.
In the case of blind spots in image acquisition or monitoring blind spots, the location of the bird's nest can be discovered and positioned in a timely manner, reducing the power consumption of smart terminal equipment, and improving the stability of the power system.
Smart Images

Figure CN119064860A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of power transmission and image processing, and specifically to a bird's nest positioning method, device, equipment, medium and program product. Background Art
[0002] In the field of power transmission, short circuit or open circuit faults are very likely to occur in the transmission line, causing power outage. Therefore, the staff needs to check and inspect the safety hazards of the transmission line to reduce the possibility of power outage.
[0003] One of the factors affecting transmission line failures is the damage caused by bird nests. For example, bird nests are usually built on transmission line towers, and the materials of bird nests usually include straw and branches. These materials falling on live equipment can easily cause short circuit failures. Another example is the bird droppings flashover failure in the power system, and the line failure caused by birds moving around the lines or towers. Therefore, power system staff need to clean up bird nests on transmission lines in a timely manner to reduce the probability of bird damage failures in the power system.
[0004] At present, the existing technology uses intelligent terminals to collect images and videos of transmission lines, and uses image analysis and processing technology to identify the location of bird nests, so that operation and maintenance personnel can accurately locate and clean the bird nests based on the location of the bird nests.
[0005] However, the inventors found that the location of the bird's nest may appear outside the image acquisition range of the smart terminal. For example, the bird's nest is blocked by the device and the smart terminal cannot capture the bird's nest, making it difficult for the existing technology to detect and locate the bird's nest in time. Summary of the invention
[0006] The present application aims to provide a bird's nest positioning method, device, equipment, medium and program product.
[0007] According to one aspect of the present application, a method for locating a bird's nest is provided, comprising collecting regional image information of a target area. Identifying whether the regional image information contains bird image features to determine whether there are bird creatures in the target area. In the case where the regional image information contains bird image features, regional sound information is collected in real time. Based on the regional sound information, the location of the bird's nest is determined.
[0008] According to some embodiments, the location of a bird's nest is determined based on regional sound information, including analyzing whether the current regional sound information contains bird sound data; in the case where the current regional sound information contains bird sound data, determining the current bird location based on the current regional sound information; in the case where the determined bird location meets a preset threshold condition, determining the location of the bird's nest based on the determined bird locations; wherein the preset threshold conditions include the degree of aggregation of bird locations reaching a preset aggregation threshold, and / or the total number of bird locations reaching a preset number threshold.
[0009] According to some embodiments, the regional sound information includes sound information collected by at least two audio collectors respectively; wherein, determining the current bird position based on the current regional sound information includes identifying the bird sound data in the current sound information collected by at least two audio collectors; determining the collection time corresponding to each bird sound data in the current sound information; and determining the current bird position based on the collection time corresponding to each bird sound data in the current sound information.
[0010] According to some embodiments, the current bird position is determined according to the collection time corresponding to the bird sound data in each current sound information, including sorting the bird sound data in the current sound information in sequence according to the order of the collection time to obtain a bird sound data sequence corresponding to the current sound information; determining the bird sound data at the same sequence number in each bird sound data sequence as the bird sound data of the same sound source; and determining the current bird position corresponding to the same sound source according to the collection time of the bird sound data of the same sound source.
[0011] According to some embodiments, the method further includes issuing a stop collection instruction to control at least two audio collectors to stop collecting when the regional sound information meets a preset sleep condition; wherein the preset sleep condition includes that the regional sound information collected by at least two audio collectors within a preset time period does not contain bird sound data.
[0012] According to some embodiments, the method further includes identifying the bird species corresponding to each of the bird sound data to determine the bird species corresponding to each of the bird positions.
[0013] Wherein, when the determined bird positions meet the preset threshold conditions, the positions of bird nests are determined according to the determined bird positions, including classifying the bird positions according to bird species to obtain the bird positions corresponding to the bird species when the determined bird positions meet the preset threshold conditions. The positions of bird nests are determined according to the bird positions corresponding to the bird species.
[0014] According to some embodiments, identifying whether the regional image information has a bird image feature includes identifying whether the regional image information has a preset alarm feature. If the regional image information has a preset alarm feature, it is determined whether the preset alarm feature has a bird image feature to identify whether the regional image information has a bird image feature.
[0015] According to one aspect of the present application, a bird nest positioning device is proposed, comprising an image acquisition module, a bird image recognition module, a sound acquisition control module and a bird nest positioning module. The image acquisition module is used to acquire regional image information of a target area. The bird image recognition module is used to identify whether there are bird image features in the regional image information to determine whether there are bird creatures in the target area. The sound acquisition control module is used to acquire regional sound information in real time when there are bird image features in the regional image information. The bird nest positioning module is used to determine the location of the bird nest based on the regional sound information.
[0016] According to one aspect of the present application, a smart terminal device is provided, which includes: an audio acquisition module, a visual module and a control module. The audio acquisition module includes at least two audio collectors to collect regional sound information. The visual module collects regional image information of the target area.
[0017] The control module includes one or more processors; a memory for storing one or more programs; when the one or more programs are executed by the one or more processors, the one or more processors implement the above method.
[0018] According to one aspect of the present application, a computer-readable medium is provided, on which a computer program is stored. When the program is executed by a processor, the method described above is implemented.
[0019] According to one aspect of the present application, a computer program product is provided, which includes a computer program stored on a computer-readable storage medium, wherein the computer program includes program instructions, and when the program instructions are executed by a computer, the computer executes the above method.
[0020] Beneficial Effects
[0021] The present application first identifies whether there are bird image features in the regional image information, and if there are bird image features, uses the regional sound information to locate the bird's nest. The present application does not simply use image recognition to locate the bird's nest, but uses sound to locate the bird's nest. In this way, the bird's nest can be found and located in blind spots such as when the camera is blind or the bird's nest is blocked, so that the bird's nest can be found and located in time, which is conducive to timely processing after the bird's nest is found to maintain the stability of the power system. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0023] Figure 1 This is a flow chart of a bird's nest positioning method according to an embodiment of the present application;
[0024] Figure 2 This is a schematic diagram of the process of determining the location of a bird's nest in step S104 of the embodiment of the present application;
[0025] Figure 3 This is a flow chart of determining the current bird position in step S1042 of the present application embodiment;
[0026] Figure 4 This is a flow chart of step S33 of the present application embodiment for determining the current bird position according to the collection time;
[0027] Figure 5 This is a flow chart of determining the location of a bird's nest according to the location of the bird in step S1043 of the embodiment of the present application;
[0028] Figure 6 This is a schematic diagram of a flow chart of controlling an audio collector to stop collecting sound in a method for locating a bird's nest according to an embodiment of the present application;
[0029] Figure 7 This is a flow chart of identifying bird image features in step S102 of the present application embodiment;
[0030] Figure 8 A schematic diagram of the basic process of the bird's nest positioning method according to an embodiment of the present application;
[0031] Fig. 9 This is a block diagram of a bird's nest positioning device according to an embodiment of the present application;
[0032] Fig.10 A schematic diagram of a control module of an intelligent terminal device according to an embodiment of the present application; DETAILED DESCRIPTION
[0033] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in many forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this application will be comprehensive and complete and will fully convey the concepts of the example embodiments to those skilled in the art. The same reference numerals in the figures represent the same or similar parts, and thus their repeated description will be omitted.
[0034] The described features, structures or characteristics may be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced without one or more of these specific details, or other modes, components, materials, devices, etc. may be adopted. In these cases, known structures, methods, devices, implementations, materials or operations will not be shown or described in detail.
[0035] In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units that are not listed, or may optionally include other steps or units that are inherent to these processes, methods, products or devices.
[0036] The terms "first", "second" and the like in the specification and claims of this application and the above drawings are used to distinguish different objects rather than to describe a specific order.
[0037] The following is a clear and complete description of the technical solution of the present application in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present application.
[0038] According to one aspect of the present application, the present application provides a method for locating a bird's nest. Figure 1 The bird's nest positioning method is executed by an intelligent terminal device, and includes step S101, step S102, step S103 and step S104.
[0039] In step S101, regional image information of a target region is collected.
[0040] According to an exemplary embodiment, the intelligent terminal device includes a visual module and a control module. The visual module is used to capture an image to collect corresponding image information.
[0041] The control module consists of CPU (Central Processing Unit), NPU (Neural Processing Unit), FLASH and DDR (Double Data Rate Synchronous Dynamic Random Access Memory). The CPU is mainly responsible for system operation, task scheduling, calculation and management of peripheral resources, the NPU is mainly responsible for the operation of the image model, the DDR is responsible for the storage of cache data, and the FLASH is responsible for the storage of programs and user data.
[0042] In step S101, the intelligent terminal device collects regional image information of the target area. Specifically, the control module may control the visual module to work so as to shoot the target area to obtain the regional image information.
[0043] Optionally, in step S101, the vision module may collect regional image information in real time, or may collect regional image information once at a preset time interval, which is not limited here.
[0044] Optionally, in step S101, the visual module may specifically include at least one of a front view camera module, a rear view camera module, and a downward view camera module. The regional image information collected by the visual module may specifically include at least one of first regional image information, second regional image information, and third regional image information.
[0045] The front-view camera module is arranged on the front surface of the smart terminal device to capture image information of a first area corresponding to the area in front of the smart terminal device.
[0046] The rear view camera module is arranged on the rear surface of the smart terminal device to capture the image information of the second area corresponding to the rear area of the smart terminal device.
[0047] The downward-looking camera module is arranged on the lower surface of the smart terminal device to capture image information of a third area corresponding to the area below the smart terminal device.
[0048] In step S102, it is determined whether the regional image information has bird image features to determine whether there are bird creatures in the target region.
[0049] According to an example embodiment, in step S102, after the visual module of the intelligent terminal device collects the regional image information, the control module receives the regional image information and identifies the regional image information to identify whether the regional image information contains bird image features.
[0050] In step S102, when the smart terminal device recognizes that there are bird image features in the regional image information, it means that the smart terminal device determines that there are bird creatures in the target area.
[0051] Optionally, the smart terminal can identify whether the regional image information contains bird image features by using a target recognition algorithm to identify the regional image information, or by using a neural network model to process the regional image information to identify bird image features in the regional image information, which is not limited here.
[0052] It is worth noting that the target recognition algorithm may be a Yolo series algorithm. The neural network model is a neural network model that has been pre-trained with a large amount of sample data, and the sample data may be image information marked with birds.
[0053] According to some embodiments, when the regional image information includes at least two of the first regional image information, the second regional image information, and the third regional image information, in step S102, the control module identifies whether the first regional image information, the second regional image information, and the third regional image information have bird image features. When any of the image information has bird image features, it indicates that there are bird creatures in the target area.
[0054] In step S103, when the regional image information contains bird image features, regional sound information is collected in real time.
[0055] According to an example embodiment, the intelligent terminal device further includes an audio collection module, which can collect sound information.
[0056] In step S103, when there are bird image features in the regional image information, that is, when there are bird creatures in the target area near the smart terminal device, the control module can control the audio acquisition module to start collecting regional sound information in real time. The collected regional sound information will contain the sounds of all bird creatures in the target area.
[0057] In step S104, the location of the bird's nest is determined based on the regional sound information.
[0058] According to an example embodiment, the control module may identify the sounds of birds from the regional sound information collected by the audio collection module, so as to locate the position of the bird's nest according to the sounds of the birds.
[0059] In a possible implementation, the location of the bird creature can be determined based on the bird sounds in the regional sound information to determine the movement trajectory of the bird creature, and then the location of the bird's nest can be determined by prediction or analysis based on the movement trajectory of the bird creature.
[0060] The bird's nest locating method of the present application can first identify whether there are bird image features in the regional image information, and when there are bird image features, use the regional sound information to locate the bird's nest. The bird's nest locating method of the embodiment of the present application does not simply use image recognition to locate the bird's nest, but uses sound to locate the bird's nest. In this way, the bird's nest position can be found and located in the case of blind spots in the camera device or when the bird's nest is blocked, so that the bird's nest position can be found and located in time, which is conducive to timely processing after the bird's nest position is found to maintain the stability of the power system.
[0061] Furthermore, the bird nest locating method of the present application uses images to identify the presence of bird life in the target area, and then controls the audio collection device to collect regional sound information to locate the bird nest in a timely manner, which is beneficial to reducing the power consumption of the smart terminal device.
[0062] According to some embodiments, reference Figure 2 In the above step S104, the location of the bird's nest is determined according to the regional sound information, which can be specifically achieved through steps S1041, S1042 and S1043.
[0063] In step S1041, it is analyzed whether the sound information of the current area contains bird sound data.
[0064] According to an example embodiment, the current area sound information may specifically be the currently collected area sound information.
[0065] According to an example embodiment, the bird sound data is data of sounds emitted by birds collected by the audio collection module.
[0066] According to the example embodiment, the audio collection module collects the sounds emitted by various sound sources in the surrounding environment, so that the collected regional sound information contains multiple sound data. In addition, the regional sound information may contain bird sound data, or may only contain sound data emitted by other sound sources in the environment without bird sound data.
[0067] Therefore, in step S1041 of the embodiment of the present application, the control module of the smart terminal device can analyze in real time whether there is bird sound data in the sound information of the current area.
[0068] According to the example embodiment, the sound of each sound source has a specific signal feature. For example, the sound emitted by a bird has a specific sound frequency band. In step S1041, the control module of the intelligent terminal device can analyze the signal features corresponding to each sound data in the current area sound information. Then the control module determines whether the signal features of each sound data belong to the signal features corresponding to the bird. The sound data whose signal features belong to the signal features corresponding to the bird is the bird sound data.
[0069] Exemplarily, the current area sound information includes sound data a1, sound data a2, and sound data a3. The control module analyzes the frequency of the sound data a1, analyzes the frequency of the sound data a2, and analyzes the frequency of the sound data a3. The control module determines whether the frequency of the sound data a1, the frequency of the sound data a2, and the frequency of the sound data a3 belong to the sound frequency band of bird creatures to identify whether there is bird sound data in the current area sound information.
[0070] According to some embodiments, the audio collection module of the smart terminal device may specifically include at least two audio collectors. The at least two audio collectors form a microphone array. The sound emitted by the sound source near the smart terminal device will be collected by each audio collector to obtain the sound information collected by each audio collector.
[0071] The current area sound information includes the current sound information collected by the at least two audio collectors. In step S1041, the control module analyzes whether there is bird sound data in the current area sound information, and each current sound information can be analyzed separately. When there is at least one bird sound data in at least one current sound information, it can be considered that there is bird sound data in the current area sound information.
[0072] In step S1042, when the current area sound information contains bird sound data, the current bird position is determined according to the current area sound information.
[0073] According to the example embodiment, in step S1042, the presence of bird sound data in the current area sound information indicates that there are bird creatures in the surrounding environment of the current smart terminal device. In this case, the control module of the smart terminal device can determine the current bird position according to the current area sound information, so as to determine the bird nest position according to the current bird position.
[0074] According to some embodiments, in step S1042, referring to Figure 3 The method of determining the current bird position according to the sound information in the current area may specifically include step S31, step S32 and step S33.
[0075] In step S31, bird sound data in current sound information collected by at least two audio collectors is identified.
[0076] According to an exemplary embodiment, in step S31, the control module of the intelligent terminal device respectively identifies the bird sound data in each current sound information.
[0077] It is worth noting that the method for identifying the bird sound data in the current sound information can refer to the method for identifying the bird sound data in the current area sound information in step S1042 in the above embodiment, which will not be described in detail here.
[0078] Exemplarily, when the audio collection module includes a first audio collector, a second audio collector, and a third audio collector, the current area sound information includes current sound information b1, current sound information b2, and current sound information b3.
[0079] Exemplarily, in step S31, the control module identifies that the bird sound data in the current sound information b1 includes bird sound data b11; the bird sound data in the current sound information b2 includes bird sound data b21; and the bird sound data in the current sound information b3 includes bird sound data b31.
[0080] In step S32, the collection time corresponding to each bird sound data in the current sound information is determined.
[0081] According to an example embodiment, in step S32, the control module of the intelligent terminal device identifies the collection time corresponding to each bird sound data in each current sound information.
[0082] Exemplarily, continuing to take the example in the above step S31 as an example, the control module determines the collection time of the bird sound data b11, the bird sound data b21 and the bird sound data b31.
[0083] According to an exemplary embodiment, the collection time is the time when the audio collector collects the bird sound data, that is, the time when the sound emitted by the bird is transmitted to the audio collector.
[0084] In step S33, the current bird position is determined according to the collection time corresponding to the bird sound data in each current sound information.
[0085] According to the example embodiment, for the sound emitted by the same sound source, due to the different locations of the audio collectors, there is a slight difference in the time when the sound emitted by the sound source is transmitted to the audio collector, and the difference is in the millisecond level. That is, there is a difference in the time when the bird sound data collected by different audio collectors for the same sound source is collected.
[0086] According to an example embodiment, in step S33, the control module may determine the current bird position according to the collection time corresponding to the bird sound data in the current sound information.
[0087] According to some embodiments, when each current sound information includes only one bird sound data, each bird sound data is data corresponding to the sound emitted by the same bird creature at the same time. Therefore, in step S33, the control module can directly calculate the time difference between the collection moments corresponding to each bird sound data, and use the time difference to perform coupling estimation to estimate the position of the bird creature at that moment, that is, the current bird position.
[0088] For example, the current sound information c1 collected at 10:00:00 includes bird sound data c11, the current sound information c2 includes bird sound data c21, and the current sound information c3 includes bird sound data c31. By calculating the time difference between the collection times of the bird sound data c11, the bird sound data c21, and the bird sound data c31, the position of the bird creature at 10:00:00 can be calculated.
[0089] According to some embodiments, there may be multiple birds making sounds at the same time, or a bird may make multiple sounds at the current time. Therefore, there may be multiple bird sound data in each current sound information collected at the current time. Figure 4 In step S33, the control module determines the current bird position according to the collection time corresponding to the bird sound data, which can also be achieved through steps S331, S332 and S333.
[0090] In step S331, the bird sound data in the current sound information are sorted in sequence according to the order of collection time to obtain a bird sound data sequence corresponding to the current sound information.
[0091] According to the exemplary embodiment, when a bird creature makes a sound, there is corresponding bird sound data in the current sound information of each audio collector. In step S331, when only one bird sound data is included in a current sound information, the bird sound data sequence determined by the control module includes only the bird sound data, and the bird sound data is numbered 1.
[0092] When a current sound information includes at least two bird sound data, the control module can sort the at least two bird sound data in each current sound information in order of collection time from earliest to latest to obtain a bird sound data sequence corresponding to each current sound information.
[0093] Exemplarily, the current sound information d1 includes bird sound data d11 and bird sound data d12. The current sound information d2 includes bird sound data d21 and bird sound data d22. The current sound information d3 includes bird sound data d31 and bird sound d32.
[0094] In step S331 , the control module determines that the current sound information d1 corresponds to the bird sound data sequence d1 , the bird sound data sequence d1 includes [bird sound data d11 , bird sound data d12 ], and the sequence number of the bird sound data d11 is 1.
[0095] Similarly, in step S331, the control module determines the bird sound data sequence d21 corresponding to the current sound information d2, and determines the bird sound data sequence d31 corresponding to the current sound information d3.
[0096] In step S332, the bird sound data at the same sequence number in each bird sound data sequence is determined as the bird sound data from the same sound source.
[0097] Bird sound data from the same sound source refers to the data of the sound emitted by the same bird creature at the same sounding time. For example, bird creature x emits two sounds successively, and the two sounds are successively collected by audio collector z1. There are two bird sound data in the current sound information z1, and the two bird sound data belong to bird sound data from different sound sources.
[0098] For another example, a bird creature x makes a sound, and the sound is collected by the audio collector z1 and the audio collector z2, then the bird sound data z1 in the current sound information z1 and the bird sound data z2 in the current sound data z2 are bird sound data from the same sound source.
[0099] According to an exemplary embodiment, the sequence number represents the position of the bird sound data in the bird sound data sequence. For example, the bird sound data d11 is located at the first position in the bird sound data sequence d1, and the corresponding sequence number is 1.
[0100] According to the exemplary embodiment, different sound sources have different sound emission times. And the sound emitted by the sound source with the earlier sound emission time is also first collected by each audio collector. Therefore, the bird sound data with the same sequence number in different current sound information is the bird sound data of the same sound source. In step S332, the control module can determine the bird sound data with the same sequence number in each bird sound data sequence as the bird sound data of the same sound source.
[0101] For example, for the above current sound information d1, current sound information d2 and current sound information d3, the sequence numbers of bird sound data d11, bird sound data d21 and bird sound data d31 are all 1, which are the bird sound data corresponding to sound source 1.
[0102] The serial numbers of the bird sound data d12 , the bird sound data d22 , and the bird sound data d32 are all 2, and are the bird sound data corresponding to the sound source 2 .
[0103] In step S333, the current bird position corresponding to the same sound source is determined according to the collection time of each bird sound data of the same sound source.
[0104] According to an example embodiment, for each piece of bird sound data from any same sound source, in step S333, the control module may calculate the difference in collection time of each piece of bird sound data, so as to calculate the current bird position corresponding to any same sound source according to the difference in collection time.
[0105] Exemplarily, in step S333, the control module calculates the bird position corresponding to the sound source 1 according to the collection time of the bird sound data d11, the bird sound data d21 and the bird sound data d31. And the control module calculates the current bird position corresponding to the sound source 2 according to the collection time of the bird sound data d12, the bird sound data d22 and the bird sound d32, which is equivalent to the control module calculating two current bird positions.
[0106] In step S1043, when the determined bird positions meet a preset threshold condition, the bird's nest position is determined according to the determined positions of each bird.
[0107] The preset threshold conditions include that the aggregation degree of the bird positions reaches a preset aggregation degree threshold, and / or the total number of the bird positions reaches a preset number threshold.
[0108] According to the example embodiment, the area where the bird's nest is located is usually an area where bird activities are relatively intensive, and it is difficult to accurately predict the location of the bird's nest for bird positions that are measured occasionally, such as measuring two bird positions.
[0109] Therefore, in step S1043 of the embodiment of the present application, the control module first determines whether the determined bird position meets the preset threshold condition, and if the preset threshold condition is met, determines the bird's nest position based on the determined positions of each bird.
[0110] According to the example embodiment, in step S1043, the control module calculates the aggregation degree of the bird positions according to the determined bird positions. Then, the control module determines whether the aggregation degree of the bird positions is greater than a preset aggregation degree threshold. If it is greater than the preset aggregation degree threshold, it indicates that the bird positions meet the preset threshold condition.
[0111] According to an example embodiment, in step S1043, the control module calculates the aggregation degree of the bird positions, which can be implemented specifically by a singular point detection algorithm. The control module can use the singular point detection algorithm to calculate the local density corresponding to each bird position to obtain the aggregation degree corresponding to each bird position. The local density is the aggregation degree of the bird positions in the local area where the bird position is located.
[0112] In step S1043, the control module may also calculate the degree of aggregation of bird positions through cluster analysis. For example, the control module divides the bird position data into different groups, each group representing a bird aggregation area, and calculates the density of bird positions in each bird aggregation area to calculate the degree of aggregation of each bird aggregation area.
[0113] In step S1043, the control module calculates the aggregation degree of the bird positions and may also use geographic information system software to perform spatial analysis on the bird position data to calculate the aggregation degree of the bird positions.
[0114] The control module may also calculate the total number of determined bird positions and determine whether the total number reaches a preset number threshold. If the preset number threshold is reached, it indicates that the determined bird positions meet the preset threshold condition.
[0115] The control module can also simultaneously calculate the total number of bird positions and the degree of aggregation of the bird positions. When the degree of aggregation of the bird positions is greater than a preset aggregation threshold and the total number of bird positions reaches a preset number threshold, it indicates that the determined bird positions meet the preset threshold conditions. Alternatively, the control module can also determine that the bird positions meet the preset threshold conditions when the degree of aggregation of the bird positions is greater than a preset aggregation threshold and the total number of bird positions does not reach a preset number threshold. Alternatively, the control module can also determine that the bird positions meet the preset threshold conditions when the distance between the bird positions is less than a preset aggregation threshold and the total number of bird positions reaches a preset number threshold.
[0116] When the bird position does not meet the preset threshold condition, it indicates that a sufficient number of bird positions have not been collected to accurately locate the bird's nest. When the bird position does not meet the preset threshold, the control module can control the audio collector to continue to collect regional sound information, and continue to analyze the bird sound data in the regional sound information and determine the bird position according to the bird sound data. Until the control module determines that the bird position meets the preset threshold condition.
[0117] In step S1043, when the bird position meets the preset threshold condition, the control module can determine the bird's nest position according to the determined positions of each bird.
[0118] In a possible implementation, the control module may determine the location of the bird's nest in a specific manner: the control module may use a heat map tool and the coordinates of each bird's location to convert each bird's location into a heat map. In the heat map, the denser the bird's location, the darker the color. The control module may determine the area in the heat map where the color depth exceeds a preset depth as the location of the bird's nest.
[0119] In another possible implementation, the control module may determine the location of the bird's nest in the following manner: the control module calculates and estimates the local density of each bird position using a singular point detection method, and determines the bird position having a local density significantly higher than the local density of other bird positions as the bird's nest position.
[0120] In another possible implementation, referring to Figure 5 In step S1043, when the determined bird positions meet the preset threshold conditions, the bird's nest position is determined according to the determined positions of each bird, which can also be achieved through steps S51 and S52.
[0121] In step S51, when the determined bird positions meet the preset threshold condition, each bird position is classified according to the bird species to obtain the bird positions corresponding to each bird species.
[0122] According to some embodiments, before step S1043, the method may further include identifying the bird species corresponding to each bird sound data to determine the bird species corresponding to each bird position. The control module may identify the signal features corresponding to each bird sound data, and determine the bird species corresponding to each bird sound data based on the specific signal features of the sounds emitted by different bird species. The bird position is determined by the control module based on the bird sound data, so the bird species corresponding to the bird sound data is the bird species corresponding to the bird position.
[0123] According to an example embodiment, in step S51, when the determined bird positions meet a preset threshold condition, the control module classifies each bird position according to the bird species.
[0124] For example: the currently determined bird positions include bird position m1, bird position m2, bird position m3, bird position n1, and bird position n2. The control module can obtain in step S51 that the bird positions corresponding to bird species m are bird position m1, bird position m2, and bird position m3; and the bird positions corresponding to bird species n are bird position n1 and bird position n2.
[0125] In step S52, the location of the bird's nest is determined according to the bird positions corresponding to the various bird species.
[0126] According to an exemplary embodiment, in step S52, the control module determines the location of the bird's nest according to the bird positions corresponding to each of the various bird species.
[0127] In a possible implementation, in step S52, the control module determines the nest position by classifying each bird position according to the bird species, and generates a corresponding heat map according to the bird position corresponding to each bird species. Then, the control module determines the nest position corresponding to the bird species according to the heat map corresponding to the bird species, so as to determine the nest position.
[0128] For example, in step S52, the control module determines the heat map corresponding to the bird species m using the bird position m1, the bird position m2, and the bird position m3 to determine the bird's nest position corresponding to the bird species m. Furthermore, the control module also determines the heat map corresponding to the bird species n according to the bird position n1 and the bird position n2 to determine the bird's nest position corresponding to the bird species n.
[0129] In another possible implementation, in step S52, the control module determines the location of the bird's nest by classifying each bird position according to the bird species, determining the bird species whose number of bird positions is less than the preset number of bird positions, deleting each bird position corresponding to the bird species, and determining the location of the bird's nest based on the bird positions corresponding to the remaining bird species.
[0130] The bird nests corresponding to different bird species are generally different. Therefore, in step S51 of the embodiment of the present application, the control module classifies each bird position according to different bird species, and in step S52, the control module determines the bird nest position according to the bird position corresponding to the bird species, which can reduce the probability of affecting the accuracy of the bird nest position due to the different bird species corresponding to each bird position.
[0131] According to some embodiments, after analyzing whether the sound information in the current area contains bird sound data in the above step S1041, referring to Figure 6 , the method also includes step S61.
[0132] In step S61, when the regional sound information meets the preset sleep condition, a stop collection instruction is issued to control at least two audio collectors to stop collecting.
[0133] The preset dormancy condition includes that the regional sound information collected by at least two audio collectors within a preset time period does not contain any bird sound data.
[0134] According to the example embodiment, the regional sound information collected within the preset time period does not contain bird sound data, which means that no bird sound is collected within the preset time period. Therefore, in this case, it can be considered that there are no bird creatures in the area where the current smart terminal device is located. Therefore, in order to reduce power consumption, in step S51, the control module can issue a stop collection instruction to control the audio collection module, that is, control the at least two audio collectors to stop collecting.
[0135] According to some embodiments, reference Figure 7 In step S102, whether the image information of the identification area has bird image features can be specifically implemented through steps S71 and S72.
[0136] In step S71, it is identified whether the regional image information has a preset alarm feature.
[0137] The preset alarm features include image features that cause power transmission line faults, such as engineering vehicle alarm image features, line sedimentation and contamination image features, and bird image features.
[0138] According to an example embodiment, in step S71, the control module may identify whether there is a preset alarm feature in the image information of the region, and if there is a preset alarm feature, identify and determine the preset alarm feature.
[0139] In step S72, when the regional image information has the preset alarm feature, it is determined whether the preset alarm feature has the bird image feature, so as to identify whether the regional image information has the bird image feature.
[0140] According to an example embodiment, in step S72, when the control module identifies a preset alarm feature, the control module determines whether the preset alarm feature includes a bird image feature, thereby identifying whether the image information of the area includes a bird image feature.
[0141] Reference Figure 8The control module performs intelligent analysis on the regional image information and finds the preset alarm features after the intelligent analysis, that is, determines whether it has bird image features. If it has bird image features, the control module controls the audio acquisition module to start collecting regional sound information and locate the bird's nest.
[0142] When the control module determines that there is no bird image feature in the preset alarm feature, the preset alarm feature can be sent to the remote operation and maintenance management platform, so that the operation and maintenance personnel can view the corresponding early warning situation through the remote operation and maintenance management platform, so as to identify other factors that may cause transmission line failures, so as to improve the operation stability of the transmission line.
[0143] When the control module analyzes that the regional image information does not have the preset alarm feature, it means that there is no safety hazard in the current power transmission line, and the regional image information can continue to be collected or sleep to reduce power consumption.
[0144] According to some embodiments, the intelligent terminal device further includes a power module and a communication module. The power module is composed of a power control board, a battery and a photovoltaic panel to power the control module, the communication module, the visual module and the audio acquisition module. When there is sufficient light, the intelligent terminal device is powered by the photovoltaic panel and the battery is also charged. When there is insufficient light, the intelligent terminal device is powered by the battery.
[0145] The communication module is connected to the control module, including WIFI module, 4G (Long Term Evolution, the fourth generation of mobile communication technology) module and Beidou GPS (Global Positioning System) module. The 4G private network is used for VPN (Virtual Private Network) encryption to ensure data reliability. The WIFI module supports local WIFI connection, and the equipment configuration and debugging of the smart terminal equipment on the tower can be carried out under the tower to reduce manual tower climbing operations. At the same time, the smart terminal equipment can be located and synchronized through the Beidou module.
[0146] It should be clearly understood that the present application describes how to form and use specific examples, but the present application is not limited to any details of these examples. On the contrary, based on the teaching of the content disclosed in the present application, these principles can be applied to many other embodiments.
[0147] Those skilled in the art may understand that all or part of the steps to implement the above embodiments are implemented as a computer program executed by a CPU. When the computer program is executed by the CPU, the above functions defined by the above method provided in this application are performed.
[0148] According to one aspect of the present application, an embodiment of the present application introduces a bird's nest positioning device from the perspective of a virtual module or a virtual unit, and details are shown in the following embodiments.
[0149] The device embodiments of the present application described below can be used to execute the method embodiments of the present application. For details not disclosed in the device embodiments of the present application, reference can be made to the method embodiments of the present application.
[0150] like Fig. 9 As shown, the bird's nest locating device may include an image acquisition module 901 , a bird image recognition module 902 , a sound acquisition control module 903 , and a bird's nest locating module 904 .
[0151] See also Fig. 9 Referring to the above description, the image acquisition module 901 is used to acquire regional image information of the target area. The bird image recognition module 902 is used to identify whether there are bird image features in the regional image information to determine whether there are bird creatures in the target area. The sound acquisition control module 903 is used to acquire regional sound information in real time when there are bird image features in the regional image information. The bird nest positioning module 904 is used to determine the location of the bird nest based on the regional sound information.
[0152] The device performs functions similar to the method provided above. For other functions, please refer to the previous description and will not be repeated here.
[0153] The embodiment of the present application also introduces a smart terminal device from the perspective of a physical device. The smart terminal device includes: an audio acquisition module, a visual module and a control module.
[0154] The audio acquisition module includes at least two audio collectors to collect regional sound information. The visual module collects regional image information of the target area.
[0155] The intelligent terminal device also includes a power module and a communication module. The power module is composed of a power control board, a battery and a photovoltaic panel to supply power to the control module, the communication module, the visual module and the audio acquisition module.
[0156] The communication module is communicatively connected with the control module, and includes a WIFI module, a 4G (common name for Long Term Evolution, the fourth generation of mobile communication technology) module and a Beidou GPS (Global Positioning System) module.
[0157] Reference Fig.10, the control module includes a processor 1001 and a memory 1003. The processor 1001 and the memory 1003 are connected, such as through a bus 1002. Optionally, the electronic device 1000 may further include a transceiver 1004. It should be noted that in actual applications, the transceiver 1004 is not limited to one, and the structure of the control module does not constitute a limitation on the embodiments of the present application.
[0158] Processor 1001 may be a CPU (Central Processing Unit), a general-purpose processor, a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. It may implement or execute various exemplary logic blocks, modules and circuits described in conjunction with the disclosure of this application. Processor 1001 may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc.
[0159] The bus 1002 may include a path to transmit information between the above components. The bus 1002 may be a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus. The bus 1002 may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Fig.10 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.
[0160] The memory 1003 can be a ROM (Read Only Memory) or other types of static storage devices that can store static information and instructions, a RAM (Random Access Memory) or other types of dynamic storage devices that can store information and instructions, or an EEPROM (Electrically Erasable Programmable Read Only Memory), a CD-ROM (Compact Disc Read Only Memory) or other optical disk storage, optical disk storage (including compressed optical disk, laser disk, optical disk, digital versatile disk, Blu-ray disk, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited to these.
[0161] The memory 1003 is used to store the application code for executing the solution of the present application, and the execution is controlled by the processor 1001. The processor 1001 is used to execute the application code stored in the memory 1003 to implement the contents shown in the above method embodiment.
[0162] According to one aspect of the present application, an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, and when the computer-readable storage medium is run on a computer, the computer can execute the corresponding content in the aforementioned method embodiment. The storage medium can be a read-only memory, a disk or an optical disk, etc.
[0163] According to one aspect of the present application, an embodiment of the present application provides a computer program product, which includes a computer program stored on a computer-readable storage medium, and the computer program includes program instructions. When the program instructions are executed by a computer, the computer executes the method described in the above method embodiment.
[0164] Finally, it should be noted that the above are only preferred embodiments of the present application and are not intended to limit the present application. Although the present application is described in detail with reference to the aforementioned embodiments, those skilled in the art can still modify the technical solutions of the aforementioned embodiments or replace some of the technical features therein by equivalents. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.
Claims
1. A method for locating a bird's nest, characterized in that: The method comprises: Collecting regional image information of the target area; Identify whether the regional image information contains bird image features to determine whether there are bird creatures in the target area; In the case where the regional image information contains bird image features, collecting regional sound information in real time; The location of the bird's nest is determined based on the sound information in the area.
2. The method according to claim 1, characterized in that Determining the location of the bird's nest according to the regional sound information includes: Analyze whether there is bird sound data in the sound information of the current area; In the case where the current area sound information contains bird sound data, determining the current bird position according to the current area sound information; When the determined bird positions meet a preset threshold condition, determining the bird nest position according to the determined positions of each bird; The preset threshold condition includes that the aggregation degree of the bird positions reaches a preset aggregation degree threshold, and / or the total number of the bird positions reaches a preset number threshold.
3. The method according to claim 2, characterized in that The regional sound information includes sound information collected by at least two audio collectors respectively; Wherein, determining the current bird position according to the sound information in the current area includes: Identifying bird sound data in current sound information collected by at least two audio collectors; Determine the collection time corresponding to each bird sound data in the current sound information; The current bird position is determined according to the collection time corresponding to the bird sound data in each current sound information.
4. The method according to claim 3, characterized in that The step of determining the current bird position according to the collection time corresponding to the bird sound data in each current sound information includes: Sorting the bird sound data in the current sound information in order of collection time to obtain a bird sound data sequence corresponding to the current sound information; Determine the bird sound data at the same sequence number in each bird sound data sequence as the bird sound data from the same sound source; According to the collection time of the bird sound data of the same sound source, the current bird position corresponding to the same sound source is determined.
5. The method according to claim 3, characterized in that: The method further comprises: When the sound information in the area meets the preset sleep condition, issuing a stop collection instruction to control the at least two audio collectors to stop collecting; The preset sleep conditions include: The regional sound information collected by the at least two audio collectors within a preset time period does not contain bird sound data.
6. The method according to claim 2, characterized in that The method further comprises: Identify the bird species corresponding to each bird sound data to determine the bird species corresponding to each bird position; Wherein, when the determined bird positions meet a preset threshold condition, determining the bird nest position according to the determined positions of each bird includes: When the determined bird positions meet the preset threshold conditions, each bird position is classified according to the bird species to obtain the bird positions corresponding to each bird species; The location of the bird's nest is determined according to the bird positions corresponding to the various bird species.
7. The method according to claim 1, characterized in that The identifying whether the regional image information has bird image features includes: Identify whether the regional image information has a preset alarm feature; In the case that the area image information has the preset alarm feature, it is determined whether the preset alarm feature has the bird image feature, so as to identify whether the area image information has the bird image feature.
8. A bird's nest positioning device, characterized in that: The device comprises: An image acquisition module, used for acquiring regional image information of a target area; A bird image recognition module is used to identify whether the regional image information has bird image features, so as to determine whether there are bird creatures in the target area; A sound collection control module, used for collecting regional sound information in real time when the regional image information contains bird image features; The bird's nest positioning module is used to determine the location of the bird's nest based on the sound information in the area.
9. An intelligent terminal device, characterized in that: include: An audio collection module, including at least two audio collectors, collects regional sound information; A visual module collects regional image information of the target area; A control module, including one or more processors and a memory; The memory is used to store one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 7.
10. A non-volatile computer-readable medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.
11. A computer program product, characterized in that The method comprises a computer program stored on a computer-readable storage medium, wherein the computer program comprises program instructions, and when the program instructions are executed by a computer, the computer is caused to execute the method according to any one of claims 1 to 7.
Citation Information
Cited By
Dispelling system and method for interference of specific-frequency electromagnetic waves on target navigation
CN121069329A
A system and method for repelling target navigation by a specific frequency electromagnetic wave interference
CN121069329B
Bird's nest positioning method and apparatus, device, medium, and program product
WO2026036778A1
