Automatic identification method and device for tax exemption equipment

Abstract

The invention discloses an automatic identification method and device for tax-exempt equipment, and relates to the technical field of image identification, and the method comprises the steps: responding to an equipment identification request of an auditing end, obtaining an active indication path based on an automatic collection mode, obtaining an active collection image photographed by aerial photographing equipment based on the active indication path, and obtaining an image of the active collection image; acquiring active identification data corresponding to tax exemption equipment according to the active acquisition image, and sending the active identification data to the auditing end, or acquiring movement information of ground equipment based on an auxiliary acquisition mode, generating a passive indication path according to the movement information, and sending the passive indication path to the auditing end; and acquiring an auxiliary acquisition image shot by the aerial photographing equipment based on the passive indication path, acquiring auxiliary identification data of the tax-exempt equipment according to the auxiliary acquisition image, and sending the auxiliary identification data to the auditing end, so that the efficiency of auditing the tax-exempt equipment can be improved.

Description

Technical Field

[0001] The present invention relates to image recognition technology, and in particular to a method and device for automatically identifying duty-free equipment. Background Art

[0002] Tax-free equipment usually refers to equipment that complies with relevant regulations and is exempt from import tariffs or value-added tax. Among them, photovoltaic panels, as important power generation equipment, can also be identified as tax-free equipment if they meet the tax-free conditions. However, in the process of identifying and reviewing equipment applying for tax exemption, traditional review methods face many challenges.

[0003] In the existing technology, when reviewing equipment applying for tax exemption, it is usually necessary to rely on the staff of the tax supervision department to conduct on-site inspections and record each device, which is a large workload and inefficient. Especially when there are a large number of clean energy equipment such as photovoltaic panels and they are widely distributed, the difficulty and cost of manual review are significantly increased.

[0004] Therefore, how to improve the efficiency of auditing tax-free equipment has become an urgent problem to be solved. Summary of the invention

[0005] The present invention provides a method and device for automatically identifying duty-free equipment, which can improve the efficiency of auditing duty-free equipment.

[0006] A first aspect of the present invention provides a method for automatically identifying duty-free equipment, comprising: In response to the device identification request of the audit end, an active indication path is obtained based on the automatic acquisition mode, and an active acquisition image is obtained by the aerial photography device based on the active indication path; Acquire active identification data corresponding to the duty-free device according to the active acquisition image, and send the active identification data to the audit end; or, Acquire movement information of the ground device based on the auxiliary acquisition mode, generate a passive indication path according to the movement information, and acquire an auxiliary acquisition image taken by the aerial photography device based on the passive indication path; Auxiliary identification data of the duty-free device is acquired according to the auxiliary collected image, and the auxiliary identification data is sent to the audit end.

[0007] Optionally, in a possible implementation of the first aspect, responding to a device identification request of the audit terminal, acquiring an active indication path based on an automatic acquisition mode, and acquiring an active acquisition image taken by an aerial photography device based on the active indication path include: Receiving the collection location point sent by the application end, and generating an active indication path according to the current location point and the collection location point of the aerial photography device; Acquire a large scene image taken by the aerial photography device at the acquisition location based on the active indication path; Identify device marks in the large scene image, determine a plurality of duty-free device outlines according to the device marks, and group the duty-free device outlines to obtain a plurality of device outline groups; Determine the detail indication position corresponding to each of the device profile groups, obtain the close-up image taken by the aerial photography device based on the detail indication position, and obtain the actively collected image according to the large scene image and the close-up image.

[0008] Optionally, in a possible implementation manner of the first aspect, identifying a device mark in the large scene image, determining a plurality of duty-free device profiles according to the device mark, and grouping the duty-free device profiles to obtain a plurality of device profile groups, including: Extracting multiple photovoltaic device contours in the large scene image, and obtaining device marks located at the vertex positions of the contours of each photovoltaic device; Determine a marked pixel value of the device mark, and obtain a photovoltaic device outline whose marked pixel value is within a tax-free pixel interval as a tax-free device outline; Acquire the contour distance between the center points of the contours of the duty-free devices, and determine that the positional relationship of the contours of the duty-free devices whose contour distance is less than or equal to the adjacent spacing threshold is an adjacent relationship; Determine the contour area of ​​each duty-free device contour, obtain the contour area difference of the duty-free device contours in the adjacent relationship, and determine the duty-free device contours whose contour area difference is less than or equal to the area similarity threshold as the same group of device contours.

[0009] Optionally, in a possible implementation manner of the first aspect, determining the detail indication position corresponding to each of the device profile groups includes: Acquire extreme value coordinate values ​​corresponding to a plurality of contour coordinate points of each of the device contour groups, generate four mutually perpendicular outer frame lines according to the extreme value coordinate values, and determine a total acquisition area of ​​each of the device contour groups based on the outer frame lines; Retrieving a detail collection frame corresponding to the aerial photography device, locating the center point of the detail collection frame based on the center point of the total collection area, and superimposing the detail collection frame on the top of the device outline group; When the total acquisition area is completely located within the detail acquisition frame, determining the actual position point corresponding to the center point of the total acquisition area as the detail indication position; When the total acquisition area is not completely within the detail acquisition frame, the difference device outline within the total acquisition area is acquired, and the actual position point corresponding to the center point of the total acquisition area and the difference device outline is determined as the detail indication position.

[0010] Optionally, in a possible implementation manner of the first aspect, when the total acquisition area is not completely located within the detail acquisition frame, acquiring a differential device contour within the total acquisition area, and determining an actual position point corresponding to a center point of the total acquisition area and the differential device contour as the detail indication position includes: Obtaining pixel means corresponding to each duty-free device outline in the total acquisition area, and determining that the duty-free device outlines whose pixel means are within the same preset pixel interval are the same device subgroup; Determine the preset pixel interval corresponding to the device subgroup with the largest number of duty-free device profiles as the reference pixel interval, and determine the duty-free device profiles corresponding to the remaining device subgroups as difference device profiles; Acquire the actual position point corresponding to the center point of the total acquisition area as the first indication position, and determine the standard acquisition height corresponding to the detail acquisition frame as the acquisition height corresponding to the first indication position; Determine the actual position point corresponding to the center point of the difference device outline as the second indication position, sequentially reduce and adjust the detail collection frame according to multiple reduction ratios, and obtain in real time the area ratio of the outline area of ​​the difference device outline to the area of ​​the framed area of ​​the detail collection frame; When the difference device outline is completely located in the detail collection frame and the area ratio is the largest, the reduction adjustment of the detail collection frame is stopped, and a preset collection height corresponding to the reduction ratio is obtained, and the preset collection height is used as the collection height corresponding to the second indication position; The detail indication position includes a first indication position and a second indication position.

[0011] Optionally, in a possible implementation manner of the first aspect, acquiring active identification data corresponding to the duty-free device according to the actively captured image, and sending the active identification data to the audit end includes: Obtain the installation days of the tax-free equipment, determine the loss stage corresponding to the installation days, and obtain the preset loss coefficient corresponding to the loss stage; identifying defect profiles in the profiles of each duty-free device in the close-up image, the defect profiles comprising at least crack profiles, fracture profiles, and contaminant profiles; Counting the defect areas of the defect contours, and retrieving the preset loss coefficients corresponding to the defect contours and the preset defect areas corresponding to the preset loss coefficients; Obtaining a shift coefficient according to a ratio of the defect area to the preset defect area, and obtaining a current loss coefficient corresponding to the defect profile according to a product of the shift coefficient and the preset loss coefficient; Counting the current loss coefficients of each of the tax-free equipment profiles to obtain a total loss coefficient, and calculating a first difference in the total loss coefficients between the tax-free equipment profiles and a second difference between each total loss coefficient and a preset loss coefficient; When all first differences are smaller than the equipment loss threshold and all second differences are smaller than the duration loss threshold, normal identification information is generated, and active identification data is obtained based on the normal identification information and sent to the audit end.

[0012] Optionally, in a possible implementation manner of the first aspect, acquiring movement information of a ground device based on an auxiliary acquisition mode, generating a passive indication path according to the movement information, and acquiring an auxiliary acquisition image taken by the aerial photography device based on the passive indication path includes: Acquire the bird's-eye view video of the aerial photography device, retrieve the preset image of the ground device, and identify the outline of the ground device in the bird's-eye view video according to the preset image; Determine the center point of the ground equipment outline as a positioning point, obtain the movement information according to the displacement information of the positioning point in adjacent video frames, and generate the passive indication path based on the movement information; Acquire the moving speed of the ground device, and determine the flying speed of the aerial photography device according to the moving speed; The aerial photography device is controlled to move based on the passive indication path and the flight speed, the position point when the ground device stops moving is determined as the target collection point, and the auxiliary collection image taken by the aerial photography device at the target collection point is obtained.

[0013] Optionally, in a possible implementation manner of the first aspect, after identifying the outline of the ground equipment in the overhead video according to the preset image, the method further includes: When the number of contours of the ground equipment contours is greater than a preset base number, obtaining a displacement spacing between positioning points of each contour of the ground equipment in adjacent video frames; Determine the ground equipment profile whose displacement interval gradually decreases within a preset time period as a screening profile, and determine the ground equipment profile other than the screening profile as a target equipment profile; A moving path of the target device profile is acquired, and the moving path is determined to be the passive indication path.

[0014] Optionally, in a possible implementation manner of the first aspect, acquiring auxiliary identification data of the duty-free device according to the auxiliary collected image, and sending the auxiliary identification data to the audit end includes: Obtain the matrix twin space sent by the applicant, and determine the first row and column numbers corresponding to each audited photovoltaic panel in the matrix twin space; Identify the photovoltaic matrix contour and row and column direction marks in the auxiliary acquisition image, and determine the row and column arrangement direction of the photovoltaic matrix contour according to the row and column direction marks; Determine the second row and column number of each photovoltaic panel outline in the photovoltaic matrix outline according to the row and column arrangement direction, and determine the second row and column number corresponding to the first row and column number as the target number; Generate an audit prompt box corresponding to the photovoltaic panel outline of the target number, update the auxiliary acquisition image to obtain auxiliary identification data, and send the auxiliary identification data to the audit end.

[0015] A second aspect of the present invention provides a device for automatically identifying duty-free equipment, comprising: A response module, used to respond to the device identification request of the audit end, obtain the active indication path based on the automatic acquisition mode, and obtain the active acquisition image taken by the aerial photography device based on the active indication path; an acquisition module, used for acquiring active identification data corresponding to the duty-free device according to the active acquisition image, and sending the active identification data to the audit end; or, A generating module, configured to obtain movement information of the ground device based on the auxiliary acquisition mode, generate a passive indication path according to the movement information, and obtain an auxiliary acquisition image taken by the aerial photography device based on the passive indication path; A sending module is used to obtain the auxiliary identification data of the duty-free device according to the auxiliary collected image, and send the auxiliary identification data to the audit end.

[0016] The beneficial effects of the present invention are as follows: 1. When the authenticity of clean energy equipment such as photovoltaic panels that apply for tax exemption is reviewed, the present invention can use drones to collect data on clean energy equipment such as photovoltaic panels. Combined with the collected image data, the authenticity of clean energy equipment that applies for tax exemption can be quickly and accurately verified, thereby improving the review efficiency. When the present invention uses drones to collect image data of clean energy equipment such as photovoltaic panels, there are two different collection modes, and the way the drone collects image data in different collection modes is different. People who apply for tax exemption for photovoltaic panels can choose different collection modes according to their own needs, so that different collection modes can be used to control the corresponding drones to collect image data in different ways, thereby improving the efficiency and accuracy of image collection.

[0017] 2. In the automatic acquisition mode, the present invention can generate an active indication path to the corresponding location according to the location of the photovoltaic matrix provided by the applicant. The active indication path can ensure that the drone accurately reaches the location of the photovoltaic panel for tax exemption application to take images and obtain the corresponding large-scene image. By identifying the equipment marks in the large-scene image, the outline of the tax-free equipment can be determined more accurately, and the outlines of each tax-free equipment can be grouped and feature images collected, so that more accurate and clear image data can be obtained, thereby improving the accuracy of the review.

[0018] 3. In the auxiliary acquisition mode, the present invention can guide the aerial photography equipment to acquire images through ground equipment, thereby ensuring the accuracy of image acquisition, and in this acquisition mode, multiple ground equipment can be used to coordinately guide the aerial photography equipment to ensure that the aerial photography equipment can accurately and continuously follow the ground equipment to the correct target acquisition point, so that the corresponding acquisition image can be accurately acquired, and the efficiency of image acquisition can be improved. When the present invention identifies the duty-free equipment in the auxiliary acquisition mode, by constructing a twin model corresponding to the photovoltaic matrix, the layout of the real photovoltaic matrix and the position of the photovoltaic panel can be accurately simulated, which helps the auditors to more accurately identify and locate the photovoltaic panels to be audited for duty-free. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 It is a flowchart of a method for automatically identifying duty-free equipment provided by an embodiment of the present invention; Figure 2 is a schematic diagram of the total collection area provided by an embodiment of the present invention; Figure 3 is a schematic diagram of determining the row and column arrangement direction provided by an embodiment of the present invention; Figure 4 It is a structural schematic diagram of the automatic identification device for duty-free equipment provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0020] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0021] The technical solution of the present invention is described in detail with specific embodiments below. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.

[0022] See also Figure 1 , is a schematic diagram of a method for automatically identifying duty-free equipment provided by an embodiment of the present invention, Figure 1 The execution subject of the method shown may be a software and / or hardware device. The execution subject of the present application may include but is not limited to at least one of the following: user equipment, network equipment, etc. Among them, user equipment may include but is not limited to computers, smart phones, personal digital assistants (PDA) and the electronic devices mentioned above. Network equipment may include but is not limited to a single network server, a server group consisting of multiple network servers, or a cloud based on cloud computing consisting of a large number of computers or network servers, wherein cloud computing is a type of distributed computing, a super virtual computer composed of a group of loosely coupled computers. This embodiment does not limit this. It includes steps S1 to S4, as follows: S1, responding to the device identification request of the audit end, obtaining the active indication path based on the automatic acquisition mode, and obtaining the active acquisition image taken by the aerial photography device based on the active indication path.

[0023] When reviewing the authenticity of clean energy equipment such as photovoltaic panels that apply for tax exemption, this plan can use drones to collect data on clean energy equipment such as photovoltaic panels. Combined with the collected image data, the authenticity of the clean energy equipment that applies for tax exemption can be verified quickly and accurately, thereby improving the review efficiency.

[0024] This solution has two different acquisition modes when using drones to collect image data of clean energy equipment such as photovoltaic panels, and the drones collect image data in different ways under different acquisition modes. People who apply for tax exemption for photovoltaic panels can choose different acquisition modes based on their own needs, so that they can control the corresponding drones to collect image data in different ways through different acquisition modes.

[0025] Among them, the audit end refers to the terminal held by the auditor who audits the photovoltaic panels applying for tax exemption, the device identification request refers to the request for identifying the photovoltaic panels applying for tax exemption, the automatic acquisition mode refers to the mode of controlling the drone to automatically acquire images of the photovoltaic panels applying for tax exemption in combination with the location information of the photovoltaic panels, the active indication path refers to the path to the corresponding position automatically generated in combination with the position of the photovoltaic matrix corresponding to the multiple photovoltaic panels applying for tax exemption, the aerial photography equipment refers to the equipment that can acquire images of the photovoltaic panels applying for tax exemption, such as a drone, and the active image acquisition refers to the image obtained by the aerial photography equipment in the automatic acquisition mode of the photovoltaic panels applying for tax exemption.

[0026] Specifically, after the applicant for tax exemption for photovoltaic panels submits the corresponding review application, the reviewer on the review end can send a corresponding device identification request, and can dispatch corresponding aerial photography equipment, such as a drone, to the location of the photovoltaic panels for which the applicant applies for review to collect images. If the photovoltaic panels for which the review is applied are located in a position that is easy to locate, such as on the roof of a building, or there is no dense interference from other energy equipment around them, the applicant can choose the automatic collection mode to collect image data.

[0027] In the automatic acquisition mode, the aerial photography equipment can generate an indication path to the corresponding location based on the location of the photovoltaic matrix provided by the applicant, that is, the active indication path, and control the aerial photography equipment to go to the corresponding location along the active indication path to capture images of the photovoltaic panels applying for tax exemption review, and obtain the corresponding active acquisition images.

[0028] In some embodiments, step S1 includes S11 to S14, which are specifically as follows: S11, receiving the collection location point sent by the applicant, and generating an active indication path according to the current location point and the collection location point of the aerial photography device.

[0029] Among them, the application end refers to the terminal held by the applicant who applies for tax exemption, such as a computer; the collection location point refers to the location of the equipment for which tax exemption is applied, such as the location point corresponding to the photovoltaic equipment for which tax exemption is applied; the current location point refers to the current location of the aerial photography equipment.

[0030] Specifically, in the automatic collection mode, the applicant at the application end can send the location points of the photovoltaic matrix corresponding to multiple photovoltaic panels, namely the collection location points, to the reviewer through the application end when applying for tax exemption. After receiving the collection location points, the reviewer can establish a stable communication connection between the aerial photography device and the review end, such as a Bluetooth connection, and then send the collection location points to the aerial photography device. After receiving the collection location points, the aerial photography device can generate an active indication path from the current location point to the collection location point based on the current location point and the collection location point, combined with the map data stored in the aerial photography device.

[0031] S12, obtaining a large scene image taken by the aerial photography device at the collection location point based on the active indication path.

[0032] The large scene image refers to a scene image obtained by taking a bird's-eye view at a collection location, and the large scene image includes the entire photovoltaic matrix corresponding to the collection location.

[0033] Specifically, after the aerial photography device reaches the corresponding collection position point according to the active indication path, its shooting interface will display a collection frame, which is located at the center of the shooting interface. When shooting, the photovoltaic matrix, that is, the array composed of multiple photovoltaic panels, needs to be fully presented in the collection frame, and ensure that the area of ​​the photovoltaic matrix in the collection frame is maximized, so as to obtain the best shooting data. When shooting the photovoltaic matrix, the shooting height can be adjusted in real time according to actual shooting needs to ensure that the photovoltaic matrix can be fully presented in the collection frame. For example, when the photovoltaic matrix is ​​not completely located in the collection frame, the shooting height can be adjusted accordingly. When the photovoltaic matrix is ​​completely presented in the collection frame and the area of ​​the photovoltaic matrix in the collection frame is maximized, the aerial photography device can be controlled to shoot to obtain the corresponding large scene image.

[0034] S13, identifying device marks in the large scene image, determining a plurality of duty-free device profiles according to the device marks, and grouping the duty-free device profiles to obtain a plurality of device profile groups.

[0035] Among them, the equipment mark refers to a marker that can be used to mark the photovoltaic panel for which the tax exemption is applied this time. For example, it can be a circular marker that is inconsistent with the color of the photovoltaic panel. The equipment mark can be installed at the four top corners of the photovoltaic panel. The tax-free equipment contour refers to the contour corresponding to the equipment for which the tax exemption is applied this time. Specifically, it can be the contour corresponding to the photovoltaic panel with the equipment mark. The equipment contour group refers to a group composed of equipment contours that are relatively close in position.

[0036] In actual applications, there are many photovoltaic panels in a photovoltaic matrix. When applying for tax exemption, not all photovoltaic panels may be the ones for which tax exemption is applied this time. In order to facilitate the identification of the photovoltaic panels for which tax exemption is applied this time, the applicant can install corresponding markers on all photovoltaic panels in the photovoltaic matrix. Specifically, the markers can be installed at the four top corners of the photovoltaic panels, and the markers corresponding to the photovoltaic panels for which tax exemption is applied this time may be different from the markers corresponding to other photovoltaic panels. For example, the marker corresponding to the photovoltaic panel for which tax exemption is applied this time may be a red marker, and the markers corresponding to other photovoltaic panels may be green. When submitting the tax exemption application, the review end may be informed of the specific information of the marker corresponding to the photovoltaic panel for which tax exemption is applied this time, for example, the pixel value range corresponding to the marker corresponding to the photovoltaic panel for which tax exemption is applied this time may be informed.

[0037] After acquiring the large scene image, the device mark corresponding to the photovoltaic panel marked in the large scene image can be identified. Specifically, the marker installed by the applicant at the four top corners of the photovoltaic panel can be identified. For example, when the marker corresponding to the photovoltaic panel for which the tax exemption is applied this time can be a red marker, if the red device mark is identified, the corresponding photovoltaic panel can be considered to be the tax-free device for which the tax exemption is applied this time, and the corresponding outline, that is, the tax-free device outline, can be obtained. By identifying the device mark in the large scene image, multiple tax-free device outlines can be determined. In order to facilitate more accurate identification of the loss of the photovoltaic panel in the future, the detailed image corresponding to the tax-free device can be obtained, so that more accurate image recognition can be performed. The acquired tax-free device outlines can be grouped to obtain multiple groups of device outline groups, and secondary image acquisition is performed on different groups of tax-free devices in turn, so that more accurate image data can be obtained, which is convenient for subsequent authenticity review.

[0038] Based on the above embodiment, the specific implementation of step S13 may be: S131, extracting multiple photovoltaic device contours in the large scene image, and obtaining device marks located at the vertex positions of the photovoltaic device contours.

[0039] The photovoltaic device outline refers to the outline corresponding to the photovoltaic panel in the large scene image.

[0040] Specifically, contours corresponding to multiple photovoltaic panels, ie, photovoltaic device contours, can be extracted from the large scene image, and device markers located at vertex positions can be acquired from each photovoltaic device contour.

[0041] S132, determining a marked pixel value of the device mark, and obtaining a photovoltaic device outline whose marked pixel value is within a tax-free pixel interval as a tax-free device outline.

[0042] Specifically, after obtaining the device mark corresponding to the outline of each photovoltaic device, the pixel value of the device mark corresponding to the outline of each photovoltaic device, that is, the mark pixel value, can be determined. Since the applicant can inform the reviewer of the marker color corresponding to the tax-free device when submitting the tax-free application, the pixel value interval corresponding to the marker color corresponding to the tax-free device can be determined in advance as the tax-free pixel interval, and the mark pixel value corresponding to the device mark on each photovoltaic device outline can be compared with the tax-free pixel interval. If the mark pixel value is within the tax-free pixel interval, the corresponding photovoltaic device outline can be determined as the tax-free device outline.

[0043] Among them, the marked pixel value refers to the pixel value corresponding to the device mark, and the tax-free pixel interval refers to the pixel value interval corresponding to the marker on the tax-free device.

[0044] S133, obtaining the contour distance between the center points of the contours of the duty-free devices, and determining that the positional relationship of the duty-free device contours whose contour distance is less than or equal to the adjacent spacing threshold is an adjacent relationship.

[0045] Among them, the contour distance refers to the distance between the center points of the duty-free device contour, and the adjacent spacing threshold refers to a pre-configured threshold that can be used to determine whether the distance between the center points of the duty-free device contour is close enough. If the contour distance is less than the adjacent spacing threshold, it can be considered that the distance between the corresponding center points of the duty-free device contour is close enough, and the corresponding positional relationship can be determined as an adjacent relationship. The adjacent relationship refers to the positional relationship corresponding to the duty-free device contour whose distance between the center points is less than the adjacent spacing threshold.

[0046] When performing secondary image acquisition on duty-free equipment to obtain clearer close-up images, in order to improve image acquisition efficiency, duty-free equipment that is relatively close may be acquired together. To facilitate the acquisition of duty-free equipment that is relatively close together, the positional relationship between the contours of each device may be obtained first, and then it may be determined whether image acquisition can be performed together based on the positional relationship. Specifically, the distance between the center points of the contours of the duty-free equipment may be obtained, that is, the contour distance. When the contour distance is less than or equal to a pre-configured adjacent spacing threshold, the corresponding duty-free equipment contours may be considered to be relatively close, and the positional relationship of the corresponding duty-free equipment contours may be determined as an adjacent relationship.

[0047] S134, determining the contour area of ​​each duty-free device contour, obtaining the contour area difference of the duty-free device contours in the adjacent relationship, and determining the duty-free device contours whose contour area difference is less than or equal to the area similarity threshold as the same group of device contours.

[0048] Among them, the contour area refers to the area of ​​the duty-free device contour, the contour area difference refers to the area difference corresponding to the adjacent duty-free device contours, and the area similarity threshold refers to the pre-configured area difference threshold that can be used to determine the same group of device contour groups. If the contour area difference is less than or equal to the area similarity threshold, the corresponding duty-free device contours can be determined as the same group of device contour groups. In practical applications, when the inclination angle and position of photovoltaic panels are similar, collecting images of them as a group can significantly reduce the number of collection points and improve collection efficiency. Since the images of photovoltaic panels are taken from a bird's-eye view, when the inclination angles of the photovoltaic panels are similar, the corresponding contour areas will also be closer. Therefore, the contour area can be used to determine whether the contours of duty-free equipment can be classified into the same group.

[0049] Specifically, the area corresponding to each duty-free equipment contour, that is, the contour area, can be obtained. By performing difference calculation on the contour areas corresponding to adjacent duty-free equipment contours, the contour area difference between adjacent duty-free equipment contours can be obtained. If the contour area difference is less than or equal to the area similarity threshold, it can be considered that the inclination angles of the corresponding photovoltaic panels are consistent, and the corresponding duty-free equipment contours can be determined as the same group of equipment contour groups.

[0050] Through the above implementation, the photovoltaic panels for which tax exemption is applied can be accurately distinguished from other photovoltaic panels, thereby ensuring the targetedness of subsequent image acquisition and review, and improving the efficiency of image acquisition.

[0051] S14, determining the detail indication position corresponding to each of the device profile groups, acquiring the close-up image taken by the aerial photography device based on the detail indication position, and obtaining the actively collected image according to the large scene image and the close-up image.

[0052] The detail indication position refers to the position corresponding to each device outline group, and the close-up image refers to the image obtained by the aerial photography equipment photographing the corresponding photovoltaic panel at the detail indication position.

[0053] Specifically, the position point corresponding to each equipment contour group, that is, the detail indication position, can be obtained. Through the detail indication position, more detailed detail image acquisition can be performed on the photovoltaic panels that need to undergo tax exemption review, and clearer image data can be obtained. By controlling the aerial photography equipment to go to the detail indication position to acquire images of the equipment corresponding to the equipment contour group, the corresponding close-up image can be acquired. When taking detail images, the shooting height of the aerial photography equipment can be adjusted accordingly, so that clearer close-up images can be acquired. Actively acquired images can be obtained based on large scene images and close-up images.

[0054] Through the above implementation, it can be ensured that the drone accurately reaches the location of the photovoltaic panels for which tax exemption is applied to take images, and more accurate and clear image data can be obtained, thereby improving the accuracy of the review.

[0055] In some embodiments, the step S14 of “determining the detail indication position corresponding to each of the device profile groups” includes the following steps: S141, obtaining extreme value coordinate values ​​corresponding to a plurality of contour coordinate points of each of the device contour groups, generating four mutually perpendicular outer frame lines according to the extreme value coordinate values, and determining a total acquisition area of ​​each of the device contour groups based on the outer frame lines.

[0056] Among them, the contour coordinate point refers to the contour point corresponding to the duty-free equipment contour in the equipment contour group, the extreme coordinate value refers to the maximum and minimum values ​​of the coordinate value corresponding to the contour coordinate point on the x-axis, and the maximum and minimum values ​​on the y-axis, the outer frame line refers to the line generated according to the extreme coordinate value, including the line perpendicular to the x-axis and the line perpendicular to the y-axis, and the total collection area refers to the area formed by 4 mutually perpendicular outer frame lines.

[0057] In actual applications, when the aerial photography equipment is collecting close-up images of the photovoltaic panels corresponding to each equipment contour group, the corresponding shooting height of the aerial photography equipment can be pre-configured, and the corresponding shooting range at the pre-configured shooting height is determined. Since the shooting range corresponding to the shooting height is limited, if the area where the photovoltaic panels corresponding to the equipment contour group are located exceeds the corresponding shooting range, it may not be possible to capture all complete photovoltaic panels at one time. Therefore, before starting close-up image collection, the area where the duty-free equipment contours in the equipment contour group are located can be compared with the shooting range of the aerial photography equipment at the pre-configured shooting height to determine whether the aerial photography equipment can collect complete images of the duty-free equipment contours in the corresponding group at one time.

[0058] Specifically, when determining the area range of the duty-free equipment contour corresponding to the equipment contour group, multiple contour coordinate points corresponding to the duty-free equipment contour in the equipment contour group can be obtained, and the contour coordinate points can be coordinate-converted to obtain the maximum x-axis coordinate value, the minimum x-axis coordinate value, the maximum y-axis coordinate value and the minimum y-axis coordinate value corresponding to the multiple contour coordinate points. Then, four mutually perpendicular outer frame lines are generated according to these four extreme coordinate values, and the total rectangular collection area is obtained through the four mutually perpendicular outer frame lines. The total collection area includes all duty-free equipment contours in the equipment contour group.

[0059] See also Figure 2 , is a schematic diagram of a total collection area provided by an embodiment of the present invention, such as Figure 2 As shown in , in the large scene image, duty-free equipment contour 1, duty-free equipment contour 2 and duty-free equipment contour 3 are adjacent duty-free equipment contours. Therefore, duty-free equipment contour 1, duty-free equipment contour 2 and duty-free equipment contour 3 can be determined as the same group of equipment contour groups. Through 4 mutually perpendicular outer frame lines, the total collection area of ​​all duty-free equipment contours including the equipment contour group can be obtained.

[0060] S142, retrieve the detail collection frame corresponding to the aerial photography device, locate the center point of the detail collection frame based on the center point of the total collection area, and superimpose the detail collection frame on the top of the device outline group.

[0061] The detail acquisition frame refers to the rectangular acquisition frame corresponding to the shooting range of the aerial photography equipment at the pre-configured shooting height. After obtaining the total acquisition area, the detail acquisition frame corresponding to the corresponding shooting range can be retrieved according to the shooting range corresponding to the aerial photography equipment at the pre-configured shooting height. By positioning the center point of the detail acquisition frame at the center point of the total acquisition area, the detail acquisition frame can be superimposed on the top of the equipment contour group. This can determine whether the aerial photography equipment can perform complete image acquisition of the corresponding equipment contour group at one time at the pre-configured shooting height.

[0062] S143: When the total acquisition area is completely located inside the detail acquisition frame, determine the actual position point corresponding to the center point of the total acquisition area as the detail indication position.

[0063] Specifically, if the total acquisition area is completely inside the detail acquisition frame, it can be considered that the aerial photography equipment can perform complete image acquisition of the duty-free equipment profile in the corresponding equipment profile group at one time. Since the total acquisition area is an area in the large scene image, its corresponding center point is a point in the image. When performing image acquisition, the aerial photography equipment needs to go to the actual position point for shooting. Therefore, the actual position point corresponding to the center point of the total acquisition area can be determined as the detail indication position. Among them, the actual position point refers to the position point corresponding to the center point of the total acquisition area in reality.

[0064] When determining the actual position point corresponding to the center point of the total collection area, the center point of the detail collection frame can be determined as the current position point of the aerial photography device, and the longitude and latitude coordinates of the current position point of the aerial photography device can be obtained according to the positioning system on the aerial photography device. Since in the image taken by the aerial photography device, there is a corresponding conversion ratio between the size of the total collection area and the size on the actual ground, and since the shooting height of the aerial photography device is pre-configured, the conversion ratio can also be determined. According to the conversion ratio, the distance from the center point of the detail collection frame in the image to the center point of the total collection area can be converted into the actual distance on the actual ground, and the direction from the center point of the detail collection frame to the center point of the total collection area can be obtained. A position point can be determined at the actual distance from the longitude and latitude corresponding to the current aerial photography device in this direction. When the shooting height is determined, the position point is the actual position point corresponding to the center point of the total collection area.

[0065] S144, when the total acquisition area is not completely within the detail acquisition frame, obtaining a differential device outline within the total acquisition area, and determining an actual position point corresponding to a center point of the total acquisition area and the differential device outline as the detail indication position.

[0066] The difference device profile refers to the profile corresponding to the abnormal photovoltaic panel.

[0067] If the total acquisition area is not completely within the detail acquisition frame, it can be considered that the aerial photography equipment is unable to perform complete image acquisition of the duty-free equipment contours in the corresponding equipment contour group at one time. At this time, the contours corresponding to the equipment with obvious differences in the total acquisition area, that is, the difference equipment contours, can be obtained, and separate image data acquisition is performed on the difference equipment contours. Specifically, the photovoltaic panels corresponding to the duty-free equipment contours in the same acquisition area usually have similar parameters, so their performance in the image should also be similar. Normally operating photovoltaic panels should have a uniform color. If the color of a photovoltaic panel is significantly different from that of other photovoltaic panels, it may mean that there are problems such as corrosion or damage on the surface of the photovoltaic panel. At this time, the contour corresponding to the photovoltaic panel can be determined as the difference equipment contour, and the actual position point corresponding to the center point of the difference equipment contour can be determined as the detail indication position when close-up image acquisition is performed on the photovoltaic panel corresponding to the difference equipment contour, and the real-time position point corresponding to the center point of the total acquisition area is determined as the detail indication position when close-up image acquisition is performed on the duty-free equipment contour corresponding to the equipment contour group.

[0068] In some embodiments, the specific implementation of step S144 may be: S1441, obtaining pixel means corresponding to each duty-free device outline in the total acquisition area, and determining that the duty-free device outlines whose pixel means are within the same preset pixel interval are the same device subgroup.

[0069] Specifically, the pixel values ​​corresponding to the multiple contour points of each duty-free device contour in the collection area can be obtained, and the pixel values ​​corresponding to the multiple contour points of each duty-free device contour can be averaged to obtain the pixel mean corresponding to each duty-free device contour, and multiple preset pixel intervals are pre-configured, and the duty-free device contours with pixel means in the same preset pixel interval are determined as the same device subgroup. Among them, the pixel mean refers to the average value of the pixel values ​​corresponding to the multiple contour points of the duty-free device contour, and the preset pixel interval refers to multiple pre-configured pixel value intervals.

[0070] S1442, determining a preset pixel interval corresponding to the device subgroup with the largest number of duty-free device profiles as a reference pixel interval, and determining duty-free device profiles corresponding to the remaining device subgroups as difference device profiles.

[0071] Specifically, the number of duty-free device profiles contained in each device subgroup may be different. Since the corresponding loss conditions of duty-free devices located in the same collection area are similar under normal circumstances, the pixel values ​​of duty-free device profiles in the same collection area are also similar. The device subgroup with the largest number of duty-free device profiles can be obtained. It can be considered that the photovoltaic panels corresponding to the duty-free device profiles in this device subgroup are normal photovoltaic panels. The preset pixel interval corresponding to this device subgroup can be determined as the reference pixel interval. The photovoltaic panels corresponding to the duty-free device profiles in the remaining device subgroups may have abnormal pixel values ​​due to corrosion or damage problems. The duty-free device profiles corresponding to the remaining device subgroups can be determined as differential device profiles. Among them, the reference pixel interval refers to the preset pixel interval corresponding to the device subgroup with the largest number of duty-free device profiles.

[0072] S1443, acquiring an actual position point corresponding to the center point of the total acquisition area as a first indication position, and determining a standard acquisition height corresponding to the detail acquisition frame as a acquisition height corresponding to the first indication position.

[0073] Specifically, the actual position point corresponding to the center point of the total acquisition area can be determined as the first indication position, and the pre-configured shooting height corresponding to the detail acquisition frame, that is, the standard acquisition height, can be determined as the acquisition height corresponding to the first indication position. The first indication position refers to the position when the characteristic image of the photovoltaic panel corresponding to the total acquisition area is acquired, the standard acquisition height refers to the shooting height corresponding to the detail acquisition frame, and the acquisition height refers to the shooting height corresponding to the corresponding image acquisition position point of the aerial photography device.

[0074] S1444, determining the actual position point corresponding to the center point of the difference device contour as the second indication position, successively reducing and adjusting the detail collection frame according to multiple reduction ratios, and obtaining in real time the area ratio of the contour area of ​​the difference device contour and the area of ​​the framed area of ​​the detail collection frame.

[0075] When performing separate image acquisition for the photovoltaic panels corresponding to the difference device contours, the center point of the duty-free device contour can be determined as the second actual position. Since the shooting height will affect the clarity and details of the image, in order to acquire clearer image data, the shooting height can be adjusted accordingly. Specifically, since the detail acquisition frame may be much larger than a single device contour, when performing feature image acquisition for each difference device contour, in order to find the optimal shooting height, multiple reduction ratios can be set in advance, and a corresponding shooting height can be configured for each reduction ratio. The detail acquisition frame can be reduced and adjusted in turn according to the corresponding reduction ratio, and after each adjustment of the detail acquisition frame size, the area ratio of the contour area of ​​the difference device contour to the framed area of ​​the detail acquisition frame can be obtained in real time.

[0076] Among them, the second indicated position refers to the position when the characteristic image of the photovoltaic panel corresponding to each different device contour is collected, the reduction ratio refers to the pre-configured ratio when the detail collection frame is reduced and adjusted, the area of ​​the framed area refers to the area corresponding to the detail collection frame, and the area ratio refers to the ratio between the contour area of ​​the different device contour and the area of ​​the framed area.

[0077] S1445, when the difference device outline is completely located in the detail collection frame and the area ratio is the largest, stop the reduction adjustment of the detail collection frame, and obtain the preset collection height corresponding to the reduction ratio, and use the preset collection height as the collection height corresponding to the second indication position.

[0078] The detail indication position includes a first indication position and a second indication position.

[0079] Specifically, in the process of reducing and adjusting the detail capture frame according to the corresponding reduction ratios, if the difference device outline is completely within the detail capture frame and the area ratio calculated at this time is the largest, then it can be considered that the current detail capture frame size can both completely cover the difference device outline and ensure that the captured image has the maximum detail clarity. At this time, the reduction and adjustment of the detail capture frame can be stopped. Since each reduction ratio can be pre-configured with a corresponding shooting height, that is, a preset capture height, the preset capture height corresponding to the current reduction ratio can be obtained. At the preset capture height, the captured image has the best clarity and details. The preset capture height can be determined as the capture height corresponding to the second indication position.

[0080] The preset acquisition height refers to the pre-configured shooting height corresponding to each reduction ratio.

[0081] Through the above implementation, the best shooting height when capturing close-up images can be obtained, so that close-up images with the best clarity can be obtained.

[0082] S2, acquiring active identification data corresponding to the duty-free device according to the actively collected image, and sending the active identification data to the audit end.

[0083] In actual applications, for photovoltaic panels from the same batch that apply for tax exemption, the loss conditions in the same time period are relatively similar. The loss conditions of photovoltaic panels from the same batch can be compared and analyzed based on actively collected images to determine whether the equipment applying for tax exemption is from the same batch, so as to reduce the risk of tax-free equipment being replaced. The corresponding active identification data can be obtained and sent to the auditors at the audit end for review.

[0084] The active identification data refers to data obtained after identifying the loss condition of the photovoltaic panel in the active identification image.

[0085] Based on the above embodiment, the specific implementation of step S2 may be: S21, obtaining the installation days of the tax-free equipment, determining the loss stage corresponding to the installation days, and obtaining a preset loss coefficient corresponding to the loss stage.

[0086] Specifically, the number of days the tax-free equipment has been installed can be obtained based on the installation time of the tax-free equipment and the time of applying for tax exemption, and a pre-configured loss situation correspondence table can be retrieved. In the loss situation correspondence table, the loss stages that the equipment may experience under different installation days are divided in detail. For example, the loss stage corresponding to the tax-free equipment with an installation day of 0-30 days can be determined as the initial stage, the loss stage corresponding to the tax-free equipment with an installation day of 31-180 days can be determined as the early loss stage, and the loss stage corresponding to the tax-free equipment with an installation day of more than 180 days can be determined as the mid-term loss stage, etc., and each loss stage has a pre-configured corresponding preset loss coefficient. The smaller the installation days, the smaller the corresponding preset loss coefficient may be.

[0087] After obtaining the installation days corresponding to the tax-free equipment, the installation days can be compared with the pre-configured loss situation correspondence table to determine the corresponding loss stage and the preset loss coefficient corresponding to the corresponding loss stage.

[0088] Among them, the number of installation days refers to the difference in days between the time of applying for tax exemption and the time of installation, the wear and tear stage refers to the different stages of the tax-free equipment in its operating cycle, and the preset wear and tear coefficient refers to the coefficient that can be used to represent the degree of wear and tear of the tax-free equipment in the corresponding wear and tear stage.

[0089] S22, identifying defect contours in the contours of each duty-free device in the close-up image, wherein the defect contours at least include crack contours, fracture contours, and contaminant contours.

[0090] Specifically, the image recognition technology can be used to identify the contours of duty-free equipment in close-up images, and the defect contours in each duty-free equipment contour in the close-up image can be identified, including crack contours, fracture contours, contaminant contours, etc. Among them, the defect contour refers to the contour that is formed inside or at the edge of the duty-free equipment contour in the close-up image and does not conform to the normal shape of the duty-free equipment. The crack contour refers to the contour corresponding to the slender and irregular cracks on the surface of the duty-free equipment. The fracture contour refers to the contour formed by the complete disconnection of the duty-free equipment. The contaminant contour refers to the contour corresponding to the contaminant on the duty-free equipment.

[0091] S23, counting the defect areas of the defect contours, and retrieving the preset loss coefficients corresponding to the defect contours and the preset defect areas corresponding to the preset loss coefficients.

[0092] Specifically, the area corresponding to each defect contour, that is, the defect area, can be obtained, and a pre-configured loss coefficient table can be retrieved. In the loss coefficient table, different defect contours correspond to different preset loss coefficients, and each preset loss coefficient has a corresponding preset defect area. The larger the loss coefficient, the larger the corresponding preset defect area may be. For example, the function of the duty-free equipment corresponding to the fracture contour may be seriously affected, so the corresponding preset loss coefficient can be larger. The function of the duty-free equipment corresponding to the crack contour is usually not greatly affected, so the corresponding preset loss coefficient can be smaller.

[0093] Among them, the defect area refers to the area corresponding to the defect contour in the tax-free equipment contour, and the preset defect area refers to the defect area corresponding to the preset loss coefficient.

[0094] S24, obtaining an offset coefficient according to a ratio of the defect area to the preset defect area, and obtaining a current loss coefficient corresponding to the defect profile according to a product of the offset coefficient and the preset loss coefficient.

[0095] Specifically, by calculating the ratio of the defect area corresponding to the defect contour on the duty-free equipment contour to the corresponding preset defect area, an offset coefficient for offsetting the preset loss coefficient can be obtained. The offset coefficient can reflect the degree of deviation of the actual defect area from the preset defect area. By multiplying the offset coefficient with the preset loss coefficient, the current loss coefficient corresponding to the defect contour can be obtained. Among them, the offset coefficient refers to a coefficient that can offset the preset loss coefficient, and the current loss coefficient refers to a coefficient obtained after the preset loss coefficient is offset.

[0096] S25, obtaining a total loss coefficient by counting the current loss coefficients of each of the tax-free equipment profiles, and calculating a first difference in the total loss coefficients between the tax-free equipment profiles and a second difference between each total loss coefficient and a preset loss coefficient.

[0097] Specifically, since there may be multiple defective contours on the duty-free equipment contour, the current loss coefficients corresponding to the multiple defective contours on the duty-free equipment contour can be summed to obtain the total loss coefficient corresponding to each duty-free equipment contour. By performing difference calculation on the total loss coefficients corresponding to each duty-free equipment contour, a corresponding first difference can be obtained. The first difference can reflect the degree of difference in the loss conditions corresponding to each duty-free equipment. The smaller the first difference, the closer the loss conditions between the corresponding duty-free equipment are. By performing difference calculation on the total loss coefficient corresponding to each duty-free equipment contour and the preset loss coefficient, a corresponding second difference can be obtained. The second difference can reflect the degree of difference between the actual loss condition of each duty-free equipment and the loss condition of the duty-free equipment in the corresponding loss stage.

[0098] Among them, the total loss coefficient refers to the sum of the current loss coefficients corresponding to multiple defect profiles, the first difference refers to the difference between the total loss coefficients corresponding to the tax-free equipment profiles, and the second difference refers to the difference between the total loss coefficient corresponding to the tax-free equipment profile and the preset loss coefficient.

[0099] S26, when all the first differences are smaller than the equipment loss threshold and all the second differences are smaller than the duration loss threshold, normal identification information is generated, and active identification data is obtained based on the normal identification information and sent to the audit end.

[0100] The equipment loss threshold refers to a threshold that can be used to determine whether the loss conditions of duty-free equipment are relatively close. If all first differences are less than the equipment loss threshold, it can be considered that the loss conditions of duty-free equipment are relatively close. If there is a first difference greater than the equipment loss threshold, it can be considered that the loss conditions of the corresponding duty-free equipment may be different. The duration loss threshold refers to a threshold that can be used to determine whether the loss conditions of duty-free equipment correspond to the loss stage. Specifically, if all the first differences are smaller than the equipment loss threshold, and all the second differences are smaller than the duration loss threshold, it can be considered that the loss conditions of the corresponding duty-free equipment are relatively similar, and the loss conditions corresponding to each duty-free equipment correspond to the corresponding loss stage. It can be considered that the corresponding multiple duty-free equipment are from the same batch of duty-free equipment and have not been replaced. The duty-free equipment in this batch can be exempted from tax, and therefore the corresponding normal identification information can be generated. Based on the normal identification information, the corresponding active identification data can be obtained and sent to the review end.

[0101] S3, or, based on the auxiliary acquisition mode, obtaining the movement information of the ground equipment, generating a passive indication path according to the movement information, and obtaining the auxiliary acquisition image taken by the aerial photography equipment based on the passive indication path.

[0102] Among them, the auxiliary acquisition mode refers to a mode of guiding the aerial photography equipment to acquire images through ground equipment. The ground equipment refers to equipment that can be used to guide the aerial photography equipment to acquire images, such as a ground robot. The movement information refers to the position, speed, direction and other related information generated by the ground equipment during the movement. The passive indication path refers to the path generated by the movement information of the ground equipment and is used to guide the aerial photography equipment to take images. The auxiliary acquisition image refers to the image acquired by the aerial photography equipment in the auxiliary acquisition mode.

[0103] In actual applications, since the accuracy of aerial photography equipment is limited when performing positioning, if the environment in which the photovoltaic panels applied for review are located is relatively complex, the aerial photography equipment may not be able to accurately locate the location of the corresponding photovoltaic panels. In this case, the applicant can choose the corresponding auxiliary acquisition mode. At this time, the ground equipment such as the ground robot can be controlled to provide corresponding auxiliary guidance for the aerial photography equipment. The ground equipment will guide the aerial photography equipment to the location of the photovoltaic panels and collect images.

[0104] Specifically, in the auxiliary acquisition mode, the movement information of the ground equipment can be obtained, such as the moving position, moving speed and other information. According to the movement information of the ground equipment, a passive indication path can be generated to guide the aerial photography equipment to the corresponding position for image acquisition. The aerial photography equipment can go to the location of the duty-free equipment along the passive indication path, take images of the duty-free equipment, and obtain corresponding auxiliary acquisition images.

[0105] Based on the above embodiment, the specific implementation of step S3 may be: S31, obtaining a bird's-eye view video shot by the aerial photography device, calling a preset image of a ground device, and identifying the outline of the ground device in the bird's-eye view video according to the preset image.

[0106] Specifically, video data of the aerial photography equipment taking bird's-eye view photos, i.e., bird's-eye view videos, can be obtained. Since there may be multiple objects in the bird's-eye view videos, image processing techniques such as contour extraction techniques can be used to identify the contours of multiple objects in the video. All possible object contours can be extracted from the bird's-eye view videos. In order to accurately identify the ground robot, the preset image corresponding to the ground device can be retrieved, and the object contour extracted from the bird's-eye view video can be compared with the preset image for contour similarity. It can be determined that the object contour with the greatest contour similarity is the contour corresponding to the ground device, i.e., the ground device contour.

[0107] Among them, the bird's-eye view video refers to the video shot by the aerial photography equipment from a bird's-eye view angle, the preset image refers to the image corresponding to the ground equipment, and the ground equipment outline refers to the outline corresponding to the ground equipment, for example, it can be the outline corresponding to the ground robot.

[0108] S32, determining the center point of the ground equipment outline as a positioning point, obtaining the movement information according to the displacement information of the positioning point in adjacent video frames, and generating the passive indication path based on the movement information.

[0109] The positioning point refers to a position point in the overhead video where the ground equipment can be positioned, and the displacement information refers to information that can reflect the position change of the ground equipment.

[0110] Specifically, the ground equipment can be controlled by the applicant when it moves, and when controlling the movement of the ground equipment, the corresponding moving path can be obtained. The aerial photography equipment can follow the ground equipment in combination with the moving path. When obtaining the moving path of the ground equipment, the center point of the ground equipment outline can be determined as the positioning point. Since the ground equipment is moving in real time, the outline and positioning point of the ground equipment are changing in real time in the multiple video frames corresponding to the overhead video. By comparing the positions of the positioning points in adjacent video frames, the displacement information of the positioning points can be calculated. According to the displacement information, the corresponding moving path of the ground equipment, that is, the movement information, can be obtained. According to the movement information of the ground equipment, a passive indication path can be generated for the aerial photography equipment to follow the ground equipment.

[0111] S33, obtaining the moving speed of the ground device, and determining the flying speed of the aerial photography device according to the moving speed.

[0112] Specifically, since the ground equipment has a corresponding moving speed when it moves, in order to ensure that the aerial photography equipment can stably and effectively follow the ground equipment, the moving speed corresponding to the ground equipment can be obtained, and the flying speed of the aerial photography equipment can be determined according to the moving speed of the ground equipment, so as to ensure that the moving speed of the aerial photography equipment is compatible with the aerial photography equipment of the ground equipment. Among them, the moving speed refers to the speed of the ground equipment when it moves, and the flying speed refers to the speed of the aerial photography equipment when it follows the ground equipment.

[0113] S34, controlling the aerial photography device to move based on the passive indication path and the flight speed, determining the position point when the ground device stops moving as the target acquisition point, and acquiring the auxiliary acquisition image taken by the aerial photography device at the target acquisition point.

[0114] Specifically, the aerial photography device can be controlled to move according to the passive indication path and the corresponding flight speed. When the ground device stops moving, it can be considered that the corresponding image acquisition position point has been reached. The position point when the ground device stops moving can be used to determine the target acquisition point. When the ground device stops moving at the target acquisition point, the aerial photography device will also stop at the target acquisition point. The aerial photography device is controlled to capture images at the target acquisition point to obtain the corresponding auxiliary acquisition image. Since the target acquisition point may be the position point corresponding to the photovoltaic matrix, the obtained auxiliary acquisition image may be an image containing the complete photovoltaic matrix. Among them, the target acquisition point may be the position point corresponding to the photovoltaic matrix.

[0115] Based on the above steps, this solution also includes the following embodiments: A1, when the number of the contours of the ground equipment is greater than a preset base number, the displacement spacing between the positioning points of each contour of the ground equipment in adjacent video frames is obtained.

[0116] Among them, the preset cardinality is 1, the positioning point can be the center point of the outline of the ground equipment in the video frame, and the displacement spacing is the distance between the positioning points in adjacent video frames.

[0117] In some embodiments, when the area where the photovoltaic matrix is ​​located is large, the ground equipment may run out of power while moving. If the ground equipment stops moving due to lack of power, the aerial photography equipment may mistakenly believe that the location where the movement stops is the corresponding target collection point, and may thus collect erroneous images. In order to avoid the above situation, multiple ground equipment can be dispatched for collaborative guidance to ensure that the aerial photography equipment can accurately and continuously follow the ground equipment to the correct target collection point.

[0118] Specifically, when the number of ground device contours identified in the row-assisted acquisition image is greater than 1, it can be considered that multiple ground devices are dispatched for collaborative guidance. Among the multiple ground devices, a power monitoring module can be configured on each ground device to monitor its power status in real time, and a low power threshold can be pre-configured. When it is detected that the power of the ground device is lower than the threshold, it can be considered that the ground device is insufficient in power and it may gradually slow down. At this time, collaborative guidance information can be sent to other ground devices, and other ground devices with sufficient power can continue to provide path guidance. Therefore, the distance between the contour positioning points corresponding to the same ground device in adjacent video frames can be obtained, that is, the displacement spacing. The displacement spacing can reflect the movement of the ground device between consecutive frames. If the displacement spacing gradually decreases, it can be considered that the corresponding ground device is gradually slowing down. If the displacement spacing gradually increases, it can be considered that the corresponding ground device is relaying path guidance. Therefore, the ground device that the aerial photography device needs to follow can be determined according to the displacement spacing.

[0119] A2, determining the ground equipment profile whose displacement interval gradually decreases within a preset time period as a screening profile, and determining the ground equipment profile other than the screening profile as a target equipment profile.

[0120] Among them, the preset time period refers to the time range that can be used to observe the changes in the displacement spacing of ground equipment, the screening profile refers to the profile of ground equipment identified as moving extremely slowly, and the target equipment profile refers to the profile of ground equipment that is still moving normally.

[0121] Specifically, within a preset time period, if the displacement spacing of the contour of a certain ground device gradually decreases, it can be considered that the corresponding ground device may be moving slower due to insufficient power, and it can be considered that the corresponding ground device cannot continue to provide path guidance for the aerial photography device, and it can be determined as a screened-out contour. In addition to the screened-out contours, the contours corresponding to other ground devices that are still moving normally can be determined as target device contours.

[0122] A3, obtaining a moving path of the target device outline, and determining that the moving path is the passive indication path.

[0123] Specifically, a corresponding moving path may be generated according to the positioning points and displacement information of the target device outline, and the moving path may be determined as a passive indication path that the aerial photography device needs to follow.

[0124] Through the above implementation, it can be ensured that the aerial photography equipment can accurately and continuously follow the ground equipment to reach the correct target collection point, thereby significantly improving the shooting efficiency and quality.

[0125] S4, obtaining auxiliary identification data of the duty-free device according to the auxiliary collected image, and sending the auxiliary identification data to the audit end.

[0126] Specifically, since the acquired auxiliary acquisition image is a panoramic image containing a complete photovoltaic matrix, when acquiring identification data, the applicant can construct a twin model corresponding to the photovoltaic matrix. The applicant can select the equipment to be audited for duty-free status from the twin model, and according to the duty-free equipment selected in the twin model, the corresponding equipment outline can be determined in the auxiliary acquisition image for circle, and the corresponding auxiliary identification data can be obtained, and the auxiliary equipment data can be sent to the auditor for review. Among them, the auxiliary identification data refers to the identification data acquired based on the auxiliary acquisition image.

[0127] In some embodiments, the specific implementation of step S4 may be: S41, obtaining the matrix twin space sent by the applicant, and determining the first row and column numbers corresponding to each audited photovoltaic panel in the matrix twin space.

[0128] Specifically, the twin model corresponding to the photovoltaic matrix constructed by the applicant can be obtained, that is, the matrix twin space. In the matrix twin space, there is a photovoltaic panel model corresponding to the real photovoltaic matrix. The model corresponding to the photovoltaic panel to be reviewed this time can be determined as the review photovoltaic panel. According to the row and column positions of each review photovoltaic panel in the matrix, each review photovoltaic panel in the matrix twin space can be numbered to obtain the first row and column number corresponding to each review photovoltaic panel. Among them, the matrix twin space refers to the virtual model corresponding to the photovoltaic matrix constructed by the auditor, the review photovoltaic panel refers to each photovoltaic panel model constructed in the matrix twin space, and the first row and column number refers to the number corresponding to each review photovoltaic panel, which can be used to uniquely identify each review photovoltaic panel in the matrix twin space.

[0129] S42, identifying the photovoltaic matrix contour and row and column direction identifiers in the auxiliary acquisition image, and determining the row and column arrangement direction of the photovoltaic matrix contour according to the row and column direction identifiers.

[0130] Specifically, the overall outline of the photovoltaic matrix, that is, the photovoltaic matrix outline, can be identified from the auxiliary acquisition image, and a mark indicating the row and column arrangement direction of the photovoltaic matrix can be identified from the auxiliary acquisition image, such as an arrow mark, and the row and column arrangement direction of the photovoltaic matrix outline can be determined based on the identified row and column direction mark. Figure 3 , which is a schematic diagram of determining the row and column arrangement direction provided by an embodiment of the present invention, such as Figure 3 As shown in , from the auxiliary acquisition image, the direction mark from left to right and the direction mark from top to bottom can be obtained. According to the direction mark from left to right, it can be seen that the rows of the photovoltaic matrix are arranged from left to right, and the direction mark from left to right can be used to determine the arrangement direction of the rows. According to the direction mark from top to bottom, it can be seen that the columns of the photovoltaic matrix are arranged from top to bottom, and the direction mark from top to bottom can be determined as the arrangement direction of the columns.

[0131] The row and column direction identifier refers to an identifier used to clearly indicate the row and column arrangement direction of the photovoltaic matrix in the auxiliary acquisition image, and the row and column arrangement direction refers to the arrangement direction of rows and columns corresponding to the photovoltaic matrix contour.

[0132] S43, determining a second row and column number of each photovoltaic panel outline in the photovoltaic matrix outline according to the row and column arrangement direction, and determining a second row and column number corresponding to the first row and column number as a target number.

[0133] Specifically, after determining the row and column arrangement direction, each photovoltaic panel outline in the photovoltaic matrix outline can be numbered to obtain the second row and column number corresponding to each photovoltaic panel outline, and the second row and column number corresponding to the first row and column number can be determined as the target number, for example Figure 3As shown in , by numbering the contours of each photovoltaic panel according to the corresponding row and column arrangement direction, it can be obtained that the second row and column numbers corresponding to each photovoltaic panel in the first row are 1-3 respectively, and the second row and column numbers corresponding to each photovoltaic panel in the second row are 4-6 respectively. When the first row and column numbers are 2 and 4 respectively, then 2 and 4 in the second row and column numbers can be determined as the target numbers.

[0134] The second row and column number refers to the number corresponding to each photovoltaic panel outline in the photovoltaic matrix outline, and the target number refers to the second row and column number corresponding to the first row and column number.

[0135] S44, generating an audit prompt box corresponding to the photovoltaic panel outline of the target number, updating the auxiliary acquisition image to obtain auxiliary identification data, and sending the auxiliary identification data to the audit end.

[0136] Specifically, for each photovoltaic panel contour corresponding to a target number, an audit prompt box can be generated on the auxiliary acquisition image, for example, it can be a rectangular box with the same specifications as the photovoltaic panel contour, so as to highlight the photovoltaic panel to be subject to tax-free audit. The generated audit prompt box is superimposed on the auxiliary acquisition image to obtain updated auxiliary identification data, and the updated auxiliary identification data can be sent to the audit end, so that the auditor can more conveniently perform the tax-free audit of the photovoltaic panels and improve the audit efficiency.

[0137] Through the above implementation, auditors can more accurately identify and locate photovoltaic panels to be subject to tax exemption audit, thereby improving audit efficiency.

[0138] See also Figure 4 , is a schematic diagram of the structure of a duty-free equipment automatic identification device provided by an embodiment of the present invention. The data processing system based on the duty-free equipment automatic identification device includes: A response module, used to respond to the device identification request of the audit end, obtain the active indication path based on the automatic acquisition mode, and obtain the active acquisition image taken by the aerial photography device based on the active indication path; an acquisition module, used for acquiring active identification data corresponding to the duty-free device according to the active acquisition image, and sending the active identification data to the audit end; or, A generating module, configured to obtain movement information of the ground device based on the auxiliary acquisition mode, generate a passive indication path according to the movement information, and obtain an auxiliary acquisition image taken by the aerial photography device based on the passive indication path; A sending module is used to obtain the auxiliary identification data of the duty-free device according to the auxiliary collected image, and send the auxiliary identification data to the audit end.

[0139] Figure 4 The apparatus of the embodiment shown can be used to perform Figure 1 The implementation principles and technical effects of the steps in the method embodiment shown are similar and will not be repeated here.

[0140] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A method for automatically identifying duty-free equipment, characterized in that: include: In response to the device identification request of the audit end, an active indication path is obtained based on the automatic acquisition mode, and an active acquisition image is obtained by the aerial photography device based on the active indication path; Acquire active identification data corresponding to the duty-free device according to the active acquisition image, and send the active identification data to the audit end; or, Acquire movement information of the ground device based on the auxiliary acquisition mode, generate a passive indication path according to the movement information, and acquire an auxiliary acquisition image taken by the aerial photography device based on the passive indication path; Auxiliary identification data of the duty-free device is acquired according to the auxiliary collected image, and the auxiliary identification data is sent to the audit end.

2. The method according to claim 1, characterized in that Responding to the device identification request of the audit end, obtaining the active indication path based on the automatic acquisition mode, and obtaining the active acquisition image taken by the aerial photography device based on the active indication path, including: Receiving the collection location point sent by the application end, and generating an active indication path according to the current location point and the collection location point of the aerial photography device; Acquire a large scene image taken by the aerial photography device at the acquisition location based on the active indication path; Identify device marks in the large scene image, determine a plurality of duty-free device outlines according to the device marks, and group the duty-free device outlines to obtain a plurality of device outline groups; Determine the detail indication position corresponding to each of the device profile groups, obtain the close-up image taken by the aerial photography device based on the detail indication position, and obtain the actively collected image according to the large scene image and the close-up image.

3. The method according to claim 2, characterized in that Identifying device marks in the large scene image, determining a plurality of duty-free device outlines according to the device marks, and grouping the duty-free device outlines to obtain a plurality of device outline groups, including: Extracting multiple photovoltaic device contours in the large scene image, and obtaining device marks located at the vertex positions of the contours of each photovoltaic device; Determine a marked pixel value of the device mark, and obtain a photovoltaic device outline whose marked pixel value is within a tax-free pixel interval as a tax-free device outline; Acquire the contour distance between the center points of the contours of the duty-free devices, and determine that the positional relationship of the contours of the duty-free devices whose contour distance is less than or equal to the adjacent spacing threshold is an adjacent relationship; Determine the contour area of ​​each duty-free device contour, obtain the contour area difference of the duty-free device contours in the adjacent relationship, and determine the duty-free device contours whose contour area difference is less than or equal to the area similarity threshold as the same group of device contours.

4. The method according to claim 3, characterized in that Determining the detail indication position corresponding to each of the device profile groups includes: Acquire extreme value coordinate values ​​corresponding to a plurality of contour coordinate points of each of the device contour groups, generate four mutually perpendicular outer frame lines according to the extreme value coordinate values, and determine a total acquisition area of ​​each of the device contour groups based on the outer frame lines; Retrieving a detail collection frame corresponding to the aerial photography device, locating the center point of the detail collection frame based on the center point of the total collection area, and superimposing the detail collection frame on the top of the device outline group; When the total acquisition area is completely located within the detail acquisition frame, determining the actual position point corresponding to the center point of the total acquisition area as the detail indication position; When the total acquisition area is not completely within the detail acquisition frame, the difference device outline within the total acquisition area is acquired, and the actual position point corresponding to the center point of the total acquisition area and the difference device outline is determined as the detail indication position.

5. The method according to claim 4, characterized in that When the total acquisition area is not completely within the detail acquisition frame, obtaining a difference device outline within the total acquisition area, and determining an actual position point corresponding to a center point of the total acquisition area and the difference device outline as the detail indication position, including: Obtaining pixel means corresponding to each duty-free device outline in the total acquisition area, and determining that the duty-free device outlines whose pixel means are within the same preset pixel interval are the same device subgroup; Determine the preset pixel interval corresponding to the device subgroup with the largest number of duty-free device profiles as the reference pixel interval, and determine the duty-free device profiles corresponding to the remaining device subgroups as difference device profiles; Acquire the actual position point corresponding to the center point of the total acquisition area as the first indication position, and determine the standard acquisition height corresponding to the detail acquisition frame as the acquisition height corresponding to the first indication position; Determine the actual position point corresponding to the center point of the difference device outline as the second indication position, sequentially reduce and adjust the detail collection frame according to multiple reduction ratios, and obtain in real time the area ratio of the outline area of ​​the difference device outline to the area of ​​the framed area of ​​the detail collection frame; When the difference device outline is completely located in the detail collection frame and the area ratio is the largest, the reduction adjustment of the detail collection frame is stopped, and a preset collection height corresponding to the reduction ratio is obtained, and the preset collection height is used as the collection height corresponding to the second indication position; The detail indication position includes a first indication position and a second indication position.

6. The method according to claim 2, characterized in that Acquiring active identification data corresponding to the duty-free device according to the active acquisition image, and sending the active identification data to the audit end, including: Obtain the installation days of the tax-free equipment, determine the loss stage corresponding to the installation days, and obtain the preset loss coefficient corresponding to the loss stage; identifying defect profiles in the profiles of each duty-free device in the close-up image, the defect profiles comprising at least crack profiles, fracture profiles, and contaminant profiles; Counting the defect areas of the defect contours, and retrieving the preset loss coefficients corresponding to the defect contours and the preset defect areas corresponding to the preset loss coefficients; Obtaining a shift coefficient according to a ratio of the defect area to the preset defect area, and obtaining a current loss coefficient corresponding to the defect profile according to a product of the shift coefficient and the preset loss coefficient; Counting the current loss coefficients of each of the tax-free equipment profiles to obtain a total loss coefficient, and calculating a first difference in the total loss coefficients between the tax-free equipment profiles and a second difference between each total loss coefficient and a preset loss coefficient; When all first differences are smaller than the equipment loss threshold and all second differences are smaller than the duration loss threshold, normal identification information is generated, and active identification data is obtained based on the normal identification information and sent to the audit end.

7. The method according to claim 1, characterized in that Acquiring movement information of the ground device based on the auxiliary acquisition mode, generating a passive indication path according to the movement information, and acquiring an auxiliary acquisition image taken by the aerial photography device based on the passive indication path, including: Acquire the bird's-eye view video of the aerial photography device, retrieve the preset image of the ground device, and identify the outline of the ground device in the bird's-eye view video according to the preset image; Determine the center point of the ground equipment outline as a positioning point, obtain the movement information according to the displacement information of the positioning point in adjacent video frames, and generate the passive indication path based on the movement information; Acquire the moving speed of the ground device, and determine the flying speed of the aerial photography device according to the moving speed; The aerial photography device is controlled to move based on the passive indication path and the flight speed, the position point when the ground device stops moving is determined as the target collection point, and the auxiliary collection image taken by the aerial photography device at the target collection point is obtained.

8. The method according to claim 7, characterized in that After identifying the outline of the ground equipment in the overhead video according to the preset image, the method further includes: When the number of contours of the ground equipment contours is greater than a preset base number, obtaining a displacement spacing between positioning points of each contour of the ground equipment in adjacent video frames; Determine the ground equipment profile whose displacement interval gradually decreases within a preset time period as a screening profile, and determine the ground equipment profile other than the screening profile as a target equipment profile; A moving path of the target device profile is acquired, and the moving path is determined to be the passive indication path.

9. The method according to claim 1, characterized in that: Acquiring auxiliary identification data of the duty-free device according to the auxiliary acquisition image, and sending the auxiliary identification data to the audit end, comprises: Obtain the matrix twin space sent by the applicant, and determine the first row and column numbers corresponding to each audited photovoltaic panel in the matrix twin space; Identify the photovoltaic matrix contour and row and column direction marks in the auxiliary acquisition image, and determine the row and column arrangement direction of the photovoltaic matrix contour according to the row and column direction marks; Determine the second row and column number of each photovoltaic panel outline in the photovoltaic matrix outline according to the row and column arrangement direction, and determine the second row and column number corresponding to the first row and column number as the target number; Generate an audit prompt box corresponding to the photovoltaic panel outline of the target number, update the auxiliary acquisition image to obtain auxiliary identification data, and send the auxiliary identification data to the audit end.

10. A device for automatically identifying duty-free equipment, characterized in that: include: A response module, used to respond to the device identification request of the audit end, obtain the active indication path based on the automatic acquisition mode, and obtain the active acquisition image taken by the aerial photography device based on the active indication path; An acquisition module, used for acquiring active identification data corresponding to the duty-free device according to the active acquisition image, and sending the active identification data to the audit end; or, A generating module, configured to obtain movement information of the ground device based on the auxiliary acquisition mode, generate a passive indication path according to the movement information, and obtain an auxiliary acquisition image taken by the aerial photography device based on the passive indication path; A sending module is used to obtain the auxiliary identification data of the duty-free device according to the auxiliary collected image, and send the auxiliary identification data to the audit end.

Images