Village and town appearance image data management platform and system
Through the village and town appearance image data management system, the combination of remote sensing analysis and drone patrols has solved the data accuracy and update speed problems in village and town ecological appearance supervision, realizing timely monitoring and correction of ecological and environmental problems, and reducing manpower consumption .
Patent Information
- Application Number
- CN202411042924.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-31
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2044-07-31
AI Technical Summary
In the prior art, the problem of ecological appearance of villages and towns cannot be solved in a timely manner due to the single shooting angle of remote sensing satellites and the intricate data.
Design a rural and town appearance image data management system, including remote sensing analysis module, image description module, drone patrol module, development analysis module and solution generation module, through preliminary analysis of remote sensing images, image uploaded by residents, and drone supplementary acquisition , data sorting and problem solution generation to realize monitoring and correction of ecological appearance problems.
It improves the accuracy of the ecological image of villages and towns and the timeliness of data updates, reduces human resources consumption, reduces the possibility of problems being blocked by the inspected objects, and improves the ability to solve ecological and environmental problems in a timely manner.
Smart Images

Figure CN119068359A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of image data management, and in particular to a village and town appearance image data management platform and system. Background Art
[0002] With the rapid development of the economy, the industrial structure of rural areas has been constantly adjusted, which has promoted the development of rural industrial structure and economy and accelerated the process of village and town construction. In the process of village and town development, we need to pay attention not only to economic development, but also to the ecological environment of villages and towns, so that people can have a good living environment.
[0003] In the existing technology, due to the scattered distribution of villages and towns, it has become a difficult problem to supervise the ecological appearance of villages and towns. When managing the ecological appearance of villages and towns, satellite remote sensing or manual inspection and photography are often used to collect data on the ecological appearance of villages and towns, and then the collected image data is analyzed. However, the image data taken by remote sensing satellites has a single angle and is not detailed enough. The manual inspection and photography method has the disadvantages of high manpower consumption, untimely data updates, and the inspected objects deliberately responding to inspections, which leads to the problems in the ecological appearance of villages and towns cannot be solved in time. Summary of the invention
[0004] The purpose of the present invention is to provide a village and town appearance image data management platform and system to solve the problems raised in the above-mentioned background technology.
[0005] In a first aspect, the present application provides a village and town appearance image data management system, the system comprising:
[0006] Remote sensing analysis module: used to obtain remote sensing images of villages and towns, conduct preliminary analysis on the remote sensing images, and obtain the locations of ecological problems in villages and towns;
[0007] Image description module: used to obtain village and town images uploaded by village and town residents, filter the village and town images according to the problem location, obtain a first appearance image, analyze the first appearance image, and obtain an appearance description statement;
[0008] A statement analysis module: used to obtain the completeness of the description of the problem location according to the appearance description statement, and determine whether the completeness exceeds a preset completeness threshold. If it is determined that the completeness threshold does not exceed the preset completeness threshold, a drone operation instruction is generated;
[0009] UAV inspection module: used to establish an inspection UAV, which performs daily inspections and collects village and town appearance images, and after receiving the operation instruction of the UAV, supplements the first appearance image to obtain a supplementary appearance image;
[0010] Development analysis module: used for screening the village and town images and the village and town appearance images to obtain the human appearance atlas and economic appearance atlas of the village and town, sorting the human appearance atlas and the economic appearance atlas to generate a human economic change table of the village and town, and obtaining the village and town development data according to the human economic change table;
[0011] Solution generation module: used to obtain a supplementary description based on the supplementary appearance image, obtain an appearance problem description of the problem location by combining the supplementary description and the problem location description, and generate a problem solution based on the appearance problem description and the village and town development data;
[0012] Correction record module: used to simulate and correct the ecological appearance problem of the problem location according to the problem solution, obtain the simulated correction result, monitor the problem location, collect the appearance correction picture and record the correction time.
[0013] Preferably, the steps of obtaining remote sensing images of villages and towns, and performing preliminary analysis on the remote sensing images to obtain problematic locations of ecological features in villages and towns are specifically as follows:
[0014] Acquire a remote sensing image of a town or village, extract lines from the remote sensing image to obtain image lines, and reorganize the image lines to obtain a remote sensing frame line image;
[0015] Based on the remote sensing frame line image, the remote sensing image is divided to obtain a plurality of sub-remote sensing images;
[0016] Performing image flipping on each remote sensing sub-image, and extracting flipped appearance features of the flipped remote sensing sub-image;
[0017] Selecting flipped appearance features one by one as target features, and comparing the target features with adjacent flipped appearance features to obtain multiple comparison values;
[0018] If it is determined that multiple comparison values are all lower than the preset comparison threshold, then the sub-remote sensing image corresponding to the target feature is a problem image, and the image position of the problem image is obtained, and the image position is used as the problem position where ecological appearance problems exist in villages and towns.
[0019] Preferably, the steps of screening the village and town images according to the problem location to obtain a first appearance image, and analyzing the first appearance image to obtain an appearance description statement are specifically as follows:
[0020] Performing image recognition on the village and town image, extracting detail features in the village and town image, and converting the visual direction of the detail features into a bird's-eye view angle to obtain bird's-eye view detail features;
[0021] Based on the bird's-eye view detail feature, an opposite value between the bird's-eye view detail feature and the target feature is obtained, and if it is determined that the opposite value is greater than or equal to a preset opposite threshold, the village and town image is used as a first appearance image;
[0022] Based on the detail features, extract key points in the detail features, and generate multiple keywords according to the key points;
[0023] Based on the multiple keywords, the keywords are connected in series and semantically clarified to obtain an appearance description sentence of the first appearance image.
[0024] Preferably, based on the detail features, the step of extracting key points in the detail features and generating a plurality of keywords according to the key points is specifically as follows:
[0025] Based on the detail features, the correlation between the detail features and the ecological appearance problem is obtained, and the detail features whose correlation exceeds a preset correlation threshold are used as target detail features;
[0026] Extracting key points from the target detail features, and obtaining the problem type, problem degree and problem scope of the ecological appearance problem according to the key points;
[0027] A plurality of keywords are generated according to the problem type, the problem degree and the problem scope.
[0028] Preferably, according to the appearance description statement, the completeness of the description of the problem location is obtained, and it is determined whether the completeness exceeds a preset completeness threshold. If it is determined that the completeness threshold does not exceed the preset completeness threshold, the step of generating a drone operation instruction is specifically:
[0029] According to the appearance description sentence, the clarity of the appearance description sentence is checked to obtain a blurred segment with blurred description in the appearance description sentence;
[0030] Based on the fuzzy segments, obtaining the proportion of the fuzzy segments in the description sentence and the description content of the fuzzy segments;
[0031] Obtaining the completeness of the problem location description based on the proportion and the description content, and determining whether the completeness exceeds a preset completeness threshold;
[0032] If it is determined that the completeness does not exceed a preset completeness threshold, obtaining the fuzzy content that needs to be supplemented based on the description content;
[0033] Supplementary requirements of the description statement are obtained according to the fuzzy content, and drone operation instructions are generated according to the supplementary requirements.
[0034] Preferably, the step of screening the village and town images and the village and town appearance images to obtain the human appearance atlas and the economic appearance atlas of the village and town is specifically:
[0035] Integrate the village and town images and the village and town appearance images to obtain an appearance atlas, and perform value assessment on the images in the appearance atlas to obtain an assessment value;
[0036] Eliminate images whose evaluation values are lower than a preset value threshold to obtain a target appearance atlas;
[0037] Performing humanities recognition and economic recognition on the images in the target appearance atlas respectively to determine image attributes of the images in the target appearance atlas;
[0038] Establish a human appearance atlas and an economic appearance atlas, and determine whether the image attribute is single. If the image attribute is single, classify the image according to the image attribute. If the image attribute is not single, classify the image into the human appearance atlas and the economic appearance atlas respectively.
[0039] Preferably, the steps of generating a solution to the problem according to the appearance problem description and the village and town development data are specifically as follows:
[0040] Acquire historical ecological governance data, and perform problem association search on the historical ecological governance data according to the appearance problem description to obtain associated historical data;
[0041] Based on the associated historical data, a historical solution and a historical village and town background corresponding to the historical solution are obtained;
[0042] According to the village and town development data, the current village and town background is obtained, and the current village and town background and the historical village and town background are differentiated and compared to obtain background differences;
[0043] Based on the background differences, the historical solutions are adjusted for background adaptability to generate problem solutions.
[0044] Preferably, according to the problem solution, the ecological appearance problem of the problem location is simulated and corrected to obtain the simulation correction result, the problem location is monitored, the appearance correction picture is collected and the correction time is recorded, specifically, the steps are:
[0045] Generate a simulated problem environment based on the ecological appearance problem of the problem location, and simulate and correct the simulated problem environment according to the problem solution to obtain a simulated correction result;
[0046] Monitoring the problem location, collecting an appearance correction image, and determining whether the appearance correction image is consistent with the simulation correction result;
[0047] If it is determined that the appearance correction image is inconsistent with the simulation correction result, continue monitoring and repeat the determination;
[0048] If it is determined that the appearance correction image is consistent with the simulation correction result, the time point of the last determination is recorded;
[0049] A correction time is obtained based on the time point, and it is determined whether the correction time exceeds a preset correction period. If it is determined that the correction time exceeds the correction period, a warning is generated and sent to the person responsible for correcting the problem.
[0050] In a second aspect, the present application provides a village and town appearance image data management platform, the platform comprising:
[0051] Acquire remote sensing images of villages and towns, conduct preliminary analysis on the remote sensing images, and obtain problematic locations of ecological features in villages and towns;
[0052] Obtaining village and town images uploaded by residents of the village and town, screening the village and town images according to the problem location to obtain a first appearance image, and analyzing the first appearance image to obtain an appearance description statement;
[0053] According to the appearance description statement, the completeness of the description of the problem location is obtained, and whether the completeness exceeds a preset completeness threshold is determined, and if it is determined that the completeness threshold does not exceed the preset completeness threshold, a drone operation instruction is generated;
[0054] Establishing a patrol drone, the patrol drone performs daily patrols and collects village and town appearance images, and after receiving the drone operation instruction, performs supplementary collection of the first appearance image to obtain a supplementary appearance image;
[0055] Screening the village and town images and the village and town appearance images to obtain a collection of human appearance and an atlas of economic appearance of the village and town, sorting the collection of human appearance and the collection of economic appearance to generate a table of human and economic changes of the village and town, and obtaining village and town development data according to the table of human and economic changes;
[0056] According to the supplementary appearance image, a supplementary description is obtained, and the appearance problem description of the problem location is obtained by combining the supplementary description and the problem location description, and a problem solution is generated according to the appearance problem description and the village and town development data;
[0057] According to the problem solution, the ecological appearance problem of the problem location is simulated and corrected to obtain a simulation correction result, the problem location is monitored, the appearance correction image is collected and the correction time is recorded.
[0058] In summary, the present application includes at least one of the following beneficial technical effects:
[0059] By acquiring remote sensing images of villages and towns, the remote sensing images are preliminarily processed to find the problem locations of ecological problems in villages and towns, reducing the possibility of problems caused by low accuracy of remote sensing images during use. The problems in the problem locations are then described through village and town images uploaded by village and town residents and village and town appearance images taken by patrol drones to obtain appearance problem descriptions; village and town development data are obtained by sorting out the changes in the human economy of villages and towns based on village and town images and village and town appearance images, and problem solutions are obtained by combining village and town development data and appearance problem descriptions, and the solution process of ecological and environmental problems is monitored. When the ecological problem loop is closed, the correction time is recorded. The image accuracy and timeliness of data updates when ecological problems are found in villages and towns are improved, and the consumption of human resources and the possibility of problems being concealed by the inspected objects are reduced. BRIEF DESCRIPTION OF THE DRAWINGS
[0060] Figure 1 It is a module block diagram of a village and town appearance image data management system provided in an embodiment of the present application;
[0061] Figure 2 It is a step flow chart of a village and town appearance image data management platform provided in an embodiment of the present application.
[0062] Explanation of the accompanying drawings: 1. Remote sensing analysis module; 2. Image description module; 3. Sentence analysis module; 4. UAV inspection module; 5. Development analysis module; 6. Solution generation module; 7. Correction record module. DETAILED DESCRIPTION
[0063] The following combination Figure 1-Figure 2 The present application is described in further detail, but the actual aspects of the present invention are not limited thereto.
[0064] The embodiments of the present application disclose a village and town appearance image data management platform and system.
[0065] In this embodiment, a village and town appearance image data management system is provided, the system comprising:
[0066] Remote sensing analysis module 1: used to obtain remote sensing images of villages and towns, conduct preliminary analysis of remote sensing images, and obtain the locations of ecological problems in villages and towns;
[0067] Image description module 2: used to obtain village and town images uploaded by village and town residents, screen the village and town images according to the problem location, obtain the first appearance image, analyze the first appearance image, and obtain the appearance description sentence;
[0068] Sentence analysis module 3: used to obtain the completeness of the description of the problem location according to the appearance description sentence, and determine whether the completeness exceeds the preset completeness threshold. If it is determined that the completeness threshold does not exceed the preset completeness threshold, a drone operation instruction is generated;
[0069] UAV inspection module 4: used to establish an inspection UAV, which conducts daily inspections and collects village and town appearance images. After receiving the UAV operation command, it supplements the first appearance image to obtain a supplementary appearance image;
[0070] Development analysis module 5: used to screen village and town images and village and town appearance images, obtain the village and town human appearance atlas and economic appearance atlas, organize the human appearance atlas and economic appearance atlas, generate the village and town human economic change table, and obtain the village and town development data based on the human economic change table;
[0071] Solution generation module 6: used to obtain a supplementary description based on the supplementary appearance image, obtain an appearance problem description of the problem location by combining the supplementary description and the problem location description, and generate a problem solution based on the appearance problem description and the village and town development data;
[0072] Correction record module 7: used to simulate and correct the ecological appearance problem at the problem location according to the problem solution, obtain the simulated correction result, monitor the problem location, collect the appearance correction picture and record the correction time.
[0073] It should be pointed out that the above modules are only basic modules of this embodiment. In the specific implementation process, some modules can be appropriately added, reduced or modified without affecting the overall implementation effect.
[0074] The steps for obtaining remote sensing images of villages and towns, conducting preliminary analysis on the remote sensing images, and obtaining the locations of ecological problems in villages and towns are as follows:
[0075] Acquire remote sensing images of villages and towns, extract lines from the remote sensing images to obtain image lines, and reorganize the image lines to obtain remote sensing frame line images;
[0076] Based on the remote sensing frame line image, the remote sensing image is divided to obtain multiple sub-remote sensing images;
[0077] Perform image flipping on each remote sensing sub-image, and extract flipping appearance features of the flipped remote sensing sub-image;
[0078] Select flipped appearance features one by one as target features, and compare the target features with adjacent flipped appearance features to obtain multiple comparison values;
[0079] If it is determined that multiple comparison values are all lower than the preset comparison threshold, the sub-remote sensing image corresponding to the target feature is a problem image, and the image position of the problem image is obtained, and the image position is used as the problem position where ecological appearance problems exist in villages and towns.
[0080] In application, taking a northern village as an example, a remote sensing image of the village is obtained, which includes residential areas and surrounding farmlands and forest areas. Lines are extracted from the remote sensing image, and the extracted lines are mainly roads and water bank boundaries. A remote sensing frame line image is obtained. The remote sensing frame line image divides the entire village into sub-remote sensing images of small areas. Each sub-remote sensing image is flipped and the flipped appearance features are extracted. One of them is selected as the target feature and compared with the surrounding flipped appearance features. It is found that the target feature is different from the flipped appearance features of the surrounding farmlands or villages. It is judged that the area of the sub-remote sensing image where the target feature is located has an ecological appearance problem, and the problem location is obtained.
[0081] The steps of screening the village and town images according to the problem location to obtain the first appearance image, analyzing the first appearance image, and obtaining the appearance description sentence are as follows:
[0082] Perform image recognition on village and town images, extract detail features in village and town images, and convert the visual direction of the detail features into a bird's-eye view to obtain bird's-eye view detail features;
[0083] Based on the bird's-eye view detail feature, the opposite value of the bird's-eye view detail feature and the target feature is obtained. If it is determined that the opposite value is greater than or equal to a preset opposite threshold, the village image is used as the first appearance image.
[0084] Based on the detail features, key points in the detail features are extracted, and multiple keywords are generated based on the key points;
[0085] Based on multiple keywords, the keywords are connected in series and semantically clarified to obtain the appearance description sentence of the first appearance image.
[0086] In application, taking a northern village as an example, the residents of the village will upload the images of the village they have taken from time to time. For example, a certain village image shows a large garbage dump next to a farmland. The detailed features in the village image are extracted, including farmland features and garbage dump features, etc. The visual direction of these two features is adjusted to a bird's-eye view to obtain the features of the farmland and the garbage dump. The features of these two bird's-eye view are compared with the target features. It is found that the garbage dump feature coincides with the target feature after being flipped 180 degrees. The village image is used as the first appearance image, and key points are found in the garbage dump feature, such as the color distribution of the garbage dump, the size of the garbage dump, etc. Based on these key points, multiple keywords such as mixed garbage, five meters in diameter, etc. are obtained. The keywords are connected in series and semantic communication is performed to obtain the appearance description sentence "Next to the wheat farmland, there is a mixed garbage dump with a diameter of five meters. The garbage dump causes serious pollution to the surrounding environment."
[0087] Based on the detail features, the key points in the detail features are extracted, and the steps of generating multiple keywords based on the key points are as follows:
[0088] Based on the detail features, the correlation between the detail features and the ecological appearance problems is obtained, and the detail features whose correlation exceeds the preset correlation threshold are taken as target detail features;
[0089] Extract key points from target detail features, and obtain the problem type, problem degree and problem scope of ecological appearance problems based on the key points;
[0090] Generate multiple keywords based on the type of problem, the severity of the problem, and the scope of the problem.
[0091] In application, taking a northern village as an example, based on the characteristics of farmland and garbage dump, the correlation between them and ecological appearance problems is 0 and 80, then the garbage dump characteristics are used as target detail features, and key points are extracted, such as the color distribution of the garbage dump, the size of the garbage dump, etc. According to these key points, the type of problem caused by the garbage dump to the ecological appearance is garbage pollution, the degree of problem is serious pollution, the problem range is fifty meters around, etc., and multiple keywords are generated based on the above content.
[0092] According to the appearance description statement, the completeness of the description of the problem location is obtained, and it is determined whether the completeness exceeds the preset completeness threshold. If it is determined that the completeness threshold does not exceed the preset completeness threshold, the steps of generating the drone operation instruction are specifically as follows:
[0093] According to the appearance description sentence, the clarity of the appearance description sentence is checked to obtain a fuzzy segment with fuzzy description in the appearance description sentence;
[0094] Based on the fuzzy segments, the proportion of the fuzzy segments in the description sentence and the description content of the fuzzy segments are obtained;
[0095] Based on the proportion and the description content, the completeness of the problem location description is obtained, and whether the completeness exceeds a preset completeness threshold is determined;
[0096] If it is determined that the completeness does not exceed the preset completeness threshold, the fuzzy content that needs to be supplemented is obtained based on the description content;
[0097] The supplementary requirements of the description sentence are obtained according to the fuzzy content, and the UAV operation instructions are generated according to the supplementary requirements.
[0098] During application, taking a northern village as an example, a clarity check was performed based on the obtained appearance description sentence, and it was found that there were relatively large sections of unclear and fuzzy fragments in the appearance description sentence, which made the appearance description sentence unusable. The proportion of extracted fuzzy fragments was 50%, and the description content was a specific ecological appearance problem. Based on this proportion and the description content, supplementary requirements that needed to be supplemented were obtained, and then drone operation instructions were generated based on this supplementary requirement, such as taking pictures of the south direction of the problem location and boundary pictures of the ecological appearance problem.
[0099] The steps of screening the village and town images and the village and town appearance images to obtain the human appearance atlas and the economic appearance atlas of the village and town are as follows:
[0100] Integrate the village and town images and the village and town appearance images to obtain an appearance atlas, and evaluate the images in the appearance atlas to obtain an evaluation value;
[0101] Eliminate images whose evaluation value is lower than a preset value threshold to obtain a target appearance atlas;
[0102] Performing humanistic recognition and economic recognition on the images in the target appearance atlas respectively, and determining the image attributes of the images in the target appearance atlas;
[0103] Establish a human appearance atlas and an economic appearance atlas, and determine whether the image attributes are single. If the image attributes are single, classify the images according to the image attributes. If the image attributes are not single, classify the images into the human appearance atlas and the economic appearance atlas respectively.
[0104] In application, taking a village in the north as an example, the village images and village appearance images were screened to obtain the appearance atlas, and the evaluation values of each image in the appearance atlas were 2, 43, 65, 77, 3, 6, 98, 5, etc. The images with evaluation values lower than 20 were deleted to obtain the target appearance atlas, and the remaining images were subjected to humanities recognition and economic recognition, and the image attributes of each image were obtained as humanities, humanities, economy, economy, humanities and economy, etc. Images with a single attribute were classified into the corresponding humanities appearance atlas or economic appearance atlas, and images with multiple attributes were classified into the humanities appearance atlas, and a copy was classified into the economic appearance atlas.
[0105] The steps to generate a solution based on the description of the appearance problem and the village and town development data are as follows:
[0106] Obtain historical ecological governance data, perform problem-related searches on the historical ecological governance data based on the description of the appearance problem, and obtain related historical data;
[0107] Based on the associated historical data, historical solutions and the historical village and town background corresponding to the historical solutions are obtained;
[0108] According to the village and town development data, the current village and town background is obtained, and the current village and town background and the historical village and town background are differentiated and compared to obtain the background difference;
[0109] Based on the background differences, historical solutions are adjusted to be context-adaptive to generate problem solutions.
[0110] In application, taking a northern village as an example, historical ecological governance data of the entire north was obtained, and the large garbage dumps mentioned in the description of the appearance problem were found in the historical ecological governance data. The associated historical data related to the governance of large garbage dumps were obtained, and the historical solutions to the large garbage dumps and the historical village and town background at that time were obtained based on the associated historical data. The current village and town background was obtained based on the village and town development data. It was found that the current village and town background was improved economic conditions and modernized facilities, which was very different from the historical village and town background. The background difference was obtained, and the historical solution was adjusted for background adaptability based on the background difference. For example, the historical solution of directly landfilling the garbage has now been adjusted to send the garbage to the garbage treatment plant, and the soil near the garbage is purified and backfilled.
[0111] According to the problem solution, simulate and correct the ecological appearance problem at the problem location, obtain the simulation correction result, monitor the problem location, collect the appearance correction picture and record the correction time. The specific steps are:
[0112] Generate a simulated problem environment based on the ecological appearance of the problem location, and simulate and correct the simulated problem environment according to the problem solution to obtain a simulated correction result;
[0113] Monitor the problem location, collect the appearance correction image, and determine whether the appearance correction image is consistent with the simulation correction result;
[0114] If it is determined that the appearance correction image is inconsistent with the simulation correction result, continue monitoring and repeat the judgment;
[0115] If it is determined that the appearance correction image is consistent with the simulation correction result, the time point of the last judgment is recorded;
[0116] The correction time is obtained based on the time point, and it is determined whether the correction time exceeds the preset correction period. If it is determined that the correction time exceeds the correction period, a warning is generated and sent to the person responsible for correcting the problem.
[0117] In application, taking a northern village as an example, a simulated problem environment is generated based on the ecological appearance problem of a large garbage dump. The problem solution is used in the simulated problem environment to correct the simulated problem environment to obtain the correction result, which includes the correction time and the correction effect. Then monitor the problem location in reality and collect the appearance correction image. When the correction effect in the appearance correction image is consistent with the simulated correction effect, close the loop on the appearance problem and record the actual correction time. Otherwise, monitor it all the time and compare it every once in a while. Preset a correction deadline, which is greater than the correction time. When it is found that the correction time is greater than the correction deadline, it means that the village appearance correction project has timed out, and a warning is generated and sent to the relevant project leader.
[0118] An embodiment of the present invention provides a village and town appearance image data management platform, using any one of the village and town appearance image data management systems described above, the platform comprising:
[0119] S100: Acquire remote sensing images of villages and towns, perform preliminary analysis on the remote sensing images, and obtain problematic locations of ecological features in villages and towns;
[0120] S200: Obtaining village and town images uploaded by village and town residents, screening the village and town images according to the problem location, obtaining a first appearance image, analyzing the first appearance image, and obtaining an appearance description statement;
[0121] S300: obtaining the completeness of the description of the problem location according to the appearance description statement, and determining whether the completeness exceeds a preset completeness threshold. If it is determined that the completeness threshold does not exceed the preset completeness threshold, generating a drone operation instruction;
[0122] S400: establishing a patrol drone, which performs routine patrols and collects village and town appearance images, and after receiving a drone operation instruction, performs supplementary collection of the first appearance image to obtain a supplementary appearance image;
[0123] S500: screening the village and town images and the village and town appearance images to obtain the human appearance atlas and the economic appearance atlas of the village and town, sorting the human appearance atlas and the economic appearance atlas to generate a human economic change table of the village and town, and obtaining the village and town development data according to the human economic change table;
[0124] S600: Obtaining a supplementary description based on the supplementary appearance image, combining the supplementary description with the problem location description to obtain an appearance problem description of the problem location, and generating a problem solution based on the appearance problem description and the village and town development data;
[0125] S700: According to the problem solution, the ecological appearance problem at the problem location is simulated and corrected to obtain the simulation correction result, the problem location is monitored, the appearance correction image is collected and the correction time is recorded.
[0126] The above are all preferred embodiments of the present application, and the protection scope of the present application is not limited thereto. Therefore, any equivalent changes made according to the structure, shape, and principle of the present application should be included in the protection scope of the present application.
Claims
1. A management system based on village and town appearance image data, characterized in that: include: Remote sensing analysis module: used to obtain remote sensing images of villages and towns, conduct preliminary analysis on the remote sensing images, and obtain the locations of ecological problems in villages and towns; Image description module: used to obtain village and town images uploaded by village and town residents, filter the village and town images according to the problem location, obtain a first appearance image, analyze the first appearance image, and obtain an appearance description statement; A statement analysis module: used to obtain the completeness of the description of the problem location according to the appearance description statement, and determine whether the completeness exceeds a preset completeness threshold. If it is determined that the completeness threshold does not exceed the preset completeness threshold, a drone operation instruction is generated; UAV inspection module: used to establish an inspection UAV, which performs daily inspections and collects village and town appearance images, and after receiving the operation instruction of the UAV, supplements the first appearance image to obtain a supplementary appearance image; Development analysis module: used for screening the village and town images and the village and town appearance images to obtain the human appearance atlas and economic appearance atlas of the village and town, sorting the human appearance atlas and the economic appearance atlas to generate a human economic change table of the village and town, and obtaining the village and town development data according to the human economic change table; Solution generation module: used to obtain a supplementary description based on the supplementary appearance image, obtain an appearance problem description of the problem location by combining the supplementary description and the problem location description, and generate a problem solution based on the appearance problem description and the village and town development data; Correction record module: used to simulate and correct the ecological appearance problem of the problem location according to the problem solution, obtain the simulated correction result, monitor the problem location, collect the appearance correction picture and record the correction time.
2. A village and town appearance image data management system according to claim 1, characterized in that: The steps of obtaining remote sensing images of villages and towns, performing preliminary analysis on the remote sensing images, and obtaining the locations of ecological problems in villages and towns are as follows: Acquire a remote sensing image of a town or village, extract lines from the remote sensing image to obtain image lines, and reorganize the image lines to obtain a remote sensing frame line image; Based on the remote sensing frame line image, the remote sensing image is divided to obtain a plurality of sub-remote sensing images; Performing image flipping on each remote sensing sub-image, and extracting flipped appearance features of the flipped remote sensing sub-image; Selecting flipped appearance features one by one as target features, and comparing the target features with adjacent flipped appearance features to obtain multiple comparison values; If it is determined that multiple comparison values are all lower than the preset comparison threshold, then the sub-remote sensing image corresponding to the target feature is a problem image, and the image position of the problem image is obtained, and the image position is used as the problem position where ecological appearance problems exist in villages and towns.
3. A village and town appearance image data management system according to claim 2, characterized in that: The steps of screening the village and town images according to the problem location to obtain a first appearance image, and analyzing the first appearance image to obtain an appearance description statement are specifically as follows: Performing image recognition on the village and town image, extracting detail features in the village and town image, and converting the visual direction of the detail features into a bird's-eye view angle to obtain bird's-eye view detail features; Based on the bird's-eye view detail feature, an opposite value between the bird's-eye view detail feature and the target feature is obtained, and if it is determined that the opposite value is greater than or equal to a preset opposite threshold, the village and town image is used as a first appearance image; Based on the detail features, extract key points in the detail features, and generate multiple keywords according to the key points; Based on the multiple keywords, the keywords are connected in series and semantically clarified to obtain an appearance description sentence of the first appearance image.
4. A village and town appearance image data management system according to claim 3, characterized in that: Based on the detail features, the steps of extracting key points in the detail features and generating multiple keywords according to the key points are specifically as follows: Based on the detail features, the correlation between the detail features and the ecological appearance problem is obtained, and the detail features whose correlation exceeds a preset correlation threshold are used as target detail features; Extracting key points from the target detail features, and obtaining the problem type, problem degree and problem scope of the ecological appearance problem according to the key points; A plurality of keywords are generated according to the problem type, the problem degree and the problem scope.
5. A village and town appearance image data management system according to claim 3, characterized in that: According to the appearance description statement, the completeness of the description of the problem location is obtained, and whether the completeness exceeds a preset completeness threshold is determined. If it is determined that the completeness threshold does not exceed the preset completeness threshold, the step of generating a drone operation instruction is specifically as follows: According to the appearance description sentence, the clarity of the appearance description sentence is checked to obtain a blurred segment with blurred description in the appearance description sentence; Based on the fuzzy segments, obtaining the proportion of the fuzzy segments in the description sentence and the description content of the fuzzy segments; Obtaining the completeness of the problem location description based on the proportion and the description content, and determining whether the completeness exceeds a preset completeness threshold; If it is determined that the completeness does not exceed a preset completeness threshold, obtaining the fuzzy content that needs to be supplemented based on the description content; Supplementary requirements of the description statement are obtained according to the fuzzy content, and drone operation instructions are generated according to the supplementary requirements.
6. A village and town appearance image data management system according to claim 3, characterized in that: The steps of screening the village and town images and the village and town appearance images to obtain the human appearance atlas and the economic appearance atlas of the village and town are specifically as follows: Integrate the village and town images and the village and town appearance images to obtain an appearance atlas, and perform value assessment on the images in the appearance atlas to obtain an assessment value; Eliminate images whose evaluation values are lower than a preset value threshold to obtain a target appearance atlas; Performing humanities recognition and economic recognition on the images in the target appearance atlas respectively to determine image attributes of the images in the target appearance atlas; Establish a human appearance atlas and an economic appearance atlas, and determine whether the image attribute is single. If the image attribute is single, classify the image according to the image attribute. If the image attribute is not single, classify the image into the human appearance atlas and the economic appearance atlas respectively.
7. A village and town appearance image data management system according to claim 6, characterized in that: The steps of generating a solution to the problem according to the appearance problem description and the village and town development data are specifically as follows: Acquire historical ecological governance data, and perform problem association search on the historical ecological governance data according to the appearance problem description to obtain associated historical data; Based on the associated historical data, a historical solution and a historical village and town background corresponding to the historical solution are obtained; According to the village and town development data, the current village and town background is obtained, and the current village and town background and the historical village and town background are differentiated and compared to obtain background differences; Based on the background differences, the historical solutions are adjusted for background adaptability to generate problem solutions.
8. A village and town appearance image data management system according to claim 7, characterized in that: According to the problem solution, the ecological appearance problem of the problem location is simulated and corrected to obtain the simulation correction result, the problem location is monitored, the appearance correction picture is collected and the correction time is recorded, specifically, the steps are: Generate a simulated problem environment based on the ecological appearance problem of the problem location, and simulate and correct the simulated problem environment according to the problem solution to obtain a simulated correction result; Monitoring the problem location, collecting an appearance correction image, and determining whether the appearance correction image is consistent with the simulation correction result; If it is determined that the appearance correction image is inconsistent with the simulation correction result, continue monitoring and repeat the determination; If it is determined that the appearance correction image is consistent with the simulation correction result, the time point of the last determination is recorded; A correction time is obtained based on the time point, and it is determined whether the correction time exceeds a preset correction period. If it is determined that the correction time exceeds the correction period, a warning is generated and sent to the person responsible for correcting the problem.
9. A data management platform based on village and town appearance images, the platform adopts a data management system based on village and town appearance images as claimed in any one of claims 1 to 8, characterized in that: The platform includes: Acquire remote sensing images of villages and towns, conduct preliminary analysis on the remote sensing images, and obtain problematic locations of ecological features in villages and towns; Obtaining village and town images uploaded by residents of the village and town, screening the village and town images according to the problem location to obtain a first appearance image, and analyzing the first appearance image to obtain an appearance description statement; According to the appearance description statement, the completeness of the description of the problem location is obtained, and whether the completeness exceeds a preset completeness threshold is determined, and if it is determined that the completeness threshold does not exceed the preset completeness threshold, a drone operation instruction is generated; Establishing a patrol drone, the patrol drone performs daily patrols and collects village and town appearance images, and after receiving the drone operation instruction, performs supplementary collection of the first appearance image to obtain a supplementary appearance image; Screening the village and town images and the village and town appearance images to obtain a collection of human appearance and an atlas of economic appearance of the village and town, sorting the collection of human appearance and the collection of economic appearance to generate a table of human and economic changes of the village and town, and obtaining village and town development data according to the table of human and economic changes; According to the supplementary appearance image, a supplementary description is obtained, and the appearance problem description of the problem location is obtained by combining the supplementary description and the problem location description, and a problem solution is generated according to the appearance problem description and the village and town development data; According to the problem solution, the ecological appearance problem of the problem location is simulated and corrected to obtain a simulation correction result, the problem location is monitored, the appearance correction image is collected and the correction time is recorded.
Citation Information
Patent Citations
Method for realizing village style and appearance management based on oblique photography and image recognition technology
CN115984721A
Public space digital treatment method for village revitalization
CN117392557A
Geometric topology matching positioning method based on village feature description
CN117876898A
