Vent and travel fusion display control system and method based on unmanned aerial vehicle, and storage medium

Abstract

The invention discloses a text and travel fusion display control system and method based on an unmanned aerial vehicle and a storage medium. The text and travel fusion display control system comprises a display module, an information acquisition module, a data processing module and a control module, the display module comprises an unmanned aerial vehicle with projection equipment and an unmanned aerial vehicle with spraying equipment; the information acquisition module is used for acquiring the number of the unmanned aerial vehicles with the spraying equipment, the display parameters of the projection display content and the residual water amount in the spraying equipment; relates to the technical field of content display, and solves the technical problems that the current travel content propaganda mode does not have universality and is difficult to achieve an obvious travel content propaganda effect. Through the performance form of the unmanned aerial vehicle, in cooperation with the unmanned aerial vehicle with the projection equipment and the unmanned aerial vehicle with the spraying equipment, by spraying volume fog to be matched with the projection equipment, the travel content can be displayed in the high altitude, and more vivid and visual visual experience is brought to audiences through different presentation forms; and the interestingness and attraction of the travel content are greatly improved.

Description

Technical Field

[0001] The present invention belongs to the technical field of content display, and specifically is a control system, method and storage medium for cultural and tourism integration display based on drones. Background Art

[0002] With the rapid development of the Internet of Things and drones in recent years, a variety of drones have emerged. Currently, drones are mainly used in various industries such as aerial photography, including border defense, agriculture, etc. With the launch of high-performance drones priced at several thousand yuan, the application of drones in more commercial fields and even the civilian market is also opening up.

[0003] At present, the simplest and most common way to promote culture and tourism in various places is to display the content through video display, but this method requires a large number of display devices for display in the local area, resulting in high costs; and with the development of the Internet, online promotion has provided a better platform for cultural and tourism displays in some places, but this method requires a large amount of traffic to achieve the promotion effect of the display. Since the viewing method is no different from ordinary video content, the cultural and tourism content needs to be very special, which makes this method not universal and difficult to achieve good cultural and tourism content promotion. Summary of the invention

[0004] The present invention aims to solve at least one of the technical problems existing in the prior art; to this end, the present invention proposes a cultural and tourism integration display control system, method and storage medium based on drones, which are used to solve the technical problems that the current cultural and tourism content promotion methods are not universal and it is difficult to achieve obvious cultural and tourism content promotion effects. The present invention uses the performance form of drones, cooperates with drones with projection equipment and drones with spray equipment, and sprays volumetric fog in conjunction with projection equipment to display cultural and tourism content in the sky. Through different forms of expression, it brings a more vivid and intuitive visual experience to the audience, greatly enhances the fun and attractiveness of cultural and tourism content, and solves the above-mentioned problems.

[0005] To achieve the above-mentioned purpose, the first aspect of the present invention provides a cultural tourism integration display control system based on a drone, comprising: a display module, an information acquisition module, a data processing module and a control module;

[0006] The display module includes a drone with a projection device and a drone with a spray device; wherein the spray device is used to form a volumetric fog, and the projection device is used to project the display content onto the volumetric fog;

[0007] The information acquisition module is used to obtain the number of drones with spray equipment, display parameters of the projected display content, and the storage capacity of the spray equipment; wherein the display parameters include video ratio, video duration, and video content; and,

[0008] The UAV of the projection device obtains the location information of the UAV of the spray device;

[0009] The data processing module is used to extract projection features in video content; and

[0010] The position of the corresponding drone is adjusted according to the projection characteristics, video duration and the remaining water volume in the spray equipment to obtain a corrected position;

[0011] The control module is used to adjust the position of the drone according to the displayed coordinates and the corrected position.

[0012] Preferably, the acquisition of the location information of the drone of the spraying device by the drone based on the projection device includes:

[0013] The height of the drone with the projection device is obtained and marked as the projection height; the projection distance is determined according to the projection height and the preset screen ratio, and the projection distance is extended with the projection height as the base point and the projection direction of the projection device as the direction to obtain the origin, and a plane rectangular coordinate system is established with the origin to obtain the display plane;

[0014] Taking the origin of the display plane as the center, the drones with spray equipment are evenly distributed on the display plane according to the video ratio and the number of drones with spray equipment, and the location information of the drones with spray equipment is determined according to the distance from each drone with spray equipment to the origin.

[0015] It should be noted that the preset screen ratio is proportional to the projection height, that is, in order to ensure that visitors below can see the projection content clearly, the higher the projection height, the larger the preset screen ratio.

[0016] Preferably, the extracting projection features in the video content includes:

[0017] A frame is extracted from each second of the video content to obtain several summary images; the summary images are divided into several planning areas i of the same size according to the number of drones equipped with spray equipment;

[0018] Respectively identify the RGB color values ​​of pixels in a plurality of summary images in the same planning area; wherein the RGB color value includes R value, G value and B value;

[0019] The maximum value of the sum of the R value, the G value and the B value is screened out by traversing and marked as the color value feature of the planning area in the summary picture, and the color value features of several summary pictures in the planning area i are integrated to obtain several groups of projection features.

[0020] Preferably, the extracting projection features in the video content includes:

[0021] A frame is extracted from each second of the video content to obtain several summary images; the summary images are divided into several planning areas of the same size according to the number of drones equipped with spray equipment;

[0022] Select n pixels in the planning area and mark them as reference pixels. Select m pixels within a circle around the reference pixels. 2 The RGB values ​​of pixels are summed to obtain n generalized color values; wherein the RGB color value includes R value, G value and B value, n and m are both positive integers, and m>2;

[0023] The maximum value among n summarized color values ​​is screened out by traversal and marked as the color value feature of the planning area in the summarized picture, and the color value features of several summarized pictures in the planning area i are integrated to obtain several groups of projection features.

[0024] It should be noted that when selecting the reference pixel, it can be selected randomly or by setting the spacing, but it is necessary to ensure that the m within a circle of the reference pixel is 2 pixels exist.

[0025] Preferably, the summary picture is a picture of any frame within one second, a picture of the first frame or a picture of the last frame.

[0026] Preferably, the adjusting the position of the corresponding drone according to the projection characteristics, the video duration and the remaining water amount in the spray device includes:

[0027] Match the projection features of the planned area i with the location information of the drone with the spray equipment; calculate the water consumption of the corresponding spray equipment based on the projection features and the video duration;

[0028] The water consumption is compared with the storage capacity. When the storage capacity is greater than the water consumption, the location information of the corresponding drone is marked as a fixed position; otherwise, the location information of the corresponding drone is marked as a mobile position;

[0029] Swap the positions of the drone in the fixed position with the drone in the mobile position.

[0030] Preferably, the method of calculating the water consumption of the corresponding spray equipment based on the projection characteristics and the video duration includes:

[0031] Extract several color value features of the planning area corresponding to the drone with the spray device, and compare several color value features in different summary images with the saturation threshold; mark the color value features greater than the saturation threshold as strong features; otherwise, mark the color value features as weak features;

[0032] By calculating the formula The water consumption Li of the spray equipment on the drone corresponding to the i-th planning area is obtained; where a is the preset proportional coefficient, x is the number of strong features, y is the number of weak features, and t is the video length.

[0033] It should be noted that, in order to enable the audience on the ground to see clearly, when the RGB color value is white, the amount of water sprayed is larger. When the RGB color value is black, the spray equipment at the corresponding position can suspend spraying or produce less spray to save water. The saturation threshold can be obtained by technical experts in this field based on experiments.

[0034] Preferably, exchanging the positions of the drone at the fixed position and the drone at the mobile position comprises:

[0035] The water consumption Li of the spray equipment on the drones corresponding to several planning areas is extracted and sorted from large to small to obtain a water consumption sequence; the drone with the jth position in the water consumption sequence corresponding to the fixed position is exchanged with the drone with the jth position in the water consumption sequence corresponding to the mobile position; where j is a positive integer, and the maximum value of j cannot be greater than the number of strong features.

[0036] It should be noted that when drones are exchanged, the same exchange path should be avoided to avoid collision incidents.

[0037] Second, the control method of cultural tourism integration display based on drones includes the following steps:

[0038] Step 1: Obtain the number of drones equipped with spray equipment, display parameters of the projected display content, and the amount of water remaining in the spray equipment;

[0039] Step 2: The UAV of the projection device obtains the location information of the UAV of the spray device;

[0040] Step 3: Extract the projection features in the video content, and adjust the position of the corresponding drone according to the projection features, video duration, and the remaining water in the spray equipment to obtain the corrected position;

[0041] Step 4: Adjust the position of the drone according to the displayed coordinates and the corrected position.

[0042] The third aspect is a storage medium, which stores a computer program, and when the computer program is executed, it runs the cultural and tourism integration display control system based on drones of the first aspect.

[0043] Compared with the prior art, the beneficial effects of the present invention are as follows: through the performance form of a drone, in conjunction with a drone with a projection device and a drone with a spray device, by spraying volumetric fog and cooperating with the projection device, cultural and tourism content can be displayed in the sky, and different forms of expression can bring a more vivid and intuitive visual experience to the audience, greatly enhancing the interest and attractiveness of cultural and tourism content, and adjusting the position of the drone through the display parameters of the projected display content to adapt to different screen ratios and sizes, and in order to reduce the pressure of the drone during flight time, by analyzing the RGB value of the video content, when the RGB value is higher, the color is brighter at this time, and the volumetric fog at this time needs to maintain a normal density, and when the RGB value is lower, it tends to be black, and this method is generally performed at high altitude at night, so even if the spray is not stopped at this time, the display effect of the area will not be greatly affected, so by partitioning the corresponding video content and analyzing its projection characteristics in turn, according to the projection characteristics, the water output of the spray equipment is obtained, so that the position of the drone with more water output and the drone with less water output are adjusted to further extend the flight time of the drone and the playback time of the video content, and further improve its usability. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0045] Figure 1 It is a schematic diagram of the process of the present invention;

[0046] Figure 2 This is a schematic diagram of the process of obtaining projection features in Example 1 of the present invention;

[0047] Figure 3 It is a schematic diagram of the process of obtaining projection features in Example 2 of the present invention. DETAILED DESCRIPTION

[0048] The technical solution of the present invention will be clearly and completely described below in conjunction with the embodiments. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0049] See also Figure 1- Figure, the first embodiment of the present invention provides a cultural tourism integration display control system based on drones, which is applied to high-altitude displays at night. The system includes: a display module, an information acquisition module, a data processing module and a control module;

[0050] The display module includes a drone with a projection device and a drone with a spray device; wherein the spray device is used to form a volumetric fog, and the projection device is used to project the display content onto the volumetric fog; when the volumetric fog encounters light and shadow, the light and shadow can be folded to realize the display of the picture;

[0051] Information acquisition module: used to obtain the number of drones with spray equipment, display parameters of projected display content and storage capacity of spray equipment; wherein the display parameters include video ratio, video duration and video content; and,

[0052] The UAV of the projection device obtains the location information of the UAV of the spray device;

[0053] Data processing module: for extracting projection features from video content; and,

[0054] The position of the corresponding drone is adjusted according to the projection characteristics, video duration and the remaining water volume in the spray equipment to obtain a corrected position;

[0055] Control module: used to adjust the position of the drone according to the displayed coordinates and corrected position.

[0056] Through the flight of drones and the flexible application of the spray system, variable volumetric fog of various sizes can be created, which, combined with projection equipment, forms a unique interactive effect, allowing the audience to participate in the cultural display in an immersive way.

[0057] In this embodiment, the UAV based on the projection device obtains the location information of the UAV of the spray device, including:

[0058] The height of the drone with the projection device is obtained and marked as the projection height; the projection distance is determined according to the projection height and the preset screen ratio, and the projection distance is extended with the projection height as the base point and the projection direction of the projection device as the direction to obtain the origin, and a plane rectangular coordinate system is established with the origin to obtain the display plane;

[0059] Taking the origin of the display plane as the center, the drones with spray equipment are evenly distributed on the display plane according to the video ratio and the number of drones with spray equipment, and the location information of the drones with spray equipment is determined according to the distance from each drone with spray equipment to the origin.

[0060] When the flow rate of the spray equipment is constant, the position of the drone can be used as a reference to ensure that the display content is completely projected onto the volumetric fog.

[0061] In order to extend the flight performance time of the drone, the projection features in the video content are extracted in this implementation, including:

[0062] A frame is extracted from each second of the video content to obtain several summary images; the summary images are divided into several planning areas i of the same size according to the number of drones equipped with spray equipment;

[0063] Respectively identify the RGB color values ​​of pixels in a plurality of summary images in the same planning area; wherein the RGB color value includes R value, G value and B value;

[0064] The maximum value of the sum of the R value, the G value and the B value is screened out by traversing and marked as the color value feature of the planning area in the summary picture, and the color value features of several summary pictures in the planning area i are integrated to obtain several groups of projection features.

[0065] This method can greatly improve the accuracy of video analysis.

[0066] It should be noted that the summary picture is a picture of any frame within one second, a picture of the first frame or a picture of the last frame.

[0067] In order to extend the duration of the drone flight show, the position of the corresponding drone is adjusted according to the projection characteristics, video duration and the remaining water in the spray equipment, including:

[0068] Match the projection features of the planned area i with the location information of the drone with the spray equipment; calculate the water consumption of the corresponding spray equipment based on the projection features and the video duration;

[0069] The water consumption is compared with the storage capacity. When the storage capacity is greater than the water consumption, the location information of the corresponding drone is marked as a fixed position; otherwise, the location information of the corresponding drone is marked as a mobile position;

[0070] Swap the positions of the drone in the fixed position with the drone in the mobile position.

[0071] The above calculation of the water consumption of the corresponding spray equipment based on the projection features and the video duration specifically includes the following steps:

[0072] Extract several color value features of the planning area corresponding to the drone with the spray device, and compare several color value features in different summary images with the saturation threshold; mark the color value features greater than the saturation threshold as strong features; otherwise, mark the color value features as weak features;

[0073] By calculating the formula The water consumption Li of the spray equipment on the drone corresponding to the i-th planning area is obtained; where a is the preset proportional coefficient, x is the number of strong features, y is the number of weak features, and t is the video length.

[0074] In order to enable the audience on the ground to see clearly, when the RGB color value is white, the amount of water sprayed is large, and when the RGB color value is black, the spray equipment at the corresponding position can suspend spraying or produce less spray to save water. The saturation threshold can be obtained by technical experts in this field based on experiments to distinguish whether to suspend spraying and whether the spray has an actual impact on the picture, and the proportional coefficient is a base number obtained by technical experts in this field based on experiments, that is, the greater the water consumption during the experiment, the greater the specific value of a.

[0075] Furthermore, the positions of the fixed-position drone and the mobile-position drone are swapped, including:

[0076] The water consumption Li of the spray equipment on the drones corresponding to several planning areas is extracted, and sorted from large to small to obtain a water use sequence; the drone corresponding to the fixed position ranked first in the water use sequence from front to back is exchanged with the drone corresponding to the mobile position ranked first in the water use sequence from back to front; the drone corresponding to the fixed position ranked second in the water use sequence from front to back is exchanged with the drone corresponding to the mobile position ranked second in the water use sequence from back to front; and so on, the number of drones with fixed positions or drones with mobile positions is.

[0077] It should be noted that when drones are exchanged, the same exchange path should be avoided to avoid collision incidents.

[0078] Second, the control method of cultural tourism integration display based on drones includes the following steps:

[0079] Step 1: Obtain the number of drones equipped with spray equipment, display parameters of the projected display content, and the amount of water remaining in the spray equipment;

[0080] Step 2: The UAV of the projection device obtains the location information of the UAV of the spray device;

[0081] Step 3: Extract the projection features in the video content, and adjust the position of the corresponding drone according to the projection features, video duration, and the remaining water in the spray equipment to obtain the corrected position;

[0082] Step 4: Adjust the position of the drone according to the displayed coordinates and the corrected position.

[0083] The third aspect is a storage medium, which stores a computer program, and when the computer program is executed, it runs the cultural and tourism integration display control system based on drones of the first aspect.

[0084] Different from the above embodiment, when the analysis is more accurate, it also means a larger amount of calculation and a longer time. In order to shorten the analysis time, the projection features extracted from the video content in this embodiment include:

[0085] A frame is extracted from each second of the video content to obtain several summary images; the summary images are divided into several planning areas of the same size according to the number of drones equipped with spray equipment;

[0086] Select n pixels in the planning area and mark them as reference pixels. Select m pixels within a circle around the reference pixels. 2 The RGB values ​​of pixels are summed to obtain n generalized color values; wherein the RGB color value includes R value, G value and B value, n and m are both positive integers, and m>2;

[0087] The maximum value among n summarized color values ​​is screened out by traversal and marked as the color value feature of the planning area in the summarized picture, and the color value features of several summarized pictures in the planning area i are integrated to obtain several groups of projection features.

[0088] Exemplary,Example: Extracting Projection Features from UAV Spray Video

[0089] There is a 60-second presentation content. According to the rule of extracting one frame per second, a total of 60 frames of summary images are extracted from the video;

[0090] If there are 30 drones with spray equipment in the display module, the entire video screen is evenly divided into 30 planning areas of the same size, and each area corresponds to the operating range of a drone;

[0091] In each planning area, 10 pixels (n=10) are randomly selected as reference pixels. For each reference pixel, the RGB values ​​of 16 pixels within a week are selected and summed to obtain 10 generalized color values. Then, by traversing the 10 generalized color values ​​in each planning area, the maximum value is found and marked as the color value feature of the planning area. For each generalized picture, 30 color value features of the planning areas are obtained.

[0092] Part of the data in the above formula is calculated by removing the dimension and taking its numerical value. The formula is a formula closest to the actual situation obtained by software simulation of a large amount of collected data; the preset parameters and preset thresholds in the formula are set by technical personnel in this field according to actual conditions or obtained through simulation of a large amount of data.

[0093] The above embodiments are only used to illustrate the technical method of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art should understand that the technical method of the present invention may be modified or replaced by equivalents without departing from the spirit and scope of the technical method of the present invention.

Claims

1. The cultural and tourism integration display control system based on drones is characterized by: include: Display module, information acquisition module, data processing module and control module; The display module includes a drone with a projection device and a drone with a spray device; wherein the spray device is used to form a volumetric fog, and the projection device is used to project the display content onto the volumetric fog; The information acquisition module is used to obtain the number of drones with spray equipment, display parameters of the projected display content, and the remaining water in the spray equipment; wherein the display parameters include video ratio, video duration, and video content; and, The UAV of the projection device obtains the location information of the UAV of the spray device; The data processing module is used to extract projection features in video content; and The position of the corresponding drone is adjusted according to the projection characteristics, video duration and the remaining water volume in the spray equipment to obtain a corrected position; The control module is used to adjust the position of the drone according to the displayed coordinates and the corrected position.

2. The cultural tourism integration display control system based on drone according to claim 1 is characterized in that: The method of obtaining the position information of the drone of the spraying device based on the drone of the projection device includes: The height of the drone with the projection device is obtained and marked as the projection height; the projection distance is determined according to the projection height and the preset screen ratio, and the projection distance is extended with the projection height as the base point and the projection direction of the projection device as the direction to obtain the origin, and a plane rectangular coordinate system is established with the origin to obtain the display plane; Taking the origin of the display plane as the center, the drones with spray equipment are evenly distributed on the display plane according to the video ratio and the number of drones with spray equipment, and the location information of the drones with spray equipment is determined according to the distance from each drone with spray equipment to the origin.

3. The cultural tourism integration display control system based on drone according to claim 1 is characterized in that: The extracting projection features in the video content includes: A frame is extracted from each second of the video content to obtain several summary images; the summary images are divided into several planning areas i of the same size according to the number of drones equipped with spray equipment; Respectively identify the RGB color values ​​of pixels in a plurality of summary images in the same planning area; wherein the RGB color value includes R value, G value and B value; The maximum value of the sum of the R value, the G value and the B value is screened out by traversing and marked as the color value feature of the planning area in the summary picture, and the color value features of several summary pictures in the planning area i are integrated to obtain several groups of projection features.

4. The cultural tourism integration display control system based on drone according to claim 1 is characterized in that: The extracting projection features in the video content includes: A frame is extracted from each second of the video content to obtain several summary images; the summary images are divided into several planning areas i of the same size according to the number of drones equipped with spray equipment; Select n pixels in the planning area and mark them as reference pixels. Select m pixels within a circle around the reference pixels. 2 The RGB values ​​of pixels are summed to obtain n generalized color values; wherein the RGB color value includes R value, G value and B value, n and m are both positive integers, and m>2; The maximum value among n summarized color values ​​is screened out by traversal and marked as the color value feature of the planning area in the summarized picture, and the color value features of several summarized pictures in the planning area i are integrated to obtain several groups of projection features.

5. The cultural tourism integration display control system based on drone according to claim 3 or 4 is characterized in that: The summary picture is a picture of any frame within one second, a picture of the first frame or a picture of the last frame.

6. The cultural tourism integration display control system based on drone according to claim 1 is characterized in that: The adjusting the position of the corresponding drone according to the projection characteristics, the video duration and the remaining water amount in the spray device includes: Match the projection features of the planned area i with the location information of the drone with the spray equipment; calculate the water consumption of the corresponding spray equipment based on the projection features and the video duration; The water consumption is compared with the storage capacity. When the storage capacity is greater than the water consumption, the location information of the corresponding drone is marked as a fixed position; otherwise, the location information of the corresponding drone is marked as a mobile position; Swap the positions of the drone in the fixed position with the drone in the mobile position.

7. The cultural tourism integration display control system based on drone according to claim 6 is characterized in that: The method of calculating the water consumption of the corresponding spray equipment based on the projection characteristics and the video duration includes: Extract several color value features of the planning area corresponding to the drone with the spray device, and compare several color value features in different summary images with the saturation threshold; mark the color value features greater than the saturation threshold as strong features; otherwise, mark the color value features as weak features; By calculating the formula The water consumption Li of the spray equipment on the drone corresponding to the i-th planning area is obtained; where a is the preset proportional coefficient, x is the number of strong features, y is the number of weak features, and t is the video length.

8. The cultural tourism integration display control system based on drone according to claim 7 is characterized in that: The step of exchanging the position of the fixed-position drone with the mobile-position drone includes: The water consumption Li of the spray equipment on the drones corresponding to several planning areas is extracted and sorted from large to small to obtain a water use sequence; the drone with the jth position in the water use sequence corresponding to the fixed position is exchanged with the drone with the jth position in the water use sequence corresponding to the mobile position; where j is a positive integer.

9. A method for controlling the display of cultural and tourism integration based on drones, applied to the display control system of cultural and tourism integration based on drones as described in any one of claims 1-4 and 6-8, characterized in that: The following steps are involved: Step 1: Obtain the number of drones equipped with spray equipment, display parameters of the projected display content, and the amount of water remaining in the spray equipment; Step 2: The UAV of the projection device obtains the location information of the UAV of the spray device; Step 3: Extract the projection features in the video content, and adjust the position of the corresponding drone according to the projection features, video duration, and the remaining water in the spray equipment to obtain the corrected position; Step 4: Adjust the position of the drone according to the displayed coordinates and the corrected position.

10. A storage medium, characterized in that The storage medium stores a computer program, and when the computer program is executed, it runs the system as described in any one of claims 1-4 and 6-8.

Images