A screen display method and system based on unmanned aerial vehicle

Abstract

The present application discloses a screen display method and system based on drones. During the drone's cruising process, the monitoring screen is acquired in real time. Once a help-seeking pattern is identified, the target to be assisted can be quickly determined and the assistance strategy corresponding to the help-seeking pattern can be executed. At the same time, depending on the brightness of the ambient light, it is flexible to choose to perform assistance through a Bluetooth module or a projection device. The present application utilizes a drone equipped with a projection device, which can quickly reach the target area, and directly display navigation instructions or emergency exit locations to trapped persons through projection technology, thereby improving the accuracy and timeliness of assistance. In addition, the present application combines Bluetooth communication technology, and even when the ambient light brightness is high and projection is not possible, the instruction information can be transmitted to the target to be assisted through the Bluetooth module, thereby ensuring the execution rate of the assistance strategy.

Description

Technical Field

[0001] The present application relates to the technical field of display panels, and in particular to a screen display method and system based on an unmanned aerial vehicle. Background Art

[0002] With the rapid development of science and technology, drone technology has been widely used in many fields, including aerial photography, environmental monitoring, agricultural plant protection and emergency rescue. In drone technology, the concept of "drone equipped with screen" has received increasing attention, but its actual application is not the traditional installation of display screens directly on the drone body. On the contrary, it usually refers to the drone integrating or carrying advanced display and projection technology to achieve visual display and transmission of information in specific demand scenarios, such as outdoor navigation and emergency rescue. This technology not only broadens the application boundaries of drones, but also greatly improves their operating efficiency and flexibility in complex environments.

[0003] In outdoor navigation and rescue scenarios, traditional manual search methods are often limited by terrain, weather, and the physical strength and experience of searchers, resulting in low search efficiency, especially in emergency situations where every minute and every second is crucial. In addition, the outdoor environment is complex and changeable, network signal coverage is unstable, and there are limitations in relying on the network for navigation or information transmission. Therefore, it is particularly important to explore a rescue navigation solution that can respond quickly and provide effective guidance. Summary of the invention

[0004] The purpose of this application is to provide a screen display method and system based on an unmanned aerial vehicle, which can improve the above-mentioned problems.

[0005] The embodiment of the present application is implemented as follows:

[0006] On the first aspect, the present application provides a screen display method based on a drone, including steps S1 to S4, wherein S1, S2, etc. are merely step identifiers, and the execution order of the method is not necessarily in ascending order of numbers, for example, step S2 may be executed first and then step S1, and the present application does not impose any restrictions thereon.

[0007] S1: During the cruise, obtain the monitoring screen in real time;

[0008] S2: when a help-seeking pattern is identified in the monitoring image, searching for a target to be helped near the help-seeking pattern;

[0009] S3: determining a corresponding assistance strategy according to the request-seeking pattern;

[0010] S4: monitoring the current ambient light brightness, and activating the Bluetooth module or the projection device to execute the assistance strategy according to the ambient light brightness.

[0011] It can be understood that the present application discloses a screen display method based on drones, which acquires monitoring images in real time during the cruise process. Once a help-seeking pattern is identified, the target to be assisted can be quickly determined and the assistance strategy corresponding to the help-seeking pattern can be executed. At the same time, according to the brightness of the ambient light, it is flexible to choose to perform assistance through a Bluetooth module or a projection device. The present application utilizes a drone equipped with a projection device, which can quickly reach the target area, and directly display navigation instructions or emergency exit locations to trapped persons through projection technology, thereby improving the accuracy and timeliness of assistance. In addition, the present application is combined with Bluetooth communication technology, and even when the ambient light brightness is high and projection is not possible, the instruction information can be transmitted to the target to be assisted through the Bluetooth module, thereby ensuring the execution rate of the assistance strategy.

[0012] In an optional embodiment of the present application, S3 includes: if the help-seeking pattern is the first pattern, determining the first assistance strategy includes the following steps: calculating the transfer route from the current position of the target to be assisted to the safe exit based on a pre-stored offline map; following the movement of the target to be assisted and conveying the indication signs of the transfer route to the target to be assisted.

[0013] It can be understood that when the drone recognizes the specific first pattern, it can quickly calculate the transfer route from the target to be assisted to the safe exit based on the pre-stored offline map, and convey the instruction sign to the target by following the movement of the target. This method not only improves the accuracy of assistance, but also ensures that the target can continue to receive correct instructions during the movement, so that it can reach a safe place faster and safer.

[0014] In an optional embodiment of the present application, S4 includes at least one of the following:

[0015] Monitoring the current ambient light brightness, and when the ambient light brightness is greater than a preset value, establishing a Bluetooth connection with a target terminal device of the target to be assisted, and sending the indication mark to the target terminal device through the Bluetooth module;

[0016] The current ambient light brightness is monitored, and when the ambient light brightness is less than a preset value, the indication mark is projected near the target to be assisted by the projection device.

[0017] It can be understood that the present invention flexibly selects to transmit the indication sign to the target to be assisted through the Bluetooth module or the projection device according to the different ambient light brightness. When the ambient light brightness is high, the Bluetooth connection is selected to send the indication, avoiding the difficulty of identification caused by the weak projection light; when the ambient light brightness is low, the indication sign is directly projected through the projection device to ensure that the target to be assisted can see it clearly. This adaptive assistance method improves the reliability and effectiveness of the assistance.

[0018] In an optional embodiment of the present application, following the movement of the target to be assisted includes at least one of the following:

[0019] When the target to be assisted is identified as a pedestrian, controlling the flight system to follow the pedestrian to be assisted;

[0020] When the target to be assisted is identified as a vehicle, the flight system is controlled to temporarily land on the vehicle to be assisted and move with the vehicle to be assisted.

[0021] It is understandable that when the drone follows the target to be assisted, it can flexibly adjust the following method according to the type of the target to be assisted. For pedestrians, the drone can control the flight system to follow the target; for vehicles, the drone can temporarily land on the vehicle and move with the vehicle. This flexible following method ensures that the drone can closely follow the target to be assisted and provide continuous assistance regardless of whether it is moving or stationary.

[0022] In an optional embodiment of the present application, S3 includes: if the help-seeking pattern is the second pattern, determining the second assistance strategy includes the following steps: establishing a Bluetooth connection with the target terminal device of the target to be assisted, and transmitting the pre-stored offline map to the target terminal device of the target to be assisted through the Bluetooth module.

[0023] It can be understood that when the drone recognizes a specific second pattern, it only needs to transmit the pre-stored offline map to the target terminal device of the target to be assisted through the Bluetooth module, such as a car computer, mobile phone and other smart terminals, to ensure that the target to be assisted cannot update the map outdoors due to poor network signals.

[0024] In an optional embodiment of the present application, the above screen display method further includes the following steps:

[0025] S5: During the cruising process, the dangerous area and / or the obstacle area in the monitoring image is identified in real time, and the dangerous area and / or the obstacle area is updated to the offline map.

[0026] It is understandable that the drone updates the information of dangerous areas and obstacle areas in the offline map in real time during the cruise process. This function is of great significance to improving the accuracy and timeliness of assistance. By constantly updating the map information, the drone can more accurately identify the environmental conditions of the target to be assisted, so as to formulate a more reasonable assistance strategy. At the same time, this also provides valuable geographic information support for other subsequent assistance missions.

[0027] In an optional embodiment of the present application, S3 includes:

[0028] If the help-seeking pattern is the third pattern, determining the third assistance strategy includes the following steps:

[0029] S31: taking the vehicle closest to the third pattern in the monitoring image as a waiting vehicle, taking other vehicles closest to the waiting vehicle in the monitoring image as obstacle vehicles, and taking the road where the obstacle vehicle is located in the monitoring image as a meeting road;

[0030] S32: Calculating the distance between the meeting separation line on the meeting road and the curbs on both sides of the meeting road according to the widths of the meeting road, the vehicle to be assisted and the obstacle vehicle;

[0031] S33: Projecting the meeting separation line on the entity of the meeting road by the projection device.

[0032] It can be understood that when the drone recognizes the specific third pattern, it can quickly identify the vehicle to be assisted and the obstacle vehicle, and calculate the position of the oncoming line on the oncoming road. By projecting the oncoming line on the oncoming road through the projection device, the driver is provided with a clear visual guide, which helps to avoid the risk of collision when oncoming vehicles and improves the safety of road driving.

[0033] In an optional embodiment of the present application, the S32 includes at least one of the following:

[0034] The single-side curb on the meeting road that is closer to the vehicle to be assisted is taken as the first curb, and the distance between the meeting separation line on the meeting road and the first curb is calculated by the following formula: ;in, represents the distance between the meeting dividing line on the meeting road and the first curb; Indicates the width of the vehicle to be assisted; Indicates the width of the obstacle vehicle; Indicates the width of the meeting road;

[0035] The single-side curb on the meeting road that is closer to the obstacle vehicle is used as the second curb, and the distance between the meeting separation line on the meeting road and the second curb is calculated by the following formula: ;in, Indicates the distance between the meeting divider on the meeting road and the second curb.

[0036] In an optional embodiment of the present application, the third assistance strategy further includes the following steps:

[0037] S34: taking the sum of the width of the vehicle to be assisted and the width of the obstacle vehicle as the total width of the vehicle;

[0038] S35: When the difference between the width of the oncoming road and the total width of the vehicle is smaller than a preset value, follow the vehicle to be assisted and project a back-up sign near the target to be assisted by the projection device until the difference in the monitoring image is larger than a preset value.

[0039] It can be understood that when the difference between the width of the oncoming road and the total width of the vehicle is less than the preset value, the drone will follow the vehicle to be assisted and project a back-up sign near it. This function provides timely warning information to the driver, allowing him to take evasive measures or back up to a safe position in time when the road width is insufficient. This not only helps to avoid potential collision risks, but also improves the overall safety and smoothness of road driving.

[0040] In the second aspect, the present application discloses a screen display system based on an unmanned aerial vehicle, comprising a Bluetooth module, a projection device, a flight module, a processor and a memory interconnected by a bus, wherein the memory is used to store a computer program, the computer program includes program instructions, and the processor is configured to call the program instructions to execute any method described in the first aspect.

[0041] It can be understood that the screen display system based on drones disclosed in this application integrates Bluetooth modules, projection equipment, and flight modules, and can directly project key information such as navigation instructions and emergency exit locations onto the ground or other planes in a dimly lit environment, providing intuitive and clear guidance for trapped people. At the same time, in a well-lit environment, combined with offline maps and Bluetooth communication technology, even in the case of poor network signals or complete interruptions, drones can provide the latest version of offline maps to the target to be assisted, ensuring the smooth progress of the rescue operation. Beneficial Effects

[0042] The present application discloses a screen display method and system based on drones, which can obtain monitoring images in real time during the drone's cruising process. Once a help-seeking pattern is identified, the target to be assisted can be quickly determined and the assistance strategy corresponding to the help-seeking pattern can be executed. At the same time, according to the brightness of the ambient light, it is flexible to choose to perform assistance through a Bluetooth module or a projection device. The present application utilizes a drone equipped with a projection device, which can quickly reach the target area, and directly display navigation instructions or emergency exit locations to trapped persons through projection technology, thereby improving the accuracy and timeliness of assistance. In addition, the present application combines Bluetooth communication technology, and even when the ambient light brightness is high and projection is not possible, the instruction information can be transmitted to the target to be assisted through the Bluetooth module, thereby ensuring the execution rate of the assistance strategy.

[0043] When the drone recognizes a specific first pattern, it can quickly calculate the transfer route from the target to the safe exit based on the pre-stored offline map, and convey the instruction signs to the target by following the target. This method not only improves the accuracy of assistance, but also ensures that the target can continue to receive correct instructions during the movement, so that it can reach a safe place faster and safer.

[0044] When the drone recognizes a specific second pattern, it only needs to transmit the pre-stored offline map to the target terminal device of the target to be assisted through the Bluetooth module, such as a car computer, mobile phone and other smart terminals, to ensure that the target to be assisted cannot update the map outdoors due to poor network signals.

[0045] When the drone recognizes a specific third pattern, it can quickly identify the vehicle to be assisted and the obstacle vehicle, and calculate the position of the oncoming line on the road. By projecting the oncoming line on the road through projection equipment, it provides clear visual guidance for the driver, helps avoid the risk of collision when oncoming vehicles, and improves road driving safety.

[0046] This application also discloses a screen display system based on drones, which integrates a Bluetooth module, a projection device, and a flight module. It can directly project key information such as navigation instructions and emergency exit locations onto the ground or other planes in a dimly lit environment, providing intuitive and clear guidance for trapped people. At the same time, in a well-lit environment, combined with offline maps and Bluetooth communication technology, even in the case of poor network signals or complete interruptions, drones can provide the latest version of offline maps to the target to be assisted, ensuring the smooth progress of the rescue operation.

[0047] In order to make the above-mentioned objects, features and advantages of the present application more obvious and understandable, optional embodiments are specifically listed below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0049] Figure 1 This is a flow chart of a screen display method based on a drone provided by the present application;

[0050] Figure 2 It is a schematic diagram of a monitoring screen with a help-seeking pattern provided by the present application;

[0051] Figure 3 It is a scenario diagram of the first assistance strategy provided by this application;

[0052] Figure 4 It is a schematic diagram of another monitoring screen with a help-seeking pattern provided by the present application;

[0053] Figure 5 It is a scenario diagram of the third assistance strategy provided by this application. DETAILED DESCRIPTION

[0054] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0055] First, as Figure 1 As shown, the present application provides a screen display method based on a drone, including steps S1 to S4, wherein S1, S2, etc. are only step identifiers, and the execution order of the method is not necessarily in the order of numbers from small to large, for example, step S2 may be executed first and then step S1, and the present application does not impose any restrictions.

[0056] S1: During the cruise, obtain the monitoring image in real time.

[0057] During the cruise, the drone uses the onboard camera to obtain real-time monitoring images. This step is the basis for the drone to perform any mission, which enables the drone to continuously observe and respond to environmental changes. For example, in a search and rescue mission, the drone can promptly detect and respond to the help patterns of trapped people or vehicles through real-time monitoring images.

[0058] S2: When a help-seeking pattern is identified in the monitoring image, a target to be helped near the help-seeking pattern is searched.

[0059] When the drone recognizes specific help-seeking patterns in the surveillance footage, it will further search for targets in need of help near these patterns. This step relies on advanced image recognition technology, which enables the drone to quickly and accurately locate the person or vehicle in need of help, providing precise location information for subsequent assistance operations.

[0060] The help-seeking pattern can be any pre-agreed mark pattern, such as a capital A pattern. The help-seeking person can spread a carpet with the help-seeking pattern on the open space, and the help-seeking vehicle can have the help-seeking pattern spray-painted on the body of the vehicle. Figure 2As shown, when the help-seeking pattern 11 in the monitoring image 1 is identified, the target to be helped carrying the help-seeking pattern 11, that is, the vehicle to be helped 12, is found.

[0061] S3: Determine the corresponding assistance strategy based on the help-seeking pattern.

[0062] Based on the identified help-seeking pattern, the drone will determine the corresponding assistance strategy. Different help-seeking patterns may represent different emergency situations and assistance needs. For example, the assistance strategy corresponding to the first pattern is to follow the target to be assisted and convey the sign of the transfer route to the target to be assisted; the assistance strategy corresponding to the second pattern is to establish a Bluetooth connection with the target terminal device of the target to be assisted and transmit the pre-stored offline map to the target terminal device of the target to be assisted through the Bluetooth module; the assistance strategy corresponding to the third pattern is to quickly identify the vehicle to be assisted and the obstacle vehicle, and project the meeting dividing line on the meeting road through the projection device, providing the driver with clear visual guidance. In this way, when the drone recognizes a specific help-seeking pattern, it can quickly formulate a corresponding assistance plan.

[0063] S4: Monitor the current ambient light brightness, and activate the Bluetooth module or projection device to execute the assistance strategy according to the ambient light brightness.

[0064] Before executing the assistance strategy, the drone will monitor the current ambient light brightness. This is because the ambient light brightness has an important impact on the working effect of the drone's projection device and Bluetooth module. According to the monitored light brightness, the drone will choose to activate the Bluetooth module or projection device to execute the assistance strategy to ensure that the assistance information can be clearly conveyed to the target to be assisted.

[0065] It can be understood that the present application discloses a screen display method based on drones, which acquires monitoring images in real time during the cruise process. Once a help-seeking pattern is identified, the target to be assisted can be quickly determined and the assistance strategy corresponding to the help-seeking pattern can be executed. At the same time, according to the brightness of the ambient light, it is flexible to choose to perform assistance through a Bluetooth module or a projection device. The present application utilizes a drone equipped with a projection device, which can quickly reach the target area, and directly display navigation instructions or emergency exit locations to trapped persons through projection technology, thereby improving the accuracy and timeliness of assistance. In addition, the present application is combined with Bluetooth communication technology, and even when the ambient light brightness is high and projection is not possible, the instruction information can be transmitted to the target to be assisted through the Bluetooth module, thereby ensuring the execution rate of the assistance strategy.

[0066] In an optional embodiment of the present application, S3 includes: if the help-seeking pattern is the first pattern, determining the first assistance strategy includes the following steps: based on a pre-stored offline map, calculating the transfer route from the current position of the target to be assisted to the safe exit; following the target to be assisted and conveying the indication signs of the transfer route to the target to be assisted.

[0067] It can be understood that when the drone recognizes the specific first pattern, it can quickly calculate the transfer route from the target to be assisted to the safe exit based on the pre-stored offline map, and convey the indication sign to the target by following the movement of the target. Figure 3 As shown, the projection device 23 carried by the drone is projecting an indication sign 24 for the pedestrian 21 to be assisted. This method not only improves the accuracy of assistance, but also ensures that the target to be assisted can continue to receive correct instructions during the movement, so as to reach a safe place faster and safer.

[0068] In an optional embodiment of the present application, S4 includes at least one of the following:

[0069] Monitor the current ambient light brightness, and when the ambient light brightness is greater than a preset value, establish a Bluetooth connection with the target terminal device of the target to be assisted, and send an indication mark to the target terminal device through the Bluetooth module;

[0070] Monitor the current ambient light brightness, and when the ambient light brightness is less than a preset value, project an indication sign near the target to be assisted through a projection device.

[0071] It can be understood that the present invention flexibly selects to transmit the indication sign to the target to be assisted through the Bluetooth module or the projection device according to the different ambient light brightness. When the ambient light brightness is high, the Bluetooth connection is selected to send the indication, avoiding the difficulty of identification caused by the weak projection light; when the ambient light brightness is low, the indication sign is directly projected through the projection device to ensure that the target to be assisted can see it clearly. This adaptive assistance method improves the reliability and effectiveness of the assistance.

[0072] In an optional embodiment of the present application, following the movement of the target to be assisted includes at least one of the following:

[0073] When the target to be assisted is identified as a pedestrian, the flight system is controlled to follow the pedestrian to be assisted;

[0074] When the target to be assisted is identified as a vehicle, the flight system is controlled to temporarily land on the vehicle to be assisted and move with the vehicle to be assisted.

[0075] It is understandable that when the drone follows the target to be assisted, it can flexibly adjust the following method according to the type of the target to be assisted. For pedestrians, the drone can control the flight system to follow the target; for vehicles, the drone can temporarily land on the vehicle and move with the vehicle. This flexible following method ensures that the drone can closely follow the target to be assisted and provide continuous assistance regardless of whether it is moving or stationary.

[0076] In an optional embodiment of the present application, S3 includes: if the help-seeking pattern is the second pattern, determining the second assistance strategy includes the following steps: establishing a Bluetooth connection with the target terminal device of the target to be assisted, and transmitting the pre-stored offline map to the target terminal device of the target to be assisted through the Bluetooth module.

[0077] It can be understood that when the drone recognizes a specific second pattern, it only needs to transmit the pre-stored offline map to the target terminal device of the target to be assisted through the Bluetooth module, such as a car computer, mobile phone and other smart terminals, to ensure that the target to be assisted cannot update the map outdoors due to poor network signals.

[0078] In an optional embodiment of the present application, the above screen display method further includes the following steps:

[0079] S5: During the cruising process, the dangerous area and / or obstacle area in the monitoring image is identified in real time, and the dangerous area and / or obstacle area is updated to the offline map.

[0080] It is understandable that the drone updates the information of dangerous areas and obstacle areas in the offline map in real time during the cruise process. This function is of great significance to improving the accuracy and timeliness of assistance. By constantly updating the map information, the drone can more accurately identify the environmental conditions of the target to be assisted, so as to formulate a more reasonable assistance strategy. At the same time, this also provides valuable geographic information support for other subsequent assistance missions.

[0081] In an optional embodiment of the present application, S3 includes:

[0082] If the help-seeking pattern is the third pattern, determining the third assistance strategy includes the following steps:

[0083] S31: The vehicle closest to the third pattern in the monitoring image is regarded as the vehicle to be assisted, other vehicles closest to the vehicle to be assisted in the monitoring image are regarded as obstacle vehicles, and the road where the obstacle vehicle is located in the monitoring image is regarded as the meeting road.

[0084] like Figure 4 As shown, when the third pattern 31 (capital C pattern) in the monitoring screen 30 is identified, the nearest vehicle is regarded as the vehicle to be assisted, that is, the vehicle 32 with the third pattern 31 sprayed on it is regarded as the vehicle to be assisted; at the same time, the vehicle 33 in the monitoring screen 30 that is closest to the vehicle to be assisted 32 is regarded as an obstacle vehicle, and the road 300 where the obstacle vehicle 33 in the monitoring screen is located is regarded as the meeting road.

[0085] S32: Calculate the distance between the passing road separation line and curbs on both sides of the passing road according to the widths of the passing road, the vehicle waiting for assistance, and the obstacle vehicle.

[0086] In an optional embodiment of the present application, S32 includes at least one of the following:

[0087] The single-side curb on the oncoming road that is closer to the assisting vehicle is taken as the first curb, and the distance between the oncoming separation line on the oncoming road and the first curb is calculated using the following formula: ;in, Indicates the distance between the meeting divider and the first curb on the meeting road; Indicates the width of the vehicle waiting for assistance; Indicates the width of the obstructing vehicle; Indicates the width of the meeting road;

[0088] The single-side curb on the passing road that is closer to the obstacle vehicle is used as the second curb. The distance between the passing separation line on the passing road and the second curb is calculated using the following formula: ;in, Indicates the distance between the meeting divider and the second curb on the meeting road.

[0089] S33: Projecting a meeting separation line on the entity of the meeting road by means of a projection device.

[0090] like Figure 5 As shown, the projection device 34 carried by the drone will project a meeting dividing line 200 on the meeting road in a real environment.

[0091] It can be understood that when the drone recognizes the specific third pattern, it can quickly identify the vehicle to be assisted and the obstacle vehicle, and calculate the position of the oncoming line on the oncoming road. By projecting the oncoming line on the oncoming road through the projection device, the driver is provided with a clear visual guide, which helps to avoid the risk of collision when oncoming vehicles and improves the safety of road driving.

[0092] In an optional embodiment of the present application, the third assistance strategy further includes the following steps:

[0093] S34: taking the sum of the width of the vehicle to be assisted and the width of the obstacle vehicle as the total width of the vehicle;

[0094] S35: When the difference between the width of the oncoming road and the total width of the vehicle is less than a preset value, follow the vehicle to be assisted and project a back-up sign near the target to be assisted by a projection device until the difference in the monitoring image is greater than a preset value.

[0095] It can be understood that when the difference between the width of the oncoming road and the total width of the vehicle is less than the preset value, the drone will follow the vehicle to be assisted and project a back-up sign near it. This function provides timely warning information to the driver, allowing him to take evasive measures or back up to a safe position in time when the road width is insufficient. This not only helps to avoid potential collision risks, but also improves the overall safety and smoothness of road driving.

[0096] In the second aspect, the present application discloses a screen display system based on an unmanned aerial vehicle, comprising a Bluetooth module, a projection device, a flight module, a processor and a memory interconnected by a bus, wherein the memory is used to store a computer program, the computer program includes program instructions, and the processor is configured to call the program instructions to execute any method described in the first aspect.

[0097] It should be understood that in the embodiments of the present invention, the processor referred to may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0098] It can be understood that the screen display system based on drones disclosed in this application integrates Bluetooth modules, projection equipment, and flight modules, and can directly project key information such as navigation instructions and emergency exit locations onto the ground or other planes in a dimly lit environment, providing intuitive and clear guidance for trapped people. At the same time, in a well-lit environment, combined with offline maps and Bluetooth communication technology, even in the case of poor network signals or complete interruptions, drones can provide the latest version of offline maps to the target to be assisted, ensuring the smooth progress of the rescue operation.

[0099] In a third aspect, the present invention provides a computer-readable storage medium storing a computer program, wherein the computer program includes program instructions, and when the program instructions are executed by a processor, the steps of any method of the first aspect are implemented.

[0100] The computer-readable storage medium may be an internal storage unit of the terminal device of any of the aforementioned embodiments, such as a hard disk or memory of the terminal device. The computer-readable storage medium may also be an external storage device of the terminal device, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the terminal device. Furthermore, the computer-readable storage medium may also include both an internal storage unit of the terminal device and an external storage device. The computer-readable storage medium is used to store the computer program and other programs and data required by the terminal device. The computer-readable storage medium may also be used to temporarily store data that has been output or is to be output.

[0101] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0102] In the several embodiments provided in the present application, it should be understood that the disclosed terminal device and method can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the above units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, or it can be an electrical, mechanical or other form of connection.

[0103] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the embodiments of the present invention.

[0104] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0105] If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.

[0106] The expressions "first", "second", "the first" or "the second" used in various embodiments of the present disclosure may modify various components regardless of order and / or importance, but these expressions do not limit the corresponding components. The above expressions are only configured for the purpose of distinguishing an element from other elements. For example, a first user device and a second user device represent different user devices, although both are user devices. For example, a first element may be referred to as a second element, and similarly, a second element may be referred to as a first element without departing from the scope of the present disclosure.

[0107] When one element (e.g., a first element) is referred to as being "(operably or communicatively) coupled" or "(operably or communicatively) coupled to" or "connected to" another element (e.g., a second element), it is understood that the one element is directly connected to the other element or the one element is indirectly connected to the other element via yet another element (e.g., a third element). Conversely, it is understood that when an element (e.g., a first element) is referred to as being "directly connected" or "directly coupled" to another element (the second element), no element (e.g., a third element) is interposed between the two.

[0108] It should be noted that, in this article, the terms "include", "comprises" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "includes a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element. In addition, components, features, and elements with the same name in different embodiments of the present application may have the same meaning or different meanings, and their specific meanings need to be determined by their explanation in the specific embodiment or further combined with the context of the specific embodiment.

[0109] The above description is only an optional embodiment of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the present application is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above invention concept. For example, the above features are replaced with the technical features with similar functions disclosed in this application (but not limited to) by each other.

[0110] As used herein, the words "if" and "if" may be interpreted as "at the time of" or "when" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrases "if it is determined" or "if (stated condition or event) is detected" may be interpreted as "when it is determined" or "in response to determining" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)", depending on the context.

[0111] The above description is only an optional embodiment of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the present application is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above invention concept. For example, the above features are replaced with the technical features with similar functions disclosed in this application (but not limited to) by each other.

[0112] The above description is only an optional embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application shall be included in the protection scope of the present application.

Claims

1. A screen display method based on drone, applied to a drone equipped with a Bluetooth module and a projection device, characterized in that: The following steps are involved: S1: During the cruise, obtain the monitoring screen in real time; S2: when a help-seeking pattern is identified in the monitoring image, searching for a target to be helped near the help-seeking pattern; S3: determining a corresponding assistance strategy according to the request-seeking pattern; S4: monitoring the current ambient light brightness, and activating the Bluetooth module or the projection device to execute the assistance strategy according to the ambient light brightness; Wherein, S3 includes: if the help-seeking pattern is the first pattern, determining the first assistance strategy includes the following steps: calculating the transfer route from the current position of the target to be assisted to the safe exit based on the pre-stored offline map; following the movement of the target to be assisted and conveying the indication sign of the transfer route to the target to be assisted; The S3 includes: if the help-seeking pattern is the second pattern, determining the second assistance strategy includes the following steps: establishing a Bluetooth connection with the target terminal device of the target to be assisted, and transmitting the pre-stored offline map to the target terminal device of the target to be assisted through the Bluetooth module; The S3 includes: If the help-seeking pattern is the third pattern, determining the third assistance strategy includes the following steps: S31: taking the vehicle closest to the third pattern in the monitoring image as a waiting vehicle, taking other vehicles closest to the waiting vehicle in the monitoring image as obstacle vehicles, and taking the road where the obstacle vehicle is located in the monitoring image as a meeting road; S32: Calculating the distance between the meeting separation line on the meeting road and the curbs on both sides of the meeting road according to the widths of the meeting road, the vehicle to be assisted and the obstacle vehicle; S33: Projecting the meeting separation line on the entity of the meeting road by the projection device.

2. The screen display method based on drone according to claim 1, characterized in that: The S4 includes at least one of the following: Monitoring the current ambient light brightness, and when the ambient light brightness is greater than a preset value, establishing a Bluetooth connection with a target terminal device of the target to be assisted, and sending the indication mark to the target terminal device through the Bluetooth module; The current ambient light brightness is monitored, and when the ambient light brightness is less than a preset value, the indication mark is projected near the target to be assisted by the projection device.

3. The screen display method based on drone according to claim 1, characterized in that: The following the target to be assisted to move includes at least one of the following: When the target to be assisted is identified as a pedestrian, controlling the flight system to follow the pedestrian to be assisted; When the target to be assisted is identified as a vehicle, the flight system is controlled to temporarily land on the vehicle to be assisted and move with the vehicle to be assisted.

4. The screen display method based on drone according to any one of claims 1 to 3, characterized in that: The following steps are also included: S5: During the cruising process, the dangerous area and / or the obstacle area in the monitoring image is identified in real time, and the dangerous area and / or the obstacle area is updated to the offline map.

5. The screen display method based on drone according to claim 1, characterized in that: The S32 includes at least one of the following: The single-side curb on the meeting road that is closer to the vehicle to be assisted is taken as the first curb, and the distance between the meeting separation line on the meeting road and the first curb is calculated by the following formula: ;in, represents the distance between the meeting dividing line on the meeting road and the first curb; Indicates the width of the vehicle to be assisted; Indicates the width of the obstacle vehicle; Indicates the width of the meeting road; The single-side curb on the meeting road that is closer to the obstacle vehicle is used as the second curb, and the distance between the meeting separation line on the meeting road and the second curb is calculated by the following formula: ;in, Indicates the distance between the meeting divider on the meeting road and the second curb.

6. The screen display method based on drone according to claim 5, characterized in that: The third assistance strategy also includes the following steps: S34: taking the sum of the width of the vehicle to be assisted and the width of the obstacle vehicle as the total width of the vehicle; S35: When the difference between the width of the oncoming road and the total width of the vehicle is smaller than a preset value, follow the vehicle to be assisted and project a back-up sign near the target to be assisted by the projection device until the difference in the monitoring image is larger than a preset value.

7. A screen display system based on an unmanned aerial vehicle, characterized in that: It comprises a Bluetooth module, a projection device, a flight module, a processor and a memory interconnected by a bus, wherein the memory is used to store a computer program, the computer program comprises program instructions, and the processor is configured to call the program instructions to execute the method according to any one of claims 1 to 6.

Images