Flight equipment information display method and electronic equipment

Abstract

The invention provides a flight equipment information display method and electronic equipment, and relates to the technical field of flight control. The method comprises the steps that in a first information display area, stage identifiers of a plurality of flight stages of flight equipment in a preset geographic range are sequentially arranged, and each flight stage corresponds to one or more air routes; and in response to the monitoring instruction, displaying the dynamic identifier of the flight equipment at the associated position of the flight stage and the air route of the flight equipment. The geographical range, the air route and the flight stage of the flight equipment are displayed through the display position of the dynamic identifier of the flight equipment, so that the flight equipment can be controlled by combining the geographical range, the air route and the flight stage.

Description

Technical Field

[0001] The present disclosure relates to the technical field of flight control, and in particular, to a method for displaying flight device information and an electronic device. Background Art

[0002] This section aims to provide background or context for the embodiments of the present disclosure described in the claims. The description herein is not admitted to be prior art merely because it is included in this section.

[0003] In the related art, in order to manage flight devices, the movement trajectories of flight devices are usually tiled on a two-dimensional map. The target object can manage the flight devices through the movement trajectories of the flight devices on the map. However, the flight device information displayed by the above solution is complex and disordered, resulting in the target object being able to observe and manage only a small number of flight devices.

[0004] Therefore, the technical problem to be solved by the present disclosure is how to display flight device information so that the target object can manage a larger number of flight devices simultaneously. Summary of the Invention

[0005] The purpose of the present disclosure is to provide a method for displaying flight device information and an electronic device to solve the problem that the control and management of flight devices are not clear and concise.

[0006] An embodiment of the present disclosure provides a method for displaying flight device information, including: arranging stage identifiers of multiple flight stages of a flight device within a preset geographical range in sequence in a first information display area, where each flight stage corresponds to one or more flight routes; and in response to a monitoring instruction, displaying a dynamic identifier of the flight device at an associated position of the flight stage and flight route where the flight device is located.

[0007] An embodiment of the present disclosure provides a device for displaying flight device information, including: a stage identifier display module and a dynamic identifier display module.

[0008] Among them, the stage identifier display module can be used to arrange stage identifiers of multiple flight stages of a flight device within a preset geographical range in sequence in a first information display area, where each flight stage corresponds to one or more flight routes; and the dynamic identifier display module can be used to display a dynamic identifier of the flight device at an associated position of the flight stage and flight route where the flight device is located in response to a monitoring instruction.

[0009] An embodiment of the present disclosure proposes an electronic device, which includes: a memory and a processor; the memory is used to store computer program instructions; and the processor calls the computer program instructions stored in the memory to implement the method for displaying flight device information described in any one of the above.

[0010] An embodiment of the present disclosure provides a computer-readable storage medium, on which computer program instructions are stored, for implementing the flight device information display method described in any one of the above.

[0011] An embodiment of the present disclosure provides a computer program product or a computer program. The computer program product or the computer program includes computer program instructions, which are stored in a computer-readable storage medium. The computer program instructions are read from the computer-readable storage medium, and a processor executes the computer program instructions to implement the above flight device information display method.

[0012] The flight device information display method and the electronic device provided by the embodiments of the present disclosure can determine the geographical range, flight route, and flight phase of a flight device according to the position of the dynamic identifier of the flight device, and concisely and effectively highlight the important reference data for controlling the flight device, enabling the target object to timely understand the geographical range, flight phase, and flight route of each flight device, so as to manage and control the flight device. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Obviously, the drawings in the following description are only some embodiments of the present disclosure. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0014] Figure 1 A schematic diagram of a scenario to which the flight device information display method or the flight device information display device according to the embodiments of the present disclosure can be applied is shown.

[0015] Figure 2 is a flowchart of a flight device information display method shown according to an exemplary embodiment.

[0016] Figure 3 is a flowchart of a flight device information display method shown according to an exemplary embodiment.

[0017] Figure 4 is a flowchart of a flight device information display method shown according to an exemplary embodiment.

[0018] Figure 5 is a schematic diagram of the display of flight phase indication information shown according to an exemplary embodiment.

[0019] Figure 6 is a schematic diagram of the display of flight phase indication information shown according to an exemplary embodiment.

[0020] Figure 7 is a schematic diagram of the display of flight phase indication information shown according to an exemplary embodiment.

[0021] Figure 8 It is a schematic diagram showing the display of flight phase indication information according to an exemplary embodiment.

[0022] Figure 9 It is a schematic diagram showing the display of flight phase indication information according to an exemplary embodiment.

[0023] Figure 10 It is a schematic diagram showing the display of flight phase indication information according to an exemplary embodiment.

[0024] Figure 11 It is a schematic diagram showing the display of flight phase indication information according to an exemplary embodiment.

[0025] Figure 12 It is a schematic diagram showing the display of flight phase indication information according to an exemplary embodiment.

[0026] Figure 13 It is a schematic diagram showing the display of flight phase indication information according to an exemplary embodiment.

[0027] Figure 14 It is a schematic diagram showing the display of flight phase indication information according to an exemplary embodiment.

[0028] Figure 15 It is a flowchart showing a method for displaying control reference information of a flight device according to an exemplary embodiment.

[0029] Figure 16 It is a flowchart showing a method for displaying flight device information according to an exemplary embodiment.

[0030] Figure 17 It is a schematic layout diagram of a second information display area according to an exemplary embodiment.

[0031] Figure 18 It is a schematic diagram showing the display of the second information display area in the waiting task phase according to an exemplary embodiment.

[0032] Figure 19 It is a flowchart showing a method for displaying flight device information according to an exemplary embodiment.

[0033] Figure 20 It is a schematic diagram showing the display of control reference information according to an exemplary embodiment.

[0034] Figure 21 It is a flowchart showing a method for activating a control control according to an exemplary embodiment.

[0035] Figure 22 It is a flowchart of a method for displaying flight device information shown according to an exemplary embodiment.

[0036] Figure 23 It is a schematic diagram of a takeover control component display shown according to an exemplary embodiment.

[0037] Figure 24 It is a schematic diagram of a confirmation takeover control component display shown according to an exemplary embodiment.

[0038] Figure 25 It is a schematic diagram of the display of the device identifier after a flight device is taken over shown according to an exemplary embodiment.

[0039] Figure 26 It is a schematic diagram of the display of control components in an active state shown according to an exemplary embodiment.

[0040] Figure 27 It is a schematic diagram of the display of the end takeover control component shown according to an exemplary embodiment.

[0041] Figure 28 It is a flowchart of a method for displaying unmanned aerial vehicle device information shown according to an exemplary embodiment.

[0042] Figure 29 It is a block diagram of a device for displaying flight device information shown according to an exemplary embodiment.

[0043] Figure 30 It shows a schematic structural diagram of an electronic device suitable for implementing the embodiments of the present disclosure. Detailed implementation manners

[0044] Example embodiments will now be described more fully with reference to the accompanying drawings. However, the example embodiments can be implemented in various forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of the example embodiments to those skilled in the art. Like reference numerals in the figures denote the same or similar parts, and thus their repeated description will be omitted.

[0045] The flowcharts shown in the accompanying drawings are only illustrative and not necessarily include all the contents and steps, nor are they necessarily executed in the described order. For example, some steps can be decomposed, while some steps can be combined or partially combined, so the actual execution order may change according to the actual situation.

[0046] In the description of the present disclosure, unless otherwise specified, " / " means "or". For example, A / B may represent A or B. Herein, "and / or" is merely an association relationship describing associated objects, indicating that there can be three relationships. For example, A and / or B may represent: A exists alone, A and B exist simultaneously, and B exists alone.

[0047] The exemplary embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.

[0048] Figure 1 A schematic diagram of a scenario to which the flight device information display method or the flight device information display device according to the embodiments of the present disclosure can be applied is shown. As Figure 1 shown, the system architecture 120 may include a flight device 101, terminal devices 102 and 103, a network 104, and a server 105. The network 104 is a medium for providing a communication link between the flight device 101, the terminal devices 102, 103, and the server 105. The network 104 may include various connection types, such as wireless communication links and the like.

[0049] The user can use the flight device 101 or the terminal devices 102 and 103 to interact with the server 105 through the network 104 to receive or send messages and the like. Among them, the flight device 101 may be a device that can fly, such as an airplane, a drone, an aircraft, etc. Whether the above flight device is a single device or a flight device fleet is not limited in this application; the terminal devices 102, 103 may be various electronic devices having a display screen and supporting web browsing, including but not limited to smart phones, tablet computers, laptop portable computers, desktop computers, wearable devices, virtual reality devices, smart homes, and the like. The server 105 may be a server that provides various services, such as a background management server that supports the information sent by the flight device 101 and the operations performed by the user using the terminal devices 102, 103. The background management server may analyze and process data such as received requests, and feedback the processing results to the terminal devices.

[0050] In some embodiments, the server 105 may collect flight information of the flight device 101 through the network 104, such as flight phase information, flight trajectory information, flight status information, flight environment information, etc.; the server 105 may analyze and process the data collected from the flight device 101, and send the results of the analysis and processing to the terminal device 102 or 103 through the network 104; the terminal device 102 or 103 may, for example, arrange the phase identifiers of multiple flight phases of the flight device within a preset geographical range in sequence in the first information display area, and each flight phase corresponds to one or more air routes; the terminal device 102 or 103 may, for example, in response to a monitoring instruction, display the dynamic identifier of the flight device at the associated position of the flight phase and air route where the flight device is located.

[0051] Figure 2 is a flowchart of a method for displaying flight device information shown according to an exemplary embodiment. The method provided by the embodiments of the present disclosure may be executed by an electronic device with display capabilities, but the present disclosure is not limited thereto. Refer to Figure 2 , the method for displaying flight device information provided by the embodiments of the present disclosure may include the following steps.

[0052] Step S202, display a plurality of flight phase indication information, and each flight phase indication information is used to indicate different flight phases of the flight device in the air route.

[0053] In some embodiments, the above-mentioned flight device may be an aircraft or a drone or other devices capable of flying.

[0054] The flight phases of the above-mentioned flight device may be flight phases divided according to the flight tasks of the flight device. For example, when performing a delivery task, the flight phases of the flight device may include a land loading phase, an air flight phase, and a land delivery phase, etc.; the flight phases of the above-mentioned flight device may also be divided according to the flight process of the flight device. For example, the flight device in the air route may include phases such as pushback and taxiing, takeoff and departure, cruise, descent, and landing. For another example, the flight phases of the flight device in the air route may include a takeoff phase, a level flight phase, and a descent phase, etc. For another example, the flight phases of the flight device in the air route may also include an origin takeoff phase, a first level flight phase, an en-route descent phase, an en-route takeoff phase, a second level flight phase, and a destination descent phase, etc. The present disclosure does not limit which specific flight phases the flight device includes, and those skilled in the art may set the flight phases in the present disclosure according to the actual flight phases corresponding to the flight device.

[0055] In some embodiments, the flight phase indication information may indicate the flight phase of the flight device without distinguishing between air routes (for example, displaying the flight devices in a certain flight phase on each air route together in the form of a list, and the specific display effect may be as shown in Figure 5 ); in some embodiments, when displaying the flight phase of the flight device, the flight phase indication information may also distinguish the air route where the flight device is located (for example, displaying the flight devices on different air routes at the positions of the flight phase indication information corresponding to different air routes, and the specific display effect may refer to Figure 14 ), and the present disclosure does not limit this.

[0056] In some embodiments, the above-mentioned flight phase indication information may be represented in various forms. For example, it may be represented by a box with a specific meaning, for example, by a straight line with a specific meaning, for example, by a region with a specific meaning, or for example, by a superscript or subscript with a specific meaning. The present disclosure does not limit the manifestation form of the flight phase indication information, and those skilled in the art can set the manifestation form of the flight phase display information according to their own needs.

[0057] For example, the flight phase indication information may be Figure 5 the box corresponding to the takeoff phase, or the square box corresponding to the level flight phase, or the box corresponding to the descent phase in Figure 5 . The specific meaning of the box may be prompted by text (such as

[0058] "takeoff phase", "descent phase", etc. in

[0059] ), or may be prompted by color, or may also be prompted by the filling color of the box, etc., and the present disclosure does not limit this.

[0060] Again, for example, the flight phase indication information may be a line with a specific meaning. Similarly, the specific meaning of the line may be represented in various ways (such as text, color, line style, etc.), and the present disclosure does not limit this. Figures 5 to 14 For details on how to display the flight phase indication information, reference may be made to the corresponding embodiments in

[0061] Step S204, display the device identifier of the flight device at the associated position of the flight phase indication information corresponding to the current flight phase of the flight device, and display the flight state of the flight device, so as to control the flight device.

[0062] In some embodiments, a flying device may refer to a device that is in flight, and there may be one, two, or more such flying devices. For example, in the scenario of drone delivery, the flying device may refer to a drone that has received a delivery task and needs to fly or is already in flight.

[0063] In some embodiments, the current flight stage of the flying device can be obtained in real time (such as determining that the flight stage of the flying device is the takeoff stage), then the flight stage indication information corresponding to the current flight state is determined (for example, determining that the flight stage indication information corresponding to the takeoff stage is A), and finally, the device identifier of the flying device is displayed at the associated position of the flight stage indication information of the current flight stage (such as displaying the flying device at the associated position of A).

[0064] In some embodiments, the device identifier of the flying device can be a device code (such as the codes 3301, 3302, and 3303 in Figure 5 ), a device model (such as an aircraft model, a drone model, or a model corresponding to other flying vehicles, or a triangular model in Figure 14 ), or a combination of a device code and a device model (such as the combination of the code 3302 and the corresponding triangular model in Figure 14 ). The present disclosure places no restrictions on the style of the device identifier of the flying device.

[0065] In some embodiments, the status of the flying device can be displayed through means other than the device identifier, such as voice, text, color, etc. For example, if the flight status of the flying device is abnormal, it can be reminded through a warning color, warning text, or warning voice that the flying device has an abnormality.

[0066] In some embodiments, the device status of the flying device can be displayed through the device identifier of the flying device. In some embodiments, displaying the device identifier of the flying device according to the current flight state of the flying device may include: if the flying device is flying normally, the device identifier of the flying device is displayed in a first state; if the flying device is flying abnormally, the device identifier of the flying device is displayed in a second state. Among them, the first state may represent the normal state, and the second state may represent the abnormal state. The present application places no restrictions on the method of displaying the status of the flying device.

[0067] In some embodiments, the abnormal status of the device identifier can be displayed through color, pattern style, or background. For example, the device identifier can be displayed in red or a dark color to indicate that the flying device represented by the device identifier has a flight abnormality; for another example, the device identifier can be displayed in yellow or a light color to indicate that the flying device represented by the device identifier has an alarm; for another example, the device identifier can be displayed in white or a transparent color to indicate that the flying device represented by the device identifier is flying normally.

[0068] Among them, the abnormal flight of the flying device may refer to abnormal trajectory, abnormal device state, or abnormal flight environment (extreme weather appears), etc., and the present disclosure does not limit this.

[0069] In some embodiments, if the flying device has an abnormal flight, it may be considered to take over and control the flying device.

[0070] The above embodiments can display the current flight state of the flying device and indicate the current flight phase of the flying device through flight phase indication information, simply and effectively highlighting the important reference data for controlling the flying device, so that the target object can timely understand the current flight phase and current flight state of each flying device, so as to manage and control the flying device.

[0071] Figure 3 It is a flowchart of a method for displaying flying device information shown according to an exemplary embodiment. Refer to Figure 3 , the flowchart of the above method for displaying flying device information may include the following steps.

[0072] Step S302, in the first information display area, arrange the phase identifiers of multiple flight phases of the flying device within a preset geographical range in sequence, and each flight phase corresponds to one or more air routes.

[0073] In some embodiments, the first information display area and the second information display area may be displayed in the terminal device. The first information display area and the second information display area may be displayed at different positions or the same position in the same display window, and may also be displayed in different display windows. The different windows may be displayed on different screens or the same screen, and the present disclosure does not limit this.

[0074] The above phase identifier may be one of the flight phase indication information and may be displayed through any identifier. For example, Figure 6 as shown, both identifier 603 and identifier 604 may be the phase identifiers in this application. The area before identifier 603 may represent the take-off phase of the flying device, the area between identifier 603 and identifier 604 may represent the level flight phase of the flying device, and the area after identifier 604 may represent the landing phase of the flying device.

[0075] In some embodiments, the phase identifiers of multiple flight phases of the flying device within a preset geographical range may be arranged in the order of the flight phases that the flying device has successively experienced during flight. Obviously, the flying device needs to first experience the take-off phase, then the level flight phase, and finally the landing phase. Therefore, as Figure 6 shown, identifier 603 needs to be arranged before identifier 604.

[0076] The preset geographical range may refer to a preset province, city, county, street, commercial area, community, etc., and the present application does not limit this.

[0077] In some embodiments, what is displayed in the first information display area may be the stage identifier corresponding to the flight stage within one, two, or more preset geographical ranges.

[0078] In some embodiments, there may be multiple preset geographical ranges in the first information display area, and the stage identifiers corresponding to the multiple preset geographical ranges are arranged horizontally or vertically in the first information display area. For example Figure 12 as shown, the stage identifier corresponding to the first geographical range, the stage identifier corresponding to the second geographical range, and the stage identifier corresponding to the third geographical range are displayed vertically.

[0079] In some embodiments, the stage identifiers of multiple flight stages within one geographical range may be arranged horizontally or vertically in the first information display area (as Figure 12 shown, the stage identifiers 1209, 1210, 1211, 1212, and 1203 are arranged horizontally).

[0080] In some embodiments, multiple air routes within the same flight stage may be arranged vertically. For example Figure 12 as shown, there are three air routes at the flight stage positions indicated by the stage identifiers 1209, 1210, 1211, 1212, or 1203, and the three air routes corresponding to each flight stage are arranged vertically.

[0081] In some embodiments, one stage identifier may correspond to one air route (as Figure 6 shown, the stage identifier 603 corresponds to one air route behind it), or may correspond to two air routes, or may also correspond to three air routes (as Figure 12 shown, the stage identifier 1209 corresponds to one air route in front of it and three air routes behind it), etc.

[0082] Step S304, in response to the monitoring instruction, display the dynamic identifier of the flight device at the associated position of the flight stage and the air route where the flight device is located.

[0083] The above-mentioned dynamic identifier may refer to an identifier whose position may change over time.

[0084] The above-mentioned monitoring instruction may refer to an instruction for monitoring a certain or certain flight devices. For example, in the scenario of using a drone for meal delivery, when the drone receives a delivery service, the corresponding execution entity of the present application will receive a monitoring instruction. However, the present application does not limit where the monitoring instruction specifically comes from and what it is.

[0085] Through the technical solutions provided by the above embodiments, it is possible to determine the flight route and flight phase of a flight device based on the position of the dynamic identifier of the flight device, simply and effectively highlighting important reference data for controlling the flight device, enabling the target object to timely understand the current flight phase and flight route of each flight device, so as to manage and control the flight device.

[0086] Figure 4 is a flowchart of a method for displaying flight device information shown according to an exemplary embodiment. Refer to Figure 4 The flowchart of the above method for displaying flight device information may include the following steps.

[0087] Step S402, in the first information display area, arrange the phase identifiers of multiple flight phases of the flight device within a preset geographical range in sequence, and each flight phase corresponds to one or more flight routes.

[0088] Step S404, in response to a monitoring instruction, display the dynamic identifier of the flight device at the associated position of the flight phase and flight route where the flight device is located.

[0089] Step S406, display the static identifier of the flight device within the target geographical range in a preset area in the first information display area.

[0090] In some embodiments, the above preset geographical range may include the target geographical range. In some embodiments, after responding to the monitoring instruction, the static identifier of the flight device within the target geographical range may also be displayed in a preset area in the first information display area. As Figure 14 shown, the device identifier of the flight device (such as identifier 3301 or identifier 3302 can be displayed at the lower left corner position of the first geographical range).

[0091] In some embodiments, the dynamic identifier and / or the static identifier can also be used to represent the monitoring state of the flight device, and the monitoring state includes a normal state, a selected state, and one or more abnormal states. Among them, the above normal state, selected state, and one or more abnormal states (such as device abnormality, device warning, etc.) can be displayed through different colors, backgrounds, etc., and the present application does not limit this.

[0092] In some embodiments, the selected state can be used to represent that the dynamic identifier and / or the static identifier has been subjected to a selection operation, and the abnormal state is used to represent that the flight device has an abnormality.

[0093] Next, the present disclosure will explain different flight phase indication information in conjunction with some embodiments.

[0094] In some embodiments, the flight phase indication information can be used to indicate the flight phase of a flight device when flying from a starting location to a destination. Then, displaying the flight phase indication information can include: displaying a starting location identifier corresponding to the starting location, a destination identifier corresponding to the destination, and a connection pattern between the starting location identifier and the destination identifier, where the connection pattern is segmented into a plurality of connection sub-patterns according to the flight phase corresponding to the flight of the flight device between the starting location and the destination, and the plurality of connection sub-patterns can be the plurality of flight phase indication information in the present application, and the plurality of connection sub-patterns are used to indicate the flight phase corresponding to the device when flying between the starting location and the destination.

[0095] Among them, the above-mentioned starting location and destination can be determined according to specific application scenarios. For example, in the scenario of an aircraft flight, the above-mentioned starting location can be the departure location of the aircraft, and the above-mentioned destination can be the destination of the aircraft; for another example, in the scenario of a drone delivering goods, the above-mentioned starting location can be the goods loading location of the drone, and the above-mentioned destination can be the goods unloading location of the drone; the present disclosure does not limit the above-mentioned starting location and destination, and those skilled in the art can determine the above-mentioned starting location and destination according to actual needs.

[0096] In some embodiments, the starting location identifier (or destination identifier) is used to represent the starting location (or represent the destination), and may or may not have geographical location information. The present disclosure does not limit this. For example, the starting location identifier and the destination identifier can be displayed on a map so that the starting location identifier and the destination identifier have geographical location information; the starting location identifier and the destination identifier can also not be displayed on a map. For example, they can be displayed in a blank area, so that the starting location identifier and the destination identifier do not have geographical location information. The present disclosure does not limit this.

[0097] It should be noted that the present application does not limit the specific form of each identifier (such as the starting location identifier or the destination identifier or the device identifier, etc.).

[0098] As Figure 6 shown, the starting location identifier 601 corresponding to the starting location, the destination identifier 602 corresponding to the destination, and the connection pattern between the starting location identifier 601 and the destination identifier 602 can be displayed (displayed in a non-map, such as at a blank position). The above-mentioned connection pattern can be a continuous line such as a straight line or a curve (not shown in the figure) as Figure 6 shown, or a connection pattern with a connection function such as a connection arrow or a connection rectangle or a connection triangle.

[0099] As Figure 6As shown, the connection pattern between the starting point identifier 601 and the destination 602 can be segmented according to the number of flight phases (such as the takeoff phase, the level flight phase, and the descent phase) (such as 3) of the flying device between the starting point and the destination, so as to obtain multiple connection sub-patterns (such as Figure 6 the connection line segments in area 1, the connection line segments in area 2, and the connection line segments in area 3 shown), and the above-mentioned multiple connection patterns can be used to indicate the corresponding flight phases when the flying device flies between the starting point and the destination. For example, through Figure 6 the connection line segments in area 1 in Figure 6 can indicate the takeoff phase of the flying device on the flight path, and through Figure 6 the connection line segments in area 2 in

[0100] can indicate the level flight phase on the flight path, and through Figure 6 the connection line segments in area 3 in Figure 6 can indicate the descent phase on the flight path.

[0101] It can be understood that, compared with displaying the connection pattern between the starting point and the destination on the map, Figure 6 in the embodiment shown, on the one hand, there is no need to carry the geographical location information of the starting point and the destination, and the information is displayed in a reduced-dimensional and concise manner; on the other hand, the starting point and the destination can be arranged according to actual needs, and multiple starting points and destinations can be displayed in one display area by arranging them side by side or in parallel. In short, through Figure 6 the information reduction display technical solution provided by the embodiment shown, the flight device information of multiple flying devices can be displayed in one display area, so as to concisely display the information of multiple flying devices at the same time in one display area and highlight the important reference information (such as the flight device status information and the flight phase information, etc.) in the flight device control process. Figure 6 in the embodiment shown, the connection sub-pattern corresponding to the descent phase, one end is connected to the second abort pattern (

[0102] the second vertical line after the starting point identifier 601 in

[0103] In some embodiments, the connection sub-pattern corresponding to the takeoff phase can be connected to the first abort pattern ( Figure 6 the first vertical line after the starting point identifier 601 in Figure 6 the second vertical line after the starting point identifier 601 in Figure 6 ), and the other end is connected to the destination identifier.

[0102] Through the above first abort pattern and second abort pattern, etc., the start or end of a flight phase can be clearly shown.

[0103] In some embodiments, the above flight phase indication information can also be used to indicate the flight phases on the flight route when the flight device departs from the starting point, passes through the stopover point(s), and then flies towards the destination.

[0104] Among them, the above starting point and destination can be determined according to specific application scenarios. For example, in the scenario of an aircraft flight, the above starting point can be the departure place of the aircraft, the stopover point can be the place where the aircraft lands during the flight, and the above destination can be the destination of the aircraft.

[0105] In some embodiments, the above stopover point(s) can be one, two, or more, and the present disclosure places no limitation thereon.

[0106] For example, in the scenario of drone delivery, the starting point can be the take-off airport of the merchant's drone, the destination can be the landing airport of the merchant's drone, and the stopover point can be the user airport corresponding to the user to be delivered. One merchant can deliver to multiple users. Therefore, a drone may stop at one, two, or more user airports where the users are located during a single flight; or a drone may only stop at one user airport where a user is located during a single flight, but different drones can stop at different user airports.

[0107] In some embodiments, if the flight device will pass through two or more stopover points in sequence when flying from the starting point to the destination, then those skilled in the art can Figure 6 expand the display scheme for the display of the flight phase indication corresponding to the flight device stopping at multiple stopover points during a single flight according to the

[0108] In some embodiments, if all flight devices flying from the starting point to the destination stop at the same stopover point, then the flight phase indication information can be displayed by the following method: displaying the starting point identifier corresponding to the starting point (such as Figure 7 the starting point identifier 701 shown), the stopover point identifier corresponding to the stopover point (such as Figure 7 the starting point identifier 702 shown), the destination identifier corresponding to the destination (such as Figure 7 the starting point identifier 703 shown), and the connection pattern between the starting point identifier, the stopover point identifier, and the destination identifier (such as Figure 7 the connection line connecting the starting point 701, the stopover point 702, and the destination 703 shown). The connection pattern is segmented into multiple connection sub-patterns according to the flight phases corresponding to the flight of the flight device between the starting point, the stopover point, and the destination. Among them, the multiple connection sub-patterns are respectively used to indicate the take-off phase at the take-off place corresponding to the flight device, the first level flight phase, the descent phase at the stopover point, the take-off phase at the stopover point, the second level flight phase, and the descent phase at the destination. As Figure 7 shown, through Figure 7The connecting line segments in area 1 in [the figure] can indicate the take-off phase at the departure location, through Figure 7 The connecting line segments in area 2 in [the figure] can indicate the first level flight phase, through Figure 7 The connecting line segments in area 3 in [the figure] can indicate the descent phase at the stopover location, through Figure 7 The connecting line segments in area 4 in [the figure] can indicate the take-off phase at the stopover location, through Figure 7 The connecting line segments in area 5 in [the figure] can indicate the second level flight phase, through Figure 7 The connecting line segments in area 6 in [the figure] can indicate the descent phase at the destination.

[0109] In some embodiments, if there are two stopover locations between the departure location and the destination, and a flying device only passes through one stopover location when flying from the departure location to the destination, and different flying devices can pass through different stopover locations when flying from the departure location to the destination, then the flight phase indication information can be displayed by the following method.

[0110] It should be noted that in this application, the route passing through different stopover locations between the departure location and the destination can be a sub-route, and the route between the departure location and the destination includes all sub-routes between the departure location and the destination.

[0111] It should be noted that the route and sub-route here are actually both routes, and the different names are only for distinguishing their relationships.

[0112] In some embodiments, the connection patterns displayed between the departure location and the destination can include a first connection pattern and a second connection pattern, the stopover locations between the departure location and the destination can include a first stopover location and a second stopover location, and the multiple connection sub-patterns can include a first connection sub-pattern and a second connection sub-pattern. Then the flight phase indication information can be displayed by the following method: display the first connection pattern (representing a sub-route, which can also be called a route) between the departure location identifier, the first stopover location identifier corresponding to the first stopover location, and the destination identifier, where the first connection pattern is divided into multiple first connection sub-patterns according to the flight phase of the flying device on the route where the first stopover location is located; display the second connection pattern (representing another sub-route) between the departure location identifier, the second stopover location identifier corresponding to the second stopover location, and the destination identifier, where the second connection pattern is divided into multiple second connection sub-patterns according to the flight phase of the flying device on the route where the second stopover location is located. Among them, the connection sub-patterns corresponding to the same flight phase of the sub-routes of the in-air flight are merged and displayed.

[0113] In some embodiments, if there are three stopover locations between the starting point and the destination, and a flying device only passes through one stopover location when flying from the starting point to the destination, and different flying devices can pass through different stopover locations when flying from the starting point to the destination, then the flight phase indication information can be displayed through Figure 8 the interface shown.

[0114] As Figure 8 shown, the stopover location identifiers corresponding to the three stopover locations can be displayed side by side between the starting point identifier and the destination identifier (such as the three stopover location identifiers indicated by 801 in Figure 8 ), and then three connection patterns are displayed between the starting point identifier and the destination identifier, where one connection pattern passes through one waypoint; then, according to the flight phases of the flying device between the starting point, the stopover locations, and the destination, the three connection patterns are respectively segmented to obtain a plurality of connection sub-patterns, and the connection sub-patterns on different sub-routes can indicate the flight phases on the corresponding sub-routes.

[0115] In some embodiments, when displaying the above-mentioned connection sub-patterns, the connection sub-patterns corresponding to the flight phases with the same air flight route (the flight direction may not be distinguished) can be merged and displayed. As Figure 8 shown, the air flight routes corresponding to the takeoff phases on the sub-routes where the three stopover locations are located may be the same, so the connection sub-patterns corresponding to the takeoff phases on the sub-routes where the three stopover locations are located can be merged and displayed (the present disclosure does not limit the specific merging method). By displaying the flight phase indication information through the above method, it can be clearly understood whether each flying device is on the same sub-route, avoiding affecting the normal flight of other flying devices on the same sub-route when controlling the flying device.

[0116] In some embodiments, the starting point takeoff phase indication information corresponding to the starting point takeoff phase (such as the connection sub-pattern in area 1 in Figure 7 ) can also be further divided according to the takeoff actions of the flying device at the takeoff point. For example, the takeoff actions of the flying device at the takeoff point may include the sub-phase of driving towards the airport and the sub-phase of taking off from the airport. Then, the Figure 7 takeoff phase indication information at the takeoff point can be divided into two parts (such as the part corresponding to area 7 and the part corresponding to area 8 in the identifier 901 shown in Figure 9 ), where one part (such as the connection line segment in area 7 shown in Figure 9 ) can be used to indicate the sub-phase of the flying device driving towards the airport, and the other part (such as the connection line segment in area 8 shown in Figure 9 ) indicates the sub-phase of the flying device taking off from the airport.

[0117] In some embodiments, the departure airport corresponding to the departure location can be one, two, or more. Then the departure location identifier corresponding to the departure location can also be one, two, or more.

[0118] In some embodiments, the departure location can include a first airport and a second airport. The departure location identifier can include a first airport identifier corresponding to the first airport in the departure location and a second airport identifier corresponding to the second airport in the departure location. Then, the first airport identifier (such as Figure 7 one of the identifiers in 1001 as shown) and the second airport identifier (such as Figure 10 the other identifier in 1001 as shown) can be displayed at the position where the departure location identifier (such as Figure 10 the departure location identifier 701) is located. Then, it is shown that the first airport identifier and the second airport identifier are respectively connected to the destination identifier through a connection pattern, and the above connection pattern can be segmented according to the flight phase of the flying device.

[0119] In some embodiments, when displaying the above connection sub-patterns, the connection sub-patterns corresponding to the flight phases with the same in-air flight route can be merged and displayed. For example, except for the in-air routes corresponding to the takeoff phase, the routes corresponding to the other flight phases of the sub-route where the first airport is located and the sub-route where the second airport is located are all the same. Therefore, the connection sub-patterns corresponding to the other flight phases except the takeoff phase at the departure location can be merged and displayed, and the display effect is as Figure 10 shown.

[0120] Through the above method, not only are the different takeoff phases on the driving sub-routes corresponding to different airports distinguished and displayed, but also the connection sub-patterns of the flight phases with the same in-air flight route are merged and displayed. This enables the target object to not only timely understand which flying devices have the same in-air flight route, but also timely distinguish the flying devices on different sub-routes, so as to control the flying devices according to the in-air routes and the sequence of the flying devices.

[0121] In some embodiments, in an application scenario, the departure location can correspond to multiple airports, and there can be multiple stopover locations between the departure location and the destination. Then, by combining the technical solutions corresponding to scenarios such as the departure location having multiple airports and there being multiple stopover locations between the departure location and the destination, a schematic diagram of flight phase indication information as Figure 11 shown can be obtained. In Figure 11In the shown schematic diagram, there can be two airport identifiers at the starting point (such as the two solid circles indicated by 1101), one destination identifier at the destination (such as the one solid circle indicated by 1102), and three stopover points can exist between the starting point and the destination (such as the three rectangles indicated by 1103); among them, the connection patterns between the starting point, the stopover points, and the destination are segmented according to the flight phases of the flying device between the starting point and the destination; in addition, the connection sub-patterns corresponding to the flight phases with the same air flight route are also merged and displayed.

[0122] Through the above display method, on the one hand, the flight sub-routes, flight phases, etc. of the flying device can be refined and prominently displayed. In addition, when displaying the flight phases, the connection sub-patterns corresponding to the flight phases with the same air flight route are also merged and displayed, so that when displaying the flight phases of the flying device, the spatial relationship of the flying devices on the same sub-route can be displayed, avoiding affecting other flying devices that are relatively close when controlling the flying device.

[0123] It should be noted that the above Figures 6 to 11 Region 1 (2, 3...) and the corresponding shaded part are marked for the convenience of explaining the technical solution and can be not displayed in the actual application process.

[0124] In some embodiments, the above flight phase indication information can be displayed according to the different geographical location ranges of the air routes. In some embodiments, the geographical range in the present disclosure can be a country, a province, a city, a street, a business district, etc., and those skilled in the art can determine according to their own needs.

[0125] In some embodiments, the first information display area can include a first geographical display sub-area corresponding to a first geographical range and a second geographical display sub-area corresponding to a second geographical range, and the air route of the flying device can include a first air route and a second air route. Among them, one starting point and one destination can include one air route, and this one air route can further include multiple sub-routes. As Figures 6 to 11 shown, there is only one air route between one starting point and one destination, and this one air route can include one, two or multiple sub-routes. One air route corresponds to one starting point and one destination, and different sub-routes pass through different stopover points.

[0126] In some embodiments, displaying the flight phase indication information may include: if the first route is within the first geographical scope and the second route is within the second geographical scope, then displaying the flight phase indication information corresponding to the first route and / or the flight environment information within the first geographical scope in the first geographical display sub-area, and displaying the flight phase indication information corresponding to the second route and / or the flight environment information within the second geographical scope in the second geographical display sub-area. If both the first route and the second route are within the first geographical scope, then displaying the flight phase indication information corresponding to the first route and the flight phase indication information corresponding to the second route and / or the flight environment information within the first geographical scope in the first geographical display sub-area.

[0127] like Figure 12 As shown, the flight phase indication information in different routes can be displayed in different geographical ranges. For example, the display sub-area corresponding to the first geographical range (such as Figure 12 The flight phase indication information on the route within the first geographical scope is displayed in the area corresponding to the name of the first geographical scope in the first geographical scope (such as Figure 12 The route indicated by 1201 in the Figure 12 As shown in 1205, the name corresponding to the geographical range can be displayed in the display sub-area; the display sub-area corresponding to the second geographical range (such as Figure 12 The flight phase indication information on the route within the second geographical scope is displayed in the area corresponding to the name of the second geographical scope in the second geographical scope (such as Figure 12 The flight phase indication information on the route within the third geographical range can be displayed in the display sub-area corresponding to the third geographical range, wherein there can be multiple routes within the third geographical range (such as Figure 12 The routes indicated by 1203 and the routes indicated by 1204, where the routes with different starting points can be displayed separately); and so on.

[0128] In some embodiments, the display sub-area corresponding to the geographical range can also display the weather corresponding to the geographical range, such as by Figure 12 The location indicated by 1207 displays the weather information within the second geographical range.

[0129] By displaying weather information, one can timely understand the weather conditions within a geographical area, thereby assisting in deciding how to control flight equipment. For example, in severe weather conditions, one can take over control of flight equipment within the geographical area.

[0130] In some embodiments, a display sub-area corresponding to a geographic range may also display a commute control (eg, Figure 12The control indicated by 1206 in the figure. Through this commuting control, it can be determined whether to display the flight device information within the geographical range. If the commuting control is in the off-work state, the flight devices within the corresponding geographical range will not be displayed.

[0131] The present disclosure also proposes to merge and display the connection sub-patterns corresponding to the flight phases with the same sub-routes in the air (this flight sub-route can ignore the flight direction and only consider the spatial route; if the flight directions of two sub-routes are opposite but the flight trajectories in the air are the same, they can also be considered as the same flight route in the air). It can be understood that when there is a stopover between the starting point and the destination, then the descent phase and the takeoff phase at the stopover corresponding to the flight device are completed within the same space. Then, there may be an impact between the flight devices taking off or descending within this space. For example, the Figure 12 connection sub-patterns corresponding to the descent phase and the takeoff phase at the stopover in the figure (such as Figure 12 the connection sub-pattern at the position indicated by 1208 in the figure) can be merged to generate a new connection sub-pattern for display (for example, it can be merged into the pattern shown in Figure 13 1301 in the figure). Thus, when controlling the flight device in the takeoff phase (or the descent phase at the stopover), not only the flight devices in the takeoff phase at the stopover will be considered, but also the flight devices in the descent phase at the stopover will be considered, so as to avoid affecting the normal flight of other flight devices in the space where a certain flight device is located when controlling a certain flight device and avoid the occurrence of flight accidents.

[0132] Next, the present disclosure will explain how to display the device identifier of the flight device in combination with Figure 5 or Figure 13 the flight phase indication information shown. Those skilled in the art can replace the flight phase indication information in the following embodiments with other flight phase indication information (such as Figures 5 to 13 any kind of flight phase indication information), and the present disclosure does not limit this.

[0133] In some embodiments, if the current flight phase of a flight device is the takeoff phase. Then, the device identifier of the flight device (such as the device identifier 3301) can be displayed in the box of the takeoff phase shown in Figure 5 the figure; the device identifier of the flight device can also be displayed near the line segment in area 1 shown in Figure 6 the figure (used to indicate the takeoff phase); the device identifier of the flight device can also be displayed before the phase identifier 603 shown in Figure 6 the figure, and so on. The present disclosure will not elaborate further.

[0134] In some embodiments, when displaying the device identifier of a flight device, the current flight route of the flight device may also be considered, and the device identifier of the current device is displayed at a position corresponding to the current flight phase of the current flight route of the flight device.

[0135] In some embodiments, as Figure 14 shown, if the flight devices indicated by 1403 and 1404 are in different flight phases of the same flight route, then the device identifier indicated by 1403 and the device identifier indicated by 1404 may be displayed at the positions of the different flight phase indication information shown in Figure 14 ; for another example, as Figure 14 shown, if the flight devices indicated by 1401 (or 1402) and 1403 (or 1404) are on different flight routes, then the device identifiers corresponding to 1401 (or 1402) and 1402 (or 1404) may be displayed on the different flight routes shown in Figure 14 .

[0136] In some embodiments, the flight devices may be displayed at an associated position of the flight phase indication information corresponding to the same flight phase in the order in which the flight devices enter the same flight phase.

[0137] For example, the flight devices may include a second flight device and a third flight device. Then, displaying the device identifiers of the flight devices at an associated position of the flight phase indication information corresponding to the current flight phase of the flight devices may include: if the current flight routes and the current flight phases of the second flight device and the third flight device are the same, then at an associated position of the current flight phase on the current flight route, the device identifiers of the second flight device and the third flight device are displayed in the order in which they enter the current flight phase. For example, the device identifier of the second flight device may be displayed before the device identifier of the third flight device. For example, as Figure 14 shown, the flight device represented by the device identifier indicated by 1404 enters the current driving phase of the current flight route (i.e., the second level flight phase corresponding to the second stop) before the flight device represented by the device identifier indicated by 1403, then on the current driving phase of the current flight route, the device identifier indicated by 1404 is located in front of the device identifier indicated by 1403.

[0138] Through the above display method, the device identifier of the flight device that first enters the current driving stage during the actual flight process can also be displayed in the front. Thereby enabling the target object to understand the relative spatial position of the flight device based on the front and rear positions of the device identifier of the flight device, and then determining which flight device to take over and control according to the relative position of the flight device. For example, assuming that device identifier 1 and device identifier 2 are displayed at the associated position of the flight stage indication information corresponding to the same takeoff stage, and device identifier 1 is in front of device identifier 2, it can be determined that the flight device corresponding to device identifier 1 takes off earlier than the flight device corresponding to device identifier 2. When controlling the flight devices corresponding to device identifier 1 and device identifier 2, it can be considered to first control the flight device corresponding to device identifier 2 to avoid affecting the flight device corresponding to device identifier 1 when controlling the flight device corresponding to device identifier 2.

[0139] Through the display method provided in this embodiment, multiple flight devices can be managed simultaneously, the current flight route and current flight stage of the flight devices can be accurately identified, as well as the sequence of each flight device in the same route and the same flight stage, so as to control the flight devices.

[0140] The current UAV management solution is to lay the motion trajectories of UAVs on a two-dimensional map, and judge whether the UAVs are working properly by observing these trajectories and the warning information of the UAVs. However, this solution has obvious limitations. Users can only observe a limited number of UAVs, and cannot intuitively grasp the flight stages of the UAVs. This embodiment adopts a dimensionality reduction design, enabling the target object to manage multiple UAVs simultaneously. At the same time, this embodiment also splits the operation stages of the UAVs, enabling the target object to accurately identify the flight stages of the UAVs, and facilitating the target object to focus on the required flight stages and the sequence between different flight devices in the same flight stage.

[0141] Figure 15 It is a flowchart of a method for displaying control reference information of a flight device shown according to an exemplary embodiment. Refer to Figure 15 In the method shown above, the above method for displaying control reference information may include the following steps.

[0142] Step S1502: Display flight phase indication information, which is used to indicate the flight phase of the flight device in the route. Step S1504: At the associated position of the flight phase indication information corresponding to the current flight phase of the flight device that has obtained the flight mission, display the device identifier of the flight device according to the current flight state of the flight device. Step S1506: In response to a trigger operation on the device identifier of the target flight device in the first information display area, display the control reference information of the target flight device in the second information display area, so as to control the target flight device according to the control reference information of the target flight device.

[0143] In some embodiments, a first information display area and a second information display area may be displayed in the terminal device. The first information display area and the second information display area may be displayed at different positions or the same position in the same display window, and may also be displayed in different display windows. The different windows may be displayed on different screens or the same screen. The present disclosure does not limit this.

[0144] In some embodiments, the above-mentioned flight phase indication information and the device identifier of the flight device may be displayed in the first information display area. The control reference information of the above-mentioned flight device may be displayed in the second information display area (such as Figure 17 in the area shown).

[0145] Figure 16 is a flowchart of a method for displaying flight device information shown according to an exemplary embodiment. Refer to Figure 16 The above-mentioned method for displaying flight device information may include the following steps. Step S1602: In the first information display area, arrange the phase identifiers of multiple flight phases of the flight device within a preset geographical range in sequence, and each flight phase corresponds to one or more routes. Step S1604: In response to a monitoring instruction, display the dynamic identifier of the flight device at the associated position of the flight phase and route where the flight device is located. Step S1606: In the second information display area, display one or more of the global panel, monitor panel, system information panel, flight device status panel, and remote control component in blocks; wherein, the global panel is used to display a two-dimensional map of the selected geographical range, the monitor panel is used to display the video transmission data of the selected flight device, the system information panel is used to display the flight device notification information, the flight device status panel is used to display the status parameters of the flight device, and the remote control component is used to take over the control of the selected flight device.

[0146] such as Figure 17As shown, in the second information display area, one or more of the overall panel (such as the trajectory display area), the monitor panel (such as the flight device monitoring information display area), the system information panel (such as the system communication information panel), the flight device status panel (such as the flight device status panel), and the remote control component (such as the components in the remote instruction control panel) are displayed in blocks; among them, the overall panel is used to display a two-dimensional map of the selected geographical range, the monitor panel is used to display the video transmission data of the selected flight device, the system information panel is used to display the flight device notification information, the flight device status panel is used to display the status parameters of the flight device, and the remote control component is used to take over the control of the selected flight device.

[0147] In some embodiments, in response to a selection operation on the dynamic identifier or static identifier of the target flight device, the video transmission data of the target flight device can also be displayed on the monitor panel, and the dynamic flight trajectory of the flight devices within the selected geographical range can be displayed in the two-dimensional map.

[0148] In some embodiments, the layout of the above-mentioned second information display area can be as Figure 17 shown, but any layout that can display the control reference information is within the protection scope of the present disclosure. In some embodiments, information can be pre-filled in Figure 17 to generate the schematic diagram as Figure 18 shown. Figure 18 is a schematic diagram of an interface when no display task is received according to an exemplary embodiment. In the interface as Figure 18 shown, a geographical range name display area indicated by 1801, a meteorological information display area within the geographical range indicated by 1802, a device status display area indicated by 1803, a map indicated by 1804, a no-fly area in the map indicated by 1805, a no-parking area in the map indicated by 1806, an unactivated control control indicated by 1807, etc. can be displayed. Areas with no information temporarily can be displayed empty.

[0149] In some embodiments, the flight device can include the target flight device. In some embodiments, the flight device in the first information display area can be triggered to view the control reference information of the flight device for controlling the flight device.

[0150] Among them, the control reference information of the target flight device can be information that can play a reference role when controlling the target flight device. The control reference information of the target flight device can include the information of the target flight device, or can also include information other than the target flight device. The present disclosure does not limit this.

[0151] In some embodiments, the terminal device may, in response to a trigger operation on the device identifier of the target flying device in the first information display area, display control reference information of the target flying device within a second information display area (as shown in Figure 18 ), and the specific display effect may refer to the schematic diagram shown in Figure 20 ), so as to control the target flying device according to the control reference information of the target flying device.

[0152] In some embodiments, the control reference information of the target flying device may include flight trajectory information of the target flying device displayed on a map within the second information display area, and / or multimedia information collected by the target flying device displayed in the second information display area, and / or device status information of the target flying device displayed in the second information display area.

[0153] Figure 19 is a flowchart of a method for displaying flying device information according to an exemplary embodiment. Referring to Figure 19 , the above method for displaying flying device information may include the following steps. Step S1902: In the first information display area, arrange in sequence the stage identifiers of multiple flight stages of the flying device within a preset geographical range, and each flight stage corresponds to one or more air routes. The above preset geographical range may include a target geographical range. Step S1904: In response to a monitoring instruction, display the dynamic identifier of the flying device at an associated position of the flight stage and air route where the flying device is located. Step S1906: Display the static identifier of the flying device within the target geographical range in a preset area in the first information display area. Step S1908: In response to a selection operation on the dynamic identifier or static identifier of the target flying device, display status information and / or a control status switching control of the target flying device in the first information display area, and the status information includes one or more of device model, task type, flight status, take-off time, starting airport, and control status.

[0154] As shown in Figure 23 , status information and / or a control status switching control (such as "takeover" control 2301) of the target flying device may be displayed in the first information display area, and the status information includes one or more of device model, task type, flight status, take-off time, starting airport, and control status.

[0155] Step S1910: In response to a trigger operation on the control status switching control, switch the control status of the target flying device.

[0156] In some embodiments, switching the control state of the target flying device includes switching the control state of the target flying device to a takeover state. When responding to a triggering operation on the control state switching control, it further includes: activating the control of the target flying device by the remote control component (such as activating the remote control components of the target device in Figure 20 , such as the "landing" and "hovering" control components). Figure 20 in the target device's remote control component).

[0157] In some embodiments, after the device identifier of the target flying device is triggered in the first information display area, Figure 20 the control reference information of the target flying device can be displayed in the displayed interface as shown.

[0158] Such as Figure 20 shown, the multimedia information collected by the target flying device can be displayed at the position indicated by 2001 (such as the video collected by the video collector during the flight of the flying device, etc.); the device status information corresponding to the target flying device can be displayed at the position indicated by 2002; the activated control controls or unactivated control controls can be displayed at the position indicated by 2003, where the activated control controls can be used to control the target flying device; the warning information of the target flying device can be displayed at the position indicated by 2004; the "start takeover" control can be displayed at the position indicated by 2005, and the target flying device can be taken over and controlled through the "start takeover control"; the meteorological information within the geographical range where the target flying device is located can be displayed at the position indicated by 2006; the flight trajectories of the flying devices within the geographical range where the target device is located can be displayed on the map, such as the flight trajectory of the target flying device indicated by 2007 and the flight trajectory of another flying device within the geographical range where the target flying device is located indicated by 2008.

[0159] In some embodiments, the flying device may further include a plurality of first flying devices, and the plurality of first flying devices and the target flying device may be set to fly within the same geographical range.

[0160] Among them, in response to a triggering operation on the device identifier of the target flying device in the first information display area, displaying the control reference information of the target flying device in the second information display area includes: in response to a triggering operation on the device identifier of the target flying device in the first information display area, displaying the control reference information of the target flying device and at least part of the control reference information of the first flying device in the second information display area, so as to control the target flying device according to at least part of the control reference information of the first flying device and the control reference information of the target flying device.

[0161] In some embodiments, at least part of the control reference information of the first flying device may include the flight trajectory information of the first flying device displayed in the map of the second information display area.

[0162] As Figure 20 shown, the flight trajectory of the selected target flight device (such as the flight trajectory indicated by 2007) can be displayed in a selected state (for example, by displaying the selected state in a dark color), and the flight trajectory of the unselected first flight device (such as the flight trajectory indicated by 2008) can be displayed in an unselected state (for example, by displaying the selected state in a light color).

[0163] In some embodiments, the control reference information of the target flight device displayed in the second information display area can be switched to the control reference information of the first flight device by triggering the flight trajectory of the first device in the map of the second information display area. The control reference information of the target flight device displayed in the second information display area can also be switched to the control reference information of the first flight device by triggering the device identifier of the first flight device in the first information display area.

[0164] In some embodiments, the terminal device can, in response to a trigger operation on the flight trajectory information of the first flight device in the second information display area, display the control reference information of the first flight device in the second information display area, and in the map, change the flight trajectory information of the first flight device from an unselected state to a selected state display, and change the flight trajectory information of the target flight device from a selected state to an unselected state display.

[0165] In some embodiments, the terminal device can, in response to a trigger operation on the device identifier of the first flight device in the first information display area, display the control reference information of the first flight device in the second information display area, and in the map, change the flight trajectory information of the first flight device from an unselected state to a selected state display, and change the flight trajectory information of the target flight device from a selected state to an unselected state display.

[0166] In some embodiments, remote control controls of the flight device (such as Figure 20 the alternate landing control control, hover control control, parachute opening control control, etc. indicated by 2003 in) can be displayed in the second information display area.

[0167] In some embodiments, when the device identifier corresponding to the target flight device is triggered, the control controls in the second information display area can be activated or not activated ( Figure 20 what is shown is the unactivated control control).

[0168] Among them, the triggered target flight device can be controlled through the activated control control.

[0169] In some embodiments, the takeover control for the target flight device in the second information display area can be triggered (such as the "Start Takeover" control indicated by Figure 20 2005 in Figure 21 to activate the control control, so as to control the triggered target flight device through the control control. The control control can also be activated by the method shown in

[0170] Figure 21 is a flowchart of a method for activating a control control according to an exemplary embodiment. Referring to Figure 21 , the above method for activating a control control may include the following steps. Step S2102, display an inactive control control in the second information display area. Step S2104, in response to a trigger operation on the device identifier of the target flight device, display the takeover control of the target flight device in the first information display area.

[0171] Figure 22 is a flowchart of a method for displaying flight device information according to an exemplary embodiment. Referring to Figure 22 , the above method for displaying flight device information may include the following steps. Step S2202, in the first information display area, arrange the stage identifiers of multiple flight stages of the flight device within a preset geographical range in sequence, and each flight stage corresponds to one or more flight routes. Step S2204, in response to a monitoring instruction, display the dynamic identifier of the flight device at the associated position of the flight stage and flight route where the flight device is located. Step S2206, in the second information display area, display one or more of the overall panel, monitor panel, system information panel, flight device status panel, and remote control component in blocks; wherein, the overall panel is used to display a two-dimensional map of the selected geographical range, the monitor panel is used to display the video transmission data of the selected flight device, the system information panel is used to display flight device notification information, the flight device status panel is used to display the status parameters of the flight device, and the remote control component is used to take over the control of the selected flight device. Step S2208, in response to a selection operation on the dynamic identifier or static identifier of the target flight device, display the status information and / or control status switching control of the target flight device in the first information display area, and the status information includes one or more of the device model, task type, flight status, takeoff time, starting airport, and control status. Step S2210, when responding to a selection operation on the dynamic identifier or static identifier of the target flight device, display the video transmission data of the target flight device on the monitor panel and display the dynamic flight trajectory of the flight device within the selected geographical range in the two-dimensional map. Step S2212, in response to a trigger operation on the control status switching control, switch the control status of the target flight device and activate the control of the target flight device by the remote control component.

[0172] Next, the present disclosure will explain and illustrate the flight device information display method proposed in the present disclosure in combination with the application scenario of drone (a flight device) delivery.

[0173] In some embodiments, there are multiple flight devices, and the flight devices may include a target flight device. The method may further include: in response to a selection operation on the dynamic identifier or static identifier of the target flight device, displaying the status information and / or control status switching control of the target flight device in the first information display area, where the status information includes one or more of device model, task type, flight status, takeoff time, starting airport, and control status.

[0174] In some embodiments, the above flight device information display method may include: in response to a trigger operation on the control status switching control, switching the control status of the target flight device.

[0175] In some embodiments, the target object may trigger the target flight device identifier in the first information display area, and then the terminal device, in response to the trigger operation on the device identifier of the target flight device, may display the takeover control of the target flight device in the first information display area. As Figure 23 shown, if the device identifier 3302 is triggered, the status information and / or control status switching control (such as the control indicated by Figure 2301) of the flight device corresponding to the device identifier 3302 may be displayed.

[0176] In some embodiments, after triggering the "takeover" control, in response to the trigger operation of the "takeover" control, a "confirm takeover" control indicated by 2401 as Figure 24 shown will also be displayed.

[0177] The target object may trigger the takeover control (or the "takeover" control as Figure 23 shown, or the "confirm takeover control" as Figure 24 shown) in the first information display area; the terminal device, in response to the trigger operation on the takeover control, causes the device identifier of the target flight device in the first information display area to be displayed in a taken-over state (as Figure 25 shown, a "+" identifier appears in the upper right corner of the device identifier indicated by 2501, and this "+" identifier represents that the flight device corresponding to the device identifier indicated by 2501 has been taken over), and causes the control controls in the second information display area to be converted from a non-activated state ( Figure 20 in which 2003 indicates an activated control control) to an activated state ( Figure 26 in which 2601 indicates an activated control control), so as to use the activated control controls to control the target flight device.

[0178] In some embodiments, triggering the device identifier of the flight device being taken over in the first information display area may also display an "End Takeover" control for the flight device being taken over (such as Figure 27 the "End Takeover" control indicated by 2701 in

[0179] Figure 28 . Through this "End Takeover" control, the takeover of the flight device can be ended, and at the same time, the control control corresponding to the flight device whose takeover has ended is switched from the activated state to the non-activated state. Figure 28 is a flowchart of a method for displaying unmanned aerial vehicle device information according to an exemplary embodiment. Referring to

[0180] Step S2802, waiting for a task.

[0181] In some embodiments, waiting for a task may refer to waiting for the unmanned aerial vehicle to receive a task. When the unmanned aerial vehicle receives a flight delivery task, the terminal device will receive a display task for the unmanned aerial vehicle that has received the delivery task. In some embodiments, the interface for managing the unmanned aerial vehicle can be divided into a main screen and a secondary screen. During the waiting task stage (when the unmanned aerial vehicle is waiting for a delivery task), the main screen is displayed as Figure 18 shown, and the secondary screen is displayed as Figure 13 shown. In the main screen (as Figure 18 shown), the meteorological data, virtual resources (no-fly zones, no-parking zones, etc.), airport facilities, etc. of the currently selected business district (a business district can be a geographical area) are displayed, and the parts without data are displayed as empty.

[0182] In the secondary screen, the business districts that the target object needs to manage are tiled for display so that the user can manage multiple unmanned aerial vehicles in different business districts at the same time. The secondary screen adopts the idea of dimensionality reduction design and designs the flight path of the unmanned aerial vehicle in a two-dimensional manner. The specific rule is to draw the flight path map of the unmanned aerial vehicle in each business district in chronological order (for example, the chronological order of reaching a certain flight stage) and split the flight path into different stages. As Figure 13 shown, there can be one, two, or more flight paths in a business district. One flight path can be divided into multiple sub-flight paths, and each sub-flight path can be divided into the takeoff and ascent stage of the unmanned aerial vehicle from the merchant airport, the level flight stage of the unmanned aerial vehicle, the precise descent stage of the unmanned aerial vehicle to the user airport, the takeoff and ascent stage of the unmanned aerial vehicle from the user airport, the level flight stage of the unmanned aerial vehicle, and the precise descent stage of the unmanned aerial vehicle to the merchant airport. In some embodiments, in the three-stage meal delivery mode, the takeoff and ascent stage of the unmanned aerial vehicle from the merchant airport can be further divided into the meal pickup stage and the ascent stage of the unmanned aerial vehicle. Through this splitting method, more precise unmanned aerial vehicle flight stage management services can be provided for the target object.

[0183] Step S2804, displaying unmanned aerial vehicle information.

[0184] When the drone receives a flight delivery task, the terminal device will receive a drone information display task of the drone that has accepted the delivery task. When receiving the drone information display task, the main screen will be displayed as shown in Figure 14 shown, and the secondary screen will be displayed as shown in Figure 20 shown. As shown in Figure 20 shown, the display area on the secondary screen can be divided into 6 areas. Area 1 is the trajectory display area, which renders elements such as drones and flight routes in the currently selected business district; Area 2 is the display area for flight device monitoring information, which displays real-time video transmission information of the drone and supports operations such as switching drones; Area 3 is the system communication information panel, which displays drone alerts and drone notification information; Area 4 is the flight device status panel, which displays various status parameter information of the drone; Area 5 is the remote command control panel, which integrates drone control commands; Area 6 is the account / title panel, which displays personal information, etc. The secondary screen displays the actual operation situation of the drone in each business district, where the drone includes a selected state (green), an abnormal state (the drone has a type I alert (red) or a type II alert (yellow)).

[0185] Step S2806, determine whether the drone is abnormal?

[0186] According to the device identifier of the drone, if it is determined that there is no abnormal drone, loop to execute step S2804.

[0187] If it is determined according to the device identifier of the drone that there is a drone with a flight anomaly, execute step S2808 to take over the abnormal drone.

[0188] In some embodiments, the target object can select a certain drone by clicking on the static identifier or dynamic identifier in the drone list on the secondary screen to view the detailed information of the drone, and at the same time connect the video transmission of the selected drone to the main screen for display. When the drone is in an abnormal state, it can be discovered and selected for takeover in a timely manner through the secondary screen, and the drone can be operated on the main screen after takeover.

[0189] In some embodiments, if it is determined according to the identifier corresponding to the drone that a certain drone has an anomaly (it can be an anomaly of the device, an anomaly of the trajectory, or an anomaly of the weather), then it can be decided whether to take over the abnormal drone by combining the flight stage of the drone and the sequence of multiple drones in this flight stage, etc.

[0190] After taking over the drone, the user can issue commands to the current drone to ensure the safe landing of the drone. After the drone lands safely, the takeover can be exited to end the management process of this drone.

[0191] In the above-mentioned embodiment, on the one hand, the route map is split and displayed using the flight stage, and the drone information is displayed by dimensionality reduction, so that the flight stage information of multiple drones can be displayed simultaneously in the secondary screen, which is convenient for monitoring the drones in combination with the identification status and flight stage of the drones and determining which drone to focus on or control in combination with the identification status and flight stage of the drones; on the other hand, by using a multi-screen approach to manage the drone fleet, the main screen can display the detailed information of the selected drone according to the operation in the secondary screen, so that the target object can control the drone according to the detailed information of the drone in the main screen.

[0192] Based on the same inventive concept, the disclosed embodiment also provides a flight equipment information display device, such as the following embodiment. Since the principle of solving the problem in the device embodiment is similar to that in the above method embodiment, the implementation of the device embodiment can refer to the implementation of the above method embodiment, and the repeated parts will not be repeated.

[0193] Figure 29 is a block diagram of a flight equipment information display device according to an exemplary embodiment. Figure 29 The flight equipment information display device 2900 provided in the embodiment of the present disclosure may include: a stage identification display module 2901 and a dynamic identification display module 2902.

[0194] Among them, the stage identification display module 2901 can be used to sequentially arrange the stage identifications of multiple flight stages of the flight equipment within a preset geographical range in the first information display area, and each flight stage corresponds to one or more routes; the dynamic identification display module 2902 can be used to respond to monitoring instructions and display the dynamic identification of the flight equipment at the associated position of the flight stage and route of the flight equipment.

[0195] In some embodiments, there are multiple preset geographical ranges, and the stage identifiers corresponding to the multiple preset geographical ranges are arranged horizontally or vertically in the first information display area; the stage identifiers of multiple flight stages are arranged horizontally or vertically in the first information display area; and the multiple routes in the same flight stage are arranged vertically.

[0196] In some embodiments, the flight equipment information display device 2900 may further include: a static identification display module.

[0197] In some embodiments, the preset geographic range includes a target geographic range.

[0198] The static identification display module may be used to display the static identification of the flying equipment within the target geographical range in a preset area in the first information display area after responding to the monitoring instruction.

[0199] In some embodiments, the dynamic identifier and / or the static identifier are also used to characterize the monitoring status of the flight device, and the monitoring status includes a normal state, a selected state, and one or more abnormal states; wherein, the selected state is used to characterize that the dynamic identifier and / or the static identifier are subjected to a selection operation, and the abnormal state is used to characterize that the flight device has an abnormality.

[0200] In some embodiments, there are multiple flight devices, and the flight devices include the target flight device. The flight device information display device 2900 may further include: a flight status information display module.

[0201] Among them, the flight status information display module can be used to respond to a selection operation on the dynamic identifier or the static identifier of the target flight device, and display the status information of the target flight device and / or a control status switching control in the first information display area. The status information includes one or more of the device model, task type, flight status, takeoff time, starting airport, and control status.

[0202] In some embodiments, the flight device information display device 2900 may further include: a control status switching module.

[0203] Among them, the control status switching module can be used to respond to a trigger operation on the control status switching control and switch the control status of the target flight device.

[0204] In some embodiments, the flight device information display device 2900 may further include a second information display area display module.

[0205] Among them, the second information display area display module can be used to, in response to a monitoring instruction, display one or more of a full panel, a monitor panel, a system information panel, a flight device status panel, and a remote control component in the second information display area in a segmented manner; wherein, the full panel is used to display a two-dimensional map of a selected geographical range, the monitor panel is used to display the video transmission data of a selected flight device, the system information panel is used to display flight device notification information, the flight device status panel is used to display the status parameters of the flight device, and the remote control component is used to take over the control of the selected flight device.

[0206] In some embodiments, the flight device information display device 2900 may further include a video transmission information display module.

[0207] Among them, the video transmission information display module can be used to, when responding to a selection operation on the dynamic identifier or the static identifier of the target flight device, display the video transmission data of the target flight device on the monitor panel and display the dynamic flight trajectory of the flight device within the selected geographical range on the two-dimensional map.

[0208] In some embodiments, switching the control state of the target flying device includes switching the control state of the target flying device to the takeover state. When responding to the triggering operation on the control state switching control, it further includes: activating the control of the target flying device by the remote control component.

[0209] Since the functions of the device 2900 have been described in detail in their corresponding method embodiments, the present disclosure will not elaborate herein.

[0210] Figure 30 The structural schematic diagram of the electronic device suitable for implementing the embodiments of the present disclosure is shown. It should be noted that, Figure 30 The shown electronic device 3000 is only an example and should not impose any limitation on the functions and usage scope of the embodiments of the present disclosure.

[0211] As Figure 30 shown, the electronic device 3000 includes a central processing unit (CPU) 3001, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 3002 or the program loaded from the storage section 3008 into the random access memory (RAM) 3003. In the RAM 3003, various programs and data required for the operation of the electronic device 3000 are also stored. The CPU 3001, ROM 3002, and RAM 3003 are connected to each other via a bus 3004. The input / output (I / O) interface 3005 is also connected to the bus 3004.

[0212] The following components are connected to the I / O interface 3005: an input portion 3006 including a keyboard, a mouse, etc.; an output portion 3007 including, for example, a cathode ray tube (CRT), a liquid crystal display (LCD), etc. and a speaker, etc.; a storage portion 3008 including a hard disk, etc.; and a communication portion 3009 including a network interface card such as a LAN card, a modem, etc. The communication portion 3009 performs communication processing via a network such as the Internet. A drive 3010 is also connected to the I / O interface 3005 as required. A removable medium 3011, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 3010 as required so that the computer program read from it can be installed into the storage portion 3008 as required.

[0213] In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, an embodiment of the present disclosure includes a computer program product that includes a computer program carried on a computer-readable storage medium, and the computer program includes computer program instructions for performing the methods shown in the flowcharts. In such an embodiment, the computer program can be downloaded and installed from a network through the communication section 3009 and / or installed from the removable medium 3011. When the computer program is executed by the central processing unit (CPU) 3001, the above-described functions defined in the system of the present disclosure are performed.

[0214] As another aspect, the present disclosure also provides a computer-readable storage medium, which may be included in the device described in the above embodiment; or may exist separately without being assembled into the device. The above computer-readable storage medium carries one or more programs, and when the one or more programs are executed by the device, the functions that the device can implement include: arranging the stage identifiers of multiple flight stages of the flying device within a preset geographical range in sequence in the first information display area, and each flight stage corresponds to one or more air routes; in response to a monitoring instruction, displaying the dynamic identifier of the flying device at the associated position of the flight stage and air route where the flying device is located.

[0215] According to one aspect of the present disclosure, there is provided a computer program product or a computer program, which includes computer program instructions stored in a computer-readable storage medium. Reading the computer program instructions from the computer-readable storage medium, and the processor executes the computer program instructions to implement the methods provided in various alternative implementations of the above embodiments.

[0216] It should be understood that the present disclosure is not limited to the detailed structures, drawing methods, or implementation methods shown here. On the contrary, the present disclosure intends to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.

Claims

1. A method for displaying flight device information, characterized in that, Including: In a first information display area, stage identifiers of multiple flight stages of a flight device within a preset geographic range are arranged in sequence, and each of the flight stages corresponds to one or more flight routes; In response to a monitoring instruction, display the dynamic identifier of the flight device at an associated position of the flight stage and flight route where the flight device is located.

2. The method according to claim 1, wherein There are multiple preset geographic ranges, and the stage identifiers corresponding to the multiple preset geographic ranges are arranged horizontally or vertically in the first information display area; the stage identifiers of the multiple flight stages are arranged horizontally or vertically in the first information display area; multiple flight routes in the same flight stage are arranged vertically.

3. The method according to claim 2, characterized in that, The preset geographic range includes a target geographic range. After the response to the monitoring instruction, it further includes: Display the static identifier of the flight device within the target geographic range in a preset area in the first information display area.

4. The method according to claim 3, wherein The dynamic identifier and / or static identifier are also used to represent the monitoring state of the flight device, and the monitoring state includes a normal state, a selected state, and one or more abnormal states; wherein, the selected state is used to represent that the dynamic identifier and / or static identifier are subjected to a selection operation, and the abnormal state is used to represent that the flight device has an abnormality.

5. The method according to claim 3, characterized in that There are multiple flight devices, and the flight devices include a target flight device. The method includes: In response to a selection operation on the dynamic identifier or static identifier of the target flight device, display the status information and / or control state switching control of the target flight device in the first information display area, and the status information includes one or more of device model, task type, flight status, takeoff time, starting airport, and control state.

6. The method according to claim 5, wherein Including: In response to a trigger operation on the control state switching control, switch the control state of the target flight device.

7. The method according to claim 6, wherein When responding to the monitoring instruction, the method further includes: in a second information display area, display one or more of a full panel, a monitor panel, a system information panel, a flight device status panel, and a remote control component in blocks; wherein, the full panel is used to display a two-dimensional map of a selected geographic range, the monitor panel is used to display the video transmission data of a selected flight device, the system information panel is used to display flight device notification information, the flight device status panel is used to display the status parameters of the flight device, and the remote control component is used to take over the control of the selected flight device.

8. The method according to claim 7, wherein When responding to a selection operation on the dynamic identifier or static identifier of the target flight device, it further includes: Display the video transmission data of the target flight device on the monitor panel, and display the dynamic flight trajectory of the flight devices within the selected geographic range in the two-dimensional map.

9. The method according to claim 7, wherein Switching the control state of the target flight device includes switching the control state of the target flight device to a takeover state. When responding to a trigger operation on the control state switching control, it further includes: activating the control of the remote control component over the target flight device.

10. An electronic device, characterized in that, Including: A memory and a processor; The memory is used to store computer program instructions; the processor calls the computer program instructions stored in the memory to implement the method according to any one of claims 1-9.

Images