Information display method for flight equipment and electronic device

By arranging the flight phase identifiers of flight equipment in the information display area and displaying dynamic identifiers, the complex information display of flight equipment is solved, and clear management and control of multiple flight equipment is achieved.

WO2025145820A1PCT designated stage expired Publication Date: 2025-07-10MEITUAN TECH CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/135383
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-01-04
Filing Date
2024-11-28
Publication Date
2025-07-10

AI Technical Summary

Technical Problem

In the prior art, the information of the movement trajectory of the flight equipment is complicated and disordered when displayed on a two-dimensional map, resulting in the target object that can only manage a small number of flight equipment, making it difficult to effectively control and manage.

Method used

The flight equipment information display method is adopted to arrange the stage identifiers of multiple flight stages of the flight equipment in sequence in the information display area, and display dynamic identifiers at related positions in response to monitoring instructions, thereby concisely highlighting the important reference data of the flight equipment.

Benefits of technology

The simple and effective management of multiple flight equipment is achieved, and the target object can timely understand the geographical range, flight stage and route of each flight equipment, improving the clarity and efficiency of control.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024135383_10072025_PF_FP_ABST
    Figure CN2024135383_10072025_PF_FP_ABST
Patent Text Reader

Abstract

An information display method for flight equipment and an electronic device, relating to the technical field of flight control. The method comprises: in a first information display area, sequentially arranging phase identifiers of a plurality of flight phases of flight equipment within a preset geographical range, wherein each flight phase corresponds to one or more air routes (S302); and in response to a monitoring instruction, displaying a dynamic identifier of the flight equipment at an associated position of a flight phase and an air route of the flight equipment (S304).
Need to check novelty before this filing date? Find Prior Art

Description

Flight equipment information display method and electronic equipment

[0001] This application claims priority to Chinese patent application No. 202410027035.8 filed on January 4, 2024, entitled “Flight Equipment Information Display Method and Electronic Device,” the entire contents of which are incorporated herein by reference. Technical Field

[0002] The present disclosure relates to the field of flight control technology, and in particular to a method for displaying flight equipment information and an electronic device. Background Art

[0003] To manage aerial vehicles, the trajectory of the aerial vehicle is usually displayed on a two-dimensional map. Target objects can manage the aerial vehicle based on the trajectory of the aerial vehicle on the map. Summary of the Invention

[0004] The present disclosure aims to provide a method and electronic device for displaying information of an aircraft device, so as to solve the problem that the control and management of the aircraft device is not clear and concise.

[0005] An embodiment of the present disclosure provides a method for displaying information of an aircraft device, comprising: sequentially arranging, in a first information display area, stage identifiers of a plurality of flight stages of an aircraft device within a preset geographical range, each of the flight stages corresponding to one or more routes; and displaying, in response to a monitoring instruction, a dynamic identifier of the aircraft device at a position associated with the flight stage and route in which the aircraft device is located.

[0006] An embodiment of the present disclosure provides a flight equipment information display device, comprising: a phase identification display module and a dynamic identification display module. The phase identification display module is configured to sequentially display phase identifications of multiple flight phases of the flight equipment within a preset geographical range in a first information display area, each corresponding to one or more routes. The dynamic identification display module is configured to display the dynamic identification of the flight equipment at a location associated with the flight phase and route in response to a monitoring instruction.

[0007] An embodiment of the present disclosure proposes an electronic device, which includes: a memory and a processor; the memory is used to store computer program instructions; the processor calls the computer program instructions stored in the memory to implement any of the above-mentioned flight equipment information display methods.

[0008] An embodiment of the present disclosure provides a computer-readable storage medium having computer program instructions stored thereon for implementing the flight equipment information display method as described in any one of the above items.

[0009] The present disclosure provides a computer program product or computer program, which includes computer program instructions stored in a computer-readable storage medium. The computer program instructions are read from the computer-readable storage medium and executed by a processor to implement the aforementioned flight equipment information display method.

[0010] In the related art, in order to manage flight equipment, the movement trajectory of the flight equipment is usually displayed on a two-dimensional map. The target object can manage the flight equipment through the movement trajectory of the flight equipment on the map. However, the flight equipment information displayed by the above scheme is complicated and disordered, resulting in the target object being able to observe and manage only a small number of flight equipment. Therefore, the technical problem to be solved by the present disclosure is how to display flight equipment information so that the target object can manage a larger number of flight equipment at the same time. The flight equipment information display method and electronic device provided in the embodiment of the present disclosure can determine the geographical range, flight route and flight stage of the flight equipment according to the location of the dynamic identifier of the flight equipment, and concisely and effectively highlight the important reference data for controlling the flight equipment, so that the target object can timely understand the geographical range, flight stage and flight route of each flight equipment, so as to manage and control the flight equipment. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Obviously, the drawings described below are only some embodiments of the present disclosure. A person skilled in the art can obtain other drawings based on these drawings without any creative effort.

[0012] FIG1 shows a schematic diagram of a scenario in which a method or apparatus for displaying flight equipment information may be applied in an embodiment of the present disclosure.

[0013] FIG2 is a flowchart showing a method for displaying flight equipment information according to an exemplary embodiment.

[0014] FIG3 is a flowchart showing a method for displaying flight equipment information according to an exemplary embodiment.

[0015] FIG4 is a flowchart showing a method for displaying flight equipment information according to an exemplary embodiment.

[0016] Fig. 5 is a schematic diagram showing display of flight phase indication information according to an exemplary embodiment.

[0017] Fig. 6 is a schematic diagram showing display of flight phase indication information according to an exemplary embodiment.

[0018] Fig. 7 is a schematic diagram showing display of flight phase indication information according to an exemplary embodiment.

[0019] Fig. 8 is a schematic diagram showing display of flight phase indication information according to an exemplary embodiment.

[0020] Fig. 9 is a schematic diagram showing display of flight phase indication information according to an exemplary embodiment.

[0021] Fig. 10 is a schematic diagram showing display of flight phase indication information according to an exemplary embodiment.

[0022] Fig. 11 is a schematic diagram showing display of flight phase indication information according to an exemplary embodiment.

[0023] Fig. 12 is a schematic diagram showing display of flight phase indication information according to an exemplary embodiment.

[0024] Fig. 13 is a schematic diagram showing display of flight phase indication information according to an exemplary embodiment.

[0025] Fig. 14 is a schematic diagram showing display of flight phase indication information according to an exemplary embodiment.

[0026] FIG15 is a flowchart showing a method for displaying control reference information of a flight device according to an exemplary embodiment.

[0027] FIG16 is a flowchart showing a method for displaying flight equipment information according to an exemplary embodiment.

[0028] Fig. 17 is a schematic diagram showing the layout of a second information display area according to an exemplary embodiment.

[0029] Fig. 18 is a schematic diagram showing display of a second information display area in a waiting task stage according to an exemplary embodiment.

[0030] FIG19 is a flowchart showing a method for displaying flight equipment information according to an exemplary embodiment.

[0031] Fig. 20 is a schematic diagram showing display of control reference information according to an exemplary embodiment.

[0032] Fig. 21 is a flowchart showing a method for activating a control component according to an exemplary embodiment.

[0033] FIG22 is a flowchart showing a method for displaying flight equipment information according to an exemplary embodiment.

[0034] Fig. 23 is a schematic diagram showing a takeover control display according to an exemplary embodiment.

[0035] Fig. 24 is a schematic diagram showing a display of a takeover confirmation control according to an exemplary embodiment.

[0036] FIG25 is a schematic diagram showing a display of a device identification after a flying device is taken over according to an exemplary embodiment.

[0037] Fig. 26 is a schematic diagram showing the display of a control widget in an activated state according to an exemplary embodiment.

[0038] Fig. 27 is a schematic diagram showing a display of a control component for ending takeover according to an exemplary embodiment.

[0039] FIG28 is a flowchart of a method for displaying drone equipment information according to an exemplary embodiment.

[0040] FIG29 is a block diagram showing a device for displaying flight equipment information according to an exemplary embodiment.

[0041] FIG30 shows a schematic structural diagram of an electronic device suitable for implementing the embodiments of the present disclosure. DETAILED DESCRIPTION

[0042] Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many forms and should not be construed as limited to the embodiments set forth herein.

[0043] The flowcharts shown in the accompanying drawings are for illustrative purposes only and do not necessarily include all content and steps, nor must they be executed in the order described. For example, some steps may be decomposed, while others may be combined or partially combined. Therefore, the actual execution order may vary depending on the actual situation.

[0044] In the description of this disclosure, unless otherwise specified, " / " means "or". For example, A / B can mean A or B. "And / or" in this document is only a description of the association relationship between related objects, indicating that three relationships can exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0045] Hereinafter, exemplary embodiments of the present disclosure will be described in detail with reference to the accompanying drawings.

[0046] Figure 1 illustrates a scenario that can be applied to the flight equipment information display method or apparatus according to embodiments of the present disclosure. As shown in Figure 1 , system architecture 120 may include flight equipment 101, terminal devices 102 and 103, a network 104, and a server 105. Network 104 provides a medium for communication links between flight equipment 101, terminal devices 102 and 103, and server 105. Network 104 can include various connection types, such as wireless communication links.

[0047] Users can use aircraft device 101 or terminal devices 102 and 103 to interact with server 105 via network 104 to receive or send messages, etc. Aircraft device 101 can be an aircraft, drone, or other flying device. This aircraft device can be a single device or a fleet of aircraft, which is not limited in this application. Terminal devices 102 and 103 can be various electronic devices with display screens and web browsing support, including but not limited to smartphones, tablets, laptops, desktop computers, wearable devices, virtual reality devices, smart homes, etc. Server 105 can be a server that provides various services, such as a backend management server that supports information sent by aircraft device 101 and devices operated by users using terminal devices 102 and 103. The backend management server can analyze and process received requests and other data, and feedback the processing results to the terminal devices.

[0048] In some embodiments, the server 105 can collect flight information of the flight equipment 101 through the network 104, such as flight phase information, flight trajectory information, flight status information, flight environment information, etc.; the server 105 can analyze and process the data collected from the flight equipment 101, and send the analysis and processing results to the terminal device 102 or 103 through the network 104; the terminal device 102 or 103 can, for example, arrange the phase identifications of multiple flight phases of the flight equipment within a preset geographical range in sequence in the first information display area, and each flight phase corresponds to one or more routes; the terminal device 102 or 103 can, for example, respond to monitoring instructions and display the dynamic identification of the flight equipment at the associated position of the flight phase and route of the flight equipment.

[0049] Figure 2 is a flowchart illustrating a method for displaying flight equipment information, according to an exemplary embodiment. The method provided by the embodiments of the present disclosure can be performed by an electronic device with display capabilities, but the present disclosure is not limited thereto. Referring to Figure 2 , the method for displaying flight equipment information provided by the embodiments of the present disclosure can include the following steps.

[0050] Step S202: Display multiple flight phase indication information, where each flight phase indication information is used to indicate a different flight phase of the aircraft in the route.

[0051] In some embodiments, the aforementioned flying device may be an airplane, a drone, or other flying device.

[0052] The flight phases of the above-mentioned aircraft equipment may be flight phases divided according to the flight missions of the aircraft equipment. For example, when performing a delivery mission, the flight phases of the aircraft equipment may include a land loading phase, an air flight phase, and a land delivery phase, etc.; the flight phases of the above-mentioned aircraft equipment may also be divided according to the flight process of the aircraft equipment. For example, the aircraft equipment may include push-out taxiing, take-off, cruising, descent, landing, etc. in the route. For another example, the flight phases of the aircraft equipment in the route may include a take-off phase, a level flight phase, and a descent phase, etc. For another example, the flight phases of the aircraft equipment in the route may also include a take-off phase at the starting point, a first level flight phase, a descent phase at a stopover, a take-off phase at a stopover, a second level flight phase, and a descent phase at the destination, etc. The present disclosure does not limit the specific flight phases of the aircraft equipment. Those skilled in the art may set the flight phases in the present disclosure according to the actual flight phases corresponding to the aircraft equipment.

[0053] In some embodiments, the flight phase indication information can indicate the flight phase of the flight equipment without distinguishing the route (such as displaying the flight equipment of each route in a certain flight phase together in the form of a list, and the specific display effect can be shown in Figure 5); in some embodiments, the flight phase indication information can also distinguish the route where the flight equipment is located when displaying the flight phase of the flight equipment (such as displaying the flight equipment on different routes at the flight phase indication information position corresponding to the different routes, and the specific display effect can be referred to in Figure 14), and the present disclosure does not impose any restrictions on this.

[0054] In some embodiments, the above-mentioned flight phase indication information can be represented in various forms, for example, it can be represented by a box with a specific meaning, for example, it can be represented by a straight line with a specific meaning, for example, it can be represented by an area with a specific meaning, or for example, it can be represented by a superscript or subscript with a specific meaning. The present disclosure does not limit the form of expression of the flight phase indication information, and those skilled in the art can set the form of expression of the flight phase display information according to their own needs.

[0055] For example, the flight phase indication information may be a box corresponding to the takeoff phase, a box corresponding to the level flight phase, or a box corresponding to the descent phase in FIG5 . The specific meaning of the box may be indicated by text (such as "takeoff phase," "descent phase," etc. in FIG5 ), color, or the fill color of the box, etc., and this disclosure does not limit this.

[0056] For another example, the flight phase indication information may be a line with a specific meaning. Similarly, the specific meaning of the line may be expressed in a variety of ways (such as text, color, line style, etc.), and the present disclosure does not impose any restrictions on this.

[0057] In some embodiments, the trajectory corresponding to the route of the flight device or the line connecting the starting point and the destination can be divided according to the flight stage of the flight device on the route to obtain multiple sub-areas, one of which can be used to indicate a flight stage.

[0058] For details on how to display the flight phase indication information, please refer to the embodiments corresponding to Figures 5 to 14, which will not be described in detail in this embodiment.

[0059] Step S204 : Displaying the device identification of the flight device at the associated position of the flight phase indication information corresponding to the current flight phase of the flight device, and displaying the flight status of the flight device, so as to control the flight device.

[0060] In some embodiments, a flying device may refer to a device that is currently flying, which may be one, two, or more. For example, in a drone delivery scenario, a flying device may refer to a drone that has received a delivery mission request or is already in flight.

[0061] In some embodiments, the current flight phase of the flight equipment can be obtained in real time (such as determining that the flight phase of the flight equipment is the take-off phase), and then the flight phase indication information corresponding to the current flight status is determined (for example, determining that the flight phase indication information corresponding to the take-off phase is A), and finally the device identification of the flight equipment is displayed at the associated position of the flight phase indication information of the current flight phase (such as displaying the flight equipment at the associated position of A).

[0062] In some embodiments, the device identification of the flight equipment can be a device code (such as codes 3301, 3302 and 3303 in Figure 5), a device model (such as an airplane model, a drone model or a model corresponding to other aircraft, or a triangular model as shown in Figure 14), or a combination of a device code and a device model (such as the combination of code 3302 and the corresponding triangular model in Figure 14). The present disclosure does not limit the style of the device identification of the flight equipment.

[0063] In some embodiments, the status of the flight equipment can be displayed by voice, text, color, etc. in addition to the equipment identification. For example, if the flight status of the flight equipment is abnormal, the flight equipment can be reminded of the abnormality through warning color, warning text or warning voice.

[0064] In some embodiments, the device status of an aircraft device can be displayed using its device identifier. In some embodiments, displaying the device identifier of an aircraft device based on its current flight status may include: displaying the device identifier of the aircraft device in a first state if the aircraft device is flying normally; and displaying the device identifier of the aircraft device in a second state if the aircraft device is flying abnormally. The first state may represent a normal state, and the second state may represent an abnormal state. This application does not limit the method for displaying the status of an aircraft device.

[0065] In some embodiments, the abnormal status of the device identifier can be displayed by color, pattern, or background. For example, the device identifier can be displayed in red or dark color to indicate that the aircraft represented by the device identifier has experienced a flight abnormality; for another example, the device identifier can be displayed in yellow or light color to indicate that the aircraft represented by the device identifier has issued an alarm; for another example, the device identifier can be displayed in white or transparent color to indicate that the aircraft represented by the device identifier is flying normally.

[0066] Among them, flight abnormality of flight equipment may refer to abnormal trajectory, abnormal equipment status or abnormal flight environment (extreme weather), etc., and this disclosure does not impose any restrictions on this.

[0067] In some embodiments, if an aircraft device experiences flight anomalies, consideration may be given to taking over and controlling the aircraft device.

[0068] The above embodiment can display the current flight status of the flight equipment and indicate the current flight stage of the flight equipment through the flight stage indication information, concisely and effectively highlighting the important reference data when controlling the flight equipment, so that the target object can timely understand the current flight stage and current flight status of each flight equipment, so as to manage and control the flight equipment.

[0069] FIG3 is a flow chart showing a method for displaying flight equipment information according to an exemplary embodiment. Referring to FIG3 , the flow chart of the method for displaying flight equipment information may include the following steps.

[0070] Step S302 : In a first information display area, stage identifiers of multiple flight stages of the aircraft within a preset geographical range are sequentially arranged, and each flight stage corresponds to one or more routes.

[0071] In some embodiments, a first information display area and a second information display area may be displayed in a terminal device. The first information display area and the second information display area may be displayed at different positions or the same position in the same display window, or may be displayed in different display windows. The different windows may be displayed in different screens or in the same screen. This disclosure does not impose any restrictions on this.

[0072] The above-mentioned stage identification can be one of the flight stage indication information and can be displayed through any type of identification. As shown in Figure 6, identification 603 and identification 604 can both be stage identifications in this application. The area before identification 603 can represent the take-off stage of the flight equipment, the area after identification 603 and before identification 604 can represent the level flight stage of the flight equipment, and the area after identification 604 can represent the landing stage of the flight equipment.

[0073] In some embodiments, the phase identifiers of the multiple flight phases of the aircraft within a preset geographical range can be arranged in the order of the flight phases that the aircraft has experienced during flight. Obviously, the aircraft must first experience the takeoff phase, then the level flight phase, and finally the landing phase. Therefore, as shown in FIG6 , identifier 603 should be arranged before identifier 604.

[0074] The preset geographical scope may refer to a preset province, city, county, street, business district, community, etc., and this application does not impose any restrictions on this.

[0075] In some embodiments, the first information display area may display phase identifiers corresponding to one, two, or more flight phases within a preset geographical range.

[0076] In some embodiments, there may be multiple preset geographic ranges in the first information display area, wherein the stage identifiers corresponding to the multiple preset geographic ranges are arranged horizontally or vertically in the first information display area. As shown in FIG12 , the stage identifier corresponding to the first geographic range is displayed vertically between the stage identifier corresponding to the second geographic range and the stage identifier corresponding to the third geographic range.

[0077] In some embodiments, the stage identifiers of multiple flight stages within a geographical range may be arranged horizontally or vertically in the first information display area (as shown in FIG. 12 , the stage identifiers 1209 , 1210 , 1211 , 1212 and 1203 are arranged horizontally).

[0078] In some embodiments, multiple routes in the same flight phase can be arranged vertically. As shown in Figure 12, there are three routes at the flight phase position indicated by phase markers 1209, 1210, 1211, 1212 or 1203, wherein the three routes corresponding to each flight phase are arranged vertically.

[0079] In some embodiments, a stage identifier may correspond to one route (as shown in FIG6 , the stage identifier 603 corresponds to one route behind it), or may correspond to two routes, or may correspond to three routes (as shown in FIG12 , the stage identifier 1209 corresponds to one route in front of it and three routes behind it), etc.

[0080] Step S304 : In response to the monitoring instruction, the dynamic identification of the flight equipment is displayed at a position associated with the flight phase and route of the flight equipment.

[0081] The dynamic identifier may refer to an identifier whose position may change over time.

[0082] The above-mentioned monitoring instructions may refer to instructions for monitoring one or more flying devices. For example, in a scenario where a drone is used for food delivery, when the drone receives a delivery order, the corresponding execution entity of this application will receive the monitoring instructions. However, this application does not restrict the specific source or content of the monitoring instructions.

[0083] Through the technical solution provided by the above embodiment, the flight route and flight phase of the flight equipment can be determined based on the position of the dynamic identification of the flight equipment, and the important reference data for controlling the flight equipment can be highlighted concisely and effectively, so that the target object can timely understand the current flight phase and flight route of each flight equipment, so as to manage and control the flight equipment.

[0084] FIG4 is a flow chart showing a method for displaying flight equipment information according to an exemplary embodiment. Referring to FIG4 , the flow chart of the method for displaying flight equipment information may include the following steps.

[0085] Step S402 : In a first information display area, stage identifiers of multiple flight stages of the aircraft within a preset geographical range are sequentially arranged, and each flight stage corresponds to one or more routes.

[0086] Step S404 : In response to the monitoring instruction, the dynamic identification of the flight equipment is displayed at a location associated with the flight phase and route of the flight equipment.

[0087] Step S406: Display the static identification of the flying equipment within the target geographical range in a preset area in the first information display area.

[0088] In some embodiments, the preset geographic range may include a target geographic range. In some embodiments, after responding to a monitoring instruction, a static identifier of an aircraft within the target geographic range may be displayed in a preset area of ​​the first information display area. As shown in FIG14 , the device identifier of the aircraft (e.g., identifier 3301 or identifier 3302) may be displayed in the lower left corner of the first geographic range.

[0089] In some embodiments, dynamic and / or static identifiers may also be used to represent the monitoring status of the flight equipment, including a normal state, a selected state, and one or more abnormal states. These normal state, selected state, and one or more abnormal states (e.g., equipment abnormality, equipment warning, etc.) may be displayed using different colors, backgrounds, etc., which are not limited in this application.

[0090] In some embodiments, the selected state may be used to indicate that a dynamic identifier and / or a static identifier is selected, and the abnormal state may be used to indicate that an abnormality occurs in the flight equipment.

[0091] Below, the present disclosure will explain different flight phase indication information in conjunction with some embodiments.

[0092] In some embodiments, flight phase indication information can be used to indicate the flight phase of an aircraft when flying from a starting point to a destination. Displaying the flight phase indication information may include: displaying an origin identifier corresponding to the starting point, a destination identifier corresponding to the destination, and a connection pattern between the origin identifier and the destination identifier, wherein the connection pattern is divided into multiple connection sub-patterns according to the flight phase corresponding to the aircraft when flying between the starting point and the destination. The multiple connection sub-patterns may be the multiple flight phase indication information in this application, wherein the multiple connection sub-patterns are used to indicate the flight phase corresponding to the aircraft when flying between the starting point and the destination.

[0093] The above-mentioned starting point and destination can be determined according to the specific application scenario. For example, in an aircraft navigation scenario, the above-mentioned starting point can be the departure point of the aircraft, and the above-mentioned destination can be the destination of the aircraft; for another example, in a drone delivery scenario, the above-mentioned starting point can be the loading point of the drone, and the above-mentioned destination can be the unloading point of the drone. This disclosure does not limit the above-mentioned starting point and destination, and those skilled in the art can determine the above-mentioned starting point and destination according to actual needs.

[0094] In some embodiments, the origin identifier (or destination identifier) ​​is used to represent the origin (or destination), and may or may not have geographic location information, and this disclosure does not limit this. For example, the origin identifier and the destination identifier may be displayed on a map so that the origin identifier and the destination identifier have geographic location information; the origin identifier and the destination identifier may also not be displayed on the map, for example, they may be displayed in a blank area, so that the origin identifier and the destination identifier do not have geographic location information, and this disclosure does not limit this.

[0095] It should be noted that this application does not limit the specific form of each identifier (such as the origin identifier, destination identifier, or device identifier, etc.).

[0096] As shown in FIG6 , a starting location marker 601 corresponding to the starting location, a destination marker 602 corresponding to the destination, and a connection pattern between starting location marker 601 and destination marker 602 may be displayed (not on the map, such as in a blank area). The connection pattern may be a continuous line such as a straight line or a curve (not shown) as shown in FIG6 , or a connection pattern having a connection function such as a connecting arrow, a connecting rectangle, or a connecting triangle.

[0097] As shown in FIG6 , the connection pattern between the origin identifier 601 and the destination identifier 602 can be divided according to the number (e.g., 3) of the flight phases (e.g., takeoff phase, level flight phase, and descent phase) of the aircraft between the origin and the destination to obtain multiple connection sub-patterns (e.g., the connection line segments in region 1, the connection line segments in region 2, and the connection line segments in region 3 as shown in FIG6 ). The above multiple connection patterns can be used to indicate the corresponding flight phases of the aircraft when flying between the origin and the destination. For example, the connection line segments in region 1 in FIG6 can indicate the takeoff phase of the aircraft on the route, the connection line segments in region 2 in FIG6 can indicate the level flight phase on the route, and the connection line segments in region 3 in FIG6 can indicate the descent phase on the route.

[0098] It is understandable that, compared to displaying a connection pattern between the origin and destination on a map, the embodiment shown in FIG6 , on the one hand, does not need to carry the geographic location information of the origin and destination, and simplifies and highlights the displayed information through information dimensionality reduction; on the other hand, the origin and destination can be arranged according to actual needs, and multiple origins and destinations can be displayed in a single display area by arranging them in parallel or side by side. In short, the information dimensionality reduction display technology solution provided by the embodiment shown in FIG6 can display the flight equipment information of multiple aircraft in a single display area, so that the information of multiple aircraft can be displayed simultaneously and concisely through a single display area, and important reference information in the flight equipment control process (such as flight equipment status information and flight phase information, etc.) can be highlighted.

[0099] In some embodiments, the connecting sub-pattern corresponding to the take-off phase can be connected to the first suspension pattern (the first vertical line after the starting point identifier 601 in Figure 6), where the first suspension pattern is used to indicate the end of the ascent phase and the beginning of the level flight phase; the connecting sub-pattern corresponding to the level flight phase has one end connected to the first suspension pattern and the other end connected to the second suspension pattern (such as the second vertical line after the starting point identifier 601 in Figure 6), where the second suspension pattern is used to indicate the end of the level flight phase and the beginning of the descent phase; the connecting sub-pattern corresponding to the descent phase has one end connected to the second suspension pattern (such as the second vertical line after the starting point identifier 601 in Figure 6) and the other end connected to the destination identifier.

[0100] The start or end of a flight phase can be clearly displayed through the first stop pattern and the second stop pattern.

[0101] In some embodiments, the above-mentioned flight phase indication information can also be used to indicate the flight phase of the flight equipment when it departs from the starting point, passes through the stopover point and flies to the destination on the route.

[0102] The starting point and destination may be determined based on specific application scenarios. For example, in an aircraft flight scenario, the starting point may be the departure point of the aircraft, the stopover point may be a place where the aircraft stops and lands during flight, and the destination point may be the destination of the aircraft.

[0103] In some embodiments, the above-mentioned stopovers may be one, two, or more, and this disclosure does not limit this.

[0104] For example, in a drone delivery scenario, the starting point can be the merchant's drone's takeoff airport, the destination can be the merchant's drone's landing airport, and the stopover can be the user airport corresponding to the user to be delivered. A merchant can deliver to multiple users. Therefore, a drone may stop at one, two, or more user airports during a flight; or a drone may only stop at one user airport during a flight, but different drones can stop at different user airports.

[0105] In some embodiments, if the flight equipment passes through two or more stopovers in sequence while flying from the starting point to the destination, then those skilled in the art can expand the display scheme of the corresponding flight phase indication display when the flight equipment stops at multiple stopovers in one flight according to the embodiment shown in Figure 6.

[0106] In some embodiments, if all flight devices flying from the origin to the destination stop at the same stopover, the flight phase indication information can be displayed by the following method: displaying the origin identifier corresponding to the origin (origin identifier 701 as shown in Figure 7), the stopover identifier corresponding to the stopover (origin identifier 702 as shown in Figure 7), the destination identifier corresponding to the destination (origin identifier 703 as shown in Figure 7), and a connection pattern between the origin identifier, the stopover identifier, and the destination identifier (the connection line connecting the origin 701, the stopover 702, and the destination 703 as shown in Figure 7), wherein the connection pattern is divided into multiple connection sub-patterns according to the corresponding flight phases when the flight device flies between the origin, the stopover, and the destination, wherein the multiple connection sub-patterns are respectively used to indicate the take-off phase of the take-off phase, the first level flight phase, the stopover descent phase, the stopover take-off phase, the second level flight phase, and the destination descent phase corresponding to the flight device. As shown in Figure 7, the takeoff phase at the takeoff point can be indicated by the connecting line segments in area 1 in Figure 7, the first level flight phase can be indicated by the connecting line segments in area 2 in Figure 7, the descent phase at the stopover point can be indicated by the connecting line segments in area 3 in Figure 7, the takeoff phase at the stopover point can be indicated by the connecting line segments in area 4 in Figure 7, the second level flight phase can be indicated by the connecting line segments in area 5 in Figure 7, and the descent phase to the destination can be indicated by the connecting line segments in area 6 in Figure 7.

[0107] In some embodiments, if there are two stopovers between the origin and the destination, and one flight device only passes through one stopover when flying from the origin to the destination, and different flight devices may pass through different stopovers when flying from the origin to the destination, then the flight phase indication information can be displayed using the following method.

[0108] It should be noted that in this application, a route between the origin and the destination passing through different stops can be a sub-route, and the route between the origin and the destination includes all sub-routes between the origin and the destination.

[0109] It should be noted that the routes and sub-routes here are actually routes, and the difference in names is only to distinguish the relationship between them.

[0110] In some embodiments, the connection pattern displayed between the origin and the destination may include a first connection pattern and a second connection pattern, the stopover between the origin and the destination may include a first stopover and a second stopover, and the multiple connection sub-patterns may include a first connection sub-pattern and a second connection sub-pattern. Then, the flight phase indication information may be displayed by the following method: displaying a first connection pattern (representing a sub-route, also referred to as a route) between the origin identifier, the first stopover identifier corresponding to the first stopover, and the destination identifier, wherein the first connection pattern is divided into multiple first connection sub-patterns according to the flight phase of the flight equipment on the route where the first stopover is located; displaying a second connection pattern (representing another sub-route) between the origin identifier, the second stopover identifier corresponding to the second stopover, and the destination identifier, wherein the second connection pattern is divided into multiple second connection sub-patterns according to the flight phase of the flight equipment on the route where the second stopover is located. Among them, the connection sub-patterns corresponding to the same flight phase of the air flight sub-route are combined and displayed.

[0111] In some embodiments, if there are three stopovers between the origin and the destination, and a flight device only passes through one stopover when flying from the origin to the destination, and different flight devices may pass through different stopovers when flying from the origin to the destination, then the flight phase indication information can be displayed through the interface shown in Figure 8.

[0112] As shown in Figure 8, the stopover identifiers corresponding to the three stopovers (such as the three stopover identifiers indicated by 801 in Figure 8) can be displayed side by side between the origin identifier and the destination identifier, and then three connection patterns are displayed between the origin identifier and the destination identifier, one of which passes through a stopover; then the three connection patterns are divided according to the flight stages of the flight equipment between the origin, stopover and destination to obtain multiple connection sub-patterns, where the connection sub-patterns on different sub-routes can indicate the flight stages on the sub-routes.

[0113] In some embodiments, when displaying the above-mentioned connection sub-patterns, the connection sub-patterns corresponding to flight phases with the same air route (without distinguishing the flight direction) can be combined and displayed. As shown in Figure 8, the air routes corresponding to the takeoff phases on the sub-routes where the three stopovers are located can be the same, so the connection sub-patterns corresponding to the takeoff phases on the sub-routes where the three stopovers are located can be combined and displayed (the present disclosure does not limit the specific merging method). By displaying the flight phase indication information using the above method, it is possible to clearly understand whether each aircraft device is on the same sub-route, thereby avoiding affecting the normal flight of other aircraft devices on the same sub-route when controlling the aircraft device.

[0114] In some embodiments, the take-off phase indication information of the origin corresponding to the take-off phase of the origin (such as the connecting sub-pattern in area 1 in Figure 7) can be further divided according to the take-off action of the aircraft at the take-off location. For example, the take-off action of the aircraft at the take-off location may include the sub-stage of driving to the take-off airport and the sub-stage of taking off from the take-off airport. Then the take-off phase indication information of the origin in Figure 7 can be divided into two parts (a part corresponding to area 7 in the mark 901 as shown in Figure 9 and a part corresponding to area 8), of which one part (the connecting line segment in area 7 as shown in Figure 9) can be used to indicate the sub-stage of the aircraft driving to the take-off airport, and the other part (the connecting line segment in area 8 as shown in Figure 9) indicates the sub-stage of the aircraft taking off from the take-off airport.

[0115] In some embodiments, the departure airport corresponding to the origin may be one, two, or more, and the origin identifier corresponding to the origin may also be one, two, or more.

[0116] In some embodiments, the starting place may include a first airport and a second airport, and the starting place identifier may include a first airport identifier corresponding to the first airport in the starting place and a second airport identifier corresponding to the second airport in the starting place. Then, the first airport identifier (such as one of the identifiers in 1001 in Figure 10) and the second airport identifier (such as another identifier in 1001 in Figure 10) can be displayed at the location of the starting place identifier (the starting place identifier 701 as shown in Figure 7), and then the first airport identifier and the second airport identifier are displayed and connected to the destination identifier respectively through a connecting pattern, and the above-mentioned connecting pattern can be divided according to the flight stage of the flight equipment.

[0117] In some embodiments, when displaying the aforementioned connecting sub-patterns, connecting sub-patterns corresponding to flight phases with the same air routes may be combined and displayed. For example, the sub-route for the first airport and the sub-route for the second airport have the same air routes except for the takeoff phase. Therefore, the connecting sub-patterns corresponding to the flight phases other than the takeoff phase at the origin may be combined and displayed, as shown in FIG10 .

[0118] This method not only displays the different takeoff phases for sub-routes corresponding to different airports separately, but also merges and displays connected sub-patterns for flight phases with the same air routes. This allows users to instantly identify which aircraft are sharing the same flight path and distinguish between aircraft on different sub-routes, enabling them to control them based on their respective routes and sequence.

[0119] In some embodiments, in an application scenario, the origin may correspond to multiple airports, and there may be multiple stopovers between the destination and the origin. Then, by combining the technical solutions corresponding to the above-mentioned scenarios of multiple airports at the origin and multiple stopovers between the origin and the destination, a schematic diagram of flight phase indication information as shown in Figure 11 can be obtained. In the schematic diagram shown in Figure 11, the origin may have two airport identifiers (such as two solid circles indicated by 1101), the destination may have one destination identifier (such as a solid circle indicated by 1102), and there may be three stopovers between the origin and the destination (such as three rectangles indicated by 1103); the connection patterns between the origin, the stopovers, and the destination are divided according to the flight phase of the flight equipment between the origin and the destination; in addition, the connection sub-patterns corresponding to the flight phases with the same air flight route are also combined and displayed.

[0120] The above display method not only allows for detailed and highlighted display of flight subroutes and flight phases of an aircraft, but also combines and displays connected sub-patterns corresponding to flight phases with the same aerial route. This allows the spatial relationship between aircraft within the same subroutes to be clearly displayed when displaying flight phases, preventing the impact of control on nearby aircraft when controlling one aircraft.

[0121] It should be noted that the area 1 (2, 3, ...) and the corresponding shaded parts in the above-mentioned Figures 6 to 11 are marked for the convenience of explaining the technical solution and may not be displayed in actual application.

[0122] In some embodiments, the flight phase indication information may be displayed according to the geographical location of the route. In some embodiments, the geographical scope in the present disclosure may be a country, province, city, street, business district, etc., which may be determined by those skilled in the art according to their needs.

[0123] In some embodiments, the first information display area may include a first geographical display sub-area corresponding to the first geographical range and a second geographical display sub-area corresponding to the second geographical range, and the route of the flight equipment may include a first route and a second route. Among them, a starting point and a destination may include a route, and the route may include multiple sub-routes. As shown in Figures 6 to 11, there is only one route between a starting point and a destination, and the route may include one, two or more sub-routes. A route corresponds to a starting point and a destination, and different sub-routes pass through different stopovers.

[0124] In some embodiments, displaying flight phase indication information may include: if a first route is within a first geographical scope and a second route is within a second geographical scope, displaying the flight phase indication information corresponding to the first route and / or flight environment information within the first geographical scope within a first geographical display sub-area, and displaying the flight phase indication information corresponding to the second route and / or flight environment information within the second geographical scope within a second geographical display sub-area. If both the first route and the second route are within the first geographical scope, displaying the flight phase indication information corresponding to the first route and the flight phase indication information corresponding to the second route and / or flight environment information within the first geographical scope within the first geographical display sub-area.

[0125] As shown in FIG12 , flight phase indication information for different routes can be displayed by geographic range. For example, flight phase indication information for routes within a first geographic range (such as the route indicated by 1201 in FIG12 ) can be displayed in a display sub-area corresponding to a first geographic range (such as the area corresponding to the name of the first geographic range in FIG12 ). As shown in FIG12 , the name of the geographic range can be displayed within the display sub-area. Flight phase indication information for routes within a second geographic range (such as the route indicated by 1202 in FIG12 ) can be displayed in a display sub-area corresponding to a second geographic range (such as the area corresponding to the name of the second geographic range in FIG12 ). Flight phase indication information for routes within a third geographic range can be displayed in a display sub-area corresponding to a third geographic range, where multiple routes can exist within the third geographic range (such as the routes indicated by 1203 and 1204 in FIG12 , where routes with different origins can be displayed separately). Furthermore, the above-mentioned information can be displayed separately.

[0126] In some embodiments, the display sub-region corresponding to a geographic range may also display the weather corresponding to that geographic range. For example, weather information for a second geographic range may be displayed at the location indicated by 1207 in FIG. The display of weather information allows timely understanding of weather conditions within a geographic range, thereby assisting in determining how to control aircraft. For example, in the event of severe weather conditions, control of aircraft within the geographic range may be taken over.

[0127] In some embodiments, a display sub-area corresponding to a geographic range may also display a commuting control (such as the control indicated by 1206 in FIG. 12 ). This commuting control can be used to determine whether to display aircraft information within the geographic range. If the commuting control is in the off-duty state, aircraft information within the corresponding geographic range is not displayed.

[0128] The present disclosure also proposes merging and displaying the connected sub-patterns corresponding to flight phases with the same aerial flight sub-route (the flight sub-route may not consider flight direction, only spatial route; if two sub-route flight directions are opposite but the aerial flight trajectory is the same, they can also be considered to have the same aerial flight route). It is understood that when there is a stopover between the origin and destination, and the aircraft's corresponding stopover descent phase and stopover takeoff phase are completed within the same space, there may be an impact between aircraft taking off or landing within that space. For example, the connecting sub-patterns corresponding to the stopover descent phase and the stopover takeoff phase in FIG. 12 (such as the connecting sub-pattern at the position indicated by 1208 in FIG. 12 ) can be merged to generate a new connecting sub-pattern for display (for example, they can be merged into the pattern shown as 1301 in FIG. 13 ), so that when controlling the flight equipment in the stopover takeoff phase (or the stopover descent phase), not only the flight equipment in the stopover takeoff phase will be considered, but also the flight equipment in the stopover descent phase will be considered, thereby avoiding affecting the normal flight of other flight equipment in the space where the flight equipment is located when controlling a certain flight equipment, and avoiding the occurrence of flight accidents.

[0129] The present disclosure below will explain how to display the device identifier of an aircraft device in conjunction with the flight phase indication information shown in Figures 5 or 13. Those skilled in the art may replace the flight phase indication information in the following embodiments with other flight phase indication information (such as any of the flight phase indication information shown in Figures 5 to 13), and this disclosure does not limit this.

[0130] In some embodiments, if the current flight phase of an aircraft is the takeoff phase, the aircraft identifier (e.g., the device identifier 3301) of the aircraft may be displayed in the takeoff phase frame shown in FIG5 ; the aircraft identifier may also be displayed near the line segment in area 1 shown in FIG6 (used to indicate the takeoff phase); the aircraft identifier may also be displayed before the phase identifier 603 shown in FIG6 , and so on, which will not be further described in this disclosure.

[0131] In some embodiments, when displaying the device identification of the flight device, the current route of the flight device may also be considered, and the device identification of the current device may be displayed at a position corresponding to the current flight stage of the current route of the flight device.

[0132] In some embodiments, as shown in Figure 14, the flight equipment indicated by 1403 and 1404 are located in different flight phases of the same route, and the device identification indicated by 1403 and the device identification indicated by 1404 can be displayed at the different flight phase indication information positions shown in Figure 14; as shown in Figure 14, the flight equipment indicated by 1401 (or 1402) and 1403 (or 1404) are located on different routes, and the corresponding device identifications of 1401 (or 1402) and 1402 (or 1404) can be displayed on the different routes shown in Figure 14.

[0133] In some embodiments, the flight equipment may be displayed at associated positions of the flight stage indication information corresponding to the same flight stage in the order in which the flight equipment enters the same flight stage.

[0134] For example, the flight equipment may include a second flight equipment and a third flight equipment. Then, displaying the equipment identifier of the flight equipment at the associated position of the flight phase indication information corresponding to the current flight phase of the flight equipment may include: if the current route and current flight phase of the second and third flight equipment are the same, then displaying the equipment identifiers of the second and third flight equipment at the associated position of the current flight phase on the current route in the order of entering the current flight phase. For example, the equipment identifier of the second flight equipment may be displayed before the equipment identifier of the third flight equipment. For example, as shown in FIG14 , the flight equipment represented by the equipment identifier indicated by 1404 enters the current travel phase of the current route (i.e., the second level flight phase corresponding to the second stopover) before the flight equipment represented by the equipment identifier indicated by 1403. In the current travel phase of the current route, the equipment identifier indicated by 1404 is positioned in front of the equipment identifier indicated by 1403.

[0135] Through the above-mentioned display method, the device identifier of the flight device that enters the current driving phase first during the actual flight process can also be displayed in the front. This allows the target object to understand the relative spatial position of the flight device based on the front and rear positions of the device identifier of the flight device, and thus decide which flight device to take over and control based on the relative positions of the flight device. For example, assuming that device identifier 1 and device identifier 2 are displayed at the associated positions of the flight phase indication information corresponding to the same takeoff phase, where device identifier 1 is located in front of device identifier 2, it can be determined that the flight device corresponding to the device identifier takes off before the flight device corresponding to device identifier 2. If the flight devices corresponding to device identifier 1 and device identifier 2 are to be controlled, the flight device corresponding to device identifier 2 can be considered to be controlled first to avoid affecting the flight device corresponding to device identifier 1 when controlling the flight device corresponding to device identifier 2.

[0136] Through the display method provided in this embodiment, multiple flight devices can be managed simultaneously, and the current flight route and current flight phase of the flight device as well as the sequential positions of each flight device in the same route and the same flight phase can be accurately identified, thereby controlling the flight equipment.

[0137] Current drone management solutions map drone trajectories onto a two-dimensional map and determine whether the drones are functioning properly by observing these trajectories and the drones' warning messages. However, this approach has significant limitations: users can only observe a limited number of drones and cannot intuitively grasp their flight phases. This embodiment employs a dimensionality reduction design, enabling the target user to manage multiple drones simultaneously. Furthermore, this embodiment breaks down the drone's operational phases, enabling the target user to accurately identify the drone's flight phase and focusing on the desired flight phase and the order of different flight devices within the same flight phase.

[0138] Figure 15 is a flow chart showing a method for displaying control reference information of a flight device according to an exemplary embodiment. Referring to the method shown in Figure 15 , the control reference information display method may include the following steps.

[0139] Step S1502 displays flight phase indication information, which indicates the flight phase of the aircraft within the route. Step S1504 displays the aircraft's device identifier based on its current flight status at the location associated with the flight phase indication information corresponding to the aircraft's current flight phase for the mission. Step S1506 displays control reference information for the target aircraft in the second information display area in response to a triggering operation on the target aircraft's device identifier in the first information display area, so that the target aircraft can be controlled based on the control reference information.

[0140] In some embodiments, a first information display area and a second information display area may be displayed in a terminal device. The first information display area and the second information display area may be displayed at different positions or the same position in the same display window, or may be displayed in different display windows. The different windows may be displayed in different screens or in the same screen. This disclosure does not impose any restrictions on this.

[0141] In some embodiments, the flight phase indication information and the equipment identification of the flight equipment may be displayed in the first information display area. The control reference information of the flight equipment may be displayed in the second information display area (as shown in FIG. 17 ).

[0142] FIG16 is a flowchart illustrating a method for displaying flight equipment information according to an exemplary embodiment. Referring to FIG16 , the flight equipment information display method may include the following steps. Step S1602: In a first information display area, the stage identifiers of multiple flight stages of the flight equipment within a preset geographic range are sequentially arranged, with each flight stage corresponding to one or more routes. Step S1604: In response to a monitoring instruction, the dynamic identifier of the flight equipment is displayed at the location associated with the flight stage and route in which the flight equipment is located. Step S1606: In a second information display area, one or more of a global panel, a monitor panel, a system information panel, a flight equipment status panel, and a remote control component are displayed in blocks; the global panel is used to display a two-dimensional map of the selected geographic range, the monitor panel is used to display image transmission data of the selected flight equipment, the system information panel is used to display flight equipment notification information, the flight equipment status panel is used to display flight equipment status parameters, and the remote control component is used to take over control of the selected flight equipment.

[0143] As shown in Figure 17, in the second information display area, one or more of the global panel (such as the trajectory display area), the monitor panel (such as the flight equipment monitoring information display area), the system information panel (such as the system communication information panel), the flight equipment status panel (such as the flight equipment status panel), and the remote control component (such as the component in the remote command control panel) are displayed in blocks; among them, the global panel is used to display a two-dimensional map of the selected geographical range, the monitor panel is used to display the image transmission data of the selected flight equipment, the system information panel is used to display flight equipment notification information, the flight equipment status panel is used to display the status parameters of the flight equipment, and the remote control component is used to take over the control of the selected flight equipment.

[0144] In some embodiments, in response to the selection operation of the dynamic identification or static identification of the target aerial device, the image transmission data of the target aerial device can also be displayed on the monitor panel, and the dynamic flight trajectory of the aerial device within the selected geographical range can be displayed on the two-dimensional map.

[0145] In some embodiments, the layout of the second information display area can be as shown in Figure 17, but any layout that can display control reference information can be within the scope of protection of this disclosure. In some embodiments, information can be pre-filled in Figure 17 to generate the schematic diagram shown in Figure 18. Figure 18 is a schematic diagram of an interface when a display task is not received according to an exemplary embodiment. In the interface shown in Figure 18, there can be displayed a geographical range name display area indicated by 1801, a weather information display area within the geographical range indicated by 1802, a device status display area indicated by 1803, a map indicated by 1804, a no-fly zone in the map indicated by 1805, a no-parking zone in the map indicated by 1806, an unactivated control control indicated by 1807, etc. Areas with no information temporarily can be displayed as empty.

[0146] In some embodiments, the flying device may include a target flying device. In some embodiments, the flying device in the first information display area may be triggered so as to view control reference information of the flying device so as to control the flying device.

[0147] Among them, the control reference information of the target flight equipment can be information that can serve as a reference when controlling the target flight equipment. The control reference information of the target flight equipment can include information of the target flight equipment, and can also include information other than the target flight equipment. This disclosure does not impose any restrictions on this.

[0148] In some embodiments, the terminal device can display the control reference information of the target aircraft device in the second information display area (as shown in Figure 18) in response to the trigger operation of the device identification of the target aircraft device in the first information display area (the specific display effect can refer to the schematic diagram shown in Figure 20), so as to control the target aircraft device according to the control reference information of the target aircraft device.

[0149] In some embodiments, the control reference information of the target aircraft device may include flight trajectory information of the target aircraft device displayed in a map in the second information display area, and / or multimedia information collected by the target aircraft device displayed in the second information display area, and / or device status information of the target aircraft device displayed in the second information display area.

[0150] Figure 19 is a flowchart illustrating a method for displaying flight equipment information, according to an exemplary embodiment. Referring to Figure 19 , the flight equipment information display method may include the following steps: Step S1902: In a first information display area, stage identifiers for multiple flight stages of a flight equipment within a preset geographical range are sequentially arranged, with each flight stage corresponding to one or more routes. The preset geographical range may include a target geographical range. Step S1904: In response to a monitoring instruction, a dynamic identifier of the flight equipment is displayed at a location associated with the flight stage and route of the flight equipment. Step S1906: A static identifier of the flight equipment within the target geographical range is displayed in a preset area of ​​the first information display area. Step S1908: In response to selecting the dynamic identifier or static identifier of a target flight equipment, status information and / or a control status switch for the target flight equipment is displayed in the first information display area. The status information includes one or more of the following: equipment model, mission type, flight status, takeoff time, originating airport, and control status.

[0151] As shown in Figure 23, the status information of the target flight equipment and / or the control status switching control (such as the "take over" control 2301) can be displayed in the first information display area. The status information includes one or more of the equipment model, mission type, flight status, take-off time, starting airport and control status.

[0152] Step S1910: In response to a triggering operation on a control state switching control, the control state of the target aircraft is switched.

[0153] In some embodiments, switching the control state of the target flight device includes switching the control state of the target flight device to a takeover state, and in response to a triggering operation on the control state switching control, also includes: activating the remote control component to control the target flight device (such as activating the remote control component "alternative landing", "hover" and other control components of the target device in Figure 20).

[0154] In some embodiments, when the device identification of the target aircraft device is triggered in the first information display area, the control reference information of the target aircraft device may be displayed in the display interface shown in FIG. 20 .

[0155] As shown in Figure 20, multimedia information collected by the target flight equipment (such as video collected by the flight equipment through a video collector during flight, etc.) can be displayed at the position indicated by 2001; the device status information corresponding to the target flight equipment can be displayed at the position indicated by 2002; the activated control control or the inactivated control control can be displayed at the position indicated by 2003, wherein the activated control control can be used to control the target flight equipment; the warning information of the target flight equipment can be displayed at the position indicated by 2004; the "start takeover" control can be displayed at the position indicated by 2005, through which the target flight equipment can be taken over and controlled; the meteorological information within the geographical range where the target flight equipment is located can be displayed at the position indicated by 2006; the flight trajectory of the flight equipment within the geographical range where the target equipment is located can be displayed on the map, such as the flight trajectory of the target flight equipment indicated by 2007 and the flight trajectory of another flight equipment within the geographical range where the target flight equipment is located indicated by 2008.

[0156] In some embodiments, the aerial device may further include a plurality of first aerial devices, wherein the plurality of first aerial devices and the target aerial device may be arranged to fly within the same geographical range.

[0157] In which, in response to a trigger operation for the device identification of the target aircraft device in the first information display area, the control reference information of the target aircraft device is displayed in the second information display area, including: in response to a trigger operation for the device identification of the target aircraft device in the first information display area, the control reference information of the target aircraft device and at least part of the control reference information of the first aircraft device are displayed in the second information display area, so as to control the target aircraft device according to at least part of the control reference information of the first aircraft device and the control reference information of the target aircraft device.

[0158] In some embodiments, at least part of the control reference information of the first flying device may include flight track information of the first flying device displayed in a map in the second information display area.

[0159] As shown in Figure 20, the flight trajectory of the selected target flying device (such as the flight trajectory indicated by 2007) can be displayed in a selected state (for example, the selected state is displayed in a dark color), and the flight trajectory of the unselected first flying device (such as the flight trajectory indicated by 2008) can be displayed in an unselected state (for example, the selected state is displayed in a light color).

[0160] In some embodiments, the flight trajectory of the first device in the second information display area can be triggered to switch the control reference information of the target aircraft displayed in the second information display area to the control reference information of the first aircraft. Alternatively, the device identifier of the first aircraft in the first information display area can be triggered to switch the control reference information of the target aircraft displayed in the second information display area to the control reference information of the first aircraft.

[0161] In some embodiments, the terminal device can respond to a trigger operation on the flight trajectory information of the first flight device in the second information display area, display the control reference information of the first flight device in the second information display area, and convert the flight trajectory information of the first flight device from an unselected state to a selected state in the map, and convert the flight trajectory information of the target flight device from a selected state to an unselected state.

[0162] In some embodiments, the terminal device can display the control reference information of the first flight device in the second information display area in response to a trigger operation on the device identification of the first flight device in the first information display area, and convert the flight trajectory information of the first flight device from an unselected state to a selected state in the map, and convert the flight trajectory information of the target flight device from a selected state to an unselected state.

[0163] In some embodiments, remote control controls for the flight equipment (such as the alternate landing control control, hovering control control, and parachute opening control control indicated by 2003 in FIG. 20 ) may be displayed in the second information display area.

[0164] In some embodiments, when the device identification corresponding to the target flight device is triggered, the control widget in the second information display area may be activated or deactivated ( FIG. 20 shows a deactivated control widget).

[0165] The triggered target flight device can be controlled through the activated control component.

[0166] In some embodiments, the takeover control corresponding to the target aircraft device in the second information display area can be triggered (such as the "Start Takeover" control indicated by 2005 in FIG. 20 ) to activate the control control, thereby controlling the triggered target aircraft device through the control control. The control control can also be activated using the method shown in FIG. 21 .

[0167] Figure 21 is a flowchart illustrating a method for activating a control element, according to an exemplary embodiment. Referring to Figure 21 , the control element activation method may include the following steps: Step S2102: Displaying an inactive control element in the second information display area. Step S2104: Displaying a takeover control element for the target aircraft device in the first information display area in response to a triggering operation for the device identifier of the target aircraft device.

[0168] FIG22 is a flowchart illustrating a method for displaying flight equipment information according to an exemplary embodiment. Referring to FIG22 , the flight equipment information display method may include the following steps. Step S2202: In a first information display area, the stage identifiers of multiple flight stages of the flight equipment within a preset geographic range are sequentially arranged, with each flight stage corresponding to one or more routes. Step S2204: In response to a monitoring instruction, the dynamic identifier of the flight equipment is displayed at the location associated with the flight stage and route in which the flight equipment is located. Step S2206: In a second information display area, one or more of a global panel, a monitor panel, a system information panel, a flight equipment status panel, and a remote control component are displayed in blocks; the global panel is used to display a two-dimensional map of the selected geographic range, the monitor panel is used to display image transmission data of the selected flight equipment, the system information panel is used to display flight equipment notification information, the flight equipment status panel is used to display flight equipment status parameters, and the remote control component is used to take over control of the selected flight equipment. Step S2208: In response to the selection of the dynamic or static identifier of the target aircraft device, the status information and / or control status switching control of the target aircraft device are displayed in the first information display area. The status information includes one or more of the device model, mission type, flight status, take-off time, starting airport, and control status. Step S2210: In response to the selection of the dynamic or static identifier of the target aircraft device, the image transmission data of the target aircraft device is displayed on the monitor panel, and the dynamic flight trajectory of the aircraft device within the selected geographical range is displayed on the two-dimensional map. Step S2212: In response to the triggering operation of the control status switching control, the control state of the target aircraft device is switched, and the remote control component is activated to control the target aircraft device.

[0169] Below, the present disclosure will explain and illustrate the flight equipment information display method proposed in the present disclosure in conjunction with the application scenario of drone (a type of flight equipment) delivery.

[0170] In some embodiments, there are multiple flying devices, and the flying devices may include a target flying device. The method may also include: in response to a selection operation of a dynamic identifier or a static identifier of the target flying device, displaying status information and / or a control status switching control of the target flying device in a first information display area, the status information including one or more of the device model, mission type, flight status, take-off time, starting airport and control status.

[0171] In some embodiments, the above-mentioned method for displaying aircraft information may include: switching the control state of the target aircraft in response to a triggering operation on a control state switching control.

[0172] In some embodiments, a target object can trigger a target aircraft device identifier in the first information display area. In response to the triggering operation for the target aircraft device identifier, the terminal device can display a takeover control for the target aircraft device in the first information display area. As shown in FIG23 , if device identifier 3302 is triggered, status information and / or a control state switching control (such as the control indicated in FIG2301 ) for the aircraft device corresponding to device identifier 3302 can be displayed.

[0173] In some embodiments, after the "Take Over" control is triggered, a "Confirm Take Over" control indicated by 2401 as shown in FIG. 24 will also be displayed in response to the triggering operation of the "Take Over" control.

[0174] The target object can trigger the takeover control in the first information display area (either the "Takeover" control shown in Figure 23, or the "Confirm Takeover Control" shown in Figure 24); the terminal device responds to the trigger operation for the takeover control, so that the device identifier of the target aircraft device in the first information display area is displayed in a taken-over state (as shown in Figure 25, a "+" mark appears in the upper right corner of the device identifier indicated by 2501, and the "+" mark represents that the aircraft device corresponding to the device identifier indicated by 2501 has been taken over), and the control control in the second information display area is converted from an inactive state (2003 in Figure 20 indicates an active control control) to an active state (2601 in Figure 26 indicates an active control control) so that the target aircraft device can be controlled using the active control control.

[0175] In some embodiments, the device identification of the taken-over aircraft device is triggered in the first information display area, and an "end takeover" control of the taken-over aircraft device (such as the "end takeover" control indicated by 2701 in Figure 27) can also be displayed. Through this "end takeover" control, the takeover of the aircraft device can be ended, and at the same time, the control control corresponding to the aircraft device that has been taken over can be switched from an activated state to an inactivated state.

[0176] FIG28 is a flow chart showing a method for displaying drone device information according to an exemplary embodiment. Referring to FIG28 , the drone device display method may include the following steps.

[0177] Step S2802, waiting for the task.

[0178] In some embodiments, waiting for a task may refer to waiting for a drone to accept a task. When a drone receives a flight delivery task, the terminal device will receive a display task for the drone that has accepted the delivery task. In some embodiments, the interface for managing drones can be divided into a main screen and a secondary screen. During the waiting task phase (drone waiting for delivery tasks), the main screen is shown in Figure 18, and the secondary screen is shown in Figure 13. The main screen (as shown in Figure 18) displays weather data, virtual resources (no-fly zones, no-parking zones, etc.), airport equipment, etc. for the currently selected business district (a business district can be a geographical area). Parts with no data are displayed as blank.

[0179] On the secondary screen, the business districts that the target subject needs to manage are displayed in a tiled format, allowing users to simultaneously manage multiple drones in different business districts. The secondary screen utilizes a dimensionality reduction design approach, designing the drone's route in two dimensions. The specific rule is to plot the drone's route in each business district in chronological order (for example, the chronological order of arrival at a certain flight phase), and then break the route down into different phases. As shown in Figure 13, a business district can contain one, two, or more routes. A route can be divided into multiple sub-routes, each of which can be divided into the drone's takeoff and ascent phase from the merchant's airport, the drone's level flight phase, the drone's precise descent to the user's airport, the drone's takeoff and ascent phase from the user's airport, the drone's level flight phase, and the drone's precise descent to the merchant's airport. In some embodiments, in the three-stage meal delivery mode, the drone's takeoff and ascent phase from the merchant's airport can be further divided into the drone's meal pickup phase and the drone's ascent phase. This segmentation approach provides the target subject with more precise drone flight phase management services.

[0180] Step S2804: display drone information.

[0181] When a drone receives a flight delivery mission, the terminal device will receive a drone information display task for the drone that has accepted the mission. When receiving a drone information display task, the main screen will display as shown in Figure 14, and the secondary screen will display as shown in Figure 20. As shown in Figure 20, the secondary screen's display area is divided into six areas. Area 1 is the trajectory display area, which renders the drone, route, and other elements of the currently selected business district; Area 2 is the flight equipment monitoring information display area, which displays real-time drone image transmission information and supports operations such as switching drones; Area 3 is the system communication information panel, which displays drone alarms and notifications; Area 4 is the flight equipment status panel, which displays various drone status parameters; Area 5 is the remote command control panel, which integrates drone control commands; and Area 6 is the account / title panel, which displays personal information. The secondary screen displays the actual drone operation status in each business district, including selected drones (green) and abnormal drone states (drones with Class 1 alarms (red) or Class 2 alarms (yellow)).

[0182] Step S2806: Determine whether the drone is abnormal.

[0183] If it is determined based on the device identification of the drone that there is no abnormal drone, step S2804 is executed in a loop.

[0184] If it is determined based on the device identification of the drone that there is a drone with abnormal flight, step S2808 is executed to take over the abnormal drone.

[0185] In some embodiments, the target user can click on a static or dynamic icon in the drone list on the secondary screen to select a drone to view its detailed information, and simultaneously connect the selected drone's image transmission to the main screen for display. If a drone exhibits abnormal behavior, the secondary screen can promptly detect it and choose to take over, and then operate the drone on the main screen.

[0186] In some embodiments, if it is determined based on the identifier corresponding to the drone that a certain drone has an abnormality (it may be an abnormality in the equipment, an abnormality in the trajectory, or an abnormality in the weather), it can be decided whether to take over the abnormal drone based on the flight phase of the drone and the sequence of multiple drones in the flight phase.

[0187] After taking over the drone, the user can issue commands to the current drone to ensure the drone lands safely. When the drone lands safely, the user can exit the takeover to end the management process of the drone.

[0188] In the above embodiment, on the one hand, the route map is split and displayed using the flight stage, and the drone information is displayed by dimensionality reduction, so that the flight stage information of multiple drones can be displayed simultaneously on the secondary screen, which makes it convenient to monitor the drones in combination with the drone's identification status and flight stage, and to decide which drone to focus on or control in combination with the drone's identification status and flight stage; on the other hand, by using a multi-screen approach to manage the drone fleet, the main screen can display the detailed information of the selected drone according to the operation in the secondary screen, so that the target object can control the drone according to the detailed information of the drone in the main screen.

[0189] Based on the same inventive concept, the present disclosure also provides a flight equipment information display device, as shown in the following embodiment. Since the principles of the device embodiment are similar to those of the above-mentioned method embodiment, the implementation of the device embodiment can refer to the implementation of the above-mentioned method embodiment, and the repeated parts will not be repeated.

[0190] FIG29 is a block diagram of a flight equipment information display device according to an exemplary embodiment. Referring to FIG29 , a flight equipment information display device 2900 provided by an embodiment of the present disclosure may include: a stage identification display module 2901 and a dynamic identification display module 2902 .

[0191] Among them, the stage identification display module 2901 can be used to arrange the stage identifications of multiple flight stages of the flight equipment within a preset geographical range in sequence in the first information display area, and each flight stage corresponds to one or more routes; the dynamic identification display module 2902 can be used to respond to monitoring instructions and display the dynamic identification of the flight equipment at the associated position of the flight stage and route of the flight equipment.

[0192] In some embodiments, there are multiple preset geographical ranges, and the stage identifiers corresponding to the multiple preset geographical ranges are arranged horizontally or vertically in the first information display area; the stage identifiers of multiple flight stages are arranged horizontally or vertically in the first information display area; and multiple routes in the same flight stage are arranged vertically.

[0193] In some embodiments, the flight equipment information display device 2900 may further include: a static identification display module.

[0194] In some embodiments, the preset geographic range includes a target geographic range.

[0195] The static identification display module may be configured to display the static identification of the flight equipment within the target geographical range in a preset area in the first information display area after responding to the monitoring instruction.

[0196] In some embodiments, the dynamic identifier and / or the static identifier are also used to characterize the monitoring status of the flight equipment, and the monitoring status includes a normal state, a selected state, and one or more abnormal states; wherein the selected state is used to characterize that the dynamic identifier and / or the static identifier has been selected, and the abnormal state is used to characterize that an abnormality has occurred in the flight equipment.

[0197] In some embodiments, there are multiple flight devices, including a target flight device, and the flight device information display device 2900 may further include: a flight status information display module.

[0198] Among them, the flight status information display module can be used to display the status information and / or control status switching control of the target flight equipment in the first information display area in response to the selection operation of the dynamic identification or static identification of the target flight equipment. The status information includes one or more of the equipment model, mission type, flight status, take-off time, starting airport and control status.

[0199] In some embodiments, the flight equipment information display device 2900 may further include: a control state switching module.

[0200] The control state switching module may be configured to switch the control state of the target flight device in response to a triggering operation on the control state switching control.

[0201] In some embodiments, the flight equipment information display device 2900 may further include a second information display area display module.

[0202] Among them, the second information display area display module can be used to display one or more of the global panel, monitor panel, system information panel, flight equipment status panel, and remote control component in blocks in the second information display area in response to a monitoring instruction; wherein the global panel is used to display a two-dimensional map of a selected geographical range, the monitor panel is used to display image transmission data of a selected flight equipment, the system information panel is used to display flight equipment notification information, the flight equipment status panel is used to display status parameters of the flight equipment, and the remote control component is used to take over control of the selected flight equipment.

[0203] In some embodiments, the flight equipment information display device 2900 may also include a video transmission information display module.

[0204] Among them, the image transmission information display module can be used to display the image transmission data of the target aircraft device on the monitor panel in response to the selection operation of the dynamic identification or static identification of the target aircraft device, and display the dynamic flight trajectory of the aircraft device within the selected geographical range on the two-dimensional map.

[0205] In some embodiments, switching the control state of the target aircraft device includes switching the control state of the target aircraft device to a takeover state, and in response to a triggering operation on the control state switching control, further includes: activating the remote control component to control the target aircraft device.

[0206] Since the functions of the device 2900 have been described in detail in the corresponding method embodiments, the present disclosure will not elaborate on them here.

[0207] Figure 30 shows a schematic diagram of the structure of the electronic device suitable for realizing the embodiment of the present disclosure. It should be noted that the electronic device 3000 shown in Figure 30 is only an example, and the function and scope of use of the embodiment of the present disclosure should not be subject to any restriction. As shown in Figure 30, the electronic device 3000 includes a central processing unit (CPU) 3001, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 3002 or the program loaded into the random access memory (RAM) 3003 from the storage part 3008. In RAM 3003, various programs and data required for the operation of the electronic device 3000 are also stored. CPU 3001, ROM 3002 and RAM 3003 are connected to each other by bus 3004. Input / output (I / O) interface 3005 is also connected to bus 3004. The following components are connected to the I / O interface 3005: an input section 3006 including a keyboard, a mouse, and the like; an output section 3007 including devices such as a cathode ray tube (CRT), a liquid crystal display (LCD), and a speaker; a storage section 3008 including a hard disk; and a communication section 3009 including a network interface card such as a LAN card or a modem. The communication section 3009 performs communication processing via a network such as the Internet. A drive 3010 is also connected to the I / O interface 3005 as needed. Removable media 3011, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, and the like, is installed in the drive 3010 as needed, so that a computer program read therefrom can be installed into the storage section 3008 as needed. In particular, according to embodiments of the present disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a computer-readable storage medium, the computer program containing computer program instructions for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network via the communication section 3009 and / or installed from the removable medium 3011. When the computer program is executed by the central processing unit (CPU) 3001, the above-described functions defined in the system of the present disclosure are performed.

[0208] As another aspect, the present disclosure further provides a computer-readable storage medium, which may be included in the device described in the above embodiments, or may exist independently and not be incorporated into the device. The computer-readable storage medium carries one or more programs, and when executed by the device, the device implements functions including: sequentially arranging, in a first information display area, phase identifiers of multiple flight phases of an aircraft within a preset geographic range, each flight phase corresponding to one or more routes; and displaying, in response to a monitoring instruction, a dynamic identifier of the aircraft at a location associated with the flight phase and route in which the aircraft is located.

[0209] According to one aspect of the present disclosure, a computer program product or computer program is provided, which includes computer program instructions stored in a computer-readable storage medium. The computer program instructions are read from the computer-readable storage medium, and a processor executes the computer program instructions to implement the methods provided in the various optional implementations of the above-mentioned embodiments. It should be understood that the present disclosure is not limited to the detailed structures, drawings, or implementation methods shown herein. On the contrary, the present disclosure is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the appended claims.

Claims

1. A method for displaying flight device information, characterized in that, Including: In the first information display area, stage identifiers of multiple flight stages of a flight device within a preset geographical range are arranged in sequence, and each of the flight stages corresponds to one or more air routes; In response to a monitoring instruction, display the dynamic identifier of the flight device at an associated position of the flight stage and the air route where the flight device is located.

2. The method according to claim 1, wherein There are multiple preset geographical ranges, and the stage identifiers corresponding to the multiple preset geographical ranges are arranged horizontally or vertically in the first information display area; the stage identifiers of the multiple flight stages are arranged horizontally or vertically in the first information display area; multiple air routes in the same flight stage are arranged vertically.

3. The method according to claim 2, wherein The preset geographical range includes a target geographical range. After the response to the monitoring instruction, it further includes: displaying the static identifier of the flight device within the target geographical range in a preset area in the first information display area.

4. The method according to claim 3, wherein The dynamic identifier and / or the static identifier are also used to represent the monitoring state of the flight device, and the monitoring state includes a normal state, a selected state, and one or more abnormal states; wherein, the selected state is used to represent that the dynamic identifier and / or the static identifier are subjected to a selection operation, and the abnormal state is used to represent that the flight device has an abnormality.

5. The method according to claim 3, wherein There are multiple flight devices, and the flight devices include a target flight device. The method includes: In response to a selection operation on the dynamic identifier or the static identifier of the target flight device, display the status information and / or a control state switching control of the target flight device in the first information display area, and the status information includes one or more of a device model, a task type, a flight status, a takeoff time, a starting airport, and a control state.

6. The method according to claim 5, characterized in that Including: In response to a triggering operation on the control state switching control, switch the control state of the target flight device.

7. The method according to claim 6, characterized in that, When responding to the monitoring instruction, the method further includes: in a second information display area, block-display one or more of a global panel, a monitor panel, a system information panel, a flight device status panel, and a remote control component; wherein, the global panel is used to display a two-dimensional map of a selected geographical range, the monitor panel is used to display the video transmission data of a selected flight device, the system information panel is used to display flight device notification information, the flight device status panel is used to display the status parameters of the flight device, and the remote control component is used to take over the control of the selected flight device.

8. The method according to claim 7, characterized in that, When responding to a selection operation on the dynamic identifier or the static identifier of the target flight device, it further includes: displaying the video transmission data of the target flight device on the monitor panel, and displaying the dynamic flight trajectories of the flight devices within the selected geographical range on the two-dimensional map.

9. The method according to claim 7, wherein Switching the control state of the target flight device includes switching the control state of the target flight device to a takeover state. When responding to a triggering operation on the control state switching control, it further includes: activating the remote control component to control the target flight device.

10. An electronic device, characterized in that, Including: A memory and a processor; the memory is used for storing computer program instructions; the processor calls the computer program instructions stored in the memory to implement the method according to any one of claims 1-9.

Citation Information

Patent Citations

  • Design method of cooperative driving aircraft system and the system

    CN105096662A

  • Device used for RNP airborne performance monitoring and warning

    CN106403995A

  • Integrated monitoring system and method oriented for multi-UAV ground station mission flight

    CN110764521A

  • Unmanned aerial vehicle route planning data visualization and man-machine interaction method and system

    CN113360055A

  • Graphic airways displays for flight management systems

    US20050137758A1