Unmanned aerial vehicle interaction method, and program product

Abstract

The present disclosure relates to the technical fields of unmanned aerial vehicles and logistics delivery, and provides an unmanned aerial vehicle interaction method and a program product. The method comprises: after an unmanned aerial vehicle is successfully connected, displaying a safety protection switch on a first interface, wherein the safety protection switch is in an off state, and the off state is used for indicating that the unmanned aerial vehicle is in a non-safety protection mode; in response to a selection operation on the safety protection switch, displaying a first pop-up window, wherein the first pop-up window comprises a first control and a second control, and the first control is used for determining to continue to turn on the safety protection switch; in response to a selection operation on the first control, closing the first pop-up window, enabling the first control of the first interface to be in an on state, and controlling the unmanned aerial vehicle to send a physical feedback signal; and adjusting a first guidance window on the first interface to be in an active state, wherein the first guidance window is used for guiding ground crew to complete a ground operation on the unmanned aerial vehicle.

Description

Interaction methods and application products for drones

[0001] This application claims priority to Chinese Patent Application No. 202411641989.4, filed on November 15, 2024, entitled "Interactive Method and Program Product for Unmanned Aerial Vehicles", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This disclosure relates to the fields of unmanned aerial vehicle (UAV) technology and logistics delivery technology, and in particular to an interaction method and program product for UAVs. Background Technology

[0003] With the rapid development of technology, the application scope of drones is constantly expanding, especially in the field of logistics and delivery, where they have shown enormous potential. From food delivery to express courier services, drones, with their high efficiency and speed, have become one of the important development directions for future delivery methods. Summary of the Invention

[0004] This disclosure provides an interaction method and program product for drones, which at least to some extent reduces the harm caused by drones to relevant personnel during human-computer interaction and improves the safety of drone-human interaction.

[0005] According to one aspect of this disclosure, an interaction method for a drone is provided, comprising: after successfully connecting the drone, displaying a safety protection switch on a first interface, wherein the safety protection switch is in a closed state, the closed state indicating that the drone is in a non-safety protection mode; in response to a selection operation of the safety protection switch, displaying a first pop-up window, the first pop-up window including a first control and a second control, the first control being used to determine whether to continue to turn on the safety protection switch, and the second control being used to determine whether to turn on the safety protection switch; in response to a selection operation of the first control, closing the first pop-up window, turning the first control on the first interface into an open state, and controlling the drone to emit a physical feedback signal, the open state indicating that the drone is in a safety protection mode; and adjusting a first guidance window on the first interface to an active state, the first guidance window being used to guide ground personnel to complete ground operations on the drone.

[0006] In one feasible embodiment of this disclosure, the first guidance window includes a third control and a prompt message, the prompt message being used to indicate that the ground support operation needs to be completed within a preset time period after selecting the third control; the method further includes: in response to the selection operation of the third control, displaying countdown information corresponding to the preset time period on the first interface, the countdown information being suspended on the first interface; after the countdown ends, displaying a second pop-up window, the second pop-up window including a fourth control; in response to the selection operation of the fourth control, closing the second pop-up window, confirming that the ground support operation is completed.

[0007] In one feasible embodiment of this disclosure, the ground handling operation includes loading cargo. The method further includes: in response to a selection operation of a third control, controlling the drone to open a cargo space so that ground personnel can load cargo into the drone's cargo space; the second pop-up window also includes a fifth control; before determining that the ground handling operation is completed, the method further includes: in response to a selection operation of the fifth control, controlling the drone to adjust the placement position of the cargo in the cargo space.

[0008] In one feasible embodiment of this disclosure, the method further includes: in response to the completion of ground support operations, adjusting the second guidance window of the first interface from an inactive state to an active state, the second guidance window being used to guide ground personnel to move away from the drone and turn off the safety protection switch; in response to the selection operation of the safety protection switch, displaying a third pop-up window, the third pop-up window including a sixth control and a seventh control, the sixth control being used to determine whether to continue turning off the safety protection switch, and the seventh control being used to determine whether to turn off the safety protection switch; in response to the selection operation of the sixth control, adjusting the third guidance window of the first interface from an inactive state to an active state, the third guidance window being used to guide ground personnel to initiate a drone flight mission, the third guidance window including an eighth control; in response to the selection operation of the eighth control, displaying a fourth pop-up window, the fourth pop-up window including a sliding control; in response to the sliding operation of the sliding control, determining that the ground personnel have completed the ground support task and initiated a drone flight mission, the ground support task including ground support operations.

[0009] In one feasible implementation of this disclosure, the ground support task is associated with the drone delivery task, and the fourth pop-up window also displays order information, which includes one or more of the following: departure airport, landing airport, drone call sign, order number, cargo weight, and user identifier.

[0010] In one feasible embodiment of this disclosure, after the goods have been loaded, the first guidance window also displays a goods position adjustment control, which is used to control the drone to adjust the placement position of the goods in the storage space; the state of the goods position adjustment control is associated with the state of the safety protection switch, the goods position adjustment control is active when the safety protection switch is on, and inactive when the safety protection switch is off; when the safety protection switch is on, the method further includes: in response to a long press operation on the goods position adjustment control, controlling the drone to adjust the placement position of the goods in the storage space.

[0011] In one feasible embodiment of this disclosure, after successfully connecting the drone, before displaying the safety protection switch on the first interface, the method further includes: displaying multiple airports on the second interface; in response to a selection operation of a target airport among the multiple airports, jumping to a third interface, the third interface including a ground support task list; in response to a selection operation of a ground support task in the ground support task list, jumping to the first interface, where a fourth guidance window is active, the fourth guidance window being used to guide ground support personnel to confirm whether the ground support task corresponds to the equipment used for ground support operations; displaying a fifth guidance window on the first interface, the fifth guidance window being used to display the drone's equipment self-test status; adjusting the first guidance window on the first interface to an active state, including: adjusting the first guidance window to an active state when the equipment self-test status is normal.

[0012] In one feasible implementation of this disclosure, ground support tasks are associated with drone delivery tasks, and each ground support task in the ground support task list is associated with a first delivery control and a second delivery control; in response to a selection operation on a ground support task in the ground support task list, the method jumps to a first interface, including: in response to a selection operation on the first delivery control of a ground support task, the method jumps to the first interface; before jumping to the first interface in response to a selection operation on a ground support task in the ground support task list, the method further includes: in response to a long press operation on the second delivery control of a ground support task, the drone delivery task associated with the ground support task is converted into a manual delivery task.

[0013] In one feasible embodiment of this disclosure, after successfully connecting the drone, before displaying the safety protection switch on the first interface, the method further includes: displaying multiple takeoff airports on a fourth interface; displaying multiple landing airports in response to a selection operation of a first airport among the multiple takeoff airports; displaying multiple drones at the first airport in response to a selection operation of a second airport among the multiple landing airports; connecting with the selected drone in response to a selection operation of a drone in a pending connection state among the multiple drones; before adjusting the first guidance window of the first interface to an active state, the method further includes: displaying a fifth guidance window on the first interface, the fifth guidance window being used to display the drone's device self-test status; displaying a sixth guidance window on the first interface, the sixth guidance window including a ground crew input box for the landing airport, the ground crew input box being associated with a ground crew menu, the ground crew input box being used to fill in the ground crew to be notified; displaying the selected ground crew in the ground crew input box in response to a selection operation of ground crew in the ground crew menu; adjusting the first guidance window of the first interface to an active state includes: adjusting the first guidance window to an active state in response to a selection operation of ground crew in the ground crew menu.

[0014] According to another aspect of this disclosure, an interactive device for a drone is provided, comprising: a first display module, configured to display a safety protection switch on a first interface after successful connection to the drone, wherein the safety protection switch is in a closed state, and the closed state indicates that the drone is in a non-safety protection mode; a second display module, configured to display a first pop-up window in response to a selection operation of the safety protection switch, the first pop-up window including a first control and a second control, the first control being configured to determine whether to continue to turn on the safety protection switch, and the second control being configured to determine whether to turn on the safety protection switch; a control module, configured to close the first pop-up window in response to a selection operation of the first control, thereby turning on the first control on the first interface, and controlling the drone to emit a physical feedback signal, the on state indicating that the drone is in a safety protection mode; and a third display module, configured to activate a first guidance window on the first interface, the first guidance window being used to guide ground personnel to complete ground operations on the drone.

[0015] According to another aspect of this disclosure, an electronic device is provided, comprising: a memory for storing instructions; and a processor for calling the instructions stored in the memory to implement the above-described interaction method of the unmanned aerial vehicle.

[0016] According to another aspect of this disclosure, a computer-readable storage medium is provided that stores computer instructions thereon, which, when executed by a processor, implement the above-described interaction method for a drone.

[0017] According to another aspect of this disclosure, a computer program product is provided, which stores instructions that, when executed by a computer, cause the computer to implement the above-described interaction method for the unmanned aerial vehicle.

[0018] According to another aspect of this disclosure, a chip is provided, including at least one processor and an interface; the interface is used to provide program instructions or data to the at least one processor; the at least one processor is used to execute the program instructions to implement the above-described UAV interaction method.

[0019] The drone interaction method and program product provided in this disclosure, when ground crew selects to activate the safety protection switch, will display a first pop-up window containing two options (i.e., a first control and a second control), clarifying the ground crew's operational intent and avoiding the possibility of misoperation. This design allows users time to think before making important decisions, further enhancing system security. Once the user selects to activate the safety protection mode, not only will there be a corresponding status change on the interface, but the drone will also emit physical feedback signals. This real-time two-way confirmation mechanism helps improve the user experience and also allows ground crew to clearly know the drone's status before approaching it, thus taking appropriate safety measures. Furthermore, the first guidance window will only be activated after the safety protection switch is turned on, which can also guide ground crew to develop the habit of activating the safety protection switch first, reducing the possibility of accidents caused by ground crew approaching the drone due to the safety protection switch not being activated.

[0020] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0021] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0022] Obviously, the accompanying drawings described below are merely some embodiments of this disclosure. Those skilled in the art can obtain other drawings based on these drawings without any creative effort.

[0023] Figure 1 shows a flowchart of an exemplary interaction method for a drone according to an embodiment of this disclosure;

[0024] Figure 2 shows a schematic diagram of an exemplary first interface in an embodiment of this disclosure;

[0025] Figure 3 illustrates an exemplary first pop-up window in an embodiment of this disclosure;

[0026] Figure 4 illustrates a schematic diagram of an exemplary first guidance window in an embodiment of this disclosure;

[0027] Figures 5a, 5b and 5c illustrate schematic diagrams of interface changes during the loading process in an exemplary embodiment of this disclosure;

[0028] Figure 6 illustrates a schematic diagram of an exemplary second guidance window in an embodiment of this disclosure;

[0029] Figure 7 shows a schematic diagram of the interface changes when an exemplary safety protection switch is turned off in an embodiment of this disclosure;

[0030] Figure 8 illustrates a schematic diagram of an exemplary third guidance window in an embodiment of this disclosure;

[0031] Figure 9 illustrates an exemplary fourth pop-up window in an embodiment of this disclosure;

[0032] Figure 10 shows another exemplary first interface schematic diagram in an embodiment of this disclosure;

[0033] Figure 11 shows a schematic diagram of an exemplary ground support task list in an embodiment of this disclosure;

[0034] Figure 12 shows a schematic diagram of another exemplary first interface in an embodiment of the present disclosure;

[0035] Figure 13 shows a schematic diagram of yet another exemplary first interface in an embodiment of this disclosure;

[0036] Figure 14 shows a schematic diagram of an exemplary drone interaction device according to an embodiment of the present disclosure;

[0037] Figure 15 shows a schematic diagram of the structure of an exemplary electronic device according to an embodiment of the present disclosure;

[0038] Figure 16 shows a schematic diagram of the hardware structure of an exemplary electronic device according to an embodiment of the present disclosure. Detailed Implementation

[0039] To make the objectives, technical solutions, and advantages of the embodiments of this disclosure clearer, the technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this disclosure, and not all of them. The components of the embodiments of this disclosure described and shown in the accompanying drawings can generally be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of this disclosure provided in the accompanying drawings is not intended to limit the scope of the claimed disclosure, but merely represents selected embodiments of this disclosure. All other embodiments obtained by those skilled in the art based on the embodiments of this disclosure without inventive effort are within the scope of protection of this disclosure.

[0040] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, users should be informed of the types, scope of use, and usage scenarios of the personal information involved in this disclosure in an appropriate manner in accordance with relevant laws and regulations, and user authorization should be obtained.

[0041] Meanwhile, it is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and related provisions.

[0042] Currently, with technological advancements and the maturity of autonomous driving technology, drones have been successfully applied in the delivery field, commonly used for food delivery, express delivery, and other similar services. However, in practical applications, drone delivery faces numerous challenges, especially in human-machine interaction. Existing drone delivery systems require human intervention in multiple stages, posing a series of safety hazards in direct or indirect interactions between drones and people, potentially causing harm. Therefore, effectively improving the safety of drone-human interaction has become a critical issue that urgently needs to be addressed.

[0043] The following detailed description of this exemplary implementation method is provided in conjunction with the accompanying drawings and embodiments.

[0044] First, this disclosure provides an interaction method for a drone. The executing entity of this drone interaction method can be a user terminal configured to execute the drone interaction method provided in this disclosure. The user terminal has a display module, which can be a display screen. In one embodiment, the executing entity of the drone interaction method can be a mobile phone with a client installed for executing the drone interaction method. In another embodiment, the executing entity of the drone interaction method can be a drone remote control with a display screen.

[0045] Figure 1 shows a flowchart of an interaction method for a drone according to an embodiment of the present disclosure. As shown in Figure 1, the interaction method for a drone provided in this embodiment of the present disclosure includes steps S101-S104.

[0046] In S101, after successfully connecting to the drone, a safety protection switch is displayed on the first interface. The safety protection switch is in the off state, which indicates that the drone is in non-safety protection mode.

[0047] The first interface can be shown in Figure 2. As can be seen from Figure 2, the first interface can also display information related to the drone's connection status, such as whether the drone is connected and the drone's battery level.

[0048] In Figure 2, the safety protection switch 201 is in the off state, which means that the drone is in the non-safety protection mode.

[0049] It should be noted that the safety protection mode in this embodiment refers to a mode used to ensure the personal safety of personnel in contact with the drone while it is on the ground. This safety protection mode can be to lock the start button to prevent accidental operation that could cause the drone to start suddenly, thereby protecting the safety of on-site personnel. In other words, it locks the power to the drone propellers to prevent the propeller rotation from causing injury to on-site personnel.

[0050] In S102, in response to the selection operation of the safety protection switch, a first pop-up window is displayed. The first pop-up window includes a first control and a second control. The first control is used to determine whether to continue to turn on the safety protection switch, and the second control is used to determine whether to turn on the safety protection switch.

[0051] The display interface corresponding to the first pop-up window can be as shown in Figure 3. The first control 301 can have a text label, such as "Confirm Open"; the second control 302 can also have a text label, such as "Cancel". In addition, the first pop-up window interface can also have a prompt message to remind the user of the operation they are performing and the possible consequences of that operation. Here, the prompt message could be: "After turning on the safety protection, you can approach the drone."

[0052] In some embodiments, the first control 301 and the second control 302 can be interconnected controls, for example, the first control 301 and the second control 302 can be selected by sliding, allowing one to be chosen. Specifically, the first pop-up window may include a sliding selection component. When the slider in the sliding selection component is in a first position, the first control 301 is in an active state and the second control 302 is in a suppressed state, i.e., the safety protection switch is turned on. When the slider is slid to a second position, the first control 301 is in a suppressed state and the second control 302 is in an active state, i.e., the safety protection switch is determined not to be turned on.

[0053] In some embodiments, the selection operation may be a user's touch input to the first control, or a voice command input by the user, or a specific gesture input by the user, or input to a physical button. The specific operation can be determined according to actual usage requirements, and this disclosure does not limit it.

[0054] The specific gesture in this embodiment can be any one of a click gesture, a swipe gesture, a drag gesture, or a pressure recognition gesture.

[0055] In S103, in response to the selection operation of the first control, the first pop-up window is closed, the first control of the first interface is turned on, and the drone is controlled to emit a physical feedback signal. The turned-on state is used to indicate that the drone is in the safety protection mode.

[0056] As shown in Figure 4, the first pop-up window is closed, and the first control 401 is turned on, thereby putting the drone into a safety protection mode.

[0057] In some embodiments, the physical feedback signal may be one or more of sound signals, light signals, or motion signals.

[0058] As an example, the aforementioned sound signal can be a beeping sound, such as a drone emitting a beeping sound or three beeps. The sound signal can also be a voice message, such as a drone uttering the message "Entering safety protection mode."

[0059] As an example, the light signal mentioned above could be a flashing light or a change in the color of the light, or it could be the light turning on when there is no light, or the light turning off when there is light.

[0060] As an example, the aforementioned action signal could be a specific action of the drone, such as retracting the propellers or lowering the cargo clamp.

[0061] In S104, the first guidance window of the first interface is activated. The first guidance window is used to guide ground crew to complete ground operations on the drone.

[0062] It should be noted that ground handling operations can include loading cargo, changing batteries, charging, maintenance, etc. For ease of description, the following text will use loading cargo as an example of ground handling operations.

[0063] It should also be noted that the aforementioned ground operations are a type of ground service task, and ground service tasks can be associated with drone delivery tasks. As an example, ground operations can include cargo loading, which is a part of a drone delivery task and also a part of the ground service task associated with that drone delivery task.

[0064] As shown in Figure 4, the first guidance window 402 is adjusted to an active state. It should be noted that the adjustment from an inactive state to an active state can mean that the content displayed in the window changes from non-executable to executable. In some embodiments, the active and inactive states can be distinguished by the different appearances of the content displayed in the window. For example, the content in the first guidance window in Figure 2 is gray, while the first guidance window 402 in Figure 4 is black.

[0065] It should be noted that the aforementioned "guidance window" refers to a display area within the first display interface, which is used to display content and controls related to a specific function. For example, the aforementioned first guidance window is used to guide ground crew in loading the drone.

[0066] It should also be noted that the terminal device for executing the UAV interaction method provided in this embodiment is the terminal device of ground staff. Ground staff generally do not have flight qualifications. When working near the UAV, if a misoperation occurs, it may cause the UAV propellers to rotate, thereby causing injury to the ground staff.

[0067] The drone interaction method provided in this disclosure, when ground crew selects to activate the safety protection switch, will display a first pop-up window containing two options (i.e., a first control and a second control), clarifying the ground crew's operational intentions and avoiding the possibility of misoperation. This design allows users time to think before making important decisions, further enhancing system security. Once the user selects to activate the safety protection mode, not only will there be a corresponding status change on the interface, but the drone will also emit physical feedback signals. This instant two-way confirmation mechanism helps improve the user experience and also allows ground crew to clearly know the drone's status before approaching it, thus taking appropriate safety measures. Furthermore, the first guidance window will only be activated after the safety protection switch is turned on, which can also guide ground crew to develop the habit of activating the safety protection switch first, reducing the possibility of accidents caused by ground crew approaching the drone when the safety protection switch is not activated.

[0068] In some embodiments, the first guidance window includes a third control and a prompt message, which prompts that the ground handling operation needs to be completed within a preset time period after selecting the third control. As an example, the ground handling operation may be loading goods, and the above information may be that the goods need to be loaded onto the drone within a preset time period after selecting the third control. As an example, as shown in Figure 5a, the prompt message may be "Please load the goods onto the drone within 3 seconds".

[0069] In some embodiments, different preset durations may correspond to different ground operations, which can encourage relevant personnel to complete ground operations within the specified time and improve the work efficiency of relevant operations.

[0070] The first guidance window, through the third control 501 and prompt message 502, clearly informs the user that after selecting the third control, cargo loading must be completed within a preset time period. This real-time guidance effectively reduces operational errors and ensures that ground staff operate according to the prescribed time and procedures.

[0071] In some embodiments, as shown in FIG5b, in response to the selection operation of the third control 501, countdown information 503 corresponding to a preset duration is displayed on the first interface, and the countdown information 503 is floating on the first interface. The display of the countdown information not only provides a sense of urgency but also ensures that ground staff can complete the task within the specified time.

[0072] As shown in Figure 5c, after the countdown ends, a second pop-up window 504 is displayed, which includes a fourth control 505. In response to a selection operation on the fourth control 505, the second pop-up window 504 closes, confirming the completion of the ground handling operation. When the ground handling operation involves loading goods, this confirmation can confirm that the goods have been loaded. This dual confirmation mechanism prevents incorrect loading of goods due to misoperation or negligence, ensuring the accuracy of the operation.

[0073] The display interface after closing the second pop-up window can be shown in Figure 6. The first guidance window can display the loading status information of the cargo, such as "loaded" and "inspection passed" in Figure 6, which respectively indicate that the cargo has been loaded onto the drone and that the ground crew has inspected the loading status of the cargo.

[0074] This disclosed embodiment, through clear guidance and real-time countdown information, enables ground staff to quickly and accurately complete cargo loading, reducing operation time and the possibility of errors, and improving overall work efficiency. From selecting the third control to confirmation after the countdown ends, and finally to the display of the loading status, the entire process provides clear guidance and feedback. This multi-level confirmation mechanism ensures the correctness and safety of each operation step, reducing potential risks.

[0075] Furthermore, the intuitive display of countdown and loading status information allows ground staff to clearly understand the current operational status at a glance, reducing operational complexity and uncertainty. Each step of the operation provides clear feedback, from confirmation after the countdown ends to the final loading status display, giving users a sense of transparency and reliability, thus enhancing the overall user experience.

[0076] In some embodiments, transferring goods to a drone can be done by attaching a cargo box to the drone's cargo clip. In the above embodiments, in response to a selection operation on a third control, the drone is also controlled to open its cargo space, allowing ground personnel to load goods into the drone's cargo space. As an example, in response to a selection operation on a third control, the drone can be controlled to open its cargo clip, allowing ground personnel to attach goods to the drone's cargo clip; specifically, this can be done by attaching a cargo box containing goods to the drone's cargo clip.

[0077] In some embodiments, as shown in FIG5c, the second pop-up window further includes a fifth control 506; in response to a selection operation on the fourth control 505, before determining that the goods have been loaded, the drone can also be controlled to adjust the placement position of the goods in the storage space in response to a selection operation on the fifth control 505. As an example, the drone can be controlled to adjust the suspension position of the goods on the cargo clamp in response to a selection operation on the fifth control 505.

[0078] It should be noted that controlling the drone to adjust the placement of goods in the storage space can be achieved by controlling the drone to toss the cargo box up, thereby adjusting the position of the cargo box. This process can also be called cargo tossing. In this embodiment of the disclosure, the goods can be stored inside the cargo box, which is suspended on the cargo clamp. The aforementioned cargo tossing can be achieved through a specific structural design that allows the cargo box to be adjusted to a more suitable position on the cargo clamp after being tossed up and then falling back down.

[0079] In some embodiments, as shown in Figure 6, after ground operations are completed, i.e., after the cargo has been loaded, the first guidance window also displays a cargo position adjustment control 601. The cargo position adjustment control 601 is used to control the drone to adjust the placement of the cargo in the storage space. The state of the cargo position adjustment control 601 is associated with the state of the safety protection switch 602. When the safety protection switch 602 is on, the cargo position adjustment control 601 is active; when the safety protection switch 602 is off, the cargo position adjustment control 601 is inactive. Discharging cargo is prohibited when the safety protection switch is off. This design prevents the cargo position adjustment control 601 from activating during drone flight due to misoperation, thereby avoiding drone flight fluctuations caused by the activation of the cargo position adjustment control 601. As an example, as shown in Figure 8, when the safety protection switch 801 is off, the cargo position adjustment control is grayed out, i.e., inactive.

[0080] In some embodiments, when the safety switch 602 is in the ON state, the above method may further include controlling the drone to adjust the placement position of the cargo in the storage space in response to a long press operation on the cargo position adjustment control 601. Designing the trigger of the cargo position adjustment control 601 as a long press operation can reduce the risk of ground staff accidentally activating the control, thereby reducing the possibility of accidental activation of the cargo position adjustment control 601 and the cargo hitting ground staff next to it.

[0081] In some embodiments, as shown in FIG6, in response to the cargo being loaded, the second guidance window 603 of the first interface is adjusted from an inactive state to an active state. The second guidance window is used to guide ground personnel to stay away from the drone and turn off the safety protection switch. The active and inactive states of the second guidance window are similar to those of the first guidance window described above, and will not be repeated here. It should be noted that, as shown in FIG2, the first interface of this embodiment may have multiple guidance windows, and the guidance windows in subsequent steps are inactive by default.

[0082] In some embodiments, as shown in FIG7, in response to the selection operation of the safety protection switch 701, a third pop-up window 702 is displayed. The third pop-up window 702 includes a sixth control 703 and a seventh control 704. The sixth control 703 is used to determine whether to continue to turn off the safety protection switch, and the seventh control 704 is used to determine whether to turn off the safety protection switch.

[0083] In some embodiments, the sixth control 703 and the seventh control 704 can be interconnected controls, for example, the sixth control 703 and the seventh control 704 can be selected by sliding, allowing one to be chosen. Specifically, the third pop-up window 702 may include a sliding selection component. When the slider in the sliding selection component is in the first position, the sixth control 703 is in an active state and the seventh control 704 is in a suppressed state, i.e., the safety protection switch remains closed. When the slider is slid to the second position, the sixth control 703 is in a suppressed state and the seventh control 704 is in an active state, i.e., the safety protection switch is turned on.

[0084] In this embodiment of the present disclosure, when ground staff select to turn off the safety protection switch, a third pop-up window containing two options (i.e., the sixth control and the seventh control) will appear, allowing ground staff to clearly understand their operating intentions, avoiding the possibility of misoperation, and further enhancing the security of the system.

[0085] As shown in Figure 8, in response to the selection operation of the sixth control 703, the safety protection switch 801 is adjusted to the closed state. In response to the selection operation of the sixth control 703, the third guidance window 802 of the first interface is adjusted from the inactive state to the active state. The third guidance window 802 is used to guide ground personnel to initiate drone flight missions. The third guidance window 802 includes the eighth control 803.

[0086] As shown in Figure 9, in response to the selection operation of the eighth control, the fourth pop-up window 901 is displayed, which includes a sliding control 902.

[0087] In response to a sliding operation on the sliding control 902, it is determined that the ground crew has completed the ground crew task and the drone flight mission is initiated. The ground crew task includes ground crew operations.

[0088] It should be noted that the embodiments disclosed herein apply to the ground mission phase of drone delivery scenarios, mainly involving the drone loading process, which can also be referred to as ground support operations, and is a type of ground support task. After the process guided by the aforementioned third guidance window is completed, that is, after the ground support personnel initiate drone delivery, i.e., initiate the drone flight mission, the ground support personnel's ground support task ends.

[0089] In the above embodiments, when ground staff finish their ground duties, they are prompted to confirm multiple times, i.e., a fourth pop-up window appears, so that the ground staff know that they are finishing their ground duties, thus avoiding the task ending due to accidental touch. In addition, the present embodiment also designs the confirmation option in the fourth pop-up window to be triggered by sliding, which further reduces the task ending due to accidental touch.

[0090] In some embodiments, ground support tasks are associated with drone delivery tasks, as shown in Figure 9. The fourth pop-up window also displays order information, which includes one or more of the following: departure airport, landing airport, drone call sign, order number, cargo weight, and user identifier. The user identifier may be the last four digits of the user's mobile phone number.

[0091] In some embodiments, after successfully connecting the drone as shown in Figure 2, before displaying the safety protection switch on the first interface, multiple airports can be displayed on the second interface; in response to the selection of a target airport among the multiple airports, the user is redirected to a third interface, which includes a ground support task list; in response to the selection of a ground support task from the ground support task list, the user is redirected back to the first interface. This first interface can be either the first interface shown in Figure 2 or the first interface shown in Figure 10.

[0092] It should be noted that the selection process for airport and ground support tasks described above can be similar to that of related technologies, and will not be described in detail here.

[0093] In some embodiments, as shown in FIG10, in response to the selection operation of a ground service task in the ground service task list, the system jumps to the first interface. In the first interface, the fourth guidance window 1001 is active. The fourth guidance window 1001 is used to guide ground staff to confirm whether the ground service task corresponds to the equipment used for the ground service operation. As an example, the ground service operation is loading goods, and the equipment used for the ground service operation can be a cargo box. As shown in FIG10, the fourth guidance window 1001 can be equipped with a barcode-linked order control. Triggering this control allows the system to scan a mark (such as a QR code) on the equipment used for the ground service operation (e.g., a cargo box), thereby confirming whether the ground service task corresponds to the cargo box and informing the system that the goods are in a loading state.

[0094] As shown in Figure 10, a fifth guidance window 1002 is displayed in the first interface. This fifth guidance window 1002 displays the self-test status of the drone device. Initially, the fifth guidance window 1002 can be inactive. Once the task in the first guidance window 1003 is completed, i.e., the drone is successfully connected, the fifth guidance window 1002 becomes active. In the above embodiment, activating the first guidance window of the first interface can be done when the drone device's self-test status is normal.

[0095] The embodiments of this disclosure, through the above-described operation of the associated cargo box and the process of inspecting the equipment, can avoid loading the wrong cargo onto the drone and reduce the situation where drone equipment problems are found after loading, resulting in the drone being unable to take off and wasting loading manpower.

[0096] In some embodiments, as shown in FIG11, each ground task in the ground task list is associated with a first delivery control 1101 and a second delivery control 1102.

[0097] The above-mentioned response to the selection operation of ground service tasks in the ground service task list, which jumps to the first interface, can be the response to the selection operation of the first delivery control 1101 of the ground service task, which jumps to the first interface.

[0098] Before navigating to the first interface, in response to the selection of a ground service task in the ground service task list, the system can also respond to a long press operation on the second delivery control 1102 of the ground service task to convert the drone delivery task associated with the ground service task into a manual delivery task. In this embodiment, setting the trigger condition for the second delivery control 1102 to a long press operation can reduce accidental touches.

[0099] In some embodiments, after successfully connecting the drone as shown in Figure 2, before displaying the safety protection switch on the first interface, multiple takeoff airports can be displayed on the fourth interface; in response to the selection operation of the first airport among the multiple takeoff airports, multiple landing airports are displayed; in response to the selection operation of the second airport among the multiple landing airports, multiple drones in the first airport are displayed; in response to the selection operation of the drone in the waiting-to-connect state among the multiple drones, a connection is established with the drone; in some embodiments, as shown in Figure 12, a drone can also be selected for connection on the first interface.

[0100] In some embodiments, before the first guidance window of the first interface is activated, a fifth guidance window may also be displayed in the first interface. The fifth guidance window is used to display the self-test status of the drone device. The fifth guidance window is similar to the description above and will not be repeated here.

[0101] As shown in Figure 13, the sixth guidance window 1301 is displayed in the first interface. The sixth guidance window includes a ground staff input box for the landing airport. The ground staff input box is associated with the ground staff menu. The ground staff input box is used to fill in the ground staff who need to be notified.

[0102] In response to the selection of ground staff in the ground staff menu, the selected ground staff member is displayed in the ground staff input box;

[0103] The aforementioned activation of the first guidance window on the first interface can be in response to the selection of ground staff in the ground staff menu.

[0104] It should also be noted that the first guidance window in the above embodiment may also include a load weight input box for inputting the weight of the load.

[0105] The embodiments shown in Figures 12 and 13 above can be used for ground crew to schedule drones. During the scheduling process, the drone may or may not be carrying a payload. When no payload is being carried, upon the appearance of the first guidance window, the user can select "load complete" using the relevant controls.

[0106] In embodiments of this disclosure, the terms "first," "second," and "third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.

[0107] Furthermore, although the steps of the method in this disclosure are described in a specific order in the accompanying drawings, this does not require or imply that the steps must be performed in that specific order, or that all the steps shown must be performed to achieve the desired result.

[0108] In some embodiments, certain steps may be omitted, multiple steps may be combined into one step for execution, or one step may be broken down into multiple steps for execution, etc.

[0109] Based on the same inventive concept, this disclosure also provides an interactive device for a drone, as described in the following embodiments. Since the principle by which this device embodiment solves the problem is similar to that of the above-described method embodiments, the implementation of this device embodiment can refer to the implementation of the above-described method embodiments, and repeated details will not be elaborated further.

[0110] Figure 14 shows a schematic diagram of an interactive device for a drone according to an embodiment of the present disclosure. As shown in Figure 14, the interactive device for the drone includes a first display module 1401, a second display module 1402, a control module 1403, and a third display module 1404.

[0111] The first display module 1401 is used to display a safety protection switch on the first interface after successfully connecting to the drone. The safety protection switch is in the off state, which indicates that the drone is in the non-safety protection mode.

[0112] The second display module 1402 is used to display a first pop-up window in response to the selection operation of the safety protection switch. The first pop-up window includes a first control and a second control. The first control is used to determine whether to continue to turn on the safety protection switch, and the second control is used to determine whether to turn on the safety protection switch.

[0113] The control module 1403 is used to respond to the selection operation of the first control, close the first pop-up window, turn the first control of the first interface into the open state, and control the drone to emit a physical feedback signal. The open state is used to indicate that the drone is in the safety protection mode.

[0114] The third display module 1404 is used to activate the first guidance window of the first interface. The first guidance window is used to guide ground crew to complete ground operations on the UAV.

[0115] The concepts of "first" and "second" mentioned in this disclosure are used only to distinguish different devices, modules or units, and are not used to define the order of functions performed by these devices, modules or units or their interdependencies.

[0116] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0117] The interactive device for the drone in this disclosure can be a device, or a component, integrated circuit, or chip in a terminal. The device can be a mobile electronic device or a non-mobile electronic device. For example, mobile electronic devices can be mobile phones, tablets, laptops, PDAs, in-vehicle electronic devices, wearable devices, ultra-mobile personal computers (UMPCs), netbooks, or personal digital assistants (PDAs), etc., while non-mobile electronic devices can be servers, network attached storage (NAS), personal computers (PCs), televisions (TVs), ATMs, or self-service machines, etc. This disclosure does not impose specific limitations.

[0118] The interactive device of the drone in this embodiment can be a device with an operating system. This operating system can be Android, iOS, or other possible operating systems; this embodiment does not impose any specific limitations.

[0119] The interactive device for the drone provided in this disclosure can implement the various processes implemented in the above method embodiments, and will not be repeated here to avoid repetition.

[0120] As shown in Figure 15, this embodiment of the present disclosure also provides an electronic device 1500, including a processor 1501, a memory 1502, and a program or instructions stored in the memory 1502 and executable on the processor 1501. When the program or instructions are executed by the processor 1501, they implement the various processes of the above-described UAV interaction method embodiment and achieve the same technical effect. To avoid repetition, they will not be described again here.

[0121] It should be noted that the electronic devices in this disclosure include the mobile electronic devices and non-mobile electronic devices described above.

[0122] Figure 16 is a schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present disclosure.

[0123] The electronic device 1600 includes, but is not limited to, components such as: radio frequency unit 1601, network module 1602, audio output unit 1603, input unit 1604, sensor 1605, display unit 1606, user input unit 1607, interface unit 1608, memory 1609, and processor 1610.

[0124] Those skilled in the art will understand that the electronic device 1600 may also include a power supply (such as a battery) for powering various components. The power supply may be logically connected to the processor 1610 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. The electronic device structure shown in Figure 16 does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0125] The user input unit 1607 is used to obtain the request information sent by the target user.

[0126] Display unit 1606 is configured to, when processor 1610 determines that the request category of the request information sent by the target user is a first request category, display the target user's permission detection result, wherein the first request category indicates the target user's intention to add an order; and when processor 1610 determines that the permission detection result is normal, display the pending orders in the first target area that match the target user; or, when processor 1610 determines that there are no pending orders in the first target area that match the target user, display a heat map including a second target area, wherein the heat map indicates that there are more pending orders in the second target area than in the first target area; wherein the target user's current location is within the first target area.

[0127] The display unit 1606 is used to display a safety protection switch on a first interface after successfully connecting to the drone. The safety protection switch is in a closed state, indicating that the drone is in a non-safety protection mode. In response to the selection operation of the safety protection switch, a first pop-up window is displayed. The first pop-up window includes a first control and a second control. The first control is used to determine whether to continue to turn on the safety protection switch, and the second control is used to determine whether to turn on the safety protection switch. In response to the selection operation of the first control, the first pop-up window is closed, and the first control on the first interface is turned on. The first guidance window on the first interface is turned on, and the first guidance window is used to guide ground personnel to complete the drone loading.

[0128] The processor 1610 is used to control the drone to emit a physical feedback signal via the radio frequency unit 1601 in response to the selection operation of the first control. The on state is used to indicate that the drone is in a safety protection mode.

[0129] It should be understood that, in this embodiment, the input unit 1604 may include a graphics processor (GPU) 16041 and a microphone 16042. The GPU 16041 processes image data of still images or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 1606 may include a display panel 16061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, etc. The user input unit 1607 includes a touch panel 16071 and other input devices 16072. The touch panel 16071 is also called a touch screen. The touch panel 16071 may include a touch detection device and a touch controller. Other input devices 16072 may include, but are not limited to, a physical keyboard, function keys (such as volume control buttons, power buttons, etc.), a trackball, a mouse, and a joystick, which will not be described in detail here. The memory 1609 can be used to store software programs and various data, including but not limited to applications and operating systems. Processor 1610 can integrate an application processor and a modem processor. The application processor mainly handles the operating system, user interface, and applications, while the modem processor mainly handles wireless communication. It is understood that the modem processor may also not be integrated into processor 1610.

[0130] This disclosure also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described UAV interaction method embodiments and achieve the same technical effects. To avoid repetition, these will not be described again here.

[0131] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0132] This disclosure also provides a computer program product that stores instructions that, when executed by a computer, cause the computer to implement the interaction method of the drone described in the above method embodiments.

[0133] The aforementioned instructions can be program code. In practice, the program code can be written using any combination of one or more programming languages.

[0134] The program code can be executed entirely on the user's computing device, partially on the user's computing device, as a standalone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0135] In cases involving remote computing devices, the remote computing devices can be connected to user computing devices via any type of network, including local area networks (LANs) or wide area networks (WANs), or they can be connected to external computing devices (e.g., via the Internet using an Internet service provider).

[0136] This disclosure also provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement the various processes of the above-described UAV interaction method embodiments and achieve the same technical effect. To avoid repetition, it will not be described again here.

[0137] It should be understood that the chip mentioned in the embodiments of this disclosure may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.

[0138] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this disclosure is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0139] Through the above description of the embodiments, those skilled in the art can clearly understand that the interaction method of the UAV in the above embodiments can be implemented by means of software plus necessary general-purpose hardware platform. Of course, it can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this disclosure, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the UAV interaction method described in the various embodiments of this disclosure.

[0140] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope of this disclosure is indicated by the following claims.

[0141] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

[0142] This disclosure is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope of this disclosure is indicated by the appended claims.

Claims

1. A method for interacting with a drone, the method comprising: include: After successfully connecting to the drone, a safety protection switch is displayed on the first interface. The safety protection switch is in the off state, which indicates that the drone is in non-safety protection mode. In response to the selection operation of the safety protection switch, a first pop-up window is displayed. The first pop-up window includes a first control and a second control. The first control is used to determine whether to continue to turn on the safety protection switch, and the second control is used to determine whether to turn on the safety protection switch. In response to the selection operation of the first control, the first pop-up window is closed, the first control on the first interface is turned on, and the drone is controlled to emit a physical feedback signal. The turned-on state is used to indicate that the drone is in a safety protection mode. The first guidance window on the first interface is activated. The first guidance window is used to guide ground crew to complete ground operations on the drone.

2. The method of claim 1, wherein, The first guidance window includes a third control and a prompt message. The prompt message is used to remind users that the ground support operation needs to be completed within a preset time after selecting the third control. The method further includes: In response to the selection operation of the third control, countdown information corresponding to the preset duration is displayed on the first interface, and the countdown information is floating on the first interface; After the countdown ends, a second pop-up window is displayed, which includes a fourth control; In response to the selection operation of the fourth control, the second pop-up window is closed, confirming that the ground support operation is completed.

3. The method of claim 2, wherein, The ground handling operations include loading cargo, and the method further includes: In response to the selection operation of the third control, the drone is controlled to open its storage space so that the ground crew can load the goods into the drone's storage space; The second pop-up window also includes a fifth control. Before determining that the ground support operation is complete, the method further includes: In response to the selection operation of the fifth control, the drone is controlled to adjust the placement position of the cargo in the storage space.

4. The method of claim 2, wherein, The method further includes: In response to the completion of the ground support operation, the second guidance window of the first interface is adjusted from the inactive state to the active state. The second guidance window is used to guide the ground support personnel to move away from the drone and turn off the safety protection switch. In response to the selection operation of the safety protection switch, a third pop-up window is displayed. The third pop-up window includes a sixth control and a seventh control. The sixth control is used to determine whether to continue to turn off the safety protection switch, and the seventh control is used to determine whether to turn off the safety protection switch. In response to the selection operation of the sixth control, the third guidance window of the first interface is adjusted from the inactive state to the active state. The third guidance window is used to guide the ground crew to initiate the drone flight mission. The third guidance window includes an eighth control. In response to a selection operation on the eighth control, a fourth pop-up window is displayed, the fourth pop-up window including a sliding control; In response to a sliding operation on the sliding control, it is determined that the ground crew has completed the ground crew task, and the UAV flight mission is initiated, the ground crew task including the ground crew operation.

5. The method of claim 4, wherein, The ground support task is associated with the drone delivery task, and the fourth pop-up window also displays order information, which includes one or more of the following: takeoff airport, landing airport, drone call sign, order number, cargo weight, and user identifier.

6. The method of claim 3, wherein, After the cargo has been loaded, the first guidance window also displays a cargo position adjustment control. The cargo position adjustment control is used to control the drone to adjust the placement position of the cargo in the storage space. The state of the cargo position adjustment control is associated with the state of the safety protection switch. When the safety protection switch is on, the cargo position adjustment control is in an active state. When the safety protection switch is off, the cargo position adjustment control is in an inactive state. When the safety protection switch is in the open state, the method further includes: In response to a long press operation on the cargo position adjustment control, the drone is controlled to adjust the placement position of the cargo in the storage space.

7. The method of claim 1, wherein, After successfully connecting to the drone, before the safety protection switch is displayed on the first interface, the method further includes: Multiple airports are displayed on the second screen; In response to the selection of a target airport among the plurality of airports, the user is redirected to a third interface, which includes a list of ground support tasks. In response to the selection of a ground crew task in the ground crew task list, the system jumps to the first interface, where the fourth guidance window is active. The fourth guidance window is used to guide the ground crew personnel to confirm whether the ground crew task corresponds to the equipment used for the ground crew operation. A fifth guidance window is displayed in the first interface, which is used to display the device self-test status of the UAV. Adjusting the first guidance window of the first interface to an active state includes: when the device self-test status is normal, adjusting the first guidance window to an active state.

8. The method of claim 7, wherein, The ground support task is associated with a drone delivery task, and each ground support task in the ground support task list is associated with a first delivery control and a second delivery control; the step of jumping to the first interface in response to a selection operation of a ground support task in the ground support task list includes: jumping to the first interface in response to a selection operation of the first delivery control of the ground support task; Before navigating to the first interface in response to a selection operation of a ground crew task in the ground crew task list, the method further includes: In response to a long press operation on the second delivery control of the ground support task, the drone delivery task associated with the ground support task is converted into a manual delivery task.

9. The method of claim 1, wherein, After successfully connecting to the drone, before the safety protection switch is displayed on the first interface, the method further includes: Multiple departure airports are displayed on the fourth screen; In response to the selection of a first airport among the plurality of departure airports, multiple landing airports are displayed; In response to the selection of a second airport among the plurality of landing airports, multiple drones at the first airport are displayed; In response to the selection operation of a drone in the pending connection state among the plurality of drones, a connection is established with the selected drone; Before adjusting the first guidance window of the first interface to the active state, the method further includes: displaying a fifth guidance window in the first interface, the fifth guidance window being used to display the device self-test status of the drone; A sixth guidance window is displayed in the first interface. The sixth guidance window includes a ground staff input box for the landing airport. The ground staff input box is associated with the ground staff menu. The ground staff input box is used to fill in the ground staff who need to be notified. In response to the selection operation of ground staff in the ground staff menu, the selected ground staff is displayed in the ground staff input box; Adjusting the first guidance window of the first interface to an active state includes: in response to the selection operation of ground staff in the ground staff menu, adjusting the first guidance window to an active state.

10. A computer program product, characterised in that, The computer program product stores instructions that, when executed by a computer, cause the computer to implement the interaction method of the UAV according to any one of claims 1-9.

Images