Unmanned Aerial Vehicle Pilot Training System

Abstract

This invention discloses a drone pilot training system, comprising: a smartphone with a touchscreen, the touchscreen further comprising: a training instruction display area, a virtual drone display area, and a virtual control joystick display area. A training program is used to control the virtual drone to perform actions such as starting, moving, turning, or stopping. The system transmits training instructions to the training instruction display area according to the settings within the training program, and the system is further configured to await user input. In training mode, after a training instruction is issued, the corresponding functional position around the virtual control joystick will display a hint, awaiting the user to move the virtual control joystick to the corresponding functional position. The control input of this invention simulates the action input of a physical joystick, that is: pressing down the virtual control joystick and then moving it to the corresponding functional position.

Description

Unmanned Aerial Vehicle Pilot Training System Technical Field

[0001] This invention relates to a drone pilot training system, and more particularly to a system that provides drone pilot training and testing, suitable for users on smartphones, tablets, or touch screens coupled to computers. Prior Technology

[0002] Figure 1 shows the learned skills

[0003] Figure 1 shows the drone smartphone system of Xizhi Technology, which is suitable for entertainment use and not specifically for drone pilot training and testing. Therefore, the display screen 11 of Xizhi smartphone 10 has only simple functions, including a virtual drone 12 in the center of the display screen to display the flight status of the virtual drone 12, and virtual buttons 131 and 132 to provide simple touch control for controlling the flight, turning and other simple functions of the virtual drone 12. Summary of the Invention

[0004] This drone pilot training system is suitable for drone pilot training and testing. In particular, the display screen of this invention has a command display area, and the control input of this invention is a simulated physical joystick pushing method as the control input. That is, when you press the center of the virtual control joystick and then push and slide it to the corresponding functional position around it, the drone will perform the corresponding action. Simple Explanation of the Diagram

[0005] Figure 1 shows the learned skills.

[0006] Figure 2 shows an example of this invention.

[0007] Figure 3 shows the virtual control joystick used in this creation.

[0008] Figure 4 shows an example of virtual control joystick operation in this creation.

[0009] Figure 5 shows the second example of the virtual control joystick in this creation.

[0010] Figure 6 shows the second embodiment of this invention.

[0011] Figure 7 shows the flowchart of this creative training program.

[0012] Figure 8 shows the flowchart of this creative testing program.

[0013] Figure 9 shows the steps of this creative training program.

[0014] Figure 10 shows the steps of this creative test program.

[0015] Figure 11 shows a diagram of this creation system. Implementation

[0016] Figure 2 shows an example of this invention.

[0017] Figure 2 shows an embodiment of the present invention: the drone pilot training system disclosed in the present invention includes: a smartphone 20 with a touch screen 21, and the touch screen 21 further includes: a first display area or instruction display area 201 for displaying training instructions; a second display area or virtual drone area (e.g., the center of the touch screen 21) for displaying the actions of a virtual drone 12; and a third display area or virtual control joystick 23 for displaying a left virtual control joystick 231 and a right virtual control joystick 232.

[0018] This invention also includes a training program to train users on how to control a virtual drone to perform actions such as starting, moving, turning, or stopping. The system transmits training instructions to the instruction display area 201 based on the training program, and the system is further configured to wait for the user to provide control input for the training instructions.

[0019] The diagram shows that in the drone pilot training system of this invention, the instruction display area 201 is located in the upper area of ​​the touch screen 21; the virtual drone 12 is located in the middle area of ​​the touch screen 21; and the virtual control joystick 23 is located in the lower area of ​​the touch screen 21.

[0020] The drone pilot training system of this invention further includes: The testing program provides testing instructions to assess a user's ability to control a virtual drone, performing various operations such as movement, turning, or stabilizing the drone. The system transmits testing instructions to the first display area (instruction display area 201) according to the testing program, and the system is further configured to wait for the user to input control commands based on the transmitted testing instructions.

[0021] Figure 3 shows how to operate the virtual control joystick in this creation.

[0022] Figure 3 shows the operation method of the virtual control joysticks in this invention: In this drone pilot training system, the left virtual control joystick 231 and the right virtual control joystick 232 further include multiple function positions set around their annular periphery, such as: ascend, descend, turn left, turn right, etc. The operation of the left virtual control joystick 231 and the right virtual control joystick 232 is similar to that of the control joysticks 31 and 32 of a physical remote control 30. Around the left virtual control joystick 231 and the right virtual control joystick 232, various function positions are set, similar to those around the physical joystick 30. The left virtual control joystick 231 and the right virtual control joystick 232 can be pushed and slid 360 degrees to the surrounding function positions, causing the virtual drone 12 to perform corresponding actions. That is, by pressing the center of the left virtual control joystick 231 and the right virtual control joystick 232 with a finger, pushing and sliding towards the surrounding function positions, the virtual drone 12 will then perform the corresponding actions.

[0023] In training mode, after a training command is issued, the corresponding function position will display a hint, guiding the user to make the correct control input. The control input in this drone pilot training system is not direct touch input, but rather simulates the joystick action of a physical remote controller 30; that is, pressing the center of the left virtual control joystick 231 and then sliding it to a surrounding function position. In training mode, the hint status of the function positions in this system is indicated by color, flashing, vibration, or voice prompts, awaiting the user's control input.

[0024] When the user makes control input to the virtual control joystick 23, if the input is correct, the system will present an answer correct response, which will be presented in the form of a first color (e.g., green), a first flash, a first vibration, or a first sound.

[0025] When a user makes a control input to the virtual joystick 23, if the input is incorrect, the system will present an incorrect response, which will be presented in the form of a second color (e.g., red), a second flash, a second vibration, or a second sound.

[0026] Figure 4 shows an example of virtual control joystick operation in this creation.

[0027] Figure 4 shows that when the command is "Up", the command display area 201 will display the word "Up", and the corresponding function position 233 will rise (as shown in Figure 3), flashing a prominent first color (e.g., green) to remind the user of the correct control input position and wait for the user to control the input. When controlling the input, the user uses sliding input. Press the center of the left virtual control joystick 231 with your finger, and then slide it to the corresponding function position above it, as shown by the sliding arrow 235.

[0028] The drone pilot training system of this invention further includes: a physical remote control console 30, which can be electrically connected to a smartphone 20 via a wire 33; the physical remote control console 30 has a left physical control joystick 31 and a right physical control joystick 32, used to control the virtual drone 12 to perform various attitude changes.

[0029] Figure 5 shows the second example of virtual control joystick operation in this creation.

[0030] Figure 5 shows that when the command is "Move Right", the command display area 201 will display the words "Move Right", and the corresponding function position _Move Right 234 (as shown in Figure 3) will flash a prominent first color (e.g., green) to remind the user of the correct control input position and wait for the user to control the input. When controlling the input, the user uses sliding input. Press the center of the right virtual control joystick 232 with your finger, and then slide it to the corresponding function position on the right side. Please refer to the sliding arrow 236 for the direction of the finger sliding.

[0031] Figure 6 shows the second embodiment of this invention.

[0032] The virtual drone display area of ​​the drone pilot training system of this invention can be replaced with a first-person perspective 22; wherein, the first-person perspective 22 is presented by real-time images captured by a camera (not shown in the figure) configured on the virtual drone.

[0033] Figure 7 shows the flowchart of this creative training program. The training program used in this work includes the following steps: (1) Instruction 1 is displayed in the instruction display area and is used to complete the corresponding function position of the instruction action, and flashes the first color clearly; (2) When the user moves the joystick to the function position where the first color is flashing, the operation is correct and the information is recorded in the background; or when the user moves the joystick to a function position where the first color is not flashing, the operation is incorrect and the information is recorded in the background. (3) Repeat the above two steps until all instructions are completed; (4) Performance feedback; (5) Operational error analysis; and (6) Training ends.

[0034] Figure 8 shows the flowchart of this creative testing program. The testing program used in this work includes the following steps: (1) Command 1 is displayed in the command display area, and the virtual drone in the screen is in a ready state; (2) When the user moves the joystick to a position that meets the specified requirements, the operation is correct and the information is recorded in the background; or when the user moves the joystick to a position that does not meet or cannot achieve the command content, the operation is incorrect and the information is recorded in the background. (3) Repeat the above two steps until all training instructions are completed; (4) Performance feedback; (5) Operational error analysis; and (6) The test is over.

[0035] Figure 9 shows the steps of this creative training program.

[0036] Figure 9 shows the training program flowchart of Figure 7, presented in a "steps" format, described as in the flowchart paragraphs of Figure 7.

[0037] Figure 10 shows the steps of this creative test program.

[0038] Figure 10 shows the test procedure flowchart of Figure 8, presented in a "steps" format, described as in the flowchart paragraphs of the test procedure in Figure 8.

[0039] Figure 11 shows a diagram of this creation system.

[0040] When the training or testing program of this creation is stored on a smartphone, tablet, or computer with a touch panel, this creation can be used offline.

[0041] Figure 11 shows that when the training or testing program of this invention is stored on a remote server 24, the server 24 can be electrically coupled to a tablet computer, smartphone, or computer touch panel via the Internet for use.

[0042] The training program for the drone pilot training system of this invention is stored on the smartphone 20, server 24, or other various storage spaces. The testing program for the drone pilot training system of this invention is stored on the smartphone 20, server 24, or other various storage spaces. The server is electrically coupled to the smartphone 20, tablet computer 25, or touch screen 26 coupled to a computer via wired or wireless connection technology.

[0043] In this invention, a drone pilot training system is created in which a physical remote control console 30 is electrically coupled to a smartphone 20 via wired or wireless connection technology.

[0044] This drone pilot training system displays user performance feedback and operational error analysis after training is completed.

[0045] This drone pilot training system, in test mode, displays user performance feedback and operational error analysis after the test is completed.

[0046] The drone pilot training system of this invention, wherein the shape of the virtual drone is presented as a helicopter, an airplane, a vertical take-off and landing (VTOL) aircraft, or a multi-rotor aircraft.

[0047] In this drone pilot training system, the smartphone 20 can be replaced by a tablet computer 25 or a touch screen 26 coupled to a computer, achieving a similar training effect.

[0048] Although this invention specification has described several embodiments by way of example, various obvious modifications that can be made by those skilled in the art without departing from the spirit of the appended claims still fall within the scope of the claims.

[0049] 12: Virtual Drones 20: Smartphones 21: Touchscreen 201: Command Display Area 22: First-person perspective 23: Virtual control joystick 231: Left virtual control joystick 232: Right virtual control joystick 235: Slide Arrow 236: Slide Arrow 24: Server 25: Tablet PC 26: Touchscreen coupled to computer 30: Physical remote control 31: Left physical control joystick 32: Right-side physical control joystick 33: Signal Line

Claims

1. A drone pilot training system, comprising: a smartphone having a touchscreen, wherein the touchscreen further comprises: a first display area for displaying training instructions; a second display area for displaying a virtual drone; and a third display area for displaying a left virtual control joystick and a right virtual control joystick; and a training program for training a user to control the virtual drone to perform actions such as starting, moving, turning, or stopping; wherein... The system transmits the training instructions to the first display area, i.e. the instruction display area, according to the training program, and the system is further configured to wait for the user to make control input on the virtual control joystick with prompts.

2. The unmanned aerial vehicle (UAV) pilot training system as described in claim 1, wherein, The virtual control joystick is surrounded by multiple functional positions. In training mode, when a training command is issued, the corresponding functional position will show a hint state, waiting for the user to input control.

3. The unmanned aerial vehicle (UAV) pilot training system as described in claim 2, wherein, The control input is input in the manner of simulating a joystick action, that is: pressing down the center of the virtual control joystick and then sliding it to the corresponding function position.

4. The unmanned aerial vehicle (UAV) pilot training system as described in claim 3, wherein, The hint status of the function location is presented through color, flashing, or voice prompts, waiting for the user to input control.

5. The unmanned aerial vehicle (UAV) pilot training system as described in claim 4, wherein, When a user makes control input using the virtual joystick, the system will provide a correct response if the input is correct.

6. The unmanned aerial vehicle (UAV) pilot training system as described in claim 5, wherein, The correct answer feedback is presented in the form of the first color, the first flash, the first vibration, or the first sound.

7. The unmanned aerial vehicle (UAV) pilot training system as described in claim 6, wherein, When a user makes a control input using the virtual joystick, the system will display an incorrect response if the input is incorrect.

8. The unmanned aerial vehicle (UAV) pilot training system as described in claim 7, wherein, The feedback for incorrect answers is presented in the form of a second color, a second flash, a second vibration, or a second sound.

9. The unmanned aerial vehicle (UAV) pilot training system as described in claim 8, wherein, The first display area is disposed in the upper layer area of ​​the touch screen; the second display area is disposed in the middle layer area of ​​the touch screen; and the third display area is disposed in the lower layer area of ​​the touch screen.

10. The drone pilot training system as described in claim 9 further comprises: a testing program that provides testing instructions to assess a user's ability to control the virtual drone and perform various operations such as movement, turning, or stabilizing the aircraft; wherein, The system transmits the test instructions to the first display area according to the test program, and the system is further configured to wait for the user to make control inputs on the transmitted test instructions.

11. The drone pilot training system as described in claim 10 further comprises: a physical remote control console electrically connected to the smartphone; the physical remote control console having a physical left control joystick and a physical right control joystick for controlling the virtual drone to perform various attitude change actions.

12. The unmanned aerial vehicle (UAV) pilot training system as described in claim 11, wherein, The virtual drone is replaced with a first-person perspective; wherein the first-person perspective is presented by real-time footage captured by a camera mounted on the virtual drone.

13. The unmanned aerial vehicle (UAV) pilot training system as described in claim 12, wherein, The training program is stored on the smartphone or server.

14. The unmanned aerial vehicle (UAV) pilot training system as described in claim 13, wherein, The testing program is stored on the smartphone or the server.

15. The unmanned aerial vehicle pilot training system as described in claim 14, wherein, The server is electrically coupled to the smartphone via wired or wireless connection technology.

16. The unmanned aerial vehicle (UAV) pilot training system as described in claim 15, wherein, The physical remote control console is electrically coupled to the smartphone via wired or wireless connection technology.

17. The unmanned aerial vehicle (UAV) pilot training system as described in claim 16, wherein, In training mode, once training is complete, the system will display user feedback and operational error analysis.

18. The unmanned aerial vehicle (UAV) pilot training system as described in claim 17, wherein, In quiz mode, after the quiz is completed, the system will display user feedback and analysis of operational errors.

19. The unmanned aerial vehicle (UAV) pilot training system as described in claim 18, wherein, The virtual drone is shaped like a helicopter, an airplane, a vertical takeoff and landing (VTOL) aircraft, or a multi-rotor aircraft.

20. The unmanned aerial vehicle (UAV) pilot training system as described in claim 19, wherein, The smartphones in question have been replaced by computer touchscreens or tablets.

21. The unmanned aerial vehicle (UAV) pilot training system as described in claim 20, wherein, The training program includes the following steps: (1) Instruction 1 is displayed in the instruction display area, and the corresponding functional position used to complete the instruction action is clearly flashed with the first color; (2) When the user moves the joystick to the functional position flashing with the first color, the operation is correct and the information is recorded in the background; or when the user moves the joystick to a functional position that is not flashing with the first color, the operation is incorrect and the information is recorded in the background; (3) Repeat the above two steps until all instructions are completed; (4) Performance feedback; (5) Operation error analysis; and (6) Training ends.

22. The unmanned aerial vehicle (UAV) pilot training system as described in claim 21, wherein, When a user makes a mistake, the corresponding function will flash a second color to indicate the error.

23. The unmanned aerial vehicle (UAV) pilot training system as described in claim 22, wherein, The test program includes the following steps: (1) Instruction 1 is displayed in the instruction display area, and the virtual drone in the screen is in a ready state; (2) When the user moves the joystick to a functional position that meets the instruction requirements, the operation is correct and the information is recorded in the background; or when the user moves the joystick to a functional position that does not meet or cannot achieve the instruction content, the operation is incorrect and the information is recorded in the background; (3) Repeat the above two steps until all training instructions are completed; (4) Performance feedback; (5) Operation error analysis; and (6) Test ends.

24. The unmanned aerial vehicle (UAV) pilot training system as described in claim 23, wherein, When the user operates correctly, the corresponding function position will display the third color, indicating that the operation is correct; when the user operates incorrectly, the corresponding function position will display the fourth color, indicating that the operation is incorrect.

Images