Radio control device
The wireless control device converts drone footage into an overhead view and uses hand gestures for control, addressing the limitations of traditional joysticks and enhancing drone operation intuitiveness and immersion.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Filing Date
- 2025-12-02
- Publication Date
- 2026-04-03
AI Technical Summary
Existing drone control methods, such as using joysticks or smartphone screens, lack intuitiveness and immersion, especially in beyond-visual-line-of-sight flights, making it difficult to operate drones effectively.
A wireless control device that converts drone camera footage into an overhead view, superimposes the drone image on the display, and uses motion sensors to detect hand gestures for control, allowing intuitive operation.
Enables more intuitive and immersive drone operation, enhancing control capabilities beyond visual line of sight by using hand gestures to control the drone's movements.
Abstract
Description
Technical Field
[0001] The present invention relates to a wireless control device for operating a drone or the like.
Background Art
[0002] Unmanned aerial vehicles represented by multicopters are generally called "drones" and are applied in various fields, and further development in the future is expected. Many of them are equipped with cameras and enable shooting from unknown viewpoints where people and conventional aircraft cannot enter, such as aerial photography and surveys.
[0003] Generally, a controller called a prop is used to operate a drone. In addition, a monitor for displaying the video captured by the camera is also provided. In many cases, visual flight is performed by operating the controller while visually observing the flying drone body. Also, in applications where the drone body cannot be visually observed, visual flight outside the line of sight is also performed by operating while only looking at the video on the monitor (or head-mounted display device) (Patent Document 1).
Prior Art Documents
Patent Documents
[0004]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0005] As described above, a controller called a prop is used to operate a drone, but in many cases, the operation is performed by tilting the left and right sticks forward, backward, left, and right. In some drones, there are cases where they are directly connected to a smartphone or the like and the operation is performed by operating the screen of the smartphone, but generally, the operability is inferior to the case of using a stick. <H
[0006] Alternatively, instead of using a monitor screen, wearing goggles can provide a more intuitive and immersive flight experience. However, even in this case, the controller's input method is limited to the joystick.
[0007] Therefore, the object of the present invention is to provide a wireless control device equipped with a new interface for a wirelessly controlled object controlled by wireless communication. [Means for solving the problem]
[0008] To solve the above problems, a wireless control device according to one aspect of the present invention is: The system comprises a wireless communication device that receives video signals captured by a camera-equipped drone and transmits control signals to the drone for controlling the drone, and a display device that displays images of the area around the drone based on the video signals, wherein the video signals are converted into images viewed from an overhead perspective of the drone, and the image of the drone is superimposed on these images and displayed on the display device. .
[0009] In one embodiment, The display device is an aerial image display device that projects an image into the air, and further comprises a motion sensor that detects a user's hand gesture made near the drone image in the aerial image projected by the aerial image display device, and is inserted into the aerial image so as to be superimposed on the drone image in the aerial image, and the drone is controlled in synchronization with the user's hand movements detected by the motion sensor.
[0010] Furthermore, in one embodiment, the drone is an unmanned aerial vehicle, and is operated such that when a user's hand, which is inserted into the aerial image so as to be superimposed on the image of the unmanned aerial vehicle in the aerial image, moves upward, the unmanned aerial vehicle rises, and when the hand moves downward, the unmanned aerial vehicle descends.
[0011] Furthermore, in one embodiment, the drone is an unmanned aerial vehicle, and when the user's hand, which is inserted into the aerial image so as to be superimposed on the image of the unmanned aerial vehicle in the aerial image, is tilted to the right, the unmanned aerial vehicle also tilts to the right, and when the user's hand is tilted to the left, the unmanned aerial vehicle also tilts to the left. [Effects of the Invention]
[0012] According to the present invention, the wireless control device can be operated more intuitively.
[0013] Furthermore, the wireless control device according to the present invention can add a new level of entertainment to the operation of the wirelessly controlled object. [Brief explanation of the drawing]
[0014] [Figure 1] Figure 1 is a perspective view showing the aerial image display device 1 in use, implemented as a wireless control device for an unmanned aerial vehicle according to Embodiment 1 of the present invention. [Figure 2] Figure 2 is a side view showing the aerial image display device 1 in use, implemented as a wireless control device for an unmanned aerial vehicle according to Embodiment 1 of the present invention. [Figure 3]FIG. 3 is a side view showing the folded state of the aerial video display device 1 shown in FIGS. 1 and 2. [Figure 4] FIG. 4 is a front view showing the folded state of the aerial video display device 1 shown in FIGS. 1 and 2. [Figure 5] FIG. 5 is a rear view showing the folded state of the aerial video display device 1 shown in FIGS. 1 and 2. [Figure 6] FIG. 6 is a view showing the dark screen used in the aerial image display device 1 shown in FIGS. 1 and 2. [Figure 7] FIG. 7 is a perspective view showing a state where the dark screen of FIG. 6 is attached to the aerial image display device 1 shown in FIGS. 1 and 2. [Figure 8] FIG. 8 is a diagram for explaining a method of constructing an aerial view image in a wireless control device of an unmanned aerial vehicle according to Embodiment 1 of the present invention, and shows an example of constructing an aerial view image seen from above the unmanned aerial vehicle while the camera of the unmanned aerial vehicle takes a picture directly below. [Figure 9] FIG. 9 is a diagram for explaining a method of constructing an aerial view image in a wireless control device of an unmanned aerial vehicle according to Embodiment 1 of the present invention, and shows an example of constructing an aerial view image seen from obliquely above the unmanned aerial vehicle while the camera of the unmanned aerial vehicle takes a picture obliquely below. [Figure 10] FIG. 10 is a diagram showing an example of a flight image of an unmanned aerial vehicle displayed on a wireless control device of an unmanned aerial vehicle according to Embodiment 1 of the present invention. [Figure 11] FIG. 11 is a diagram for explaining an example of controlling an unmanned aerial vehicle performed by a wireless control device of an unmanned aerial vehicle according to Embodiment 1 of the present invention. [[ID=;26]] [Figure 12] FIG. 12 is a perspective view showing an aerial video display device 2 in a use state mounted as a wireless control device of an unmanned aerial vehicle according to Embodiment 2 of the present invention. [Figure 13] FIG. 13 is a side view showing an aerial video display device 2 in a use state mounted as a wireless control device of an unmanned aerial vehicle according to Embodiment 2 of the present invention. [Figure 14] FIG. 13 is a perspective view showing an example of mounting without using an aerial video display device as a modified example of a wireless control device of an unmanned aerial vehicle according to Embodiment 2 of the present invention.
Best Mode for Carrying Out the Invention
[0015] Hereinafter, as a wireless control target controlled by the wireless control device of the present invention, an unmanned aircraft (drone) will be used as a specific example to describe an embodiment. The drone operated by the wireless control device according to the embodiment of the present invention is not significantly different from a general drone. However, it is necessary to equip at least one imaging device (camera) for aerial photography. And it is also equipped with an altitude sensor for measuring the altitude of the drone. As the altitude sensor, an ultrasonic sonar, a LIDAR sensor, etc. can be adopted. Furthermore, it is equipped with a wireless communication device for wirelessly receiving a control signal from the wireless control device and transmitting a video signal of the camera etc. to the wireless control device.
Embodiment
[0016] [Structure of Aerial Video Display Device] The wireless control device of the unmanned aircraft (drone) according to the embodiment of the present invention is implemented by an aerial video display device (aerial display) that forms an image of a video in the air. FIG. 1 is a perspective view showing the aerial video display device 1 in a usage state according to Embodiment 1 of the present invention. FIG. 2 is a side view showing the aerial video display device 1 in a usage state according to Embodiment 1 of the present invention. FIGS. 3, 4, and 5 are side view, front view, and rear view showing the folded state of the aerial video display device 1 shown in FIGS. 1 and 2.
[0017] As shown in these figures, the aerial video display device 1 is composed of a support substrate 10 on which an information processing device for performing overall signal processing is implemented, a liquid crystal display 20 connected to this support substrate 10 via a hinge portion 12, and an optical plate 30 connected to this liquid crystal display 20 via a hinge portion 22.
[0018] The information processing device mounted on the support board 10 is essentially a miniature computer and consists of a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), a storage device for storing various programs and data, and input / output interfaces. The input / output interfaces include, for example, a USB port 14 and a wireless communication device.
[0019] The wireless communication device is used to communicate with the drone, transmitting control signals to the drone for operation and receiving video signals captured by the drone's camera. While wireless standards for unmanned mobile image transmission systems in the 5.7GHz or 2.4GHz band are used here, general wireless LANs such as Wi-Fi found on computers can also be used. Furthermore, the wireless communication device can be an external device connected to USB port 14.
[0020] The liquid crystal display 20 has a display surface 24 on the side facing the optical plate 30. That is, in the operational state of the aerial image display device 1 shown in Figures 1 and 2, the display surface 24 is angled upwards. Based on the display data transmitted from the support substrate 10, the flight image of the drone, described later, is displayed on the display surface 24.
[0021] The optical plate 30 has its incident surface 31 facing downwards towards the display surface 24 of the liquid crystal display 20, and its exit surface 33 facing directly upwards. The image on the display surface 24 of the liquid crystal display 20 is then focused again as an aerial image 4 at the same distance on the opposite side, forming the same image as before.
[0022] As such an optical plate 30, for example, an optical imaging element described in Japanese Patent Application Publication No. 2011-175297 can be used. This optical imaging element is realized by arranging a large number of mutually orthogonal planar light reflecting parts at a constant pitch. In addition, a structure such as a two-sided corner reflector, in which a reflective surface is formed on the side surface of a square-shaped hole, as described in Japanese Patent No. 4900618, may also be used.
[0023] Furthermore, an infrared LED 32 and a pair of infrared cameras 34 are provided on the optical plate 30 near the hinge portion 22. These infrared LED 32 and infrared cameras 34 constitute an operation detection unit (motion sensor) that detects user actions on the aerial image 4. The detection range of the operation detection unit is defined by the emission angle of the infrared LED 32 and the field of view of the infrared cameras 34.
[0024] The support substrate 10, the liquid crystal display 20, and the optical plate 30 are connected by hinge portions 12 and 22, respectively, but are fixed in the operational state of the aerial image display device 1 shown in Figures 1 and 2 by a pair of left and right locking rods 40.
[0025] In other words, the locking rod 40 is pivotally supported by a shaft 42 located in the center of the side surface of the liquid crystal display 20, and is capable of engaging with the engaging recess 16 of the support substrate 10 and the engaging recess 36 of the optical plate 30. When both ends of the locking rod 40 are engaged with the engaging recess 16 of the support substrate 10 and the engaging recess 36 of the optical plate 30, the optical plate 30 is supported horizontally, and the liquid crystal display 20 is fixed at an angle of approximately 45 degrees downward relative to the optical plate 30. In this operating state, the liquid crystal display 20 and the support substrate 10 are also fixed at an angle of approximately 45 degrees.
[0026] It is important that the angle between the liquid crystal display 20 and the optical plate 30, and the angle between the liquid crystal display 20 and the support substrate 10, is approximately 45 degrees. At this angle, the optical plate 30 is horizontal, and the light from the liquid crystal display 20 is optimally focused onto the aerial image 4, which is angled at approximately 45 degrees. More specifically, it is desirable that the angle be roughly in the range of 40 to 50 degrees.
[0027] In this state, when an image is displayed on the liquid crystal display 20, it is projected as an aerial image 4 on the opposite side of the optical plate 30. When a gesture is made to this aerial image 4, such as touching it with a finger, the operation is detected by the operation detection unit (motion sensor) consisting of an infrared LED 32 and an infrared camera 34, and the corresponding operation signal is sent to the information processing device on the support substrate 10, where predetermined processing is performed.
[0028] In actual drone operation, the video captured by the drone's camera is displayed on the LCD display 20 as an aerial view. In addition, an image of the drone itself is displayed superimposed on it. As described later, the camera's video is converted into an overhead view, as if taken from above and behind the drone, and displayed on the LCD display 20. This overhead view is displayed as an aerial view 4 via the optical plate 30. Gestures made on the aerial view 4 are detected by a motion sensor. As a result, the aerial view 4 becomes an operating interface that allows the drone to be controlled by touching it with the hands.
[0029] This aerial image display device 1 is highly portable. Specifically, when transporting it, both ends of the locking rod 40 are detached from the engaging recess 16 of the support substrate 10 and the engaging recess 36 of the optical plate 30, and the support substrate 10, liquid crystal display 20, and optical plate 30 are rotated at the hinge portion 12 and hinge portion 22, and stacked horizontally to form a compact structure as shown in the side view of Figure 3, the front view of Figure 4, and the rear view of Figure 5.
[0030] Therefore, the aerial image display device is designed to be portable, foldable into a small size, and easily carried. For example, this aerial image display device and a drone can be taken to any location where aerial photography and other activities can be freely performed.
[0031] As shown in Figure 1, a speaker 18 can also be provided on the support substrate 10. For example, if some operation is performed on the aerial image 4 and detected, the user can be notified with a click sound or other means. Alternatively, guidance audio can be played for unfamiliar users.
[0032] Furthermore, in order to achieve a clearer aerial image 4, it is desirable that external light is not added to the light from the liquid crystal display 20. For this purpose, it is advisable to use a blackout curtain 44 as shown in Figure 6. This blackout curtain 44 is intended to cover the space between the liquid crystal display 20 and the optical plate 30, and consists of a left shielding portion 44L, a central shielding portion 44C, and a right shielding portion 44R.
[0033] The left shielding portion 44L covers the left open area between the liquid crystal display 20 and the optical plate 30, the central shielding portion 44C covers the central open area, i.e., the back area, between the liquid crystal display 20 and the optical plate 30, and the right shielding portion 44R covers the right open area between the liquid crystal display 20 and the optical plate 30.
[0034] A hook-and-loop fastener 46 is provided on the edge of the blackout curtain 44. Although not directly shown in the figure, a hook-and-loop fastener is also provided on the corresponding surface of the aerial image display device 1. The hook-and-loop fasteners on the blackout curtain 44 and the aerial image display device 1 are female fasteners on one side and male fasteners on the other, and as shown in Figure 7, they can be bonded together to completely cover the space between the liquid crystal display 20 and the optical plate 30. As a result, external light is not added to the light from the liquid crystal display 20, and a clearer aerial image 4 can be realized.
[0035] Although the blackout curtain 44 is shown here to be attached when in use, it may also be permanently fixed to the liquid crystal display 20 and optical plate 30 without being attached or removed. In this case, when folding the aerial image display device 1, it should be folded between the liquid crystal display 20 and optical plate 30. One way to fold it is, for example, by folding it in a zigzag pattern like a fan.
[0036] [Method for composing overhead shots] The drone is controlled using the aerial image from the aerial image display device 1 as the control interface, but this control is for beyond visual line of sight (BVLOS) flight. Normally, BVLOS flight is performed remotely using first-person view video. That is, the controller's monitor displays the drone's camera footage directly, and the drone is controlled while viewing that footage. In this case, a sense of control is obtained as if the pilot were in the cockpit. It can also be used in situations where in-visual-line-of-sight flight is difficult.
[0037] However, remote control using first-person perspective video is difficult because the drone itself is not visible, making it hard to judge its distance from its surroundings. In this invention, instead of first-person perspective video, an overhead view video that includes the drone itself is displayed on the controller's monitor. This makes it possible to control the drone while confirming its position in the surrounding environment, just as in visual line of sight (BVLOS) flight, even though it is BVLOS flight.
[0038] Next, we will explain how to obtain an overhead view that includes the drone itself from the drone's camera footage. The simplest method is to point the drone U's camera straight down (see Figure 8). If the ground is flat, an overhead view can be obtained from a virtual camera virtually set at position V above the drone by embedding a pre-saved image of the drone in the center of the camera's footage. The size of the drone image to be embedded in the overhead view is calculated from the virtual camera's field of view, the drone's altitude, and the virtual camera's altitude.
[0039] More generally, when the camera is tilted or the overhead viewpoint (the position of the virtual camera V) is set at an oblique angle, image processing of the camera footage is required to obtain an overhead view. Here, we obtain footage as if the drone were filmed from diagonally above. For example, consider Figure 9, where the drone U is moving to the right and the camera is pointed downwards in the direction of travel. In this case, the area R of the ground will be imaged. Here, we assume the camera has a 90-degree field of view.
[0040] The video captured by the camera is a perspective image of the ground region R, with the camera position (drone position) as the viewpoint. Therefore, first, the image data of this captured video is converted into planar image data of the ground region R by performing an inverse perspective transformation. This requires data on the altitude of the camera position and the camera's tilt angle.
[0041] Next, we assume a virtual camera at a predetermined position above and behind the drone. In this embodiment 1, the position V of the virtual camera is linked to the tilt of the drone's camera. For example, the optical axis of the virtual camera (shown as a dashed line in Figure 9) always passes through the position of the drone's camera, and the position V of the virtual camera is linked to the tilt of the drone's camera so that the distance between the drone's camera and the virtual camera is equal to the altitude of the drone's camera. Therefore, in most cases, the image displayed will appear as if it were taken from above and behind the drone.
[0042] Then, by performing a perspective transformation on the planar image data of the ground region R into a perspective image with the virtual camera as the viewpoint, an image of the ground as seen from the virtual camera is obtained. By superimposing a previously saved image of the drone onto the drone's position in the obtained image, a flight image of the drone as seen from the virtual camera's position is obtained (see Figure 10).
[0043] Here, the drone's image is displayed directly as aerial footage. This is a natural display and helps in understanding the relative positions of the ground and the drone. However, naturally, the central part of the ground image is hidden by the drone image. To make this central part visible, it is best to make the drone image superimposed on the overhead view semi-transparent. This allows the entire ground image to be seen.
[0044] [Method for controlling a drone using an aerial image display device] Next, we will explain how to control the drone using gestures on aerial footage. As explained in "Method of Composing Overhead Footage" above, the aerial footage display device will show footage as if it were taken from above and behind the drone.
[0045] The operator controls the drone by placing their hand into the display screen of the aerial video display device (the screen indicated by the dashed line in Figure 11) and making gestures. Specifically, they control the drone by directly touching the displayed image of the drone. If the operator removes their hand from this display screen, control is lost.
[0046] Additionally, you can change the camera's shooting angle by touching the tilt lever C displayed in the lower right corner of the screen and moving it up or down (see Figure 10). For example, you can adjust it from directly downwards (-90 degrees) to slightly upwards (+24 degrees).
[0047] Here are some specific examples of gestures used to control a drone. First, by horizontally inserting your hand so that it overlaps with the drone displayed in the aerial image, and then tilting it to the right, you can control the actual drone to tilt to the right (see arrow R in Figure 11). Similarly, by tilting the hand inserted into the aerial image to the left, you can control the actual drone to tilt to the left (see arrow L in Figure 11).
[0048] Furthermore, by horizontally inserting your hand over the drone displayed in the aerial image and lifting it upwards, the actual drone will ascend (see arrow U in Figure 11). Similarly, by lowering the hand inserted into the aerial image, you can control the actual drone to descend (see arrow D in Figure 11).
[0049] Furthermore, you can freely define various gestures. For example, you can define controls such as the drone moving straight when you insert your index finger over it, and tilting it left or right while it moves straight while tilting it left or right, or the drone moving backward when you point behind it with your thumb.
[0050] Thus, the drone control method according to the present invention is based on hand gestures and is extremely simple and intuitive. Therefore, even beginners can understand and enjoy controlling the drone in a short amount of time. [Examples]
[0051] In the above example 1, gestures are made directly with the hand towards the drone displayed in the aerial image. While this is intuitive and easy to understand, it also has the drawback of obstructing the view of the drone and the drone itself, making it difficult to see.
[0052] Therefore, in Example 2, the hands are replaced with a semi-transparent display. Since the description of Example 2 is largely the same as that of Example 1, the same elements are given the same reference numbers in the drawings, and their descriptions are omitted. Below, only the differences from Example 1 will be described.
[0053] Figure 12 is a perspective view showing the aerial image display device 2 in use, implemented as a wireless control device for an unmanned aerial vehicle according to Embodiment 2 of the present invention. Figure 13 is a side view showing the aerial image display device 2 shown in Figure 12.
[0054] As shown in these figures, the aerial image display device 2 consists of a support board 10 on which an information processing device that performs overall signal processing is mounted, a liquid crystal display 20 connected to the support board 10 via a hinge portion 12, and an optical plate 30 connected to the liquid crystal display 20 via a hinge portion 22.
[0055] The structure and function of the support substrate 10, liquid crystal display 20, and optical plate 30 are generally the same as those of Embodiment 1 described above, but differ in that an image sensor 49 is provided in the inner center of the hinge portion 12, and an image sensor 48 is provided in the upper center of the back surface of the liquid crystal display 20.
[0056] Image sensor 48 captures images of the space between the support substrate 10 and the liquid crystal display 20 (hereinafter referred to as the operating space S) from above, and image sensor 49 captures images of the operating space S between the support substrate 10 and the liquid crystal display 20 from the front. These image sensors 48 and 49 detect the movement of a hand H inserted into the operating space S between the support substrate 10 and the liquid crystal display 20.
[0057] The hand H detected by these image sensors 48 and 49 is displayed on the display surface 24 of the liquid crystal display 20 and on the aerial image 4, which is a collected image through its optical plate 30. However, in order not to obstruct the overhead view or drone image displayed on the aerial image 4, only the outline H' of the hand H is displayed or it is displayed semi-transparently. Movement of the hand H makes it possible to manipulate the aerial image 4 (control the drone) using this hand H'.
[0058] Similar to Example 1, during actual drone operation, the image captured by the drone's camera is displayed on the LCD display 20 as an overhead view. In addition, a drone image is displayed superimposed on it. In this Example 2, a hand H is further displayed as semi-transparent or as an outline H', superimposed on the drone image in the overhead view. The overhead view displayed as an aerial image via the optical plate 30 serves as an operating interface that allows the drone to be controlled using the hands. The actual method of controlling the drone is as described in "Method of controlling a drone using an aerial image display device" in the above-mentioned example.
[0059] As a method for detecting a hand H in the operating space S, for example, the positions of the five fingertips can be identified, and from there, an outline H' or semi-transparent image of the hand H can be created on the aerial image 4. Alternatively, instead of an outline or semi-transparent image, it is also effective to display only pointers indicating the fingertips on the aerial image 4. In this case, a simple method is to identify only the position of the index finger and display one pointer on the aerial image 4. Or, the positions of the index finger and thumb can be identified and two pointers can be displayed on the aerial image 4, or all five fingers can be displayed as five pointers on the aerial image 4. By moving these pointers, it is also possible to control the drone.
[0060] Figure 14 shows a concrete example of a wireless control device for an unmanned aerial vehicle (drone) implemented without using an aerial image display device. Here, the elements corresponding to each element of the aerial image display device in Figure 13 are given the same reference numerals in this wireless control device 5, and their explanations will not be repeated. Here, the optical plate 30 in Figure 13 is replaced by a liquid crystal display 60, and a support substrate 65 is provided in the position of the liquid crystal display 20 in Figure 13. However, the liquid crystal display 60 is supported in a position that is easy for the user to view, with the display raised to the position of the aerial image 4 in Figure 1.
[0061] Similarly, in the wireless control device 5, an image sensor 48 is provided in the upper center of the back surface of the support substrate 65, and an image sensor 49 is provided in the inner center of the hinge portion 12. The image sensor 48 captures the operating space S from above, and the image sensor 49 captures the operating space S between the support substrate 10 and the support substrate 65 from the front. These image sensors 48 and 49 detect the movement of the hand H inserted into the operating space S.
[0062] The hand H detected by these image sensors 48 and 49 is displayed on the liquid crystal display 60. However, as in the example shown in Figure 1, in order not to obstruct the overhead view or drone image displayed on the liquid crystal display 60, only the outline H' of the hand H is displayed, or it is displayed semi-transparently, or a pointer corresponding to the position of the fingertip is displayed. The movement of the hand H enables the drone to be controlled.
[0063] This allows for gesture-based control while viewing the entire flight footage of the drone, making the challenging beyond-visual-line-of-sight (BVLOS) flight more accessible. [Industrial applicability]
[0064] According to the wireless control device of the present invention, control becomes possible by making gestures with bare hands in response to aerial images, enabling more intuitive and entertaining operation.
[0065] The paper straightening apparatus and image forming system according to the present invention have been described above based on embodiments. However, the present invention is not limited thereto, and modifications may be made without departing from the spirit of the invention. If possible, the technologies described in each embodiment may be combined, or known technologies may be combined.
[0066] In the above embodiment, an unmanned aerial vehicle (drone) is used as a specific example of a wirelessly controlled object controlled by the wireless control device of the present invention. However, the present invention is not limited to this and can be applied to wirelessly controlled objects in general that can be controlled by a wireless control device. For example, various types of drones such as underwater drones and unmanned vehicles can be used as wirelessly controlled objects.
[0067] Furthermore, while the above embodiment constructs an overhead view by performing image conversion on real-time camera footage, the present invention is not limited to this. For example, by storing footage captured by a camera, converting past captured footage into an overhead view from the current virtual camera position, and combining it with the overhead view converted from the current captured footage, an overhead view with a wider field of view can be obtained.
[0068] Furthermore, although a liquid crystal display is used in the above embodiment, the present invention is not limited thereto, and organic EL displays, electronic paper, etc. may also be used. Furthermore, although a locking rod is used as a support structure for fixing the display and optical panel, the present invention is not limited thereto. For example, a locking mechanism may be implemented in the hinge part itself, or a shielding plate may be used instead of a blackout curtain, and this shielding plate may be used as a support structure for fixing the display and optical panel. [Explanation of Symbols]
[0069] 1, 2, 5 Aerial Image Display Device 10, 65 Support substrate 12. Hinge section 14 ports 16 Engaging recess 18 speakers 20, 60 LCD display 22 Hinge section 24 Display surface 30 Optical Plates 31 Incidence plane 33. Ejection surface 34 Infrared Cameras 36 Engaging recess 40 Locking Rod 42 axes 44 Blackout Curtain 44C Central shielding part 44L Left side shielding part 44R Right side shielding part 46 hook-and-loop fasteners 48, 49 Image sensor
Claims
1. A wireless control device comprising: a wireless communication device that receives a video signal captured by a camera-equipped drone and transmits control signals to the drone for operating the drone; and a display device that displays an image of the area around the drone based on the video signal, wherein the video signal is converted into an image viewed from an overhead perspective of the drone, and an image of the drone is superimposed thereon and displayed on the display device.
2. The wireless control device according to Claim 1, wherein the display device is an aerial image display device that projects an image into the air, and further comprises a motion sensor that detects a user's hand gesture made near the image of the drone in the aerial image projected by the aerial image display device, and is inserted into the aerial image so as to be superimposed on the image of the drone in the aerial image, and the drone is operated in synchronization with the user's hand movement detected by the motion sensor.
3. The wireless control device according to Claim 2, wherein the drone is an unmanned aerial vehicle, and when a user's hand inserted into the aerial image so as to be superimposed on the image of the unmanned aerial vehicle in the aerial image is moved upward, the unmanned aerial vehicle rises, and when the user's hand is moved downward, the unmanned aerial vehicle descends.
4. The wireless control device according to Claim 2, wherein the drone is an unmanned aerial vehicle, and when the user's hand, which is inserted into the aerial image so as to be superimposed on the image of the unmanned aerial vehicle in the aerial image, is tilted to the right, the unmanned aerial vehicle also tilts to the right, and when the user's hand is tilted to the left, the unmanned aerial vehicle also tilts to the left.
Citation Information
Patent Citations
Control device for unmanned aerial vehicle and control method thereof
JP2023081259A