Radio control device
The wireless control device addresses the limitations of traditional stick controls by using an aerial image display and motion sensing to enable intuitive and immersive drone operation, improving control precision and user experience, especially in out-of-visual flight scenarios.
Patent Information
- Application Number
- PCT/JP2024/019363
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-07-02
- Filing Date
- 2024-05-27
- Publication Date
- 2025-01-09
AI Technical Summary
Current wireless control devices for unmanned aircraft, such as drones, rely on limited input methods like stick controls, which are not intuitive and lack immersive experience, especially in out-of-visual flight scenarios where visual feedback is restricted.
A wireless control device equipped with an aerial image display that forms images in the air, using a motion sensor to detect hand gestures, allowing users to control the drone by interacting with the displayed image, enabling intuitive operation and immersive control.
Enhances the operability and entertainment value of controlling unmanned aircraft by providing an intuitive interface for users to control drones using hand gestures, even in out-of-visual flight conditions, and allows for more precise control of the drone's movements.
Smart Images

Figure JP2024019363_09012025_PF_FP_ABST
Abstract
Description
wireless control device
[0001] The present invention relates to a wireless control device for operating an unmanned aerial vehicle or the like.
[0002] Unmanned aerial vehicles, such as multicopters, are commonly called "drones" and are used in a variety of fields, with further developments expected in the future. Many of them are equipped with cameras, enabling aerial photography and surveys to be performed from unknown perspectives that are inaccessible to humans or conventional aircraft.
[0003] Generally, a controller called a radio control system is used to control a drone. A monitor is also provided to display images captured by a camera. Most drones are flown within visual line of sight (VLS), where the drone is controlled by operating the controller while keeping an eye on the drone itself. In applications where the drone cannot be seen, BLS flights are also performed, where the drone is controlled by viewing only the image on a monitor (or a head-mounted display device) (Patent Document 1).
[0004] JP 2023-81259 A
[0005] As such, drones are controlled using a controller called a radio control system, and most are controlled by tilting the left and right sticks back and forth and left and right. Some drones can be connected directly to a smartphone and controlled by operating the smartphone screen, but this generally results in less operability than using sticks.
[0006] Alternatively, goggles can be worn instead of a monitor for a more intuitive and immersive flying experience, but even in this case, controller input is limited to sticks.
[0007] SUMMARY OF THE INVENTION It is therefore an object of the present invention to provide a wireless control device equipped with a new interface for a wireless control object that is controlled by wireless communication.
[0008] In order to solve the above problem, one aspect of the present invention provides a wireless control device that controls a wirelessly controlled object equipped with a photographing device, and includes an aerial image display device that forms an image in the air, and a motion sensor that detects a user's hand gestures made near the aerial image formed by the aerial image display device, wherein the wireless control device receives the image of the wirelessly controlled object photographed by the photographing device and displays it as an aerial image on the aerial image display device, and wherein a plurality of gestures for controlling the wirelessly controlled object are defined, and in response to one of the gestures detected by the motion sensor, the wireless control device transmits a control signal for the corresponding wirelessly controlled object to the wirelessly controlled object, thereby controlling the wirelessly controlled object.
[0009] In one embodiment, the wirelessly controlled object is an unmanned aerial vehicle, and the image captured by the camera is converted into an image viewed from a bird's-eye view of the unmanned aerial vehicle, an image showing the unmanned aerial vehicle is superimposed, and then the image is displayed as an aerial image by the aerial image display device.
[0010] According to the wireless control device of the present invention, it is possible to operate a wirelessly controlled object more intuitively.
[0011] Furthermore, the wireless control device according to the present invention can add a new entertainment element to the operation of a wirelessly controlled object.
[0012] FIG. 1 is a perspective view showing an aerial image display device 1 in use when implemented as a wireless control device for an unmanned aerial vehicle according to a first embodiment of the present invention. FIG. 2 is a side view showing an aerial image display device 1 in use when implemented as a wireless control device for an unmanned aerial vehicle according to a first embodiment of the present invention. FIG. 3 is a side view showing the aerial image display device 1 shown in FIGS. 1 and 2 in a folded state. FIG. 4 is a front view showing the aerial image display device 1 shown in FIGS. 1 and 2 in a folded state. FIG. 5 is a rear view showing the aerial image display device 1 shown in FIGS. 1 and 2 in a folded state. FIG. 6 is a diagram showing a blackout curtain used in the aerial image display device 1 shown in FIGS. 1 and 2. FIG. 7 is a perspective view showing the blackout curtain of FIG. 6 attached to the aerial image display device 1 shown in FIGS. 1 and 2. FIG. 8 is a diagram explaining a method for constructing an overhead image in the wireless control device for an unmanned aerial vehicle according to a first embodiment of the present invention, and shows an example in which a camera on the unmanned aerial vehicle captures an image directly below and constructs an overhead image seen from above. FIG. 9 is a diagram illustrating a method for constructing an overhead image in a wireless control device for an unmanned aerial vehicle according to Example 1 of the present invention, illustrating an example in which a camera on the unmanned aerial vehicle captures an image diagonally downward and constructs an overhead image of the unmanned aerial vehicle viewed from diagonally above. FIG. 10 is a diagram illustrating an example of a flight image of an unmanned aerial vehicle displayed on the wireless control device for an unmanned aerial vehicle according to Example 1 of the present invention. FIG. 11 is a diagram illustrating an example of unmanned aerial vehicle operation performed by the wireless control device for an unmanned aerial vehicle according to Example 1 of the present invention. FIG. 12 is a perspective view illustrating an aerial image display device 2 in use when implemented as a wireless control device for an unmanned aerial vehicle according to Example 2 of the present invention. FIG. 13 is a side view illustrating an example in which an aerial image display device is used when implemented as a wireless control device for an unmanned aerial vehicle according to Example 2 of the present invention. FIG. 13 is a perspective view illustrating an example in which a modified example of the wireless control device for an unmanned aerial vehicle according to Example 2 of the present invention is implemented without using an aerial image display device.
[0013] The following description of the embodiments will be given using an unmanned aerial vehicle (drone) as a specific example of a wirelessly controlled object controlled by the wireless control device of the present invention. The drone operated by the wireless control device according to the embodiment of the present invention is not significantly different from a typical drone. However, it must be equipped with at least one imaging device (camera) for aerial photography. It also has an altitude sensor for measuring the drone's altitude. The altitude sensor can be an ultrasonic sonar or a LIDAR sensor. It also has a wireless communication device for wirelessly receiving control signals from the wireless control device and transmitting camera video signals and the like to the wireless control device.
[0014] [Structure of Aerial Image Display Device] A wireless control device for an unmanned aerial vehicle (drone) according to an embodiment of the present invention is implemented by an aerial image display device (aerial display) that forms an image in the air. Figure 1 is a perspective view showing the aerial image display device 1 according to embodiment 1 of the present invention in use. Figure 2 is a side view showing the aerial image display device 1 according to embodiment 1 of the present invention in use. Figures 3, 4, and 5 are side, front, and rear views showing the aerial image display device 1 shown in Figures 1 and 2 in a folded state.
[0015] As shown in these figures, the aerial image display device 1 consists of a support substrate 10 on which an information processing device that performs overall signal processing is mounted, a liquid crystal display 20 connected to this support substrate 10 via a hinge portion 12, and an optical plate 30 connected to this liquid crystal display 20 via a hinge portion 22.
[0016] The information processing device mounted on the support substrate 10 is essentially a small computer and is composed of a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), a storage device for storing various programs and data, an input / output interface, etc. The input / output interface includes, for example, a USB port 14 and a wireless communication device.
[0017] The wireless communication device is used to communicate with the drone, sending control signals to the drone for controlling the drone and receiving video signals captured by the drone's camera. Here, the wireless standard for unmanned mobile image transmission systems in the 5.7 GHz and 2.4 GHz bands is used, but wireless LANs such as WiFi that are equipped on general computers can also be used. The wireless communication device can also be an external device that connects to the USB port 14.
[0018] The surface of the liquid crystal display 20 facing the optical plate 30 is the display surface 24. That is, when the aerial image display device 1 is in the operable state shown in Figures 1 and 2, the display surface 24 faces diagonally upward. Then, based on the display data transmitted from the support substrate 10, a flight image of the drone, which will be described later, is displayed on the display surface 24.
[0019] Optical plate 30 has incident surface 31 facing downward and facing display surface 24 of liquid crystal display 20, and exit surface 33 facing directly upward. The image on display surface 24 of liquid crystal display 20 is then re-condensed as aerial image 4 at a position on the opposite side at the same distance, forming the same image as the original.
[0020] For example, the optical imaging element described in Japanese Patent Laid-Open Publication No. 2011-175297 can be used as this optical plate 30. This optical imaging element is realized by arranging a large number of mutually orthogonal planar light reflecting portions at a fixed pitch. Alternatively, a structure such as a two-sided corner reflector, in which reflective surfaces are formed on the side surfaces of a square hole, as described in Japanese Patent No. 4900618, can also be used.
[0021] Furthermore, optical plate 30 near hinge portion 22 is provided with infrared LEDs 32 and a pair of infrared cameras 34. These infrared LEDs 32 and infrared cameras 34 constitute an operation detection unit (motion sensor) that detects operations performed by the user on aerial image 4. The detection range of the operation detection unit is determined by the emission angle of infrared LEDs 32 and the angle of view of infrared cameras 34.
[0022] The support substrate 10, the liquid crystal display 20 and the optical plate 30 are connected to each other by hinge portions 12 and 22, respectively, and are fixed in an operable state by a pair of left and right locking rods 40, respectively, to the aerial image display device 1 shown in Figures 1 and 2.
[0023] That is, the locking rod 40 is rotatably supported by a shaft 42 provided in the center of the side surface of the liquid crystal display 20, and is capable of engaging with the engaging recess 16 of the support substrate 10 and the engaging recess 36 of the optical plate 30. In an in-use state in which both ends of the locking rod 40 are engaged with the engaging recess 16 of the support substrate 10 and the engaging recess 36 of the optical plate 30, the optical plate 30 is supported horizontally, and the liquid crystal display 20 is fixed at an angle of approximately 45 degrees downward relative to the optical plate 30. In this in-use state, the liquid crystal display 20 and the support substrate 10 are fixed at an angle of approximately 45 degrees.
[0024] It is important that the angle between the liquid crystal display 20 and the optical plate 30 and between the liquid crystal display 20 and the support substrate 10 is approximately 45 degrees. At this angle, the optical plate 30 is horizontal, and the light from the liquid crystal display 20 is focused into the aerial image 4 that rises at an angle of approximately 45 degrees under optimal conditions. More specifically, approximately 45 degrees is preferably in the range of approximately 40 to 50 degrees.
[0025] In this state, when an image is displayed on liquid crystal display 20, it is formed as aerial image 4 on the opposite side of optical plate 30. When a gesture such as touching this aerial image 4 with a finger is made, the operation is detected by an operation detection unit (motion sensor) consisting of infrared LED 32 and infrared camera 34, and a corresponding operation signal is sent to the information processing device of support substrate 10, where predetermined processing is performed.
[0026] When actually operating a drone, the image captured by the drone's camera is displayed as an aerial image on the LCD display 20. An image of the drone itself is then superimposed on the aerial image. As will be described later, the image captured by the camera is converted into an overhead image, as if taken from above and behind the drone, and displayed on the LCD display 20. This overhead image is displayed as aerial image 4 via the optical plate 30. Gestures made on the aerial image 4 are detected by a motion sensor. As a result, the aerial image 4 serves as an operation interface that allows the user to control the drone by touching it with their hands.
[0027] This aerial image display device 1 is highly portable. That is, when carrying it, both ends of the locking rod 40 are removed from the engagement recess 16 of the support substrate 10 and the engagement recess 36 of the optical plate 30, and the support substrate 10, the liquid crystal display 20, and the optical plate 30 are rotated at the hinge portions 12 and 22, and then horizontally stacked in a small pile as shown in the side view of Figure 3, the front view of Figure 4, and the rear view of Figure 5.
[0028] Therefore, the aerial image display device is portable and can be folded up small and carried around easily. For example, this aerial image display device and drone can be taken to any location and used to freely take aerial photographs, etc.
[0029] As shown in Fig. 1, a speaker 18 may be provided on the support substrate 10. For example, when an operation is performed on the aerial image 4 and detected, a clicking sound or the like can be used to notify the user. Also, audio guidance may be played for users who are unfamiliar with the operation.
[0030] Furthermore, to achieve a clearer aerial image 4, it is desirable that external light not be added to the light from the liquid crystal display 20. To achieve this, it is recommended to use a blackout curtain 44 as shown in Figure 6. This blackout curtain 44 is used to cover the space between the liquid crystal display 20 and the optical plate 30, and is made up of a left shielding portion 44L, a central shielding portion 44C, and a right shielding portion 44R.
[0031] The left shielding portion 44L covers the left opening between the liquid crystal display 20 and the optical plate 30, the central shielding portion 44C covers the central opening between the liquid crystal display 20 and the optical plate 30, i.e., the back portion, and the right shielding portion 44R covers the right opening between the liquid crystal display 20 and the optical plate 30.
[0032] Hook-and-loop fasteners 46 are provided on the edges of the blackout curtain 44. Although not directly shown in the figure, hook-and-loop fasteners are also provided on the corresponding surface of the aerial image display device 1. One of the hook-and-loop fasteners between the blackout curtain 44 and the aerial image display device 1 is a female fastener and the other is a male fastener, and as shown in Figure 7, they can be attached to completely cover the space between the liquid crystal display 20 and the optical plate 30. This prevents external light from mixing with the light from the liquid crystal display 20, achieving a clearer aerial image 4.
[0033] Here, the blackout curtain 44 is attached when in use, but it may be permanently fixed to the liquid crystal display 20 and the optical plate 30 without being attached or removed. In this case, when folding the aerial image display device 1, it is folded between the liquid crystal display 20 and the optical plate 30. One method of folding is, for example, an accordion fold, which is a zigzag fold like a folding fan.
[0034] [Method for constructing a bird's-eye view image] The aerial image displayed on the aerial image display device 1 is used as an operation interface to control the drone, but the drone is controlled in a BVLOS flight. Typically, BVLOS flight is performed by remote control using first-person viewpoint images. That is, the image from the drone's camera is displayed directly on the controller's monitor, and the drone is controlled while viewing that image. In this case, the user can feel as if they are in the cockpit. Furthermore, the drone can be controlled in situations where BVLOS flight is difficult.
[0035] However, with remote control using first-person perspective video, the drone itself cannot be seen, making it difficult to grasp the sense of distance from the surroundings, and the difficulty level is high.In this invention, instead of first-person perspective video, an overhead video that includes the drone itself is displayed on the controller monitor.This makes it possible to control the drone while checking its position in the surrounding situation as if it were flying within visual line of sight, even though it is flying beyond visual line of sight.
[0036] Next, we will explain how to obtain a bird's-eye view from drone camera footage that includes the drone itself. The simplest method is to point the camera of drone U directly downward (see Figure 8). If the ground is flat, a bird's-eye view from a virtual camera virtually set at position V above the drone can be obtained by inserting a pre-saved image of the drone into the center of the camera's captured image. The size of the drone image to be inserted into the bird's-eye view is calculated from the virtual camera's angle of view, the drone's altitude, and the virtual camera's altitude.
[0037] More generally, if the camera is tilted or the bird's-eye view point (virtual camera position V) is set at an oblique position, image conversion processing of the camera image is required to obtain a bird's-eye view image. In this case, an image is obtained as if the drone were photographed from diagonally above. For example, in FIG. 9, consider the case where drone U is moving to the right and the camera is pointing downward in the direction of travel. In this case, the range of area R on the ground is imaged. In this case, the camera has a 90-degree angle of view.
[0038] The image captured by the camera is a perspective image of the ground area R, with the camera position (drone position) as the viewpoint. Therefore, first, an inverse perspective transformation is performed on the image data of this captured image to convert it into planar image data of the ground area R. This requires data on the altitude of the camera position and the tilt angle of the camera.
[0039] Next, a virtual camera is assumed to be placed at a predetermined position above and behind the drone. In this first embodiment, the position V of the virtual camera is linked to the tilt of the drone's camera. For example, the optical axis of the virtual camera (shown by the two-dot chain line in FIG. 9 ) always passes through the position of the drone's camera, and the position V of the virtual camera is linked to the tilt of the drone's camera so that the distance between the drone's camera and the virtual camera is equal to the altitude of the drone's camera. Therefore, in many cases, an image is displayed that appears to have been taken from above and behind the drone.
[0040] Then, by performing perspective transformation on the planar image data of the ground area R to create a perspective image with the virtual camera as the viewpoint, a captured image of the ground as seen from the virtual camera is obtained. By inserting a pre-saved image of the drone at the drone's position in the captured image, a flight image of the drone as seen from the virtual camera's position is obtained (see Figure 10).
[0041] Note that the drone image is displayed as an aerial image here. This is a natural display and is useful for understanding the positional relationship between the ground and the drone. However, the center of the ground image will naturally be hidden by the drone image and will not be visible. To make this center part visible, it is a good idea to make the drone image superimposed on the overhead image semi-transparent. This will allow you to see the entire ground image.
[0042] [Method for controlling a drone using an aerial image display device] Next, we will explain a method for controlling a drone using gestures on an aerial image. As explained above in "Method for generating an overhead image," the aerial image display device displays an image that appears to be taken from above and behind the drone.
[0043] The pilot controls the drone by placing his / her hand on the image screen of the aerial image display device (the surface indicated by the dashed line in Figure 11) and making gestures. Specifically, the pilot controls the drone by directly touching the image of the displayed drone. If the pilot removes his / her hand from the image screen, the drone will not be controlled.
[0044] You can also change the camera's shooting angle by touching and moving your finger up and down the tilt lever C displayed at the bottom right of the screen (see Figure 10). For example, you can adjust it from directly below (-90 degrees) to slightly upward (+24 degrees).
[0045] Here are some specific examples of gestures for controlling a drone. First, by inserting your hand horizontally so that it overlaps the drone displayed in the aerial image and tilting it to the right, you can control the actual drone to tilt to the right (see arrow R in Figure 11). Similarly, by tilting your hand inserted in the aerial image to the left, you can control the actual drone to tilt to the left (see arrow L in Figure 11).
[0046] Furthermore, by inserting your hand horizontally so that it overlaps the drone displayed in the aerial image and then lifting it up, the actual drone will rise (see arrow U in Figure 11). Similarly, by lowering your hand inserted in the aerial image, you can control the actual drone to descend (see arrow D in Figure 11).
[0047] You can also freely define various other gestures. For example, if you insert your index finger over the drone, the drone will fly straight, and if you tilt it left or right, the actual drone will also move straight ahead while tilting left or right. You can also define operations such as pointing your thumb back and the drone will move backward.
[0048] As described above, the drone control method of the present invention is extremely simple and intuitive, relying on gestures using bare hands, so even beginners can quickly learn and enjoy controlling the drone.
[0049] In the first example, gestures are made directly with the hand to the drone displayed in the aerial image. While this is intuitive and easy to understand, the hand is placed over the drone displayed in the aerial image, which blocks the overhead image and the display of the drone, making it difficult to see.
[0050] Therefore, in Example 2, the hand is replaced with a semi-transparent display. Since the explanation of Example 2 is largely the same as that of Example 1, the same elements in the drawings are given the same reference numerals and their explanation will be omitted. Only the differences from Example 1 will be explained below.
[0051] Fig. 12 is a perspective view showing the aerial image display device 2 in use, implemented as a wireless control device for an unmanned aerial vehicle according to Example 2 of the present invention. Fig. 13 is a side view showing the aerial image display device 2 shown in Fig. 12.
[0052] As shown in these figures, the aerial image display device 2 consists of a support substrate 10 on which an information processing device that performs overall signal processing is mounted, a liquid crystal display 20 connected to this support substrate 10 via a hinge portion 12, and an optical plate 30 connected to this liquid crystal display 20 via a hinge portion 22.
[0053] The structures and functions of the support substrate 10, the liquid crystal display 20, and the optical plate 30 are generally the same as those of the first embodiment, except that an image sensor 49 is provided at the center inside the hinge portion 12, and an image sensor 48 is provided at the upper center of the back surface of the liquid crystal display 20.
[0054] The imaging element 48 images the space between the support substrate 10 and the liquid crystal display 20 (hereinafter referred to as the operation space S) from above, and the imaging element 49 images the operation space S between the support substrate 10 and the liquid crystal display 20 from the front. These imaging elements 48 and 49 detect the movement of the hand H inserted in the operation space S between the support substrate 10 and the liquid crystal display 20.
[0055] The hand H detected by these imaging elements 48, 49 is displayed on the display surface 24 of the liquid crystal display 20 and on the aerial image 4 as a condensed image through the optical plate 30. However, only the outline H' of the hand H is displayed, or displayed semi-transparently, so as not to obstruct the overhead video or drone image displayed on the aerial image 4. By moving the hand H, it is possible to operate the aerial image 4 (pilot the drone) using this hand H'.
[0056] As in Example 1, when actually operating a drone, the image captured by the drone's camera is displayed as a bird's-eye view on the LCD display 20. The drone image is then displayed superimposed on top of this. In Example 2, a hand H is also displayed as a semi-transparent image or as an outline H' superimposed on the drone image of the bird's-eye view. The bird's-eye view image displayed as an aerial image via the optical plate 30 serves as an operation interface that allows the drone to be operated using the hand. The actual method of operating a drone is as described in the "Method of operating a drone using an aerial image display device" in the above example.
[0057] As a method for detecting the hand H in the operational space S, for example, the positions of the five fingertips may be identified and an outline H' or semi-transparent image of the hand H may be created from the identified positions on the aerial image 4. Alternatively, it is effective to display only pointers indicating the fingertips on the aerial image 4, rather than an outline or semi-transparent image. In this case, a simple method is to identify only the position of the index fingertip and display one pointer on the aerial image 4. Alternatively, the positions of the index finger and thumb may be identified and two pointers may be displayed on the aerial image 4, or the five fingers may be displayed as five pointers on the aerial image 4. By moving these pointers, it is also possible to control a drone.
[0058] Figure 14 shows a specific example of a wireless control device for an unmanned aerial vehicle (drone) that does not use an aerial image display device. Elements of this wireless control device 5 that correspond to the elements of the aerial image display device in Figure 13 are given the same reference numerals, and their descriptions will not be repeated. Here, optical plate 30 in Figure 13 is replaced with a liquid crystal display 60, and a support substrate 65 is provided at the position of liquid crystal display 20 in Figure 13. However, liquid crystal display 60 is supported in a position that is easy for the user to view, raised to the position of aerial image 4 in Figure 1.
[0059] Similarly, in the wireless control device 5, an imaging element 48 is provided at the upper center of the back surface of the support substrate 65, and an imaging element 49 is provided at the center of the inside of the hinge portion 12. The imaging element 48 captures an image of the operational space S from above, and the imaging element 49 captures an image of the operational space S between the support substrate 10 and the support substrate 65 from the front. These imaging elements 48 and 49 detect the movement of the hand H inserted in the operational space S.
[0060] The hand H detected by these image sensors 48, 49 is displayed on the liquid crystal display 60. However, similar to the example shown in Fig. 1, only the outline H' of the hand H is displayed or displayed semi-transparently, or a pointer corresponding to the position of the fingertip is displayed so as not to obstruct the overhead image or drone image displayed on the liquid crystal display 60. The drone can be controlled by the movement of the hand H.
[0061] This makes it possible to control the drone using gestures while viewing the entire flight footage, making the difficult task of flying beyond visual line of sight more accessible.
[0062] According to the wireless control device of the present invention, it is possible to control the aerial image by making gestures with bare hands, making it possible to operate the device more intuitively and with a high level of entertainment.
[0063] The paper correction device and image forming system according to the present invention have been described above based on the embodiments, but the present invention is not limited to these, and modifications may be made within the scope of the present invention, and if possible, the techniques described in each embodiment may be combined, or publicly known techniques may be combined.
[0064] In the above embodiment, an unmanned aerial vehicle (drone) is used as a specific example of a wireless control target controlled by a wireless control device of the present invention. However, the present invention is not limited to this and can be applied to any wireless control target that can be controlled by a wireless control device. For example, various drones such as underwater drones, unmanned vehicles, etc. can be wirelessly controlled targets.
[0065] In the above embodiment, the bird's-eye view image is generated by performing image conversion on the camera image in real time, but the present invention is not limited to this. For example, it is possible to obtain a bird's-eye view image with a wider angle of view by storing images captured by a camera, converting a previously captured image into an bird's-eye view image seen from the current position of the virtual camera, and combining the converted image with the bird's-eye view image from the current captured image.
[0066] Furthermore, while the above-described embodiments employ a liquid crystal display, the present invention is not limited to this and may employ an organic electroluminescence (EL) display, electronic paper, or the like. Furthermore, while a locking rod is used as a support structure for fixing the display and optical panel, the present invention is not limited to this. For example, a locking mechanism may be implemented in the hinge portion itself, or a shielding plate may be used instead of a blackout curtain and used as a support structure for fixing the display and optical panel.
[0067] REFERENCE SIGNS LIST 1, 2, 5 Aerial image display device 10, 65 Support substrate 12 Hinge portion 14 Port 16 Engagement recess 18 Speaker 20, 60 Liquid crystal display 22 Hinge portion 24 Display surface 30 Optical plate 31 Incident surface 33 Exit surface 34 Infrared camera 36 Engagement recess 40 Locking rod 42 Axis 44 Blackout curtain 44C Central shielding portion 44L Left shielding portion 44R Right shielding portion 46 Hook-and-loop fastener 48, 49 Imaging element
Claims
1. A wireless control device for controlling a wirelessly controlled object equipped with a photographing device, comprising: an aerial image display device that forms an image in the air; and a motion sensor that detects hand gestures made by a user in the vicinity of the aerial image formed by the aerial image display device, wherein the wireless control device receives images of the wirelessly controlled object photographed by the photographing device and displays them as an aerial image on the aerial image display device, wherein a plurality of gestures for controlling the wirelessly controlled object are defined, and in response to one of the gestures detected by the motion sensor, the wireless control device transmits a corresponding control signal for the wirelessly controlled object to the wirelessly controlled object, thereby controlling the wirelessly controlled object.
2. The wireless control device described in claim 1, characterized in that the wireless control target is an unmanned aerial vehicle, the image captured by the imaging device is converted into an image viewed from a bird's-eye view of the unmanned aerial vehicle, an image showing the unmanned aerial vehicle is superimposed, and then the image is displayed as an aerial image by the aerial image display device.
Citation Information
Patent Citations
Gesture operation device
JP2017062709A
Information processing device and program
JP2019139306A
Feedback to facilitate control of unmanned aerial vehicles (UAVs)
US9563201B1
Unmanned aerial vehicle remote control device, unmanned aerial vehicle remote control system, unmanned aerial vehicle remote control method, and recording medium
WO2021215366A1