Unmanned aerial vehicle camera remote control method, unmanned aerial vehicle system and storage medium

Abstract

The invention discloses an unmanned aerial vehicle camera remote control method, an unmanned aerial vehicle system and a storage medium, and the method comprises the steps: controlling a camera control module to cache a target instruction in response to an unmanned aerial vehicle control panel receiving the target instruction sent by a wireless mobile device through a wireless communication module, and enabling the camera control module to control the camera control module to cache the target instruction; in response to the fact that the camera control module judges that the target instruction is an instruction used for controlling the camera module, the camera control module is controlled to convert the target instruction into an instruction in a format adaptive to the camera module, and the converted target instruction is sent to the camera module for parameter control; and in response to the real-time picture data sent by the camera module and received by the image coding board, controlling the image coding board to send the real-time picture data to the wireless mobile equipment through the wireless communication module so as to display a camera interface picture corresponding to parameter control on the wireless mobile equipment. Based on the above mode, the use flexibility of the unmanned aerial vehicle camera can be improved.

Description

Technical Field

[0001] The present application relates to the field of drone technology, and in particular to a drone camera remote control method, a drone system, and a storage medium. Background Art

[0002] In the prior art, when controlling common cameras on the market, it is usually necessary to use a computer host that supports Windows and macOS systems to connect the camera, and then control the camera parameters through the computer host to perform shooting operations.

[0003] The drawback of the existing technology is that the drone's onboard camera is usually not configured with a computer host with Windows and macOS systems, making it difficult for the drone to adapt to common cameras on the market. Instead, it can only be configured with a corresponding drone-specific camera as the onboard camera, which makes the drone camera less flexible to use. Summary of the Invention

[0004] The main technical problem solved by this application is how to improve the flexibility of using drone cameras.

[0005] In order to solve the above technical problems, the first technical solution adopted in the present application is: a remote control method for a drone camera, applied to a drone system, the drone system including a wireless communication module, a drone control board, an image encoding board, a camera control module and a camera module; the drone control board is respectively connected to the wireless communication module and the camera control module, and the camera control module is connected to the camera module; the image encoding board is connected to the wireless communication module, and the image encoding board is connected to the camera module; the remote control method for the drone camera includes: in response to the drone control board receiving a target instruction sent by a wireless mobile device through the wireless communication module, controlling the camera control module to cache the target instruction, and in response to the camera control module determining that the target instruction is an instruction for controlling the camera module, controlling the camera control module to convert the target instruction into an instruction in a format adapted for the camera module, and sending the converted target instruction to the camera module for parameter control; in response to the image encoding board receiving real-time image data sent by the camera module, controlling the image encoding board to send the real-time image data to the wireless mobile device through the wireless communication module, so as to display a camera interface screen corresponding to the parameter control on the wireless mobile device.

[0006] The camera control module is a LINUX system control board, and / or the camera control module is connected to the camera module via a USB interface, and the image encoding board is connected to the camera module via an HDMI interface.

[0007] Among them, the target instruction is a MAVLINK instruction; in response to the drone control board receiving the target instruction sent by the wireless mobile device through the wireless communication module, the camera control module is controlled to cache the target instruction, and in response to the camera control module judging that the target instruction is an instruction for controlling the camera module, the camera control module is controlled to convert the target instruction into an instruction in a format suitable for the camera module, and the converted target instruction is sent to the camera module for parameter control, including: in response to the drone control board receiving the target instruction sent by the wireless mobile device through the wireless communication module, the camera control module is controlled to cache the target instruction, and the camera control module is controlled to judge whether the target instruction is a MAVLINK instruction; in response to the target instruction being a MAVLINK instruction, the camera control module is controlled to judge whether the target instruction is an instruction for controlling the camera module; in response to the target instruction being an instruction for controlling the camera module, the camera control module is controlled to convert the target instruction into an instruction in a format suitable for the camera module, and the converted target instruction is sent to the camera module through the USB interface for parameter control.

[0008] Among them, in response to the image encoding board receiving the real-time picture data sent by the camera module, the image encoding board is controlled to send the real-time picture data to the wireless mobile device through the wireless communication module, so as to display the camera interface picture corresponding to the parameter control on the wireless mobile device, including: in response to the image encoding board, through the HDMI interface, receiving the real-time picture data sent by the camera module, the image encoding board is controlled to send the real-time picture data to the wireless mobile device through the wireless communication module, so that the wireless communication module pushes the real-time picture data to the target IP address, and the wireless mobile device receives the real-time picture data through the target IP address, and displays the camera interface picture corresponding to the parameter control.

[0009] The step of pushing the real-time image data to the target IP address includes: pushing the real-time image data to the target IP address based on the RTSP protocol.

[0010] The method of sending the real-time picture data to the wireless mobile device through the wireless communication module includes: compressing the real-time picture data based on the H.264 encoder or the H.265 encoder; and sending the compressed real-time picture data to the wireless mobile device through the wireless communication module.

[0011] Among them, the camera control module is a processor of 64-bit Linux system based on ARM architecture.

[0012] Among them, the wireless communication module is a 32-bit Linux system processor based on the MIPS architecture.

[0013] In order to solve the above technical problems, the second technical solution adopted in this application is: a drone system, including: a memory and a processor; the memory is used to store program instructions, and the processor is used to execute program instructions to implement the above method.

[0014] In order to solve the above technical problems, the third technical solution adopted in this application is: a computer-readable storage medium, which stores program instructions, and the above method is implemented when the program instructions are executed by a processor.

[0015] The beneficial effects of the present application are as follows: different from the prior art, in the technical solution of the present application, the drone system includes a wireless communication module, a drone control board, an image encoding board, a camera control module and a camera module; the drone control board is connected to the wireless communication module and the camera control module respectively, and the camera control module is connected to the camera module; the image encoding board is connected to the wireless communication module, and the image encoding board is connected to the camera module; the drone camera remote control method applied to the drone system includes: in response to the drone control board receiving a target instruction sent by a wireless mobile device through the wireless communication module, controlling the camera control module to cache the target instruction, and in response to the camera control module determining that the target instruction is an instruction for controlling the camera module, controlling the camera control module to convert the target instruction into an instruction in a format adapted for the camera module, and sending the converted target instruction to the camera module for parameter control; in response to the image encoding board receiving real-time image data sent by the camera module, controlling the image encoding board to send the real-time image data to the wireless mobile device through the wireless communication module, so as to display a camera interface screen corresponding to the parameter control on the wireless mobile device. Based on the above method, in the first information channel, a camera control module can be added to the drone system, and the drone control board can receive target instructions in its commonly used format. The camera control module can cache the target instructions after detecting that the drone control board has received the target instructions, and in response to determining that the target instructions are not for drone control but for camera control, the camera control module converts the target instructions into corresponding instructions adapted to control the camera module, and sends them to the camera module for corresponding parameter control. At the same time, in the second information channel, the camera module can send the real-time image of the camera module to the corresponding wireless mobile device through the image encoding board and the wireless communication module, so that the user can use the wireless mobile device to control the parameters of the camera module on the drone and view the camera interface image corresponding to the parameter control, thereby realizing corresponding adaptation processing for common cameras when they are mounted on drones, thereby improving the flexibility of use of drone cameras. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0017] Figure 1 This is a schematic structural diagram of an embodiment of the drone system of the present application;

[0018] Figure 2 This is a flow chart of an embodiment of the method for remotely controlling a drone camera of the present application;

[0019] Figure 3 is a structural diagram of another embodiment of the drone system of the present application;

[0020] Figure 4 It is a structural diagram of an embodiment of the computer-readable storage medium of the present application.

[0021] Reference numerals: 11, wireless communication module; 12, drone control board; 13, image encoding board; 14, camera control module; 15, camera module. DETAILED DESCRIPTION

[0022] The present application will be further described in detail below in conjunction with the accompanying drawings and examples. It is particularly noted that the following examples are only intended to illustrate the present application and are not intended to limit the scope of the present application. Similarly, the following examples are only some examples of the present application and not all examples. All other examples obtained by those of ordinary skill in the art without creative work are intended to fall within the scope of protection of this application.

[0023] References to "embodiments" herein mean that a particular feature, structure, or characteristic described in connection with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various places in the specification does not necessarily refer to the same embodiment, nor does it constitute an independent or alternative embodiment that is mutually exclusive of other embodiments. It is understood, both explicitly and implicitly, by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0024] In the description of this application, it should be noted that, unless otherwise specified or limited, the terms "installed," "installed," "connected," and "connected" should be understood in a broad sense. For example, they can mean fixed connection, detachable connection, or integral connection; mechanical connection or electrical connection; direct connection or connection through an intermediate medium. Those skilled in the art will be able to understand the specific meanings of the above terms in this application in specific circumstances.

[0025] The present application provides a method for remotely controlling a drone camera, which is applied to a drone system.

[0026] See also Figure 1 , Figure 1 This is a schematic diagram of the structure of an embodiment of the drone system of the present application. Figure 1 As shown, the drone system includes a wireless communication module 11 , a drone control board 12 , an image encoding board 13 , a camera control module 14 and a camera module 15 .

[0027] The drone control board 12 is connected to the wireless communication module 11 and the camera control module 14, and the camera control module 14 is connected to the camera module 15. The drone control board 12 can also be called a flight control board, which can be used to control the flight of the drone included in the drone system.

[0028] The image encoding board 13 is connected to the wireless communication module 11 , and the image encoding board 13 is connected to the camera module 15 . The image encoding board 13 can be used to compress the image output by the camera module 15 and then output it through the wireless communication module 11 .

[0029] See also Figure 2 , Figure 2 This is a flow chart of an embodiment of the method for remotely controlling a drone camera of the present application. Figure 2 As shown, the remote control method of the drone camera includes:

[0030] Step S11: In response to the drone control board 12 receiving a target instruction sent by the wireless mobile device through the wireless communication module 11, the camera control module 14 is controlled to cache the target instruction, and in response to the camera control module 14 determining that the target instruction is an instruction for controlling the camera module 15, the camera control module 14 is controlled to convert the target instruction into an instruction in a format suitable for the camera module 15, and send the converted target instruction to the camera module 15 for parameter control.

[0031] Among them, the user can click to take a photo or adjust the photo parameters on a wireless mobile device (such as a tablet computer or mobile phone or other type of mobile device with wireless communication capabilities), so that the wireless mobile device generates and sends a target instruction to the wireless communication module 11. After the drone control board 12 receives the target instruction, the camera control module 14 caches the target instruction and judges the target instruction. If it is judged that the instruction is not used to control the flight of the drone, but to control the parameters of the camera module 15, the target instruction originally in a format suitable for flight control can be converted into a target instruction in a format suitable for parameter control of the camera module 15, and the converted target instruction is passed through the camera module 15 to realize parameter control of the camera module 15.

[0032] Step S12: In response to the image encoding board 13 receiving the real-time image data sent by the camera module 15, the image encoding board 13 is controlled to send the real-time image data to the wireless mobile device through the wireless communication module 11, so as to display the camera interface screen corresponding to the parameter control on the wireless mobile device.

[0033] Among them, while performing step S11, step S12 can also be performed synchronously. The image encoding board 13 can compress the received real-time image data, and then push the compressed real-time image data to the specified link address through the wireless communication module 11, so that the wireless mobile device can obtain the real-time image data when wirelessly communicating with the link address. The user can use the wireless mobile device to watch the real-time image data of the camera module 15 in real time while wirelessly controlling the parameters of the camera module 15, thereby performing shooting operations such as taking pictures and adjusting parameters. That is, based on the above method, low-latency and high-quality real-time remote wireless control of the camera module 15 can be achieved, and by adding a camera control module 14 and a corresponding control method, it can be adapted to common cameras that are not dedicated to drones, such as digital cameras such as SLR cameras, thereby improving the flexibility of drone cameras.

[0034] In addition, it should be noted that steps S11 and S12 can be executed in any order or in parallel, which is not limited here.

[0035] Parameter control may specifically refer to shutter control, aperture control, focal length control, and other types of parameter control, which are not limited here.

[0036] Different from the prior art, in the technical solution of the present application, the drone system includes a wireless communication module, a drone control board, an image encoding board, a camera control module and a camera module; the drone control board is connected to the wireless communication module and the camera control module respectively, and the camera control module is connected to the camera module; the image encoding board is connected to the wireless communication module, and the image encoding board is connected to the camera module; the drone camera remote control method applied to the drone system includes: in response to the drone control board receiving a target instruction sent by a wireless mobile device through the wireless communication module, the camera control module is controlled to cache the target instruction, and in response to the camera control module judging that the target instruction is an instruction for controlling the camera module, the camera control module is controlled to convert the target instruction into an instruction in a format adapted for the camera module, and the converted target instruction is sent to the camera module for parameter control; in response to the image encoding board receiving real-time image data sent by the camera module, the image encoding board is controlled to send the real-time image data to the wireless mobile device through the wireless communication module, so as to display a camera interface screen corresponding to the parameter control on the wireless mobile device. Based on the above method, in the first information channel, a camera control module can be added to the drone system, and the drone control board can receive target instructions in its commonly used format. The camera control module can cache the target instructions after detecting that the drone control board has received the target instructions, and in response to determining that the target instructions are not for drone control but for camera control, the camera control module converts the target instructions into corresponding instructions adapted to control the camera module, and sends them to the camera module for corresponding parameter control. At the same time, in the second information channel, the camera module can send the real-time image of the camera module to the corresponding wireless mobile device through the image encoding board and the wireless communication module, so that the user can use the wireless mobile device to control the parameters of the camera module on the drone and view the camera interface image corresponding to the parameter control, thereby realizing corresponding adaptation processing for common cameras when they are mounted on drones, thereby improving the flexibility of use of drone cameras.

[0037] In one embodiment, the camera control module 14 is a LINUX system control board.

[0038] and / or,

[0039] The camera control module 14 is connected to the camera module 15 via a USB interface, and the image encoding board 13 is connected to the camera module 15 via an HDMI interface.

[0040] Specifically, the camera control module 14 may be a processor of a 64-bit Linux system based on the ARM architecture. The program on the camera control module 14 may be a program supporting the ARMv8 architecture running under the Linux system.

[0041] The wireless communication module 11 can be a 32-bit Linux system processor based on the MIPS architecture. The wireless communication module 11 can be a WIFI module with the above processor, which is used to allow wireless mobile devices to access and achieve wireless communication by providing AP access point mode (i.e. hotspot mode).

[0042] Common cameras usually have a USB interface and an HDMI interface. The camera control module 14 can be connected to the camera module 15 via the USB interface, so that the camera control module 14 can input the converted target instructions through the USB interface to control the parameters of the camera module 15. The image encoding board 13 can be connected to the camera module 15 via the HDMI interface, so that the image encoding board 13 can obtain real-time image data of the camera module 15 through the HDMI interface, and send the real-time image data to the wireless mobile device through the wireless communication module 11.

[0043] Based on the above method, the parameters of common cameras can be controlled through the camera control module 14, and based on the two signal transmission channels of parameter control and real-time image data, the user can remotely view the real-time picture and real-time control of the camera module 15, thereby improving the convenience of using the drone camera.

[0044] Optionally, the target command is a MAVLINK command.

[0045] In response to the drone control board 12 receiving a target instruction sent by the wireless mobile device through the wireless communication module 11, the camera control module 14 is controlled to cache the target instruction. In response to the camera control module 14 determining that the target instruction is an instruction for controlling the camera module 15, the camera control module 14 is controlled to convert the target instruction into an instruction in a format adapted for the camera module 15 and send the converted target instruction to the camera module 15 for parameter control, including:

[0046] In response to the drone control board 12 receiving a target instruction sent by the wireless mobile device through the wireless communication module 11, the camera control module 14 is controlled to cache the target instruction, and the camera control module 14 is controlled to determine whether the target instruction is a MAVLINK instruction.

[0047] In response to the target command being a MAVLINK command, the camera control module 14 is controlled to determine whether the target command is a command for controlling the camera module 15 .

[0048] In response to the target instruction being an instruction for controlling the camera module 15, the camera control module 14 is controlled to convert the target instruction into an instruction in a format suitable for the camera module 15, and send the converted target instruction to the camera module 15 through the USB interface for parameter control.

[0049] Specifically, the MAVLINK protocol is a communication protocol for small unmanned vehicles, mainly used for communication between ground control terminals (ground stations) and drones, and also for communication between drone internal subsystems. MAVLINK instructions are instructions generated based on the MAVLINK protocol.

[0050] Since drones usually require low-latency and high-quality communication, MAVLINK instructions can be used to control the flight of the drone in a relatively timely and accurate manner. By sending target instructions for controlling the camera module 15 through MAVLINK instructions, real-time control of the camera module 15 can be achieved with the help of this low-latency and high-quality communication method, thereby improving the timeliness and accuracy of drone camera control.

[0051] Furthermore, in response to the image encoding board 13 receiving the real-time image data sent by the camera module 15, the image encoding board 13 is controlled to send the real-time image data to the wireless mobile device through the wireless communication module 11, so as to display the camera interface screen corresponding to the parameter control on the wireless mobile device, including:

[0052] In response to the image encoding board 13 receiving the real-time picture data sent by the camera module 15 through the HDMI interface, the image encoding board 13 is controlled to send the real-time picture data to the wireless mobile device through the wireless communication module 11, so that the wireless communication module 11 pushes the real-time picture data to the target IP address, and the wireless mobile device receives the real-time picture data through the target IP address and displays the camera interface picture corresponding to the parameter control.

[0053] Specifically, pushing real-time image data to a target IP address may include:

[0054] Based on the RTSP protocol, real-time image data is pushed to the target IP address.

[0055] The real-time image data is sent to the wireless mobile device via the wireless communication module 11, which may specifically include:

[0056] Based on the H.264 encoder or H.265 encoder, the real-time image data is compressed.

[0057] The compressed real-time image data is sent to the wireless mobile device via the wireless communication module 11 .

[0058] Based on the above method, the data transmission efficiency when the wireless communication module 11 obtains real-time image data can be improved, and the smoothness of users viewing the camera interface image in real time and performing corresponding parameter control through wireless mobile devices can be further improved, thereby achieving the effect of improving user experience.

[0059] For example, in practice, the camera control module 14 can be a control module based on RK3399 running a Linux system, and can have a Serial-to-USB driver chip for driving a USB interface. The wireless mobile device can be an Android platform device.

[0060] The specific process of step S11 may include:

[0061] After the user clicks to take a photo or adjust parameters on the wireless mobile device, the wireless mobile device generates a target instruction of the corresponding MAVLINK instruction and sends the target instruction to the drone control board 12. The camera control module 14 detects through the corresponding serial port that the drone control board 12 has received the target instruction, and then caches the target instruction and determines whether the cached target instruction conforms to the format of the MAVLINK protocol. If so, it further determines whether the target instruction is an instruction for controlling the camera module 15. If so, it triggers the camera control application of the application layer, first converts the target instruction into an instruction in a format that can control the camera module 15, and then sends the converted target instruction to the camera module 15 through the USB interface to achieve parameter control of the camera module 15.

[0062] The specific process of step S12 may include:

[0063] The camera module 15 can continuously transmit real-time image data to the image encoding board 13 through the HDMI interface. The image encoding board 13 can compress the real-time image data based on the RTSP (Real Time Streaming Protocol) protocol and the RTP (Real-Time Transport Protocol) protocol, and push the compressed real-time image data to the target IP address and target port through the wireless communication module 11, thereby building a streaming server and pushing real-time image data in real time on the streaming server. The wireless mobile device can connect to the target IP address and target port through video stream monitoring software (such as VLC software) to receive and play real-time image data from the streaming server in real time. The real-time image data will change in real time according to the above-mentioned parameter control, so that the user can obtain a smooth control feeling similar to or the same as that of the handheld camera module 15 when remotely controlling the camera module 15 located on the drone, thereby improving the convenience and flexibility of use of the drone camera.

[0064] This application also proposes a cleaning robot, see Figure 3 , Figure 3 FIG. 1 is a structural diagram of another embodiment of the drone system of the present application. Figure 3 As shown, the drone system 20 includes a processor 21 , a memory 22 and a bus 23 .

[0065] The processor 21 and the memory 22 are respectively connected to the bus 23. The memory 22 stores program instructions, and the processor 21 is used to execute the program instructions to implement the drone camera remote control method in the above embodiment.

[0066] In this embodiment, the processor 21 may also be referred to as a CPU (Central Processing Unit). The processor 21 may be an integrated circuit chip having signal processing capabilities. The processor 21 may also be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component. The general-purpose processor may be a microprocessor, or the processor 21 may be any conventional processor.

[0067] Different from the prior art, in the technical solution of the present application, the drone system includes a wireless communication module, a drone control board, an image encoding board, a camera control module and a camera module; the drone control board is connected to the wireless communication module and the camera control module respectively, and the camera control module is connected to the camera module; the image encoding board is connected to the wireless communication module, and the image encoding board is connected to the camera module; the drone camera remote control method applied to the drone system includes: in response to the drone control board receiving a target instruction sent by a wireless mobile device through the wireless communication module, the camera control module is controlled to cache the target instruction, and in response to the camera control module judging that the target instruction is an instruction for controlling the camera module, the camera control module is controlled to convert the target instruction into an instruction in a format adapted for the camera module, and the converted target instruction is sent to the camera module for parameter control; in response to the image encoding board receiving real-time image data sent by the camera module, the image encoding board is controlled to send the real-time image data to the wireless mobile device through the wireless communication module, so as to display a camera interface screen corresponding to the parameter control on the wireless mobile device. Based on the above method, in the first information channel, a camera control module can be added to the drone system, and the drone control board can receive target instructions in its commonly used format. The camera control module can cache the target instructions after detecting that the drone control board has received the target instructions, and in response to determining that the target instructions are not for drone control but for camera control, the camera control module converts the target instructions into corresponding instructions adapted to control the camera module, and sends them to the camera module for corresponding parameter control. At the same time, in the second information channel, the camera module can send the real-time image of the camera module to the corresponding wireless mobile device through the image encoding board and the wireless communication module, so that the user can use the wireless mobile device to control the parameters of the camera module on the drone and view the camera interface image corresponding to the parameter control, thereby realizing corresponding adaptation processing for common cameras when they are mounted on drones, thereby improving the flexibility of use of drone cameras.

[0068] This application also proposes a computer-readable storage medium, such as Figure 4 As shown, Figure 4 This is a schematic diagram of the structure of an embodiment of the computer-readable storage medium of the present application. Figure 4 As shown, in one embodiment of the present application, a computer-readable storage medium 30 stores program instructions 31 thereon, and when the program instructions 31 are executed by a processor (not shown), the drone camera remote control method in the above embodiment is implemented.

[0069] The computer-readable storage medium 30 in this embodiment can be, but is not limited to, a USB flash drive, an SD card, a PD optical drive, a mobile hard drive, a large-capacity floppy drive, a flash memory, a multimedia memory card, a server, a storage unit in an FPGA or an ASIC, etc.

[0070] Different from the prior art, in the technical solution of the present application, the drone system includes a wireless communication module, a drone control board, an image encoding board, a camera control module and a camera module; the drone control board is connected to the wireless communication module and the camera control module respectively, and the camera control module is connected to the camera module; the image encoding board is connected to the wireless communication module, and the image encoding board is connected to the camera module; the drone camera remote control method applied to the drone system includes: in response to the drone control board receiving a target instruction sent by a wireless mobile device through the wireless communication module, the camera control module is controlled to cache the target instruction, and in response to the camera control module judging that the target instruction is an instruction for controlling the camera module, the camera control module is controlled to convert the target instruction into an instruction in a format adapted for the camera module, and the converted target instruction is sent to the camera module for parameter control; in response to the image encoding board receiving real-time image data sent by the camera module, the image encoding board is controlled to send the real-time image data to the wireless mobile device through the wireless communication module, so as to display a camera interface screen corresponding to the parameter control on the wireless mobile device. Based on the above method, in the first information channel, a camera control module can be added to the drone system, and the drone control board can receive target instructions in its commonly used format. The camera control module can cache the target instructions after detecting that the drone control board has received the target instructions, and in response to determining that the target instructions are not for drone control but for camera control, the camera control module converts the target instructions into corresponding instructions adapted to control the camera module, and sends them to the camera module for corresponding parameter control. At the same time, in the second information channel, the camera module can send the real-time image of the camera module to the corresponding wireless mobile device through the image encoding board and the wireless communication module, so that the user can use the wireless mobile device to control the parameters of the camera module on the drone and view the camera interface image corresponding to the parameter control, thereby realizing corresponding adaptation processing for common cameras when they are mounted on drones, thereby improving the flexibility of use of drone cameras.

[0071] In the description of the present application, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described can be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art can combine and combine different embodiments or examples described in this specification and features of different embodiments or examples without contradiction.

[0072] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of the technical features being referred to. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of such features. Throughout the description of this application, "plurality" means at least two, for example, two, three, etc., unless otherwise specifically defined.

[0073] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code comprising one or more executable instructions for implementing the steps of a specific logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may be performed out of the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by those skilled in the art to which the embodiments of the present application belong.

[0074] The logic and / or steps represented in the flowcharts or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing the logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (which can be a personal computer, server, network device, or other system that can fetch and execute instructions from an instruction execution system, apparatus, or device). For purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport a program for use by, or in conjunction with, an instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of computer-readable media include the following: an electrical connection with one or more wires (electronic devices), a portable computer disk cartridge (magnetic device), random access memory (RAM), read-only memory (ROM), erasable and programmable read-only memory (EPROM or flash memory), fiber optic devices, and a portable compact disc read-only memory (CDROM). Furthermore, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing it in another suitable manner if necessary, and then storing it in a computer memory.

[0075] The above description is only an implementation method of the present application and does not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the description and drawings of this application, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A method for remotely controlling a drone camera, characterized in that: Applied to UAV system, the UAV system includes a wireless communication module, a UAV control board, an image encoding board, a camera control module and a camera module; The drone control board is connected to the wireless communication module and the camera control module respectively, and the camera control module is connected to the camera module; The image coding board is connected to the wireless communication module, and the image coding board is connected to the camera module; The remote control method for the drone camera includes: In response to the drone control board receiving a target instruction sent by a wireless mobile device through the wireless communication module, the camera control module is controlled to cache the target instruction, and in response to the camera control module determining that the target instruction is an instruction for controlling the camera module, the camera control module is controlled to convert the target instruction into an instruction in a format adapted for the camera module, and the converted target instruction is sent to the camera module for parameter control; In response to the image encoding board receiving the real-time picture data sent by the camera module, the image encoding board is controlled to send the real-time picture data to the wireless mobile device through the wireless communication module, so as to display the camera interface picture corresponding to the parameter control on the wireless mobile device.

2. The method for remotely controlling a drone camera according to claim 1, wherein: The camera control module is a LINUX system control board. and / or, The camera control module is connected to the camera module via a USB interface, and the image encoding board is connected to the camera module via an HDMI interface.

3. The method for remotely controlling a drone camera according to claim 2, wherein: The target instruction is a MAVLINK instruction; In response to the drone control board receiving a target instruction sent by a wireless mobile device through the wireless communication module, the camera control module is controlled to cache the target instruction, and in response to the camera control module determining that the target instruction is an instruction for controlling the camera module, the camera control module is controlled to convert the target instruction into an instruction in a format adapted for the camera module, and the converted target instruction is sent to the camera module for parameter control, including: In response to the drone control board receiving a target instruction sent by a wireless mobile device through the wireless communication module, controlling the camera control module to cache the target instruction, and controlling the camera control module to determine whether the target instruction is a MAVLINK instruction; In response to the target instruction being a MAVLINK instruction, controlling the camera control module to determine whether the target instruction is an instruction for controlling the camera module; In response to the target instruction being an instruction for controlling the camera module, the camera control module is controlled to convert the target instruction into an instruction in a format compatible with the camera module, and the converted target instruction is sent to the camera module through the USB interface for parameter control.

4. The method for remotely controlling a drone camera according to claim 3, wherein: In response to the image encoding board receiving the real-time image data sent by the camera module, controlling the image encoding board to send the real-time image data to the wireless mobile device through the wireless communication module, so as to display a camera interface screen corresponding to the parameter control on the wireless mobile device, including: In response to the image encoding board receiving the real-time picture data sent by the camera module through the HDMI interface, the image encoding board is controlled to send the real-time picture data to the wireless mobile device through the wireless communication module, so that the wireless communication module pushes the real-time picture data to the target IP address, and the wireless mobile device receives the real-time picture data through the target IP address and displays the camera interface screen corresponding to the parameter control.

5. The method for remotely controlling a drone camera according to claim 4, wherein: Pushing the real-time image data to the target IP address includes: Based on the RTSP protocol, the real-time image data is pushed to the target IP address.

6. The method for remotely controlling a drone camera according to claim 5, wherein: The sending of the real-time image data to the wireless mobile device via the wireless communication module includes: Based on the H.264 encoder or the H.265 encoder, the real-time picture data is compressed; The compressed real-time image data is sent to the wireless mobile device through the wireless communication module.

7. The method for remotely controlling a drone camera according to any one of claims 2 to 6, wherein: The camera control module is a processor of a 64-bit Linux system based on the ARM architecture.

8. The method for remotely controlling a drone camera according to any one of claims 2 to 6, wherein: The wireless communication module is a 32-bit Linux system processor based on the MIPS architecture.

9. A drone system, characterized in that: include: memory and processor; The memory is used to store program instructions, and the processor is used to execute the program instructions to implement the method according to any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that The computer-readable storage medium stores program instructions, and when the program instructions are executed by a processor, the method according to any one of claims 1 to 8 is implemented.

Images