Data transmission method, device, system, unmanned aerial vehicle and storage medium

Abstract

The application provides a data transmission method, device, system, unmanned aerial vehicle and storage medium. The method comprises: acquiring a first video collected by an image collection device of an unmanned aerial vehicle, the resolution of the first video being a first resolution; converting the first video to obtain a second video and a third video, the resolution of the second video being a second resolution, the second resolution being a video resolution supported by a first communication link, the resolution of the third video being a third resolution, the third resolution being a video resolution supported by a second communication link, and the third resolution being different from the second resolution; transmitting the second video to a first target device through the first communication link, and transmitting the third video to a second target device through the second communication link. The application can realize data transmission of the unmanned aerial vehicle through the double communication links.

Description

Technical Field

[0001] This application relates to unmanned aerial vehicle (UAV) communication technology, and more particularly to a data transmission method, apparatus, system, UAV, and storage medium. Background Technology

[0002] Unmanned aerial vehicles (UAVs) are unmanned aircraft controlled by radio remote control equipment and their own program control devices, or operated autonomously, either completely or intermittently, by an onboard computer. They have been widely used in many fields.

[0003] A key function of drones is aerial photography, transmitting captured video images to ground equipment. This relies heavily on communication between the drone and the ground equipment. Currently, the drone industry uses point-to-point wireless communication links to transmit video at a maximum resolution of 1080P. Alternatively, 5G mobile communication links can be used to transmit higher resolution video (greater than 1080P).

[0004] However, current drones cannot simultaneously employ dual communication links and transmit data. Summary of the Invention

[0005] This application provides a data transmission method, apparatus, system, drone, and storage medium to solve the problem that current drones cannot simultaneously use dual communication links for data transmission.

[0006] In a first aspect, this application provides a data transmission method, comprising: acquiring a first video captured by an image acquisition device of a drone, the first video having a first resolution; converting the first video to obtain a second video and a third video, the second video having a second resolution, the second resolution being a video resolution supported by a first communication link, the third video having a third resolution, the third resolution being a video resolution supported by a second communication link, and the third resolution being different from the second resolution; transmitting the second video to a first target device via the first communication link, and transmitting the third video to a second target device via the second communication link.

[0007] Secondly, this application provides a data transmission device, comprising: a first image processing module, configured to acquire a first video captured by an image acquisition device of a UAV, wherein the first video has a first resolution, and to convert the first video to obtain a second video, wherein the second video has a second resolution, and the second resolution is a video resolution supported by a first communication link; a second image processing module, configured to convert the first video to obtain a third video, wherein the second video has a second resolution, and the second resolution is a video resolution supported by the first communication link, and the third video has a third resolution, wherein the third resolution is a video resolution supported by a second communication link, and the third resolution is different from the second resolution; a first communication module, configured to transmit the second video to a first target device via the first communication link; and a second communication module, configured to transmit the third video to a second target device via the second communication link.

[0008] Thirdly, this application provides a data transmission system, including: a drone, a first target device, and a second target device; the drone is used to perform the method as described in the first aspect; the first target device is used to receive a second video; and the second target device is used to receive a third video.

[0009] Fourthly, this application provides a drone, comprising: an image acquisition device, a first transceiver, a second transceiver, a processor, and a memory communicatively connected to the processor; the image acquisition device is used to acquire video during drone operation to obtain a first video; the memory stores computer execution instructions; the processor executes the computer execution instructions stored in the memory to implement the method as described in the first aspect; the first transceiver is used to transmit a second video; and the second transceiver is used to transmit a third video.

[0010] Fifthly, this application provides a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, are used to implement the method described in the first aspect.

[0011] The data transmission method, apparatus, system, drone, and storage medium provided in this application acquire a first video captured by the drone's image acquisition device, the first video having a first resolution; convert the first video to obtain a second video and a third video, the second video having a second resolution supported by a first communication link, and the third video having a third resolution supported by a second communication link, and the third resolution being different from the second resolution; the second video is transmitted to a first target device via the first communication link, and the third video is transmitted to a second target device via the second communication link. Because the conversion is performed on the first video to obtain the second and third videos, and the second video is transmitted to the first target device via the first communication link, and the third video is transmitted to the second target device via the second communication link, the effect of data transmission from the drone using dual communication links can be achieved. Attached Figure Description

[0012] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0013] Figure 1 This is a schematic diagram of the structure of the data transmission system provided in the embodiments of this application;

[0014] Figure 2 A flowchart illustrating the data transmission method provided in this application embodiment;

[0015] Figure 3 This is a schematic diagram of the structure of a data transmission system provided in an embodiment of this application;

[0016] Figure 4 A schematic diagram of the data transmission method provided in the embodiments of this application;

[0017] Figure 5 A flowchart illustrating one implementation method for video acquisition using a drone as provided in this application embodiment;

[0018] Figure 6 This is a schematic diagram of another data transmission system provided in an embodiment of this application;

[0019] Figure 7 A flowchart illustrating another implementation of video acquisition using a drone provided in this application embodiment;

[0020] Figure 8 This is a schematic diagram of the structure of another data transmission system provided in an embodiment of this application;

[0021] Figure 9This is a schematic diagram of the structure of a drone provided in an embodiment of this application.

[0022] The accompanying drawings illustrate specific embodiments of this application, which will be described in more detail below. These drawings and descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concept of this application to those skilled in the art through reference to particular embodiments. Detailed Implementation

[0023] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0024] In recent years, with the development of drone technology, drones have been widely used in fields such as remote sensing data acquisition and processing, environmental monitoring, power line inspection, agricultural plant protection, aerial photography, photogrammetry, and rescue. In these fields, the most common use of drones is image acquisition, sending the acquired video to a handheld device (such as a remote controller) or a remote control. Users can then control the drone via the handheld device or remote control to hover, fly to designated destinations, and perform other actions.

[0025] The aforementioned image acquisition and transmission, as well as the control of the drone, all require communication between the drone and a handheld radio, or between the drone and a remote device. Currently, the traditional communication method for drones is based on microwave point-to-point transmission of video data to the handheld radio, which is short-range transmission. However, due to the bandwidth limitations of microwave point-to-point communication, drones can only transmit video with resolutions of 1080p and below. With the development of camera technology and mobile communication technologies such as 4G and 5G, drone image acquisition devices can acquire video with resolutions of 1080p and above, and transmit the acquired video data over long distances via 4G or 5G networks. In this case, because 4G or 5G networks can transmit video data with higher resolutions, and traditional microwave point-to-point methods cannot transmit high-resolution video data, the traditional microwave point-to-point method must be abandoned. In short-range transmission scenarios, users can usually observe the drone's surrounding environment on-site and make timely adjustments to the drone in dangerous situations. However, 4G or 5G networks have network latency, and in some cases with poor signal, data transmission may fail, meaning that the data transmission method for drones based on 4G or 5G networks has lower reliability. Therefore, a technology is needed that enables the coexistence of microwave point-to-point communication links and mobile communication links. Based on this, this application proposes the following technical concept: For 4K and higher resolution video acquired by a UAV image acquisition device, it is mirrored into two video data sets. One set is processed to the video resolution and format supported by the point-to-point communication link and transmitted to a first target device via the point-to-point communication link. The other set is processed to the video format supported by the mobile communication link and transmitted to a second target device via the mobile communication link.

[0026] The technical solution of this application and how the technical solution of this application solves the above-mentioned technical problems are described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. The embodiments of this application will now be described with reference to the accompanying drawings.

[0027] Figure 1 This is a schematic diagram of the data transmission system provided in an embodiment of this application. Figure 1 As shown, the data transmission system includes: a drone 1, a first target device 2, and a second target device 3;

[0028] In this embodiment, the drone 1 can be a fixed-wing drone, an unmanned helicopter, or a multi-rotor drone, etc.

[0029] The first target device 2 can be a handheld radio for the drone (i.e., the drone's remote control device), and the drone 1 communicates with the first target device 2 at close range. The user can control the drone at close range or receive data transmitted by the drone through the handheld radio.

[0030] The second target device 3 can be a server, specifically a cloud server. The drone 1 communicates with the second target device 3 over a long distance. Users can log in to the cloud server using smartphones, desktop computers, tablets, or laptops to view data received from the drone and send control commands to the drone for remote control.

[0031] based on Figure 1 The application scenarios shown are as follows: Figure 2 A flowchart illustrating the data transmission method provided in an embodiment of this application. Figure 2 As shown, the data transmission method includes the following steps:

[0032] S201. Acquire the first video captured by the image acquisition device of the UAV, wherein the resolution of the first video is the first resolution.

[0033] For example, Figure 3 This is a logical block diagram of a data transmission system provided in an embodiment of this application. Figure 3 As shown, the data transmission system includes: an image acquisition device 11, a first image processing module 12, a second image processing module 13, a first communication module 14, and a second communication module 15;

[0034] The image acquisition device 11 can be a camera, which is installed in a pod on the drone body.

[0035] Image acquisition device 11 is connected to first image processing module 12, first image processing module 12 is connected to first communication module 14, and second image processing module 13 is connected to second communication module 15. Optionally, first image processing module 12 can be an image processing chip, and second image processing module 13 can be implemented based on a microcontroller, specifically a JESTON embedded system.

[0036] The first communication module 14 can be a microwave point-to-point communication module, through which the image acquisition device 11 communicates with the first target device 2 via microwave point-to-point communication.

[0037] The second communication module 15 can be a mobile communication module, such as a 4G or 5G communication module, or a customer premise equipment (CPE). The image acquisition device 11 communicates with the second target device 3 via the second communication module 15. The CPE can receive 4G or 5G signals and forward them to the second target device in the form of wireless WIFI (wireless communication technology) signals.

[0038] It should be understood that in some embodiments, the first image processing module 12 and the second image processing module 13 may be integrated into a single image processing module.

[0039] In this embodiment, the first image processing module acquires the first video from the image acquisition device 11. Specifically, the image acquisition device 11 acquires video during the drone's operation to obtain the first video. The image acquisition device 11 then sends the first video to the first image processing module 12.

[0040] S202. The first video is converted to obtain a second video and a third video. The resolution of the second video is the second resolution, which is the video resolution supported by the first communication link. The resolution of the third video is the third resolution, which is the video resolution supported by the second communication link, and the third resolution is different from the second resolution.

[0041] Specifically, the first image processing module 12 converts the first video to obtain the second video. At the same time, the first image processing module 12 also sends the first video to the second image processing module 13, which converts the first video to obtain the third video.

[0042] In this embodiment, the communication link between the first communication module 14 and the first target device 2 is the first communication link, and the communication link between the second communication module 15 and the second target device 3 is the second communication link. Optionally, the first communication link is a point-to-point communication link, and the second communication link is a mobile communication link, such as a 4G or 5G mobile communication link.

[0043] In some alternative implementations, the second resolution may be lower than the first resolution, while the third resolution may be equal to the first resolution. Furthermore, the second video may be in a format supported by the first communication link, and the third video may be in a format supported by the second communication link; the formats of the second and third videos may be different.

[0044] Based on the above optional implementation methods, the first video is converted to obtain the second video, specifically including:

[0045] Step a1: Determine whether the format of the first video is a video format supported by the first communication link.

[0046] Step a2: If the format of the first video is a video format supported by the first communication link, then the first video is compressed to obtain the second video.

[0047] Step a3: If the format of the first video is not a video format supported by the first communication link, then the first video is transcoded and compressed to obtain the second video.

[0048] In this embodiment, the bandwidth of the first communication link is insufficient to transmit the first video at the first resolution. Therefore, the first video needs to be compressed to reduce its first resolution to a second resolution, resulting in a second video. The second resolution is the resolution of the video that the bandwidth of the first communication link can transmit.

[0049] exist Figure 3 In addition to the above, the first image processing module 12 may also be equipped with a High Definition Multimedia Interface (HDMI) and an RJ45 (Registered Jack 45) interface. The image acquisition device 11 can transmit the first video to the first image processing module 12 via the HDMI interface or the RJ45 interface.

[0050] Figure 4 This is a schematic diagram illustrating the data transmission method provided in an embodiment of this application. Figure 4As shown, the first video transmitted via the HDMI interface and the RJ45 interface has different formats. For example, if the image acquisition device and the HDMI interface on the first image processing module are connected via an HDMI cable, the first video in HDMI format is transmitted via the HDMI interface. If the image acquisition device and the RJ45 interface on the first image processing module are connected via an RJ45 network cable, the first video in the following formats can be transmitted via the RJ45 interface: User Datagram Protocol (UDP), Real-Time Streaming Protocol (RTSP), Real-Time Messaging Protocol (RTMP), etc. The first communication link supports the HDMI format. Therefore, if the first video is in HDMI format, it is directly compressed to reduce the resolution of the first video at the first resolution, resulting in a second video at the second resolution. If the first video is in UDP, RTSP, or RTMP format, it needs to be transcoded to convert the first video to HDMI format to obtain the second video.

[0051] Based on the above optional implementation methods, the first video is converted to obtain the third video, specifically including:

[0052] Step b1: Determine whether the format of the first video is a video format supported by the second communication link.

[0053] Step b2: If the format of the first video is not a video format supported by the second communication link, then the first video is transcoded to obtain the third video.

[0054] Step b3: If the format of the first video is a video format supported by the second communication link, then the first video is used as the third video.

[0055] In this embodiment, the bandwidth of the second communication link is sufficient to support the transmission of the first video at the first resolution.

[0056] Please continue reading. Figure 4 Since the second communication link supports RTMP video format, if the first video is in HDMI, UDP, or RTSP format (i.e., a format not supported by the second communication link), then the first video will undergo transcoding, i.e., video format conversion, to convert it into a third video in RTMP format. If the first video is in RTMP format, then no processing is required, and it can be directly used as the third video.

[0057] S203. Transmit the second video to the first target device through the first communication link, and transmit the third video to the second target device through the second communication link.

[0058] When the first target device is a handheld radio, the first image processing module 12 transmits the second video to the first target device through the first communication module 14, and the user at the near end can watch the second video through the handheld radio.

[0059] When the second target device is a cloud server, after the second image processing module 13 transmits the third video to the second target device through the second communication module 15, the remote user can watch the video in real time by accessing the IP address of the cloud server.

[0060] This embodiment acquires a first video captured by the image acquisition device of a drone, the first video having a first resolution; it then converts the first video to obtain a second video and a third video, the second video having a second resolution supported by the first communication link, and the third video having a third resolution supported by the second communication link, and the third resolution being different from the second resolution; the second video is transmitted to a first target device via the first communication link, and the third video is transmitted to a second target device via the second communication link. Because the conversion is performed on the first video to obtain the second and third videos, and the second video is transmitted to the first target device via the first communication link, and the third video is transmitted to the second target device via the second communication link, the effect of data transmission from the drone using dual communication links can be achieved.

[0061] The above embodiments describe how the UAV processes the acquired first video into a video format supported by the first and second communication links, transmits the first video to the first target device via the first communication link, and transmits the second video to the second target device via the second communication link. In some embodiments, the first and second target devices can also send image acquisition commands to the UAV to control image acquisition. The image acquisition command instructs the UAV's image acquisition device to acquire video of a first object to obtain the first video. The image acquisition device can receive the first image acquisition command sent from the first target device and, based on the command, acquire the first video acquired by the UAV's image acquisition device. Specifically, it controls the UAV's image acquisition device to acquire video of the first object indicated by the first image acquisition command to obtain the first video.

[0062] As described above, both the first target device and the second target device can send image acquisition commands to the drone to control it. However, to avoid the first target device and the second target device simultaneously controlling the drone, and to prevent the acquired images from interfering with each other, especially since the first target devices' image acquisition commands indicate different first objects for acquisition, this application can also propose at least two other implementation methods:

[0063] Figure 5 A flowchart illustrating one implementation method for video acquisition using a drone provided in this application. Figure 5 As shown, this embodiment includes:

[0064] S501, Receive the first image acquisition command sent by the first target device and the second image acquisition command sent by the second target device.

[0065] Specifically, at the same time, the first target device sends a first image acquisition command to the image acquisition device, and the second target device sends a second image acquisition command to the image acquisition device.

[0066] Figure 6 This is a schematic diagram of another data transmission system provided in an embodiment of this application. Figure 3 On the basis of, such as Figure 6 As shown, the system also includes: a control module 61; a first communication module 14 and a second communication module 15 are also connected to the control module 61, and the control module 61 is also connected to the image acquisition device 11.

[0067] The first target device can send a first image acquisition command to the control module 61 through the first communication module, and the second target device can send a second image acquisition command to the control module 61 through the second communication module. The control module 61 then determines the target image acquisition command from the first and second image acquisition commands; the target image acquisition command is either the first or the second image acquisition command, and controls the image acquisition device of the UAV to perform video acquisition on the first acquisition object indicated by the target image acquisition command, thereby obtaining the first video.

[0068] S502, determine the target image acquisition command from the first image acquisition command and the second image acquisition command; the target image acquisition command is either the first image acquisition command or the second image acquisition command.

[0069] Specifically, the target image acquisition command is determined from the first image acquisition command and the second image acquisition command, including:

[0070] 1. If the acquisition object indicated by the first image acquisition command and the second image acquisition command is the first object, then the first image acquisition command or the second image acquisition command shall be used as the target image acquisition command.

[0071] To avoid the situation where the image acquisition device of the UAV repeatedly captures video of the same object when the first image acquisition command and the second image acquisition command indicate the same object, the UAV can execute only one of the first image acquisition command and the second image acquisition command.

[0072] 2. If the objects indicated by the first image acquisition command and the second image acquisition command are different, the target image acquisition command shall be determined from the first image acquisition command and the second image acquisition command according to the preset priority of the first image acquisition command and the priority of the second image acquisition command.

[0073] For example, if the object to be acquired indicated by the first image acquisition instruction is a first object, and the object to be acquired indicated by the second image acquisition instruction is a second object, and the first object and the second object are not the same, then the image acquisition instruction corresponding to the higher priority of the first image acquisition instruction and the second image acquisition instruction can be used as the target image acquisition instruction according to the preset priority of the first image acquisition instruction and the priority of the second image acquisition instruction.

[0074] S503: The image acquisition device controlling the UAV performs video acquisition on the first acquisition object indicated by the target image acquisition command, and obtains the first video.

[0075] In this embodiment, if the objects indicated by the first image acquisition command and the second image acquisition command are different objects, the drone can execute the first image acquisition command first and then the second image acquisition command, or vice versa. The first image acquisition command is issued by the near-end user at the drone's operating site based on the on-site situation, while the second image acquisition command is issued by the remote user based on video footage of the drone's surrounding environment captured by the drone. Therefore, the near-end user can more accurately grasp the actual situation at the operating site. Thus, this embodiment can pre-set the image acquisition command from the first target device, meaning the first image acquisition command has a higher priority than the image acquisition command from the second target device. This allows the drone to execute the first and second image acquisition commands sequentially from highest to lowest priority, even when the objects indicated by the first and second image acquisition commands are different.

[0076] Figure 5 The illustrated embodiments are applicable to most scenarios. However, in some scenarios, when using UAVs to collect images for 3D modeling, the distance and time for UAV photography are strictly regulated. If the first target device and the second target device send image acquisition commands simultaneously, they will interfere with each other. For example, if a remote terminal sends a second image acquisition command while the UAV is performing a photography task according to the first image acquisition command, the footage captured by the UAV will be affected. Therefore, this application also proposes the following implementation method:

[0077] Figure 7 A flowchart illustrating another implementation of the video acquisition method using a drone provided in this application. Figure 7 As shown, this embodiment includes:

[0078] S701: Receive the first image acquisition command and instruction information sent by the first target device. The instruction information is used to instruct the UAV to disconnect the second communication link.

[0079] Please continue reading. Figure 6 The first target device can send a first image acquisition command and instruction information to the control module 61 through the first communication module. The control module 61 then disconnects the mobile communication link between the UAV and the second target device according to the instruction information, and controls the UAV's image acquisition device to acquire video according to the first image acquisition command to obtain the first video.

[0080] S702. According to the instructions, disconnect the mobile communication link between the UAV and the second target device.

[0081] S703, The image acquisition device controlling the UAV performs video acquisition according to the first image acquisition command to obtain the first video.

[0082] In some scenarios, the first image acquisition command is used to instruct the image acquisition device of the UAV to perform video acquisition at the target time and target location. In this case, S703 controls the image acquisition device of the UAV to perform video acquisition at the target location at the target time and obtain the first video.

[0083] In this embodiment, a near-end user can send first control commands and instruction information to the drone via a handheld radio. Specifically, the handheld radio can provide a graphical user interface for the near-end user, which can be configured with a function control. When the user triggers the function control, the first target device sends instruction information.

[0084] This embodiment sends an instruction message to the drone while simultaneously sending the first image acquisition command to the drone, thereby disconnecting the second communication link between the drone and the second target device. This ensures that the drone only receives and executes the image acquisition command from the first target device at any given time, thus preventing the drone from receiving the second image acquisition command while executing the first image acquisition command, which could affect the first video acquired according to the first image acquisition command and render the first video unusable.

[0085] It should be understood that Figure 7 The illustrated implementation is not limited to applications in special scenarios such as 3D modeling. In ordinary scenarios, the near-end user can also send a first image acquisition command and instruction information to the drone to cause the drone to disconnect the second communication link, that is, only receive the first image acquisition command and perform video acquisition according to the first image acquisition command to obtain the first video. In other words, the first video in this embodiment can be a video captured in an ordinary scenario or a video image captured in a special scenario such as 3D modeling.

[0086] The above embodiments describe the video acquisition process. For the drone, it can also receive a first control command sent by a first target device and a second control command sent by a second target device. To avoid the drone from simultaneously receiving and executing both the first and second control commands, potentially causing a dangerous accident, this application also proposes the following embodiments: receiving control commands and indication information sent by the first target device, whereby the indication information instructs the drone to disconnect the second communication link; disconnecting the mobile communication link between the drone and the second target device according to the indication information; and controlling the drone according to the control commands. Optionally, the first control command can instruct the drone to hover or move to a target Global Positioning System (GPS) coordinate point. This embodiment avoids the simultaneous control of the drone by the first and second target devices, preventing accidents. For example, if the first target device wants to control the drone to hover while the second target device wants to control it to move to a second destination, and the drone receives both control commands simultaneously, it is highly likely to crash.

[0087] Figure 8 This is a logical block diagram of another data transmission system provided in an embodiment of this application. (See diagram below.) Figure 8 As shown, in Figure 3Based on the data transmission system shown, the data transmission system may further include: a flight control module 81, a pod control module 82, a data processing module 83, and a third communication module 84, all of which are connected to the data processing module 83; the third communication module 82 may be a microwave point-to-point communication module.

[0088] The flight control module 81 is used to control the flight of the UAV. Data transmission between the flight control module 81 and the data processing module 83 is conducted via a first serial port. For example, the flight control module 81 can send flight control data and SBUS (a serial communication protocol using a 100K baud rate, 8 data bits, 2 stop bits, even parity, i.e., 8E2) data to the data processing module 83 through the first serial port. The flight control data includes the UAV's flight speed, flight altitude, and sensor data from various sensors installed on the UAV. The SBUS data includes data sent from the ground handheld device to control the UAV's ascent, descent, scrambling, and descent.

[0089] The pod control module 82 is used to control the camera mounted on the drone. Data transmission between the pod control module 82 and the data processing module 83 occurs via a second serial port. For example, the pod control module 82 can send pod control data to the data processing module 83 through the second serial port. This pod control data includes data for controlling the forward, backward, left, and right rotation, focusing, and locking of the camera mounted on the drone.

[0090] The data processing module 83 is used to process first control data such as flight control data, pod control data, and SBUS data. For example, it summarizes the flight control data, pod control data, and SBUS data to obtain second control data, and mirrors this second control data into two copies. One copy of the second control data is directly transmitted to the serial port conversion module to be converted into RTMP format second control data, and then sent to the cloud server through the second communication module. Remote users can view the UAV data and perform real-time control of the UAV and pod by entering the target IP address (the IP address of the cloud server).

[0091] Another set of second control data is sent to the drone's handheld device via the third communication module 84 and displayed on the drone's handheld device. Near-end users can view drone data and selectively control the drone through the drone's handheld device.

[0092] It should be noted that the division of the various modules in the above device is merely a logical functional division. In actual implementation, they can be fully or partially integrated into a single physical entity, or they can be physically separated. Furthermore, these modules can be implemented entirely in software via processing elements; they can be fully implemented in hardware; or some modules can be implemented by processing elements calling software, while others are implemented in hardware. For example, the first image processing module 12 can be a separate processing element, or it can be integrated into a chip in the above device. Alternatively, it can be stored as program code in the memory of the above device, and its functions can be called and executed by a processing element of the above device. The implementation of other modules is similar. Moreover, these modules can be fully or partially integrated together, or they can be implemented independently. The processing element here can be an integrated circuit with signal processing capabilities. In the implementation process, each step of the above method or each of the above modules can be completed through integrated logic circuits in the hardware of the processor element or through software instructions.

[0093] Figure 9 This is a schematic diagram of the structure of a drone provided in an embodiment of this application. Figure 9 As shown, the drone may include: a first transceiver 90, a second transceiver 91, a processor 92, a memory 93, and an image acquisition device 94.

[0094] Image acquisition device 94 is used to acquire video during the operation of the UAV to obtain the first video;

[0095] Processor 92 executes computer execution instructions stored in memory, causing processor 92 to perform the scheme in the above embodiments. Processor 92 can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components.

[0096] The memory 93 is connected to the processor 92 via the system bus and completes communication between them. The memory 93 is used to store computer program instructions.

[0097] The first transceiver 90 can be used to receive the first image acquisition command and to send the second video;

[0098] The second transceiver 91 is used to receive the second image acquisition command and to send the third video. This can be understood as the first transceiver 90 being used for data transmission with the first target device, and the second transceiver 91 being used for data transmission with the second target device.

[0099] The system bus can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The system bus can be divided into address bus, data bus, control bus, etc. For ease of representation, only one thick line is used in the diagram, but this does not indicate that there is only one bus or one type of bus. Transceivers are used to enable communication between database access devices and other computers (e.g., clients, read-write libraries, and read-only libraries). Memory may include random access memory (RAM) and may also include non-volatile memory.

[0100] This application also provides a chip for executing instructions, which is used to execute the data transmission method described in the above embodiments.

[0101] This application also provides a computer-readable storage medium storing computer instructions that, when executed on a computer, cause the computer to perform the data transmission method described in the above embodiments.

[0102] This application also provides a computer program product, which includes a computer program stored in a computer-readable storage medium. At least one processor can read the computer program from the computer-readable storage medium, and when the at least one processor executes the computer program, it can implement the technical solution of the data transmission method described in the above embodiments.

[0103] Other embodiments of this application will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this application that follow the general principles of this application and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this application are indicated by the following claims.

[0104] It should be understood that this application is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this application is limited only by the appended claims.

Claims

1. A data transmission method, characterized in that, include: Acquire a first video captured by the image acquisition device of the drone, wherein the resolution of the first video is a first resolution; The first video is converted synchronously and in parallel to obtain a second video and a third video. Both the second and third videos are complete videos that can be played independently. The second video has a second resolution, which is the video resolution supported by the first communication link. The third video has a third resolution, which is the video resolution supported by the second communication link and is different from the second resolution. The first communication link is a point-to-point communication link, and the second communication link is a mobile communication link. Both the first and second communication links are in a working state simultaneously. The second video is transmitted to the first target device via the first communication link, and the third video is transmitted to the second target device via the second communication link; wherein the first target device is the handheld radio of the drone, and the second target device is a server.

2. The method according to claim 1, characterized in that, The second resolution is lower than the first resolution, and the third resolution is equal to the first resolution.

3. The method according to claim 2, characterized in that, The second video is in a format supported by the first communication link, and the third video is in a format supported by the second communication link. The formats of the second video and the third video are different.

4. The method according to claim 3, characterized in that, The process of converting the first video to obtain the second video includes: Determine whether the format of the first video is a video format supported by the first communication link; If the format of the first video is a video format supported by the first communication link, then the first video is compressed to obtain the second video; If the format of the first video is not a video format supported by the first communication link, then the first video is transcoded and compressed to obtain the second video.

5. The method according to claim 3, characterized in that, The process of converting the first video to obtain the third video includes: Determine whether the format of the first video is a video format supported by the second communication link; If the format of the first video is not a video format supported by the second communication link, then the first video is transcoded to obtain the third video. If the format of the first video is a video format supported by the second communication link, then the first video is used as the third video.

6. The method according to any one of claims 1-5, characterized in that, The first video acquired by the image acquisition device of the drone includes: Receive the first image acquisition command sent by the first target device; According to the first image acquisition command, the first video captured by the image acquisition device of the UAV is obtained.

7. The method according to claim 6, characterized in that, The step of acquiring the first video captured by the image acquisition device of the UAV according to the first image acquisition command includes: The image acquisition device of the UAV is controlled to acquire video of the first acquisition object indicated by the first image acquisition command, thereby obtaining the first video.

8. The method according to claim 6, characterized in that, The step of receiving the first image acquisition command sent by the first target device includes: Receive a first image acquisition command sent by the first target device and a second image acquisition command sent by the second target device; The step of acquiring the first video captured by the image acquisition device of the UAV according to the first image acquisition command includes: A target image acquisition instruction is determined from the first image acquisition instruction and the second image acquisition instruction; the target image acquisition instruction is either the first image acquisition instruction or the second image acquisition instruction. The image acquisition device of the UAV is controlled to acquire video of the first acquisition object indicated by the target image acquisition command, and the first video is obtained.

9. The method according to claim 8, characterized in that, Determining the target image acquisition command from the first image acquisition command and the second image acquisition command includes: If the acquisition objects indicated by the first image acquisition command and the second image acquisition command are both the first object, then the first image acquisition command or the second image acquisition command shall be used as the target image acquisition command; If the objects indicated by the first image acquisition command and the second image acquisition command are different, the target image acquisition command is determined from the first image acquisition command and the second image acquisition command according to the preset priority of the first image acquisition command and the priority of the second image acquisition command.

10. The method according to claim 9, characterized in that, The step of determining the target image acquisition command from the first image acquisition command and the second image acquisition command according to the preset priorities of the first image acquisition command and the second image acquisition command includes: Based on the preset priorities of the first image acquisition command and the second image acquisition command, the image acquisition command with the higher priority among the first image acquisition command and the second image acquisition command is taken as the target image acquisition command.

11. The method according to claim 6, characterized in that, The step of receiving the first image acquisition command sent by the first target device includes: The drone receives a first image acquisition command and instruction information sent by the first target device, wherein the instruction information is used to instruct the drone to disconnect the second communication link. The step of acquiring the first video captured by the image acquisition device of the UAV according to the first image acquisition command includes: According to the instruction information, disconnect the second communication link; The image acquisition device controlling the UAV performs video acquisition according to the first image acquisition command, thereby obtaining the first video.

12. A data transmission device, characterized in that, include: The first image processing module is used to acquire a first video captured by the image acquisition device of the UAV, the first video having a first resolution, and to convert the first video to obtain a second video, the second video being a complete video that can be played independently, the second video having a second resolution, and the second resolution being the video resolution supported by the first communication link; The second image processing module is used to simultaneously and in parallel convert the first video to obtain a second video while the first image processing module converts the first video to obtain a third video. The third video is a complete video that can be played independently. The second video has a second resolution, which is a video resolution supported by the first communication link. The third video has a third resolution, which is a video resolution supported by the second communication link and is different from the second resolution. The first communication link is a point-to-point communication link, and the second communication link is a mobile communication link. The first communication link and the second communication link are both in operation. A first communication module is used to transmit the second video to a first target device via the first communication link; the first target device is the handheld radio of the drone. The second communication module is used to transmit the third video to the second target device through the second communication link; the second target device is a server.

13. A data transmission system, characterized in that, include: Unmanned aerial vehicle (UAV), first target equipment, and second target equipment; The drone is used to perform the method as described in any one of claims 1-11; The first target device is used to receive the second video; The second target device is used to receive the third video.

14. An unmanned aerial vehicle (UAV), characterized in that, include: The image acquisition device, the first transceiver, the second transceiver, the processor, and the memory communicatively connected to the processor; The image acquisition device is used to acquire video during the operation of the drone to obtain a first video. The memory stores computer-executed instructions; The processor executes computer execution instructions stored in the memory to implement the method as described in any one of claims 1-11; The first transceiver is used to send the second video; The second transceiver is used to send the third video.

15. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, are used to implement the method as described in any one of claims 1-11.

Images