Data processing method, terminal device, unmanned aerial vehicle, system and storage medium

Abstract

A data processing method, terminal device, unmanned aerial vehicle, system and storage medium, the method comprising: displaying an image captured by a camera of an unmanned aerial vehicle on a display interface of a terminal device (S101); obtaining an operation of a user on the display interface, and determining a target image from the image captured by the unmanned aerial vehicle according to the operation (S102); obtaining target state data when the camera captures the target image (S103), the target state data comprising flight state data and camera state data; generating an identification code according to the target state data, and displaying the identification code on the display interface, wherein the target state data can be obtained based on the identification code (S104).

Description

Technical Field

[0001] This application relates to the field of unmanned aerial vehicle (UAV) technology, and more particularly to a data processing method, terminal equipment, UAV, system, and storage medium. Background Technology

[0002] When shooting, the camera on a drone usually stores relevant information (such as exposure, aperture, focal length, shutter speed, GPS information when the drone takes photos, flight path information when the drone takes videos, gimbal rotation angle, etc.) in a Keyhole Markup Language (KML) file. However, the operation of transferring files between devices is cumbersome, which is not conducive to users obtaining this relevant information conveniently and performing reshoots. Summary of the Invention

[0003] Based on this, this application provides a data processing method, a terminal device, a drone, a drone system, and a storage medium.

[0004] In a first aspect, this application provides a data processing method, the method comprising:

[0005] The images captured by the drone's camera are displayed on the terminal device's screen.

[0006] The system acquires user actions on the display interface and determines the target image from images captured by the drone based on those actions.

[0007] Acquire target state data when the shooting device captures the target image, the target state data including flight state data and shooting state data;

[0008] An identification code is generated based on the target status data, and the identification code is displayed on the display interface, wherein the target status data can be obtained based on the identification code.

[0009] Secondly, this application provides a data processing method applied to a drone, the method comprising:

[0010] The device receives a request instruction sent by a terminal device. The request instruction is used to instruct the UAV to send target status data when the UAV's shooting device is shooting a target image. The target status data includes flight status data and shooting status data.

[0011] The target status data is sent to the terminal device, which generates an identification code based on the target status data, and the target status data can be obtained based on the identification code.

[0012] Thirdly, this application provides a terminal device, the terminal device comprising: a memory and a processor; the memory is used to store computer programs;

[0013] The processor is configured to execute the computer program and, when executing the computer program, perform the following steps:

[0014] The images captured by the drone's camera are displayed on the terminal device's screen.

[0015] The system acquires user actions on the display interface and determines the target image from images captured by the drone based on those actions.

[0016] Acquire target state data when the shooting device captures the target image, the target state data including flight state data and shooting state data;

[0017] An identification code is generated based on the target status data, and the identification code is displayed on the display interface, wherein the target status data can be obtained based on the identification code.

[0018] Fourthly, this application provides a drone equipped with a camera, the drone including: a communication module, a memory, and a processor;

[0019] The memory is used to store computer programs;

[0020] The processor is configured to execute the computer program and, when executing the computer program, perform the following steps:

[0021] The control communication module receives a request instruction sent by the terminal device. The request instruction is used to instruct the UAV to send target status data when the UAV's shooting device is shooting a target image. The target status data includes flight status data and shooting status data.

[0022] The control communication module sends the target status data to the terminal device, enabling the terminal device to generate an identification code based on the target status data, and the target status data can be obtained based on the identification code.

[0023] Fifthly, this application provides an unmanned aerial vehicle (UAV) system, which includes the terminal device described above and the UAV described above.

[0024] In a sixth aspect, this application provides a computer-readable storage medium storing a computer program that, when executed by a processor, causes the processor to implement the data processing method described in the first aspect above.

[0025] In a seventh aspect, this application provides a computer-readable storage medium storing a computer program that, when executed by a processor, causes the processor to implement the data processing method described in the second aspect above.

[0026] This application provides a data processing method, a terminal device, a drone, a drone system, and a storage medium. The method on the terminal device includes: displaying images captured by a drone's camera on a display interface of the terminal device; acquiring user operations on the display interface and determining a target image from the images captured by the drone based on the operations; acquiring target state data when the camera captured the target image, the target state data including flight state data and shooting state data; generating an identification code based on the target state data and displaying the identification code on the display interface, wherein the target state data can be obtained based on the identification code. Since the target image is determined from the images captured by the drone based on user operations on the display interface showing images captured by the drone's camera, it is very convenient to capture target images that the user may be interested in. Since the identification code is generated based on the acquired target state data when the camera captured the target image and displayed on the display interface, the target state data can be obtained based on the identification code. This provides technical support for quickly and conveniently sharing the identification code, and provides technical support for quickly and conveniently obtaining target state data of the target image, including flight state data and shooting state data, based on the identification code, thereby providing technical support for subsequent reshoots. The method on the drone side includes: receiving a request instruction sent by a terminal device, the request instruction instructing the drone to send target status data when its imaging device captures an image of the target; sending the target status data to the terminal device, enabling the terminal device to generate an identification code based on the target status data, and the target status data can be obtained based on the identification code. This provides technical support for the terminal device to generate an identification code based on the target status data.

[0027] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and do not limit this application. Attached Figure Description

[0028] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0029] Figure 1 This is a flowchart illustrating an embodiment of the data processing method of this application;

[0030] Figure 2 This is a flowchart illustrating another embodiment of the data processing method of this application;

[0031] Figure 3 This is a flowchart illustrating another embodiment of the data processing method of this application;

[0032] Figure 4 This is a schematic diagram of an image identification code according to an embodiment of the data processing method of this application;

[0033] Figure 5 This is a flowchart illustrating another embodiment of the data processing method of this application;

[0034] Figure 6 This is a flowchart illustrating another embodiment of the data processing method of this application;

[0035] Figure 7 This is a flowchart illustrating another embodiment of the data processing method of this application;

[0036] Figure 8 This is a schematic diagram of the structure of an embodiment of the terminal device of this application;

[0037] Figure 9 This is a schematic diagram of the structure of an embodiment of the UAV of this application;

[0038] Figure 10 This is a schematic diagram of the structure of an embodiment of the unmanned aerial vehicle system of this application. Detailed Implementation

[0039] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0040] The flowchart shown in the attached diagram is for illustrative purposes only and does not necessarily include all content and operations / steps, nor does it necessarily have to be performed in the order described. For example, some operations / steps can be broken down, combined, or partially merged, so the actual execution order may change depending on the actual situation.

[0041] This application provides a data processing method, a terminal device, a drone, a drone system, and a storage medium. The method on the terminal device includes: displaying images captured by a drone's camera on a display interface of the terminal device; acquiring user operations on the display interface and determining a target image from the images captured by the drone based on the operations; acquiring target state data when the camera captured the target image, the target state data including flight state data and shooting state data; generating an identification code based on the target state data and displaying the identification code on the display interface, wherein the target state data can be obtained based on the identification code. Since the target image is determined from the images captured by the drone based on user operations on the display interface showing images captured by the drone's camera, it is very convenient to capture target images that the user may be interested in. Since the identification code is generated based on the acquired target state data when the camera captured the target image and displayed on the display interface, the target state data can be obtained based on the identification code. This provides technical support for quickly and conveniently sharing the identification code, and provides technical support for quickly and conveniently obtaining target state data of the target image, including flight state data and shooting state data, based on the identification code, thereby providing technical support for subsequent reshoots. The method on the drone side includes: receiving a request instruction sent by a terminal device, the request instruction instructing the drone to send target status data when its imaging device captures an image of the target; sending the target status data to the terminal device, enabling the terminal device to generate an identification code based on the target status data, and the target status data can be obtained based on the identification code. This provides technical support for the terminal device to generate an identification code based on the target status data.

[0042] The following detailed description of some embodiments of this application is provided in conjunction with the accompanying drawings. Unless otherwise specified, the following embodiments and features can be combined with each other.

[0043] The data processing methods in this application include a data processing method applied to a terminal device (hereinafter referred to as the terminal device method) and a data processing method applied to a drone (hereinafter referred to as the drone method). For ease of description and to better understand the data processing methods in this application, the terminal device method and the drone method will be described in detail together below.

[0044] It should be noted that although the terminal device method and the drone method are described together, they are independent of each other. The terminal device method provides technical support for the rapid and convenient sharing of identification codes and for the rapid and convenient acquisition of target state data, including flight state data and shooting state data, based on the identification codes, thereby providing technical support for subsequent reshoots. The drone method provides technical support for the terminal device to generate identification codes based on the target state data.

[0045] See Figures 1 to 3 , Figure 1 This is a flowchart illustrating an embodiment of the data processing method of this application. Figure 2 This is a flowchart illustrating another embodiment of the data processing method of this application. Figure 3 This is a flowchart illustrating another embodiment of the data processing method of this application. It should be noted that... Figure 1 The method is the terminal device method. Figure 2 The method is a drone-based approach, where the drone is equipped with a camera. Figure 3 The method combines terminal device-side methods and drone-side methods.

[0046] The terminal device method includes steps S101, S102, S103, and S104; the drone method includes steps S201 and S202.

[0047] Terminal device method:

[0048] Step S101: Display the images captured by the drone's camera on the terminal device's display interface.

[0049] Step S102: Obtain the user's operation on the display interface, and determine the target image from the image captured by the drone based on the operation.

[0050] Drone-side methods:

[0051] Step S201: Receive a request instruction sent by the terminal device. The request instruction is used to instruct the UAV to send target status data when the UAV's shooting device is shooting a target image. The target status data includes flight status data and shooting status data.

[0052] Step S202: Send the target status data to the terminal device, so that the terminal device generates an identification code based on the target status data, and the target status data can be obtained based on the identification code.

[0053] Terminal device method:

[0054] Step S103: Obtain target state data when the shooting device captures the target image, the target state data including flight state data and shooting state data.

[0055] Step S104: Generate an identification code based on the target state data and display the identification code on the display interface, wherein the target state data can be obtained based on the identification code.

[0056] In this embodiment, a terminal device can refer to a device capable of sending commands to a drone that the drone can respond to. A terminal device can be a single device with a display screen, or a combination of two or more devices (one of which is a device with a display screen for displaying images captured by the drone's camera). Terminal devices include, but are not limited to: remote controls with displays, combinations of remote controls and mobile phones, combinations of remote controls and tablet computers (e.g., iPads), combinations of mobile phones and tablet computers (e.g., iPads), and so on.

[0057] Images captured by the drone's camera are transmitted to a terminal device via image transmission and displayed on the terminal device's screen. Users can interact with these images on the screen (e.g., click, select, box selection, favorite, etc.) to indicate their interest. The terminal device determines the target image from the drone's images based on these interactions; for example, it determines the image clicked by the user, the image favorited by the user, the image selected by the user, and so on. This interactive method allows the determination of the target image of interest to the user. Specifically, step S102, acquiring the user's actions on the screen and determining the target image from the drone's images based on those actions, may further include: acquiring the user's actions of clicking, selecting, or favorited images on the screen, and determining the clicked, selected, or favorited image as the target image from the drone's images based on those actions.

[0058] When the terminal device determines the target image, it is also sending a request command to the drone, requesting the drone to send the target status data when the drone's camera was taking the target image. The target status data includes flight status data and shooting status data.

[0059] Flight status data refers to the flight status data of a drone related to its camera when capturing an image of a target. Specifically, when flight status data is used for subsequent reshooting, it refers to the drone's flight status data related to the reshooting process. The drone's flight status data related to reshooting typically includes drone waypoint information or drone flight path information, and may also include drone altitude information. If the target image is a photograph, the flight status data may include the drone's waypoint information when the photograph was taken; if the target image is a video image, the flight status data may include the drone's flight path information when the video image was taken.

[0060] Shooting status data can refer to the shooting status data related to the target image when the drone's shooting device is shooting the target image. The shooting status data includes at least one of the following: image information acquired by the sensing camera, gimbal angle information, and shooting parameter information of the shooting device.

[0061] Perception cameras can intelligently analyze video footage to identify content within the monitored area, providing semantic descriptions and optimal image capture. For example, they can sense people, vehicles, and objects in the scene, analyze their type, color, size, direction, speed, and other information, and then provide textual descriptions and optimal image captures. Therefore, the image information acquired by perception cameras can provide more accurate location information, correcting the position of drones, and enabling high-precision re-enhancing of images.

[0062] The shooting parameters of the shooting device include one or more of the following: aperture, exposure time, ISO, white balance, resolution, and image aspect ratio.

[0063] After receiving the request command, the drone sends target status data to the terminal device. The terminal device obtains the target status data sent by the drone when the imaging device captured the target image, generates an identification code based on the target status data, and displays the identification code on the display interface. The target status data can be obtained based on the identification code. Thus, the user can see the identification code on the display interface, and subsequently perform simple and convenient operations on the identification code, enabling interactive interaction with the terminal device or other terminal devices. Furthermore, the user does not need to view the image's exchangeable image file (EXIF) information to understand the image's capture information, nor can they use third-party software to copy coordinates to control the drone to the waypoint; they can quickly retake the image using the identification code.

[0064] For example, when interacting with a terminal device, if the target status data has been deleted locally, the operation identifier code can be used to retrieve the target status data and retake the photo locally. Alternatively, when interacting with other terminal devices, the operation identifier code can be shared with other terminal devices, allowing them to retrieve the target status data and retake the photo. Application scenarios involving interaction with other terminal devices include: if a user changes their terminal device or drone, the target status data can be retrieved on another terminal device using the identifier code, allowing for retaking the photo; or a user can share the identifier code with other users' terminal devices, allowing those devices to retrieve the target status data and retake the photo; and so on.

[0065] There are many ways to obtain the target state data based on the identification code. For example, the target state data can be recorded on an image, and an identification code can be generated from the image containing the target state data. Using the identification code, the image containing the target state data can be obtained, and the target state data recorded in the image can be read directly. Another example is to store the target state data on a server, generate an identification code based on the storage address of the target state data on the server, and then obtain the target state data from that storage address on the server using the identification code.

[0066] The method on the terminal device side of this application embodiment includes: displaying images captured by a drone's camera on the display interface of the terminal device; acquiring user operations on the display interface, and determining a target image from the images captured by the drone based on the operations; acquiring target state data when the camera captured the target image, the target state data including flight state data and shooting state data; generating an identification code based on the target state data, and displaying the identification code on the display interface, wherein the target state data can be obtained based on the identification code. Since the target image is determined from the images captured by the drone based on user operations on the display interface showing images captured by the drone's camera, it is very convenient to capture target images that the user may be interested in; since the identification code is generated based on the acquired target state data when the camera captured the target image and displayed on the display interface, the target state data can be obtained based on the identification code, thus providing technical support for quickly and conveniently sharing the identification code, providing technical support for quickly and conveniently obtaining target state data of the target image, including flight state data and shooting state data, based on the identification code, and thus providing technical support for subsequent reshoots. The method on the drone side includes: receiving a request instruction sent by a terminal device, the request instruction instructing the drone to send target status data when its imaging device captures an image of the target; sending the target status data to the terminal device, enabling the terminal device to generate an identification code based on the target status data, and the target status data can be obtained based on the identification code. This provides technical support for the terminal device to generate an identification code based on the target status data.

[0067] The following section details the identification code.

[0068] In one embodiment, the identification code is a commonly used text identification code or image identification code. This provides a completely new way for users to communicate, using identification codes or image identification codes—methods that can be disseminated on almost all social media platforms—to facilitate communication between users.

[0069] For example, text-based identification codes can be implemented by generating a meaningless code from the storage address of the target state data, and adding prefixes and suffixes before and after the code for easy identification. Similarly, image identification codes can be implemented by generating a meaningless code from the storage address of the target state data, converting the code into a QR code, and then retrieving locally compressed photo or video materials. If it's a video, it can be compressed into a GIF animation; if it's a photo, it can be combined into a single image. Through this image, users can quickly learn about the location, author, and preview effect of the image identification code, etc. Figure 4 As shown.

[0070] In one embodiment, the identification code is an encrypted identification code, which ensures the security of the target state data. For example, in the implementation of text identification codes or image identification codes, the storage address of the target state data can be encrypted first, and then a meaningless code can be generated.

[0071] In one embodiment, the identification code carries an expiration period. Within the expiration period, the target status data can be obtained based on the identification code; after the expiration period, the target status data cannot be obtained based on the identification code. This ensures that the identification code is valid within its validity period and invalid after it expires, preventing the target status data from being subject to the risk of being easily obtained at any time without time control, thereby guaranteeing the security of the target status data.

[0072] In one embodiment, the identification code carries a target sharing object. When the identification code is shared with the target sharing object, the target status data can be obtained based on the identification code. When shared with non-target sharing objects other than the target sharing object, the target status data cannot be obtained based on the identification code. Thus, the identification code can be shared with the target sharing object according to the user's wishes, ensuring that only the target sharing object can obtain the target status data, while non-target sharing objects cannot. This prevents the identification code from being shared indefinitely with other terminal devices and prevents any other terminal device from obtaining the target status data, thereby ensuring the security of the target status data.

[0073] In one embodiment, the terminal device can share the identification code, that is, the method further includes: sharing the identification code with other terminal devices according to the user's first operation on the identification code on the display interface, so that the other terminal devices can obtain the target status data based on the identification code.

[0074] There are many ways to implement the first operation. For example, clicking and long-pressing the identification code will display the word "Share," allowing you to select "Share"; or clicking the identification code will display a "Share" button on the screen, which you can then click; and so on. This allows for convenient and quick sharing of the identification code with other terminal devices, which can easily obtain the target status data based on the identification code.

[0075] For example, a good photograph is highly dependent on the photographer; the photographer's skills, aesthetic communication, and parameter adjustments all affect the quality of a product. Newcomers to this field have much to learn. With the consent of master photographers, their photos and videos can be shared externally for newcomers to reshoot and learn from. Experienced photographers mentoring newcomers, facilitating rapid reshoots, makes creating master-level work much easier.

[0076] In one embodiment, the terminal device can locally acquire target status data for re-photographing, that is, the method further includes: steps S105 and S106, as follows: Figure 5 As shown.

[0077] Step S105: Based on the user's second operation on the identification code on the display interface, obtain the target status data based on the identification code. There are many ways to implement the second operation, such as clicking and long-pressing the identification code to display the words "Recognize Identification Code" and selecting "Recognize Identification Code"; or simply clicking the identification code; etc.

[0078] Step S106: Based on the target status data, control the drone to perform a repeat shot.

[0079] When the target status data is not saved locally on the terminal device or has been deleted, and the user wants to reshoot, the target status data can be retrieved locally using the identifier code. This function can be used for example, when shooting frequently fixed locations such as buildings or rivers, or when the user feels that previous shots have flaws and wants to reshoot. Before reshooting, the user can also edit the acquired target status data, such as editing drone waypoints or flight paths, adjusting its flight speed, shooting mode, and shooting parameters of the shooting device.

[0080] In this way, users who want to repeatedly shoot the same location can do so quickly and efficiently; on the other hand, it can also serve as a tool to help multiple users collaborate with each other.

[0081] In one embodiment, the terminal device can obtain the target status data corresponding to the identification code based on the identification code shared by other terminal devices for re-photographing. That is, the method further includes steps S107 and S108, as follows: Figure 6 As shown.

[0082] Step S107: Obtain the target status data corresponding to the identification code based on the identification code shared by other terminal devices.

[0083] Step S108: Based on the target status data, control the drone to perform a repeat shot.

[0084] The implementation of sharing the identification code with other terminal devices can be achieved by other terminal devices actively sharing the identification code, or by the local terminal device actively scanning the identification code of other terminal devices.

[0085] After obtaining the target status data corresponding to the identification code based on the identification code shared by other terminal devices, the user can also edit the obtained target status data before taking a second shot. For example, the user can edit the drone waypoints or flight paths, and adjust its flight speed, shooting mode, shooting parameters of the shooting device, etc.

[0086] In one embodiment, the terminal device can determine whether the drone meets the conditions for reshooting from the perspective of safe drone flight before reshooting. That is, in step S106 or step S108, before controlling the drone to reshoot based on the target state data, it may further include: determining whether the drone meets the conditions for reshooting based on the flight state data in the target state data.

[0087] At this point, in step S106 or step S108, controlling the drone to perform a reshoot based on the target state data may further include: if the drone meets the reshoot conditions, then controlling the drone to perform a reshoot based on the target state data.

[0088] In this embodiment, the reshoot conditions can refer to the safety conditions related to the drone during the reshoot. For example, whether the drone has reached the location indicated in the flight status data, whether the drone's flight altitude is appropriate, whether the location indicated in the flight status data is within a prohibited flight zone, and so on. This ensures that the reshoot location is as close as possible to the user's desired location, while also guaranteeing the safety of the drone's flight and helping to reduce the risk of the drone crashing during flight missions.

[0089] In one embodiment, determining whether the drone meets the conditions for reshooting may include: if the distance between the current position of the drone and the starting position indicated by the flight status data is less than or equal to a preset distance threshold, then the drone is determined to meet the conditions for reshooting.

[0090] In this embodiment, the starting position can refer to a location that ensures the safe flight of the drone. Ideally, the drone's current position coincides with the starting position indicated by the flight status data. Generally, it is difficult for the drone's current position and the starting position indicated by the flight status data to coincide. Therefore, if the distance between the drone's current position and the starting position indicated by the flight status data is less than or equal to a preset distance threshold, the drone is determined to meet the conditions for repeat shooting. The preset distance threshold is set according to the actual situation; for example, it can typically be set to 200m or 500m.

[0091] In one embodiment, determining whether the drone meets the conditions for re-shooting may include: if the waypoint locations indicated by the flight status data are all outside the prohibited flight areas, then the drone is determined to meet the conditions for re-shooting. Drone flights must comply with relevant laws and regulations; the location for re-shooting cannot fall within prohibited flight areas, otherwise it will violate laws and regulations and may also cause safety issues.

[0092] In one embodiment, the determination of whether to perform a high-precision or low-precision retake is based on whether the target state data includes image information acquired by the sensing camera. Specifically, in step S106 or S108, controlling the drone to perform a retake based on the target state data may further include: if the target state data includes image information acquired by the sensing camera, then controlling the drone to perform a high-precision retake based on the image information acquired by the sensing camera; or, if the target state data does not include image information acquired by the sensing camera, then controlling the drone to perform a low-precision retake.

[0093] Because the sensing camera can intelligently analyze video to identify content in the monitored area, perform semantic descriptions, and capture optimal images, the image information acquired by the sensing camera can provide more accurate location information, correcting the drone's position and enabling high-precision re-enhancing based on the image information obtained by the sensing camera. If the target state data does not include the image information acquired by the sensing camera, the drone will be controlled to perform low-precision re-enhancing.

[0094] In one embodiment, step S103 on the terminal device, acquiring target state data when the shooting device captures the target image, may include: downloading the target state data when the shooting device captures the target image from the drone based on the target image, wherein a first correspondence is established between the target image and the target state data. The establishment of the first correspondence between the target image and the target state data allows for convenient downloading of the target state data when the shooting device captures the target image from the drone based on the target image.

[0095] In one embodiment, the terminal device uploads target status data to the server and generates an identification code based on the storage address of the target status data, i.e., step S104. The generation of the identification code based on the target status data may further include sub-steps S1041, S1042, and S1043, such as... Figure 7 As shown.

[0096] Sub-step S1041: Upload the target state data to the server, so that the server saves the target state data, and establish a second correspondence between the storage address of the target image and the target state data.

[0097] Sub-step S1042: Obtain the storage address of the target state data from the server based on the target image.

[0098] Sub-step S1043: Generate an identifier code based on the storage address of the target state data.

[0099] Uploading the target status data to the server allows the server to store the target status data. This avoids storing the target status data locally and occupying the terminal device's storage space. Furthermore, using the server to store the target status data makes it easier for the terminal device to communicate the storage address of the target status data via the identification code.

[0100] A second correspondence is established between the storage address of the target image and the storage address of the target state data. Specifically, this correspondence can be established between the identifier of the target image and the identifier of the storage address of the target state data; or the target image and target state data can be stored in the same storage address; and so on. This allows for convenient retrieval of the storage address of the target state data from the server based on the target image.

[0101] An identifier is generated based on the storage address of the target state data. The storage address of the target state data can be obtained by recognizing the identifier, and then the target state data can be obtained through the server, thereby improving the efficiency and convenience of interaction.

[0102] The following describes other details regarding the drone side.

[0103] In one embodiment, the method on the drone side further includes storing the image's state data locally on a secure digital card or in memory. This protects user privacy and ensures data security.

[0104] In one embodiment, the method on the drone side further includes: outputting a prompt message according to the received instruction to format the security digital card, to prompt the user that the security digital card stores image status data, and asking whether to confirm deletion. This method can prevent users from accidentally deleting data.

[0105] See Figure 8 , Figure 8 This is a schematic diagram of the structure of a terminal device according to an embodiment of the present application. It should be noted that the terminal device of this embodiment can execute the steps in the data processing method of the terminal device described above. For a detailed description of the relevant content, please refer to the relevant content of the data processing method of the terminal device described above, which will not be repeated here.

[0106] The terminal device 100 includes: a memory 1 and a processor 2; the processor 2 and the memory 1 are connected via a bus.

[0107] The processor 2 can be a microcontroller unit, a central processing unit, or a digital signal processor, etc.

[0108] Among them, memory 1 can be a Flash chip, read-only memory, disk, optical disk, USB flash drive, or portable hard drive, etc.

[0109] The memory 1 is used to store computer programs; the processor 2 is used to execute the computer programs and, when executing the computer programs, performs the following steps:

[0110] The system displays images captured by the drone's camera on the terminal device's display interface; it acquires user operations on the display interface and determines a target image from the images captured by the drone based on the operations; it acquires target status data when the camera captures the target image, the target status data including flight status data and shooting status data; it generates an identification code based on the target status data and displays the identification code on the display interface, wherein the target status data can be obtained based on the identification code.

[0111] The flight status data includes UAV waypoint information or UAV flight route information.

[0112] The flight status data also includes the drone's altitude information.

[0113] The shooting status data includes at least one of the following: image information acquired by the sensing camera, gimbal angle information, and shooting parameter information of the shooting device.

[0114] The shooting parameters of the shooting device include one or more of the following: aperture, exposure time, ISO, white balance, resolution, and image aspect ratio.

[0115] The identification code can be a text identification code or an image identification code.

[0116] The identification code is an encrypted identification code.

[0117] The identification code carries a validity period. Within the validity period, the target status data can be obtained based on the identification code. When the validity period expires, the target status data cannot be obtained based on the identification code.

[0118] The identifier carries the target sharing object. When the identifier is shared with the target sharing object, the target status data can be obtained based on the identifier. When shared with a non-target sharing object other than the target sharing object, the target status data cannot be obtained based on the identifier.

[0119] When the processor executes the computer program, it performs the following steps: based on the user's first operation on the identification code on the display interface, it shares the identification code with other terminal devices so that the other terminal devices can obtain the target status data based on the identification code.

[0120] When the processor executes the computer program, it performs the following steps: based on the second operation of the user on the identification code on the display interface, it obtains the target status data based on the identification code; based on the target status data, it controls the drone to perform a repeat shot.

[0121] When the processor executes the computer program, it performs the following steps: obtaining target status data corresponding to the identification code based on the identification code shared by other terminal devices; and controlling the drone to perform re-shooting based on the target status data.

[0122] When the processor executes the computer program, it performs the following steps: determining whether the drone meets the conditions for reshooting based on the flight status data in the target status data; if the drone meets the conditions for reshooting, controlling the drone to perform reshooting based on the target status data.

[0123] When the processor executes the computer program, it performs the following steps: if the distance between the current position of the drone and the starting position indicated by the flight status data is less than or equal to a preset distance threshold, then the drone is determined to meet the conditions for reshooting.

[0124] When the processor executes the computer program, it performs the following steps: if the waypoints indicated by the flight status data are all outside the prohibited flight area, then it is determined that the UAV meets the conditions for reshooting.

[0125] When executing the computer program, the processor performs the following steps: if the target state data includes image information acquired by the sensing camera, then the drone is controlled to perform high-precision reshooting based on the image information acquired by the sensing camera; or, if the target state data does not include the image information acquired by the sensing camera, then the drone is controlled to perform low-precision reshooting.

[0126] When the processor executes the computer program, it performs the following steps: downloads target state data from the drone when the shooting device captures the target image, based on the target image, and establishes a first correspondence between the target image and the target state data.

[0127] When the processor executes the computer program, it performs the following steps: uploading the target state data to the server, so that the server saves the target state data, and establishing a second correspondence between the target image and the storage address of the target state data; obtaining the storage address of the target state data from the server based on the target image; and generating an identification code based on the storage address of the target state data.

[0128] When the processor executes the computer program, it performs the following steps: acquiring the user's operation of clicking an image, selecting an image, or saving an image on the display interface, and determining the clicked image, selected image, or saved image as the target image from the images captured by the drone based on the operation.

[0129] See Figure 9 , Figure 9 This is a schematic diagram of a drone embodiment of the present application. It should be noted that the drone in this embodiment can execute the steps in the above-described drone-side data processing method. For a detailed description of the relevant content, please refer to the relevant content of the above-described drone-side data processing method, which will not be repeated here.

[0130] The drone 200 is equipped with a shooting device 33. The drone 200 also includes a communication module 44, a memory 11, and a processor 22. The processor 22 is connected to the memory 11, the shooting device 33, and the communication module 44 via a bus.

[0131] The memory 11 is used to store computer programs; the processor 22 is used to execute the computer programs and, when executing the computer programs, performs the following steps:

[0132] The control communication module receives a request instruction sent by the terminal device. The request instruction is used to instruct the UAV to send target status data when the UAV's imaging device captures a target image. The target status data includes flight status data and imaging status data. The control communication module sends the target status data to the terminal device, so that the terminal device generates an identification code based on the target status data. The target status data can be obtained based on the identification code.

[0133] When the processor executes the computer program, it performs the following steps: saving the image status data in a local secure digital card or memory.

[0134] When the processor executes the computer program, it performs the following steps: based on the received instruction to format the security digital card, it outputs a prompt message to the user, prompting the user that the security digital card stores image status data and asking whether to delete it.

[0135] The flight status data includes UAV waypoint information or UAV flight route information.

[0136] The flight status data also includes the drone's altitude information.

[0137] The shooting status data includes at least one of the following: image information acquired by the sensing camera, gimbal angle information, and shooting parameter information of the shooting device.

[0138] The shooting parameters of the shooting device include one or more of the following: aperture, exposure time, ISO, white balance, resolution, and image aspect ratio.

[0139] See Figure 10 , Figure 10 This is a schematic diagram of an embodiment of the unmanned aerial vehicle (UAV) system of this application. The UAV system includes the terminal device 100 as described in any of the preceding claims and the UAV 200 as described in any of the preceding claims. For detailed descriptions of the relevant content, please refer to the above-mentioned relevant content section, which will not be repeated here.

[0140] This application also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, causes the processor to implement any of the aforementioned data processing methods for terminal devices. For detailed descriptions of related content, please refer to the aforementioned related content section, and will not be repeated here.

[0141] The computer-readable storage medium can be an internal storage unit of the aforementioned terminal device, such as a hard disk or memory. Alternatively, it can be an external storage device, such as an external hard disk, smart memory card, secure digital card, flash memory card, etc.

[0142] This application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, causes the processor to implement any of the above-described UAV-side data processing methods. For detailed descriptions of related content, please refer to the aforementioned related content section, which will not be repeated here.

[0143] The computer-readable storage medium can be an internal storage unit of the aforementioned UAV, such as a hard drive or memory. Alternatively, it can be an external storage device, such as an external hard drive, smart memory card, secure digital card, flash memory card, etc.

[0144] It should be understood that the terminology used in this application specification is for the purpose of describing particular embodiments only and is not intended to limit the application.

[0145] It should also be understood that the term “and / or” as used in this application specification and the appended claims means any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.

[0146] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and such modifications or substitutions should all be covered within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A data processing method, characterized in that, The method includes: The images captured by the drone's camera are displayed on the terminal device's screen. The system acquires user actions on the display interface and determines the target image from images captured by the drone based on those actions. Acquire target state data when the shooting device captures the target image, the target state data including flight state data and shooting state data; An identification code is generated based on the target state data, and the identification code is displayed on the display interface, wherein the target state data can be obtained based on the identification code; The method further includes: Based on the user's second operation on the identification code on the display interface, the target status data is obtained based on the identification code; Based on the target status data, control the drone to perform a repeat shot.

2. The method according to claim 1, characterized in that, The flight status data includes UAV waypoint information or UAV flight path information.

3. The method according to claim 2, characterized in that, The flight status data also includes the drone's altitude information.

4. The method according to claim 1, characterized in that, The shooting status data includes at least one of the following: image information acquired by the sensing camera, gimbal angle information, and shooting parameter information of the shooting device.

5. The method according to claim 4, characterized in that, The shooting parameters of the shooting device include one or more of the following: aperture, exposure time, ISO, white balance, resolution, and image aspect ratio.

6. The method according to claim 1, characterized in that, The identification code can be a text identification code or an image identification code.

7. The method according to claim 1, characterized in that, The identification code is an encrypted identification code.

8. The method according to claim 1, characterized in that, The identification code carries a validity period. Within the validity period, the target status data can be obtained based on the identification code. When the validity period expires, the target status data cannot be obtained based on the identification code.

9. The method according to claim 1, characterized in that, The identifier carries the target sharing object. When the identifier is shared with the target sharing object, the target status data can be obtained based on the identifier. When shared with a non-target sharing object other than the target sharing object, the target status data cannot be obtained based on the identifier.

10. The method according to claim 1, characterized in that, The method further includes: Based on the user's first operation on the identification code on the display interface, the identification code is shared with other terminal devices so that the other terminal devices can obtain the target status data based on the identification code.

11. The method according to claim 1, characterized in that, The method further includes: The target status data corresponding to the identification code is obtained based on the identification code shared by other terminal devices; Based on the target status data, control the drone to perform a repeat shot.

12. The method according to claim 1 or 11, characterized in that, Before controlling the drone to perform a repeat shot based on the target state data, the following steps are included: Based on the flight status data in the target status data, determine whether the drone meets the conditions for reshooting; The step of controlling the drone to perform a reshoot based on the target state data includes: If the drone meets the conditions for reshooting, then the drone is controlled to reshoot based on the target status data.

13. The method according to claim 12, characterized in that, Determining whether the drone meets the conditions for reshooting includes: If the distance between the current position of the drone and the starting position indicated by the flight status data is less than or equal to a preset distance threshold, then the drone is determined to meet the conditions for reshooting.

14. The method according to claim 12, characterized in that, Determining whether the drone meets the conditions for reshooting includes: If the waypoints indicated by the flight status data are all outside the prohibited flight areas, then the drone is determined to meet the conditions for reshooting.

15. The method according to claim 1 or 11, characterized in that, The step of controlling the drone to perform a reshoot based on the target state data includes: If the target state data includes image information acquired by the sensing camera, then the drone is controlled to perform high-precision reshooting based on the image information acquired by the sensing camera. or, If the target state data does not include the image information acquired by the sensing camera, then the drone is controlled to perform a low-precision reshoot.

16. The method according to claim 1, characterized in that, The step of acquiring target state data when the shooting device captures the target image includes: Based on the target image, target state data when the shooting device captured the target image is downloaded from the drone, and a first correspondence is established between the target image and the target state data.

17. The method according to claim 16, characterized in that, The step of generating an identifier code based on the target state data includes: The target state data is uploaded to the server, and the server saves the target state data. A second correspondence is established between the storage address of the target image and the target state data. The storage address of the target state data is obtained from the server based on the target image; An identifier code is generated based on the storage address of the target state data.

18. The method according to claim 1, characterized in that, The step of acquiring the user's operation on the display interface and determining the target image from the image captured by the drone based on the operation includes: The system acquires user actions such as clicking on an image, selecting an image, or saving an image on the display interface, and determines the clicked, selected, or saved image as the target image from the images captured by the drone based on the actions.

19. A data processing method, characterized in that, Applied to drones, the method includes: The device receives a request instruction sent by a terminal device. The request instruction is used to instruct the UAV to send target status data when the UAV's shooting device is shooting a target image. The target status data includes flight status data and shooting status data. The target status data is sent to the terminal device, which generates an identification code based on the target status data. The target status data can be obtained based on the identification code. The target status data is used by the terminal device to obtain the identification code based on the user's second operation on the identification code in the display interface, and to control the drone to perform repeat shooting based on the target status data.

20. The method according to claim 19, characterized in that, The method further includes: The image status data is stored locally on a secure digital card or in memory.

21. The method according to claim 20, characterized in that, The method further includes: Based on the received instruction to format the security digital card, a prompt message is output to remind the user that the security digital card stores image status data, and to confirm whether to delete it.

22. The method according to claim 19, characterized in that, The flight status data includes UAV waypoint information or UAV flight path information.

23. The method according to claim 22, characterized in that, The flight status data also includes the drone's altitude information.

24. The method according to claim 19, characterized in that, The shooting status data includes at least one of the following: image information acquired by the sensing camera, gimbal angle information, and shooting parameter information of the shooting device.

25. The method according to claim 24, characterized in that, The shooting parameters of the shooting device include one or more of the following: aperture, exposure time, ISO, white balance, resolution, and image aspect ratio.

26. A terminal device, characterized in that, The terminal device includes: a memory and a processor; the memory is used to store computer programs. The processor is configured to execute the computer program and, when executing the computer program, perform the following steps: The images captured by the drone's camera are displayed on the terminal device's screen. The system acquires user actions on the display interface and determines the target image from images captured by the drone based on those actions. Acquire target state data when the shooting device captures the target image, the target state data including flight state data and shooting state data; An identification code is generated based on the target state data, and the identification code is displayed on the display interface, wherein the target state data can be obtained based on the identification code; Based on the user's second operation on the identification code on the display interface, the target status data is obtained based on the identification code; Based on the target status data, control the drone to perform a repeat shot.

27. The terminal device according to claim 26, characterized in that, The flight status data includes UAV waypoint information or UAV flight path information.

28. The terminal device according to claim 27, characterized in that, The flight status data also includes the drone's altitude information.

29. The terminal device according to claim 26, characterized in that, The shooting status data includes at least one of the following: image information acquired by the sensing camera, gimbal angle information, and shooting parameter information of the shooting device.

30. The terminal device according to claim 29, characterized in that, The shooting parameters of the shooting device include one or more of the following: aperture, exposure time, ISO, white balance, resolution, and image aspect ratio.

31. The terminal device according to claim 26, characterized in that, The identification code can be a text identification code or an image identification code.

32. The terminal device according to claim 26, characterized in that, The identification code is an encrypted identification code.

33. The terminal device according to claim 26, characterized in that, The identification code carries a validity period. Within the validity period, the target status data can be obtained based on the identification code. When the validity period expires, the target status data cannot be obtained based on the identification code.

34. The terminal device according to claim 26, characterized in that, The identifier carries the target sharing object. When the identifier is shared with the target sharing object, the target status data can be obtained based on the identifier. When shared with a non-target sharing object other than the target sharing object, the target status data cannot be obtained based on the identifier.

35. The terminal device according to claim 26, characterized in that, When the processor executes the computer program, it performs the following steps: Based on the user's first operation on the identification code on the display interface, the identification code is shared with other terminal devices so that the other terminal devices can obtain the target status data based on the identification code.

36. The terminal device according to claim 26, characterized in that, When the processor executes the computer program, it performs the following steps: The target status data corresponding to the identification code is obtained based on the identification code shared by other terminal devices; Based on the target status data, control the drone to perform a repeat shot.

37. The terminal device according to claim 26 or 36, characterized in that, When the processor executes the computer program, it performs the following steps: Based on the flight status data in the target status data, determine whether the drone meets the conditions for reshooting; If the drone meets the conditions for reshooting, then the drone is controlled to reshoot based on the target status data.

38. The terminal device according to claim 37, characterized in that, When the processor executes the computer program, it performs the following steps: If the distance between the current position of the drone and the starting position indicated by the flight status data is less than or equal to a preset distance threshold, then the drone is determined to meet the conditions for reshooting.

39. The terminal device according to claim 37, characterized in that, When the processor executes the computer program, it performs the following steps: If the waypoints indicated by the flight status data are all outside the prohibited flight areas, then the drone is determined to meet the conditions for reshooting.

40. The terminal device according to claim 26 or 36, characterized in that, When the processor executes the computer program, it performs the following steps: If the target state data includes image information acquired by the sensing camera, then the drone is controlled to perform high-precision reshooting based on the image information acquired by the sensing camera. or, If the target state data does not include the image information acquired by the sensing camera, then the drone is controlled to perform a low-precision reshoot.

41. The terminal device according to claim 26, characterized in that, When the processor executes the computer program, it performs the following steps: Based on the target image, target state data when the shooting device captured the target image is downloaded from the drone, and a first correspondence is established between the target image and the target state data.

42. The terminal device according to claim 41, characterized in that, When the processor executes the computer program, it performs the following steps: The target state data is uploaded to the server, and the server saves the target state data. A second correspondence is established between the storage address of the target image and the target state data. The storage address of the target state data is obtained from the server based on the target image; An identifier code is generated based on the storage address of the target state data.

43. The terminal device according to claim 26, characterized in that, When the processor executes the computer program, it performs the following steps: The system acquires user actions such as clicking on an image, selecting an image, or saving an image on the display interface, and determines the clicked, selected, or saved image as the target image from the images captured by the drone based on the actions.

44. A drone, wherein the drone is equipped with a camera, characterized in that, The drone includes: a communication module, a memory, and a processor; The memory is used to store computer programs; The processor is configured to execute the computer program and, when executing the computer program, perform the following steps: The control communication module receives a request instruction sent by the terminal device. The request instruction is used to instruct the UAV to send target status data when the UAV's shooting device is shooting a target image. The target status data includes flight status data and shooting status data. The control communication module sends the target status data to the terminal device, enabling the terminal device to generate an identification code based on the target status data. The target status data can be obtained based on the identification code. The target status data is used by the terminal device to obtain the data based on the user's second operation on the identification code displayed on the interface, and to control the drone to perform repeat shooting based on the target status data.

45. The UAV according to claim 44, characterized in that, When the processor executes the computer program, it performs the following steps: The image status data is stored locally on a secure digital card or in memory.

46. ​​The UAV according to claim 45, characterized in that, When the processor executes the computer program, it performs the following steps: Based on the received instruction to format the security digital card, a prompt message is output to remind the user that the security digital card stores image status data, and to confirm whether to delete it.

47. The UAV according to claim 44, characterized in that, The flight status data includes UAV waypoint information or UAV flight path information.

48. The UAV according to claim 47, characterized in that, The flight status data also includes the drone's altitude information.

49. The UAV according to claim 44, characterized in that, The shooting status data includes at least one of the following: image information acquired by the sensing camera, gimbal angle information, and shooting parameter information of the shooting device.

50. The UAV according to claim 49, characterized in that, The shooting parameters of the shooting device include one or more of the following: aperture, exposure time, ISO, white balance, resolution, and image aspect ratio.

51. An unmanned aerial vehicle (UAV) system, characterized in that, The unmanned aerial vehicle system includes the terminal device as described in any one of claims 26-43 and the unmanned aerial vehicle as described in any one of claims 44-50.

52. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, causes the processor to implement the data processing method as described in any one of claims 1-18.

53. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, causes the processor to implement the data processing method as described in any one of claims 19-25.

Images