Unmanned aerial vehicle cooperative data processing transmission method, device and equipment and storage medium

Abstract

The invention relates to the technical field of vehicles, and discloses an unmanned aerial vehicle cooperative data processing and transmission method, device and equipment and a storage medium, and the method comprises the steps: transmitting original image data collected by an unmanned aerial vehicle to a target user side through a target channel under the condition that the distance between the target user side and the unmanned aerial vehicle is smaller than or equal to a preset distance, receiving first image data returned by the target user side; issuing the first image data to other user sides through a target channel in response to requests of the other user sides for acquiring the first image data, so that the other user sides edit the first image data to obtain second image data uploaded to the unmanned aerial vehicle; and issuing the second image data to the target user side through the target channel, so that the target user determines the target image data uploaded to the cloud side. According to the embodiment of the invention, the unmanned aerial vehicle serves as an air communication relay station, and the effectiveness and convenience of communication are improved.

Description

Technical Field

[0001] The present application relates to the field of vehicle technology, and in particular to a method, device, equipment and storage medium for data processing and transmission in collaboration with unmanned aerial vehicles. Background Art

[0002] With the popularization of cars, more and more users have become private car owners, and the scene of multiple cars forming a convoy to travel has become more and more common. Due to the high speed of vehicles and complex road conditions, in order to ensure driving safety and driving efficiency, there is a need for vehicles in the same convoy to communicate road conditions.

[0003] Under related technologies, users usually use mobile phone voice or video to communicate about road conditions with other users in the same fleet. However, when using this method, users can only understand and synchronize road conditions within a few meters of their current vehicle's location. If long-distance data interaction between vehicles is performed through the cloud, there will be problems such as untimely data interaction or missing data transmission due to reasons such as lack of operator signals. Summary of the invention

[0004] In view of the above problems, the present application provides a drone collaborative data processing and transmission method, device, equipment and storage medium, which are used to solve the problem of untimely long-distance data interaction or missing data transmission due to the lack of operator signals in the prior art.

[0005] According to one aspect of the present application, a method for data processing and transmission of drone collaboration is provided, the method comprising: when the distance between a target user terminal and the drone is less than or equal to a preset distance, sending the original image data collected by the drone to the target user terminal through a target channel to receive first image data returned by the target user terminal; wherein the first image data is data obtained by the target user terminal by editing the original image data, and the target channel is a transmission channel for the drone and the corresponding user terminal to perform data interaction within the preset distance; when the distance between other user terminals and the drone is less than or equal to the preset distance, in response to a request from the other user terminals to obtain the first image data, sending the first image data to the other user terminals through the target channel, so that the other user terminals edit the first image data and obtain second image data uploaded to the drone; sending the second image data to the target user terminal through the target channel, so that the target user determines the target image data uploaded to the cloud; wherein the target image data includes at least one of the original image data, the first image data, and the second image data.

[0006] In an optional manner, in response to the request of the other user terminal to obtain the first image data, the first image data is sent to the other user terminal through the target channel, including: verifying the validity of the identity credential carried in the request of the other user terminal to obtain the first image data; wherein the identity credential is the credential information sent by the drone to the other user terminal after the other user terminal successfully establishes the target channel with the drone; if the validity verification passes, indicating that the other user terminal and the target user terminal belong to the same user cluster, the first image data is sent to the other user terminal through the target channel.

[0007] In an optional manner, the validity verification of the identity credential includes: matching the identity credential with multiple candidate credential information stored locally on the drone; if the match is successful, determining that the identity credential has passed a first validity verification; if the current time does not exceed the validity period of the identity credential, determining that the identity credential has passed a second validity verification; and when the identity credential has passed the first validity verification and the second validity verification, determining that the validity verification of the identity credential has passed.

[0008] In an optional manner, the method further includes: in response to a distribution instruction from a target user terminal, determining other online drones that match the device identification of the drone within a radius of the preset distance, and distributing the target image data carried in the distribution instruction to the other online drones.

[0009] In an optional manner, the method further includes: in response to an image acquisition signal from a target user terminal, acquiring an initial image of a target road section; wherein the target road section is a road section where the vehicle density in the driving direction of the target vehicle is greater than a preset density threshold and the average driving speed of each vehicle is less than a preset speed threshold; based on the geographic location information of the target road section and the initial image, the original image data is generated so that the target user terminal determines the distance between the target vehicle and the target road section according to the geographic location information.

[0010] In an optional manner, before responding to the image acquisition signal of the target user end, it also includes: determining the safety power required for the drone to return based on the distance between the drone and the target vehicle; if the sum of the minimum power consumption required for the drone to execute the image acquisition signal and the safety power is greater than the current remaining power of the drone, then the image acquisition signal of the target user end is not responded.

[0011] In an optional manner, the method further includes: when the local memory occupancy rate of the target user terminal is greater than a preset storage threshold, uploading the original image data to the cloud and sending a full load warning to the target user terminal so that the target user can clean up the local memory of the target user terminal; or, when the distance between the target user terminal and the drone is greater than the preset distance, saving the original image data in the local memory of the drone.

[0012] According to another aspect of the present application, a data processing and transmission device for drone collaboration is provided, the device comprising: a first transmission module, when the distance between a target user terminal and the drone is less than or equal to a preset distance, sending the original image data collected by the drone to the target user terminal through a target channel to receive the first image data returned by the target user terminal; wherein the first image data is data obtained by the target user terminal by editing the original image data, and the target channel is a transmission channel for the drone and the corresponding user terminal to perform data interaction within the preset distance; a second transmission module, when the distance between other user terminals and the drone is less than or equal to the preset distance, in response to a request from the other user terminals to obtain the first image data, sending the first image data to the other user terminals through the target channel, so that the other user terminals edit the first image data and obtain the second image data uploaded to the drone; a third transmission module, sending the second image data to the target user terminal through the target channel, so that the target user determines the target image data uploaded to the cloud; wherein the target image data includes at least one of the original image data, the first image data, and the second image data.

[0013] According to one aspect of the present application, an electronic device is provided, including: a controller; and a memory for storing one or more programs, wherein when the one or more programs are executed by the controller, the above method is executed.

[0014] According to one aspect of the present application, a storage medium is also provided, on which computer-readable instructions are stored. When the computer-readable instructions are executed by a processor of a computer, the computer executes the above method.

[0015] According to one aspect of the present application, a computer program product or computer program is also provided, the computer program product or computer program includes computer instructions, the computer instructions are stored in a storage medium. A processor of a computer device reads the computer instructions from the storage medium, and the processor executes the computer instructions, so that the computer device executes the above method.

[0016] The embodiment of the present application uses a drone as an aerial communication relay station to form an internal user cluster with the target user terminal and other user terminals, so that the target user terminal and other user terminals can perform stable data sharing and data processing in real time at a long distance. In addition, through the flexibility and long-distance mobility of the drone, real-time images and other information of the specified location can be quickly acquired, and then synchronized in the same user cluster, thereby improving the effectiveness and convenience of communication. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 It is a flowchart of a method for data processing and transmission of UAV collaboration shown in an exemplary embodiment of the present application.

[0018] Figure 2 It is a flowchart of verifying the identity of other user terminals shown in an exemplary embodiment of the present application.

[0019] Figure 3 It is a flowchart of verifying the validity of identity credentials shown in an exemplary embodiment of the present application.

[0020] Figure 4 It is a flowchart of a method for collecting raw image data shown in an exemplary embodiment of the present application.

[0021] Figure 5 It is a flowchart of a method for determining electric quantity according to an exemplary embodiment of the present application.

[0022] Figure 6 This is a schematic diagram of an application scenario of a drone collaborative data processing and transmission method of the present application.

[0023] Figure 7 It is a structural schematic diagram of a data processing and transmission device for drone collaboration shown in an exemplary embodiment of the present application.

[0024] Figure 8 This is a schematic diagram of the structure of a computer system of an electronic device shown in an exemplary embodiment of the present application. DETAILED DESCRIPTION

[0025] Here, exemplary embodiments will be described in detail, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are only examples of devices and methods consistent with some aspects of the present application as detailed in the attached claims.

[0026] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities may be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0027] The flowcharts shown in the accompanying drawings are only exemplary and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps can be decomposed, and some operations / steps can be combined or partially combined, so the actual execution order may change according to actual conditions.

[0028] The term "multiple" as used in this application refers to two or more than two. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the related objects are in an "or" relationship.

[0029] In related technologies, users usually communicate about road conditions with other users in the same fleet via mobile phone voice or video. However, when using this method, users can only understand and synchronize road conditions within a few meters of their current vehicle's location. If long-distance data interaction between vehicles is performed through the cloud, problems such as untimely data interaction or missing data transmission may occur due to reasons such as lack of operator signals.

[0030] To this end, one aspect of the present application provides a method for data processing and transmission in cooperation with drones. Figure 1 , Figure 1 1 is a flow chart of a method for data processing and transmission of UAV collaboration shown in an exemplary embodiment of the present application. The method at least includes S110 to S120, which are described in detail as follows:

[0031] S110: When the distance between the target user terminal and the drone is less than or equal to a preset distance, the original image data collected by the drone is sent to the target user terminal through a target channel to receive the first image data returned by the target user terminal.

[0032] Among them, the first image data is the data obtained by editing the original image data by the target user end, and the target channel is the transmission channel for the drone and the corresponding user end to exchange data within a preset distance.

[0033] In this application, the target user end can be the target vehicle's computer, which can realize information communication and interactive control functions between people and vehicles, and vehicles and the outside world, or it can be a specific application software that can realize the control and data processing functions of the drone.

[0034] The drone is a vehicle-mounted drone configured on the target vehicle, and communicates with the target user end through the target channel. In this application, the target channel is an exclusive communication channel established after the drone and the target user end authorize each other through a preset interface. When the distance between the target user end and the drone meets the conditions, the target channel is more stable than the communication channels built by operators such as Wi-Fi and cellular networks (4G / 5G), and will not cause problems such as untimely data interaction or missing data transmission due to reasons such as lack of operator signals.

[0035] In some optional embodiments, if the operator signal is good, wireless communication technologies such as Wi-Fi, cellular network (4G / 5G) and so on can be directly used to achieve the target channel, and this application does not impose any restrictions on this.

[0036] Exemplarily, assuming that the maximum communication distance supported by the target channel is 10 kilometers, when the distance between the target user terminal and the drone is less than or equal to 10 kilometers, that is, the target user terminal and the drone meet the communication conditions, the drone transmits the collected original image data to the target user terminal, and receives the first image data obtained after the target user terminal edits the original image data, thereby completing the data transmission process between the target user terminal and the drone.

[0037] S120: When the distance between the other user terminal and the drone is less than or equal to the preset distance, in response to the other user terminal's request to obtain the first image data, the first image data is sent to the other user terminal through the target channel, so that the other user terminal can edit the first image data and obtain the second image data uploaded to the drone.

[0038] In this application, other user terminals can be the vehicle computers of other vehicles, or mobile phones, computers, etc. located in the target vehicle or other vehicles, and there can be multiple other user terminals. The communication method used by other user terminals and the drone is the same as the communication method used by the target user terminal and the drone.

[0039] Exemplarily, when the distance between the other user terminal and the drone is less than or equal to 10 kilometers, the drone can receive a request from the other user terminal to obtain the first image data, and receive the second image data obtained after the other user terminal edits the first image data, thereby completing the data transmission process between the other user terminal and the drone.

[0040] S130: Send the second image data to the target user terminal through the target channel, so that the target user can determine the target image data uploaded to the cloud.

[0041] The target image data includes at least one of original image data, first image data, and second image data.

[0042] In this application, after receiving the second image data uploaded by other user terminals, the drone sends the second image data to the target user terminal, so that the target user determines the target image data to be uploaded to the cloud based on the original image data, the first image data and the second image data, that is, the target user determines the final version to be uploaded to the cloud for backup. Among them, the target user is the owner of the target vehicle and has the highest authority to process the data.

[0043] In the above process, if the target user terminal and other user terminals are the target vehicle and the vehicle computers of other vehicles respectively, the target user terminal and other user terminals together form a fleet, and conduct long-distance data communication through drones to realize the sharing of corresponding road condition information of the driving road.

[0044] In this embodiment, the drone acts as an aerial communication relay station, and the target user terminal and other user terminals are organized into an internal user cluster, so that the target user terminal and other user terminals can perform real-time and stable data sharing and data processing at a long distance. In addition, through the flexibility and long-distance mobility of the drone, real-time images and other information of the specified location can be quickly acquired, and then synchronized in the same user cluster, thereby improving the effectiveness and convenience of communication.

[0045] In another exemplary embodiment of the present application, please refer to Figure 2 , Figure 2 This is a schematic diagram of a process for verifying the identity of another user terminal shown in an exemplary embodiment of the present application. The method at least includes S210 to S220, which are described in detail as follows:

[0046] S210: extracting the identity credentials carried in the request from other user terminals for obtaining the first image data, and performing validity verification on the identity credentials.

[0047] The identity credential is the credential information sent by the drone to the other user terminal after the other user terminal successfully establishes a target channel with the drone.

[0048] In this application, before other user terminals obtain data through the drone, they need to first establish a target channel with the drone to obtain data access rights. In the process of establishing the target channel, the drone receives the account and password sent by other user terminals, matches it with the user information stored locally by the drone, and after the match is successful, establishes the target channel with other user terminals. Among them, the user information stored locally by the drone is usually the account and password information of the authorized user preset in advance by the target user.

[0049] After the drone successfully establishes the target channel with other user terminals, the drone assigns a random string to the other user terminals as an identity credential. In the subsequent communication process with the drone, the other user terminals can carry the identity credential and no longer need to perform account and password verification, thereby improving communication efficiency.

[0050] In some optional embodiments, when the drone establishes a target channel with other user terminals, in addition to using account and password verification, it can also use email verification or phone number verification, etc., and this application does not impose any restrictions on this.

[0051] S220: If the validity verification is passed, indicating that the other user terminals and the target user terminal belong to the same user cluster, the first image data is sent to the other user terminals through the target channel.

[0052] In the present application, if the identity credentials of other clients pass the validity verification, indicating that the other user terminals are authorized by the target user and belong to the same user cluster as the target user terminal, the drone sends the first image data to the other user terminals through the target channel.

[0053] This embodiment provides an identity authentication method for other user terminals. When other user terminals request drone data, the identities of other user terminals are verified through identity credentials, which can ensure the data security of the drone on the basis of improving data transmission efficiency.

[0054] In another exemplary embodiment of the present application, please refer to Figure 3 , Figure 3 This is a flow chart of validating the identity certificate according to an exemplary embodiment of the present application. The method at least includes S310 to S330, which are described in detail as follows:

[0055] S310: Match the identity credential with multiple candidate credential information stored locally on the drone. If the match is successful, it is determined that the identity credential passes the first validity verification.

[0056] Exemplarily, the drone obtains the first image data from other user terminals, extracts the identity credential "dsyww", and matches it with multiple candidate credential information stored locally on the drone. If there is a candidate credential information that is the same as the identity credential, it is determined that the identity credential passes the first validity verification.

[0057] S320: If the current time does not exceed the validity period of the identity credential, it is determined that the identity credential passes the second validity verification.

[0058] In this application, when the drone allocates identity credentials to other user terminals, it will also associate an expiration date with the identity credentials, such as 00:00:00 on February 28, 2022. If the current time does not exceed the expiration date, it is determined that the identity credential has passed the second validity verification.

[0059] S330: When the identity credential passes the first validity verification and the second validity verification, determine that the validity verification of the identity credential passes.

[0060] Only when the identity credential passes both the first validity verification and the second validity verification, the drone determines that the validity verification of the identity credential of the other user terminal has passed.

[0061] In other optional embodiments, if the current time exceeds the validity period of the identity credential, the drone requires other user terminals to re-provide their account and password, and re-assigns them new identity credentials after the account and password are verified, thereby further improving data security.

[0062] This embodiment provides a method for verifying the validity of identity credentials, which prevents unauthorized users from obtaining drone data through double verification, thereby further ensuring data security.

[0063] In another exemplary embodiment of the present application, how to broadcast target image data is described in detail, and the specific steps include: responding to a distribution instruction from a target user terminal, determining other online drones that match the device identification of the drone within a radius of a preset distance, and distributing the target image data carried in the distribution instruction to the other online drones.

[0064] In this application, after the target user determines the target image data, the target image data can also be broadcasted to other online drones through the drone, thereby sharing the target image data with the user cluster connected to other online drones. Among them, the other online drones that match the device identification of the drone can be other online drones of the same manufacturer as the drone, or other online drones that are adapted to the drone communication interface, and this application does not limit this.

[0065] This embodiment introduces a method for broadcasting data through a drone. The drone searches for other online drones that can be matched within the range, and distributes the data specified by the target user to the other online drones, so that the other online drones send the data to the corresponding user end, thereby realizing data broadcasting and improving the convenience of data transmission.

[0066] With the popularization of cars, the traffic volume on the roads is getting larger and larger, and traffic jams often occur. In particular, when the following vehicles do not understand the road conditions ahead in time and cannot change the driving route or take corresponding measures in time, more vehicles will enter the congested section, making the congestion more serious.

[0067] The solution to the above problem is usually to obtain traffic information through third-party map software to determine whether there is congestion ahead. However, when the road condition changes, the third-party map software has a delay in updating the traffic information, which makes it impossible for users to determine whether to continue waiting or re-plan the route, seriously affecting driving efficiency and user experience.

[0068] To this end, in another exemplary embodiment of the present application, a method for collecting image data by a drone is provided. Figure 4 , Figure 4 1 is a flow chart of a method for collecting raw image data according to an exemplary embodiment of the present application. The method at least includes S410 to S420, which are described in detail as follows:

[0069] S410: In response to an image acquisition signal from a target user terminal, an initial image of a target road section is acquired.

[0070] The target road section is a road section where the vehicle density in the target vehicle's driving direction is greater than a preset density threshold and the average driving speed of each vehicle is less than a preset speed threshold.

[0071] In the present application, the UAV performs corresponding actions by receiving control instructions from the target user end. When receiving the image acquisition signal from the target user end, the UAV acquires images of the target road section in the direction of travel of the target vehicle to obtain an initial image of the target road section.

[0072] For example, the drone flies to a position 1 km ahead of the target vehicle through the control command of the target user terminal, and obtains the initial image of the current position in response to the image acquisition signal of the target user terminal. According to the density of vehicles reflected in the initial image and the average driving speed of each vehicle, the target user can judge the traffic jam of the target section in real time. Among them, when the drone performs image acquisition, according to the requirements of the target user, it can obtain static photos or short films synthesized by time-lapse photography, and this application does not limit this.

[0073] In some optional embodiments, the drone can automatically perform an image acquisition function when it determines that the current road section may be a traffic jam section based on the density of vehicles on the road and the average driving speed of each vehicle.

[0074] S420: Generate original image data based on the geographic location information of the target road section and the initial image, so that the target user terminal determines the distance between the target vehicle and the target road section according to the geographic location information.

[0075] In this application, after the drone collects the initial image, it will embed the geographic location information of the target road section in the initial image to generate original image data, so that the target user can determine the distance between the target vehicle and the target road section based on the geographic location information, and then determine the estimated time for the target vehicle to travel to the target road section. Alternatively, the drone can also embed the shooting time of the initial image in the initial image so that the target user can monitor the road condition information of the target road section in real time.

[0076] In addition, after receiving the original image data, the target user terminal can also perform editing operations such as cropping, rotating, annotating, and renaming on the original image data, and this application does not impose any restrictions on this.

[0077] Exemplarily, the drone collects the initial image of the target road section, and records the current shooting time as 14:23:00 on May 15, 2021, and the current GPS coordinate information, and embeds the current shooting time and current GPS coordinate information into the initial image to generate original image data that can reflect the real-time road conditions information of the target road section.

[0078] This embodiment introduces how to obtain original image data. The original image data is generated by combining the shooting time and geographic location information with the initial image taken, which is helpful for the target user end or other user ends to edit and georeference in the later stage, ensuring the effectiveness of data transmission. In addition, in a traffic jam scenario, the user can determine the traffic jam situation of the target road section in real time based on the original image data transmitted by the drone, so as to quickly take corresponding measures. Compared with third-party map software with update delays, this application can effectively improve driving efficiency and driving experience through the rapid mobility of drones and the real-time nature of data collection.

[0079] On the other hand, under the relevant technology, the design of the intelligent low-battery return function for drones usually sets a fixed safety power level. When the remaining power level is lower than the safety power level, the drone automatically returns. However, the fixed safety power level design does not take into account the flight distance of the drone. When the drone flies too far, the remaining power may not support the drone to return to the designated location smoothly. In addition, if the drone receives a control command from the user during the return process, the return function may be interrupted, resulting in the drone's flight safety cannot be effectively guaranteed.

[0080] To this end, in another exemplary embodiment of the present application, a method for ensuring the flight safety of a drone is provided. Figure 5 , Figure 51 is a flow chart of a method for determining power level according to an exemplary embodiment of the present application. The method at least includes S510 to S520, which are described in detail as follows:

[0081] S510: Determine the safe amount of power required for the drone to return based on the distance between the drone and the target vehicle.

[0082] In this application, before the drone responds to the image acquisition signal of the target user end each time, it is necessary to first determine the safety power required for the drone to return based on the distance between the drone and the target vehicle. The farther the distance between the drone and the target vehicle, the more safety power is required.

[0083] For example, assuming that the current distance between the UAV and the target vehicle is 9 kilometers, it is determined that the safety power required for the corresponding UAV to return is 10% of the battery capacity.

[0084] In addition, in order to set the safety power more accurately and thus better ensure the flight safety of the drone, the safety power required for the drone to return can also be determined based on factors such as the drone's flight altitude, drone model, and weather conditions. This application does not impose any restrictions on this.

[0085] S520: If the sum of the minimum power consumption and the safety power required for the drone to execute the image acquisition signal is greater than the current remaining power of the drone, the drone will not respond to the image acquisition signal of the target user end.

[0086] For example, assuming that the minimum power consumption required for the drone to execute the image acquisition signal is 0.2%, and the current remaining power is 10.1%, the sum of the minimum power consumption and the safety power 10.2% is greater than the current remaining power 10%. In order to ensure flight safety, the drone will not respond to the image acquisition signal of the target user end.

[0087] In actual applications, the drone may respond to other flight control signals with lower power consumption and continue to hover or fly until the remaining power is equal to the safe power required for the current drone to return, and then automatically start to return.

[0088] This embodiment can ensure that the priority of the drone's automatic return command is always higher than the image acquisition signal by judging the drone's battery level. That is, even if the drone is low on battery, it can ensure that the drone has enough power to return, thereby ensuring the drone's flight safety.

[0089] In another exemplary embodiment of the present application, how to ensure the security of drone data under special circumstances is described in detail. The specific steps include: when the local memory occupancy rate of the target user terminal is greater than a preset storage threshold, uploading the original image data to the cloud and sending a full load warning to the target user terminal so that the target user can clean up the local memory of the target user terminal; or, when the distance between the target user terminal and the drone is greater than a preset distance, saving the original image data in the local memory of the drone.

[0090] In some optional embodiments, when the drone transmits the collected raw image data to the target user terminal, if the local memory occupancy rate of the target user terminal is greater than a preset storage threshold, in order to ensure that the data is not lost due to insufficient memory and to reduce the storage pressure of the drone, the drone uploads the raw image data to the cloud and sends a full load warning to the target user terminal by means of a pop-up window or flashing signal light, so that the target user can clean up the local memory of the target user terminal.

[0091] In other optional embodiments, if the distance between the target user terminal and the drone is greater than a preset distance, that is, the target user terminal and the drone cannot transmit data through the target channel, the drone saves the original image data in the local memory of the drone to ensure data security.

[0092] In another exemplary embodiment of the present application, a device management method is also introduced, and the specific steps include: responding to the device management instruction of the target user terminal, disconnecting the target channel between the drone and other user terminals.

[0093] In this application, the target user terminal has the highest control authority over the drone and can limit the communication between other user terminals and the drone. Therefore, when the drone receives the device management instruction from the target user terminal, it will disconnect the target channel with other user terminals.

[0094] This embodiment disconnects the communication between the drone and other user terminals by receiving the device management instruction from the target user terminal, and then disconnects the data interaction between the drone and other user terminals, thereby protecting the data rights and interests of the target user terminal and avoiding the risk of data leakage caused by malicious intrusion on other user terminals.

[0095] In another exemplary embodiment of the present application, an exemplary application scenario of the above-mentioned drone collaborative data processing and transmission method is described. For details, please refer to Figure 6 , Figure 6This is a schematic diagram of an application scenario of a drone collaborative data processing and transmission method of the present application, wherein the target user terminal 100, the drone 200 and other user terminals 300 (including other user terminals 301, other user terminals 302, ...) can be connected by wireless communication, and the present application does not limit the connection method between them.

[0096] The drone 200 collects image data and executes the drone collaborative data processing and transmission method shown in any of the above exemplary embodiments, so that the target user terminal 100 and other user terminals 300 can complete data sharing and data processing at a long distance. The following is an exemplary description:

[0097] The drone 200 collects original image data for the target road section, transmits the original image data to the target user terminal 100, and receives the first image data obtained after the target user terminal 100 edits the original image data. In response to the access request of the other user terminal 300 to obtain the first image data, the drone 200 sends the first image data to the other user terminal 300, so that the other user terminal 300 edits the first image data and obtains the second image data uploaded to the drone 200. The drone 200 sends the second image data to the target user terminal 100, so that the target user determines the target image data uploaded to the cloud from the original image data, the first image data, and the second image data. In the above interaction process, the distance between the target user terminal 100, the other user terminal 300 and the drone 200 is less than or equal to the preset distance.

[0098] In some optional embodiments, the drone collaborative data processing and transmission method can be used in scenarios such as long-distance road condition exploration and emergency on-site command to obtain real-time road condition information, thereby improving driving safety. It can also be used to shoot travel, outdoor sports and other scenes, capture outdoor scenery images or video streams, and thus enrich the driving experience. This application does not impose any restrictions on this.

[0099] The embodiment of the present application uses a drone as an aerial communication relay station to form an internal user cluster with the target user terminal and other user terminals, so that the target user terminal and other user terminals can perform stable data sharing and data processing in real time at a long distance. In addition, through the flexibility and long-distance mobility of the drone, real-time images and other information of the specified location can be quickly acquired, and then synchronized in the same user cluster, thereby improving the effectiveness and convenience of communication.

[0100] Another aspect of the present application also provides a data processing and transmission device for drone cooperation, such as Figure 7 As shown, Figure 7 700 is a schematic diagram of a data processing and transmission device for drone collaboration according to an exemplary embodiment of the present application. The refreshing device 700 includes:

[0101] The first transmission module 710, when the distance between the target user terminal and the drone is less than or equal to the preset distance, sends the original image data collected by the drone to the target user terminal through the target channel to receive the first image data returned by the target user terminal; wherein the first image data is data obtained by the target user terminal by editing the original image data, and the target channel is a transmission channel for the drone and the corresponding user terminal to exchange data within the preset distance;

[0102] The second transmission module 720, in response to a request from the other user end to obtain the first image data, sends the first image data to the other user end through a target channel when the distance between the other user end and the drone is less than or equal to a preset distance, so that the other user end edits the first image data and obtains the second image data uploaded to the drone;

[0103] The third transmission module 730 sends the second image data to the target user end through the target channel, so that the target user can determine the target image data uploaded to the cloud; wherein the target image data includes at least one of the original image data, the first image data, and the second image data.

[0104] In an optional manner, the second transmission module 720 further includes:

[0105] A verification unit verifies the validity of the identity credentials carried in the request of the other user end for obtaining the first image data; wherein the identity credentials are the credential information sent by the drone to the other user end after the other user end successfully establishes a target channel with the drone;

[0106] The sending unit sends the first image data to the other user terminals through the target channel if the validity verification is passed, indicating that the other user terminals and the target user terminal belong to the same user cluster.

[0107] In an optional manner, the verification unit further includes:

[0108] The matching subunit matches the identity credential with multiple candidate credential information stored locally on the drone. If the match is successful, it is determined that the identity credential passes the first validity verification.

[0109] The judging subunit determines that the identity credential passes the second validity verification if the current time does not exceed the validity period of the identity credential.

[0110] The determining unit determines that the validity verification on the identity credential passes when the identity credential passes the first validity verification and the second validity verification.

[0111] In an optional manner, the apparatus 700 further includes:

[0112] The broadcast module, in response to the distribution instruction of the target user terminal, determines other online drones that match the device identification of the drone within a radius of a preset distance, and distributes the target image data carried in the distribution instruction to the other online drones.

[0113] In an optional manner, the apparatus 700 further includes:

[0114] The acquisition module is configured to acquire an initial image of a target road section in response to an image acquisition signal from a target user terminal; wherein the target road section is a road section where the density of vehicles in the driving direction of the target vehicle is greater than a preset density threshold and the average driving speed of each vehicle is less than a preset speed threshold;

[0115] The generating module generates original image data based on the geographical location information of the target road section and the initial image, so that the target user terminal determines the distance between the target vehicle and the target road section according to the geographical location information.

[0116] In an optional manner, the apparatus 700 further includes:

[0117] The safety power calculation module determines the safety power required for the drone to return based on the distance between the drone and the target vehicle;

[0118] The discrimination module ignores the image acquisition signal of the target user end if the sum of the minimum power consumption and the safety power required for the drone to execute the image acquisition signal is greater than the current remaining power of the drone.

[0119] In an optional manner, the apparatus 700 further includes:

[0120] The warning module uploads the original image data to the cloud and sends a full-load warning to the target user terminal when the local memory usage of the target user terminal is greater than a preset storage threshold, so that the target user can clean up the local memory of the target user terminal; or

[0121] The storage module stores the original image data in the local memory of the drone when the distance between the target user terminal and the drone is greater than a preset distance.

[0122] Another aspect of the present application provides an electronic device, comprising: a controller; and a memory for storing one or more programs, wherein when the one or more programs are executed by the controller, the above method is executed.

[0123] See also Figure 8 , Figure 81 is a schematic diagram of the structure of a computer system of an electronic device shown in an exemplary embodiment of the present application, which shows a schematic diagram of the structure of a computer system of an electronic device suitable for implementing an embodiment of the present application.

[0124] It should be noted that Figure 8 The computer system 800 of the electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0125] like Figure 8 As shown, the computer system 800 includes a central processing unit (CPU) 801, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 802 or the program loaded from the storage part 808 to the random access memory (RAM) 803, such as executing the method in the above embodiment. In the RAM 803, various programs and data required for system operation are also stored. The CPU 801, ROM 802 and RAM 803 are connected to each other through a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.

[0126] The following components are connected to the I / O interface 805: an input section 806 including a keyboard, a mouse, etc.; an output section 807 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 808 including a hard disk, etc.; and a communication section 809 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 809 performs communication processing via a network such as the Internet. A drive 810 is also connected to the I / O interface 805 as needed. A removable medium 811, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 810 as needed so that a computer program read therefrom is installed into the storage section 808 as needed.

[0127] In particular, according to an embodiment of the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a computer program for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication section 809, and / or installed from a removable medium 811. When the computer program is executed by a central processing unit (CPU) 801, various functions defined in the system of the present application are executed.

[0128] It should be noted that the computer-readable medium shown in the embodiment of the present application may be a computer-readable signal medium or a storage medium or any combination of the above two. The storage medium may be, for example, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, the storage medium may be any tangible medium containing or storing a program, which may be used by an instruction execution system, device or device or used in combination with it. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, wherein a computer-readable computer program is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. A computer program contained on a computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0129] The flowchart and block diagram in the accompanying drawings illustrate the possible architecture, functions and operations of the system, method and computer program product according to various embodiments of the present application. Wherein, each box in the flowchart or block diagram can represent a module, a program segment, or a part of the code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0130] The units involved in the embodiments described in this application may be implemented by software or hardware, and the units described may also be set in a processor. The names of these units do not, in some cases, constitute limitations on the units themselves.

[0131] Another aspect of the present application further provides a storage medium on which a computer program is stored, and when the computer program is executed by a processor, the above method is implemented. The storage medium may be included in the electronic device described in the above embodiment, or may exist independently without being assembled into the electronic device.

[0132] Another aspect of the present application also provides a computer program product or computer program, which includes computer instructions stored in a storage medium. A processor of a computer device reads the computer instructions from the storage medium, and the processor executes the computer instructions, so that the computer device executes the methods provided in the above embodiments.

[0133] According to one aspect of an embodiment of the present application, a computer system is also provided, including a central processing unit (CPU), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) or a program loaded from a storage portion into a random access memory (RAM), such as executing the method in the above embodiment. In RAM, various programs and data required for system operation are also stored. CPU, ROM and RAM are connected to each other via a bus. An input / output (I / O) interface is also connected to the bus.

[0134] The following components are connected to the I / O interface: an input part including a keyboard, a mouse, etc.; an output part including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker; a storage part including a hard disk, etc.; and a communication part including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication part performs communication processing via a network such as the Internet. A drive is also connected to the I / O interface as needed. Removable media, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., are installed on the drive as needed so that the computer program read therefrom is installed into the storage part as needed.

[0135] The above content is only a preferred exemplary embodiment of the present application and is not intended to limit the implementation scheme of the present application. A person skilled in the art can easily make corresponding changes or modifications based on the main concept and spirit of the present application. Therefore, the scope of protection of the present application shall be based on the scope of protection required by the claims.

Claims

1. A data processing and transmission method for unmanned aerial vehicle collaboration, characterized in that: The method is applied to a drone, comprising: When the distance between the target user terminal and the drone is less than or equal to the preset distance, the original image data collected by the drone is sent to the target user terminal through the target channel to receive the first image data returned by the target user terminal; wherein the first image data is the data obtained by the target user terminal by editing the original image data, and the target channel is the transmission channel for the drone and the corresponding user terminal to exchange data within the preset distance; When the distance between the other user terminal and the drone is less than or equal to the preset distance, in response to the other user terminal's request to obtain the first image data, the first image data is sent to the other user terminal through the target channel, so that the other user terminal edits the first image data and obtains the second image data uploaded to the drone; The second image data is sent to the target user terminal through the target channel, so that the target user can determine the target image data uploaded to the cloud; wherein the target image data includes at least one of the original image data, the first image data, and the second image data.

2. The method according to claim 1, characterized in that The step of sending the first image data to the other user terminal through the target channel in response to the other user terminal's request for acquiring the first image data includes: Verifying the validity of the identity credentials carried in the request of the other user end for obtaining the first image data; wherein the identity credentials are credential information sent by the drone to the other user end after the other user end successfully establishes the target channel with the drone; If the validity verification is passed, indicating that the other user terminals and the target user terminal belong to the same user cluster, the first image data is sent to the other user terminals through the target channel.

3. The method according to claim 2, characterized in that The verifying the validity of the identity credential includes: Matching the identity credential with multiple candidate credential information, and if the match is successful, determining that the identity credential passes the first validity verification; If the current time does not exceed the validity period of the identity credential, determining that the identity credential passes the second validity verification; In a case where the identity credential passes the first validity verification and the second validity verification, it is determined that the validity verification of the identity credential passes.

4. The method according to claim 1, characterized in that The method further comprises: In response to the distribution instruction of the target user terminal, other online drones matching the device identification of the drone within the radius of the preset distance are determined, and the target image data carried in the distribution instruction is distributed to the other online drones.

5. The method according to claim 1, characterized in that The method further comprises: In response to the image acquisition signal of the target user terminal, an initial image of the target road section is acquired; wherein the target road section is a road section where the density of vehicles in the driving direction of the target vehicle is greater than a preset density threshold and the average driving speed of each vehicle is less than a preset speed threshold; The original image data is generated based on the geographic location information of the target road section and the initial image, so that the target user terminal determines the distance between the target vehicle and the target road section according to the geographic location information.

6. The method according to claim 5, characterized in that Before responding to the image acquisition signal of the target user terminal, the method further includes: Determining the safe amount of power required for the drone to return based on the distance between the drone and the target vehicle; If the sum of the minimum power consumption required by the drone to execute the image acquisition signal and the safety power is greater than the current remaining power of the drone, the drone will not respond to the image acquisition signal of the target user end.

7. The method according to claim 1, characterized in that The method further comprises: When the local memory usage rate of the target user terminal is greater than a preset storage threshold, the original image data is uploaded to the cloud, and a full load warning is sent to the target user terminal, so that the target user can clean up the local memory of the target user terminal; or When the distance between the target user terminal and the drone is greater than the preset distance, the original image data is stored in the local memory of the drone.

8. A data processing and transmission device for drone collaboration, characterized in that: The device comprises: A first transmission module, when the distance between the target user terminal and the drone is less than or equal to a preset distance, sends the original image data collected by the drone to the target user terminal through a target channel, so as to receive the first image data returned by the target user terminal; wherein the first image data is data obtained by the target user terminal by editing the original image data, and the target channel is a transmission channel for the drone and the corresponding user terminal to perform data exchange within the preset distance; a second transmission module, in response to a request from the other user terminal to obtain the first image data, sending the first image data to the other user terminal through the target channel when the distance between the other user terminal and the drone is less than or equal to the preset distance, so that the other user terminal edits the first image data and obtains the second image data uploaded to the drone; The third transmission module sends the second image data to the target user terminal through the target channel, so that the target user can determine the target image data uploaded to the cloud; wherein the target image data includes at least one of the original image data, the first image data, and the second image data.

9. A device, characterized in that: include: Controller; A memory for storing one or more programs, which, when executed by a controller, enables the controller to implement the method according to any one of claims 1 to 7.

10. A storage medium, characterized in that: Computer-readable instructions are stored thereon, and when the computer-readable instructions are executed by a processor of a computer, the computer is caused to execute the method according to any one of claims 1 to 7.

Images