Data processing and transmission method, device and equipment coordinated by unmanned aerial vehicle, and storage medium

Abstract

The application relates to the technical field of vehicles and discloses a data processing and transmission method, device and equipment coordinated by a drone and a storage medium, the method comprising the following steps: in the case that the distance between a target user terminal and a drone is less than or equal to a preset distance, sending original image data collected by the drone to the target user terminal through a target channel to receive first image data returned by the target user terminal; in response to a request of other user terminals for the first image data, sending the first image data to the other user terminals through the target channel to make the other user terminals obtain second image data uploaded to the drone after editing the first image data; and sending the second image data to the target user terminal through the target channel to make the target user determine target image data uploaded to the cloud. The application takes the drone as an air communication relay station, and the effectiveness and convenience of communication are improved.

Description

Technical Field

[0001] The present application relates to the field of vehicle technology, and specifically to a method, device, equipment and storage medium for data processing and transmission in collaboration with unmanned aerial vehicles. Background Art

[0002] With the increasing popularity of cars, more and more people are becoming private car owners, and the phenomenon of multiple vehicles traveling in convoys is becoming increasingly common. Due to the high speeds of vehicles and the complex road conditions, there is a need for vehicles in the same convoy to communicate road conditions to ensure driving safety and efficiency.

[0003] Under related technologies, users usually use mobile phone voice or video to communicate road conditions with other users in the same fleet. However, when using this method, users can only understand and synchronize road conditions within a few meters of their vehicle's current location. If long-distance data exchange between various vehicles is carried out through the cloud, there will be problems such as untimely data exchange or missing data transmission due to reasons such as lack of operator signals. Summary of the Invention

[0004] In view of the above problems, the present application provides a drone collaborative data processing and transmission method, device, equipment and storage medium, which are used to solve the problem of untimely long-distance data interaction or missing data transmission due to the lack of operator signals in the existing technology.

[0005] According to one aspect of the present application, a method for collaborative data processing and transmission of drones is provided, the method comprising: when the distance between a target user terminal and the drone is less than or equal to a preset distance, sending original image data collected by the drone to the target user terminal via a target channel to receive first image data returned by the target user terminal; wherein the first image data is data obtained by the target user terminal by editing the original image data, and the target channel is a transmission channel for data exchange between the drone and the corresponding user terminal within the preset distance; when the distance between other user terminals and the drone is less than or equal to the preset distance, in response to a request from the other user terminals to obtain the first image data, sending the first image data to the other user terminals via the target channel, so that the other user terminals edit the first image data to obtain second image data uploaded to the drone; and sending the second image data to the target user terminals via the target channel, so that the target user determines the target image data uploaded to the cloud; wherein the target image data includes at least one of the original image data, the first image data, and the second image data.

[0006] In an optional manner, in response to the request of the other user terminal to obtain the first image data, the first image data is sent to the other user terminal through the target channel, including: verifying the validity of the identity credentials carried in the request of the other user terminal to obtain the first image data; wherein, the identity credentials are the credential information sent by the drone to the other user terminal after the other user terminal successfully establishes the target channel with the drone; if the validity verification is passed, indicating that the other user terminal and the target user terminal belong to the same user cluster, the first image data is sent to the other user terminal through the target channel.

[0007] In an optional manner, the validity verification of the identity credential includes: matching the identity credential with multiple candidate credential information stored locally on the drone; if the match is successful, determining that the identity credential has passed the first validity verification; if the current time does not exceed the validity period of the identity credential, determining that the identity credential has passed the second validity verification; and if the identity credential has passed the first validity verification and the second validity verification, determining that the validity verification of the identity credential has passed.

[0008] In an optional embodiment, the method further includes: responding to a distribution instruction from the target user terminal, determining other online drones that match the device identification of the drone within a radius with the preset distance, and distributing the target image data carried in the distribution instruction to the other online drones.

[0009] In an optional embodiment, the method further includes: in response to an image acquisition signal from a target user terminal, acquiring an initial image of a target road section; wherein the target road section is a road section where the vehicle density in the direction of travel of the target vehicle is greater than a preset density threshold, and the average travel speed of each vehicle is less than a preset speed threshold; based on the geographic location information of the target road section and the initial image, the original image data is generated so that the target user terminal determines the distance between the target vehicle and the target road section according to the geographic location information.

[0010] In an optional manner, before responding to the image acquisition signal of the target user terminal, it also includes: determining the safety power required for the drone to return based on the distance between the drone and the target vehicle; if the sum of the minimum power consumption required for the drone to execute the image acquisition signal and the safety power is greater than the current remaining power of the drone, then the image acquisition signal of the target user terminal will not be responded to.

[0011] In an optional embodiment, the method further includes: when the local memory occupancy rate of the target user terminal is greater than a preset storage threshold, uploading the original image data to the cloud and sending a full load warning to the target user terminal so that the target user can clean up the local memory of the target user terminal; or, when the distance between the target user terminal and the drone is greater than the preset distance, saving the original image data in the local memory of the drone.

[0012] According to another aspect of the present application, a data processing and transmission device for drone collaboration is provided, the device comprising: a first transmission module, which, when the distance between a target user terminal and the drone is less than or equal to a preset distance, transmits raw image data collected by the drone to the target user terminal via a target channel, so as to receive first image data returned by the target user terminal; wherein the first image data is data obtained by the target user terminal by editing the raw image data, and the target channel is a transmission channel for data exchange between the drone and the corresponding user terminal within the preset distance; a second transmission module, which, when the distance between another user terminal and the drone is less than or equal to the preset distance, responds to a request from the other user terminal to obtain the first image data, transmits the first image data to the other user terminal via the target channel, so that the other user terminal edits the first image data and obtains second image data uploaded to the drone; and a third transmission module, which, when the distance between the other user terminal and the drone is less than or equal to the preset distance, transmits the second image data to the other user terminal via the target channel, so that the target user determines the target image data to be uploaded to the cloud; wherein the target image data includes at least one of the original image data, the first image data, and the second image data.

[0013] According to one aspect of the present application, an electronic device is provided, comprising: a controller; and a memory for storing one or more programs, wherein when the one or more programs are executed by the controller, the above method is executed.

[0014] According to one aspect of the present application, a storage medium is further provided, on which computer-readable instructions are stored. When the computer-readable instructions are executed by a processor of a computer, the computer is caused to execute the above method.

[0015] According to one aspect of the present application, a computer program product or computer program is further provided, the computer program product or computer program including computer instructions stored in a storage medium. A processor of a computer device reads the computer instructions from the storage medium and executes the computer instructions, causing the computer device to perform the above method.

[0016] In the embodiment of the present application, a drone is used as an aerial communication relay station to form an internal user cluster with the target user terminal and other user terminals, so that the target user terminal and other user terminals can perform stable data sharing and data processing in real time at a long distance. In addition, through the flexibility and long-distance mobility of the drone, real-time images and other information of the specified location can be quickly obtained, and then synchronized in the same user cluster, thereby improving the effectiveness and convenience of communication. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 It is a flowchart of a method for data processing and transmission of UAV collaboration shown in an exemplary embodiment of the present application.

[0018] Figure 2 This is a flowchart of verifying the identity of other user terminals, shown in an exemplary embodiment of the present application.

[0019] Figure 3 This is a flowchart illustrating a process for verifying the validity of identity credentials according to an exemplary embodiment of the present application.

[0020] Figure 4 It is a flowchart of a method for collecting raw image data shown in an exemplary embodiment of the present application.

[0021] Figure 5 This is a flow chart of a method for determining power level shown in an exemplary embodiment of the present application.

[0022] Figure 6 This is a schematic diagram of an application scenario of a drone collaborative data processing and transmission method of the present application.

[0023] Figure 7 It is a structural diagram of a data processing and transmission device for drone collaboration shown in an exemplary embodiment of the present application.

[0024] Figure 8 This is a structural diagram of a computer system of an electronic device shown in an exemplary embodiment of the present application. DETAILED DESCRIPTION

[0025] Exemplary embodiments will be described in detail herein, with examples illustrated in the accompanying drawings. When the following description refers to the drawings, identical numerals in different figures represent identical or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.

[0026] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically separate entities. That is, these functional entities may be implemented in software, in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0027] The flowcharts shown in the accompanying drawings are for illustrative purposes only and do not necessarily include all contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may be decomposed, while others may be combined or partially combined. Therefore, the actual execution order may vary depending on the actual situation.

[0028] In this application, "plurality" refers to two or more. "And / or" describes the relationship between related objects, indicating that three possible relationships exist. For example, "A and / or B" can mean: A exists alone, A and B exist simultaneously, and B exists alone. The character " / " generally indicates that the related objects are in an "or" relationship.

[0029] In related technologies, users usually use mobile phone voice or video to communicate road conditions with other users in the same fleet. However, when using this method, users can only understand and synchronize road conditions within a few meters of their vehicle's current location. If long-distance data interaction between various vehicles is carried out through the cloud, there will be problems such as untimely data interaction or missing data transmission due to reasons such as lack of operator signals.

[0030] To this end, one aspect of this application provides a method for data processing and transmission in collaboration with drones. Figure 1 , Figure 1 This is a flow chart of a method for data processing and transmission in cooperation with drones, as shown in an exemplary embodiment of the present application. The method includes at least S110 to S120, which are described in detail as follows:

[0031] S110: When the distance between the target user terminal and the drone is less than or equal to a preset distance, the original image data collected by the drone is sent to the target user terminal through a target channel to receive first image data returned by the target user terminal.

[0032] Among them, the first image data is the data obtained by the target user end by editing the original image data, and the target channel is the transmission channel for the drone and the corresponding user end to exchange data within a preset distance.

[0033] In this application, the target user end can be the target vehicle's vehicle computer, which can realize information communication and interactive control functions between people and vehicles, and vehicles and the outside world, or it can be a specific application software that can realize the control and data processing functions of the drone.

[0034] The drone is a vehicle-mounted drone configured on the target vehicle, communicating with the target user end through the target channel. In this application, the target channel is a dedicated communication channel established after the drone and the target user end authorize each other through a preset interface. When the distance between the target user end and the drone meets the requirements, the target channel is more stable than the communication channels established by operators such as Wi-Fi and cellular networks (4G / 5G), and will not cause problems such as delayed data interaction or missing data transmission due to reasons such as loss of operator signals.

[0035] In some optional embodiments, if the operator signal is good, wireless communication technologies such as Wi-Fi, cellular network (4G / 5G) can also be directly used to achieve the target channel. This application does not impose any restrictions on this.

[0036] For example, assuming that the maximum communication distance supported by the target channel is 10 kilometers, when the distance between the target user terminal and the drone is less than or equal to 10 kilometers, that is, the target user terminal and the drone meet the communication conditions, the drone will transmit the collected original image data to the target user terminal, and receive the first image data obtained after the target user terminal edits the original image data, completing the data transmission process between the target user terminal and the drone.

[0037] S120: When the distance between the other user terminal and the drone is less than or equal to the preset distance, in response to the other user terminal's request to obtain the first image data, the first image data is sent to the other user terminal through the target channel, so that the other user terminal can edit the first image data and obtain the second image data uploaded to the drone.

[0038] In this application, "other user terminals" can be the onboard computers of other vehicles, or mobile phones, computers, etc. located in the target vehicle or other vehicles, and there can be multiple other user terminals. The communication method used by other user terminals and the drone is the same as the communication method used by the target user terminal and the drone.

[0039] For example, when the distance between the other user terminal and the drone is less than or equal to 10 kilometers, the drone can receive a request from the other user terminal to obtain the first image data, and receive the second image data obtained after the other user terminal edits the first image data, thereby completing the data transmission process between the other user terminal and the drone.

[0040] S130: Send the second image data to the target user terminal through the target channel, so that the target user can determine the target image data uploaded to the cloud.

[0041] The target image data includes at least one of original image data, first image data, and second image data.

[0042] In this application, after receiving the second image data uploaded by another user, the drone sends the second image data to the target user, allowing the target user to determine the target image data to be uploaded to the cloud based on the original image data, the first image data, and the second image data. In other words, the target user determines the final version and uploads it to the cloud for backup. The target user is the owner of the target vehicle and has the highest authority over data processing.

[0043] In the above process, if the target user end and the other user ends are the target vehicle and the vehicle computers of other vehicles respectively, the target user end and the other user ends together form a fleet, and conduct long-distance data communication through drones to realize the sharing of road condition information corresponding to the driving road.

[0044] In this embodiment, the drone acts as an aerial communication relay station, forming an internal user cluster with the target user terminal and other user terminals, so that the target user terminal and other user terminals can perform stable data sharing and data processing in real time at a long distance. In addition, through the flexibility and long-distance mobility of the drone, real-time images and other information of the specified location can be quickly obtained, and then synchronized in the same user cluster, thereby improving the effectiveness and convenience of communication.

[0045] In another exemplary embodiment of the present application, please refer to Figure 2 , Figure 2 This is a flow chart illustrating an exemplary embodiment of the present application for verifying the identity of another user terminal. The method includes at least S210 to S220, which are described in detail as follows:

[0046] S210: Extracting the identity credentials carried in the request from other user terminals to obtain the first image data, and performing validity verification on the identity credentials.

[0047] The identity certificate is the certificate information sent by the drone to the other user terminal after the other user terminal successfully establishes a target channel with the drone.

[0048] In this application, before other users can access data through the drone, they must first establish a target channel with the drone to obtain data access rights. During this process, the drone receives the user account and password sent by the other user, matches them with the user information stored locally on the drone, and, upon successful matching, establishes the target channel with the other user. The user information stored locally on the drone is typically the account and password information of authorized users pre-set by the target user.

[0049] After the drone successfully establishes a target channel with other user terminals, the drone assigns a random string to the other user terminals as an identity credential. In the subsequent communication process with the drone, the other user terminals can carry this identity credential and no longer need to perform account and password verification, thereby improving communication efficiency.

[0050] In some optional embodiments, when establishing a target channel with other user terminals, the drone may use, in addition to account and password verification, email verification or phone number verification, etc., and this application does not impose any restrictions on this.

[0051] S220: If the validity verification is passed, indicating that the other user terminals and the target user terminal belong to the same user cluster, the first image data is sent to the other user terminals through the target channel.

[0052] In this application, if the identity credentials of other clients pass the validity verification, indicating that the other user terminals are authorized by the target user and belong to the same user cluster as the target user terminal, the drone sends the first image data to the other user terminals through the target channel.

[0053] This embodiment provides an identity authentication method for other user terminals. When other user terminals request drone data, the identity of the other user terminals is verified through identity credentials, which can ensure the data security of the drone while improving data transmission efficiency.

[0054] In another exemplary embodiment of the present application, please refer to Figure 3 , Figure 3 This is a flow chart illustrating a method for verifying the validity of an identity credential according to an exemplary embodiment of the present application. The method includes at least steps S310 to S330, which are described in detail as follows:

[0055] S310: Match the identity credential with multiple candidate credential information stored locally in the drone. If the match is successful, it is determined that the identity credential passes the first validity verification.

[0056] Exemplarily, the drone obtains the first image data from other user terminals, extracts the identity credential "dsyww", and matches it with multiple candidate credential information stored locally on the drone. If there is a candidate credential information that is the same as the identity credential, it is determined that the identity credential passes the first validity verification.

[0057] S320: If the current time does not exceed the validity period of the identity certificate, it is determined that the identity certificate passes the second validity verification.

[0058] In this application, when the drone assigns identity credentials to other user terminals, it will also associate an expiration date with the identity credentials, such as 00:00:00 on February 28, 2022. If the current time does not exceed the expiration date, it is determined that the identity credentials have passed the second validity verification.

[0059] S330: When the identity credential passes the first validity verification and the second validity verification, it is determined that the validity verification of the identity credential passes.

[0060] Only when the identity credential passes both the first validity verification and the second validity verification, the drone determines that the validity verification of the identity credential for the other user terminal has passed.

[0061] In other optional embodiments, if the current time exceeds the validity period of the identity certificate, the drone requires other user terminals to re-provide their account and password, and re-assigns them new identity certificates after the account and password are verified, thereby further improving data security.

[0062] This embodiment provides a method for verifying the validity of identity credentials, which prevents unauthorized users from obtaining drone data through double verification, further ensuring data security.

[0063] In another exemplary embodiment of the present application, how to broadcast target image data is described in detail. The specific steps include: responding to a distribution instruction from a target user terminal, determining other online drones that match the device identification of the drone within a radius of a preset distance, and distributing the target image data carried in the distribution instruction to the other online drones.

[0064] In this application, after the target user determines the target image data, they can also broadcast the target image data to other online drones through the drone, thereby sharing the target image data with the user cluster connected to the other online drones. The other online drones that match the drone's device identifier can be other online drones from the same manufacturer as the drone, or other online drones that are compatible with the drone's communication interface. This application does not impose any restrictions on this.

[0065] This embodiment introduces a method for broadcasting data through a drone. The drone searches for other online drones that can match within the range, and distributes the data specified by the target user to the other online drones, so that the other online drones send the data to the corresponding user end, thereby realizing data broadcasting and improving the convenience of data transmission.

[0066] With the popularization of cars, the traffic volume on the roads is getting larger and larger, and traffic jams often occur. Especially when the following vehicles do not understand the road conditions ahead in time and cannot change the driving route or take corresponding measures in time, more vehicles will enter the congested section, making the congestion more serious.

[0067] The solution to this problem is typically to obtain traffic information from third-party mapping software to determine whether there is congestion ahead. However, when traffic conditions change, third-party mapping software updates traffic information with delays, making it difficult for users to determine whether to continue waiting or re-route, severely impacting driving efficiency and user experience.

[0068] To this end, in another exemplary embodiment of the present application, a method for collecting image data by a drone is provided. Figure 4 , Figure 4 FIG4 is a flow chart of a method for collecting raw image data according to an exemplary embodiment of the present application. The method includes at least S410 to S420, which are described in detail as follows:

[0069] S410: In response to an image acquisition signal from a target user terminal, an initial image of the target road section is acquired.

[0070] The target road section is a road section where the vehicle density in the target vehicle's driving direction is greater than a preset density threshold and the average driving speed of each vehicle is less than a preset speed threshold.

[0071] In this application, the UAV performs corresponding actions by receiving control instructions from the target user end. When receiving the image acquisition signal from the target user end, it acquires images of the target road section in the direction of travel of the target vehicle to obtain an initial image of the target road section.

[0072] For example, the drone, following control instructions from the target user, flies to a location 1 km ahead of the target vehicle and, in response to image acquisition signals from the target user, obtains an initial image of the current location. Based on the vehicle density and average speed of each vehicle reflected in the initial image, the target user can determine the traffic congestion situation on the target road section in real time. During image acquisition, the drone can capture either still photos or time-lapse videos, as requested by the target user; this application does not impose any restrictions on this.

[0073] In some optional embodiments, the drone may automatically perform an image acquisition function when it determines that the current road section may be a traffic jam section based on the density of vehicles on the road and the average driving speed of each vehicle.

[0074] S420: Generate original image data based on the geographic location information of the target road section and the initial image, so that the target user terminal determines the distance between the target vehicle and the target road section according to the geographic location information.

[0075] In this application, after a drone captures an initial image, it embeds the geographic location information of the target road section into the initial image to generate raw image data. This allows the target user to determine the distance between the target vehicle and the target road section based on the geographic location information, and further determine the estimated time it will take for the target vehicle to reach the target road section. Alternatively, the drone can also embed the time the initial image was taken into account, allowing the target user to monitor the road conditions of the target road section in real time.

[0076] In addition, after the target user terminal receives the original image data, it can also perform editing operations such as cropping, rotating, annotating, and renaming the original image data, and this application does not impose any restrictions on this.

[0077] Exemplarily, the drone collects the initial image of the target road section, records the current shooting time as 14:23:00 on May 15, 2021, and the current GPS coordinate information, and embeds the current shooting time and current GPS coordinate information into the initial image to generate original image data that can reflect the real-time road conditions information of the target road section.

[0078] This embodiment describes how to obtain raw image data. By combining the captured initial image with the capture time and geographic location information, raw image data is generated, which facilitates post-editing and georeferencing by the target user or other users, ensuring the effectiveness of data transmission. Furthermore, in traffic jam scenarios, users can determine the traffic congestion situation of the target road section in real time based on the raw image data transmitted by the drone, allowing them to quickly take appropriate measures. Compared to third-party map software with update delays, this application can effectively improve driving efficiency and experience by leveraging the drone's rapid mobility and real-time data collection.

[0079] On the other hand, the design of a drone's intelligent low-battery return-to-home function under related technologies typically sets a fixed safety level. When the remaining battery level falls below the safety level, the drone automatically returns home. However, this fixed safety level design does not take into account the drone's flight range. If the drone flies too far, the remaining battery may not support the drone's smooth return to the designated location. Furthermore, if the drone receives a control command from the user during the return process, the return function may be interrupted, resulting in the drone's flight safety being unable to be effectively guaranteed.

[0080] To this end, in another exemplary embodiment of the present application, a method for ensuring the flight safety of a drone is provided. Figure 5 , Figure 5This is a flow chart of a method for determining power level according to an exemplary embodiment of the present application. The method includes at least steps S510 to S520, which are described in detail as follows:

[0081] S510: Determine the safe amount of power required for the drone to return based on the distance between the drone and the target vehicle.

[0082] In this application, before the drone responds to the image acquisition signal of the target user end each time, it needs to first determine the safety power required for the drone to return based on the distance between the drone and the target vehicle. The farther the distance between the drone and the target vehicle, the more safety power is required.

[0083] For example, assuming that the current distance between the UAV and the target vehicle is 9 kilometers, it is determined that the safety power required for the UAV to return is 10% of the battery capacity.

[0084] In addition, in order to set the safety power more accurately and thus better ensure the flight safety of the drone, the safety power required for the drone to return can also be determined based on factors such as the drone's flight altitude, drone model, and weather conditions. This application does not impose any restrictions on this.

[0085] S520: If the sum of the minimum power consumption and the safety power required for the drone to execute the image acquisition signal is greater than the current remaining power of the drone, the drone does not respond to the image acquisition signal of the target user end.

[0086] For example, assuming that the minimum power consumption required for the drone to execute the image acquisition signal is 0.2% and the current remaining power is 10.1%, the sum of the minimum power consumption and the safety power 10.2% is greater than the current remaining power 10%. In order to ensure flight safety, the drone will not respond to the image acquisition signal of the target user end.

[0087] In actual applications, the drone may respond to other flight control signals with lower power consumption and continue to hover or fly until the remaining power is equal to the safe power required for the current drone to return, and then automatically start to return.

[0088] This embodiment can ensure that the priority of the drone's automatic return command is always higher than the image acquisition signal by judging the drone's battery level. That is, even if the drone's battery is low, it can ensure that the drone has enough power to return, thereby ensuring the drone's flight safety.

[0089] In another exemplary embodiment of the present application, how to ensure the security of drone data under special circumstances is described in detail. The specific steps include: when the local memory occupancy rate of the target user terminal is greater than a preset storage threshold, uploading the original image data to the cloud and sending a full load warning to the target user terminal so that the target user can clean up the local memory of the target user terminal; or, when the distance between the target user terminal and the drone is greater than a preset distance, saving the original image data in the local memory of the drone.

[0090] In some optional embodiments, when the drone transmits the collected original image data to the target user terminal, if the local memory occupancy rate of the target user terminal is greater than a preset storage threshold, in order to ensure that the data is not lost due to insufficient memory and to reduce the storage pressure of the drone, the drone uploads the original image data to the cloud and sends a full load warning to the target user terminal through a pop-up window or flashing signal light, so that the target user can clean up the local memory of the target user terminal.

[0091] In other optional embodiments, if the distance between the target user terminal and the drone is greater than a preset distance, that is, the target user terminal and the drone cannot transmit data through the target channel, the drone saves the original image data in the local memory of the drone to ensure data security.

[0092] In another exemplary embodiment of the present application, a device management method is also introduced, and the specific steps include: responding to the device management instruction of the target user terminal, disconnecting the target channel between the drone and other user terminals.

[0093] In this application, the target user terminal has the highest control authority over the drone and can limit the communication between other user terminals and the drone. Therefore, when the drone receives the device management instruction from the target user terminal, it will disconnect the target channel with other user terminals.

[0094] This embodiment disconnects the communication between the drone and other user terminals by receiving device management instructions from the target user terminal, and then disconnects the data interaction between the drone and other user terminals, thereby protecting the data rights and interests of the target user terminal and avoiding the risk of data leakage caused by malicious intrusion on other user terminals.

[0095] In another exemplary embodiment of the present application, the application scenario of the above-mentioned UAV collaborative data processing and transmission method is exemplified. For details, please refer to Figure 6 , Figure 6This is a schematic diagram of an application scenario for a method for collaborative data processing and transmission between drones. The method includes a target user terminal 100, a drone 200, and other user terminals 300 (including other user terminals 301, 302, etc.). These three terminals can be connected via wireless communication, and this application does not limit the connection method between them.

[0096] The drone 200 collects image data and executes the drone-coordinated data processing and transmission method described in any of the above exemplary embodiments, so that the target user terminal 100 and other user terminals 300 can complete data sharing and data processing at a long distance. The following exemplary description is provided:

[0097] Drone 200 collects raw image data for a target road section, transmits the raw image data to target user terminal 100, and receives first image data obtained by target user terminal 100 after editing the raw image data. In response to a request from another user terminal 300 to access the first image data, drone 200 sends the first image data to the other user terminal 300, allowing the other user terminal 300 to edit the first image data and obtain second image data uploaded to drone 200. Drone 200 then sends the second image data to target user terminal 100, allowing the target user to determine the target image data uploaded to the cloud from the raw image data, the first image data, and the second image data. During this interaction, the distance between target user terminal 100, the other user terminal 300, and drone 200 is less than or equal to a preset distance.

[0098] In some optional embodiments, the drone collaborative data processing and transmission method can be used in scenarios such as long-distance road condition exploration and emergency on-site command to obtain real-time road condition information, thereby improving driving safety. It can also be used to shoot travel, outdoor sports and other scenes, capture images or video streams of scenery outside the vehicle, and thus enrich the driving experience. This application does not impose any restrictions on this.

[0099] In the embodiment of the present application, a drone is used as an aerial communication relay station to form an internal user cluster with the target user terminal and other user terminals, so that the target user terminal and other user terminals can perform stable data sharing and data processing in real time at a long distance. In addition, through the flexibility and long-distance mobility of the drone, real-time images and other information of the specified location can be quickly obtained, and then synchronized in the same user cluster, thereby improving the effectiveness and convenience of communication.

[0100] Another aspect of the present application also provides a data processing and transmission device for UAV collaboration, such as Figure 7 As shown, Figure 7 : This is a schematic diagram of a data processing and transmission device for drone collaboration according to an exemplary embodiment of the present application. The refreshing device 700 includes:

[0101] The first transmission module 710 transmits the original image data collected by the drone to the target user terminal via a target channel when the distance between the target user terminal and the drone is less than or equal to a preset distance, and receives first image data returned by the target user terminal. The first image data is data obtained by editing the original image data by the target user terminal, and the target channel is a transmission channel for data exchange between the drone and the corresponding user terminal within the preset distance.

[0102] The second transmission module 720, when the distance between the other user terminal and the drone is less than or equal to the preset distance, responds to the other user terminal's request to obtain the first image data and transmits the first image data to the other user terminal via the target channel, so that the other user terminal can edit the first image data and obtain the second image data uploaded to the drone;

[0103] The third transmission module 730 sends the second image data to the target user terminal through the target channel, so that the target user can determine the target image data uploaded to the cloud; wherein the target image data includes at least one of the original image data, the first image data, and the second image data.

[0104] In an optional manner, the second transmission module 720 further includes:

[0105] a verification unit for verifying the validity of an identity credential carried in a request from another user terminal for obtaining the first image data; wherein the identity credential is credential information sent by the drone to the other user terminal after the other user terminal successfully establishes a target channel with the drone;

[0106] The sending unit sends the first image data to the other user terminals through the target channel if the validity verification is passed, indicating that the other user terminals and the target user terminal belong to the same user cluster.

[0107] In an optional manner, the verification unit further includes:

[0108] The matching subunit matches the identity credential with multiple candidate credential information stored locally on the drone. If the match is successful, it is determined that the identity credential has passed the first validity verification.

[0109] The judgment subunit determines that the identity credential passes the second validity verification if the current time does not exceed the validity period of the identity credential.

[0110] The determining unit determines that the validity verification of the identity credential passes when the identity credential passes the first validity verification and the second validity verification.

[0111] In an optional manner, the apparatus 700 further includes:

[0112] The broadcast module responds to the distribution instruction of the target user terminal, determines other online drones that match the device identification of the drone within a preset distance radius, and distributes the target image data carried in the distribution instruction to the other online drones.

[0113] In an optional manner, the apparatus 700 further includes:

[0114] an acquisition module, in response to an image acquisition signal from a target user terminal, acquiring an initial image of a target road section; wherein the target road section is a road section where the density of vehicles in the direction of travel of the target vehicle is greater than a preset density threshold and the average travel speed of each vehicle is less than a preset speed threshold;

[0115] The generation module generates original image data based on the geographic location information of the target road section and the initial image, so that the target user terminal can determine the distance between the target vehicle and the target road section according to the geographic location information.

[0116] In an optional manner, the apparatus 700 further includes:

[0117] The safety power calculation module determines the safety power required for the drone to return based on the distance between the drone and the target vehicle;

[0118] The discrimination module ignores the image acquisition signal of the target user end if the sum of the minimum power consumption and the safety power required for the drone to execute the image acquisition signal is greater than the current remaining power of the drone.

[0119] In an optional manner, the apparatus 700 further includes:

[0120] The warning module uploads the original image data to the cloud and sends a full-load warning to the target user terminal when the local memory usage of the target user terminal exceeds the preset storage threshold, so that the target user can clean up the local memory of the target user terminal; or

[0121] The storage module stores the original image data in the local memory of the drone when the distance between the target user terminal and the drone is greater than a preset distance.

[0122] Another aspect of the present application provides an electronic device, comprising: a controller; and a memory for storing one or more programs, which, when executed by the controller, executes the above method.

[0123] See also Figure 8 , Figure 81 is a schematic diagram of the structure of a computer system of an electronic device shown in an exemplary embodiment of the present application, which shows a schematic diagram of the structure of a computer system of an electronic device suitable for implementing an embodiment of the present application.

[0124] It should be noted that Figure 8 The computer system 800 of the electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0125] like Figure 8 As shown, the computer system 800 includes a central processing unit (CPU) 801, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 802 or the program loaded from the storage part 808 into the random access memory (RAM) 803, such as executing the method in the above embodiment. Various programs and data required for system operation are also stored in the RAM 803. The CPU 801, ROM 802 and RAM 803 are connected to each other via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.

[0126] The following components are connected to the I / O interface 805: an input section 806 including a keyboard, a mouse, and the like; an output section 807 including devices such as a cathode ray tube (CRT), a liquid crystal display (LCD), and a speaker; a storage section 808 including a hard disk and the like; and a communication section 809 including a network interface card such as a LAN (Local Area Network) card or a modem. The communication section 809 performs communication processing via a network such as the Internet. A drive 810 is also connected to the I / O interface 805 as needed. Removable media 811, such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, is installed in the drive 810 as needed, so that computer programs read therefrom can be installed into the storage section 808 as needed.

[0127] In particular, according to an embodiment of the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a computer program for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network via the communication section 809, and / or installed from a removable medium 811. When the computer program is executed by the central processing unit (CPU) 801, the various functions defined in the system of the present application are executed.

[0128] It should be noted that the computer-readable medium shown in the embodiments of the present application may be a computer-readable signal medium or a storage medium or any combination of the two. The storage medium may be, for example, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or component, or any combination of the above. More specific examples of storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present application, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries a computer-readable computer program. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a storage medium that can transmit, propagate, or convey a program for use by or in connection with an instruction execution system, apparatus, or device. A computer program embodied on a computer-readable medium may be conveyed using any suitable medium, including but not limited to wireless, wired, or any suitable combination thereof.

[0129] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present application. Among them, each box in the flowchart or block diagram can represent a module, program segment, or part of the code, and the above-mentioned module, program segment, or part of the code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in an order different from that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0130] The units involved in the embodiments described in this application may be implemented by software or hardware, and the units described may also be set in a processor. In some cases, the names of these units do not constitute limitations on the units themselves.

[0131] Another aspect of the present application further provides a storage medium having a computer program stored thereon, which implements the above method when executed by a processor. The storage medium may be included in the electronic device described in the above embodiments, or may exist independently without being incorporated into the electronic device.

[0132] Another aspect of the present application further provides a computer program product or computer program, which includes computer instructions stored in a storage medium. A processor of a computer device reads the computer instructions from the storage medium and executes the computer instructions, causing the computer device to perform the methods provided in the above embodiments.

[0133] According to one aspect of an embodiment of the present application, a computer system is further provided, including a central processing unit (CPU), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) or a program loaded from a storage portion into a random access memory (RAM), such as executing the method in the above embodiment. Various programs and data required for system operation are also stored in the RAM. The CPU, ROM, and RAM are connected to each other via a bus. An input / output (I / O) interface is also connected to the bus.

[0134] The following components are connected to the I / O interface: an input section including a keyboard, mouse, etc.; an output section including a cathode ray tube (CRT), liquid crystal display (LCD), and speakers; a storage section including a hard disk; and a communication section including a network interface card such as a LAN (Local Area Network) card and a modem. The communication section performs communication processing via a network such as the Internet. A drive is also connected to the I / O interface as needed. Removable media such as magnetic disks, optical disks, magneto-optical disks, semiconductor memories, etc. are installed in the drive as needed so that computer programs read from them can be installed into the storage section as needed.

[0135] The above content is only a preferred exemplary embodiment of the present application and is not intended to limit the implementation scheme of the present application. Ordinary technicians in this field can easily make corresponding changes or modifications based on the main ideas and spirit of the present application. Therefore, the scope of protection of the present application shall be based on the scope of protection required by the claims.

Claims

1. A data processing and transmission method for UAV collaboration, characterized in that: The method is applied to a drone, comprising: When the distance between the target user terminal and the drone is less than or equal to a preset distance, the original image data collected by the drone is sent to the target user terminal via a target channel, so as to receive first image data returned by the target user terminal; wherein the first image data is data obtained by the target user terminal by editing the original image data, and the target channel is a transmission channel for the drone and the corresponding user terminal to exchange data within the preset distance; When the distance between the other user terminal and the drone is less than or equal to the preset distance, in response to the other user terminal's request to obtain the first image data, the first image data is sent to the other user terminal via the target channel, so that the other user terminal edits the first image data to obtain second image data uploaded to the drone; The second image data is sent to the target user terminal through the target channel, so that the target user can determine the target image data uploaded to the cloud; wherein the target image data includes at least one of the original image data, the first image data, and the second image data.

2. The method according to claim 1, wherein The step of sending the first image data to the other user terminal through the target channel in response to the request from the other user terminal to obtain the first image data includes: Verifying the validity of the identity credentials carried in the request by the other user terminal to obtain the first image data; wherein the identity credentials are credential information sent by the drone to the other user terminal after the other user terminal successfully establishes the target channel with the drone; If the validity verification passes, indicating that the other user terminals and the target user terminal belong to the same user cluster, the first image data is sent to the other user terminals through the target channel.

3. The method according to claim 2, wherein Verify the validity of the identity credentials, including: Matching the identity credential with multiple candidate credential information, and if the match is successful, determining that the identity credential passes the first validity verification; If the current time does not exceed the validity period of the identity credential, determining that the identity credential passes the second validity verification; If the identity credential passes the first validity verification and the second validity verification, it is determined that the validity verification of the identity credential passes.

4. The method according to claim 1, wherein The method further comprises: In response to the distribution instruction of the target user terminal, other online drones that match the device identification of the drone within the preset distance radius are determined, and the target image data carried in the distribution instruction is distributed to the other online drones.

5. The method according to claim 1, wherein The method further comprises: In response to an image acquisition signal from a target user terminal, an initial image of a target road section is acquired; wherein the target road section is a road section where the density of vehicles in the direction of travel of the target vehicle is greater than a preset density threshold and the average travel speed of each vehicle is less than a preset speed threshold; The original image data is generated based on the geographic location information of the target road section and the initial image, so that the target user terminal determines the distance between the target vehicle and the target road section according to the geographic location information.

6. The method according to claim 5, wherein Before responding to the image acquisition signal of the target user terminal, the method further includes: Determining the safe amount of power required for the drone to return based on the distance between the drone and the target vehicle; If the sum of the minimum power consumption required by the drone to execute the image acquisition signal and the safety power is greater than the current remaining power of the drone, the drone will not respond to the image acquisition signal of the target user end.

7. The method according to claim 1, wherein The method further comprises: When the local memory usage of the target user terminal is greater than a preset storage threshold, the original image data is uploaded to the cloud, and a full load warning is sent to the target user terminal, so that the target user can clean up the local memory of the target user terminal; or When the distance between the target user terminal and the drone is greater than the preset distance, the original image data is stored in the local memory of the drone.

8. A data processing and transmission device for UAV collaboration, characterized in that: The device comprises: a first transmission module, configured to transmit raw image data collected by the drone to the target user terminal via a target channel when the distance between the target user terminal and the drone is less than or equal to a preset distance, so as to receive first image data returned by the target user terminal; wherein the first image data is data obtained by the target user terminal by editing the raw image data, and the target channel is a transmission channel for data exchange between the drone and the corresponding user terminal within the preset distance; a second transmission module, in response to a request from the other user terminal to obtain the first image data, transmitting the first image data to the other user terminal via the target channel when the distance between the other user terminal and the drone is less than or equal to the preset distance, so that the other user terminal edits the first image data and obtains second image data uploaded to the drone; The third transmission module sends the second image data to the target user terminal through the target channel, so that the target user can determine the target image data uploaded to the cloud; wherein, the target image data includes at least one of the original image data, the first image data, and the second image data.

9. A device, characterized in that include: Controller; A memory for storing one or more programs, which, when executed by a controller, enables the controller to implement the method according to any one of claims 1 to 7.

10. A storage medium, characterized in that: Computer-readable instructions are stored thereon, and when the computer-readable instructions are executed by a processor of a computer, the computer is caused to execute the method according to any one of claims 1 to 7.

Images