Method, device, storage medium and electronic device for autonomous photography of scenic spot drone

Abstract

The present application provides a method, device, storage medium and electronic device for autonomous photography of scenic spots by drones, including: receiving a photography task sent by a service platform, wherein the photography task is sent by a user terminal to the service platform, and the photography task is generated after the user terminal generates a photography service order, and the photography task includes: photography mode and / or photography area, and the photography mode includes: fixed-point photography and follow-up photography; generating a drone photography position and photography parameters corresponding to the photography task; photographing a target object according to the photography parameters and the drone photography position, and obtaining photography data, wherein the photography data is used to send to the user terminal. The drone of the embodiment of the present application can provide autonomous photography services, which improves the photography efficiency and user experience of the drone.

Description

Technical Field

[0001] The present application relates to the field of unmanned photography technology, and more specifically, to a method, device, storage medium and electronic device for autonomous photography of scenic spots by unmanned aerial vehicles. Background Art

[0002] With the increasing popularity of drones, they are being applied to various fields.

[0003] At present, since drones usually require professional technicians to operate and manage, and drone photography needs to meet the photography regulations of different regions, it is difficult for users to independently control and obtain aerial photography data during daily activities or scenic spot visits. In addition, the low intelligence level of drones has greatly reduced the user experience. If users do not know how to operate drones, how to easily obtain high-quality aerial photos or automatically obtain tour videos when visiting scenic spots has become a limitation for scenic spot applications.

[0004] Therefore, how to provide a technical solution for an autonomous shooting method with a higher degree of intelligence has become a technical problem that needs to be solved urgently. Summary of the invention

[0005] The purpose of some embodiments of the present application is to provide a method, device, storage medium and electronic device for autonomous photography of scenic spots by drones. Through the technical solutions of the embodiments of the present application, autonomous photography of drones can be realized, with a high degree of intelligence, which is convenient for users to control and improves photography efficiency and experience.

[0006] In the first aspect, some embodiments of the present application provide a method for autonomous photography of a scenic spot by a drone, comprising: receiving a shooting task sent by a service platform, wherein the shooting task is sent by a user terminal to the service platform, and the shooting task is generated after the user terminal generates a shooting service order, and the shooting task includes: shooting mode and / or shooting area, and the shooting mode includes: fixed-point shooting and follow-up shooting; generating a drone shooting position and shooting parameters corresponding to the shooting task; shooting a target object according to the shooting parameters and the drone shooting position, and obtaining shooting data, wherein the shooting data is used to send to the user terminal.

[0007] In some embodiments of the present application, the drone can generate a corresponding drone shooting position and shooting parameters after receiving the shooting task of the user terminal sent by the service platform, and finally shoot according to the drone shooting position and shooting parameters to obtain shooting data and give it to the user terminal. The embodiments of the present application can realize autonomous shooting of drones in scenic spots, with a high degree of intelligence, which is convenient for users to control and improves shooting efficiency and experience.

[0008] In some embodiments, the shooting service order is generated by the software interface of the user terminal in response to a user's operation instruction; or, the shooting service order is generated after the user terminal recognizes an identification code.

[0009] In some embodiments of the present application, a user obtains a shooting task through operation on a user terminal, or the user terminal identifies an identification code to determine the shooting task, thereby achieving flexible online or offline operations and improving the user experience.

[0010] In some embodiments, the shooting mode is the fixed-point shooting, wherein the drone shooting position is determined by the following method: determining the shooting target area selected by the user terminal in the shooting area, and determining the drone shooting position based on the range of the shooting target area.

[0011] Some embodiments of the present application can achieve fixed-point shooting of the target object by analyzing the shooting target area to obtain the drone shooting position, thereby improving the shooting quality and efficiency.

[0012] In some embodiments, generating a drone shooting position and shooting parameters corresponding to the shooting task includes: obtaining user positioning information, and determining a shooting target area based on the user positioning information; determining the drone shooting position and the shooting parameters that match the shooting target area, and the shooting parameters include: focal length, sensitivity, and white balance.

[0013] Some embodiments of the present application can automatically generate a matching drone shooting position and shooting parameters based on user location information, with a high degree of intelligence, providing users with a convenient photo-taking experience.

[0014] In some embodiments, after determining the drone shooting position and the shooting parameters that match the shooting target area, the method further includes: adjusting different shooting angles and / or shooting color parameters, wherein the shooting parameters corresponding to the different shooting angles or the same shooting angles are the same or different.

[0015] In some embodiments, the shooting mode is the follow-up shooting, wherein the shooting position of the drone is determined by the following method: identifying an image of the object to be followed in the shooting area; and when the image of the object to be followed matches a preset image of the target object, taking the position of the object to be followed in the image of the object to be followed as the shooting position of the drone.

[0016] Some embodiments of the present application obtain the shooting position of the drone by matching and identifying the image of the object to be followed with a preset image, thereby achieving follow-up shooting of the target object and ensuring the accuracy of the shooting.

[0017] In some embodiments, the method further includes: acquiring motion data of the target object; tracking the target object, and controlling the flight data of the drone based on the motion data.

[0018] In some embodiments, photographing the target object according to the shooting parameters and the drone shooting position to obtain shooting data includes: photographing the target object at the drone shooting position according to the shooting parameters to obtain a shot video; processing the shot video to generate wonderful and key video clips, wherein the wonderful and key video clips are the shooting data.

[0019] In some embodiments, the shooting task includes: a shooting time threshold, wherein the method further includes: monitoring the shooting duration and / or the drone power; confirming that the shooting duration exceeds the shooting time threshold, or the drone power is less than the power threshold, performing a return operation.

[0020] In some embodiments, after acquiring the shooting data, the method further includes: after confirming that the shooting task is completed, determining a landing point and performing a return landing operation, wherein the landing point is a hangar where the take-off task is performed or a hangar closest to the UAV.

[0021] In some embodiments, the shooting parameters are determined by the following method: analyzing at least the focal length of the camera and the environmental parameters of the shooting position of the drone to determine the shooting parameters.

[0022] Some embodiments of the present application determine shooting parameters by using camera focal length and environmental parameters, thereby improving the shooting quality of the drone.

[0023] In some embodiments, generating a drone shooting position and shooting parameters corresponding to the shooting task includes: obtaining a selected scene model area sent by the service platform, wherein the selected scene model area is determined by the user terminal in response to a selection operation of the user on the preview scene model and then sent to the service platform; determining the drone shooting position and shooting target area for shooting in the corresponding drone shooting service according to the selected scene model area.

[0024] In some embodiments of the present application, the user selects a selected scene model area for shooting on the preview scene model, and the drone can obtain the drone shooting position and shooting parameters based on the selected scene model area, thereby meeting the shooting needs of different users and improving the user experience.

[0025] In some embodiments, photographing the target object according to the shooting parameters and the drone shooting position to obtain shooting data includes: photographing the target object at the drone shooting position according to the shooting parameters to obtain shooting data to be confirmed; sending the shooting data to be confirmed to the service platform end, so that the service platform end sends the shooting data to be confirmed to the user terminal, so that the user terminal generates a confirmation instruction after confirming the shooting data to be confirmed; receiving the confirmation instruction sent by the service platform end to obtain the shooting data.

[0026] Some embodiments of the present application can meet user needs, ensure shooting quality, and improve user experience by obtaining final shooting data after the shooting data to be confirmed is submitted to the user terminal for confirmation.

[0027] On the second aspect, some embodiments of the present application provide a device for autonomous photography of scenic spots by drones, including: a task determination module, used to receive a photography task sent by a service platform, wherein the photography task is sent by a user terminal to the service platform, and the photography task is generated after the user terminal generates a photography service order, and the photography task includes: a photography mode and / or a photography area, and the photography mode includes: fixed-point photography and follow-up photography; a parameter determination module, used to generate a drone photography position and photography parameters corresponding to the photography task; a photography module, used to photograph a target object according to the photography parameters and the drone photography position, and obtain photography data, wherein the photography data is used to send to the user terminal.

[0028] In a third aspect, some embodiments of the present application provide a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, can implement the method described in any embodiment of the first aspect.

[0029] In a fourth aspect, some embodiments of the present application provide an electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor can implement a method as described in any embodiment of the first aspect when executing the program.

[0030] In a fifth aspect, some embodiments of the present application provide a computer program product, wherein the computer program product comprises a computer program, wherein the computer program, when executed by a processor, can implement the method described in any embodiment of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] In order to more clearly illustrate the technical solutions of some embodiments of the present application, the drawings required for use in some embodiments of the present application will be briefly introduced below. It should be understood that the following drawings only show some embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0032] Figure 1 System diagram for autonomous photography of scenic spots by drones provided in some embodiments of the present application;

[0033] Figure 2 One of the flow charts of the method for autonomous photography of scenic spots by drones provided in some embodiments of the present application;

[0034] Figure 3 A schematic diagram of autonomous shooting provided for some embodiments of the present application;

[0035] Figure 4 Flowchart 2 of a method for autonomous photography of scenic spots by drones provided in some embodiments of the present application;

[0036] Figure 5 A block diagram of the composition of a device for autonomous photography of scenic spots by drones provided in some embodiments of the present application;

[0037] Figure 6 A schematic diagram of an electronic device is provided for some embodiments of the present application. DETAILED DESCRIPTION

[0038] The technical solutions in some embodiments of the present application will be described below in conjunction with the drawings in some embodiments of the present application.

[0039] It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings. At the same time, in the description of this application, the terms "first", "second", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance.

[0040] In the related art, when drones are used in the field of photography, they are usually controlled and managed on a daily basis by professional operators. For users who have never used drones, since they do not know how to operate drones, they cannot obtain aerial photography data autonomously when there is a need for photography. In addition, there are many different types of drones and different regions have different photography requirements. If users want to conduct targeted learning, they need to pay a high time cost.

[0041] It can be seen from the above-mentioned related technologies that the time cost of existing drone photography is high and the degree of intelligence is low. It is unable to provide users with autonomous photography services, which reduces the user experience.

[0042] In view of this, some embodiments of the present application provide a method for autonomous photography of scenic spot drones, in which the drone of the method can interact with the user terminal of the user through the service platform end. The user can determine the shooting task on the user terminal and send it to the service platform end, and the service platform end will send it to the drone. After receiving the shooting task, the drone automatically generates the corresponding drone shooting position and shooting parameters, and finally shoots according to this to obtain shooting data, and sends it to the user terminal. Some embodiments of the present application can provide users with autonomous shooting services of scenic spot drones, which can achieve shooting without user autonomous control, can meet different user needs, and improve shooting efficiency and user experience.

[0043] The following is combined with Figure 1 The overall composition structure of the autonomous photography system provided by some embodiments of the present application is exemplified.

[0044] like Figure 1 As shown, some embodiments of the present application provide an autonomous shooting system, which includes: a drone hangar 100, a user terminal 200 and a service platform end 300. Among them, a first drone 110 is deployed in the drone hangar 100. The user can select a drone that provides autonomous shooting services for him through the user terminal 200, such as the user selects the first drone 110. After the selection is completed, the user terminal 200 can send the shooting task corresponding to the selected shooting service order to the service platform end 300, and the service platform end 300 sends the shooting task to the first drone 110. After receiving the shooting task, the first drone 110 can generate the drone shooting position and shooting parameters corresponding to the shooting task, and finally shoot the target object according to the drone shooting position and shooting parameters, obtain shooting data, and send the shooting data to the service platform end 300, and then send it to the user terminal 200 by the service platform end 300. Alternatively, the first drone 110 can also directly send the shooting data obtained by shooting to the user terminal 200. It should be understood that the embodiments of the present application are not limited to this.

[0045] In some embodiments of the present application, in addition to the drone hangar 100 Figure 1In addition to the first drone 110 listed, multiple drones may also be included. In other words, the number of drones can be set as needed; and the number of drone hangars 100 can also be set as needed, which is not specifically limited in the embodiments of the present application. Moreover, drones and drone hangars 100 can be deployed in scenic areas, tourist areas, or the deployment location can be selected near important attractions in the scenic area (e.g., within a preset distance range), etc., which is not specifically limited in the embodiments of the present application. By deploying drone hangars 100 in specific areas, the leasing and sharing of drones can be realized, providing users with autonomous shooting services and improving user experience.

[0046] In some embodiments of the present application, the user terminal 200 may be different types of mobile terminals, such as a smart phone, a tablet computer, etc.

[0047] The following is combined with Figure 2 The implementation process of autonomous drone photography of a scenic spot performed by any drone in the drone hangar 100 provided in some embodiments of the present application is exemplified.

[0048] Please see attached Figure 2 , Figure 2 A flow chart of a method for autonomous photography of a scenic spot by a drone is provided for some embodiments of the present application. The method for autonomous photography of a scenic spot by a drone includes:

[0049] S210, receiving a shooting task sent by a service platform, wherein the shooting task is sent by a user terminal to the service platform, the shooting task is generated after the user terminal generates a shooting service order, and the shooting modes include: fixed-point shooting and follow-up shooting.

[0050] For example, in some embodiments of the present application, the drone needs to receive a shooting task sent by the service platform end 300. Among them, the shooting mode in the shooting service order corresponding to the shooting task can be set on demand by the user in the user terminal 200 from different modes such as fixed-point shooting and follow-up shooting; the shooting mode can also be determined by the drone model itself, that is, the shooting mode applicable to the drone is pre-set, and the user's choice is unique. The shooting area can also be selected by the user in the user terminal 200, or it can be pre-set in the drone according to the specifications of the scenic area. The shooting range is used as the shooting area. It is understandable that the shooting task can also include the location information of the target object, the shooting time threshold, the number of shots, etc. The data contained in the shooting task can be flexibly adjusted, and the embodiments of the present application are not limited to this.

[0051] In some embodiments of the present application, the photography service order is generated by the software interface of the user terminal in response to the user's operation instruction.

[0052] In some embodiments, the user can generate a corresponding shooting task after obtaining a shooting service order by operating on the software interface corresponding to the user terminal 200 and send it to the service platform end 300. The service platform end 300 sends it to the drone. Specifically, the user connects to the drone autonomous shooting service through the client program (as a specific example of the software interface corresponding to the user terminal 200), and can select (as a specific example of the operation instruction) the drone and shooting mode of the service on the client program. After the selection is completed, the corresponding shooting service order is generated. After the user pays for the shooting service order, the shooting task can be generated accordingly. The user can obtain the shooting authority of the drone through this online method. At this time, the client program can send the shooting task corresponding to the shooting service order to the service platform end 300.

[0053] In other embodiments of the present application, the shooting task is determined after the user terminal recognizes the identification code.

[0054] In other embodiments, the user can obtain the shooting permission of the drone offline. After the user arrives at the drone rental (or sharing) area inside the scenic area, the user terminal 200 scans the QR code (as a specific example of the identification code) provided by the scenic area for identification. After identification, the corresponding drone hangar and drone can be matched according to the user's location information, and then the shooting service order is completed. Generate a shooting task. Alternatively, the user terminal 200 can also scan the QR code of the drone rental area to enter the small program or software interface of the drone management, and then the small program or software interface displays the drone hangar 100 that matches the user's location. The user can select the corresponding drone from the drone hangar 100, and select the shooting mode and / or shooting area to generate a shooting task. It should be understood that the identification code can also be a barcode or other string, and the embodiments of the present application are not limited to this.

[0055] It should be noted that some parameters in the shooting task may be selected by the user on the user terminal 200; some parameters may also be pre-set in the drone or related programs based on the type of the drone. The embodiments of the present application are not specifically limited here.

[0056] S220, generating a drone shooting position and shooting parameters corresponding to the shooting task.

[0057] For example, in some embodiments of the present application, the drone can autonomously adjust to obtain the drone's shooting position and shooting parameters.

[0058] In some embodiments of the present application, when the shooting mode is fixed-point shooting, S220 may include: determining a shooting target area selected by the user terminal in the shooting area, and determining the shooting position of the drone according to the range of the shooting target area.

[0059] For example, in some embodiments of the present application, the drone can use a detection algorithm to analyze the shooting target area selected by the user to obtain the drone shooting position.

[0060] In some embodiments of the present application, S220 may include: obtaining user positioning information, and determining a shooting target area based on the user positioning information; determining a shooting position of the drone and the shooting parameters that match the shooting target area, the shooting parameters including: focal length, sensitivity, and white balance.

[0061] For example, in some embodiments of the present application, the drone can automatically collect statistics of the surrounding shooting area based on the user's location information to obtain the shooting target area, and then determine the best drone shooting position. Figure 3 The autonomous shooting schematic diagram shown in the figure, by counting the check-in points of Internet celebrities taking photos (that is, the photo area), the check-in points of Internet celebrities form a rectangular area (as a specific example of the shooting target area), and the intersection position of the four vertex emission lines of the rectangular area is taken as the designated position (as a specific example of the drone shooting position), that is Figure 3 The position of the person (as a specific example of the target object) in the video. It can be understood that the optimal drone shooting position can also be obtained by analyzing the target positioning algorithm, which is not specifically limited in the embodiment of the present application.

[0062] In some embodiments of the present application, S220 may include: adjusting different shooting angles and / or shooting color parameters, wherein the shooting parameters corresponding to the different shooting angles or the same shooting angles are the same or different.

[0063] For example, in some embodiments of the present application, the drone can automatically adjust the shooting angle and shooting color parameters to improve the multi-angle shooting of the target object and improve the shooting quality. Among them, the shooting parameters corresponding to the shooting angle can be adjusted according to the actual situation, and the present application does not make specific limitations here.

[0064] In some other embodiments of the present application, when the shooting mode is follow-up shooting, S220 may include: identifying an image of the object to be followed in the shooting area; when the image of the object to be followed matches a preset image of the target object, using the position of the object to be followed in the image of the object to be followed as the shooting position of the drone.

[0065] For example, in some other embodiments of the present application, the user can upload a preset image of the target object to be photographed on the user terminal 200, and send the preset image to the drone through the service platform end 300. The drone collects the image of the object to be followed in the shooting area and matches the feature points with the preset image. If the match is successful, the corresponding drone shooting position can be obtained, so that follow-up shooting can be performed. Among them, the target object can be the user himself, and the preset image can be a face image; the target object can also be an animal, such as a pet dog or a pet cat, and the preset image can be a pet dog image or a pet cat image, etc. Specifically, the type of the target object and the preset image can be selected as needed, and the embodiments of the present application are not limited to this.

[0066] In some embodiments of the present application, during follow-up shooting, the method for autonomous shooting of scenic spot drones may also include: acquiring motion data of the target object; tracking the target object, and controlling drone flight data based on the motion data.

[0067] For example, in some embodiments of the present application, the drone can track and locate the target object in real time, analyze the target object's movement speed, acceleration, posture, etc. (as a specific example of motion data), and automatically adjust the drone flight data accordingly to achieve real-time target tracking and shooting to ensure shooting quality.

[0068] In some embodiments of the present application, S220 may include: analyzing at least the focal length of the camera and the environmental parameters of the shooting position of the drone to determine the shooting parameters.

[0069] For example, in some embodiments of the present application, the drone can determine the optimal shooting parameters in combination with the frame, the focal length of the gimbal camera, and the current weather conditions (as a specific example of environmental parameters) during shooting. Specifically, the optimal shooting parameters can be obtained by deploying relevant image processing algorithms in the drone to analyze the frame, the focal length of the camera, and the weather conditions.

[0070] In some other embodiments of the present application, S220 may include: obtaining a selected scene model area sent by the service platform, wherein the selected scene model area is determined by the user terminal in response to a selection operation performed by the user on the preview scene model and sent to the service platform; determining the drone shooting position and shooting target area for shooting in the corresponding drone shooting service according to the selected scene model area.

[0071] For example, in some other embodiments of the present application, the user can also select an area on the preview scene model displayed on the user terminal 200, and the drone can automatically identify the designated location and shooting parameters. After the user terminal 200 scans the code to enter the relevant interface, the interface can display the pre-stored three-dimensional model of the scenic area corresponding to the different scenic spots (as a specific example of the preview scene model). Before shooting, the user can preview the real scene of the scenic area through the three-dimensional model of the scenic area, and then the user terminal 200 can respond to the user's interception operation instruction, and determine the area of ​​interest that he wants to shoot or the area of ​​interest by taking a screenshot (as a specific example of selecting a scene model area), or determine the area of ​​interest by manual selection, clicking or gesture instructions, etc., and then the user terminal 200 sends the area of ​​interest to the service platform end 300, and the service platform end 300 sends it to the drone.

[0072] In one embodiment, the user terminal 200 displays a 3D preview screen (that is, a three-dimensional model of the scenic spot), and the user can select a suitable viewing angle on it, take a screenshot after previewing the shooting effect, and then the drone can obtain the shooting information corresponding to the current screenshot (that is, the user's area of ​​interest). The shooting information may include: the drone shooting position (that is, shooting position information), shooting target area and shooting parameters, etc. Among them, the implementation process of obtaining shooting information is as follows: the drone can first obtain the gimbal attitude information under the current screenshot according to the current screenshot obtained. Since the three-dimensional model includes the correspondence between the gimbal information, that is, the shooting attitude information, and the drone waypoint position information, after obtaining the gimbal attitude information, the waypoint position information corresponding to the gimbal attitude information is determined according to the correspondence, that is, the shooting position information. At this time, the drone obtains the waypoint shooting information corresponding to the current screenshot. The waypoint shooting information at least includes shooting position information and shooting parameters. The shooting parameters include shooting attitude information and camera zoom information. Among them, the shooting attitude information includes gimbal attitude or drone attitude. Among them, the gimbal attitude includes a first yaw angle, a first pitch angle and a first roll angle, and the drone attitude includes a second yaw angle, a second pitch angle and a second roll angle.

[0073] Specifically, the method for obtaining the shooting position information may include: obtaining the camera posture information carried by the current screenshot; converting the camera posture information carried by the current screenshot into drone posture information or gimbal posture; calculating the camera zoom information corresponding to the current screenshot according to the screen width; generating the shooting position information corresponding to the current screenshot according to the camera posture information, drone posture information and camera zoom information.

[0074] Among them, camera zoom information = (screen width / 1920)*5; this application obtains the camera attitude information, drone attitude information and camera zoom information of the current screenshot, generates waypoint shooting information corresponding to the current screenshot, and can improve the accuracy of shooting position positioning.

[0075] Optionally, the camera attitude information carried in the current screenshot is converted into drone attitude information, including: converting the arc information in the camera attitude information into the angle information in the drone attitude information; converting the angle information in the camera attitude information into the arc information in the drone attitude information.

[0076] Exemplarily, the angle information in the drone attitude information=the radian information in the camera attitude information*180 / π; the radian information in the drone attitude information=the angle information in the camera attitude information*π / 180.

[0077] In the embodiment of the present application, each parameter in the camera attitude information in the acquired screenshot is converted into drone attitude information, so that the shooting position information can be better obtained.

[0078] Optionally, calculating the camera zoom information corresponding to the current screenshot according to the screen width includes: calculating the camera zoom information corresponding to the current screenshot according to the screen width and a preset algorithm.

[0079] The current screenshot corresponding to the 3D model is mapped to the real-world shooting range, and the shooting target area corresponding to the range is determined.

[0080] In the embodiment of the present application, the camera zoom information corresponding to the current screenshot is calculated according to the screen width and the preset algorithm, and the waypoint shooting information corresponding to the current screenshot is generated according to the camera posture information, the drone posture information and the camera zoom information, so that the shooting location information can be better obtained.

[0081] S230: photograph the target object according to the photographing parameters and the photographing position of the drone to obtain photographing data, wherein the photographing data is used to be sent to the user terminal.

[0082] For example, after obtaining the above-mentioned shooting information, the drone flies to the corresponding shooting position and shoots according to the shooting parameters. In some embodiments of the present application, the drone can shoot after determining the designated position and the optimal shooting parameters, obtain photos and / or videos (as a specific example of shooting data), and send them to the user terminal 200. The drone can first send photos and / or videos to the service platform end 300, which will be sent to the user terminal 200 by the service platform end 300; or, the drone can directly send photos and / or videos to the user terminal 200. The embodiments of the present application are not specifically limited here.

[0083] In some embodiments of the present application, S230 may include: shooting the target object at the shooting position of the drone according to the shooting parameters to obtain a shot video; processing the shot video to generate wonderful and key video clips, and the wonderful and key video clips are the shooting data.

[0084] For example, in some embodiments of the present application, after the drone shoots the target object to obtain the shot video, the shot video can be edited to obtain a vlog (as a specific example of exciting and key video clips). For example, the shot video is streamlined by a video processing algorithm, a video editing tool, or a video extraction algorithm to obtain a vlog. In other embodiments, photos taken at different locations or different shooting angles can also be classified to obtain a photo collection (as a specific example of shooting data).

[0085] In some embodiments of the present application, S230 may include: photographing the target object at the shooting position of the drone according to the shooting parameters to obtain shooting data to be confirmed; sending the shooting data to be confirmed to the service platform end, so that the service platform end sends the shooting data to be confirmed to the user terminal, so that the user terminal generates a confirmation instruction after confirming the shooting data to be confirmed; receiving the confirmation instruction sent by the service platform end to obtain the shooting data.

[0086] For example, in some embodiments of the present application, the drone can send the photos and / or videos to be confirmed (as a specific example of the shooting data to be confirmed) taken during the shooting process to the service platform end 300 in real time, and the user can view the photos and / or videos to be confirmed sent back by the service platform end 300 in real time on the user terminal 200, or the drone directly sends them back to the user terminal 200 to confirm whether they meet their requirements. If the user confirms that it is correct, the user terminal 200 can feed back the confirmation instruction to the drone through the service platform end 300, and then obtain the photos and / or videos that meet the user's requirements. Finally, the photos and / or videos are sent to the user terminal 200 through the service platform end 300, so that the user can download and save them. In other embodiments, the photos and / or videos can also be stored in the service platform end 300 or other IoT intermediate platforms connected to the user terminal 200, and the user terminal 200 will download and save them uniformly after shooting.

[0087] In addition, in some embodiments of the present application, the shooting task includes: a shooting time threshold, wherein the method of autonomous shooting by a scenic drone also includes: monitoring the shooting time and / or the drone power; confirming that the shooting time exceeds the shooting time threshold, or the drone power is less than the power threshold, executing a return operation.

[0088] For example, in some embodiments of the present application, when a shooting task contains a shooting time threshold, the length of time the user uses the drone can be agreed upon. When the shooting time used exceeds the shooting time threshold (e.g., 1 hour, 2 hours, etc.), the drone can automatically perform a return operation. In some scenarios, the drone can also send a timed reminder message to the user terminal 200 through the service platform end 300. For example, the shooting time threshold selected by the user in the shooting service order of the user terminal 200 is 1 hour, and the drone can send a reminder message to the user terminal 200 through the service platform end 300 at a preset shooting time node of 45 minutes or 50 minutes, or the user can choose to remind the user by ringing or text message at a preset time node in the shooting service order, so that the user can pay attention to the shooting time. In addition, in order to enable the drone to shoot normally, its power can also be monitored, and the return operation is automatically performed when the power is less than the power threshold (e.g., 10%, 5%, etc.). In other embodiments, the shooting task can also include the number of shots, and the reminder method for setting the number of shots can be similar to the shooting time, which will not be repeated here. It should be understood that the specific reminder method can be flexibly set, and the embodiments of the present application are not limited to this.

[0089] It should be noted that the monitoring of the shooting duration and power of the drone can also be performed by the service platform 300. After the return requirement is met, the service platform 300 sends a return instruction to the drone, and the drone performs the return operation. The embodiment of the present application is not specifically limited here.

[0090] In some embodiments of the present application, after acquiring the shooting data, the method for autonomous shooting by a scenic drone also includes: after confirming that the shooting task is completed, determining a landing point and performing a return landing operation, wherein the landing point is a hangar that performs a take-off mission or a hangar closest to the drone.

[0091] For example, in some embodiments of the present application, after receiving the service platform 300 or detecting that the shooting time reaches the shooting time threshold, the drone can automatically confirm that the shooting task is completed. At this time, it can return to the drone hangar 100 where it took off, or locate the nearest hangar (that is, the hangar) for landing. The landing method can be landing through a preset path, or re-regulating the landing path based on positioning, which is not specifically limited in the embodiments of the present application.

[0092] The following is combined with Figure 4 The specific process of autonomous shooting provided by some embodiments of the present application is exemplified.

[0093] Please see attached Figure 4 , Figure 4A flow chart of a method for autonomous photography of scenic spots by drones provided in some embodiments of the present application.

[0094] The above process is explained below as an example.

[0095] S310, the user terminal generates a service order in response to the user's selection or input operation instruction.

[0096] S320: The user terminal generates a photographing service order and a photographing task in response to the user's payment operation.

[0097] S330, the user terminal sends a shooting task to the service platform.

[0098] S331, the service platform sends a shooting task to the drone.

[0099] S340, the drone generates a drone shooting position and shooting parameters corresponding to the shooting task.

[0100] S350, the drone shoots the target object at the drone shooting position according to the shooting parameters to obtain the shooting data to be confirmed.

[0101] S360: The drone sends the shooting data to be confirmed to the service platform.

[0102] S361, the service platform sends the shooting data to be confirmed to the user terminal.

[0103] S362, the service platform receives a confirmation instruction sent by the user terminal.

[0104] S370, the drone receives a confirmation instruction corresponding to the shooting data to be confirmed sent by the service platform, and uses the shooting data to be confirmed as the shooting data.

[0105] S380, the drone sends shooting data to the service platform.

[0106] S390, the service platform sends the shooting data to the user terminal.

[0107] It should be noted that the specific implementation process of S310 to S390 can refer to the method embodiment provided above. To avoid repetition, the detailed description is appropriately omitted here.

[0108] Please refer to Figure 5 , Figure 5 The block diagram of the composition of the device for autonomous photography of scenic spots by drones provided in some embodiments of the present application is shown. It should be understood that the device for autonomous photography of scenic spots by drones corresponds to the above method embodiment and can execute each step involved in the above method embodiment. The specific functions of the device for autonomous photography of scenic spots by drones can be found in the description above. To avoid repetition, the detailed description is appropriately omitted here.

[0109] Figure 5 The device for autonomous photography of scenic spots by unmanned aerial vehicles includes at least one software function module that can be stored in a memory in the form of software or firmware or solidified in the device for autonomous photography of scenic spots by unmanned aerial vehicles. The device for autonomous photography of scenic spots by unmanned aerial vehicles includes: a task determination module 410, used to receive a photography task sent by a service platform end, wherein the photography task is sent by a user terminal to the service platform end, and the photography task is generated after the user terminal generates a photography service order, and the photography task includes: a photography mode and / or a photography area, and the photography mode includes: fixed-point photography and follow-up photography; a parameter determination module 420, used to generate a drone photography position and photography parameters corresponding to the photography task; a photography module 430, used to photograph a target object according to the photography parameters and the drone photography position, and obtain photography data, wherein the photography data is used to send to the user terminal.

[0110] In some embodiments of the present application, the shooting service order is generated by the software interface of the user terminal in response to the user's operation instruction; or, the shooting service order is generated after the user terminal recognizes the identification code.

[0111] In some embodiments of the present application, the shooting mode is the fixed-point shooting, wherein the parameter determination module 420 is used to determine the shooting target area selected by the user terminal in the shooting area, and determine the drone shooting position based on the range of the shooting target area.

[0112] In some embodiments of the present application, the parameter determination module 420 is used to obtain user positioning information and determine the shooting target area based on the user positioning information; determine the drone shooting position and the shooting parameters that match the shooting target area, and the shooting parameters include: focal length, sensitivity and white balance.

[0113] In some embodiments of the present application, the parameter determination module 420 is used to adjust different shooting angles and / or shooting color parameters, wherein the shooting parameters corresponding to the different shooting angles or the same shooting angles are the same or different.

[0114] In some embodiments of the present application, the shooting mode is the follow-up shooting, wherein the parameter determination module 420 is used to identify the image of the object to be followed in the shooting area; when the image of the object to be followed matches the preset image of the target object, the position of the object to be followed in the image of the object to be followed is used as the shooting position of the drone.

[0115] In some embodiments of the present application, the parameter determination module 420 is used to obtain motion data of the target object; track the target object, and control the flight data of the drone based on the motion data.

[0116] In some embodiments of the present application, the parameter determination module 420 is used to analyze at least the camera focal length and the environmental parameters of the drone shooting position to determine the shooting parameters.

[0117] In some embodiments of the present application, the parameter determination module 420 is used to obtain the selected scene model area sent by the service platform, wherein the selected scene model area is determined by the user terminal in response to the user's selection operation on the preview scene model and sent to the service platform; the drone shooting position and shooting target area for shooting in the corresponding drone shooting service are determined according to the selected scene model area.

[0118] In some embodiments of the present application, the shooting module 430 is used to shoot the target object at the shooting position of the drone according to the shooting parameters to obtain a shot video; and process the shot video to generate wonderful and key video clips, and the wonderful and key video clips are the shooting data.

[0119] In some embodiments of the present application, the shooting module 430 is used to shoot the target object at the shooting position of the drone according to the shooting parameters to obtain the shooting data to be confirmed; send the shooting data to be confirmed to the service platform end, so that the service platform end sends the shooting data to be confirmed to the user terminal, so that the user terminal generates a confirmation instruction after confirming the shooting data to be confirmed; receive the confirmation instruction sent by the service platform end to obtain the shooting data.

[0120] In some embodiments of the present application, the shooting task includes: a shooting time threshold, a shooting module 430, which is used to monitor the shooting time and / or the drone power; when it is confirmed that the shooting time exceeds the shooting time threshold, or the drone power is less than the power threshold, a return operation is performed.

[0121] In some embodiments of the present application, the shooting module 430 is used to determine the landing point and perform a return landing operation after confirming the completion of the shooting task, wherein the landing point is the hangar where the take-off mission is performed or the hangar closest to the drone.

[0122] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the device described above can refer to the corresponding process in the aforementioned method, and will not be described in detail here.

[0123] Some embodiments of the present application further provide a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, can implement the operations of the method corresponding to any of the above methods provided in the above embodiments.

[0124] Some embodiments of the present application further provide a computer program product, which includes a computer program, wherein when the computer program is executed by a processor, it can implement the operations corresponding to any of the above methods provided in the above embodiments.

[0125] like Figure 6 As shown, some embodiments of the present application provide an electronic device 500, which includes: a memory 510, a processor 520, and a computer program stored in the memory 510 and executable on the processor 520, wherein the processor 520 can implement a method as described in any of the above embodiments when reading the program from the memory 510 through a bus 530 and executing the program.

[0126] Processor 520 can process digital signals and can include various computing structures, such as complex instruction set computer structure, reduced instruction set computer structure, or a structure that implements a combination of multiple instruction sets. In some examples, processor 520 can be a microprocessor.

[0127] The memory 510 may be used to store instructions executed by the processor 520 or data related to the execution of instructions. These instructions and / or data may include codes for implementing some or all functions of one or more modules described in the embodiments of the present application. The processor 520 of the disclosed embodiment may be used to execute instructions in the memory 510 to implement the method shown above. The memory 510 includes a dynamic random access memory, a static random access memory, a flash memory, an optical memory, or other memory known to those skilled in the art.

[0128] The above description is only an embodiment of the present application and is not intended to limit the scope of protection of the present application. For those skilled in the art, the present application may have various changes and variations. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application should be included in the scope of protection of the present application. It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in the subsequent drawings.

[0129] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0130] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

Claims

1. A method for autonomous photography of scenic spots by drones, characterized in that: include: Receive a shooting task sent by the service platform, wherein the shooting task is sent by a user terminal to the service platform, the shooting task is generated after the user terminal generates a shooting service order, and the shooting task includes: a shooting mode and a shooting area, the shooting mode includes: fixed-point shooting and follow-up shooting; the shooting area is captured by the user on the preview scene model; Generate a drone shooting position and shooting parameters corresponding to the shooting task; wherein the drone shooting position and the shooting parameters exist in the waypoint shooting information corresponding to the shooting area, and the shooting parameters include shooting posture information and camera zoom information; The target object in the shooting target area is photographed according to the shooting parameters and the shooting position of the drone to obtain shooting data, wherein the shooting data is used to send to the user terminal; the shooting target area is determined by the scene model area obtained by the user terminal in response to the user's operation instructions on the preview scene model, and the preview scene model represents the real scene of the scenic spot.

2. The method according to claim 1, characterized in that The shooting service order is generated after the software interface of the user terminal responds to the user's operation instruction; or, the shooting service order is generated after the user terminal recognizes the identification code.

3. The method according to claim 1 or 2, characterized in that The shooting mode is the fixed-point shooting, wherein the shooting position of the drone is determined by the following method: Determine the shooting target area selected by the user terminal in the shooting area, and determine the shooting position of the drone according to the range of the shooting target area.

4. The method according to claim 1 or 2, characterized in that: The generating of the drone shooting position and shooting parameters corresponding to the shooting task includes: Acquire user location information, and determine a shooting target area based on the user location information; Determine the drone shooting position and the shooting parameters that match the shooting target area, wherein the shooting parameters include: focal length, sensitivity, and white balance.

5. The method according to claim 4, characterized in that After determining the drone shooting position and the shooting parameters that match the shooting target area, the method further includes: Adjust different shooting angles and / or shooting color parameters, wherein the shooting parameters corresponding to the different shooting angles or the same shooting angles are the same or different.

6. The method according to claim 1 or 2, characterized in that: The shooting mode is the follow-up shooting, wherein the shooting position of the drone is determined by the following method: Identifying an image of an object to be followed within the shooting area; When the image of the object to be followed matches the preset image of the target object, the position of the object to be followed in the image of the object to be followed is used as the shooting position of the drone.

7. The method according to claim 6, characterized in that The method further comprises: Acquiring motion data of the target object; The target object is tracked, and the flight data of the UAV is controlled according to the motion data.

8. The method according to claim 1 or 2, characterized in that: The shooting parameters are determined by the following method: At least the camera focal length and the environmental parameters of the shooting position of the unmanned aerial vehicle are analyzed to determine the shooting parameters.

9. The method according to claim 1 or 2, characterized in that: The generating of the drone shooting position and shooting parameters corresponding to the shooting task includes: Acquire the selected scene model area sent by the service platform, wherein the selected scene model area is determined by the user terminal in response to a selection operation of the user on the preview scene model and sent to the service platform; The drone shooting position and the shooting target area corresponding to the shooting in the drone shooting service are determined according to the selected scene model area.

10. The method according to claim 1 or 2, characterized in that: The step of photographing the target object according to the photographing parameters and the photographing position of the drone to obtain photographing data includes: Shooting the target object at the shooting position of the drone according to the shooting parameters to obtain a shot video; The shot video is processed to generate wonderful and key video clips, where the wonderful and key video clips are the shot data.

11. The method according to claim 1 or 2, characterized in that: The step of photographing the target object according to the photographing parameters and the photographing position of the drone to obtain photographing data includes: photographing the target object at the photographing position of the drone according to the photographing parameters to obtain photographing data to be confirmed; Sending the to-be-confirmed shooting data to the service platform end, so that the service platform end sends the to-be-confirmed shooting data to the user terminal, so that the user terminal generates a confirmation instruction after confirming the to-be-confirmed shooting data; The confirmation instruction sent by the service platform is received to obtain the shooting data.

12. The method according to claim 1 or 2, characterized in that: The shooting task includes: a shooting time threshold, wherein the method further includes: Monitor shooting time and / or drone battery level; When it is confirmed that the shooting time exceeds the shooting time threshold, or the battery level of the drone is less than the battery level threshold, a return operation is performed.

13. The method according to claim 1 or 2, characterized in that: After acquiring the shooting data, the method further includes: After confirming that the shooting mission is completed, the landing point is determined and the return landing operation is performed, wherein the landing point is the hangar where the take-off mission is performed or the hangar closest to the UAV.

14. A device for autonomous photography of scenic spots by drones, characterized in that: The device is used to perform the method according to claim 1, comprising: A task determination module is used to receive a shooting task sent by a service platform, wherein the shooting task is sent by a user terminal to the service platform, and the shooting task is generated after the user terminal generates a shooting service order, and the shooting task includes: a shooting mode and a shooting area, and the shooting mode includes: fixed-point shooting and follow-up shooting; A parameter determination module, used to generate a drone shooting position and shooting parameters corresponding to the shooting task; The shooting module is used to shoot the target object according to the shooting parameters and the shooting position of the drone to obtain shooting data, wherein the shooting data is used to send to the user terminal.

15. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, wherein the computer program executes the method according to any one of claims 1 to 13 when executed by a processor.

16. An electronic device, characterized in that: The method comprises a memory, a processor, and a computer program stored in the memory and running on the processor, wherein the computer program executes the method according to any one of claims 1 to 13 when being run by the processor.

Images