Video shooting method and device and electronic equipment

Abstract

The invention discloses a video shooting method and device and electronic equipment, and belongs to the technical field of electronic equipment. The video shooting method comprises the following steps: receiving video shooting input of a shooting preview interface; in response to the video shooting input, shooting a video, and displaying first prompt information on the shooting preview interface based on the first shooting information in the shooting process, the first prompt information being used for prompting at least one of the following items: a planned shooting path and at least one planned moving speed of a user on the planned shooting path; the first shooting information is determined based on the geographical location information of the user or the shooting demand information of the user.

Description

Technical Field

[0001] This application belongs to the field of electronic equipment technology, specifically relating to a video shooting method, apparatus, and electronic equipment. Background Technology

[0002] Currently, with the continuous improvement of electronic device functions, it has become increasingly common to use electronic devices to take photos or videos.

[0003] In related technologies, different shooting methods, such as composition and / or camera movement, can be selected for different shooting scenarios during video recording to improve the display effect of videos shot by electronic devices. For example, in portrait shooting scenarios, it is usually necessary to highlight the main subject in the photo or video. Therefore, electronic devices can use a composition method that keeps the main subject in the center and a camera movement that pans around the subject from a low angle to achieve the effect of focusing and highlighting the subject. Similarly, in long-distance shooting scenarios, electronic devices can use a camera movement that first obscures and then rises to shoot the distant view to emphasize the sense of depth in the background. Choosing the wrong composition and camera movement during shooting may result in a lack of focus and depth in the final product, failing to achieve artistic beauty.

[0004] However, in related technologies, during the video shooting process, users usually need to adjust the shooting mode themselves to improve the display effect of the captured photos or videos, making the user operation relatively cumbersome. Summary of the Invention

[0005] The purpose of this application is to provide a video shooting method, apparatus, and electronic device that can improve the ease of user operation.

[0006] In a first aspect, embodiments of this application provide a video shooting method, the method comprising:

[0007] Displays the shooting preview interface;

[0008] Receive video capture input to the shooting preview interface;

[0009] In response to the video shooting input, a video is captured, and during the shooting process, a first prompt message is displayed on the shooting preview interface based on the first shooting information. The first prompt message is used to prompt at least one of the following: a planned shooting path, and at least one planned movement speed of the user on the planned shooting path.

[0010] The first shooting information is determined based on the user's geographical location information or the user's shooting needs information.

[0011] Secondly, embodiments of this application provide a video recording device, the device comprising:

[0012] The display module is used to display the shooting preview interface;

[0013] The receiving module is used to receive video capture input to the shooting preview interface displayed by the display module;

[0014] The shooting module is used to shoot video in response to the video shooting input received by the receiving module, and during the shooting process, based on the first shooting information, to display the first prompt information on the shooting preview interface. The first prompt information is used to prompt at least one of the following: a planned shooting path, and at least one planned movement speed of the user on the planned shooting path.

[0015] The first shooting information is determined based on the user's geographical location information or the user's shooting needs information.

[0016] Thirdly, embodiments of this application provide an electronic device including a processor and a memory, wherein the memory stores a program or instructions executable on the processor, and the program or instructions, when executed by the processor, implement the steps of the video capture method as described in the first aspect.

[0017] Fourthly, embodiments of this application provide a readable storage medium storing a program or instructions that, when executed by a processor, implement the steps of the video capture method as described in the first aspect.

[0018] Fifthly, embodiments of this application provide a chip, the chip including a processor and a communication interface, the communication interface being coupled to the processor, the processor being used to run programs or instructions to implement the video shooting method as described in the first aspect.

[0019] In a sixth aspect, embodiments of this application provide a computer program product stored in a storage medium, which is executed by at least one processor to implement the video capture method as described in the first aspect.

[0020] In this embodiment, a video shooting input is received to the shooting preview interface; in response to the video shooting input received by the receiving module, a video is shot, and during the shooting process, based on first shooting information, a first prompt is displayed on the shooting preview interface. The first prompt is used to prompt at least one of the following: a planned shooting path and at least one planned movement speed of the user on the planned shooting path; the first shooting information is determined based on the user's geographical location information or the user's shooting needs information. Thus, the electronic device can display prompts on the shooting preview interface during the shooting process, prompting at least one of the planned shooting path and at least one planned movement speed of the user on the planned shooting path, enabling the user to shoot video along the planned shooting path according to the prompted shooting path and at least one of the planned movement speeds in the prompt, thereby effectively simplifying user operation. Attached Figure Description

[0021] Figure 1 This is a flowchart illustrating a video capture method provided in some embodiments of this application;

[0022] Figure 2 This is a flowchart illustrating a video capture method provided in some embodiments of this application;

[0023] Figure 3 This is a flowchart illustrating a video capture method provided in some embodiments of this application;

[0024] Figure 4 These are schematic diagrams of the shooting information extraction models provided in some embodiments of this application;

[0025] Figure 5 This is a flowchart illustrating a video capture method provided in some embodiments of this application;

[0026] Figure 6A These are schematic diagrams of the shooting preview interface provided in some embodiments of this application;

[0027] Figure 6B These are schematic diagrams of the shooting preview interface provided in some embodiments of this application;

[0028] Figure 6C These are schematic diagrams of the shooting preview interface provided in some embodiments of this application;

[0029] Figure 6D These are schematic diagrams of the shooting preview interface provided in some embodiments of this application;

[0030] Figure 7 These are schematic diagrams of the video capturing device provided in some embodiments of this application;

[0031] Figure 8 These are schematic diagrams of the video capturing device provided in some embodiments of this application;

[0032] Figure 9 These are schematic diagrams of the structure of electronic devices provided in some embodiments of this application;

[0033] Figure 10 These are schematic diagrams of the hardware structure of electronic devices provided in some embodiments of this application. Detailed Implementation

[0034] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0035] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0036] The terms "at least one," "at least one," etc., used in the specification and claims of this application refer to any one, any two, or a combination of two or more of the included items. For example, at least one of a, b, and c can mean: "a," "b," "c," "a and b," "a and c," "b and c," and "a, b, and c," where a, b, and c can be single or multiple. Similarly, "at least two" refers to two or more items, and its meaning is similar to that of "at least one."

[0037] The video shooting method provided in this application will be described in detail below with reference to the accompanying drawings, through specific embodiments and application scenarios.

[0038] The video shooting method provided in this application can be applied to video shooting scenarios.

[0039] For example, in a mountain scene, User A wants to shoot a magnificent video with towering mountains and a grand, distant view. Or, in a nighttime cityscape scene, User B wants to shoot a video with urban scenery and flashing neon lights.

[0040] The video shooting method provided in this application can be executed by a video shooting device. Exemplarily, the video shooting device can be an electronic device, or a functional component or entity within that electronic device. The following will use an electronic device as an example to illustrate the video shooting method provided in this application.

[0041] Figure 1 This is a flowchart illustrating the video shooting method provided in the embodiments of this application, as shown below. Figure 1 As shown, the video shooting method provided in this application embodiment may include the following steps 101 and 102.

[0042] Step 101: The electronic device receives video capture input to the shooting preview interface.

[0043] In some embodiments of this application, the electronic device may display the aforementioned shooting preview interface upon receiving a second input from the user regarding the shooting icon.

[0044] In some embodiments of this application, the aforementioned shooting icon can be the icon of a shooting application on an electronic device.

[0045] In some embodiments of this application, the aforementioned second input can be user click input, swipe input, press input, voice input, gesture input, or other feasible inputs. This application does not limit this type of input.

[0046] In some embodiments of this application, the above-mentioned gesture input may include, but is not limited to, at least one of the following: click gesture, swipe gesture, drag gesture, pressure recognition gesture, long press gesture, area change gesture, double press gesture, double tap gesture, specific gesture input or other possible gesture inputs. The specific gesture input form can be determined according to actual needs, and is not limited in some embodiments.

[0047] In some embodiments of this application, the above-mentioned click input can be single-click input, double-click input, or any number of clicks, or it can be long-press input or short-press input. In some embodiments, this is not limited.

[0048] In some embodiments of this application, the above-mentioned sliding input can be a sliding input in any direction, such as sliding up, sliding down, sliding left, or sliding right, etc., and in some embodiments, this is not limited.

[0049] In some embodiments of this application, the shape of the above-mentioned shooting icon can be any possible shape such as a circle, rectangle, triangle, rhombus, ring or polygon, which can be determined according to actual usage requirements. This embodiment of the invention does not limit the shape.

[0050] In some embodiments of this application, after the electronic device receives the second input, it determines that the user intends to shoot while displaying the shooting preview interface. Therefore, the electronic device can obtain the user's geographical location information or display a prompt box on the shooting preview interface to prompt the user to input shooting requirements, and then determine the first shooting information for shooting video based on the geographical location information or the shooting requirement information corresponding to the user's input shooting requirements.

[0051] In some embodiments of this application, the electronic device can receive video capture input to the shooting controls on the shooting preview interface.

[0052] In some embodiments of this application, the shooting controls described above are used to shoot video.

[0053] In some embodiments of this application, the shape of the above-mentioned shooting control can be any possible shape such as a circle, rectangle, triangle, rhombus, ring or polygon, which can be determined according to actual usage requirements. This embodiment of the invention does not limit the shape.

[0054] In some embodiments of this application, the video capture input can be user click input, swipe input, press input, voice input, gesture input, or other feasible inputs, and this application does not limit this.

[0055] Step 102: The electronic device responds to the video capture input, captures a video, and during the capture process, displays a first prompt message on the capture preview interface based on the first capture information.

[0056] In some embodiments of this application, the aforementioned first prompt information is used to prompt at least one of the following: a planned shooting path, and at least one planned movement speed of the user on the planned shooting path.

[0057] In some embodiments of this application, the planned shooting path can be a path consisting of a planned initial shooting position, a planned ending shooting position, and at least one intermediate shooting position between the planned initial shooting position and the planned ending shooting position.

[0058] In some embodiments of this application, the first shooting information is determined based on the user's geographical location information or the user's shooting needs information.

[0059] In some embodiments of this application, the aforementioned first notification information includes at least one of the following:

[0060] Path markings for the planned shooting path from the initial planned shooting position to the planned shooting end position;

[0061] The user has a speed indicator for at least one planned movement speed along the planned shooting path.

[0062] In some embodiments of this application, the aforementioned path identifier can be text, symbols, images, etc., used to indicate the planned shooting path from the initial planned shooting position to the final planned shooting position. The specific path identifier can be determined according to actual needs, and this embodiment does not limit it here.

[0063] In some embodiments of this application, the speed indicator can be text, symbols, images, etc., used to indicate at least one planned movement speed of the user on the planned shooting path. The specific speed can be determined according to actual needs, and this embodiment does not limit it here.

[0064] In some embodiments of this application, the first shooting information mentioned above includes the shooting path information of the planned shooting path and the at least one planned movement speed.

[0065] In some embodiments of this application, the first shooting information mentioned above further includes at least one of the following: shooting location information, at least one shooting angle, shutter speed, field of view, and magnification.

[0066] In some embodiments of this application, the first shooting information mentioned above includes at least one planned shooting angle, and the at least one planned shooting angle includes the planned shooting angle from each of the at least one shooting point in the planned shooting path; combined with Figure 1 ,like Figure 2 As shown, the video shooting method provided in this application embodiment may further include the following step 103:

[0067] Step 103: During the shooting process, the electronic device controls the gimbal to rotate and shoot according to at least one planned shooting angle.

[0068] In some embodiments of this application, each shooting point in the above-described planned shooting path can be a shooting location.

[0069] In some embodiments of this application, the first of the at least one shooting points can be the planned initial shooting position, the last of the at least one shooting points can be the planned ending shooting position, and the other shooting points can be other planned shooting positions in the planned shooting path besides the planned initial shooting position and the planned ending shooting position.

[0070] In some embodiments of this application, the aforementioned gimbal is used to fix electronic devices.

[0071] In some embodiments of this application, each of the at least one planned shooting angle can be a rotation angle of the gimbal during the shooting process.

[0072] In some embodiments of this application, a rotation angle of the gimbal may include the pitch axis angle, traverse axis angle, and yaw axis angle of the gimbal.

[0073] In some embodiments of this application, during the shooting process, when the electronic device determines that the user has arrived at each shooting point in the above shooting path in sequence, the electronic device can control the gimbal to rotate to the planned shooting angle at that shooting point, so as to drive the electronic device to rotate and shoot.

[0074] In some embodiments of this application, during the shooting process, the electronic device can also shoot video according to at least one of shutter speed, field of view, and magnification.

[0075] In the video shooting method provided in this application embodiment, a video shooting input is received to a shooting preview interface; in response to the video shooting input received by the receiving module, a video is shot; and during the shooting process, based on first shooting information, a first prompt message is displayed on the shooting preview interface. The first prompt message is used to prompt at least one of the following: a planned shooting path, and at least one planned movement speed of the user on the planned shooting path; the first shooting information is determined based on the user's geographical location information or the user's shooting needs information. Thus, the electronic device can display prompt messages on the shooting preview interface during the shooting process, prompting at least one of the planned shooting path and at least one planned movement speed of the user on the planned shooting path, enabling the user to shoot video along the planned shooting path according to the prompt message and at least one of the planned movement speeds in the prompt message, thereby effectively simplifying user operation.

[0076] In some embodiments of this application, combined with Figure 1 ,like Figure 3 As shown, prior to step 101 above, the video shooting method provided in this application embodiment may further include the following steps 104 and 105:

[0077] Step 104: The electronic device obtains the user's geographical location information.

[0078] In some embodiments of this application, the electronic device can obtain the user's geographical location information through the positioning module.

[0079] In some embodiments of this application, the positioning module can be a GPS positioning module, a GNSS positioning module, or other positioning modules. The specific module can be determined according to actual needs, and no specific limitation is made here.

[0080] Step 105: The electronic device retrieves the first shooting information that matches the geographical location information from the shooting parameter database.

[0081] In some embodiments of this application, the first shooting information mentioned above includes at least shooting path information and shooting location information.

[0082] In some embodiments of this application, the above-mentioned shooting parameter database includes at least one shooting information, each shooting information including at least one of the following: a shooting location information, a shooting path information, and at least one shooting angle. Each shooting location information indicates a shooting location, each shooting path information corresponds to a shooting location information, and a shooting path information is a preset shooting path information when shooting at the shooting location indicated by the corresponding shooting location information.

[0083] In some embodiments of this application, the above-mentioned shooting location information may include the shooting location name and the latitude and longitude information of the shooting location.

[0084] In some embodiments of this application, the user's geographic location information may include the latitude and longitude information of the user's geographic location.

[0085] In some embodiments of this application, the electronic device can calculate the distance between the user's geographical location and each shooting location based on the latitude and longitude information of the user's geographical location and the latitude and longitude information of each shooting location, then determine the shooting location closest to the user's geographical location, and then use the shooting information corresponding to the shooting location as the aforementioned first shooting information.

[0086] In some embodiments of this application, prior to step 101 above, the video capture method provided in this application may further include the following steps 106 to 108:

[0087] Step 106: The electronic device obtains the user's geographical location information.

[0088] It should be noted that the description of step 106 above can be referred to the explanation of step 104 above. To avoid repetition, this embodiment will not repeat it here.

[0089] Step 107: The electronic device performs a 3D model of the first shooting location based on the geographic description information of the first shooting location that matches the geographic location information, thereby obtaining a 3D model of the first shooting location.

[0090] In some embodiments of this application, the first shooting location of the electronic device can be the shooting location closest to the user's geographical location indicated by the geographical location information.

[0091] In some embodiments of this application, the electronic device can obtain geographic information of at least one shooting location from a cloud-based terrain database, each geographic information including the latitude and longitude information and geographic description information of the shooting location.

[0092] In some embodiments of this application, the geographical description information of each shooting location can be the latitude and longitude information, altitude information, and terrain information of multiple locations evenly distributed within a preset range around the shooting location.

[0093] In some embodiments of this application, the terrain information for each location is used to indicate the terrain of that location, which may include, but is not limited to, at least one of the following:

[0094] Mountains, lakes, roads, forests, and tall buildings.

[0095] In some embodiments of this application, the electronic device can calculate the distance between the user's geographical location and each shooting location based on the latitude and longitude information of the user's geographical location and the latitude and longitude information of each shooting location, and then determine the first shooting location that is closest to the user's geographical location.

[0096] In some embodiments of this application, after the electronic device determines the first shooting location that is closest to the user's geographical location, it can obtain the geographical description information of the first shooting location from the cloud terrain database, namely the latitude and longitude information, altitude information and terrain information of multiple locations evenly distributed within a preset range around the first shooting location, and perform three-dimensional modeling on the first shooting location based on the latitude and longitude information, altitude information and terrain information of multiple locations evenly distributed within the preset range around the first shooting location to obtain a three-dimensional model of the first shooting location. The three-dimensional model can be a three-dimensional model of the preset range area including the first shooting location.

[0097] Step 108: The electronic device inputs the model data of the 3D model into the shooting information to extract the model and outputs the first shooting information.

[0098] In some embodiments of this application, the structure of the above-described image information extraction model can be a GAN (Generative Adversarial Networks) structure or a Transformer structure.

[0099] In some embodiments of this application, the above-described shooting information extraction model is used to extract the first shooting information of the first shooting location from the above-described three-dimensional model.

[0100] In some embodiments of this application, the first shooting information may be the best shooting information for the first shooting location, including the shooting path information of the best shooting path for the first shooting location, the best at least one moving speed on the best shooting path, the best shooting angle, the best shooting shutter speed, the best shooting field of view, and the best shooting magnification.

[0101] In some embodiments of this application, such as Figure 4 As shown, the image capture information extraction model 40 may include a feature extraction module 401, an encoding module 402, an attention module 403, and a decoding module 404. The feature extraction module 401 is used to extract features from the 3D model data of the first shooting location, obtaining at least one of a first feature data and a second feature data from the 3D model data. The first feature data is point cloud feature data, and the second feature data is mesh feature data.

[0102] In some embodiments of this application, when the 3D model data includes point cloud 3D model data, the output of the feature extraction module 401 may include first feature data. When the 3D model data includes mesh 3D model data, the output of the feature extraction module 401 may include second feature data.

[0103] In some embodiments of this application, the electronic device may stitch together the first feature data, the second feature data, and the location data of the first shooting location randomly selected by the electronic device from the three-dimensional model of the first shooting location, when the output of the feature extraction module 401 includes the first feature data and the second feature data, to obtain stitched data.

[0104] In some embodiments of this application, the electronic device can input spliced ​​data into the encoding module 402, encode the spliced ​​data through the encoding module 402, and output encoded data.

[0105] In some embodiments of this application, the electronic device can input the encoded data into the attention module 403, perform attention operations on the spliced ​​encoded data through the attention module 403, and output the encoded data after attention operations.

[0106] In some embodiments of this application, the electronic device can input the encoded data after attention calculation into the decoding module, and the decoding module can decode the encoded data after attention calculation to obtain the aforementioned first shooting information.

[0107] In some embodiments of this application, prior to step 108 above, the video capture method provided in this application may further include the following steps 109 to 111:

[0108] Step 109: The electronic device acquires the training set.

[0109] In some embodiments of this application, the training set includes at least one training sample and at least one sample label.

[0110] In some embodiments of this application, each training sample in the at least one training sample is a three-dimensional model data of a shooting location, and each sample label in the at least one sample label is shooting information corresponding to a shooting location.

[0111] In some embodiments of this application, each of the above sample tags may include optimal shooting information for a shooting location, which includes shooting path information of the optimal shooting path at the shooting location, at least one optimal moving speed on the optimal shooting path, at least one optimal shooting angle, optimal shooting shutter speed, optimal shooting field of view, and optimal shooting magnification.

[0112] Step 110: The electronic device inputs the first training sample into the shooting information extraction model and outputs at least one piece of shooting information and at least one score.

[0113] In some embodiments of this application, before the electronic device inputs the first training sample into the image information extraction model, it can perform data augmentation on the first training sample. For example, it can simulate lighting, weather, occlusion, etc., on the 3D model corresponding to the first training sample to increase the diversity of the 3D model data.

[0114] In some embodiments of this application, the electronic device can input the data-enhanced first training sample into the shooting information extraction model and output at least one piece of shooting information and at least one score.

[0115] In some embodiments of this application, each piece of shooting information may include shooting location information corresponding to the 3D model, a shooting path information, at least one movement speed, at least one shooting angle, shutter speed, shooting field of view, and shooting magnification. The aforementioned shooting path information is the shooting path information when shooting at that shooting location, and the at least one movement speed can be the user's movement speed on the shooting path indicated by the shooting path information.

[0116] In some embodiments of this application, each score is the score of one of the above-mentioned at least one shooting information, and the above-mentioned at least one shooting information includes a first sample label corresponding to the above-mentioned first training sample.

[0117] In some embodiments of this application, the score for each piece of shooting information can be the confidence level of that shooting information.

[0118] In some embodiments of this application, for each piece of shooting information, the electronic device may employ a virtual camera to capture at least one video frame on the shooting path indicated by the shooting path information in the shooting information, according to at least one of the following: at least one moving speed, at least one shooting angle, shutter speed, shooting field of view, and shooting magnification. Then, a pre-trained visual aesthetic model is used to evaluate the composition score of each video frame in the at least one video frame.

[0119] In some embodiments of this application, the electronic device can also determine whether there are obstacles on the shooting path indicated by the shooting path information in the shooting information based on the three-dimensional model data of the shooting location, that is, whether the virtual camera will collide with the obstacles when shooting on the shooting path.

[0120] In some embodiments of this application, the electronic device may also employ a target detection model to detect the subject in each video frame of at least one video frame, and determine whether the position of the subject in the corresponding video frame conforms to the rule of thirds or the golden ratio.

[0121] In some embodiments of this application, the electronic device can also calculate the motion acceleration between each two adjacent video frames based on the two moving speeds corresponding to each two adjacent video frames in at least one video frame, and determine whether there is shaking during the shooting process of at least one video frame.

[0122] In some embodiments of this application, the electronic device can adjust the model parameters of the channel that outputs the shooting information based on the composition score of each video frame in at least one video frame, the detection results of whether the virtual camera will collide with obstacles when shooting on the shooting path, whether the position of the subject in each video frame in the corresponding video frame conforms to the rule of thirds or the golden ratio, and the detection results of whether there is shaking during the shooting process of at least one video frame. The model parameters can be the weights of the channel that outputs the shooting information.

[0123] For example, if the composition score of each video frame in at least one video frame is greater than or equal to a first threshold, the weight of the channel outputting the shooting information is increased by a second threshold; or if the composition score of more than a first proportion of video frames in at least one video frame is greater than or equal to a third threshold, the weight of the channel outputting the shooting information is increased by a second threshold. If the composition score of each video frame in at least one video frame is less than a fourth threshold, the score corresponding to the shooting information is decreased by a second threshold; or if the composition score of more than a first proportion of video frames in at least one video frame is less than or equal to a fifth threshold, the weight of the channel outputting the shooting information is decreased by a second threshold.

[0124] It should be noted that the process by which the electronic device adjusts the weight of the channel that outputs the shooting information based on the detection results of whether the virtual camera will collide with obstacles when shooting on the shooting path, whether the position of the main body in each video frame in the corresponding video frame conforms to the rule of thirds or the golden ratio, and whether there is shaking during the shooting of at least one video frame is similar to the process by which the electronic device adjusts the weight of the channel that outputs the shooting information based on the composition score of each video frame in at least one video frame. This embodiment will not be described in detail here.

[0125] Step 111: The electronic device adjusts the model parameters of the shooting information extraction model until the score of the first sample label is greater than or equal to the first threshold.

[0126] In some embodiments of this application, since the first sample label represents the optimal shooting information for the shooting location corresponding to the first sample, the combined result of the composition score corresponding to at least one video frame captured by the electronic device using a virtual camera along the optimal shooting path of the optimal shooting information, the collision detection result of the virtual camera with obstacles while shooting along the optimal shooting path, whether the position of the main body in each video frame captured along the optimal shooting path conforms to the rule of thirds or the golden ratio, and the detection result of whether there is shaking during the shooting process of at least one video frame captured along the optimal shooting path, is the best among all shooting information. Therefore, during the process of training the model parameters of the entire shooting information extraction model, the electronic device will continuously increase the weight of the channel that outputs the optimal shooting information, thereby making the score of the output optimal shooting information higher and higher. Thus, the electronic device can complete the training process of the shooting information extraction model when the score of the optimal shooting information is greater than or equal to a first threshold.

[0127] In some embodiments of this application, the first training sample can be any of the at least one training sample mentioned above.

[0128] In some embodiments of this application, the score of the first sample label is greater than or equal to the first threshold, indicating that when the shooting information extraction model extracts at least one shooting path information of the shooting location corresponding to the first training sample, the confidence level of the shooting path information of the best shooting path of the shooting location is greater than or equal to the first threshold. That is, when the shooting information extraction model extracts at least one shooting information of each shooting location in at least one training sample, the confidence level of the best shooting information of the shooting location is greater than or equal to the first threshold. Therefore, the shooting information extraction model can accurately extract the best shooting information of each shooting location in at least one training sample, and then the shooting information extraction model is trained and can be used to extract the shooting information of the first shooting location.

[0129] In some embodiments of this application, prior to step 101 above, the video recording method of this application may further include the following steps 112 to 114:

[0130] Step 112: The electronic device displays a prompt box on the shooting preview interface.

[0131] In some embodiments of this application, the above-mentioned prompt box is used to prompt the user to input the user's shooting requirements.

[0132] In some embodiments of this application, the shape of the above-mentioned prompt box can be any possible shape such as a circle, rectangle, triangle, rhombus, ring or polygon, and can be determined according to actual usage requirements. This embodiment of the present invention does not limit the shape.

[0133] Step 113: The electronic device receives the user's first input to the prompt box.

[0134] In some embodiments of this application, the first input mentioned above can be a user's click input, swipe input, press input, voice input, gesture input, or other feasible inputs, and this application does not limit this.

[0135] Step 114: The electronic device responds to the first input and performs semantic recognition on the input information of the first input to obtain the shooting requirement information.

[0136] In some embodiments of this application, the aforementioned shooting requirement information includes descriptive information describing the orientation of at least one planned shooting location in the planned shooting path.

[0137] In some embodiments of this application, the input information may be text information or language information.

[0138] In some embodiments of this application, the electronic device may use a Natural Language Processing (NLP) model to perform semantic recognition on the above-mentioned input information to obtain the above-mentioned shooting requirement information.

[0139] In some embodiments of this application, prior to step 101 above, the video recording method of this application may further include the following steps 115 and 116, and step 101 above can be implemented by the following step 101a:

[0140] Step 115: The electronic device displays a path marker on the shooting preview interface, indicating the navigation path to the planned initial shooting location.

[0141] In some embodiments of this application, the aforementioned path identifier is used to indicate to the user the planned initial shooting location.

[0142] In some embodiments of this application, the navigation path described above can be a navigation path from the user's geographic location to the planned initial shooting location.

[0143] In some embodiments of this application, the aforementioned path identifier can be text, symbols, images, etc., used to indicate the navigation path from the user's geographical location to the planned initial shooting location. The specific path identifier can be determined according to actual needs, and this embodiment does not limit it here.

[0144] Step 116: Once the electronic device confirms that the user has arrived at the planned initial shooting position, it displays a second prompt message on the shooting preview interface and controls the gimbal to rotate to the first planned initial shooting angle.

[0145] In some embodiments of this application, the aforementioned second prompt information is used to prompt the user to turn to the second planned shooting initial angle.

[0146] In some embodiments of this application, the first planned shooting initial angle can be the initial rotation angle of the gimbal during the shooting process.

[0147] In some embodiments of this application, the initial rotation angle of the gimbal may include the initial pitch axis angle, the initial traverse axis angle, and the initial yaw axis angle of the gimbal.

[0148] Step 101a: When the electronic device determines that the user has turned to the second planned shooting initial angle and the gimbal has rotated to the first planned shooting initial angle, it receives video shooting input.

[0149] In some embodiments of this application, the aforementioned second planned shooting initial angle can be the user's initial shooting angle. In other words, the aforementioned second planned shooting initial angle can be the shooting angle of the electronic device itself during the shooting process.

[0150] In some embodiments of this application, the electronic device can obtain the triaxial magnetic induction intensity of the geomagnetic sensor in real time through the geomagnetic sensor, and then determine the user's real-time shooting angle based on the real-time obtained triaxial magnetic induction intensity of the geomagnetic sensor.

[0151] In some embodiments of this application, assuming that the X-axis of the geomagnetic sensor is placed horizontally and points to the right of the electronic device, the Y-axis is placed in front of the electronic device, and the Z-axis is perpendicular to the ground and pointing downwards, the triaxial magnetic induction intensity of the geomagnetic sensor along the X, Y, and Z axes is obtained. .

[0152] In some embodiments of this application, if the electronic device has a pitch angle ( ) and roll angle ( The triaxial magnetic induction intensity needs to be... Transform from the device coordinate system to the horizontal coordinate system. Calculate the tilt-compensated magnetic flux density using accelerometer data; the specific formula is as follows:

[0153] , (1)

[0154] in, This represents the compensated magnetic flux density along the X-axis. This represents the compensated Y-axis magnetic flux density.

[0155] In some embodiments of this application, the compensated magnetic induction intensity is utilized. and The user's real-time shooting angle is calculated using the following formula:

[0156] ; (2)

[0157] in, This indicates the real-time shooting angle.

[0158] In some embodiments of this application, the electronic device can calculate the angle difference between the real-time shooting angle and the second planned initial shooting angle, and then control the electronic device to turn to the second initial shooting angle based on the angle difference.

[0159] In some embodiments of this application, after step 102 described above, the video capture method provided in this application may further include the following step 117:

[0160] Step 117: If the electronic device determines that the user has deviated from the planned shooting path during the shooting process, then perform at least one of the following steps 118 and 119:

[0161] Step 118: The electronic device controls the gimbal to vibrate, prompting the user to deviate from the planned shooting path.

[0162] In some embodiments of this application, the electronic device can control the gimbal to vibrate in accordance with at least one of the following:

[0163] Vibration at the first vibration frequency;

[0164] The first vibration amplitude is oscillation.

[0165] Step 119: The electronic device displays the third prompt message on the shooting preview interface.

[0166] In some embodiments of this application, the aforementioned third prompt information is used to prompt the user to deviate from the planned shooting path.

[0167] In some embodiments of this application, the content of the aforementioned third prompt information may be text information, image information, symbol information, or voice information. The specific content can be determined according to actual needs, and this embodiment does not impose specific limitations here.

[0168] Thus, if the electronic device determines that the user has deviated from the planned shooting path during the shooting process, it will execute at least one of the following actions: control the gimbal to vibrate, prompt the user to deviate from the planned shooting path, and display a third prompt message on the shooting preview interface. This will enable the electronic device to promptly prompt the user to deviate from the planned shooting path.

[0169] The video shooting method provided in this application will be further described in detail below with reference to specific implementation methods. Figure 5 This is a schematic diagram of the video shooting process provided in the embodiments of this application. Taking a mobile phone as an example, the method may include the following steps 501 to 508:

[0170] Step 501: During the manufacturing process of the handheld gimbal device, a dual-frequency GPS / BeiDou chip (positioning accuracy ±0.5m) is added to the handheld gimbal device of the mobile phone.

[0171] For example, the geomagnetic sensor module in the chip is used to detect real-time position and orientation. The gimbal can detect and record the three-axis rotation angles. Suppose a user has reached a high mountainside and is trying to photograph the distant scenery of layered mountains. At this time, the device's GNSS module detects the user's position, acquires data in NMEA 0183 standard format, and uses this to obtain the user's specific orientation; the geomagnetic sensor acquires raw sensor data such as three-axis magnetic induction intensity, and uses this to calculate the azimuth angle data to determine the user's orientation. The gimbal can record its three-axis rotation angle data and save it in real time.

[0172] Step 502: Build an offline shooting database using the mobile phone.

[0173] Before users conduct actual shooting, the shooting data for famous landscapes is preset. This preset data is collected through on-site shooting. The main recorded data includes: GNSS position (represented using the NMEA 0183 data structure), direction (obtained by calculating the azimuth angle using the three-axis magnetic induction intensity of the geomagnetic sensor), pitch axis angle, traverse axis angle, and yaw axis angle (obtained through data recording from the three-axis gimbal), as well as shutter speed, field of view (FOV), and magnification (obtained through internal camera data recording). During on-site shooting, assuming the scene is a mountain scene or a night view of tall buildings, a professional photographer records data in real time while shooting and moving the camera, then packages and uploads the recorded data stream to the database. In addition to the camera movement and composition data provided by the product provider, users can also upload and share their own shooting trajectory data for other users to learn from.

[0174] Data types How to obtain Representation (data structure) GNSS location GNSS sensor output data NMEA 0813 direction Geomagnetic sensor output data Floating-point vector group / matrix Pitch axis angle PTZ output data floating-point numbers transverse axis angle PTZ output data floating-point numbers yaw axis angle PTZ output data floating-point numbers Shutter speed Camera internal data Fraction FOV Camera internal data floating-point numbers magnification Camera internal data floating-point numbers

[0175] Table 1 Data collected from the database

[0176] Step 503: The phone composes the shot when it is close to the shooting point.

[0177] For example, assuming the user has reached a mountainside or a cluster of tall buildings in a city and is ready to start shooting, as the user manipulates the gimbal to move the camera, the phone's GNSS module continuously matches the surrounding area for recommended shooting locations that are close to the database location. Figure 6A As shown, the UI prompts the user whether to perform a recommended shot. The specific matching process is as follows: the GNSS module obtains the user's location information, gets NMEA 0183 data, combines it with map information to obtain the user's real-time location, and matches it with location information records in the database. If the user selects recommended shooting, as shown... Figure 6B As shown, the UI guides the user to a recommended location. Once the user is within 0.5m of the recommended location, the UI prompts: "You can start the recommended shooting now." Subsequently, the geomagnetic sensor acquires the user's azimuth data and calculates the user's orientation, guiding the user to turn towards the orientation recorded in the database, ensuring that the user's position and orientation match the database records. When the user turns to the specified orientation, the user selects to start shooting, and the gimbal automatically rotates according to the three-axis angle parameters in the database to complete the composition. For example, for mountain shooting scenes, a wide field of view is needed to capture the entire mountain scenery; therefore, the camera cannot have a large range of shake, and the rotation angle should not be too large. This is already recorded in the database and will be reflected in real time during the user's shooting process.

[0178] Step 504: Turn on automatic camera movement on your phone.

[0179] For example, start recommending camera movement functions, such as Figure 6C As shown, the UI displays the movement trajectory, which the user follows. The gimbal's three-axis angles are automatically and dynamically adjusted according to database data. As long as the user moves along the path prompted by the UI, they can capture stunning footage.

[0180] Step 505: The mobile phone provides a trajectory deviation warning.

[0181] For example, such as Figure 6D As shown, when the user deviates from the recommended path, the controller vibrates to alert the user to stay on the recommended path.

[0182] Step 506: Smart Mobile Composition and Camera Movement. When no shooting location is available in the database, an AI model can be used to automatically compose the shot and generate the optimal composition and shooting path. For model training, this invention first automatically generates a simulation trajectory of the 3D model based on publicly available 3D data, sets reward and penalty conditions for different trajectories, and iteratively trains by calculating the score of the optimal trajectory. A GAN architecture or a Transformer architecture can be used for model training, ultimately resulting in a model that can generate camera movement and composition routes for a given 3D scene. When a user arrives at a location not recorded in the database, the GNSS module and geomagnetic sensor are first used to obtain the user's current position and direction. Next, a 3D model of the current location is obtained from a cloud-based terrain database. Based on this 3D model, a camera movement trajectory is generated using a deep learning model, which then guides the user to begin shooting.

[0183] Step 507: The mobile phone can preset the shooting script in advance and generate the camera movement and composition path through semantic analysis of the NLP model.

[0184] For example, a camera movement script could be created by slowly rotating the camera around a person, then panning the camera, then pulling the camera up, and rotating the tilt axis by 10 degrees. The phone could automatically generate the actual motion parameters of the gimbal to achieve automatic camera movement.

[0185] Step 508: After the mobile phone user completes all the shooting work, a blockbuster film with distinctive camera movements and excellent composition can be generated for the user, ending the entire shooting process.

[0186] The video shooting method provided in this application will be described below in conjunction with specific scenarios.

[0187] Scenario 1: Mountain Shooting Scene. For mountain shooting scenes, users expect to capture a grand, epic scene with towering mountains and magnificent vistas. Therefore, a typical shooting scene would look like this:

[0188] The user arrives at the mountainside and turns on the filming equipment;

[0189] At this time, the device to which this invention is applicable starts the GNSS module and obtains the user's current location in real time. If it detects that the user's current location is close to the recommended shooting point in the database (assuming it is within 500m), the device issues a UI prompt, allowing the user to choose whether to accept going to the recommended shooting location and use the shooting script in the database to take pictures.

[0190] The user selects to accept the suggested shooting location script, and the UI prompts and guides the user to the recommended shooting location. During the user's journey to the recommended shooting location, the GNSS sensor and the geomagnetic sensor work together. The GNSS sensor acquires the user's real-time location information, and the geomagnetic sensor acquires the user's direction information. Based on this, the system calculates the user's path and direction of travel to the recommended shooting location, which is then displayed in real time on the UI.

[0191] When the user arrives at the recommended shooting location, the geomagnetic sensor module acquires the user's current orientation and uses the UI to guide the user to align the device's orientation with the records in the database. The device then begins automatic camera movement. The UI displays the movement trajectory, guiding the user to follow it. The gimbal's three-axis angles are automatically and dynamically adjusted according to the database data. As long as the user moves along the path indicated by the UI, they can capture stunning footage.

[0192] During filming, the sensors monitor the user's position and orientation in real time. If the user deviates from the intended direction or position, the device calculates the optimal direction to return to the intended route based on the difference between the current position and orientation information and the expected route's direction and position information, and guides the user back to the expected route through the UI.

[0193] Ultimately, the user followed the instructions to complete the filming, resulting in a magnificent, large-scale video.

[0194] Scenario 2: High-rise building night scene shooting. For high-rise building shooting scenes, the user expects to shoot a stylized video with urban scenery and flashing neon lights that reflects the advanced side of a modern city. Therefore, a typical shooting scene would look like this:

[0195] The user arrives at the rooftop of the high-rise building and turns on the camera.

[0196] At this time, the device to which this invention is applicable starts the GNSS module and obtains the user's current location in real time. However, no recommended shooting point close to the user's current location is detected in the database. The device issues a UI prompt and starts to use the AI ​​model to automatically compose the image and automatically generate the optimal composition and path.

[0197] The user selects to accept the AI-generated automatic composition and the suggested shooting location script. The UI then prompts and guides the user to the recommended shooting location. During the user's journey to the recommended location, the GNSS sensor and the geomagnetic sensor work together. The GNSS sensor acquires the user's real-time location information, and the geomagnetic sensor acquires the user's direction information. Based on this, the system calculates the user's path and direction of travel to the recommended shooting location, which is then displayed in real-time on the UI.

[0198] When the user arrives at the recommended shooting location, the geomagnetic sensor module acquires the user's current orientation and uses the UI to guide the user to align the device's orientation with the records in the database. The device then begins automatic camera movement. The UI displays the movement trajectory, guiding the user to follow it. The gimbal's three-axis angles are automatically and dynamically adjusted according to the database data. As long as the user moves along the path indicated by the UI, they can capture stunning footage.

[0199] During filming, the sensors monitor the user's position and orientation in real time. If the user deviates from the intended direction or position, the device calculates the optimal direction to return to the intended route based on the difference between the current position and orientation information and the expected route's direction and position information, and guides the user back to the expected route through the UI.

[0200] Ultimately, users follow the instructions to complete the filming, resulting in a stylized film that showcases the advanced aspects of a modern city.

[0201] The video shooting method provided in this embodiment enables fully automatic composition and shooting. It integrates multi-source sensor data (GNSS, IMU, visual sensor) with an AI decision engine in a handheld gimbal system. Through three core technologies—geographic tag linkage, scene semantic understanding, and camera movement path sharing—it addresses the industry pain point of complex professional photography operations. Furthermore, firstly, by pre-loading a database of globally renowned scenic landmarks and shooting locations, as well as pre-collected optimal shooting positions, gimbal three-axis angle data, and optimal camera movement route data, a shooting database is constructed to assist users in fully automatic shooting. Secondly, users can compose shots simply by approaching the location; the gimbal automatically rotates and composes the shot according to the database data as the user moves to the preset geographic coordinates. Thirdly, AI automatically generates optimal composition and camera movement parameters, allowing the gimbal to rotate automatically for camera movement. Alternatively, scripts can be imported to generate camera movement parameters and trajectories through NLP models for automatic camera movement. Fourthly, users can share their own camera movements and compositions. Fifthly, handheld vibration prompts users to check the accuracy of the camera movement trajectory against the database, facilitating silent camera movement.

[0202] It should be noted that each of the above method embodiments, or various possible implementations of each method embodiment, can be executed individually or in combination of any two or more. The specific implementation can be determined according to actual usage requirements, and this application embodiment does not impose any restrictions on this.

[0203] The video processing method provided in this application can be executed by a video processing device. This application uses a video processing device executing the video processing method as an example to illustrate the video processing device provided in this application.

[0204] Figure 7This is a schematic diagram of the structure of a video processing device 700 provided in an embodiment of this application. The video processing device 700 includes a receiving module 701 and a shooting module 702.

[0205] The receiving module 701 is used to receive video shooting input to the shooting preview interface;

[0206] The shooting module 702 is used to shoot video in response to video shooting input on the shooting preview interface, and during the shooting process, display a first prompt message on the shooting preview interface based on the first shooting information. The first prompt message is used to prompt at least one of the following: a planned shooting path and at least one planned movement speed of the user on the planned shooting path.

[0207] The first shooting information is determined based on the user's geographical location information or the user's shooting needs information.

[0208] In some embodiments of this application, the first prompt information includes at least one of the following:

[0209] Path markings for the planned shooting path from the initial planned shooting position to the planned shooting end position;

[0210] A speed indicator for at least one planned movement speed by the user on the planned shooting path.

[0211] In some embodiments of this application, the first shooting information includes the shooting path information of the planned shooting path.

[0212] In some embodiments of this application, the first shooting information further includes at least one of the following: shooting location information, at least one shooting angle, shutter speed, field of view, and magnification.

[0213] In some embodiments of this application, the first shooting information includes at least one planned shooting angle, the at least one planned shooting angle including the shooting angle from each of at least one shooting point in the planned shooting path; combined with Figure 7 ,like Figure 8 As shown, the device 700 further includes:

[0214] The control module 703 is used to control the gimbal to rotate and shoot according to the at least one planned shooting angle during the shooting process.

[0215] In some embodiments of this application, such as Figure 8 As shown, the device 700 further includes:

[0216] The acquisition module 704 is used to acquire the user's geographical location information before receiving video shooting input to the shooting preview interface;

[0217] From the shooting parameter database, first shooting information matching the geographic location information is obtained, and the first shooting information includes at least shooting path information and shooting location information;

[0218] The shooting parameter database includes at least one shooting information, and each shooting information includes at least one of the following: a shooting location information, a shooting path information, at least one moving speed, and at least one shooting angle. Each shooting location information indicates a shooting location, each shooting path information corresponds to a shooting location information, and a shooting path information is a preset shooting path information when shooting at the shooting location indicated by the corresponding shooting location information.

[0219] In some embodiments of this application, the shooting location information includes the shooting location name and the latitude and longitude information of the shooting location.

[0220] In some embodiments of this application, such as Figure 8 As shown, the device further includes:

[0221] The acquisition module 704 is used to acquire the user's geographical location information before receiving video shooting input to the shooting preview interface;

[0222] Based on the geographic description information of the first shooting location that matches the geographic location information, a three-dimensional model of the first shooting location is performed to obtain a three-dimensional model of the first shooting location.

[0223] The model data of the three-dimensional model is input into the shooting information to extract the model, and the first shooting information is output.

[0224] In some embodiments of this application, such as Figure 8 As shown, the device further includes:

[0225] The training module 705 is used to obtain a training set before inputting the model data of the 3D model into the shooting information to extract the model and outputting the first shooting path information. The training set includes at least one training sample and at least one sample label. Each training sample in the at least one training sample is the 3D model data of a shooting location, and each sample label in the at least one sample label is the shooting path information corresponding to a shooting location.

[0226] The first training sample is input into the shooting information extraction model, which outputs at least one shooting path information and at least one score. Each score is the score of one of the at least one shooting path information. The at least one shooting path information includes a first sample label corresponding to the first training sample.

[0227] Adjust the model parameters of the shooting information extraction model until the score of the first sample label is greater than or equal to the first threshold.

[0228] Wherein, the first training sample is any one of the at least one training samples.

[0229] In some embodiments of this application, the apparatus further includes:

[0230] Display module 706 is used to display a prompt box on the shooting preview interface before receiving video shooting input to the shooting preview interface, the prompt box being used to prompt the user to input shooting requirements;

[0231] The receiving module 701 is also used to receive the user's first input to the prompt box;

[0232] like Figure 8 As shown, the device 700 further includes: a processing module 707, configured to perform semantic recognition on the input information of the first input in response to the first input, and obtain the shooting requirement information;

[0233] The shooting requirement information includes descriptive information describing the orientation of at least one planned shooting location in the planned shooting path.

[0234] In some embodiments of this application, the display module 706 is further configured to:

[0235] Before receiving video shooting input to the shooting preview interface, a path identifier for a navigation path to the planned initial shooting position is displayed on the shooting preview interface. The navigation path is used to guide the user to arrive at the planned initial shooting position.

[0236] The display module 701 is also used to display a second prompt message on the shooting preview interface when it is determined that the user has arrived at the planned initial shooting position, and to control the gimbal to rotate to the first planned initial shooting angle. The second prompt message is used to prompt the user to turn to the second planned initial shooting angle.

[0237] The receiving module 702 is specifically used for:

[0238] When it is determined that the user turns to the second initial shooting angle and the gimbal rotates to the first initial shooting angle, the video shooting input is received.

[0239] In some embodiments of this application, such as Figure 8 As shown, the device 700 further includes: a processing module 707, used for:

[0240] After the prompt message is displayed on the shooting preview interface, if it is determined during the shooting process that the user deviates from the planned shooting path, then at least one of the following actions will be performed:

[0241] The control of the gimbal vibration is used to alert the user that they have deviated from the planned shooting path;

[0242] A third prompt message is displayed on the shooting preview interface, which is used to remind the user to deviate from the planned shooting path.

[0243] In the video shooting device provided in this application embodiment, a video shooting input to a shooting preview interface is received; in response to the video shooting input received by the receiving module, video is shot, and during the shooting process, a first prompt message is displayed on the shooting preview interface based on first shooting information. The first prompt message is used to prompt at least one of the following: a planned shooting path and at least one planned movement speed of the user on the planned shooting path; the first shooting information is determined based on the user's geographical location information or the user's shooting needs information. Thus, the electronic device can display prompt messages on the shooting preview interface during the shooting process, prompting at least one of the planned shooting path and at least one planned movement speed of the user on the planned shooting path, enabling the user to shoot video along the planned shooting path according to the prompted shooting path and at least one of the planned movement speeds in the prompt message, thereby effectively simplifying user operation.

[0244] The video recording device in this application embodiment can be an electronic device or a component within an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices besides a terminal. For example, the electronic device can be a mobile phone, tablet computer, laptop computer, PDA, in-vehicle electronic device, mobile internet device, augmented reality / virtual reality device, robot, wearable device, super mobile personal computer, netbook, or personal digital assistant, etc. It can also be a server, network attached storage (NAS), personal computer (PC), television (TV), ATM, or self-service machine, etc. This application embodiment does not specifically limit the device.

[0245] The video recording device in this application embodiment can be a device with an operating system. This operating system can be Android, iOS, or other possible operating systems; this application embodiment does not specifically limit the specific operating system used.

[0246] The video shooting device provided in this application can realize the various processes implemented in the various embodiments of the above video shooting method. To avoid repetition, it will not be described again here.

[0247] Optionally, such as Figure 9 As shown, this application embodiment also provides an electronic device 900, including a processor 901 and a memory 902. The memory 902 stores a program or instructions that can run on the processor 901. When the program or instructions are executed by the processor 901, they implement the various steps of the above-described video shooting method embodiment and can achieve the same technical effect. To avoid repetition, they will not be described again here.

[0248] It should be noted that the electronic devices in the embodiments of this application include the mobile electronic devices and non-mobile electronic devices described above.

[0249] Figure 10 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of this application.

[0250] The electronic device 1000 includes, but is not limited to, components such as: radio frequency unit 1001, network module 1002, audio output unit 1003, input unit 1004, sensor 1005, display unit 1006, user input unit 1007, interface unit 1008, memory 1009, and processor 1010.

[0251] Those skilled in the art will understand that the electronic device 1000 may also include a power supply (such as a battery) for supplying power to various components. The power supply may be logically connected to the processor 1010 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system. Figure 10 The electronic device structure shown does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.

[0252] The user input unit 1007 is used to receive video shooting input to the shooting preview interface;

[0253] Processor 1010 is configured to capture video in response to the video capture input, and during the capture process, display first prompt information on the capture preview interface based on first capture information, wherein the first prompt information is configured to prompt at least one of the following: a planned capture path, and at least one planned movement speed of the user on the planned capture path;

[0254] The first shooting information is determined based on the user's geographical location information or the user's shooting needs information.

[0255] In some embodiments of this application, the first prompt information includes: a path identifier of the planned shooting path from the planned shooting initial position to the planned shooting end position, and a speed identifier of at least one planned movement speed of the user on the planned shooting path.

[0256] In some embodiments of this application, the first shooting information includes shooting path information of the planned shooting path and the at least one planned movement speed.

[0257] In some embodiments of this application, the first shooting information further includes at least one of the following: shooting location information, at least one shooting angle, shutter speed, field of view, and magnification.

[0258] In some embodiments of this application, the first shooting information includes at least one planned shooting angle, the at least one planned shooting angle including the shooting angle from each of the at least one shooting point in the shooting path; the processor 1010 is used to control the gimbal to rotate and shoot according to the at least one planned shooting angle during the shooting process.

[0259] In some embodiments of this application, the processor 1010 is configured to obtain the user's geographic location information before receiving video shooting input to the shooting preview interface;

[0260] From the shooting parameter database, first shooting information matching the geographic location information is obtained, and the first shooting information includes at least shooting path information and shooting location information;

[0261] The shooting parameter database includes at least one shooting information, and each shooting information includes at least one of the following: a shooting location information, a shooting path information, at least one moving speed, and at least one shooting angle. Each shooting location information indicates a shooting location, each shooting path information corresponds to a shooting location information, and a shooting path information is a preset shooting path information when shooting at the shooting location indicated by the corresponding shooting location information.

[0262] In some embodiments of this application, the shooting location information includes the shooting location name and the latitude and longitude information of the shooting location.

[0263] In some embodiments of this application, the processor 1010 is configured to obtain the user's geographic location information before receiving video shooting input to the shooting preview interface;

[0264] Based on the geographic description information of the first shooting location that matches the geographic location information, a three-dimensional model of the first shooting location is performed to obtain a three-dimensional model of the first shooting location.

[0265] The model data of the three-dimensional model is input into the shooting information to extract the model, and the first shooting information is output.

[0266] In some embodiments of this application, the processor 1010 is configured to obtain a training set before inputting the model data of the 3D model into the shooting information to extract the model and outputting the first shooting path information. The training set includes at least one training sample and at least one sample label. Each training sample in the at least one training sample is 3D model data of a shooting location, and each sample label in the at least one sample label is shooting path information corresponding to a shooting location.

[0267] The first training sample is input into the shooting information extraction model, which outputs at least one shooting path information and at least one score. Each score is the score of one of the at least one shooting path information. The at least one shooting path information includes a first sample label corresponding to the first training sample.

[0268] Adjust the model parameters of the shooting information extraction model until the score of the first sample label is greater than or equal to the first threshold.

[0269] Wherein, the first training sample is any one of the at least one training samples.

[0270] In some embodiments of this application, the display unit 1006 is used for:

[0271] Before receiving video shooting input on the shooting preview interface, a prompt box is displayed on the shooting preview interface to prompt the user to input shooting requirements;

[0272] The user input unit 1007 is also used to receive the user's first input to the prompt box;

[0273] The processor 1010 is configured to respond to the first input by performing semantic recognition on the input information of the first input to obtain the shooting requirement information;

[0274] The shooting requirement information includes descriptive information describing the orientation of at least one planned shooting location in the planned shooting path.

[0275] In some embodiments of this application, the display unit 1006 is further configured to:

[0276] Before receiving video shooting input to the shooting preview interface, a path identifier for a navigation path to the planned initial shooting position is displayed on the shooting preview interface. The navigation path is used to guide the user to arrive at the planned initial shooting position.

[0277] Once it is determined that the user has arrived at the planned initial shooting position, a second prompt message is displayed on the shooting preview interface, and the gimbal is controlled to rotate to the first planned initial shooting angle. The second prompt message is used to prompt the user to turn to the second planned initial shooting angle.

[0278] The user input unit 1007 is specifically used for:

[0279] When it is determined that the user turns to the second planned shooting initial angle and the gimbal rotates to the first planned shooting initial angle, the video shooting input is received.

[0280] In some embodiments of this application, the apparatus further includes: a processor 1010.

[0281] After the prompt message is displayed on the shooting preview interface, if it is determined during the shooting process that the user deviates from the shooting path, then at least one of the following actions will be performed:

[0282] The control of the gimbal vibration is used to alert the user that they have deviated from the planned shooting path;

[0283] A third prompt message is displayed on the shooting preview interface, which is used to remind the user to deviate from the planned shooting path.

[0284] In the electronic device provided in this application embodiment, a video shooting input to a shooting preview interface is received; in response to the video shooting input received by the receiving module, a video is shot, and during the shooting process, based on first shooting information, a first prompt message is displayed on the shooting preview interface. The first prompt message is used to prompt at least one of the following: a planned shooting path, and at least one planned movement speed of the user on the planned shooting path; the first shooting information is determined based on the user's geographical location information or the user's shooting needs information. Thus, the electronic device can display prompt messages on the shooting preview interface during the shooting process, prompting at least one of the planned shooting path and at least one planned movement speed of the user on the planned shooting path, enabling the user to shoot video along the planned shooting path according to the prompted shooting path and at least one of the planned movement speeds in the prompt message, thereby effectively simplifying user operation.

[0285] It should be understood that, in this embodiment, the input unit 1004 may include a graphics processing unit (GPU) 10041 and a microphone 10042. The GPU 10041 processes image data of still images or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 1006 may include a display panel 10061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, etc. The user input unit 1007 includes at least one of a touch panel 10071 and other input devices 10072. The touch panel 10071 is also called a touch screen. The touch panel 10071 may include a touch detection device and a touch controller. Other input devices 10072 may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, power buttons, etc.), trackballs, mice, joysticks, etc., which will not be described in detail here.

[0286] The memory 1009 can be used to store software programs and various data. The memory 1009 may primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback, image playback, etc.). Furthermore, the memory 1009 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 1009 in this embodiment includes, but is not limited to, these and any other suitable types of memory.

[0287] The processor 1010 may include one or more processing units; optionally, the processor 1010 integrates an application processor and a modem processor, wherein the application processor mainly handles operations involving the operating system, user interface, and applications, and the modem processor mainly handles wireless communication signals, such as a baseband processor. It is understood that the aforementioned modem processor may also not be integrated into the processor 1010.

[0288] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described video processing method embodiments and achieve the same technical effect. To avoid repetition, they will not be described again here.

[0289] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0290] This application embodiment also provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement the various processes of the above video processing method embodiments and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0291] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.

[0292] This application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the various processes of the video processing method embodiments described above, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0293] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0294] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0295] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Claims

1. A video shooting method characterized by comprising: The method comprises: receiving a video shooting input on a shooting preview interface; in response to the video shooting input, shooting a video, and during shooting, displaying first prompt information based on first shooting information, the first prompt information being used to prompt at least one of the following: planning a shooting path, at least one planned moving speed of a user on the planning shooting path; wherein the first shooting information is determined based on geographical location information of the user or shooting demand information of the user.

2. The method of claim 1, wherein, The first prompt information comprises at least one of the following: path identification of the planning shooting path between a planning shooting initial position and a planning shooting terminal position; speed identification of at least one planned moving speed of the user on the planning shooting path.

3. The method according to claim 1 or 2, characterized in that, Before the receiving a video shooting input on the shooting preview interface, the method further comprises: obtaining geographical location information of the user; from a shooting parameter database, obtaining first shooting information matched with the geographical location information, the first shooting information comprising at least shooting path information and shooting location information; wherein the shooting parameter database comprises at least one shooting information, each shooting information comprising at least one of the following: one shooting location information, one shooting path information, at least one moving speed, at least one shooting angle, each shooting location information indicating one shooting location, each shooting path information corresponding to one shooting location information, one shooting path information being preset shooting path information for shooting at the shooting location indicated by the corresponding shooting location information, and at least one moving speed being a moving speed of the user on the shooting path indicated by the preset shooting path information.

4. The method of claim 1, wherein, Before the receiving a video shooting input on the shooting preview interface, the method further comprises: obtaining geographical location information of the user; based on geographical description information of a first shooting location matched with the geographical location information, performing three-dimensional modeling on the first shooting location to obtain a three-dimensional model of the first shooting location; inputting model data of the three-dimensional model into a shooting information extraction model to output the first shooting information.

5. The method of claim 2, wherein, Before the receiving a video shooting input on the shooting preview interface, the method further comprises: displaying, on the shooting preview interface, path identification of a navigation path that navigates to the planning shooting initial position, the navigation path being used to indicate that the user reaches the planning shooting initial position; in a case where it is determined that the user reaches the planning initial shooting position, displaying, on the shooting preview interface, second prompt information and controlling a gimbal to rotate to a first planning shooting initial angle, the second prompt information being used to prompt the user to turn to a second planning shooting initial angle; The receiving a video shooting input on the shooting preview interface comprises: in a case where it is determined that the user turns to the second planning shooting initial angle and the gimbal rotates to the first planning shooting initial angle, receiving the video shooting input.

6. A video camera device, characterized by comprising: The device comprises: a receiving module configured to receive a video shooting input on a shooting preview interface; The shooting module is configured to shoot a video in response to the video shooting input received by the receiving module, and display first prompt information on the shooting preview interface based on first shooting information during the shooting process, the first prompt information being used to prompt at least one of the following: a planned shooting path and at least one planned moving speed of the user on the planned shooting path. The first shooting information is determined based on geographical position information of the user or shooting demand information of the user.

7. The apparatus of claim 6, wherein, The first prompt information includes: path identification of the planned shooting path from a planned shooting initial position to a planned shooting terminal position; and speed identification of the at least one planned moving speed of the user on the planned shooting path.

8. The apparatus of claim 6 or 7, wherein, The device further includes: an obtaining module configured to obtain geographical position information of the user before receiving the video shooting input on the shooting preview interface; obtain first shooting information matched with the geographical position information from a shooting parameter database, the first shooting information including at least shooting path information and shooting location information; The shooting parameter database includes at least one shooting information, each shooting information including at least one of the following: one shooting location information, one shooting path information, at least one moving speed, and at least one shooting angle, each shooting location information indicating a shooting location, each shooting path information corresponding to one shooting location information, and one shooting path information being preset shooting path information for shooting at the shooting location indicated by the corresponding shooting location information.

9. The apparatus of claim 6, wherein, The device further includes: an obtaining module configured to obtain geographical position information of the user before receiving the video shooting input on the shooting preview interface; perform three-dimensional modeling on the first shooting location based on geographical description information of the first shooting location matched with the geographical position information, to obtain a three-dimensional model of the first shooting location; input model data of the three-dimensional model into a shooting information extraction model, and output the first shooting information.

10. The apparatus of claim 7, wherein, The device further includes: a display module configured to display, before receiving the video shooting input on the shooting preview interface, path identification of a navigation path to the planned shooting initial position on the shooting preview interface, the navigation path being used to indicate the user to reach the planned shooting initial position; the display module is further configured to display second prompt information on the shooting preview interface and control the gimbal to rotate to a first planned shooting initial angle if it is determined that the user reaches the planned shooting initial position, the second prompt information being used to prompt the user to turn to a second planned shooting initial angle; The receiving module is specifically configured to: receive the video shooting input if it is determined that the user turns to the second planned shooting initial angle and the gimbal rotates to the first planned shooting initial angle.

11. An electronic device, comprising: A device includes a processor and a memory, the memory storing programs or instructions executable on the processor, the programs or instructions being executed by the processor to implement the steps of the video shooting method according to any one of claims 1 to 5.

Images