Method and device for generating display content and method and device for generating image

Abstract

A method and device for generating display content, and a method and device for generating images, the method comprising: obtaining control parameter information of a remote controller for a drone; generating first display content representing changes in the remote controller's control parameters based on the control parameter information and a parameter display template; wherein the first display content is added to an environmental image file for playback and display, wherein the environmental image file is captured by the drone during flight in response to the control parameter information of the remote controller. Images captured during drone flight can be displayed on the same screen as the corresponding control parameters, making it easier for users to learn how to operate the drone and providing more instructive images. This overcomes the limitations of on-site drone instruction.

Description

Technical Field

[0001] The present invention belongs to the field of aircraft, and in particular relates to a method and device for generating display content and a method and device for generating images. Background Art

[0002] As unmanned aerial vehicles (UAVs) become increasingly powerful, their applications are expanding. Consequently, more and more people are becoming acquainted with aircraft, specifically drones. However, existing drones often present a certain level of difficulty in operating. Mastering some drones, such as racing drones and cross-country drones, requires significant time and effort, along with continuous learning and practice.

[0003] Given the difficulty of operating drones, on-site instruction is often used to help students learn how to operate them. This requires students to observe and learn closely, which makes this learning method very limited. Summary of the Invention

[0004] The present invention provides a method and device for generating display content and a method and device for generating images, so as to solve the problem of limitations of on-site teaching using unmanned aerial vehicles.

[0005] In order to solve the above-mentioned technical problems, the present invention is achieved as follows:

[0006] In a first aspect, an embodiment of the present invention provides a method for generating display content, the method comprising:

[0007] Get the control parameter information of the remote controller for the drone;

[0008] generating, according to the control parameter information and the parameter display template, first display content for representing a change in the control parameter of the remote controller;

[0009] The first display content is used to be added to an environmental image file for playback and display, wherein the environmental image file is captured by the UAV during flight in response to the control parameter information of the remote controller.

[0010] Optionally, the method further includes:

[0011] A parameter image file is generated according to the first display content, wherein the parameter image file is used to be called when playing the environment image file to add the first display content to the environment image file for playback and display.

[0012] Optionally, the control parameter information includes control parameter values ​​collected at different times; and generating first display content for representing changes in the control parameters of the remote controller according to the control parameter information and a parameter display template includes:

[0013] Adjust the parameter display template according to the control parameter value to generate a parameter display template image representing the control parameter value at different times;

[0014] The first display content is generated according to the parameter display template image at different times.

[0015] Optionally, the control parameter information includes control parameter values ​​collected at different times; and generating first display content for representing changes in the control parameters of the remote controller according to the control parameter information and a parameter display template includes:

[0016] Adjust the parameter display template according to the control parameter value to generate a display object representing the control parameter value at different times; the display object includes at least one of: numbers, letters, special symbols, and object identifiers;

[0017] The first display content is generated according to the display objects at different times.

[0018] Optionally, the control parameter information includes at least one of the following: a stick amount change parameter, a gimbal angle control parameter, a video recording control parameter, a photo taking control parameter, a flight mode control parameter, a return control parameter, and a playback control parameter.

[0019] Optionally, the method further includes:

[0020] Acquiring flight parameter information of the UAV during flight in response to the control parameter information of the remote controller;

[0021] According to the flight parameter information and the parameter display template, second display content for characterizing the change of the flight parameter of the UAV is generated.

[0022] Optionally, the drone includes at least two detection modules, and different detection modules are used to detect different flight parameters of the drone;

[0023] The obtaining of flight parameter information of the UAV during the flight in response to the control parameter information of the remote controller includes:

[0024] According to the parameter display template selected by the user, determine the detection module corresponding to the selected parameter display template;

[0025] Acquire the flight parameters detected by the detection module corresponding to the selected parameter display template during the flight of the UAV in response to the control parameter information of the remote controller.

[0026] Optionally, the flight parameter information includes at least one of the following: an attitude parameter of the UAV, an air pressure parameter of the UAV, a positioning parameter of the UAV, a speed parameter of the UAV, an acceleration parameter of the UAV, and a route parameter of the UAV.

[0027] Optionally, the method further includes:

[0028] When the control parameters in the control parameter information meet the parameter conditions corresponding to the preset control state, generating preset control state reminder information;

[0029] The preset control state reminder information is added to the first display content.

[0030] In a second aspect, an embodiment of the present invention provides an image generation method, the method comprising:

[0031] Get the control parameter information of the remote controller for the drone;

[0032] generating, according to the control parameter information and the parameter display template, first display content for representing a change in the control parameter of the remote controller;

[0033] Acquire an environmental image file captured by the drone during flight in response to the control parameter information of the remote controller;

[0034] A target image file is synthesized according to the first display content and the environment image file.

[0035] Optionally, the control parameter information includes control parameter values ​​collected at different times; and generating first display content for representing changes in the control parameters of the remote controller according to the control parameter information and a parameter display template includes:

[0036] Adjust the parameter display template according to the control parameter value to generate a parameter display template image representing the control parameter value at different times;

[0037] The first display content is generated according to the parameter display template image at different times.

[0038] Optionally, synthesizing a target image file according to the first display content and the environment image file includes:

[0039] synthesizing each of the parameter display template images and a video frame into a single image frame based on a first time corresponding to the parameter display template image and a second time corresponding to different video frames in the environmental image file; wherein the duration between the first time corresponding to the parameter display template image and the second time corresponding to the video frame synthesized into the same image frame is less than a preset threshold; the first time is the acquisition time of the control parameters corresponding to the parameter display template image; and the second time is the time when the video frame is generated;

[0040] Generate target image files based on the synthesized multi-frame images.

[0041] Optionally, the control parameter information includes control parameter values ​​collected at different times; and generating first display content for representing changes in the control parameters of the remote controller according to the control parameter information and a parameter display template includes:

[0042] Adjust the parameter display template according to the control parameter value to generate a display object representing the control parameter value at different times; the display object includes at least one of: numbers, letters, special symbols, and object identifiers;

[0043] The first display content is generated according to the display objects at different times.

[0044] Optionally, synthesizing a target image file according to the first display content and the environment image file includes:

[0045] Embed each display object into a video frame to obtain a frame of image based on a first time corresponding to the display object and a second time corresponding to different video frames in the environmental image file; wherein the duration between the first time corresponding to the display object and the second time corresponding to the video frame in the same frame of the image is less than a preset threshold; the first time is the time when the control parameters corresponding to the display object are collected; and the second time is the time when the video frame is generated;

[0046] Generate target image files based on the obtained multi-frame images.

[0047] Optionally, the method further includes:

[0048] Acquiring flight parameter information of the UAV during flight in response to the control parameter information of the remote controller;

[0049] generating, based on the flight parameter information and the parameter display template, second display content for characterizing changes in the flight parameters of the UAV;

[0050] The synthesizing a target image file according to the first display content and the environment image file includes:

[0051] A target image file is synthesized according to the first display content, the second display content and the environment image file.

[0052] Optionally, the drone includes at least two detection modules, and different detection modules are used to detect different flight parameters of the drone;

[0053] The obtaining of flight parameter information of the UAV during the flight in response to the control parameter information of the remote controller includes:

[0054] According to the parameter display template selected by the user, determine the detection module corresponding to the selected parameter display template;

[0055] Acquire the flight parameters detected by the detection module corresponding to the selected parameter display template during the flight of the UAV in response to the control parameter information of the remote controller.

[0056] Optionally, the method further includes:

[0057] When the control parameters in the control parameter information meet the parameter conditions corresponding to the preset control state, generating preset control state reminder information;

[0058] The preset control state reminder information is added to the first display content.

[0059] Optionally, the method further includes:

[0060] Acquiring a remote control image file obtained by capturing the remote control by a camera device during the flight of the drone in response to the control parameter information of the remote control;

[0061] The synthesizing a target image file according to the first display content and the environment image file includes:

[0062] A target image file is synthesized according to the first display content, the remote control image file and the environment image file.

[0063] In a third aspect, an embodiment of the present invention provides a device for generating display content, the device comprising:

[0064] Remote control information acquisition module, used to obtain the control parameter information of the remote controller on the drone;

[0065] a processor, configured to generate, based on the control parameter information and the parameter display template, first display content for representing a change in the control parameter of the remote controller;

[0066] The first display content is used to be added to an environmental image file for playback and display, wherein the environmental image file is captured by the UAV during flight in response to the control parameter information of the remote controller.

[0067] Optionally, the device further includes:

[0068] An image configuration module is used to generate a parameter image file according to the first display content, wherein the parameter image file is used to be called when playing the environment image file to add the first display content to the environment image file for playback and display.

[0069] Optionally, the control parameter information includes control parameter values ​​collected at different times; the processor is specifically used to adjust the parameter display template according to the control parameter values, and generate a parameter display template image representing the control parameter values ​​at different times; and generate the first display content according to the parameter display template image at different times.

[0070] Optionally, the control parameter information includes control parameter values ​​collected at different times; the processor is specifically used to adjust the parameter display template according to the control parameter values, and generate display objects representing the control parameter values ​​at different times; the display objects include: at least one of: numbers, letters, special symbols, and object identifiers; and the first display content is generated according to the display objects at different times.

[0071] Optionally, the device further includes:

[0072] a flight information acquisition module, configured to acquire flight parameter information of the UAV during flight in response to the control parameter information of the remote controller;

[0073] The processor is further configured to generate second display content for characterizing changes in the flight parameters of the UAV based on the flight parameter information and the parameter display template.

[0074] Optionally, the drone includes at least two detection modules, and different detection modules are used to detect different flight parameters of the drone; the flight information acquisition module is specifically used to determine the detection module corresponding to the selected parameter display template based on the parameter display template selected by the user; and obtain the flight parameters detected by the detection module corresponding to the selected parameter display template during the flight of the drone in response to the control parameter information of the remote control.

[0075] Optionally, the device further includes:

[0076] a reminder module, configured to generate preset control state reminder information when the control parameters in the control parameter information meet the parameter conditions corresponding to the preset control state;

[0077] The processor is further configured to add the preset control status reminder information to the first display content.

[0078] In a fourth aspect, an embodiment of the present invention provides an image generation device, comprising:

[0079] Remote control information acquisition module, used to obtain the control parameter information of the remote controller on the drone;

[0080] a processor, configured to generate, based on the control parameter information and the parameter display template, first display content for representing a change in the control parameter of the remote controller;

[0081] a first image acquisition device, configured to acquire an environmental image file captured by the drone during flight in response to the control parameter information of the remote controller;

[0082] The processor is further configured to synthesize a target image file according to the first display content and the environment image file.

[0083] Optionally, the control parameter information includes control parameter values ​​collected at different times; the processor is specifically used to adjust the parameter display template according to the control parameter values, and generate a parameter display template image representing the control parameter values ​​at different times; and generate the first display content according to the parameter display template image at different times.

[0084] Optionally, the processor is specifically used to synthesize each parameter display template image with a video frame into a frame of image based on the first time corresponding to the parameter display template image and the second time corresponding to different video frames in the environmental image file; wherein the duration between the first time corresponding to the parameter display template image and the second time corresponding to the video frame for synthesizing the same frame of the image is less than a preset threshold; the first time is the acquisition time of the control parameters corresponding to the parameter display template image; the second time is the time for generating the video frame; and a target image file is generated based on the synthesized multiple frames of images.

[0085] Optionally, the control parameter information includes control parameter values ​​collected at different times; the processor is specifically used to adjust the parameter display template according to the control parameter values, and generate display objects representing the control parameter values ​​at different times; the display objects include: at least one of: numbers, letters, special symbols, and object identifiers; and the first display content is generated according to the display objects at different times.

[0086] Optionally, the processor is specifically used to embed each display object into a video frame to obtain a frame of image based on the first time corresponding to the display object and the second time corresponding to different video frames in the environmental image file; wherein the duration between the first time corresponding to the display object and the second time corresponding to the video frame of the same frame of the image is less than a preset threshold; the first time is the acquisition time of the control parameters corresponding to the display object; the second time is the time of generating the video frame; and a target image file is generated based on the obtained multiple frames of image.

[0087] Optionally, the device further includes:

[0088] a flight information acquisition module, configured to acquire flight parameter information of the UAV during flight in response to the control parameter information of the remote controller;

[0089] The processor is further configured to generate second display content for representing changes in the flight parameters of the UAV based on the flight parameter information and the parameter display template;

[0090] The processor is further configured to synthesize a target image file according to the first display content, the second display content, and the environment image file.

[0091] Optionally, the drone includes at least two detection modules, and different detection modules are used to detect different flight parameters of the drone;

[0092] The flight information acquisition module is specifically used to determine the detection module corresponding to the selected parameter display template according to the parameter display template selected by the user; and obtain the flight parameters detected by the detection module corresponding to the selected parameter display template during the flight of the drone in response to the control parameter information of the remote controller.

[0093] Optionally, the device further includes:

[0094] a reminder module, configured to generate preset control state reminder information when the control parameters in the control parameter information meet the parameter conditions corresponding to the preset control state;

[0095] The processor is further configured to add the preset control state reminder information to the parameter image file.

[0096] Optionally, the device further includes:

[0097] a second image acquisition device, configured to obtain a remote control image file obtained by capturing the remote control by a camera device during the flight of the UAV in response to the control parameter information of the remote control;

[0098] The processor is further configured to synthesize a target image file according to the parameter image file, the remote control image file and the environment image file.

[0099] In a fifth aspect, an embodiment of the present invention provides an electronic device comprising a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the computer program, when executed by the processor, implements the steps of the method described in the first aspect or the second aspect.

[0100] In a sixth aspect, an embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the method described in the first aspect or the second aspect are implemented.

[0101] In an embodiment of the present invention, control parameter information of a remote controller for a drone can be obtained; the control parameter information includes control information during the flight of the drone controlled by the remote controller. Based on a parameter display template and the obtained control parameter information, first display content representing changes in the control parameters of the remote controller is generated. This first display content is added to an environmental image file for playback and display, wherein the environmental image file is captured by the drone during flight in response to the control parameter information of the remote controller. This allows the image captured during the drone flight and the corresponding control parameters to be displayed on the same screen, making it easier for users to learn how to control the drone and making the displayed images more instructive. This overcomes the limitations of on-site drone teaching. BRIEF DESCRIPTION OF THE DRAWINGS

[0102] Figure 1 This is a flowchart of a method for generating display content provided by an embodiment of the present invention;

[0103] Figure 2 This is one of the flow charts of steps for generating first display content provided by an embodiment of the present invention;

[0104] Figure 3 This is the second flowchart of the steps of generating the first display content provided by the embodiment of the present invention;

[0105] Figure 4 is a flowchart of steps for generating second display content provided by an embodiment of the present invention;

[0106] Figure 5 1 is a schematic diagram of a process for obtaining flight parameter information and control parameter information provided by an embodiment of the present invention;

[0107] Figure 6 is a flowchart of the steps of an image generation method provided by an embodiment of the present invention;

[0108] Figure 7This is a block diagram of a display content generation device provided by an embodiment of the present invention;

[0109] Figure 8 is a block diagram of an image generating device provided by an embodiment of the present invention;

[0110] Figure 9 A schematic diagram of the hardware structure of a device for implementing various embodiments of the present invention;

[0111] Figure 10 A block diagram of a computing and processing device provided in an embodiment of the present invention;

[0112] Figure 11 A block diagram of a portable or fixed storage unit provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0113] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0114] The present invention is applied to a drone flight system, which includes at least a drone and a remote controller. The drone is equipped with a gimbal, and a camera is mounted on the gimbal. The remote controller is wirelessly connected to the drone, and the remote controller can send control instructions to the drone to control the drone to complete takeoff, return, pitch, roll, yaw and other flights. The remote controller can also control the gimbal, adjust the gimbal attitude, and then adjust the shooting angle of the camera. The remote controller can also control the camera to take pictures, record videos, etc. Of course, the drone can also be equipped with equipment for detecting flight parameters, such as a gyroscope, a barometer, a positioning module, an accelerometer, etc. Optionally, the drone can be a racing drone or a cross-country drone, but is not limited to this.

[0115] Figure 1 This is a flowchart of a method for generating display content provided by an embodiment of the present invention. Figure 1 As shown, the method may include:

[0116] Step 101: Obtain control parameter information of the remote controller for the drone.

[0117] In embodiments of the present invention, the remote control continuously transmits control parameter information to the drone during flight control. The drone can recognize this control parameter information and respond to it, operating according to the control parameter information. For example, the control parameter information can be a variable control parameter. After receiving this variable control parameter, the drone will perform pitch, roll, or yaw operations based on its specific content. Of course, the control parameter information is not limited to this; it can be one or more parameters transmitted by the remote control to control the drone.

[0118] Step 102: Generate first display content for representing changes in the control parameters of the remote controller according to the control parameter information and the parameter display template.

[0119] In embodiments of the present invention, the first display content may display control parameter changes in the form of images, text, tables, videos, etc., but is not limited thereto. The first display content is added to an environmental image file for display, where the environmental image file is captured by the drone during flight in response to the control parameter information from the remote control. That is, while the drone is controlled by the remote control, the environmental image file and the first display content respectively record the control parameter changes and the environmental image captured by the drone during the same time period.

[0120] In an embodiment of the present invention, control parameter information of a drone controlled by a remote controller can be obtained; this control parameter information includes control information during the flight of the drone controlled by the remote controller. Based on a parameter display template and the obtained control parameter information, first display content representing changes in the control parameters of the remote controller is generated. This first display content is added to an environmental image file for playback and display, wherein the environmental image file is captured by the drone during flight in response to the control parameter information of the remote controller. This allows the images captured during the drone flight and the corresponding control parameters to be displayed on the same screen, making it easier for users to learn how to control the drone and making the displayed images more instructive. This overcomes the limitations of on-site drone teaching.

[0121] Optionally, after step 102: generating first display content for representing a change in a control parameter of the remote controller according to the control parameter information and the parameter display template, the method further includes:

[0122] A parameter image file is generated according to the first display content, wherein the parameter image file is used to be called when playing the environment image file to add the first display content to the environment image file for playback and display.

[0123] In an embodiment of the present invention, a parameter image file is generated based on the first display content and is used to configure the first display content, thereby adjusting the storage format of the first display content or adding configuration information to ensure that the first display content is automatically added to the environment image file for playback when the environment image file is played. For example, if a video file without subtitles and a subtitle file corresponding to the video file are played, the subtitle file will be called when the video file is played, and the text in the subtitle file will be automatically added to the video file for playback. However, the parameter image files in this embodiment of the present invention are not limited to subtitle files.

[0124] Optionally, the control parameter information includes control parameter values ​​collected at different times; see Figure 2 The above step 102: generating first display content for representing the change of the control parameter of the remote controller according to the control parameter information and the parameter display template, includes:

[0125] Step 1021, adjusting the parameter display template according to the control parameter value, and generating a parameter display template image representing the control parameter value at different times;

[0126] In this step, different control parameters correspond to different parameter display templates. Here, the control parameter values ​​of the same control parameter at different times can be considered a group of control parameters, so that the control parameter information includes at least one group of control parameters, and each group of control parameters corresponds to a parameter display template. Thus, the generated parameter display template images include at least one group of parameter display template images, each group of parameter display template images corresponding to a group of control parameters. Preferably, the parameter display template can be a virtual instrument panel template image, but is not limited thereto.

[0127] Taking the parameter display template as a virtual instrument panel template image as an example, when the control parameter information only includes a set of stick quantity change parameters, the parameter display template corresponding to the control parameter information can be a virtual joystick image, which includes a first joystick identifier and a second joystick identifier representing two joysticks, and each joystick identifier is located at the center of a circular coordinate, and the two circular coordinates do not overlap. Of course, the specific display form of the virtual joystick image is not limited to this. This is just an example of a virtual joystick image. According to the parameter values ​​in the set of stick quantity change parameters and in the order of acquisition time from early to late, the position of the joystick identifier in each virtual joystick image is adjusted respectively to obtain a set of virtual joystick images; wherein, each virtual joystick image in the obtained set of virtual joystick images corresponds to a parameter value in the set of stick quantity change parameters.

[0128] Step 1022 : Generate first display content based on the parameter display template image at different times.

[0129] In an embodiment of the present invention, parameter display template images at different times can be synthesized into a video file, and the synthesized video file can be used as the first display content. Therefore, when the environment image file needs to be played, the first display content and the environment image file can be synthesized using video synthesis technology to play the synthesized video file.

[0130] Optionally, the control parameter information includes control parameter values ​​collected at different times; see Figure 3 The above step 102: generating first display content for representing the change of the control parameter of the remote controller according to the control parameter information and the parameter display template, includes:

[0131] Step 1023 : Adjust the parameter display template according to the control parameter value, and generate a display object representing the control parameter value at different times.

[0132] In this step, the parameter display template can be a configuration file template, in which the display content and display form to be configured are set. The generated display object includes the display content and the display form. Specifically, the display object includes: at least one of numbers, letters, special symbols, and object identifiers. Different numbers indicate different control parameter values, and there is a fixed ratio between the corresponding numbers and the control parameter values. Similarly, different letters, different special symbols, and different object identifiers indicate different control parameter values. For example, the display object can represent the direction parameter value in the control parameter value by arrows of different directions in special symbols; and represent the deflection angle in the control parameter value by numbers. The display form includes arrows, the position of digital display, or special effects. Special effects include changes in color, changes in display position, changes in display size, etc.

[0133] Step 1024: Generate first display content according to the display objects at different times.

[0134] In embodiments of the present invention, a configuration file can be generated based on display objects at different times, and this configuration file can be used as the first display content. This configuration file can be, but is not limited to, a subtitle configuration file. When the first display content is a subtitle configuration file, the subtitle configuration file is read during playback of the ambient image file, and the content configured therein is displayed together with the ambient image.

[0135] Optionally, the control parameter information includes at least one of the following: stick amount change parameter, gimbal angle control parameter, video recording control parameter, photo taking control parameter, flight mode control parameter, return home control parameter, and playback control parameter.

[0136] In an embodiment of the present invention, the control parameter information is the parameters of the remote controller used to control the drone and all electronic devices carried by the drone. Specifically, the control parameter information can be any one or any combination of stick change parameters, gimbal angle control parameters, video recording control parameters, photo control parameters, flight mode control parameters, return control parameters, and playback control parameters. Here, the stick change parameters include the parameters of each joystick of the remote controller; the gimbal angle control parameters include the gimbal posture of the drone or the shooting angle of the camera; the video recording control parameters include parameters for controlling the camera to start or stop recording; the photo control parameters include parameters for controlling the camera to take photos; the flight mode control parameters include parameters for controlling the drone to be in P mode, A mode, or F mode; the return control parameters include parameters for controlling the drone to perform a return operation; and the playback control parameters include parameters for controlling the playback of captured images or videos.

[0137] Optional, see Figure 4 , the method for generating display content further includes:

[0138] Step 401: Acquire flight parameter information of the UAV during the flight in response to control parameter information of the remote controller.

[0139] In this step, the flight parameter information includes at least one parameter used to characterize the flight status of the drone. Specifically, the flight parameter information includes at least one of the following: the drone's attitude parameter, the drone's air pressure parameter, the drone's positioning parameter, the drone's speed parameter, the drone's acceleration parameter, and the drone's route parameter. The drone's attitude, air pressure, positioning, speed, and acceleration can be obtained through detection equipment installed on the drone. Preferably, the drone includes at least two detection modules, and different detection modules are used to detect different flight parameters of the drone;

[0140] Obtaining the flight parameter information of the UAV during the flight in response to the control parameter information of the remote controller, including:

[0141] According to the parameter display template selected by the user, determine the detection module corresponding to the selected parameter display template;

[0142] During the flight process of obtaining the control parameter information of the UAV in response to the remote controller, the flight parameters detected by the detection module corresponding to the selected parameter display template are displayed.

[0143] like Figure 5The figure shows a schematic diagram of the process of obtaining flight parameter information and control parameter information provided by an embodiment of the present invention. The user can select a parameter display template in the camera video settings of the drone. The camera module collects remote control stick changes, gyroscope data, barometer data, GPS (Global Positioning System) module data, accelerometer data, and other parameters, such as corresponding parameters of the perception, navigation, flight control, and other modules. Based on the selected parameter display template, corresponding data is selected from the collected data to generate the first display content and the second display content.

[0144] Step 402 : Generate second display content for representing changes in the flight parameters of the UAV based on the flight parameter information and the parameter display template.

[0145] In this step, the second display content can be in the form of images, text, tables, videos, etc. to display the control parameter changes, but is not limited to these. The second display content is added to the environment image file for playback. In other words, when the environment image file is playing, the first and second display content will be played simultaneously on the playback screen.

[0146] In this embodiment of the present invention, while generating first display content representing changes in remote control parameters, second display content representing changes in the drone's flight parameters is also generated based on flight parameter information and a parameter display template. This allows for the simultaneous display of images captured during drone flight, along with the corresponding control and flight parameters, making it easier for users to learn how to control the drone, enriching the visual content and making the displayed images more instructive. This overcomes the limitations of on-site drone instruction.

[0147] Optionally, when the control parameters in the control parameter information meet the parameter conditions corresponding to the preset control state, preset control state reminder information is generated; and the preset control state reminder information is added to the first display content.

[0148] In embodiments of the present invention, the preset control states may be special control states of the remote control, such as the remote control state for controlling a drone to maintain flight, the remote control state for controlling a drone to return home with one button, the remote control state for controlling a drone to advance at full speed, or the remote control state for controlling a drone to climb at full speed. The user can determine which special control states are and set corresponding parameter conditions. Specifically, at least one parameter condition can be pre-set, with each parameter condition corresponding to a control state reminder message. When it is detected that a control parameter in the control parameter information meets a certain parameter condition, the corresponding control state reminder message is selected and added to the first display content, thereby simultaneously displaying the control state reminder message with the first display content. Preferably, a fixed time window can be set, within which the control state reminder message is displayed. For example, at a target time, when it is detected that a control parameter in the control parameter information meets a first parameter condition, a first control state reminder message corresponding to the first parameter condition is selected and added to the target time window of the first display content, where the target time falls within the target time window. In this way, when displaying the first display content, when the target time window is reached, the first control status reminder information starts to be displayed, and when the target time window is reached, the first control status reminder information stops being displayed.

[0149] The control status reminder information may be at least one of a fixed number, a subtitle, a special symbol, or an object identifier. Alternatively, it may be configuration information for controlling the display format of the first display content. For example, when the status reminder information is displayed, the display format of the first display content is adjusted to a target display format, where the target display format may be a color change, a display position change, or the like.

[0150] Optionally, when the flight parameters in the flight parameter information meet the parameter conditions corresponding to the preset flight status, preset flight status reminder information is generated; and the preset flight status reminder information is added to the second display content.

[0151] In this embodiment of the present invention, the preset control state can be some special flight state of the drone, such as a flight altitude exceeding a safe altitude. The process of generating flight state reminder information and adding it to the second display content is similar to the process of generating control state reminder information and adding it to the first display content described above, and will not be repeated here.

[0152] like Figure 6 As shown, in another aspect of the present invention, an image generation method is also provided, the image generation method comprising:

[0153] Step 601: Obtain control parameter information of the remote controller for the drone.

[0154] In embodiments of the present invention, the remote control continuously transmits control parameter information to the drone during flight control. The drone can recognize this control parameter information and respond to it, operating according to the control parameter information. This control parameter information can be a variable control parameter. Upon receiving this variable control parameter, the drone will then adjust pitch, roll, or yaw based on its specific content. Of course, the control parameter information is not limited to this; it can be any one or more parameters sent by the remote control to control the drone.

[0155] Step 602: Generate first display content for representing changes in the control parameters of the remote controller according to the control parameter information and the parameter display template.

[0156] In the embodiment of the present invention, the first display content may display the change of the control parameter in the form of images, text, tables, videos, etc., but is not limited thereto.

[0157] Step 603: Acquire an environmental image file captured by the drone during flight in response to the control parameter information of the remote controller.

[0158] In this step, the environment image file may be an original image file obtained by shooting, or may be an image file obtained by processing the original image file.

[0159] Step 604 : synthesize a target image file according to the first display content and the environment image file.

[0160] In this step, while the drone is being controlled by the remote controller, the environment image file and the first display content respectively record the changes in the control parameters and the environment image captured by the drone during the same time period. This allows the environment image and control parameters to be displayed synchronously when the target image file is played.

[0161] In an embodiment of the present invention, control parameter information for a drone controlled by a remote controller can be obtained; this control parameter information includes control information during the remote controller's flight. Based on a parameter display template and the obtained control parameter information, first display content representing changes in the remote controller's control parameters is generated. Then, an environmental image file captured during the drone's flight in response to the remote controller's control parameter information is obtained, and a target image file is synthesized based on the first display content and the environmental image file. This allows the images captured during the drone's flight and the corresponding control parameters to be displayed on the same screen, facilitating user learning to control the drone and making the displayed images more instructive. This overcomes the limitations of on-site drone instruction.

[0162] Optionally, the control parameter information includes control parameter values ​​collected at different times; the above step 602: generating first display content for representing the change of the control parameter of the remote control according to the control parameter information and the parameter display template, includes:

[0163] Adjust the parameter display template according to the control parameter value, and generate a parameter display template image representing the control parameter value at different times;

[0164] Specifically, this step may refer to the aforementioned step 1021, and the embodiment of the present invention will not be described in detail here.

[0165] The first display content is generated according to the parameter display template image at different times.

[0166] Specifically, this step may refer to the aforementioned step 1022, and the embodiment of the present invention will not be described in detail here.

[0167] Optionally, the above step 604: synthesizing the target image file according to the first display content and the environment image file includes:

[0168] According to the first time corresponding to the parameter display template image and the second time corresponding to different video frames in the environment image file, each parameter display template image and a video frame are synthesized into a frame image;

[0169] Generate target image files based on the synthesized multi-frame images.

[0170] In an embodiment of the present invention, the first time is the acquisition time of the control parameters corresponding to the parameter display template image; the second time is the time for generating the video frame. The duration between the first time corresponding to the parameter display template image and the second time corresponding to the video frame for synthesizing the same frame image is less than a preset threshold. The preset threshold is a relatively small value. When the duration between the two times is less than the preset threshold, it can be understood that the two times are equal and are the same moment. That is, the parameter display template image and the video frame at the same moment are synthesized into one frame image. This ensures that the parameter display template image and the environment image file in the target image file have good time synchronization. Of course, frame alignment technology and video synthesis technology can also be used to generate the target image file, which will not be repeated here.

[0171] Optionally, the control parameter information includes control parameter values ​​collected at different times; the above step 602: generating first display content for representing the change of the control parameter of the remote control according to the control parameter information and the parameter display template, includes:

[0172] Adjust the parameter display template according to the control parameter value to generate a display object representing the control parameter value at different times; the display object includes at least one of: numbers, letters, special symbols, and object identification;

[0173] Specifically, this step may refer to the aforementioned step 1023, and the embodiment of the present invention will not be described in detail here.

[0174] The first display content is generated according to the display objects at different times.

[0175] Specifically, this step may refer to the aforementioned step 1024, and the embodiment of the present invention will not be described in detail here.

[0176] Optionally, the above step 604: synthesizing the target image file according to the first display content and the environment image file includes:

[0177] Based on a first time corresponding to the display object and a second time corresponding to different video frames in the environment image file, each display object is embedded in a video frame to obtain a frame of image; wherein the duration between the first time corresponding to the display object and the second time corresponding to the video frame in the same frame of image is less than a preset threshold; the first time is the time when the control parameters corresponding to the display object are collected; and the second time is the time when the video frame is generated;

[0178] Generate target image files based on the obtained multi-frame images.

[0179] In an embodiment of the present invention, the first time is the acquisition time of the control parameters corresponding to the display object; the second time is the time for generating the video frame. The duration between the first time corresponding to the display object and the second time corresponding to the video frame of the same frame image is less than a preset threshold. The preset threshold is a relatively small value. When the duration between the two times is less than the preset threshold, it can be understood that the two times are equal and are at the same moment. That is, the display object and the video frame at the same moment are synthesized into one frame of image. This ensures that the display object in the target image file and the environment image file have good time synchronization. Of course, a non-embedded method can also be used to generate the target image file. For example, the display object can be set to the configuration file of the environment image file, so that the target image file includes the environment image file and the configuration file. When the target image file is played, the display object is displayed simultaneously in the playback screen of the environment image file by playing the environment image file and calling the configuration file.

[0180] Optionally, the image generation method further includes:

[0181] Acquiring flight parameter information of the UAV during flight in response to control parameter information of the remote controller;

[0182] In this step, the flight parameter information includes at least one parameter for characterizing the flight state of the drone. Specifically, the flight parameter information includes at least one of the following: the attitude parameter of the drone, the air pressure parameter of the drone, the positioning parameter of the drone, the speed parameter of the drone, the acceleration parameter of the drone, and the route parameter of the drone. Here, the attitude, air pressure, positioning, speed and acceleration of the drone can be obtained by detection equipment provided on the drone. Preferably, the drone includes at least two detection modules, and different detection modules are used to detect different flight parameters of the drone; obtaining the flight parameter information of the drone during the flight process in response to the control parameter information of the remote control includes: determining the detection module corresponding to the selected parameter display template according to the parameter display template selected by the user; obtaining the flight parameters detected by the detection module corresponding to the selected parameter display template during the flight process in response to the control parameter information of the remote control.

[0183] According to the flight parameter information and the parameter display template, second display content for representing the change of the flight parameters of the UAV is generated.

[0184] In this step, the second display content may be in the form of images, text, tables, videos, etc. to display the change of control parameters, but is not limited thereto.

[0185] Accordingly, synthesizing the target image file according to the first display content and the environment image file includes:

[0186] A target image file is synthesized according to the first display content, the second display content and the environment image file.

[0187] In this embodiment of the present invention, while generating first display content representing changes in remote control parameters, second display content representing changes in the drone's flight parameters is also generated based on flight parameter information and a parameter display template. This allows for the simultaneous display of images captured during drone flight, along with the corresponding control and flight parameters, making it easier for users to learn how to control the drone, enriching the visual content and making the displayed images more instructive. This overcomes the limitations of on-site drone instruction.

[0188] Optionally, the image generation method further includes: generating preset control state reminder information when the control parameters in the control parameter information meet the parameter conditions corresponding to the preset control state; and adding the preset control state reminder information to the first display content.

[0189] Specifically, this step may refer to the aforementioned specific process of generating the preset control state reminder information and adding the preset control state reminder information to the first display content, which will not be described in detail in this embodiment of the present invention.

[0190] Optionally, when the flight parameters in the flight parameter information meet the parameter conditions corresponding to the preset flight status, preset flight status reminder information is generated; and the preset flight status reminder information is added to the second display content.

[0191] Specifically, this step may refer to the aforementioned specific process of generating the preset flight status reminder information and adding the preset flight status reminder information to the second display content, which will not be described in detail in this embodiment of the present invention.

[0192] Optionally, the image generation method further includes:

[0193] Acquire the remote control image file obtained by the camera device during the flight process of the drone in response to the control parameter information of the remote control;

[0194] The target image file is synthesized according to the first display content and the environment image file, including:

[0195] A target image file is synthesized according to the first display content, the remote control image file and the environment image file.

[0196] In the embodiment of the present invention, the remote control image file obtained by photographing the remote control can also be synthesized into the target image file, so that the remote control operation screen obtained by photographing can be displayed together with the playing of the environment image screen.

[0197] like Figure 7 As shown, an embodiment of the present invention provides a device for generating display content, the device comprising:

[0198] Remote control information acquisition module 71, used to obtain the control parameter information of the remote controller on the drone;

[0199] The processor 72 is configured to generate first display content representing a change in the control parameter of the remote controller based on the control parameter information and the parameter display template;

[0200] The first display content is used to be added to the environment image file for playback and display, wherein the environment image file is captured by the drone during flight in response to control parameter information of the remote controller.

[0201] Optionally, the device further includes:

[0202] The image configuration module is used to generate a parameter image file according to the first display content, wherein the parameter image file is used to be called when playing the environment image file to add the first display content to the environment image file for playback and display.

[0203] Optionally, the control parameter information includes control parameter values ​​collected at different times; the processor is specifically used to adjust the parameter display template according to the control parameter values, generate a parameter display template image representing the control parameter values ​​at different times; and generate the first display content according to the parameter display template image at different times.

[0204] Optionally, the control parameter information includes control parameter values ​​collected at different times; the processor is specifically used to adjust the parameter display template according to the control parameter values, and generate display objects representing the control parameter values ​​at different times; the display objects include: at least one of: numbers, letters, special symbols, and object identifiers; and the first display content is generated according to the display objects at different times.

[0205] Optionally, the device further includes:

[0206] A flight information acquisition module is used to obtain flight parameter information of the UAV during flight in response to the control parameter information of the remote controller;

[0207] The processor is further configured to generate second display content for characterizing changes in the flight parameters of the UAV based on the flight parameter information and the parameter display template.

[0208] Optionally, the drone includes at least two detection modules, and different detection modules are used to detect different flight parameters of the drone; a flight information acquisition module is specifically used to determine the detection module corresponding to the selected parameter display template based on the parameter display template selected by the user; and obtain the flight parameters detected by the detection module corresponding to the selected parameter display template during the flight process of the drone in response to the control parameter information of the remote control.

[0209] Optionally, the device further includes:

[0210] a reminder module, configured to generate preset control state reminder information when the control parameters in the control parameter information meet the parameter conditions corresponding to the preset control state;

[0211] The processor is further configured to add preset control status reminder information to the first display content.

[0212] The display content generation device provided in the embodiment of the present invention is used to execute each step in the above-mentioned display content generation method and can achieve the same technical effect. To avoid repetition, it will not be described here.

[0213] In an embodiment of the present invention, control parameter information of a drone controlled by a remote controller can be obtained; this control parameter information includes control information during the flight of the drone controlled by the remote controller. Based on a parameter display template and the obtained control parameter information, first display content representing changes in the control parameters of the remote controller is generated. This first display content is added to an environmental image file for playback and display, wherein the environmental image file is captured by the drone during flight in response to the control parameter information of the remote controller. This allows the images captured during the drone flight and the corresponding control parameters to be displayed on the same screen, making it easier for users to learn how to control the drone and making the displayed images more instructive. This overcomes the limitations of on-site drone teaching.

[0214] like Figure 8 As shown, an embodiment of the present invention provides an image generation device, which includes:

[0215] Remote control information acquisition module 81, used to obtain the control parameter information of the remote controller on the UAV;

[0216] The processor 82 is configured to generate first display content representing a change in the control parameter of the remote controller according to the control parameter information and the parameter display template;

[0217] The first image acquisition device 83 is used to obtain an environmental image file captured by the UAV during flight in response to the control parameter information of the remote controller;

[0218] The processor 82 is further configured to synthesize a target image file according to the first display content and the environment image file.

[0219] Optionally, the control parameter information includes control parameter values ​​collected at different times; the processor is specifically used to adjust the parameter display template according to the control parameter values, and generate a parameter display template image representing the control parameter values ​​at different times; and generate the first display content according to the parameter display template image at different times.

[0220] Optionally, the processor is specifically used to synthesize each parameter display template image and a video frame into a frame image based on the first time corresponding to the parameter display template image and the second time corresponding to different video frames in the environmental image file; wherein the duration between the first time corresponding to the parameter display template image and the second time corresponding to the video frame for synthesizing the same frame image is less than a preset threshold; the first time is the acquisition time of the control parameters corresponding to the parameter display template image; the second time is the time for generating the video frame; and a target image file is generated based on the synthesized multiple frames of images.

[0221] Optionally, the control parameter information includes control parameter values ​​collected at different times; the processor is specifically used to adjust the parameter display template according to the control parameter values, and generate display objects representing the control parameter values ​​at different times; the display objects include: at least one of: numbers, letters, special symbols, and object identifiers; and the first display content is generated according to the display objects at different times.

[0222] Optionally, the processor is specifically used to embed each display object into a video frame to obtain a frame of image based on a first time corresponding to the display object and a second time corresponding to different video frames in the environmental image file; wherein the duration between the first time corresponding to the display object and the second time corresponding to the video frame of the same frame of image is less than a preset threshold; the first time is the acquisition time of the control parameters corresponding to the display object; the second time is the time for generating the video frame; and a target image file is generated based on the obtained multiple frames of image.

[0223] Optionally, the device further includes:

[0224] A flight information acquisition module is used to obtain flight parameter information of the UAV during flight in response to the control parameter information of the remote controller;

[0225] The processor is further configured to generate second display content for representing changes in the flight parameters of the UAV based on the flight parameter information and the parameter display template;

[0226] The processor is further configured to synthesize a target image file according to the first display content, the second display content and the environment image file.

[0227] Optionally, the drone includes at least two detection modules, and different detection modules are used to detect different flight parameters of the drone;

[0228] The flight information acquisition module is specifically used to determine the detection module corresponding to the selected parameter display template based on the parameter display template selected by the user; and obtain the flight parameters detected by the detection module corresponding to the selected parameter display template during the flight process of the drone in response to the control parameter information of the remote control.

[0229] Optionally, the device further includes:

[0230] a reminder module, configured to generate preset control state reminder information when the control parameters in the control parameter information meet the parameter conditions corresponding to the preset control state;

[0231] The processor is further configured to add preset control status reminder information to the parameter image file.

[0232] Optionally, the device further includes:

[0233] The second image acquisition device is used to obtain the remote control image file obtained by the camera device shooting the remote control during the flight of the UAV in response to the control parameter information of the remote control;

[0234] The processor is further used to synthesize the target image file according to the parameter image file, the remote control image file and the environment image file.

[0235] The image generation device provided in the embodiment of the present invention is used to execute each step in the above-mentioned image generation method and can achieve the same technical effect. To avoid repetition, it will not be described here.

[0236] In an embodiment of the present invention, control parameter information for a drone controlled by a remote controller can be obtained; this control parameter information includes control information during the remote controller's flight. Based on a parameter display template and the obtained control parameter information, first display content representing changes in the remote controller's control parameters is generated. Then, an environmental image file captured during the drone's flight in response to the remote controller's control parameter information is obtained, and a target image file is synthesized based on the first display content and the environmental image file. This allows the images captured during the drone's flight and the corresponding control parameters to be displayed on the same screen, facilitating user learning to control the drone and making the displayed images more instructive. This overcomes the limitations of on-site drone instruction.

[0237] Optionally, an embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, it implements each step in the above-mentioned display content generation method or image generation method, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0238] Figure 9 This is a schematic diagram of the hardware structure of a device for implementing various embodiments of the present invention. The device 900 includes but is not limited to: a radio frequency unit 901, a network module 902, an audio output unit 903, an input unit 904, a sensor 905, a display unit 906, a user input unit 907, an interface unit 908, a memory 909, a processor 910, and a power supply 911. Those skilled in the art will understand that Figure 9The device structure shown does not limit the device; the device may include more or fewer components than shown, or combine certain components, or have a different component arrangement. In embodiments of the present invention, the device includes, but is not limited to, a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle device, a wearable device, and a pedometer. It should be understood that the RF unit 901 can be used to receive and transmit signals during messaging or phone calls. It receives downlink data from the base station and passes it to the processor 910 for processing; it sends uplink data to the base station. Typically, the RF unit 901 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low-noise amplifier, a duplexer, and the like. Furthermore, the RF unit 901 can communicate with the network and other devices via a wireless communication system. The device provides users with wireless broadband internet access via the network module 902, enabling them to send and receive emails, browse the web, and access streaming media. The audio output unit 903 converts audio data received by the RF unit 901 or the network module 902 or stored in the memory 909 into audio signals and outputs them as sound. Furthermore, the audio output unit 903 can also provide audio output related to specific functions performed by the device 900 (e.g., call signal reception sound, message reception sound, etc.). The audio output unit 903 includes a speaker, a buzzer, and a receiver. The input unit 904 is used to receive audio or video signals. The input unit 904 may include a graphics processing unit (GPU) 9041 and a microphone 9042. The GPU 9041 processes image data of still images or videos obtained by an image capture device (e.g., a camera) in video capture mode or image capture mode. The processed image frames can be displayed on the display unit 906. The image frames processed by the GPU 9041 can be stored in the memory 909 (or other storage medium) or transmitted via the RF unit 901 or the network module 902. The microphone 9042 can receive sound and process such sound into audio data. In phone call mode, the processed audio data can be converted into a format that can be transmitted to a mobile communication base station via the RF unit 901. The device 900 also includes at least one sensor 905, such as a light sensor, a motion sensor, or other sensors. The light sensor includes an ambient light sensor and a proximity sensor. The ambient light sensor can adjust the brightness of the display panel 9061 based on the brightness of the ambient light, and the proximity sensor can turn off the display panel 9061 and / or backlight when the device 900 is moved to the ear.As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used to identify the device posture (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; the sensor 905 can also include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, etc., which are not repeated here. The display unit 906 is used to display information input by the user or information provided to the user. The display unit 906 may include a display panel 9061, which can be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc. The user input unit 907 can be used to receive input digital or character information, and generate key signal input related to the user settings and function control of the device. Specifically, the user input unit 907 includes a touch panel 9041 and other input devices 9072. The touch panel 9041, also known as a touch screen, can collect user touch operations on or near it (such as operations performed by the user using any suitable object or accessory such as a finger, stylus, etc. on or near the touch panel 9041). The touch panel 9041 may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch direction, detects the signal caused by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device and converts it into contact coordinates, which are then sent to the processor 910, which receives the command sent by the processor 910 and executes it. In addition, the touch panel 9041 can be implemented using various types such as resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 9041, the user input unit 907 may also include other input devices 9072. Specifically, other input devices 9072 may include but are not limited to physical keyboards, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, and joysticks, which will not be repeated here. Furthermore, the touch panel 9041 can be overlaid on the display panel 9061. When the touch panel 9041 detects a touch operation on or near it, it is transmitted to the processor 910 to determine the type of touch event. Subsequently, the processor 910 provides a corresponding visual output on the display panel 9061 according to the type of touch event. Although the touch panel 9041 and the display panel 9061 are two independent components to implement the input and output functions of the device, in some embodiments, the touch panel 9041 and the display panel 9061 can be integrated to implement the input and output functions of the device, which is not limited here. The interface unit 908 is an interface for connecting external devices to the device 900.For example, external devices may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting to a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headphone port, and the like. The interface unit 908 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more components within the device 900, or may be used to transmit data between the device 900 and an external device. The memory 909 may be used to store software programs and various data. The memory 909 may primarily include a program storage area and a data storage area. The program storage area may store an operating system, application programs required for at least one function (e.g., sound playback function, image playback function, etc.), and the data storage area may store data generated based on the use of the mobile phone (e.g., audio data, phone book, etc.). Furthermore, the memory 909 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state memory device. The processor 910 is the device's control center, connecting the various components of the device using various interfaces and circuits. By running or executing software programs and / or modules stored in the memory 909 and accessing data stored in the memory 909, it performs various device functions and processes data, thereby providing overall device monitoring. The processor 910 may include one or more processing units. Preferably, the processor 910 may integrate an application processor and a modem processor, with the application processor primarily processing the operating system, user interface, and application programs, while the modem processor primarily handles wireless communications. It is understood that the modem processor may not be integrated into the processor 910. The device 900 may also include a power supply 911 (such as a battery) to power the various components. Preferably, the power supply 911 may be logically connected to the processor 910 via a power management system, enabling the power management system to manage charging, discharging, and power consumption. Furthermore, the device 900 includes several functional modules not shown, which will not be described in detail here.

[0239] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed across multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the present embodiment. A person of ordinary skill in the art may understand and implement the present invention without inventive effort. The various component embodiments of the present invention may be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. A person of ordinary skill in the art should understand that a microprocessor or a digital signal processor may be used in practice to implement some or all of the functions of some or all of the components in the computing and processing device according to an embodiment of the present invention. The present invention may also be implemented as a device or apparatus program (e.g., a computer program and a computer program product) for executing part or all of the methods described herein. Such a program for implementing the present invention may be stored on a computer-readable medium, or may be in the form of one or more signals. Such a signal may be downloaded from an Internet website, or provided on a carrier signal, or provided in any other form. For example, Figure 10 A block diagram of a computing and processing device provided in an embodiment of the present invention, such as Figure 10 As shown, Figure 10 A computing processing device that can implement the method according to the present invention is shown. The computing processing device conventionally includes a processor 510 and a computer program product or computer-readable medium in the form of a memory 520. The memory 520 can be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read-only memory), an EPROM, a hard disk or a ROM. The memory 520 has a storage space 530 for program codes for executing any method steps in the above method. For example, the storage space 530 for program codes can include individual program codes for implementing various steps in the above method respectively. These program codes can be read from or written to one or more computer program products. These computer program products include program code carriers such as a hard disk, a compact disk (CD), a memory card or a floppy disk. Such a computer program product is usually as described in reference Figure 11 The portable or fixed storage unit. The storage unit may have Figure 10Memory segments, storage spaces, etc., arranged similarly to memory 520 in the processing device. The program code can be compressed, for example, in an appropriate form. Typically, the storage unit includes computer-readable code, i.e., code that can be read by a processor, such as 510, and which, when executed by the processing device, causes the processing device to perform the steps of the method described above. The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on its differences from the other embodiments. References to "one embodiment," "an embodiment," or "one or more embodiments" herein mean that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Furthermore, please note that instances of the phrase "in one embodiment" herein do not necessarily refer to the same embodiment. Numerous specific details are described in the description provided herein. However, it is understood that embodiments of the present invention can be practiced without these specific details. In some instances, well-known methods, structures, and techniques are not described in detail to avoid obscuring the understanding of this specification. In the claims, any reference signs placed between parentheses should not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in the claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The present invention may be implemented by means of hardware comprising several different elements and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means may be embodied by the same item of hardware. The use of the words first, second, and third etc. does not indicate any order. These words may be interpreted as names. Finally, it should be noted that the above embodiments are only intended to illustrate the technical solutions of the present invention, not to limit them; although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they may still modify the technical solutions described in the aforementioned embodiments, or make equivalent substitutions for some of the technical features therein; and these modifications or substitutions do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims

1. A method for generating display content, characterized in that: The method comprises: Get the control parameter information of the remote controller for the aircraft; Generate first display content for representing the control parameter information according to the control parameter information and a parameter display template; wherein the parameter display template is a virtual instrument panel template image; The first display content is added to an environment image file for playback and display, the environment image file being obtained by the aircraft capturing an environment image in response to the control parameter information, and the playback and display comprising: displaying the environment image and superimposing the control parameter information corresponding to the captured environment image on the environment image; Wherein, the control parameter information includes control parameter values ​​collected at different times; The generating, according to the control parameter information and the parameter display template, first display content for representing the control parameter information includes: Adjust the parameter display template according to the control parameter value to generate a parameter display template image representing the control parameter value at different times; generating the first display content according to the parameter display template images at different times; Alternatively, the parameter display template is adjusted according to the control parameter value to generate a display object representing the control parameter value at different times; the display object includes: at least one of a number, a letter, a special symbol, and an object identifier; The first display content is generated according to the display objects at different times.

2. The method according to claim 1, characterized in that The method further comprises: A parameter image file is generated according to the first display content, wherein the parameter image file is used to be called when playing the environment image file to add the first display content to the environment image file for playback and display.

3. The method according to claim 1, characterized in that The control parameter information includes at least one of the following: a stick amount change parameter, a gimbal angle control parameter, a video recording control parameter, a photo taking control parameter, a flight mode control parameter, a return control parameter, and a playback control parameter.

4. The method according to claim 1, wherein The method further comprises: Acquiring flight parameter information of the aircraft during flight in response to the control parameter information of the remote controller; Second display content for representing changes in the flight parameters of the aircraft is generated based on the flight parameter information and the parameter display template.

5. The method according to claim 4, characterized in that The aircraft comprises at least two detection modules, and different detection modules are used to detect different flight parameters of the aircraft; The acquiring of flight parameter information of the aircraft during the flight in response to the control parameter information of the remote controller includes: According to the parameter display template selected by the user, determine the detection module corresponding to the selected parameter display template; Acquiring the flight parameters detected by the detection module corresponding to the selected parameter display template during the flight of the aircraft in response to the control parameter information of the remote controller.

6. The method according to claim 4, characterized in that The flight parameter information includes at least one of the following: an attitude parameter of the aircraft, an air pressure parameter of the aircraft, a positioning parameter of the aircraft, a speed parameter of the aircraft, an acceleration parameter of the aircraft, and a route parameter of the aircraft.

7. The method according to claim 1, characterized in that The method further comprises: When the control parameters in the control parameter information meet the parameter conditions corresponding to the preset control state, generating preset control state reminder information; The preset control state reminder information is added to the first display content.

8. An image generation method, characterized in that: The method comprises: Get the control parameter information of the remote controller for the aircraft; Generate first display content for representing the control parameter information according to the control parameter information and a parameter display template; wherein the parameter display template is a virtual instrument panel template image; Acquiring an environmental image file obtained by photographing an environmental image by the aircraft in response to the control parameter information; synthesizing a target image file according to the first display content and the environment image file, wherein the target image file displays the environment image when played, and superimposes the control parameter information corresponding to the environment image on the environment image; The control parameter information includes control parameter values ​​collected at different times; and generating first display content representing the control parameter information based on the control parameter information and a parameter display template includes: Adjust the parameter display template according to the control parameter value to generate a parameter display template image representing the control parameter value at different times; generating the first display content according to the parameter display template images at different times; Alternatively, the parameter display template is adjusted according to the control parameter value to generate a display object representing the control parameter value at different times; the display object includes: at least one of a number, a letter, a special symbol, and an object identifier; The first display content is generated according to the display objects at different times.

9. The method according to claim 8, characterized in that The synthesizing a target image file according to the first display content and the environment image file includes: synthesizing each of the parameter display template images and a video frame into a single image frame based on a first time corresponding to the parameter display template image and a second time corresponding to different video frames in the environmental image file; wherein the duration between the first time corresponding to the parameter display template image and the second time corresponding to the video frame synthesized into the same image frame is less than a preset threshold; the first time is the acquisition time of the control parameters corresponding to the parameter display template image; and the second time is the time when the video frame is generated; Generate target image files based on the synthesized multi-frame images.

10. The method according to claim 8, characterized in that The synthesizing a target image file according to the first display content and the environment image file includes: Embed each display object into a video frame to obtain a frame of image based on a first time corresponding to the display object and a second time corresponding to different video frames in the environmental image file; wherein the duration between the first time corresponding to the display object and the second time corresponding to the video frame in the same frame of the image is less than a preset threshold; the first time is the time when the control parameters corresponding to the display object are collected; and the second time is the time when the video frame is generated; Generate target image files based on the obtained multi-frame images.

11. The method according to claim 8, characterized in that The method further comprises: Acquiring flight parameter information of the aircraft during flight in response to the control parameter information of the remote controller; generating, based on the flight parameter information and the parameter display template, second display content for characterizing changes in the flight parameters of the aircraft; The synthesizing a target image file according to the first display content and the environment image file includes: A target image file is synthesized according to the first display content, the second display content and the environment image file.

12. The method according to claim 11, characterized in that The aircraft comprises at least two detection modules, and different detection modules are used to detect different flight parameters of the aircraft; The acquiring of flight parameter information of the aircraft during the flight in response to the control parameter information of the remote controller includes: According to the parameter display template selected by the user, determine the detection module corresponding to the selected parameter display template; Acquiring the flight parameters detected by the detection module corresponding to the selected parameter display template during the flight of the aircraft in response to the control parameter information of the remote controller.

13. The method according to claim 8, characterized in that The method further comprises: When the control parameters in the control parameter information meet the parameter conditions corresponding to the preset control state, generating preset control state reminder information; The preset control state reminder information is added to the first display content.

14. The method according to claim 8, characterized in that The method further comprises: Acquiring a remote control image file obtained by capturing the remote control by a camera device during the flight of the aircraft in response to the control parameter information of the remote control; The synthesizing a target image file according to the first display content and the environment image file includes: A target image file is synthesized according to the first display content, the remote control image file and the environment image file.

15. A device for generating display content, characterized in that: The device comprises: Remote control information acquisition module, used to obtain the control parameter information of the remote controller on the aircraft; A processor, configured to generate first display content representing the control parameter information based on the control parameter information and a parameter display template; wherein the parameter display template is a virtual instrument panel template image; The first display content is added to an environment image file for playback and display, the environment image file being obtained by the aircraft capturing an environment image in response to the control parameter information, and the playback and display comprising: displaying the environment image and superimposing the control parameter information corresponding to the captured environment image on the environment image; Among them, the control parameter information includes control parameter values ​​collected at different times; the processor is specifically used to adjust the parameter display template according to the control parameter values, and generate a parameter display template image representing the control parameter values ​​at different times; the first display content is generated according to the parameter display template image at different times; or, the processor is specifically used to adjust the parameter display template according to the control parameter values, and generate a display object representing the control parameter values ​​at different times; the display object includes: at least one of: numbers, letters, special symbols, and object identifications; the first display content is generated according to the display object at different times.

16. The device according to claim 15, characterized in that The device further comprises: An image configuration module is used to generate a parameter image file according to the first display content, wherein the parameter image file is used to be called when playing the environment image file to add the first display content to the environment image file for playback and display.

17. The device according to claim 15, characterized in that The device further comprises: a flight information acquisition module, configured to acquire flight parameter information of the aircraft during flight in response to the control parameter information of the remote controller; The processor is further configured to generate second display content for characterizing changes in the flight parameters of the aircraft based on the flight parameter information and the parameter display template.

18. The device according to claim 17, characterized in that The aircraft comprises at least two detection modules, and different detection modules are used to detect different flight parameters of the aircraft; The flight information collection module is specifically used to determine the detection module corresponding to the selected parameter display template based on the parameter display template selected by the user; and obtain the flight parameters detected by the detection module corresponding to the selected parameter display template during the flight of the aircraft in response to the control parameter information of the remote controller.

19. The device according to claim 15, characterized in that The device further comprises: a reminder module, configured to generate preset control state reminder information when the control parameters in the control parameter information meet the parameter conditions corresponding to the preset control state; The processor is further configured to add the preset control status reminder information to the first display content.

20. An image generating device, characterized in that: The device comprises: Remote control information acquisition module, used to obtain the control parameter information of the remote controller on the aircraft; a processor, configured to generate first display content representing a change in the control parameter of the remote controller based on the control parameter information and a parameter display template; wherein the parameter display template is a virtual instrument panel template image; a first image acquisition device, configured to acquire an environmental image file obtained by the aircraft shooting an environmental image in response to the control parameter information; The processor is further configured to synthesize a target image file based on the first display content and the environmental image file, wherein when the target image file is played, the environmental image is displayed, and the control parameter information corresponding to the environmental image is superimposed and displayed on the environmental image; Among them, the control parameter information includes control parameter values ​​collected at different times; the processor is specifically used to adjust the parameter display template according to the control parameter values, and generate parameter display template images representing the control parameter values ​​at different times; generate the first display content according to the parameter display template images at different times; or, the processor is specifically used to adjust the parameter display template according to the control parameter values, and generate display objects representing the control parameter values ​​at different times; the display objects include: at least one of: numbers, letters, special symbols, and object identifiers; and generate the first display content according to the display objects at different times.

21. The device according to claim 20, characterized in that The processor is specifically used to synthesize each parameter display template image and a video frame into a frame of image based on the first time corresponding to the parameter display template image and the second time corresponding to different video frames in the environmental image file; wherein the duration between the first time corresponding to the parameter display template image and the second time corresponding to the video frame for synthesizing the same frame of the image is less than a preset threshold; the first time is the acquisition time of the control parameters corresponding to the parameter display template image; the second time is the time for generating the video frame; and a target image file is generated based on the synthesized multiple frames of image.

22. The device according to claim 20, characterized in that The processor is specifically configured to embed each display object into a video frame to obtain a frame of image based on a first time corresponding to the display object and a second time corresponding to different video frames in the environmental image file; wherein the duration between the first time corresponding to the display object and the second time corresponding to the video frame in the same frame of the image is less than a preset threshold; the first time is the acquisition time of the control parameters corresponding to the display object; the second time is the time of generating the video frame; and a target image file is generated based on the obtained multiple frames of image.

23. The device according to claim 20, characterized in that The device further comprises: a flight information acquisition module, configured to acquire flight parameter information of the aircraft during flight in response to the control parameter information of the remote controller; The processor is further configured to generate second display content for representing a change in a flight parameter of the aircraft based on the flight parameter information and the parameter display template; The processor is further configured to synthesize a target image file according to the first display content, the second display content, and the environment image file.

24. The device according to claim 23, characterized in that The aircraft comprises at least two detection modules, and different detection modules are used to detect different flight parameters of the aircraft; The flight information collection module is specifically used to determine the detection module corresponding to the selected parameter display template based on the parameter display template selected by the user; and obtain the flight parameters detected by the detection module corresponding to the selected parameter display template during the flight of the aircraft in response to the control parameter information of the remote controller.

25. The device according to claim 20, characterized in that The device further comprises: a reminder module, configured to generate preset control state reminder information when the control parameters in the control parameter information meet the parameter conditions corresponding to the preset control state; The processor is further configured to add the preset control status reminder information to the first display content.

26. The device according to claim 20, characterized in that The device further comprises: a second image acquisition device, configured to obtain a remote control image file obtained by photographing the remote control by a camera device during the flight of the aircraft in response to the control parameter information of the remote control; The processor is further configured to synthesize a target image file according to the first display content, the remote control image file, and the environment image file.

27. An electronic device comprising a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein: When the computer program is executed by the processor, the computer program implements the steps of the method for generating display content according to any one of claims 1 to 7 or the method for generating images according to any one of claims 8 to 14.

28. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the computer program implements the steps of the method for generating display content according to any one of claims 1 to 7 or the method for generating images according to any one of claims 8 to 14.

Images