Software extension method, terminal device, removable platform, load and storage medium
By obtaining the load's control configuration file to display the interactive interface in the control software, the problem of terminal devices needing to frequently switch applications is solved, and convenient interaction between terminal devices and loads is achieved, reducing the development workload of load developers.
Patent Information
- Application Number
- CN201980067327.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-12-18
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2039-12-18
AI Technical Summary
When using loads from different manufacturers, terminal devices need to frequently switch different applications, which leads to inconvenience in use. Third-party manufacturers need to develop terminal devices' applications, which is difficult to develop and has a long cycle.
By obtaining the control configuration file of the load, displaying the interactive interface on the display interface of the control software according to the control configuration file, the interaction between the terminal device and the load is realized, reducing the development workload of the load developer.
Users can control the mobile platform and interact with the load without frequent switching of software, reducing the development difficulty and workload of load developers.
Smart Images

Figure CN112955868B_ABST
Abstract
Description
Technical Field
[0001] The present specification relates to the field of computer software technology, and in particular to a software expansion method, a terminal device, a mobile platform, a load and a storage medium. Background Art
[0002] Due to the wide expansion of the uses of mobile platforms such as drones, the types of loads that mobile platforms can carry are becoming more and more diverse, such as cameras, radars, etc. For open mobile platforms. Each third-party manufacturer can develop its own load to connect to the mobile platform. At present, the interaction between terminal devices and loads is generally achieved through terminal applications independently developed by the load manufacturer. If the end user purchases loads from different manufacturers and uses them on the same mobile platform, it is necessary to switch back and forth between the applications corresponding to different loads on the terminal device, causing inconvenience in use. Summary of the invention
[0003] Based on this, this specification provides a software expansion method, terminal device, removable platform, load and storage medium, aiming to expand the function of the removable platform control software on the terminal device according to the load carried by the removable platform, so as to realize the interaction between the terminal device and the load.
[0004] In a first aspect, the present specification provides a software extension method for a terminal device, wherein the terminal device is communicatively connected to a mobile platform, a load is mounted on the mobile platform, and the terminal device communicates with the load through the mobile platform; the terminal device is installed with control software for controlling the mobile platform; the method comprises:
[0005] Acquire a control configuration file of the load; wherein the control configuration file includes property information of at least one control;
[0006] The interactive interface of the load is displayed on the display interface of the control software according to the control configuration file; wherein the interactive interface is used to display the control.
[0007] In a second aspect, the present specification provides a software expansion method for a load carried on a movable platform, wherein the movable platform is communicatively connected to a terminal device, and the load communicates with the terminal device through the movable platform; the terminal device is installed with control software for controlling the movable platform; the method comprises:
[0008] Acquire a control configuration file of the load; wherein the control configuration file includes property information of at least one control;
[0009] The control configuration file is sent to the terminal device via the mobile platform, so that the terminal device can display the interactive interface of the load on the display interface of the control software according to the control configuration file; wherein the interactive interface is used to display the control.
[0010] In a third aspect, the present specification provides a software expansion method for a mobile platform, the mobile platform being communicatively connected to a terminal device, the mobile platform being equipped with a load, and the terminal device being installed with control software for controlling the mobile platform; the method comprising:
[0011] Acquire a control configuration file of the load; wherein the control configuration file includes property information of at least one control;
[0012] The control configuration file of the load is sent to the terminal device, so that the terminal device can display the interactive interface of the load on the display interface of the control software according to the control configuration file; wherein the interactive interface is used to display the control.
[0013] In a fourth aspect, the present specification provides a terminal device, the terminal device being capable of being communicatively connected with a movable platform, the movable platform being equipped with a load, the terminal device communicating with the load through the movable platform;
[0014] The terminal device includes a memory and a processor;
[0015] The memory is used to store computer programs, and at least stores a computer program of control software for controlling the movable platform;
[0016] The processor is used to execute the computer program and implement the following steps when executing the computer program:
[0017] Acquire a control configuration file of the load; wherein the control configuration file includes property information of at least one control;
[0018] The interactive interface of the load is displayed on the display interface of the control software according to the control configuration file; wherein the interactive interface is used to display the control.
[0019] In a fifth aspect, the present specification provides a payload of a movable platform, wherein when the payload is mounted on the movable platform, it can communicate with a terminal device through the movable platform, and the terminal device is installed with control software for controlling the movable platform;
[0020] The load includes a memory and a processor;
[0021] The memory is used to store computer programs;
[0022] The processor is used to execute the computer program and implement the following steps when executing the computer program:
[0023] Acquire a control configuration file of the load; wherein the control configuration file includes property information of at least one control;
[0024] The control configuration file is sent to the terminal device via the mobile platform, so that the terminal device displays the interactive interface of the load on the display interface of the control software according to the control configuration file; wherein the interactive interface is used to display the control.
[0025] In a sixth aspect, the present specification provides a mobile platform, the mobile platform being capable of being connected to a terminal device for communication, the mobile platform being used to carry a load, and the terminal device being installed with control software for controlling the mobile platform;
[0026] The mobile platform includes a memory and a processor;
[0027] The memory is used to store computer programs;
[0028] The processor is used to execute the computer program and implement the following steps when executing the computer program:
[0029] Acquire a control configuration file of the load; wherein the control configuration file includes property information of at least one control;
[0030] The control configuration file of the load is sent to the terminal device, so that the terminal device displays the interactive interface of the load on the display interface of the control software according to the control configuration file; wherein the interactive interface is used to display the control.
[0031] In a seventh aspect, the present specification provides a computer-readable storage medium storing a computer program, which, when executed by a processor, enables the processor to implement the above-mentioned method.
[0032] The embodiments of this specification provide a software expansion method, a terminal device, a mobile platform, a load and a storage medium. By obtaining a control configuration file of the load of the mobile platform, the interactive interface of the load is displayed on the display interface of the control software according to the control configuration file, thereby expanding the interactive interface for interacting with the load based on the control software for controlling the mobile platform. The user does not need to frequently switch between different software to achieve control of the mobile platform and interaction between the terminal device and the load, and the development workload of the load development manufacturer can be reduced.
[0033] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure of this specification. BRIEF DESCRIPTION OF THE DRAWINGS
[0034] In order to more clearly illustrate the technical solutions of the embodiments of this specification, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of this specification. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.
[0035] Figure 1 It is a schematic diagram of controlling the load carried by the movable platform through the terminal device at present;
[0036] Figure 2 It is a flowchart of a software expansion method provided in an embodiment of this specification;
[0037] Figure 3 is a schematic diagram of controlling a load carried by a movable platform through a terminal device in an embodiment of this specification;
[0038] Figure 4 It is a schematic diagram showing the interactive interface of the load on the display interface of the control software;
[0039] Figure 5 It is a schematic diagram of the control information of the terminal device displaying the load;
[0040] Figure 6 is a flowchart of a software expansion method provided by another embodiment of this specification;
[0041] Figure 7 is a flowchart of a software expansion method provided by another embodiment of this specification;
[0042] Figure 8 is a schematic block diagram of a terminal device provided in an embodiment of this specification;
[0043] Fig. 9 is a schematic block diagram of a load of a movable platform provided in an embodiment of this specification;
[0044] Fig.10 It is a schematic block diagram of a movable platform provided in one embodiment of this specification. DETAILED DESCRIPTION
[0045] The following will be combined with the drawings in the embodiments of this specification to clearly and completely describe the technical solutions in the embodiments of this specification. Obviously, the described embodiments are part of the embodiments of this specification, not all of the embodiments. Based on the embodiments in this specification, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this specification.
[0046] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions.
[0047] In conjunction with the accompanying drawings, some implementation methods of this specification are described in detail below. In the absence of conflict, the following embodiments and features in the embodiments can be combined with each other.
[0048] See also Figure 1 , Figure 1 This is a schematic diagram of the current control of the load carried by the movable platform through the terminal device.
[0049] Specifically, the terminal device is communicatively connected to the mobile platform, and an application for controlling the mobile platform may be installed on the terminal device, for example, an application for controlling the movement, posture, movement trajectory, etc. of the mobile platform.
[0050] The mobile platform can carry one or more loads. In addition to installing the application for controlling the mobile platform, the terminal device also needs to install one or more applications for controlling each load and / or obtaining information from the load. Figure 1 As shown, application 1 installed on the terminal device is used to control load 1, and application 2 is used to obtain data collected by load 2 from load 2.
[0051] In some implementations, the application for controlling the mobile platform may be launched by the mobile platform developer and installed in the terminal device by the mobile platform developer or by the user.
[0052] The load can be a load developed by a third-party manufacturer, and the third-party manufacturer can develop its own load and terminal device applications based on the open interface of the mobile platform. For example, a third-party manufacturer can open a software package for the load application launched by the mobile platform developer, transplant the software package to the load, and develop an application on the load; a third-party manufacturer can also develop an application for installation on the terminal device to interact with the load based on the software package of the mobile terminal application launched by the mobile platform developer.
[0053] The inventors of the present application have discovered that the above-mentioned control method of the load requires the installation of a large number of applications on the terminal device, and the application programs running on the terminal device need to be frequently switched during use, which is very inconvenient. In addition, third-party manufacturers need to develop application programs for the terminal device, which is difficult and takes a long time to develop.
[0054] In response to this discovery, the inventors of the present application have improved the control method of the load to achieve a more convenient expansion of the functions for interacting with the load on the terminal device.
[0055] See also Figure 2 , Figure 2 The software expansion method can be applied in a terminal device, and the terminal device can be connected to a mobile platform for communication, for example, data can be transmitted between the terminal device and the mobile platform through a wireless channel.
[0056] like Figure 3 As shown, the terminal device of the application software expansion method is, for example, a mobile phone, a tablet computer, etc. The terminal device can be connected to a movable platform through another terminal device such as a ground station, a remote control, etc., for example, the communication distance between the terminal device such as a mobile phone, a tablet computer and the movable platform can be extended.
[0057] The movable platform can carry one or more loads. For example, the load can be connected to the movable platform via a hardware interface to achieve information transmission between the load and the movable platform.
[0058] The load may include, for example, at least one of a gimbal, a camera, a radar, an air pressure measuring device, an altitude measuring device, a gas detection device, a lighting device, and a sound generating device.
[0059] The terminal device can communicate with the load through the movable platform; the terminal device is installed with control software for controlling the movable platform.
[0060] The software extension method applied to the terminal device can be used to expand the functions of the mobile platform control software on the terminal device according to the load carried by the mobile platform to realize the interaction between the terminal device and the load.
[0061] The terminal device may include at least one of a mobile phone, a tablet computer, a laptop computer, a desktop computer, a personal digital assistant, a wearable device, a remote controller, etc. The movable platform may be, for example, a robot, a robot car, an aircraft, etc. Further, the aircraft may be a rotary-wing drone, such as a quad-rotor drone, a hexacopter drone, an octo-rotor drone, or a fixed-wing drone.
[0062] like Figure 2As shown, the software expansion method of the embodiment of this specification includes steps S110 to S120.
[0063] S110. Obtain a control configuration file of the load; wherein the control configuration file includes property information of at least one control.
[0064] Specifically, third-party manufacturers can develop their own payloads based on the open interface of the mobile platform. For example, third-party manufacturers can open software packages for payload applications launched by mobile platform developers, such as Payload SDK, and transplant the software packages to the payload to develop applications on the payload.
[0065] Exemplarily, the control configuration file is generated by the load or stored by the load.
[0066] For example, the payload may generate a control configuration file based on the payload application open software package and / or an application on the payload.
[0067] Exemplarily, the control configuration file includes attribute information of at least one control, and the attribute information can be described by files such as JSON format, XML format, HTML format, etc., and is used to define the UI (user interface, UserInterface) properties, presentation style, control type, etc. of the control.
[0068] Exemplarily, the load may send the control configuration file to the terminal device via the movable platform.
[0069] Specifically, the mobile platform may obtain the control configuration file of the payload, and then send the control configuration file of the payload to the terminal device.
[0070] In some implementations, the terminal device obtains the control configuration file that the load actively sends after the mobile platform is communicatively connected with the terminal device.
[0071] For example, when the load is connected to the mobile platform, it can be detected whether the mobile platform is communicatively connected with the terminal device; if it is detected that the mobile platform is communicatively connected with the terminal device, the load transmits the control configuration file to the mobile platform, so that the mobile platform sends the control configuration file of the load to the terminal device.
[0072] For example, the movable platform may detect whether a load is carried. If a load is detected, a control configuration file of the load is sent to the terminal device when the movable platform is in communication connection with the terminal device.
[0073] In some implementations, the terminal device sends a file acquisition instruction to the load, and acquires the control configuration file sent by the load according to the file acquisition instruction.
[0074] Exemplarily, the terminal device may send a file acquisition instruction to the load of the mobile platform when an application for controlling the mobile platform is started or when a communication connection with the mobile platform is successfully established, so that the load sends the control configuration file to the terminal device via the mobile platform.
[0075] S120. Displaying an interactive interface of the load on a display interface of the control software according to the control configuration file; wherein the interactive interface is used to display the control.
[0076] For example, Figure 4 As shown, the terminal device displays the interactive interface of the camera load and the interactive interface of the radar load on the display interface of the control software, and displays the controls of the camera and the controls of the radar respectively.
[0077] In some implementations, the control configuration file further includes a control icon for the control.
[0078] The displaying the interactive interface of the load on the display interface of the control software according to the control configuration file includes: displaying the control icon on the interactive interface according to the attribute information of the control.
[0079] Exemplarily, the attribute information may define the display mode, function definition, interactive interface, etc. of the control icon. For example, the attribute information of the control configuration file of the camera load includes information for defining the control icons of taking photos and recording videos as clickable, and information for defining the control icon of zooming as including a slider in the up and down directions and a black slider on the slider, and information for the slider being able to slide on the slider, etc. The terminal device may display the control icons on the interactive interface and define the functions corresponding to each control icon according to the attribute information.
[0080] Exemplarily, the program running on the load includes a service interface adapted to the control software. The terminal device can send instructions for controlling the load to the service interface through the control software.
[0081] Exemplarily, when the terminal device detects a user operation on the control, the terminal device may execute a function corresponding to the attribute information of the control.
[0082] It can be understood that the execution of the function corresponding to the attribute information of the control may include the terminal device executing the corresponding function by itself, the terminal device controlling the movable platform and / or the load to execute the corresponding function, and the terminal device executing the corresponding function together with the movable platform and / or the load.
[0083] For example, when a user clicks Figure 4 When the camera's photo control icon is clicked, the terminal device can store the image taken by the camera and transmitted back by the movable platform.
[0084] Exemplarily, if the terminal device obtains the user's operation on the control icon, it can send a control instruction corresponding to the attribute information to the load via the movable platform according to the operation of the control icon, so that the load performs a preset task according to the control instruction.
[0085] For example, when a user clicks Figure 4 When the left and right swiping control icon of the camera is clicked, the terminal device can control the shooting direction of the camera mounted on the movable platform to move back and forth left and right.
[0086] In some implementations, the terminal device may also obtain operating information of the load and display the operating information on the interactive interface.
[0087] Exemplarily, the program running on the load includes a service interface adapted to the control software, and the load can send the operation information of the load to the terminal device through the service interface.
[0088] For example, the radar payload can send the operating information such as the height from the ground and the distance from obstacles measured by the radar to the terminal device. The terminal device can obtain the operating information of the payload and display the operating information on the interactive interface. Figure 4 As shown, the interactive interface shows that the current height from the ground is 50 meters and the distance from the obstacle is 10 meters.
[0089] Thereby, the terminal device can expand the functions of the mobile platform control software on the terminal device according to the load carried by the mobile platform, so as to realize the interaction between the terminal device and the load.
[0090] In some implementations, the load or the movable platform may send the control information of the load to the terminal device, so that the terminal device obtains the control configuration file of the load according to the control information.
[0091] The control information may include at least one of information for identifying the type of load, the unique identifier of the load, the control version of the load, the verification information of the control configuration file of the load, the generation time of the control configuration file of the load, etc.
[0092] For example, the control information may include the MD5 checksum information of the control configuration file. Specifically, the load can determine the MD5 checksum information of the control configuration file based on a hash function, such as MD5. The hash function can convert a data string of any length into a shorter fixed-length value. If the MD5 checksum information of two data is the same, it can be determined that the two data are the same data, complete and correct, and have not been tampered with. By verifying the MD5, you can know whether the corresponding control configuration file is stored locally. If the verification is successful, the corresponding control configuration file is stored locally, and there is no need to further transmit the control configuration file; if the verification is unsuccessful, the corresponding control configuration file is not stored locally (it has not been transmitted, or the control configuration file has been updated), and the control configuration file needs to be further transmitted.
[0093] When the types of the loads are different and the control versions of the loads are different, the control information of the loads is also different. When the control configuration file of the load is damaged, the control information of the load is also different. Thus, the terminal device can distinguish different control configuration files according to the control information.
[0094] Exemplarily, the acquiring the control configuration file of the load includes: acquiring control information of the load; and acquiring the control configuration file of the load according to the control information.
[0095] For example, Figure 5 As shown, the terminal device can also display the control information on the display interface of the control software. Specifically, the load can send the control information of the load to the terminal device via the mobile platform. Thus, the user can view the type of load carried by the mobile platform, the version of the control of the load, etc.
[0096] Exemplarily, if the terminal device detects a user operation on the control information, the control configuration file of the load can be obtained according to the operation of the control information. For example, if the terminal device detects a user operation on the control information, a file acquisition instruction can be sent to the load according to the operation of the control information, and the control configuration file sent by the load according to the file acquisition instruction can be obtained.
[0097] For example, when the user wants to expand the interactive function of load 1 on the control software of the terminal device, he can click the control information of load 1 displayed on the display interface to trigger the terminal device to send a file acquisition instruction to load 1 and obtain the control configuration file sent by load 1 according to the file acquisition instruction. Therefore, the user can choose whether to expand the interactive function of a certain load to the control software of the terminal device.
[0098] Exemplarily, after the terminal device obtains the control configuration file, it can verify whether the obtained control configuration file is correct according to the verification information in the control information. If it is incorrect, it can be obtained again.
[0099] In some other implementations, the terminal device may obtain the control configuration file of the load from an external server, wherein the server stores the control configuration file of the load.
[0100] Exemplarily, the control information of the load may include type information of the load. The terminal device may obtain a control configuration file of the load from an external server according to the type information of the load.
[0101] Exemplarily, when the terminal device runs the control software, it can display a control download interface, and the control download interface can display control configuration files of respective loads uploaded by multiple load development manufacturers.
[0102] Specifically, the external server can store the control configuration files of each load uploaded by the load development manufacturer. The user can operate on the control software to enable the terminal device to connect to the server to display the control information of loads of several manufacturers, or the user can search and download the control information of the control configuration file of a certain load stored on the server.
[0103] Exemplarily, the terminal device can obtain the control configuration file of the load from an external server according to the control information of the load. This step can be automatically performed by the terminal device or implemented by the terminal device according to the user's operation. For example, the load or the movable platform can send the control information of the load to the terminal device, and the terminal device automatically obtains the control configuration file of the load from the external server according to the control information. For example, if the terminal device detects the user's operation on the control information, it can send a file acquisition instruction to the server according to the operation of the control information, and obtain the control configuration file sent by the server. Thereby, the load developer and the user can update the load's controls more conveniently.
[0104] In some embodiments, obtaining the control configuration file of the load based on the control information includes: determining whether the terminal device stores the control configuration file corresponding to the control information; if the terminal device stores the control configuration file corresponding to the control information, obtaining the stored control configuration file; if the terminal device does not store the control configuration file corresponding to the control information, obtaining the control configuration file corresponding to the control information from the mobile platform and / or server.
[0105] For example, if the terminal device has previously obtained the control configuration file of the load, there is no need to obtain it from the load again, which saves time and improves practical efficiency.
[0106] Exemplarily, it is also possible to determine whether there is an updated version of the control configuration file based on the control information, and if so, obtain the updated version of the control configuration file from the mobile platform and / or server, and delete the old version of the control configuration file previously stored.
[0107] Exemplarily, it is also possible to determine whether the control configuration file stored in the terminal device is damaged according to the control information. If damaged, a correct control configuration file is obtained from the mobile platform and / or server, and the damaged control configuration file can be deleted.
[0108] In some implementations, step S110 of obtaining a control configuration file of the load includes: obtaining a control configuration file of the load that is consistent with the device attribute information according to the device attribute information of the terminal device.
[0109] Exemplarily, the device attribute information includes at least one of the language used and the screen size of the terminal device.
[0110] The control software on the terminal device can set the user's language and can also match the screen size of the terminal device, such as adjusting the size and resolution of the displayed interface.
[0111] Exemplarily, the terminal device may send its device attribute information to the load, so that the load obtains a control configuration file consistent with the device attribute information; then the terminal device obtains the control configuration file sent by the load via the mobile platform. Thus, the terminal device obtains the control configuration file of the load that is consistent with the device attribute information.
[0112] Therefore, when the interactive interface of the load is displayed on the display interface of the control software according to the control configuration file in step S120, an interactive interface consistent with the user's habits and terminal equipment can be displayed, so that the user can use the controls of the load more conveniently.
[0113] Exemplarily, the terminal device may send its device attribute information to the mobile platform. After receiving the device attribute information sent by the terminal device, the mobile platform may transmit the device attribute information to the load.
[0114] Exemplarily, after the load obtains the device attribute information of the terminal device from the terminal device, it can generate a control configuration file that matches the device attribute information, such as generating a control configuration file whose language, display resolution, etc. match the device attribute information, and then transmit the control configuration file to the mobile platform.
[0115] The mobile platform may obtain a control configuration file that is consistent with the device attribute information from the payload, and send the control configuration file to the terminal device.
[0116] Exemplarily, the terminal device may send its device attribute information to an external server, so that the server obtains a control configuration file of the load that is consistent with the device attribute information; then the terminal device obtains the control configuration file sent by the server.
[0117] Specifically, the server may pre-store control configuration files in different languages and adapted to terminal devices of different screen sizes to meet the software expansion requirements of different users and terminal devices.
[0118] The software extension method provided in the embodiments of this specification obtains a control configuration file of the load of the mobile platform, and displays the interactive interface of the load on the display interface of the control software according to the control configuration file, thereby expanding the interactive interface for interacting with the load on the basis of the control software for controlling the mobile platform. The user does not need to frequently switch between different software to realize the control of the mobile platform and the interaction between the terminal device and the load, and the development workload of the load development manufacturer can be reduced.
[0119] Please refer to the above examples. Figure 6 , Figure 6 This is a flowchart of a software expansion method provided by another embodiment of the present application, which can be used for a load carried on a movable platform. The movable platform is connected to a terminal device for communication, and the load communicates with the terminal device through the movable platform; the terminal device is installed with control software for controlling the movable platform.
[0120] like Figure 6 As shown, the software expansion method for a load according to an embodiment of the present specification includes steps S210 to S220.
[0121] S210. Obtain a control configuration file of the load; wherein the control configuration file includes property information of at least one control.
[0122] S220. Send the control configuration file to the terminal device via the mobile platform, so that the terminal device can display the interactive interface of the load on the display interface of the control software according to the control configuration file; wherein the interactive interface is used to display the control.
[0123] Exemplarily, the control configuration file is generated by the load or stored by the load.
[0124] Exemplarily, the obtaining the control configuration file of the load includes:
[0125] Acquire device attribute information of the terminal device from the terminal device;
[0126] Generate a control configuration file that matches the device attribute information.
[0127] Exemplarily, the device attribute information includes at least one of the language used and the screen size of the terminal device.
[0128] Exemplarily, the method further includes:
[0129] The control information of the load is sent to the terminal device via the movable platform.
[0130] Exemplarily, the sending the control configuration file to the terminal device via the mobile platform includes:
[0131] If a file acquisition instruction sent by the terminal device is acquired, the control configuration file is sent to the terminal device via the mobile platform;
[0132] The file acquisition instruction is sent by the terminal device according to the user's operation on the control information.
[0133] Exemplarily, the method further includes:
[0134] If a control instruction sent by the terminal device according to the user's operation on the control is obtained, a preset task is performed according to the control instruction.
[0135] Exemplarily, the method further includes:
[0136] Obtaining operation information of the load;
[0137] The operation information is sent to the terminal device, so that the terminal device displays the operation information on the interactive interface.
[0138] Exemplarily, the load includes at least one of a gimbal, a camera, a radar, an air pressure measuring device, an altitude measuring device, a gas detection device, a lighting device, and a sound-generating device.
[0139] Exemplarily, the program running on the load includes a service interface adapted to the control software.
[0140] The specific principles and implementation methods of the software expansion method for a load provided in the embodiments of this specification are similar to those of the software expansion method for a terminal device in the aforementioned embodiments, and will not be repeated here.
[0141] Please refer to the above examples. Figure 7 , Figure 7This is a flowchart of a software expansion method provided by another embodiment of the present application, which can be used for a mobile platform. The mobile platform is connected to a terminal device for communication, a load is carried on the mobile platform, and the terminal device is installed with control software for controlling the mobile platform.
[0142] like Figure 7 As shown, the software expansion method for a load according to an embodiment of the present specification includes steps S310 to S320.
[0143] S310. Obtain a control configuration file of the load; wherein the control configuration file includes property information of at least one control.
[0144] S320. Send the control configuration file of the load to the terminal device, so that the terminal device can display the interactive interface of the load on the display interface of the control software according to the control configuration file; wherein the interactive interface is used to display the control.
[0145] Exemplarily, the obtaining the control configuration file of the load includes:
[0146] Acquire device attribute information of the terminal device from the terminal device;
[0147] Transmitting the device attribute information to the load, so that the load generates a control configuration file matching the device attribute information;
[0148] A control configuration file consistent with the device attribute information is obtained from the load.
[0149] Exemplarily, the device attribute information includes at least one of the language used, screen size, and control attribute configuration information of the terminal device.
[0150] The specific principles and implementation methods of the software expansion method for a mobile platform provided in the embodiments of this specification are similar to the software expansion method for a terminal device and the software expansion method for a load in the aforementioned embodiments, and will not be repeated here.
[0151] The software extension method provided in the embodiments of this specification sends a control configuration file of the load of the mobile platform to the terminal device, so that the terminal device displays the interactive interface of the load on the display interface of the control software according to the control configuration file, thereby expanding the interactive interface for interacting with the load on the basis of the control software for controlling the mobile platform. The user does not need to frequently switch between different software to realize the control of the mobile platform and the interaction between the terminal device and the load, and the development workload of the load development manufacturer can be reduced.
[0152] Please refer to the above examples. Figure 8 , Figure 8 6 is a schematic block diagram of a terminal device 600 provided in an embodiment of the present specification. The terminal device 600 includes a processor 601 and a memory 602 .
[0153] Exemplarily, the processor 601 and the memory 602 are connected via a bus 603 , which is, for example, an I2C (Inter-integrated Circuit) bus.
[0154] Specifically, the processor 601 may be a micro-controller unit (MCU), a central processing unit (CPU) or a digital signal processor (DSP).
[0155] Specifically, the memory 602 may be a Flash chip, a read-only memory (ROM) disk, an optical disk, a USB flash drive, or a mobile hard disk.
[0156] The processor 601 is used to run the computer program stored in the memory 602, and implement the aforementioned software expansion method for the terminal device when executing the computer program.
[0157] Specifically, the terminal device 600 can be communicatively connected with a movable platform, on which a load is mounted, and the terminal device 600 communicates with the load through the movable platform.
[0158] Exemplarily, the processor 601 is used to run a computer program stored in the memory 602, and implement the following steps when executing the computer program:
[0159] Acquire a control configuration file of the load; wherein the control configuration file includes property information of at least one control;
[0160] The interactive interface of the load is displayed on the display interface of the control software according to the control configuration file; wherein the interactive interface is used to display the control.
[0161] The specific principles and implementation methods of the terminal device provided in the embodiments of this specification are similar to the software expansion method of the aforementioned embodiments and will not be repeated here.
[0162] A computer-readable storage medium is also provided in an embodiment of the present specification. The computer-readable storage medium stores a computer program. The computer program includes program instructions. The processor executes the program instructions to implement the steps of the software expansion method for a terminal device provided in the above embodiment.
[0163] The computer-readable storage medium may be an internal storage unit of the terminal device described in any of the above embodiments, such as a hard disk or memory of the terminal device. The computer-readable storage medium may also be an external storage device of the terminal device, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc., equipped on the terminal device.
[0164] Please refer to the above examples. Fig. 9 , Fig. 9 700 is a schematic block diagram of a load 700 provided in an embodiment of the present specification. The load 700 includes a processor 701 and a memory 702 .
[0165] Exemplarily, the processor 701 and the memory 702 are connected via a bus 703 , which is, for example, an I2C (Inter-integrated Circuit) bus.
[0166] Specifically, the processor 701 may be a micro-controller unit (MCU), a central processing unit (CPU) or a digital signal processor (DSP).
[0167] Specifically, the memory 702 may be a Flash chip, a read-only memory (ROM) disk, an optical disk, a USB flash drive, or a mobile hard disk.
[0168] The processor 701 is used to run the computer program stored in the memory 702, and implement the aforementioned software expansion method for the load when executing the computer program.
[0169] Specifically, when the load 700 is mounted on a movable platform, it can communicate with a terminal device through the movable platform, and the terminal device is installed with control software for controlling the movable platform.
[0170] Exemplarily, the processor 701 is used to run a computer program stored in the memory 702, and implement the following steps when executing the computer program:
[0171] Acquire a control configuration file of the load; wherein the control configuration file includes property information of at least one control;
[0172] The control configuration file is sent to the terminal device via the mobile platform, so that the terminal device displays the interactive interface of the load on the display interface of the control software according to the control configuration file; wherein the interactive interface is used to display the control.
[0173] The specific principles and implementation methods of the load of the movable platform provided in the embodiments of this specification are similar to the software expansion method of the aforementioned embodiments, and will not be repeated here.
[0174] A computer-readable storage medium is also provided in an embodiment of the present specification. The computer-readable storage medium stores a computer program. The computer program includes program instructions. The processor executes the program instructions to implement the steps of the software expansion method for a load provided in the above embodiment.
[0175] The computer-readable storage medium may be an internal storage unit of the load described in any of the above embodiments, such as a hard disk or memory of the load. The computer-readable storage medium may also be an external storage device of the load, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the load.
[0176] Please refer to the above examples. Fig.10 , Fig.10 800 is a schematic block diagram of a mobile platform 800 provided in an embodiment of the present specification. The mobile platform 800 includes a processor 801 and a memory 802 .
[0177] Exemplarily, the processor 801 and the memory 802 are connected via a bus 803 .
[0178] Exemplarily, the movable platform includes at least one of the following: an unmanned aerial vehicle, a handheld gimbal, and a gimbal vehicle.
[0179] The processor 801 is used to run the computer program stored in the memory 802, and implement the aforementioned software expansion method for a mobile platform when executing the computer program.
[0180] Exemplarily, the processor 801 is used to run a computer program stored in the memory 802, and implement the following steps when executing the computer program:
[0181] Acquire a control configuration file of the load; wherein the control configuration file includes property information of at least one control;
[0182] The control configuration file of the load is sent to the terminal device, so that the terminal device displays the interactive interface of the load on the display interface of the control software according to the control configuration file; wherein the interactive interface is used to display the control.
[0183] The specific principles and implementation methods of the mobile platform provided in the embodiments of this specification are similar to the software expansion method in the aforementioned embodiments, and will not be repeated here.
[0184] A computer-readable storage medium is also provided in an embodiment of the present specification. The computer-readable storage medium stores a computer program. The computer program includes program instructions. The processor executes the program instructions to implement the steps of the software expansion method for a mobile platform provided in the above embodiment.
[0185] The computer-readable storage medium may be an internal storage unit of the mobile platform described in any of the above embodiments, such as a hard disk or memory of the mobile platform. The computer-readable storage medium may also be an external storage device of the mobile platform, such as a plug-in hard disk, a smart memory card (SmartMedia Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc., equipped on the mobile platform.
[0186] The terminal device, load, mobile platform, and computer-readable storage medium provided in the above embodiments of this specification are capable of obtaining a control configuration file of the load of the mobile platform, so as to display an interactive interface of the load on the display interface of the control software according to the control configuration file, thereby expanding an interactive interface for interacting with the load on the basis of the control software for controlling the mobile platform. The user does not need to frequently switch between different software to realize control of the mobile platform and interaction between the terminal device and the load, and the development workload of the load development manufacturer can be reduced.
[0187] It should be understood that the terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the specification.
[0188] It will also be understood that the term "and / or" used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.
[0189] The above is only a specific implementation of this specification, but the protection scope of this specification is not limited to this. Any technician familiar with this technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in this specification, and these modifications or replacements should be included in the protection scope of this specification. Therefore, the protection scope of this specification should be based on the protection scope of the claims.
Claims
1. A software expansion method, characterized in that: For a terminal device, the terminal device is communicatively connected with a movable platform, the movable platform can carry a load, and the terminal device communicates with the load through the movable platform; the method comprises: When one or more loads are connected to the mobile platform through a hardware interface, obtaining control information of the loads carried by the mobile platform, the control information including at least one of information for identifying the type of the load, a unique identifier of the load, a control version of the load, verification information of a control configuration file of the load, and a generation time of the control configuration file of the load; Acquire a control configuration file of the load according to the control information; wherein the control configuration file includes property information of at least one control; and The interactive interface of the load is displayed on the display interface of the control software according to the control configuration file; wherein the control software is control software installed in the terminal device for controlling the movable platform, and the interactive interface is used to display the control.
2. The method according to claim 1, characterized in that The acquiring a control configuration file of the load according to the control information includes: Send a file acquisition instruction to the load according to the control information, and acquire the control configuration file sent by the load according to the file acquisition instruction; The control configuration file is generated by the load or stored by the load.
3. The method according to claim 1, characterized in that The method further comprises: Displaying the control information on the display interface of the control software; The acquiring a control configuration file of the load according to the control information includes: If a user operation on the control information is detected, a control configuration file of the load is obtained according to the operation on the control information.
4. The method according to claim 1, characterized in that The acquiring a control configuration file of the load according to the control information includes: A control configuration file of the load is obtained from an external server according to the control information; wherein the server stores the control configuration file of the load.
5. The method according to claim 4, characterized in that The control information includes type information of the load; The acquiring the control configuration file of the load from the external server according to the control information includes: A control configuration file of the load is obtained from an external server according to the type information of the load.
6. The method according to any one of claims 1 to 5, characterized in that The acquiring a control configuration file of the load according to the control information includes: Determining whether the terminal device stores a control configuration file corresponding to the control information; If the terminal device stores a control configuration file corresponding to the control information, acquiring the stored control configuration file; If the terminal device does not store the control configuration file corresponding to the control information, the control configuration file corresponding to the control information is obtained from the mobile platform and / or the server.
7. The method according to any one of claims 1 to 5, characterized in that The acquiring a control configuration file of the load according to the control information includes: Acquire a control configuration file of the load that is consistent with the device attribute information according to the device attribute information of the terminal device and the control information; The device attribute information includes at least one of the language used and the screen size of the terminal device.
8. The method according to claim 7, characterized in that The acquiring, according to the device attribute information of the terminal device and the control information, a control configuration file of the load that is consistent with the device attribute information includes: Sending device attribute information of the terminal device to the load according to the control information, so that the load obtains a control configuration file consistent with the device attribute information; The control configuration file sent by the payload via the mobile platform is obtained.
9. The method according to claim 7, characterized in that: The acquiring, according to the device attribute information of the terminal device and the control information, a control configuration file of the load that is consistent with the device attribute information includes: Sending the device attribute information of the terminal device and the control information to an external server, so that the server obtains a control configuration file of the load that is consistent with the device attribute information; Obtain the control configuration file sent by the server.
10. The method according to any one of claims 1 to 5, characterized in that The control configuration file also includes a control icon of the control; The step of displaying the interactive interface of the load on the display interface of the control software according to the control configuration file includes: The control icon is displayed on the interactive interface according to the attribute information of the control.
11. The method according to claim 10, characterized in that The method further comprises: When a user operation on the control is detected, a function corresponding to the attribute information of the control is executed.
12. The method according to claim 11, characterized in that When detecting the user's operation on the control, executing a function corresponding to the attribute information of the control includes: If the user's operation on the control icon is obtained, a control instruction corresponding to the attribute information is sent to the load via the movable platform according to the operation of the control icon, so that the load performs a preset task according to the control instruction.
13. The method according to any one of claims 1 to 5, characterized in that The method further comprises: Obtaining operation information of the load; The operation information is displayed on the interactive interface.
14. The method according to any one of claims 1 to 5, characterized in that The load includes at least one of a gimbal, a camera, a radar, an air pressure measuring device, an altitude measuring device, a gas detection device, a lighting device, and a sound generating device.
15. The method according to claim 14, characterized in that The program run by the load includes a service interface adapted to the control software.
16. A software expansion method, characterized in that: A load carried on a movable platform, the movable platform being communicatively connected with a terminal device, and the load communicating with the terminal device through the movable platform; The terminal device is installed with control software for controlling the mobile platform; the method comprises: Sending the control information of the load to the terminal device, the control information including at least one of information for identifying the type of the load, the unique identifier of the load, the control version of the load, verification information of the control configuration file of the load, and generation time of the control configuration file of the load; Acquire a control configuration file of the load; wherein the control configuration file includes property information of at least one control; When obtaining the file acquisition instruction sent by the terminal device according to the control information, the control configuration file is sent to the terminal device via the mobile platform, so that the terminal device can display the interactive interface of the load on the display interface of the control software according to the control configuration file; wherein the interactive interface is used to display the control.
17. The method according to claim 16, characterized in that The control configuration file is generated by the load or stored by the load.
18. The method according to claim 17, characterized in that The step of obtaining a control configuration file of the load includes: Acquire device attribute information of the terminal device from the terminal device; Generate a control configuration file that matches the device attribute information.
19. The method according to claim 18, characterized in that The device attribute information includes at least one of the language used and the screen size of the terminal device.
20. The method according to any one of claims 16 to 19, characterized in that The sending the control information of the load to the terminal device includes: Sending the control information of the load to the terminal device via the mobile platform; The step of sending the control configuration file to the terminal device via the mobile platform when acquiring the file acquisition instruction sent by the terminal device according to the control information comprises: If a file acquisition instruction sent by the terminal device is acquired, the control configuration file is sent to the terminal device via the mobile platform; The file acquisition instruction is sent by the terminal device according to the user's operation on the control information.
21. The method according to any one of claims 16 to 19, characterized in that The method further comprises: If a control instruction sent by the terminal device according to the user's operation on the control is obtained, a preset task is performed according to the control instruction.
22. The method according to any one of claims 16 to 19, characterized in that The method further comprises: Obtaining operation information of the load; The operation information is sent to the terminal device, so that the terminal device displays the operation information on the interactive interface.
23. The method according to any one of claims 16 to 19, characterized in that The load includes at least one of a gimbal, a camera, a radar, an air pressure measuring device, an altitude measuring device, a gas detection device, a lighting device, and a sound generating device.
24. The method according to any one of claims 16 to 19, characterized in that The program run by the load includes a service interface adapted to the control software.
25. A software expansion method, characterized in that: For a movable platform, the movable platform is in communication connection with a terminal device, the movable platform can carry a load, and the terminal device is installed with control software for controlling the movable platform; the method comprises: Sending the control information of the load to the terminal device, the control information including at least one of information for identifying the type of the load, the unique identifier of the load, the control version of the load, verification information of the control configuration file of the load, and generation time of the control configuration file of the load; Acquire a control configuration file of the load; wherein the control configuration file includes property information of at least one control; and When obtaining the file acquisition instruction sent by the terminal device according to the control information, the control configuration file of the load is sent to the terminal device, so that the terminal device can display the interactive interface of the load on the display interface of the control software according to the control configuration file; wherein, the interactive interface is used to display the control.
26. The method according to claim 25, characterized in that The step of obtaining a control configuration file of the load includes: Acquire device attribute information of the terminal device from the terminal device; Transmitting the device attribute information to the load, so that the load generates a control configuration file matching the device attribute information; A control configuration file consistent with the device attribute information is obtained from the load.
27. The method according to claim 26, characterized in that The device attribute information includes at least one of the language used, screen size, and control attribute configuration information of the terminal device.
28. A terminal device, characterized in that: The terminal device can be communicatively connected with a movable platform, the movable platform can carry a load, the terminal device communicates with the load via the movable platform, and the terminal device is installed with control software for controlling the movable platform; The terminal device includes a memory and a processor; The memory is used to store computer programs, and at least stores a computer program of control software for controlling the movable platform; The processor is used to execute the computer program and implement the following steps when executing the computer program: Acquire control information of the payload carried by the mobile platform, the control information including at least one of information for identifying the type of the payload, a unique identifier of the payload, a control version of the payload, verification information of a control configuration file of the payload, and a generation time of the control configuration file of the payload; Acquire a control configuration file of the load according to the control information; wherein the control configuration file includes property information of at least one control; and The interactive interface of the load is displayed on the display interface of the control software according to the control configuration file; wherein the interactive interface is used to display the control.
29. A load for a movable platform, characterized in that: When the payload is mounted on the movable platform, it can communicate with a terminal device through the movable platform, and the terminal device is installed with control software for controlling the movable platform; The load includes a memory and a processor; The memory is used to store computer programs; The processor is used to execute the computer program and implement the following steps when executing the computer program: Sending the control information of the load to the terminal device, the control information including at least one of information for identifying the type of the load, the unique identifier of the load, the control version of the load, verification information of the control configuration file of the load, and generation time of the control configuration file of the load; Acquire a control configuration file of the load; wherein the control configuration file includes property information of at least one control; and When obtaining the file acquisition instruction sent by the terminal device according to the control information, the control configuration file is sent to the terminal device via the mobile platform, so that the terminal device displays the interactive interface of the load on the display interface of the control software according to the control configuration file; wherein the interactive interface is used to display the control.
30. A movable platform, characterized in that: The movable platform can be communicatively connected with a terminal device, the movable platform can carry a load, and the terminal device is installed with control software for controlling the movable platform; The mobile platform includes a memory and a processor; The memory is used to store computer programs; The processor is used to execute the computer program and implement the following steps when executing the computer program: Sending the control information of the load to the terminal device, the control information including at least one of information for identifying the type of the load, the unique identifier of the load, the control version of the load, verification information of the control configuration file of the load, and generation time of the control configuration file of the load; Acquire a control configuration file of the load; wherein the control configuration file includes property information of at least one control; and When obtaining the file acquisition instruction sent by the terminal device according to the control information, the control configuration file of the load is sent to the terminal device, so that the terminal device displays the interactive interface of the load on the display interface of the control software according to the control configuration file; wherein the interactive interface is used to display the control.
31. The movable platform according to claim 30, characterized in that: The movable platform includes at least one of the following: an unmanned aerial vehicle, a handheld gimbal, and a gimbal vehicle.
32. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor implements the software expansion method according to any one of claims 1 to 27.
