Control method, motion sensing control device, display device, system, and related apparatus

Abstract

The present application discloses a control method, a motion sensing control device, a display device, a movable object, a system, and a computer readable storage medium. The motion sensing control device can generate orientation information in response to its own orientation change. The control method comprises: acquiring a current state of a movable object; on the basis of the current state of the movable object, performing automatic switching on a control mode for a display device and a control mode for the movable object; in the control mode for the display device, generating first orientation information, and using the first orientation information to control a display interface of the display device; and in the control mode for the movable object, generating second orientation information, and using the second orientation information to control the movable object, wherein the movable object is an object capable of moving in a real space. Thus, the difficulty of controlling the display interface of the display device when a user uses the motion sensing control device to control the movable object can be reduced.

Description

Control method, somatosensory control device, display device, system and related apparatus TECHNICAL FIELD

[0001] The present application relates to the somatosensory control field, and in particular to a control method, a somatosensory control device, a display device, a movable object, a system, and a computer readable storage medium. BACKGROUND

[0002] In the related art, a somatosensory control device can be used to control a movable object, and information related to the movable object can be displayed on a display device. When a user needs to interact with the display interface of the display device, the user often needs to directly control the display device with his hand. However, when the user is holding the somatosensory control device to control the movable object, and then manually controls the display device, there is a high risk of misoperation, which may cause the movable object to be controlled in an unexpected manner, and thus risks the movement of the movable object.

[0003] SUMMARY

[0004] To solve the above technical problems, the present application provides a control method, a somatosensory control device, a display device, a movable object, a system, and a computer readable storage medium, and the technical solutions are as follows.

[0005] According to a first aspect of the present application, a control method is provided, which is applied to a somatosensory control device capable of generating posture information in response to a change in its own posture. The method comprises:

[0006] obtaining a current state of a movable object;

[0007] automatically switching a control mode for a display device and a control mode for the movable object based on the current state of the movable object;

[0008] in the control mode for the display device, generating first posture information and using the first posture information to control a display interface of the display device;

[0009] in the control mode for the movable object, generating second posture information and using the second posture information to control the movable object, the movable object being an object capable of moving in a real space.

[0010] According to a second aspect of the present application, a control method is provided, which is applied to a display device. The method comprises:

[0011] receiving first posture information sent by a somatosensory control device, and configuring a display interface of the display device based on the first posture information, the somatosensory control device being capable of generating posture information in response to a change in its own posture;

[0012] receiving second posture information sent by the somatosensory control device, and forwarding the second posture information to the movable object, so that the somatosensory control device controls the movable object by using the second posture information, wherein the movable object is an object capable of moving in a real space.

[0013] According to a third aspect of the present application, a control method applied to a display device is provided, and the method comprises:

[0014] receiving posture information sent by a somatosensory control device and control object information associated with the posture information, wherein the somatosensory control device is capable of generating posture information in response to a change in its own posture;

[0015] when the control object represented by the control object information is the display device, performing a response measure corresponding to the posture information;

[0016] when the control object represented by the control object information is an object other than the display device, not performing the response measure corresponding to the posture information.

[0017] According to a fourth aspect of the present application, a control method applied to a display device is provided, and the method comprises:

[0018] receiving posture information sent by a somatosensory control device and control object information associated with the posture information, wherein the somatosensory control device is capable of generating posture information in response to a change in its own posture;

[0019] when the control object represented by the control object information is the display device, performing a response measure corresponding to the posture information;

[0020] when the control object represented by the control object information is a target object other than the display device, forwarding the posture information and the control object information to the target object, so that the target object performs a response measure corresponding to the posture information.

[0021] According to a fifth aspect of the present application, a control method applied to a movable object is provided, and the method comprises:

[0022] receiving posture information sent by a somatosensory control device and control object information associated with the posture information, wherein the somatosensory control device is capable of generating posture information in response to a change in its own posture;

[0023] when the control object represented by the control object information is the movable object, performing a response measure corresponding to the posture information;

[0024] when the control object represented by the control object information is an object other than the movable object, not performing the response measure corresponding to the posture information.

[0025] According to a sixth aspect of the present application, a control method is provided, which is suitable for a body-sensing control device to control a display device and a movable object in a scene respectively, the body-sensing control device is capable of generating posture information in response to a change of its own posture, and the method comprises:

[0026] In response to a current state of the movable object being a first state, a control object to which the posture information generated by the body-sensing control device is directed is the movable object;

[0027] In response to the current state of the movable object being a second state, the control object to which the posture information generated by the body-sensing control device is directed is the display interface.

[0028] According to a seventh aspect of the present application, a body-sensing control device is provided, which comprises:

[0029] a processor;

[0030] a memory for storing processor-executable instructions;

[0031] The processor is configured to implement the method according to the first aspect.

[0032] According to an eighth aspect of the present application, a display device is provided, which comprises:

[0033] a processor;

[0034] a memory for storing processor-executable instructions;

[0035] The processor is configured to implement the method according to any one of the second aspect to the fourth aspect.

[0036] According to a ninth aspect of the present application, a movable object is provided, which comprises:

[0037] a processor;

[0038] a memory for storing processor-executable instructions;

[0039] The processor is configured to implement the method according to the fifth aspect or the sixth aspect.

[0040] According to a tenth aspect of the present application, a control system is provided, which comprises the body-sensing control device according to the seventh aspect, the display device according to the eighth aspect, and the movable object according to the ninth aspect, the body-sensing control device is capable of generating posture information in response to a change of its own posture, the movable object is an object capable of moving in a real space, and information associated with the movable object can be displayed on a display interface of the display device.

[0041] According to an eleventh aspect of the present application, a computer readable storage medium is provided, and a computer program is stored on the computer readable storage medium, and the computer program is executed by a processor to implement the steps in the method according to any one of the first aspect to the sixth aspect.

[0042] The technical solution provided in the present application provides two control modes for a display device and a movable object for a somatosensory control device capable of generating posture information in response to a change in its own posture, and provides the ability of automatic switching between the two control modes based on the current state of the movable object. Based on the automatic switching between the two control modes based on the current state of the movable object, the user can conveniently control the display device and the movable object by using the posture information generated by the somatosensory control device, so that the user does not need to worry about the possible misoperation of the movable object when manipulating the display interface of the display device while using the somatosensory control device to control the movable object, thereby facilitating the safe control of the movable object.

[0043] It should be understood that the foregoing general description and the following detailed description are only exemplary and explanatory, and are not limiting to the present application. BRIEF DESCRIPTION OF DRAWINGS

[0044] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the related art, the drawings needed to be used in the embodiments or the related art description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments described in the present application, and other drawings can also be obtained by those skilled in the art based on these drawings.

[0045] FIG. 1 is a schematic diagram of a scene of a somatosensory control device, a movable object and a display device in the related art;

[0046] FIG. 2A is a schematic diagram of a manipulation scene of a somatosensory control device in the related art;

[0047] FIG. 2B and FIG. 2C are schematic diagrams of a manipulation scene of a display device in the related art;

[0048] FIG. 3 is a flow diagram of a control method according to an embodiment of the present application;

[0049] FIG. 4 is a schematic diagram of a control method according to an embodiment of the present application;

[0050] FIG. 5 is a schematic diagram of a position point according to an embodiment of the present application;

[0051] FIG. 6A, FIG. 6B and FIG. 6C are schematic diagrams of a position point control scene according to an embodiment of the present application;

[0052] FIG. 7A and FIG. 7B are schematic diagrams of a somatosensory control device control scene according to an embodiment of the present application;

[0053] FIG. 8 is a schematic diagram of another embodiment of the control method provided in the present application;

[0054] FIG. 9 is a schematic diagram of another embodiment of the control method provided in the present application;

[0055] FIG. 10 is a schematic diagram of another embodiment of the control method provided in the present application;

[0056] FIG. 11 is a schematic diagram of another embodiment of the control method provided in the present application;

[0057] FIG. 12 is a schematic diagram of an application scenario of the control method provided in the present application;

[0058] FIG. 13 is a schematic diagram of another application scenario of the control method provided in the present application;

[0059] FIG. 14 is a schematic diagram of the structure of a somatosensory control device according to an embodiment of the present application;

[0060] FIG. 15 is a schematic diagram of the structure of a display device according to an embodiment of the present application;

[0061] FIG. 16 is a schematic diagram of the structure of a movable object according to an embodiment of the present application;

[0062] FIG. 17 is a schematic diagram of the structure of a control system according to an embodiment of the present application. DETAILED DESCRIPTION

[0063] In order to enable a person skilled in the art to better understand the technical solutions in the present application, the technical solutions in the embodiments of the present application will be described in detail below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, but not all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by a person skilled in the art should belong to the scope of protection of the present application.

[0064] Please refer to FIG. 1, and a control scenario of a somatosensory control device, a movable object and a display device in the related art will be exemplarily introduced as follows:

[0065] The somatosensory control device 101 in the related art can be used to control the movable object 102, and information related to the movable object 102 can be displayed in the display device 103. When a user needs to interact with the display interface of the display device 103, the user often needs to directly control the display device 103 with hands. However, when the user controls the movable object 102 with the somatosensory control device 101, it can be difficult for the user to manually control the display device 103.

[0066] As an example, the movable object 102 can be a drone, and the display device 103 can be flight glasses. The drone can send flight state parameters or information related to the drone, such as pictures taken during flight, to the flight glasses, and the display interface of the flight glasses can display the related information. It can be understood that the specific implementation of the movable object 102 and the display device 103 is not limited.

[0067] Please refer to FIG. 2A, and the following exemplary describes a control scene of a somatosensory control device in the related art:

[0068] The somatosensory control device in the related art is generally designed for a right-hand holding scene, and the left side of the somatosensory control device is often configured with a button. When a user holds the somatosensory control device with the right hand, the left side of the somatosensory control device is generally a right-hand thumb control area. At this time, if the user chooses to hold the somatosensory control device with the left hand, the button in the right-hand thumb control area is not convenient for the user to trigger.

[0069] Please refer to FIG. 2B and FIG. 2C, and the following exemplary describes a control scene of a display device in the related art:

[0070] Taking the flight glasses shown in FIG. 2B and FIG. 2C as an example, when a user wears the flight glasses, the user needs to interact with the display interface in the flight glasses to control the display interface in the flight glasses. The control of the display interface can be realized through a button area (for example, the right joystick shown in FIG. 2B) on the flight glasses, or a touchpad as shown in FIG. 2C. For example, as shown in FIG. 2C, the menu of the display interface is controlled through the touchpad of the flight glasses. The button area or the touchpad of the flight glasses are both designed for the right hand. As shown in FIG. 2B-2C, the button area and the touchpad for controlling the display interface of the flight glasses are both arranged on the right side of the flight glasses, so as to be convenient for the user to use with the right hand.

[0071] In an example control scenario of a related art somatosensory control device, a movable object and a display device shown in FIG. 1, and a control scenario of a somatosensory control device and a display device shown in FIGS. 2A-2C, taking a display device as flight glasses and a somatosensory control device as a handheld device as an example, when a user wears the flight glasses, if the user needs to interact with a display interface of the flight glasses, the user often needs to first exchange the somatosensory control device held by the right hand to the left hand, and then lift the right hand to control a key area or a touchpad area on the right side of the flight glasses to control the display interface of the flight glasses. After the user finishes the interaction with the display interface, the user puts down the right hand and takes back the somatosensory control device to continue the control of the movable object. The convenience of such operation is low, and when the user holds other objects with the left hand, the convenience of temporarily holding the somatosensory control device with the left hand is particularly low. Meanwhile, when the somatosensory control device is exchanged from the right hand to the left hand, the user may mistakenly touch the keys of the somatosensory control device, causing the movable object to move in a manner that is not expected by the user, thereby causing hidden dangers to the movement of the movable object.

[0072] It should be noted that the above description of the control scenario of the somatosensory control device, the movable object and the display device is only an example, and other control scenarios may exist in actual applications, which are not limited in particular.

[0073] To solve the above problems, the present application provides a control method applied to a somatosensory control device capable of generating posture information in response to a change in its own posture. The user can conveniently control a display device and a movable object by using the posture information generated by the somatosensory control device, so that the difficulty of the user in manipulating the display interface of the display device while controlling the movable object with the somatosensory control device is reduced. As shown in FIG. 3, the method includes the following steps:

[0074] S301, obtaining a current state of a movable object;

[0075] S302, automatically switching a control mode for a display device and a control mode for the movable object based on the current state of the movable object;

[0076] S303, in the control mode for the display device, generating first posture information and controlling a display interface of the display device by using the first posture information;

[0077] S304, in the control mode for the movable object, generating second posture information and controlling the movable object by using the second posture information, the movable object being an object capable of moving in a real space.

[0078] It should be noted that the sequence of S303 and S304 is not limited.

[0079] The technical scheme provided in the embodiments of the present application provides two control modes for a display device and for a movable object for a somatosensory control device capable of generating posture information in response to a change in its posture, and provides the capability of automatically switching between the two control modes based on the current state of the movable object. The automatic switching between the two control modes based on the current state of the movable object enables a user to conveniently control the display device and the movable object by using the posture information generated by the somatosensory control device, thereby reducing the difficulty of manipulating the display interface of the display device while the user is using the somatosensory control device to control the movable object.

[0080] In the embodiments of the present application, the somatosensory control device can control the display device and the movable object in multiple ways by using the generated posture information. A plurality of embodiments are provided, and one of the embodiments is described below. The specific implementation process of the embodiment is shown in FIG. 4. The somatosensory control device is capable of generating posture information in response to a change in its posture. One embodiment of the control method provided in the present application can include the following steps.

[0081] 401. Obtaining the current state of the movable object.

[0082] 402. Automatically switching between the control mode for the display device and the control mode for the movable object based on the current state of the movable object.

[0083] The control mode of the somatosensory control device can be affected by multiple factors. As an example, the control mode of the somatosensory control device can be related to the current state of the movable object. In response to the current state of the movable object being a first state, the posture information generated by the somatosensory control device is directed to the control of the movable object. In response to the current state of the movable object being a second state, the posture information generated by the somatosensory control device is directed to the control of the display interface. In this way, the somatosensory control device can switch the control object to which the posture information generated by the somatosensory control device is directed according to the current state of the movable object, thereby achieving the automatic switching between the control mode for the display device and the control mode for the movable object.

[0084] The current state of the movable object can be determined in a variety of ways. As an example, the current state of the movable object can be determined based on state information received from the movable object. It is to be appreciated that the above description of determining the current state of the movable object is merely exemplary. In actual implementation, other implementations can also be used. For example, a body-sensing control device can be used to control the state of the movable object. The body-sensing control device can obtain historical control instructions for the state of the movable object. The current state of the movable object can be determined based on the historical control instructions. As another example, the body-sensing control device can have a special key for switching the state of the movable object. The current state of the movable object can be determined based on preset control instructions stored locally on the body-sensing control device. Therefore, the manner of determining the current state of the movable object is not limited.

[0085] The state information sent by the movable object can have a variety of implementations. As an example, the state information sent by the movable object can include the communication state of the movable object. As another example, the state information sent by the movable object can also include the motion state of the movable object. As another example, the state information sent by the movable object can include the communication state and the motion state of the movable object. It is to be appreciated that the above description of the implementation of the state information sent by the movable object is merely exemplary. In actual implementation, other implementations can also be used. Therefore, the implementation of the state information sent by the movable object is not limited.

[0086] The communication state of the movable object can have various implementations. As an example, the movable object and the display device can be in a communication connection state, and the communication state of the movable object can include that the movable object and the display device are in the communication connection state. As another example, the communication state of the movable object can include that the movable object and the display device are in a communication disconnection state. As an example, the first state can include that the movable object and the display device are in the communication connection state, and the second state can include that the movable object and the display device are in the communication connection state or the movable object and the display device are in the communication disconnection state. When the movable object and the display device are in the communication connection state, the posture information generated by the motion sensing control device can control the display device or the movable object. In this case, since the movable object and the display device are in the communication connection state, the display device can display information related to the movable object, and the user can understand the information related to the movable object through the display device and will not worry about the control of the movable object. When the movable object and the display device are in the communication disconnection state, the posture information generated by the motion sensing control device can control the display device but not the movable object. In this case, the display device and the movable object are not in communication, and the user cannot understand the information related to the movable object through the display device. Therefore, the motion sensing control device not controlling the movable object but only controlling the display device can reduce the worry of the user about the control of the movable object. It should be noted that the above description of the implementation of the communication state of the movable object is only illustrative, and other implementations can exist in actual applications, and the disclosure is not limited in this regard.

[0087] The movement state of the movable object can have various implementations. As an example, the movable object can include a plurality of movement states, the first state can include that the movable object is in a first movement state, and the second state can include that the movable object is in a second movement state. As another example, the movable object can include an aerial vehicle, and the first movement state can include at least one of that the aerial vehicle is in a take-off state, the aerial vehicle is in a flight state, the aerial vehicle is in a return state, the aerial vehicle is in a landing state, or the aerial vehicle has landed but is not in a stop state. As another example, the second movement state can include that the movable object is in a locked state, and when the movable object is in the locked state, the movable object stops moving. The somatosensory control device can control the movable object and the display device without interfering with each other, and the somatosensory control device can switch between controlling the movable object and the display device safely. The somatosensory control device can control the display device only when the movable object is in the locked state, and the somatosensory control device can control the movable object only when the movable object is in an unlocked state, thereby ensuring the safety of the somatosensory control device in controlling the movable object. It should be noted that the above description of the movement state of the movable object is only illustrative, and other implementations are not excluded in actual applications.

[0088] As another example, when the movable object includes an aerial vehicle, the movable object in the locked state can include that the aerial vehicle is in a hovering state, and the movable object in the locked state can also include that the aerial vehicle is in a stop state. The implementations of the locked state are not limited.

[0089] The movement state of the movable object can have various changes. As an example, the movement state of the movable object can change based on at least one of an operation instruction of an operator of the movable object or a movement environment of the movable object. For example, the movement state of the movable object can change based on the operation instruction of the operator, the movement environment of the movable object, or both. For example, in response to a stop instruction of the operator, the aerial vehicle can enter the hovering state from the flight state. As another example, when an obstacle appears in the flight environment of the aerial vehicle, the aerial vehicle can automatically perform an obstacle avoidance operation, such as stopping at a distance from the obstacle. The change of the movement state of the movable object is not limited.

[0090] As an example, the control mode of the somatosensory control device can also be related to a user trigger instruction received by the somatosensory control device. As another example, the user trigger instruction includes a user selection instruction of the control mode of the somatosensory control device, or the user trigger instruction can also include a user switching instruction of the state of the movable object. As another example, the user selection instruction of the control mode of the somatosensory control device can include a selection of the control mode of the display device, or the user selection instruction of the control mode of the somatosensory control device can also include a selection of the control mode of the movable object. As another example, the user switching instruction of the state of the movable object can include a switching of the communication state of the movable object, or the user switching instruction of the state of the movable object can also include a switching of the motion state of the movable object. It should be noted that the above-mentioned influencing factors of the control mode switching of the somatosensory control device are only exemplary, and other influencing factors can exist in actual application, which are not limited.

[0091] As an example, the somatosensory control device can also switch the current state of the movable object to the second state when the current state of the movable object is in the first state in response to the selection of the control mode of the display device. As another example, when the first state is the first motion state and the second state is the second motion state, the somatosensory control device can switch the current state of the movable object to the first motion state in response to the selection of the control mode of the display device when the current state of the movable object is in the first motion state. When the user triggers the switching control object to be the display device in the non-locked state of the movable object, the movable object can be automatically switched to the locked state, further ensuring the safety of the movable object.

[0092] As an example, the first attitude information and the second attitude information are both associated with control object information, and the control object information is used to enable the display device and the movable object to determine the control object to which the received attitude information is directed, and the control object is one of the display device and the movable object.

[0093] As an example, the control object information can be generated by the somatosensory control device based on the current state of the movable object, the control object information can also be generated by the movable object based on the current state of the movable object, and the control object information can also be generated by the display device based on the current state of the movable object.

[0094] 403. The somatosensory control device generates first attitude information in the control mode of the display device;

[0095] 404. The somatosensory control device sends the first attitude information to the display device;

[0096] As an example, the specific implementation of the somatosensory control device controlling the display interface of the display device by using the first posture information can be that the somatosensory control device generates the first posture information first, and then sends the first posture information to the display device, so that the display device configures its display interface based on the first posture information.

[0097] 405、the display device configures the display interface of the display device based on the first posture information;

[0098] For the display device in the related art, taking the flight glasses as an example, since the original interaction mode of the flight glasses is the key type or touchpad type interaction, the flight glasses cannot realize the function that needs to be similar to the touch screen interaction (the touchpad in the related art only supports up, down, left and right sliding), for example, selecting the focus point or the frame selection target on the screen.

[0099] In view of the above problems, the somatosensory control device can control the display interface of the display device in multiple ways by using the first posture information. As an example, a movable position point can be formed on the display interface of the display device by using the first posture information, so as to control the display interface of the display device by using the position point. By using the posture information to control the movable position point, the function similar to the touch screen interaction, such as selecting the focus point or the frame selection target, can be conveniently realized.

[0100] As an example, when the calibration instruction for the above-mentioned position point is detected, the position point can be calibrated to a preset position of the display interface of the display device. For the case where the area of the display interface is small, the relative posture change of the display device or the somatosensory control device caused by the posture change of the user can cause the position point to disappear in the display interface. If the position point cannot be observed in the display interface, the position point can be calibrated to the preset position, so as to facilitate the user to observe the position point.

[0101] The position point can be displayed in various manners. As an example, the position point can be dynamically generated on the display interface when the control mode for the movable object is switched to the control mode for the display device. The position point can also be displayed at a preset position on the display interface when the control mode for the movable object is switched to the control mode for the display device. The position point can be dynamically generated on the display interface and displayed at a preset position on the display interface when the control mode for the movable object is switched to the control mode for the display device. The dynamic position point and / or the position point displayed at the preset position can facilitate the user to timely find the current position of the position point on the display interface when the control mode is switched, thereby improving the operation efficiency of the user. As another example, the position point can be displayed in a preset symbol on the display interface. It should be noted that the above description of the display manner of the position point is merely illustrative, and other display manners can also be used in actual applications, which are not limited in this regard.

[0102] As an example, the preset symbol can be a cursor, and the position point can be a dynamically flashing cursor.

[0103] The preset position can be implemented in various manners. As an example, the preset position can be the center position of the display interface of the display device, or can be another preset position, which is not limited in this regard.

[0104] The position point can be aligned to the preset position in various manners. As an example, when the position point cannot be observed on the display interface, the position point can be aligned to the preset position by a preset alignment action. For example, the motion sensing control device can be held horizontally and a preset key can be triggered to return the position point to the preset position, thereby resetting the heading angle of the motion sensing control device. As another example, if the position point still cannot be observed on the display interface after the motion sensing control device is held horizontally and the preset key is triggered, the motion sensing control device can be tilted up and down until the position point appears on the display interface. The manner of aligning the position point to the preset position is not limited in this regard.

[0105] There are various ways to control the position point to move to a region of interest in the display interface of the display device in response to the posture change of the somatosensory control device, for example, moving a position point from one selection icon to another selection icon in the display interface; moving a target object in the display interface along with the position point in response to the posture change of the somatosensory control device, for example, moving a picture in the display interface from one position to another position; moving a target object in the display interface along with the position point in response to the posture change of the somatosensory control device to a region of interest in the display interface. As another example, when the position point is in a region of interest in the display interface, the object in the region of interest can be controlled to execute a corresponding object control command in response to an object control command of the user.

[0106] There are various ways to control the object in the region of interest to execute a corresponding object control command, for example, the ways to control the object in the region of interest to execute a corresponding object control command can include at least one of controlling the object to execute a confirmation command, controlling the object to execute an exit command, controlling the object to execute a frame selection command, controlling the object to execute a play command, and controlling the object to execute a pause command. It should be noted that the above description of the ways to control the object in the region of interest to execute a corresponding object control command is only exemplary, and other control ways can exist in actual applications, which are not limited.

[0107] As an example, another way to control the display interface of the display device using the first posture information can include controlling the zoom of the display interface of the display device using the first posture information, and controlling the zoom of an object in the display interface using the first posture information. As another example, the object in the display interface can include a virtual screen, and the zoom of the virtual screen can be controlled using the first posture information, and the zoom of the display content in the virtual screen can be controlled using the first posture information.

[0108] As an example, the posture information generated by the somatosensory control device can be 3 degrees of freedom (3DoF) posture information, 6DoF posture information, or other types of information, which are not limited.

[0109] Please refer to FIG. 5, and the following exemplary description of a specific formation scenario of the position point of an embodiment of the present application:

[0110] The first attitude information sent by the somatosensory control device to the display device can be converted into a virtual ray (as shown in FIG. 5, the color of the virtual ray can be white or other colors, which is not limited) on the display interface of the display device. The virtual ray can form a position point on the display interface, which can be displayed in the form of a cursor (the cursor can be circular or other shapes, which is not limited). When the attitude information generated by the somatosensory control device is 3 degrees of freedom (3DoF) attitude information, the projection relationship of the above cursor and ray can be as follows:

[0111] A virtual space is created, which has a fixed display interface position and a fixed somatosensory control device position. The default rotation direction of the somatosensory control device points to the center position of the display interface. The connection between the somatosensory control device position and the display interface position forms a virtual ray. The virtual ray is projected onto the display interface to obtain the position of the virtual ray on the display interface. The end of the virtual ray on the display interface is also the position of the cursor. The attitude information of the somatosensory control device is applied to make the change of the heading angle of the somatosensory control device affect the left and right movement positions of the cursor on the display interface, and the change of the pitch angle can affect the up and down movement positions of the cursor on the display interface.

[0112] Please refer to FIGS. 6A-7B, the somatosensory control device control scene and the formed position point control scene of an embodiment of the present application are exemplarily introduced as follows:

[0113] There can be a preset button on the somatosensory control device, for example, a trigger button (as shown in FIGS. 7A-7B) for controlling the size of the oil gate of the movable object, hereinafter referred to as the oil gate trigger.

[0114] When the attitude of the somatosensory control device changes, the somatosensory control device can generate attitude information in response to the change of its own attitude. Based on the current state of the movable object, the somatosensory control device can determine whether to provide a control mode for the display device or a control mode for the movable object, and determine the specific control effect of the attitude information based on the oil gate amount.

[0115] If the control mode for the movable object is to be provided, the attitude information and the control object of the attitude information, i.e., the movable object, are associated, and are directly sent to the movable object in combination with the oil gate amount, or are forwarded to the movable object through the display device. After receiving the above information, the movable object controls the direction in response to the attitude information and controls the speed in response to the oil gate size.

[0116] If the control mode for the display device is to be provided, the attitude information is associated with the control object of the attitude information, i.e. the display device, and is directly sent to the display device in combination with the throttle amount, or is forwarded to the display device through the movable object. The position point generated by the attitude information in combination with the throttle trigger can control the menu interface of the display interface of the display device.

[0117] The display interface of the display device can be controlled by rotating or tilting the body feeling control device, moving the position point to the left arrow of the display interface (as shown in FIG. 6A), triggering the throttle trigger, and confirming that the menu of the display interface is opened,

[0118] Triggering the throttle trigger can be pressing the throttle trigger as shown in FIG. 7A. When the throttle trigger is triggered, the size of the position point can change, for example, the position point becomes smaller.

[0119] Moving the position point to the top arrow of the display interface (as shown in FIG. 6B), triggering the throttle trigger, can open the shortcut setting panel of the display interface to perform the movable object recording, picture display enhancement and other shortcut settings.

[0120] Moving the position point to the bottom arrow of the display interface (as shown in FIG. 6C), triggering the throttle trigger, can open the camera parameter setting panel of the movable object to set various parameters of the camera of the movable object.

[0121] As shown in FIG. 7A, when the throttle trigger is pressed, the position point can become smaller. When the throttle trigger is lifted to restore the throttle trigger from the pressed state, the position point can return to the original size. As shown in FIG. 7B, when the throttle is pulled out, the position point can become larger. When the throttle trigger is pressed or pulled out, the position point can also have other size change modes, which are not limited in detail.

[0122] As an example, when the position point hovers over a certain control of the display interface (for example, a certain option in the above-mentioned menu), the control can become larger. When the position point leaves the control, the control can return to the original size. If the position point enters the next level of sub-controls of the control, the parent control maintains a larger state or the table has other forms, which are not limited in detail.

[0123] The throttle trigger can have various implementations. As an example, the throttle trigger can be one-segment (i.e., the pressing amplitude has only one segment) or two-segment (i.e., the pressing amplitude has two segments). As another example, for a two-segment throttle trigger, a pause can be set when the throttle trigger is pressed to the boundary between the first segment and the second segment. As another example, for a two-segment throttle trigger, the movable object can be controlled to switch different actions when the throttle trigger is pressed to different positions. As another example, when the movable object is an aircraft, the left-right tilting motion control device in the vertical direction can adjust the heading of the aircraft when the throttle trigger is pressed to the first segment. The aircraft can be controlled to move towards the position point in the display interface of the display device when the throttle trigger is pressed to the second segment. As another example, the throttle trigger can be pulled out to control the aircraft to fly backward. As another example, the greater the force with which the throttle trigger is pressed or pulled, the greater the speed of the aircraft. As another example, when the throttle trigger is in a relaxed state, the aircraft can be in a locked state (i.e., when the throttle trigger is released, the aircraft can directly enter the locked state, and at this time, the motion control device generates a change in attitude, but the throttle trigger is not triggered, and the aircraft does not change attitude).

[0124] As an example, while the throttle trigger is pressed, the position point is moved, and a frame can be drawn in the display interface within the frameable range to frame a region of interest, such as a frame of a shooting object or a frame of a tracking object.

[0125] In some examples, the framed shooting object can be obtained by the movable object, and the camera on the movable object can perform focusing, light measurement, temperature measurement, and the like on the shooting object. In some examples, the framed tracking object can be obtained by the movable object, and the movable object can continuously track the tracking object, for example, the movable object can maintain a preset orientation, height, distance, and the like with the tracking object, or the tracking object can be maintained at a preset position in the image captured by the movable object. The tracking object can be a stationary object or a moving object.

[0126] As an example, while the throttle trigger is pressed, the position point is moved, and the movement of the target object can be achieved in the display interface that can be dragged, such as moving the image position when the user views the image captured by the movable object in the display interface of the display device.

[0127] After the interface is selected, the forward-backward motion control is achieved to adjust the size of the interface. For example, the cursor in the large screen in the glasses is adjusted by selecting the large screen of the glasses interface with the laser pen, and the forward-backward motion control is achieved to change the size of the screen after the second trigger is pressed. The forward-backward motion control can also be a joystick on the forward-backward push motion control.

[0128] As an example, when a user previews a photo or a video stored in a display device, the playback control can be performed through the somatosensory control device; as another example, pressing the throttle trigger can pause or continue the playback, and pushing the throttle trigger can exit the playback; as another example, moving the position point while pressing the throttle trigger can adjust the playback progress; as another example, moving the position point to the arrow at the top of the display interface and pressing the throttle trigger can open the playback settings, such as setting the display interface brightness and the playback volume.

[0129] It should be noted that the above description of the somatosensory control device control scenario and the formed position point control scenario of one embodiment of the present application is only exemplary, and other control scenarios can exist in actual applications, which are not limited in particular.

[0130] 406. The somatosensory control device generates second attitude information in the control mode for the movable object;

[0131] As an example, the specific implementation of the somatosensory control device controlling the movable object by using the second attitude information can be that the somatosensory control device first generates the second attitude information, so that the movable object executes the corresponding response measures after finally receiving the second attitude information generated by the somatosensory control device.

[0132] 407. The somatosensory control device sends the second attitude information to the display device;

[0133] 408. The display device forwards the second attitude information sent by the somatosensory control device to the movable object;

[0134] As an example, the somatosensory control device can send the second attitude information to the display device through the first communication link, so that the display device forwards the second attitude information to the movable object through the second communication link, to control the movable object by using the second attitude information.

[0135] The display device can receive the first attitude information generated by the somatosensory control device in various ways. As an example, the somatosensory control device can directly send the first attitude information to the display device as described in step 404. As another example, the somatosensory control device can also send the first attitude information to the movable object through a third communication link, and the movable object can forward the first attitude information to the display device through a fourth communication link, so as to provide the somatosensory control device to control the display device by using the first attitude information.

[0136] When the display device receives the first attitude information generated by the somatosensory control device in the manner as described in step 404, that is, the somatosensory control device directly sends the first attitude information to the display device, as an example, the somatosensory control device can directly send the first attitude information to the display device by using the first communication link, and directly send the second attitude information to the movable object by using the third communication link.

[0137] As an example, the first communication link or the fourth communication link is a near field communication link, and the second communication link or the third communication link is a far field communication link.

[0138] For the case that the display device receives the second attitude information through the first communication link, and forwards the second attitude information to the movable object through the second communication link, since the somatosensory control device and the display device both belong to the user terminal, and the distance between them is relatively short, the communication between them can adopt a near field communication mode (that is, the first communication link is a near field communication link at this time), such as Bluetooth, WIFI communication mode; while the communication distance between the movable object and the display device is often relatively long, and the communication between them can adopt a far field communication mode (that is, the second communication link is a far field communication link at this time), such as SDR communication mode, mobile communication network such as 5G, 4G, 3G, etc. On the one hand, because the distance between the somatosensory control device and the display device is relatively short, the communication delay is low, so when the display device forwards the attitude information generated by the somatosensory control device to the movable object, the response of the movable object depends on the delay of the communication link between the display device and the movable object, so the picture displayed by the display device is closer to the response of the movable object to the somatosensory control device. On the other hand, when the display device is a flight glasses worn by the user, since the degree of freedom of the head is relatively low compared with the somatosensory control device, that is, when the user controls the movable object, the spatial orientation of the somatosensory control device may change greatly due to the movement of the hand, but the spatial orientation of the flight glasses changes less, therefore, if the somatosensory control device directly sends the attitude information to the movable object, the communication signal may be poor due to the large angle deviation between the antenna in the somatosensory control device and the antenna of the movable object caused by the large change in the orientation of the somatosensory control device, while the flight glasses change less in orientation, and the angle change between the antenna in the flight glasses and the antenna of the movable object will not be too large, so the communication between the flight glasses and the movable object will be relatively stable, therefore, by taking the flight glasses as a communication relay, the attitude information of the somatosensory control device is forwarded to the movable object, and the attitude information of the somatosensory control device for controlling the movable object is less likely to be unable to be sent to the movable object in time due to the easy change in the orientation of the somatosensory control device.

[0139] For the case that the somatosensory control device directly sends the first attitude information to the display device by using the first communication link and directly sends the second attitude information to the movable object by using the third communication link, the somatosensory control device can simultaneously send the first attitude information to the display device and the movable object by using the first communication link and the third communication link, or simultaneously send the second attitude information to the display device and the movable object by using the first communication link and the third communication link, and the display device and the movable object respectively determine whether the received attitude information is for the display device or the movable object. Since the display device and the movable object can both receive the somatosensory control device, when the somatosensory control device controls the display interface of the display device, the movable object does not think that the communication with the somatosensory control device is interrupted, and the movable object can avoid thinking that the communication with the somatosensory control device is interrupted for a long time because the movable object and the somatosensory control device can communicate normally. When the communication between the movable object and the somatosensory control device is interrupted, the movable object can return.

[0140] 409、The movable object performs a response measure corresponding to the second attitude information.

[0141] It can be understood that the movable object is an object that can move in a real space.

[0142] As an example, the display device can be configured to display information associated with the movable object on the display interface.

[0143] As an example, the information associated with the movable object can include at least one of a speed of the movable object, an acceleration of the movable object, a position of the movable object, and an environmental image collected by the movable object, without limitation.

[0144] The movable object can perform the response measure corresponding to the second attitude information in various manners. As an example, the movable object can change an attitude in response to the second attitude information.

[0145] Another embodiment of the somatosensory control device controlling the display device by using the generated attitude information will be described below. The embodiment specifically performs the process shown in FIG. 8. The somatosensory control device can generate attitude information in response to an attitude change of the somatosensory control device. Another embodiment of the control method provided in the present application can include:

[0146] 801、The somatosensory control device sends attitude information and control object information associated with the attitude information to the display device.

[0147] It can be understood that the somatosensory control device can generate attitude information in response to an attitude change of the somatosensory control device.

[0148] The somatosensory control device can send the posture information and the control object information associated with the posture information to the display device in various manners. The specific sending manners can refer to the content described in any of the above embodiments, and will not be described here.

[0149] 802. When the control object represented by the control object information is the display device, the display device performs a response measure corresponding to the posture information.

[0150] The display device can perform the response measure corresponding to the posture information in various manners. For example, the display device can configure a display interface of the display device based on the posture information.

[0151] The display device can configure the display interface of the display device based on the posture information generated by the somatosensory control device in various manners. The specific configuration manners can refer to the content described in any of the above embodiments, and will not be described here.

[0152] 803. When the control object represented by the control object information is an object other than the display device, the display device does not perform the response measure corresponding to the posture information.

[0153] The object other than the display device can have various specific implementations. For example, the object other than the display device can be a movable object, which is an object capable of moving in a real space. The object other than the display device is not specifically limited.

[0154] The somatosensory control device can control the display device and the movable object in various manners by using the generated posture information. Another embodiment of the control method provided by the somatosensory control device for controlling the display device by using the generated posture information will be described below. The specific implementation process can refer to FIG. 8. The somatosensory control device can generate posture information in response to a change in a posture of the somatosensory control device. One embodiment of the control method provided by the somatosensory control device can include the following steps.

[0155] Another embodiment of the control method provided by the somatosensory control device for controlling the display device by using the generated posture information will be described below. The specific implementation process can refer to FIG. 9. The somatosensory control device can generate posture information in response to a change in a posture of the somatosensory control device. Another embodiment of the control method provided by the somatosensory control device can include the following steps.

[0156] 901. The somatosensory control device sends posture information and control object information associated with the posture information to the display device.

[0157] It can be understood that the somatosensory control device can generate posture information in response to a change in a posture of the somatosensory control device.

[0158] The somatosensory control device can send the posture information and the control object information associated with the posture information to the display device in various manners. For details, refer to the description of any of the foregoing embodiments, which will not be repeated here.

[0159] 902. When the control object represented by the control object information is the display device, the display device performs a response measure corresponding to the posture information;

[0160] The display device can perform the response measure corresponding to the posture information in various manners. For example, the display device can configure a display interface of the display device based on the posture information.

[0161] The display device can configure the display interface of the display device based on the posture information generated by the somatosensory control device in various manners. For details, refer to the description of any of the foregoing embodiments, which will not be repeated here.

[0162] 903. When the control object represented by the control object information is a target object other than the display device, the posture information and the control object information are forwarded to the target object;

[0163] 904. The target object performs a response measure corresponding to the posture information.

[0164] The target object can have various implementations. For example, the target object can be a movable object, which is an object capable of moving in a real space.

[0165] When the target object is a movable object, the display device can forward the posture information and the control object information to the movable object in various manners. For details, refer to the description of any of the foregoing embodiments, which will not be repeated here.

[0166] The target object can perform the response measure corresponding to the posture information in various manners. For example, the target object can change posture in response to the posture information, which is not limited in particular.

[0167] Another embodiment of the somatosensory control device controlling a movable object by using generated posture information will be described below. For details of the implementation process, refer to FIG. 10. The somatosensory control device can generate posture information in response to a change in its own posture. Another embodiment of the control method provided in the present application can include the following steps.

[0168] 1001. The somatosensory control device sends posture information and control object information associated with the posture information to a movable object.

[0169] The somatosensory control device can send the posture information and the control object information associated with the posture information to the movable object in various manners. For details, refer to the description of any of the above embodiments. Here, no further description is provided.

[0170] 1002. When the control object represented by the control object information is the movable object, the movable object performs a response measure corresponding to the posture information.

[0171] The movable object can perform the response measure corresponding to the posture information in various manners. For example, the movable object is an object capable of moving in a real space. The movable object can change the posture in response to the posture information.

[0172] 1003. When the control object represented by the control object information is an object other than the movable object, the movable object does not perform the response measure corresponding to the posture information.

[0173] For example, the object other than the movable object is a display device.

[0174] Another embodiment of the somatosensory control device for controlling the display device and the movable object by using the generated posture information is described below. For details of the implementation process, refer to FIG. 11. This embodiment is applicable to a scenario in which the somatosensory control device controls the display device and the movable object. The somatosensory control device can generate posture information in response to a change in the posture of the somatosensory control device. Another embodiment of the control method provided in this application can include the following steps.

[0175] S1101. In response to the current state of the movable object being a first state, the control object to which the posture information generated by the somatosensory control device is the movable object.

[0176] S1102. In response to the current state of the movable object being a second state, the control object to which the posture information generated by the somatosensory control device is the display interface.

[0177] For example, the control mode for the display device and the control mode for the movable object can be automatically switched based on the current state of the movable object. For example, the movable object is an object capable of moving in a real space.

[0178] For example, the state information sent by the movable object is received to determine the current state of the movable object based on the state information.

[0179] For example, the state information includes the communication state of the movable object and / or the motion state of the movable object.

[0180] As an example, the movable object and the display device are communicatively connected, and the communication status includes the movable object and the display device being in a communicatively connected state or the movable object and the display device being in a communicatively disconnected state.

[0181] As an example, the first status includes the movable object and the display device being in a communicatively connected state, and the second status includes the movable object and the display device being in a communicatively connected state or the movable object and the display device being in a communicatively disconnected state.

[0182] As an example, the movable object includes a plurality of motion statuses, the first status includes the movable object being in a first motion status, and the second status includes the movable object being in a second motion status.

[0183] As an example, the movable object includes an aerial vehicle, the first motion status includes at least one of the aerial vehicle being in a propeller start-up, the aerial vehicle being in a take-off, the aerial vehicle being in a flight, the aerial vehicle being in a return, the aerial vehicle being in a landing, or the aerial vehicle having landed but not having stopped the propeller.

[0184] As an example, the second motion status includes the movable object being in a locked status in which the movable object stops moving.

[0185] As an example, the movable object includes an aerial vehicle, and the locked status includes the aerial vehicle being in a hovering status.

[0186] As an example, the motion status of the movable object is changeable based at least on an operation instruction of an operator of the movable object or a factor in a motion environment of the movable object.

[0187] As an example, the control mode of the motion control device is related to a user trigger instruction received by the motion control device.

[0188] As an example, the user trigger instruction includes a selection instruction of the user for the control mode of the motion control device or a switching instruction of the user for a status of the movable object.

[0189] As an example, the selection instruction includes a selection for a control mode of the display device or a selection for a control mode of the movable object.

[0190] As an example, the switching instruction includes a switching for a communication status of the movable object or a switching for a motion status of the movable object.

[0191] As an example, in response to a selection of a control mode for the display device, the current state of the movable object is switched from a first state to a second state when the current state of the movable object is in the first state.

[0192] As an example, the switching of the current state of the movable object from the first state to the second state includes:

[0193] The movable object is switched from the first motion state to the second motion state when the movable object is in the first motion state.

[0194] As an example, the pose information generated by the body-sensing control device is associated with control object information for causing the display device and the movable object to determine a control object to which the received pose information is directed, the control object being one of the display device and the movable object.

[0195] As an example, the control object information is generated by the body-sensing control device based on a current state of the movable object, the control object information is generated by the movable object based on a current state of the movable object, or the control object information is generated by the display device based on a current state of the movable object.

[0196] Please refer to FIG. 12-13, which shows an exemplary three-party communication control scenario of the somatosensory control device (the "somatosensory control" in the figure), the display device (for example, the flight glasses, and the "glasses GUI" is the display interface of the flight glasses), and the movable object (for example, the drone, and the "aircraft" in the figure). The posture information generated by the somatosensory control device can include a "stick amount", and the "laser pen" in FIG. 12-13 can be understood as a virtual laser pen formed by the somatosensory control device and the virtual ray emitted from the somatosensory control device as described above. As shown in FIG. 12-13, as an example, the flight control of the aircraft can send the flight state (flight control state) to the laser pen state management module through a far-field communication mode (such as S2 in FIG. 13), and the laser pen state management module can determine the state of the somatosensory control, i.e., the control mode of the somatosensory control device, according to the received flight state. The corresponding control object (aircraft or glasses GUI) can be written in the stick amount generated by the somatosensory control according to the control mode of the somatosensory control, as shown in FIG. 13. The stick amount generated by the somatosensory control can be sent to the glasses through a near-field communication mode (such as GFSK in FIG. 13), and converted into a cursor event of the glasses GUI through a laser pen space mapping mode. The stick amount generated by the somatosensory control can also be sent directly to the flight control of the aircraft through a far-field communication mode, or the glasses can forward the received stick amount to the flight control of the aircraft through a far-field communication. The specific implementation is not limited herein. The control object written in the stick amount generated by the somatosensory control can respond to the stick amount after receiving the stick amount.

[0197] The embodiment of the present application also provides a somatosensory control device, as shown in FIG. 14, the electronic device comprises:

[0198] a processor 1401;

[0199] a memory 1402 for storing processor-executable instructions;

[0200] The processor 1401 is configured to implement the control method described in any of the above embodiments.

[0201] As an example, the somatosensory control device comprises a remote controller capable of controlling the movable object.

[0202] The embodiment of the present application also provides a display device, as shown in FIG. 15, the electronic device comprises:

[0203] a processor 1501;

[0204] a memory 1502 for storing processor-executable instructions;

[0205] The processor 1501 is configured to implement the control method described in any of the above embodiments.

[0206] As an example, the display device comprises a head-mounted glasses.

[0207] The embodiment of the present application further provides a movable device, as shown in Fig. 16, which comprises:

[0208] a processor 1601;

[0209] a memory 1602 for storing processor-executable instructions;

[0210] The processor 1601 is configured to implement the control method described in any of the above embodiments.

[0211] As an example, the movable object comprises a drone, an unmanned vehicle, and an unmanned ship.

[0212] The embodiment of the present application further provides a control system, as shown in Fig. 17, which comprises the somatosensory control device 1701 described in any of the above embodiments, the display device 1702 described in any of the above embodiments, and the movable object 1703 described in any of the above embodiments. The somatosensory control device 1701 is capable of generating posture information in response to a change in its own posture. The movable object 1703 is an object capable of moving in a real space. Information associated with the movable object 1703 can be displayed on the display interface of the display device 1702.

[0213] The embodiment of the present application further provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the control method described in any of the above embodiments is implemented.

[0214] The above description is merely specific embodiments of the present application. It should be noted that, for those skilled in the art, without departing from the principle of the present application, a number of improvements and refinements can be made, which should also be considered as falling within the protection scope of the present application.

Claims

1. A control method, applied to a somatosensory control device, wherein the somatosensory control device is capable of generating posture information in response to its own posture changes, characterized in that: The method comprises: Get the current state of the movable object; Automatically switching a control mode for a display device and a control mode for the movable object based on a current state of the movable object; In a control mode for the display device, generating first posture information, and controlling a display interface of the display device using the first posture information; In a control mode for the movable object, second posture information is generated, and the movable object is controlled using the second posture information. The movable object is an object that can move in real space.

2. The method according to claim 1, characterized in that Automatically switching a control mode for a display device and a control mode for the movable object based on a current state of the movable object includes: In response to the current state of the movable object being the first state, the control object for which the posture information generated by the somatosensory control device is directed is the movable object; In response to the current state of the movable object being the second state, the control object targeted by the gesture information generated by the somatosensory control device is the display interface.

3. The method according to claim 2, characterized in that The method further comprises: The state information sent by the movable object is received to determine a current state of the movable object based on the state information.

4. The method according to claim 3, characterized in that The state information includes a communication state of the movable object and / or a motion state of the movable object.

5. The method according to claim 4, characterized in that The movable object and the display device are communicatively connected, and the communication state includes the movable object and the display device being in a communication connected state or the movable object and the display device being in a communication disconnected state.

6. The method according to claim 5, characterized in that The first state includes that the movable object and the display device are in a communication connection state; the second state includes that the movable object and the display device are in a communication connection state or that the movable object and the display device are in a communication disconnection state.

7. The method according to claim 4, characterized in that The movable object includes a plurality of motion states, the first state includes the movable object being in a first motion state, and the second state includes the movable object being in a second motion state.

8. The method according to claim 7, characterized in that The movable object includes an aircraft, and the first motion state includes at least one of the following: the aircraft is in the process of propeller rotation, the aircraft is in takeoff, the aircraft is in flight, the aircraft is returning, the aircraft is landing, or the aircraft has landed but has not stopped propeller rotation.

9. The method according to claim 7, characterized in that The second motion state includes the movable object being in a locked state, in which the movable object stops moving.

10. The method according to claim 9, characterized in that The movable object includes an aircraft, and the locked state includes the aircraft being in a hovering state.

11. The method according to claim 7, characterized in that The motion state of the movable object can be changed based on at least one of an operation instruction of an operator of the movable object and a motion environment of the movable object.

12. The method according to any one of claims 1 to 11, characterized in that The control mode of the somatosensory control device is related to a user triggering instruction received by the somatosensory control device.

13. The method according to claim 12, characterized in that The user trigger instruction includes a user's instruction to select a control mode of the somatosensory control device or a user's instruction to switch the state of the movable object.

14. The method according to claim 13, characterized in that The selection instruction includes selection of a control mode for the display device or selection of a control mode for the movable object.

15. The method according to claim 13, characterized in that The switching instruction includes switching the communication state of the movable object or switching the motion state of the movable object.

16. The method according to claim 14, characterized in that The method further comprises: In response to selection of a control mode for the display device, when the current state of the movable object is in the first state, the current state of the movable object is switched to the second state.

17. The method according to claim 16, characterized in that When the current state of the movable object is in the first state, switching the current state of the movable object to the second state includes: When the movable object is in the first motion state, the movable object is switched to the second motion state.

18. The method according to claim 1, wherein The first posture information and the second posture information are both associated with control object information, and the control object information is used to enable the display device and the movable object to determine the control object targeted by the received posture information, and the control object is one of the display device and the movable object.

19. The method according to claim 18, characterized in that The control object information is generated by the somatosensory control device based on the current state of the movable object, the control object information is generated by the movable object based on the current state of the movable object, or the control object information is generated by the display device based on the current state of the movable object.

20. The method according to claim 1, wherein The controlling the display interface of the display device by using the first posture information includes: A movable position point is formed on the display interface using the first posture information, so as to control the display interface using the position point.

21. The method according to claim 20, characterized in that The method further comprises: When a calibration instruction for the position point is detected, the position point is calibrated to a preset position of the display interface.

22. The method according to claim 20, characterized in that The method further comprises: When the control mode for the movable object is switched to the control mode for the display device, a dynamic position point is generated on the display interface, and / or the position point is displayed at a preset position on the display interface.

23. The method according to claim 21 or 22, characterized in that The preset position is the center position of the display interface.

24. The method according to claim 21, characterized in that The location point is displayed on the display interface using a preset symbol.

25. The method according to claim 20, wherein The controlling the display interface by using the position point includes: In response to a change in the posture of the somatosensory control device, controlling the position point to move to an area of ​​interest in the display interface; and / or, In response to the posture change of the somatosensory control device, the target object in the display interface is controlled to move along with the movement of the position point.

26. The method according to claim 25, characterized in that The method further comprises: When the position point is located in the region of interest of the display interface, in response to an object control command of a user, an object in the region of interest is controlled to execute a corresponding object control command.

27. The method according to claim 26, characterized in that The controlling the object in the region of interest to execute a corresponding object control command includes: Control the object to execute at least one of a confirmation command, a quit command, a selection command, a play command, and a pause command.

28. The method according to claim 1, wherein The controlling the display interface of the display device by using the first posture information includes: Control the scaling of a display interface of the display device, and / or control the scaling of objects within the display interface.

29. The method according to claim 28, characterized in that The object in the display interface includes a virtual screen, and controlling the scaling of the object in the display interface includes: controlling the scaling of the virtual screen, and / or controlling the scaling of content displayed in the virtual screen.

30. The method according to claim 1, wherein The controlling the movable object by using the second posture information includes: The second posture information is sent to the display device through the first communication link, so that the display device forwards the second posture information to the movable object through the second communication link, so as to control the movable object using the second posture information.

31. The method according to claim 1, wherein The controlling the display interface of the display device by using the first posture information includes: The first posture information is sent to the movable object through a third communication link, so that the movable object forwards the first posture information to the display device through a fourth communication link, so as to control the display device using the first posture information.

32. The method according to claim 1, wherein The first posture information is sent to the display device using a first communication link, and the second posture information is sent to the movable object using a third communication link.

33. The method according to any one of claims 30 to 32, characterized in that The first communication link or the fourth communication link is a near-field communication link, and the second communication link or the third communication link is a far-field communication link.

34. The method according to claim 1, wherein The display device is configured to display information associated with the movable object on the display interface.

35. The method according to claim 34, wherein The information associated with the movable object includes at least one of a speed of the movable object, an acceleration of the movable object, a position of the movable object, and an environment image captured by the movable object.

36. A control method, applied to a display device, characterized in that: The method comprises: receiving first posture information sent by a somatosensory control device, and configuring a display interface of the display device based on the first posture information, wherein the somatosensory control device is capable of generating posture information in response to changes in its own posture; Receive second posture information sent by the somatosensory control device, and forward the second posture information to a movable object, so that the somatosensory control device uses the second posture information to control the movable object, where the movable object is an object that can move in real space.

37. The method according to claim 36, wherein The somatosensory control device provides a control mode for the display device and a control mode for the movable object; the control mode of the somatosensory control device is related to the current state of the movable object, wherein: In response to the current state of the movable object being the first state, the control object targeted by the gesture information sent by the somatosensory control device is the movable object; In response to the current state of the movable object being the second state, the control object targeted by the gesture information sent by the somatosensory control device is the display interface.

38. The method according to claim 37, wherein The method further comprises: The state information sent by the movable object is received to determine a current state of the movable object based on the state information.

39. The method according to claim 38, characterized in that The state information includes a communication state of the movable object and / or a motion state of the movable object.

40. The method according to claim 39, wherein The movable object and the display device are communicatively connected, and the communication state includes the movable object and the display device being in a communication connected state or the movable object and the display device being in a communication disconnected state.

41. The method according to claim 40, characterized in that The first state includes that the movable object and the display device are in a communication connection state; the second state includes that the movable object and the display device are in a communication connection state or that the movable object and the display device are in a communication disconnection state.

42. The method according to claim 39, wherein The movable object includes a plurality of motion states, the first state includes the movable object being in a first motion state, and the second state includes the movable object being in a second motion state.

43. The method according to claim 42, characterized in that The movable object includes an aircraft, and the first motion state includes at least one of the following: the aircraft is in the process of propeller rotation, the aircraft is in takeoff, the aircraft is in flight, the aircraft is returning, the aircraft is landing, or the aircraft has landed but has not stopped propeller rotation.

44. The method according to claim 42, wherein The second motion state includes the movable object being in a locked state, in which the movable object stops moving.

45. The method according to claim 44, wherein The movable object includes an aircraft, and the locked state includes the aircraft being in a hovering state.

46. ​​The method according to claim 42, wherein The motion state of the movable object can be changed based on at least one of an operation instruction of an operator of the movable object and a factor in the motion environment of the movable object.

47. The method according to any one of claims 37 to 46, wherein: The control mode of the somatosensory control device is related to a user triggering instruction received by the somatosensory control device.

48. The method according to claim 47, wherein The user trigger instruction includes a user's instruction to select a control mode of the somatosensory control device or a user's instruction to switch the state of the movable object.

49. The method according to claim 48, characterized in that The selection instruction includes selection of a control mode for the display device or selection of a control mode for the movable object.

50. The method according to claim 48, wherein The switching instruction includes switching the communication state of the movable object or switching the motion state of the movable object.

51. The method according to claim 49, wherein The method further comprises: In response to selection of a control mode for the display device, when the current state of the movable object is in the first state, the current state of the movable object is switched to the second state.

52. The method according to claim 51, characterized in that When the current state of the movable object is in the first state, switching the current state of the movable object to the second state includes: When the movable object is in the first motion state, the movable object is switched to the second motion state.

53. The method according to claim 36, wherein The first posture information and the second posture information are both associated with control object information, and the control object information is used to enable the display device and the movable object to determine the control object targeted by the received posture information, and the control object is one of the display device and the movable object.

54. The method according to claim 53, wherein The control object information is generated by the somatosensory control device based on the current state of the movable object, the control object information is generated by the movable object based on the current state of the movable object, or the control object information is generated by the display device based on the current state of the movable object.

55. The method according to claim 36, wherein The configuring a display interface of the display device based on the first posture information includes: A movable position point is formed on the display interface based on the first posture information, so as to configure the display interface based on the position point.

56. The method according to claim 55, characterized in that The method further comprises: When a calibration instruction for the position point is detected, the position point is calibrated to a preset position of the display interface.

57. The method according to claim 55, characterized in that The method further comprises: When the control mode for the movable object is switched to the control mode for the display device, a dynamic position point is generated on the display interface, and / or the position point is displayed at a preset position on the display interface.

58. The method according to claim 56 or 57, characterized in that The preset position is the center position of the display interface.

59. The method according to claim 56, characterized in that The location point is displayed on the display interface using a preset symbol.

60. The method according to claim 55, wherein The configuring the display interface based on the location point includes: In response to a change in the posture of the somatosensory control device, controlling the position point to move to an area of ​​interest in the display interface; and / or, In response to the posture change of the somatosensory control device, the target object in the display interface is controlled to move along with the movement of the position point.

61. The method according to claim 60, characterized in that The method further comprises: When the position point is located in the region of interest of the display interface, in response to an object control command of a user, an object in the region of interest is controlled to execute a corresponding object control command.

62. The method according to claim 61, characterized in that The controlling the object in the region of interest to execute a corresponding object control command includes: Control the object to execute at least one of a confirmation command, a quit command, a selection command, a play command, and a pause command.

63. The method according to claim 36, wherein The configuring a display interface of the display device based on the first posture information includes: Control the scaling of a display interface of the display device, and / or control the scaling of objects within the display interface.

64. The method according to claim 63, wherein The object in the display interface includes a virtual screen, and controlling the scaling of the object in the display interface includes: controlling the scaling of the virtual screen, and / or controlling the scaling of content displayed in the virtual screen.

65. The method according to claim 36, wherein The enabling the somatosensory control device to control the movable object using the second posture information includes: The second posture information is received through the first communication link, and the second posture information is forwarded to the movable object through the second communication link, so that the somatosensory control device controls the movable object using the second posture information.

66. The method according to claim 36, wherein The first posture information is sent by the somatosensory control device to the movable object through a third communication link, and configuring the display interface of the display device based on the first posture information includes: The first posture information forwarded by the movable object is received through a fourth communication link, so as to configure the display interface based on the first posture information.

67. The method according to claim 36, wherein The first posture information is received from the motion control device using a first communication link.

68. The method according to any one of claims 65 to 67, wherein: The first communication link or the fourth communication link is a near-field communication link, and the second communication link or the third communication link is a far-field communication link.

69. The method according to claim 36, wherein The display device is configured to display information associated with the movable object on the display interface.

70. The method according to claim 69, wherein The information associated with the movable object includes at least one of a speed of the movable object, an acceleration of the movable object, a position of the movable object, and an environment image captured by the movable object.

71. A control method, applied to a display device, characterized in that: The method comprises: receiving posture information and control object information associated with the posture information sent by a somatosensory control device, wherein the somatosensory control device is capable of generating posture information in response to a change in its own posture; When the control object represented by the control object information is the display device, executing a response measure corresponding to the posture information; When the control object represented by the control object information is an object other than the display device, the response measure corresponding to the gesture information is not executed.

72. The method according to claim 71, characterized in that The executing of a response measure corresponding to the posture information includes: A display interface of the display device is configured based on the posture information.

73. The method according to claim 72, characterized in that The object outside the display device is a movable object, and the movable object is an object that can move in real space.

74. The method according to claim 73, characterized in that The somatosensory control device provides a control mode for the display device and a control mode for the movable object; the control mode of the somatosensory control device is related to the current state of the movable object, wherein: In response to the current state of the movable object being the first state, the control object targeted by the gesture information sent by the somatosensory control device is the movable object; In response to the current state of the movable object being the second state, the control object targeted by the gesture information sent by the somatosensory control device is the display interface.

75. The method according to claim 74, wherein The method further comprises: The state information sent by the movable object is received to determine a current state of the movable object based on the state information.

76. The method according to claim 75, characterized in that The state information includes a communication state of the movable object and / or a motion state of the movable object.

77. The method according to claim 76, characterized in that The movable object and the display device are communicatively connected, and the communication state includes the movable object and the display device being in a communication connected state or the movable object and the display device being in a communication disconnected state.

78. The method according to claim 77, characterized in that The first state includes that the movable object and the display device are in a communication connection state; the second state includes that the movable object and the display device are in a communication connection state or that the movable object and the display device are in a communication disconnection state.

79. The method according to claim 76, characterized in that The movable object includes a plurality of motion states, the first state includes the movable object being in a first motion state, and the second state includes the movable object being in a second motion state.

80. The method according to claim 79, wherein The movable object includes an aircraft, and the first motion state includes at least one of the following: the aircraft is in the process of propeller rotation, the aircraft is in takeoff, the aircraft is in flight, the aircraft is returning, the aircraft is landing, or the aircraft has landed but has not stopped propeller rotation.

81. The method according to claim 79, wherein The second motion state includes the movable object being in a locked state, in which the movable object stops moving.

82. The method according to claim 81, characterized in that The movable object includes an aircraft, and the locked state includes the aircraft being in a hovering state.

83. The method according to claim 79, wherein The motion state of the movable object can be changed based on at least one of an operation instruction of an operator of the movable object and a factor in the motion environment of the movable object.

84. The method according to any one of claims 73 to 83, wherein The control mode of the somatosensory control device is related to a user triggering instruction received by the somatosensory control device.

85. The method according to claim 84, characterized in that The user trigger instruction includes a user's instruction to select a control mode of the somatosensory control device or a user's instruction to switch the state of the movable object.

86. The method according to claim 85, characterized in that The selection instruction includes selection of a control mode for the display device or selection of a control mode for the movable object.

87. The method according to claim 85, characterized in that The switching instruction includes switching the communication state of the movable object or switching the motion state of the movable object.

88. The method according to claim 86, characterized in that The method further comprises: In response to selection of a control mode for the display device, when the current state of the movable object is in the first state, the current state of the movable object is switched to the second state.

89. The method according to claim 88, characterized in that When the current state of the movable object is in the first state, switching the current state of the movable object to the second state includes: When the movable object is in the first motion state, the movable object is switched to the second motion state.

90. The method of claim 73, wherein: The control target information is generated by the body sensing control device based on the current state of the movable object, and the control target information is generated by the movable object based on the current state of the movable object.

91. The method according to claim 73, wherein The configuring a display interface of the display device based on the posture information includes: A movable position point is formed on the display interface based on the posture information, so as to configure the display interface based on the position point.

92. The method according to claim 91, wherein The method further comprises: When a calibration instruction for the position point is detected, the position point is calibrated to a preset position of the display interface.

93. The method according to claim 91, wherein The method further comprises: When the control mode for the movable object is switched to the control mode for the display device, a dynamic position point is generated on the display interface, and / or the position point is displayed at a preset position on the display interface.

94. The method according to claim 92 or 93, characterized in that The preset position is the center position of the display interface.

95. The method according to claim 92, wherein The location point is displayed on the display interface using a preset symbol.

96. The method according to claim 91, characterized in that The configuring the display interface based on the location point includes: In response to a change in the posture of the somatosensory control device, controlling the position point to move to an area of ​​interest in the display interface; and / or, In response to the posture change of the somatosensory control device, the target object in the display interface is controlled to move along with the movement of the position point.

97. The method according to claim 96, characterized in that The method further comprises: When the position point is located in the region of interest of the display interface, in response to an object control command of a user, an object in the region of interest is controlled to execute a corresponding object control command.

98. The method according to claim 97, wherein The controlling the object in the region of interest to execute a corresponding object control command includes: Control the object to execute the confirmation command, control the object to execute the exit command, control the object to execute the box The device controls the object to execute at least one of a selection command, a play command, and a pause command.

99. The method according to claim 72, wherein The configuring a display interface of the display device based on the posture information includes: Control the scaling of a display interface of the display device, and / or control the scaling of objects within the display interface.

100. The method according to claim 99, wherein The object in the display interface includes a virtual screen, and controlling the scaling of the object in the display interface includes: controlling the scaling of the virtual screen, and / or controlling the scaling of content displayed in the virtual screen.

101. The method according to claim 73, characterized in that The posture information is sent by the somatosensory control device to the movable object through a third communication link, and configuring the display interface of the display device based on the posture information includes: The posture information forwarded by the movable object is received through a fourth communication link, so as to configure the display interface based on the posture information.

102. The method according to claim 71, wherein The posture information is received from the motion control device using a first communication link.

103. The method according to claim 101 or 102, characterized in that The first communication link or the fourth communication link is a near-field communication link, and the third communication link is a far-field communication link.

104. The method according to claim 73, characterized in that The display device is configured to display information associated with the movable object on the display interface.

105. The method according to claim 104, characterized in that The information associated with the movable object includes at least one of a speed of the movable object, an acceleration of the movable object, a position of the movable object, and an environment image captured by the movable object.

106. A control method, applied to a display device, characterized in that: The method comprises: receiving posture information and control object information associated with the posture information sent by a somatosensory control device, wherein the somatosensory control device is capable of generating posture information in response to a change in its own posture; When the control object represented by the control object information is the display device, executing a response measure corresponding to the posture information; When the control object represented by the control object information is a target object other than the display device, the gesture information and the control object information are forwarded to the target object, so that the target object executes a response measure corresponding to the gesture information.

107. The method according to claim 106, characterized in that When the control object represented by the control object information is the display device, executing a response measure corresponding to the posture information includes: A display interface of the display device is configured based on the posture information.

108. The method according to claim 107, characterized in that The target object is a movable object, which is an object that can move in real space.

109. The method according to claim 108, characterized in that The target object executes a response measure corresponding to the gesture information, including: The target object changes its posture in response to the posture information.

110. The method according to claim 109, characterized in that The somatosensory control device provides a control mode for the display device and a control mode for the movable object; the control mode of the somatosensory control device is related to the current state of the movable object, wherein: In response to the current state of the movable object being the first state, the control object targeted by the gesture information sent by the somatosensory control device is the movable object; In response to the current state of the movable object being the second state, the control object targeted by the gesture information sent by the somatosensory control device is the display interface.

111. The method according to claim 110, characterized in that The method further comprises: The state information sent by the movable object is received to determine a current state of the movable object based on the state information.

112. The method according to claim 111, characterized in that The state information includes a communication state of the movable object and / or a motion state of the movable object.

113. The method according to claim 112, characterized in that The movable object and the display device are communicatively connected, and the communication state includes the movable object and the display device being in a communication connected state or the movable object and the display device being in a communication disconnected state.

114. The method according to claim 113, characterized in that The first state includes that the movable object and the display device are in a communication connection state; the second state includes that the movable object and the display device are in a communication connection state or that the movable object and the display device are in a communication disconnection state.

115. The method according to claim 112, characterized in that The movable object includes a plurality of motion states, the first state includes the movable object being in a first motion state, and the second state includes the movable object being in a second motion state.

116. The method according to claim 115, characterized in that The movable object includes an aircraft, and the first motion state includes at least one of the following: the aircraft is in the process of propeller rotation, the aircraft is in takeoff, the aircraft is in flight, the aircraft is returning, the aircraft is landing, or the aircraft has landed but has not stopped propeller rotation.

117. The method according to claim 115, characterized in that The second motion state includes the movable object being in a locked state, in which the movable object stops moving.

118. The method according to claim 117, characterized in that The movable object includes an aircraft, and the locked state includes the aircraft being in a hovering state.

119. The method according to claim 115, characterized in that The motion state of the movable object can be changed based on at least one of an operation instruction of an operator of the movable object and a factor in the motion environment of the movable object.

120. The method according to any one of claims 109 to 119, wherein: The control mode of the somatosensory control device is related to a user triggering instruction received by the somatosensory control device.

121. The method according to claim 120, characterized in that The user trigger instruction includes a user's instruction to select a control mode of the somatosensory control device or a user's instruction to switch the state of the movable object.

122. The method according to claim 121, characterized in that The selection instruction includes selection of a control mode for the display device or selection of a control mode for the movable object.

123. The method according to claim 121, characterized in that The switching instruction includes switching the communication state of the movable object or switching the motion state of the movable object.

124. The method according to claim 122, characterized in that The method further comprises: In response to selection of a control mode for the display device, when the current state of the movable object is in the first state, the current state of the movable object is switched to the second state.

125. The method according to claim 124, characterized in that When the current state of the movable object is in the first state, switching the current state of the movable object to the second state includes: When the movable object is in the first motion state, the movable object is switched to the second motion state.

126. The method according to claim 108, wherein The control target information is generated by the body sensing control device based on the current state of the movable object, and the control target information is generated by the movable object based on the current state of the movable object.

127. The method according to claim 108, characterized in that The configuring a display interface of the display device based on the posture information includes: Based on the posture information, a movable position point is formed on the display interface, and a Set the display interface.

128. The method according to claim 127, characterized in that The method further comprises: When a calibration instruction for the position point is detected, the position point is calibrated to a preset position of the display interface.

129. The method according to claim 127, characterized in that The method further comprises: When the control mode for the movable object is switched to the control mode for the display device, a dynamic position point is generated on the display interface, and / or the position point is displayed at a preset position on the display interface.

130. The method according to claim 128 or 129, characterized in that The preset position is the center position of the display interface.

131. The method according to claim 128, wherein The location point is displayed on the display interface using a preset symbol.

132. The method according to claim 127, characterized in that The configuring the display interface based on the location point includes: In response to a change in the posture of the somatosensory control device, controlling the position point to move to an area of ​​interest in the display interface; and / or, In response to the posture change of the somatosensory control device, the target object in the display interface is controlled to move along with the movement of the position point.

133. The method according to claim 132, characterized in that The method further comprises: When the position point is located in the region of interest of the display interface, in response to an object control command of a user, an object in the region of interest is controlled to execute a corresponding object control command.

134. The method according to claim 133, characterized in that The controlling the object in the region of interest to execute a corresponding object control command includes: Control the object to execute at least one of a confirmation command, a quit command, a selection command, a play command, and a pause command.

135. The method according to claim 107, characterized in that The configuring a display interface of the display device based on the posture information includes: Control the scaling of a display interface of the display device, and / or control the scaling of objects within the display interface.

136. The method according to claim 135, characterized in that The object in the display interface includes a virtual screen, and controlling the scaling of the object in the display interface includes: controlling the scaling of the virtual screen, and / or controlling the scaling of content displayed in the virtual screen.

137. The method according to claim 106, characterized in that The causing the target object to execute a response measure corresponding to the posture information includes: The posture information and the control object information are received through a first communication link, and the posture information and the control object information are forwarded to the target object through a second communication link, so that the target object executes a response measure corresponding to the posture information.

138. The method according to claim 106, characterized in that The posture information and the control object information are received from the somatosensory control device using a first communication link, and the posture information and the control object information are forwarded to the target object using a third communication link.

139. The method according to claim 137 or 138, characterized in that The first communication link is a near-field communication link, and the second communication link or the third communication link is a far-field communication link.

140. The method according to claim 108, wherein The display device is configured to display information associated with the movable object on the display interface.

141. The method according to claim 140, characterized in that The information associated with the movable object includes at least one of a speed of the movable object, an acceleration of the movable object, a position of the movable object, and an environment image captured by the movable object.

142. A control method, applied to a movable object, characterized in that: The method comprises: receiving posture information and control object information associated with the posture information sent by a somatosensory control device, wherein the somatosensory control device is capable of generating posture information in response to a change in its own posture; When the control object represented by the control object information is the movable object, executing a response measure corresponding to the posture information; When the control object represented by the control object information is an object other than the movable object, the response measure corresponding to the posture information is not executed.

143. The method according to claim 142, characterized in that The movable object is an object that can move in real space, and the executing a response measure corresponding to the posture information includes: A posture change is performed in response to the posture information.

144. The method according to claim 143, characterized in that The object other than the movable object is a display device.

145. The method according to claim 144, characterized in that The somatosensory control device provides a control mode for the display device and a control mode for the movable object; the control mode of the somatosensory control device is related to the current state of the movable object, wherein: In response to the current state of the movable object being the first state, the control object targeted by the gesture information sent by the somatosensory control device is the movable object; In response to the current state of the movable object being the second state, the control object targeted by the gesture information sent by the somatosensory control device is the display interface.

146. The method according to claim 145, characterized in that The method further comprises: The state information of the movable object is sent to the motion sensing control device, so that the motion sensing control device determines the current state of the movable object based on the state information.

147. The method according to claim 146, characterized in that The state information includes a communication state of the movable object and / or a motion state of the movable object.

148. The method according to claim 147, characterized in that The movable object and the display device are communicatively connected, and the communication state includes the movable object and the display device being in a communication connected state or the movable object and the display device being in a communication disconnected state.

149. The method according to claim 148, characterized in that The first state includes that the movable object and the display device are in a communication connection state; the second state includes that the movable object and the display device are in a communication connection state or that the movable object and the display device are in a communication disconnection state.

150. The method according to claim 147, characterized in that The movable object includes a plurality of motion states, the first state includes the movable object being in a first motion state, and the second state includes the movable object being in a second motion state.

151. The method according to claim 150, characterized in that The movable object includes an aircraft, and the first motion state includes at least one of the following: the aircraft is in the process of propeller rotation, the aircraft is in takeoff, the aircraft is in flight, the aircraft is returning, the aircraft is landing, or the aircraft has landed but has not stopped propeller rotation.

152. The method according to claim 150, characterized in that The second motion state includes the movable object being in a locked state, in which the movable object stops moving.

153. The method according to claim 152, characterized in that The movable object includes an aircraft, and the locked state includes the aircraft being in a hovering state.

154. The method according to claim 150, characterized in that The motion state of the movable object can be changed based on at least one of an operation instruction of an operator of the movable object and a factor in the motion environment of the movable object.

155. The method according to any one of claims 145 to 154, wherein: The control mode of the somatosensory control device is related to a user triggering instruction received by the somatosensory control device.

156. The method according to claim 155, characterized in that The user trigger instruction includes a user's instruction to select a control mode of the somatosensory control device or a user's instruction to switch the state of the movable object.

157. The method according to claim 156, characterized in that The selection instruction includes selection of a control mode for the display device or selection of a control mode for the movable object.

158. The method according to claim 156, characterized in that The switching instruction includes switching the communication state of the movable object or switching the motion state of the movable object.

159. The method according to claim 157, characterized in that The method further comprises: In response to selection of a control mode for the display device, when the current state of the movable object is in the first state, the current state of the movable object is switched to the second state.

160. The method according to claim 159, wherein When the current state of the movable object is in the first state, switching the current state of the movable object to the second state includes: When the movable object is in the first motion state, the movable object is switched to the second motion state.

161. The method according to claim 144, characterized in that The control object information is generated by the motion control device based on the current state of the movable object, or the control object information is generated by the display device based on the current state of the movable object.

162. The method according to claim 144, characterized in that The posture information and the control object information are sent by the somatosensory control device to the display device through the first communication link and then forwarded by the display device through the second communication link.

163. The method according to claim 142, characterized in that The posture information and the control object information are received from the somatosensory control device using a third communication link.

164. The method according to claim 162 or 163, characterized in that The first communication link is a near-field communication link, and the second communication link or the third communication link is a far-field communication link.

165. A control method, characterized in that: Applicable to scenarios where a motion control device controls a display device and a movable object respectively, the motion control device is capable of generating posture information in response to its own posture changes, and the method includes: In response to the current state of the movable object being the first state, the control object for which the posture information generated by the somatosensory control device is directed is the movable object; In response to the current state of the movable object being the second state, the control object targeted by the gesture information generated by the somatosensory control device is the display interface.

166. The method according to claim 165, characterized in that The movable object is an object that can move in real space.

167. The method according to claim 166, characterized in that The method further comprises: The state information sent by the movable object is received to determine a current state of the movable object based on the state information.

168. The method according to claim 167, characterized in that The state information includes a communication state of the movable object and / or a motion state of the movable object.

169. The method according to claim 168, characterized in that The movable object and the display device are communicatively connected, and the communication state includes the movable object and the display device being in a communication connected state or the movable object and the display device being in a communication disconnected state.

170. The method according to claim 169, characterized in that The first state includes that the movable object and the display device are in a communication connection state; the second state includes that the movable object and the display device are in a communication connection state or that the movable object and the display device are in a communication disconnection state.

171. The method according to claim 168, characterized in that The movable object includes a plurality of motion states, the first state includes the movable object being in a first motion state, and the second state includes the movable object being in a second motion state.

172. The method according to claim 171, characterized in that The movable object includes an aircraft, and the first motion state includes at least one of the following: the aircraft is in the process of propeller rotation, the aircraft is in takeoff, the aircraft is in flight, the aircraft is returning, the aircraft is landing, or the aircraft has landed but has not stopped propeller rotation.

173. The method according to claim 171, characterized in that The second motion state includes the movable object being in a locked state, in which the movable object stops moving.

174. The method according to claim 173, characterized in that The movable object includes an aircraft, and the locked state includes the aircraft being in a hovering state.

175. The method according to claim 171, characterized in that The motion state of the movable object can be changed based on at least one of an operation instruction of an operator of the movable object and a factor in the motion environment of the movable object.

176. The method according to any one of claims 165-175, characterized in that The control mode of the somatosensory control device is related to a user triggering instruction received by the somatosensory control device.

177. The method according to claim 176, characterized in that The user trigger instruction includes a user's instruction to select a control mode of the somatosensory control device or a user's instruction to switch the state of the movable object.

178. The method according to claim 177, characterized in that The selection instruction includes selection of a control mode for the display device or selection of a control mode for the movable object.

179. The method according to claim 177, characterized in that The switching instruction includes switching the communication state of the movable object or switching the motion state of the movable object.

180. The method according to claim 178, characterized in that The method further comprises: In response to selection of a control mode for the display device, when the current state of the movable object is in the first state, the current state of the movable object is switched to the second state.

181. The method according to claim 180, characterized in that When the current state of the movable object is in the first state, switching the current state of the movable object to the second state includes: When the movable object is in the first motion state, the movable object is switched to the second motion state.

182. The method according to claim 165, characterized in that The posture information generated by the somatosensory control device is associated with the control object information, and the control object information is used to enable the display device and the movable object to determine the control object targeted by the received posture information, and the control object is one of the display device and the movable object.

183. The method according to claim 182, characterized in that The control object information is generated by the somatosensory control device based on the current state of the movable object, the control object information is generated by the movable object based on the current state of the movable object, or the control object information is generated by the display device based on the current state of the movable object.

184. A somatosensory control device, characterized in that include: processor; a memory for storing processor-executable instructions; The processor is configured to implement the method according to any one of claims 1 to 35.

185. The somatosensory control device according to claim 184, characterized in that: The somatosensory control device includes a remote controller, and the remote controller is capable of controlling the movable object.

186. A display device, characterized in that include: processor; a memory for storing processor-executable instructions; The processor is configured to implement the method of any one of claims 36 to 141.

187. The display device of claim 186, wherein: The display device includes head-mounted glasses.

188. A movable object, characterized in that: include: processor; a memory for storing processor-executable instructions; Wherein, the processor is configured to implement the method of any one of claims 142 to 183.

189. The movable object according to claim 188, characterized in that The movable objects include drones, unmanned vehicles, and unmanned ships.

190. A control system, characterized in that: It includes the somatosensory control device described in claim 184, the display device described in claim 186, and the movable object described in claim 188, the somatosensory control device can generate posture information in response to its own posture changes, the movable object is an object that can move in real space, and the information associated with the movable object can be displayed on the display interface of the display device.

191. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 183 are implemented.

Images